Thursday, 2024-08-01

-@gerrit:opendev.org- Zuul merged on behalf of Benedikt Löffler: [zuul/nodepool] 925320: Support AWS IMDSv2 in fleet API https://review.opendev.org/c/zuul/nodepool/+/92532008:46
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 925476: Fix wrong blob cleanup for items w/o job graph https://review.opendev.org/c/zuul/zuul/+/92547612:13
@tristanc_:matrix.orgHello folks, our users are worried that a change with a depends-on on GitHub is able to trigger a rate limit, effectively causing a zuul denial of service. This just happened because of https://review.opendev.org/c/openstack/neutron/+/925446 , even though the neutron repository is configured to not include any zuul config in our tenants config.12:14
@tristanc_:matrix.orgWould it be possible to improve the scheduler to avoid consuming api credits in such a case, or limit the impact of a rate limit to this single buildset?12:15
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 925476: Fix wrong blob cleanup for items w/o job graph https://review.opendev.org/c/zuul/zuul/+/92547612:18
-@gerrit:opendev.org- Benjamin Schanzel proposed: [zuul/zuul] 924067: Add filtering support for pipeline status views https://review.opendev.org/c/zuul/zuul/+/92406712:36
@jim:acmegating.commordred: usually just racy tests; the whole suite tends to fail catastrophically if some of the individual tests have a timeout. finding and fixing those is difficult.13:45
@jim:acmegating.comClark: https://review.opendev.org/921637 is needed for ansible 9; the js lint jobs (and likely others) are broken without it13:45
@jim:acmegating.comthat's failing with this: https://zuul.opendev.org/t/zuul/build/9704247d140a44e68fa789f27b1e6e62/console14:00
@jim:acmegating.comit's failing to install ansible 8 in a tox environment on an ubuntu focal node14:01
@jim:acmegating.comhttps://zuul.opendev.org/t/zuul/builds?job_name=zuul-jobs-test-fetch-sphinx-tarball-ubuntu-focal&project=zuul/zuul-jobs14:01
@jim:acmegating.comthe build history for that job says it worked until early june, then stopped14:01
@jim:acmegating.comi can reproduce that in a local focal docker container14:01
@jim:acmegating.comwas there a setuptools/pip/something change around then that might be involved?14:02
@clarkb:matrix.orgcorvus: I guess that was an optimization to speed up those tasks. One odd thing is my example from yesterday ran nox jobs successfully but the nox role also gets this cleanup so maybe it isn't always fatal?14:03
@jim:acmegating.com`8.0.0 Requires-Python >=3.9;`  (from the failing focal job -- that seems unlikely to have changed retroactively?)14:03
@jim:acmegating.comClark: there's a "when nox_constraints_file is defined" on the nox task14:04
@jim:acmegating.comprobably tox too14:04
@jim:acmegating.comso that may be why we're only seeing it on js jobs in the zuul project14:04
@clarkb:matrix.orgcorvus: the error in that job appears to come from pip and ya it's saying the python version isn't valid14:05
@clarkb:matrix.orgAh that makes sense for why bindep was fine 14:05
@jim:acmegating.comright, and the python version being invalid seems like a really weird thing to start happening 2 monhs ago14:05
@clarkb:matrix.orgMaybe we changed the Ansible version. In fact I bet that's it14:06
@clarkb:matrix.orgBut this job didn't run when we did so?14:06
@jim:acmegating.comoh yeah, bet so14:06
@clarkb:matrix.orgWe could use python_version markers to run with older Ansible on focal/python3.814:07
@jim:acmegating.comyep Icd563def65dcfd40b174218cc4e2b94e0230c37414:07
@clarkb:matrix.orgOr drop the job and call jammy good enough14:07
@jim:acmegating.comansible>=6,<9;python_version<'3.9'14:09
ansible>=8,<9;python_version>='3.9'
@jim:acmegating.comsomething like that?14:09
@clarkb:matrix.orgYa assuming Ansible 6 is old enough to work on python 3.814:10
@jim:acmegating.comyeah i just took a guess14:10
@jim:acmegating.comi think i'll squash that into lukas's change14:11
@clarkb:matrix.orgWorks for me14:12
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed on behalf of Lukas Kranz: [zuul/zuul-jobs] 921637: Remove get_md5 parameter from stat module. https://review.opendev.org/c/zuul/zuul-jobs/+/92163714:13
@jim:acmegating.comyay we will run many more tests now.  :|14:15
@clarkb:matrix.orgoh heh I just approved it so I guess we'll see if those extra tests pass14:16
-@gerrit:opendev.org- Zuul merged on behalf of Lukas Kranz: [zuul/zuul-jobs] 921637: Remove get_md5 parameter from stat module. https://review.opendev.org/c/zuul/zuul-jobs/+/92163714:28
@jim:acmegating.comhuzzah14:28
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 925506: Add test for blobstore cleanup fix https://review.opendev.org/c/zuul/zuul/+/92550615:41
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 925141: Don't log tracebacks on missing jobs in freeze https://review.opendev.org/c/zuul/zuul/+/92514115:42
@jamesharrisg:matrix.org> <@jim:acmegating.com> https://zuul-ci.org/docs/zuul/latest/job-content.html#var-nodepool.slot16:32
Thanks. That actually would probably be the way to do it.
@jamesharrisg:matrix.orgthough, looking at this again. Is there a way to tell ansible that the current working directory of the ansible jobs is something other than the ansible_user_dir?16:35
@jim:acmegating.comno, that's why the zuul-jobs have the workspace variable convention16:36
@jamesharrisg:matrix.orgmany of the default zuul roles use `zuul_workspace_dir: .`16:36
@jamesharrisg:matrix.orgit doesn't appear to flow throughout the thing. I.e. some jobs have `zuul_work_dir: "{{zuul.project.src_dir}}"` without prepending `zuul_workspace_root`16:37
@jim:acmegating.comi think patches to flesh that out would probably be welcome; i suspect that's just oversight.16:38
@jamesharrisg:matrix.orgah. that makes sense there.16:39
@jim:acmegating.comhrm, maybe not -- i think it's zuul_work_dir i'm thinking of that should be universal in zuul-jobs16:40
@jim:acmegating.comyeah, zuul_workspace_root is just for the prepare workspace roles16:41
@jamesharrisg:matrix.orgbut since `zuul_workspace_root` sets the parent path for all `zuul.project.src_dir` shouldn't it inherit that on nodes?16:43
@jamesharrisg:matrix.orgin the default cause?16:43
@jamesharrisg:matrix.org * in the default case?16:43
@jamesharrisg:matrix.orgotherwise changing your zuul_workspace_root will require you to sett a zuul_work_dir for all of your tasks manually to point to where you actually cloned your stuff.16:44
@jamesharrisg:matrix.org * otherwise changing your zuul\_workspace\_root will require you to sett a zuul\_work\_dir for all of your roles manually to point to where you actually cloned your stuff.16:45
@jim:acmegating.comyou could set it at a higher level than the tasks; they should be default vars16:45
@jamesharrisg:matrix.orgI guess that is true, but it sucks that the default configuration doesn't automatically include the `zuul_workspace_root`16:45
@jim:acmegating.comalso, i'm going to retract my statement about ansible_user_dir; you might be able to set or override that for a host.  you may want to check that.16:47
@jamesharrisg:matrix.orgtechnically ansible_user_dir is a fact you gather based on your user name.16:48
@jim:acmegating.com> <@jamesharrisg:matrix.org> I guess that is true, but it sucks that the default configuration doesn't automatically include the `zuul_workspace_root`16:48
i'm not sure i'd say it sucks. it's not clear to me that you can't accomplish what you want without setting one or two variables. there's a lot of flexibility there to handle a lot of different cases.
@jamesharrisg:matrix.orgI guess. I would expect the default behavior of something executing in the project src directory to look somewhere relative to zuul_workspace_root for the project src directory.16:51
@jamesharrisg:matrix.orgI also really don't want to change ansible_user_dir, because, many of the roles that effect things like ssh keys assume that that points to the user's home directory.16:52
@jim:acmegating.comi agree it's worth considering changing the default; it would probably benefit from some careful contemplation, and possibly review of the history of those 2 vars.  might want to ask on the mailing list if anyone sees problems with that before you start.16:53
@jamesharrisg:matrix.orgok. that is fair.16:54
@jamesharrisg:matrix.orgIt may be some time before I can get to working directly on it though (or other colleagues of mine might take up the effort if they need it sooner.) but I think it is worth pursuing so I will ask about it.16:55
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 925506: Add test for blobstore cleanup fix https://review.opendev.org/c/zuul/zuul/+/92550617:03
-@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [zuul/zuul] 925434: Combine reserved variable name lists in check_varnames https://review.opendev.org/c/zuul/zuul/+/92543421:02
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:21:49
- [zuul/zuul-jobs] 925539: Update test-prepare-workspace-git to use a module https://review.opendev.org/c/zuul/zuul-jobs/+/925539
- [zuul/zuul-jobs] 925540: Synchronize test-prepare-workspace-git to prepare-workspace-git https://review.opendev.org/c/zuul/zuul-jobs/+/925540

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!