| -@gerrit:opendev.org- Joshua Watt proposed: [zuul/zuul] 914818: gerrit: Add `approval-change` trigger https://review.opendev.org/c/zuul/zuul/+/914818 | 14:01 | |
| @vlotorev:matrix.org | I'm having issues running dependent jobs in post (supercedent), periodic and tag pipelines. | 21:37 |
|---|---|---|
| The issue is jobs A and B from the same project (B has job.dependecies on A) are run in one buildset. | ||
| Job job A is finished successfully, but job B is stuck in 'queued' state. | ||
| The same jobs A+B execute in check (independent) pipeline without errors. | ||
| This issue appeared after upgrading zuul 9.2 -> 9.5. And keeps reproducing on 10.0, and on 10.1.dev82 (current latest)) running on zuul.opendev.org. | ||
| There is a stable exception in zuul scheduler logs (running jobs for tag pipeline, sandbox-publish-docs is dependent job that has stuck): | ||
| ``` | ||
| 2024-04-03 00:19:07,208 ERROR zuul.Pipeline.nto7.tag: [e: 63ecccaec4774fc8967a8d6c9ab9892f] Exception while executing job <FrozenJob sandbox-publish-docs> for <QueueItem 45cc652da0184fe9bacd94a4297f7fab live for [<Tag 0x7fa14c149810 sandbox creates refs/tags/0.4 on ae4801e5316b6899596c8e5d6884663a3b595ca2>] in tag>: | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/manager/__init__.py", line 1065, in _executeJobs | ||
| self.sched.executor.execute( | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/client.py", line 63, in execute | ||
| params = zuul.executor.common.construct_build_params( | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/common.py", line 97, in construct_build_params | ||
| ) = item.getJobParentData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5431, in getJobParentData | ||
| artifact_data = job.artifact_data or self.getArtifactData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5414, in getArtifactData | ||
| self.providesRequirements(job, data) | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5377, in providesRequirements | ||
| 'change': change.number, | ||
| ^^^^^^^^^^^^^ | ||
| AttributeError: 'Tag' object has no attribute 'number' | ||
| ``` | ||
| @vlotorev:matrix.org | * Hi. | 21:37 |
| I'm having issues running dependent jobs in post (supercedent), periodic and tag pipelines. | ||
| The issue is jobs A and B from the same project (B has job.dependecies on A) are run in one buildset. | ||
| Job job A is finished successfully, but job B is stuck in 'queued' state. | ||
| The same jobs A+B execute in check (independent) pipeline without errors. | ||
| This issue appeared after upgrading zuul 9.2 -> 9.5. And keeps reproducing on 10.0, and on 10.1.dev82 (current latest)) running on zuul.opendev.org. | ||
| There is a stable exception in zuul scheduler logs (running jobs for tag pipeline, sandbox-publish-docs is dependent job that has stuck): | ||
| ``` | ||
| 2024-04-03 00:19:07,208 ERROR zuul.Pipeline.nto7.tag: [e: 63ecccaec4774fc8967a8d6c9ab9892f] Exception while executing job <FrozenJob sandbox-publish-docs> for <QueueItem 45cc652da0184fe9bacd94a4297f7fab live for [<Tag 0x7fa14c149810 sandbox creates refs/tags/0.4 on ae4801e5316b6899596c8e5d6884663a3b595ca2>] in tag>: | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/manager/__init__.py", line 1065, in _executeJobs | ||
| self.sched.executor.execute( | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/client.py", line 63, in execute | ||
| params = zuul.executor.common.construct_build_params( | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/common.py", line 97, in construct_build_params | ||
| ) = item.getJobParentData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5431, in getJobParentData | ||
| artifact_data = job.artifact_data or self.getArtifactData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5414, in getArtifactData | ||
| self.providesRequirements(job, data) | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5377, in providesRequirements | ||
| 'change': change.number, | ||
| ^^^^^^^^^^^^^ | ||
| AttributeError: 'Tag' object has no attribute 'number' | ||
| ``` | ||
| @vlotorev:matrix.org | * Hi. | 21:38 |
| I'm having issues running dependent jobs in post (supercedent), periodic and tag pipelines. | ||
| The issue is: | ||
| * jobs A and B from the same project (B has job.dependecies on A) are run in one buildset. | ||
| * Job job A is finished successfully, but job B is stuck in 'queued' state. | ||
| The same jobs A+B execute in check (independent) pipeline without errors. | ||
| This issue appeared after upgrading zuul 9.2 -> 9.5. And keeps reproducing on 10.0, and on 10.1.dev82 (current latest)) running on zuul.opendev.org. | ||
| There is a stable exception in zuul scheduler logs (running jobs for tag pipeline, sandbox-publish-docs is dependent job that has stuck): | ||
| ``` | ||
| 2024-04-03 00:19:07,208 ERROR zuul.Pipeline.nto7.tag: [e: 63ecccaec4774fc8967a8d6c9ab9892f] Exception while executing job <FrozenJob sandbox-publish-docs> for <QueueItem 45cc652da0184fe9bacd94a4297f7fab live for [<Tag 0x7fa14c149810 sandbox creates refs/tags/0.4 on ae4801e5316b6899596c8e5d6884663a3b595ca2>] in tag>: | ||
| Traceback (most recent call last): | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/manager/__init__.py", line 1065, in _executeJobs | ||
| self.sched.executor.execute( | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/client.py", line 63, in execute | ||
| params = zuul.executor.common.construct_build_params( | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/executor/common.py", line 97, in construct_build_params | ||
| ) = item.getJobParentData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5431, in getJobParentData | ||
| artifact_data = job.artifact_data or self.getArtifactData(job) | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5414, in getArtifactData | ||
| self.providesRequirements(job, data) | ||
| File "/usr/local/lib/python3.11/site-packages/zuul/model.py", line 5377, in providesRequirements | ||
| 'change': change.number, | ||
| ^^^^^^^^^^^^^ | ||
| AttributeError: 'Tag' object has no attribute 'number' | ||
| ``` | ||
| @vlotorev:matrix.org | I was trying to reproduce the issue in `opendev/sandbox` repo but after merging the change [1] jobs didn't run in post pipeline [2]. | 21:42 |
| [1] https://review.opendev.org/c/opendev/sandbox/+/914866 | ||
| [2] https://zuul.opendev.org/t/openstack/builds?project=opendev%2Fsandbox&pipeline=post&skip=0 | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 914928: Fix deletion of intermediate image builds https://review.opendev.org/c/zuul/nodepool/+/914928 | 22:30 | |
| @clarkb:matrix.org | vlotorev: for half a second I thought that the opendev/system-config infra-prod-* jobs might be supercedent (I know they have dependencies between at least some jobs) but I think I may be wrong about that | 22:41 |
| @vlotorev:matrix.org | Clark: I found supercedent infra-prod-* jobs here and they are running without errors in periodic opendev-prod-hourly pipeline https://opendev.org/opendev/system-config/src/branch/master/zuul.d/project.yaml#L662 | 22:45 |
| These jobs doesn't use 'provides/requires'. While my jobs are using dependencies and provides/requires. | ||
| @vlotorev:matrix.org | * Clark: I found supercedent infra-prod-\* jobs here and they are running without errors in periodic opendev-prod-hourly pipeline https://opendev.org/opendev/system-config/src/branch/master/zuul.d/project.yaml#L662 | 22:45 |
| infra-prod-\* jobs doesn't use 'provides/requires'. While my jobs are using dependencies and provides/requires. | ||
| @clarkb:matrix.org | corvus: I have a question on 914866 that I've posted | 22:45 |
| @vlotorev:matrix.org | * Clark: I found supercedent infra-prod-\* jobs here and they are running without errors in periodic opendev-prod-hourly pipeline https://opendev.org/opendev/system-config/src/branch/master/zuul.d/project.yaml#L662 | 22:45 |
| infra-prod-\* jobs don't use 'provides/requires'. While my jobs are using dependencies and provides/requires. | ||
| @jim:acmegating.com | Clark: replied | 22:49 |
| @clarkb:matrix.org | thanks +2 from me | 22:51 |
| @clarkb:matrix.org | vlotorev: ya the more I thought about it what we're doing is probably not the same. I just thought maybe it was an example taht could be compared against | 22:51 |
| @vlotorev:matrix.org | Clark: AFAIK I finally managed to reproduce my issue on zuul.opendev.org: | 23:41 |
| * https://review.opendev.org/c/opendev/sandbox/+/914866 specifies two jobs with dependencies and provides/requires. | ||
| * These jobs are running in 'post' pipeline and can be found in https://zuul.opendev.org/t/openstack/status . The first job finished successfully, but the second one has stuck in 'queued' state for at least half an hour. | ||
| @vlotorev:matrix.org | * Clark: I finally managed to reproduce my issue on zuul.opendev.org: | 23:44 |
| - https://review.opendev.org/c/opendev/sandbox/+/914866 specifies two jobs with dependencies and provides/requires. | ||
| - These jobs are running in 'post' pipeline and can be found in https://zuul.opendev.org/t/openstack/status . The first job finished successfully, but the second one has stuck in 'queued' state for at least half an hour. | ||
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!