-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 945907: Make Gerrit Connection Replication Aware https://review.opendev.org/c/zuul/zuul/+/945907 | 00:23 | |
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul] 945907: Make Gerrit Connection Replication Aware https://review.opendev.org/c/zuul/zuul/+/945907 | 03:18 | |
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 945423: WIP: Changes needed for run tests in container https://review.opendev.org/c/zuul/zuul/+/945423 | 08:02 | |
-@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 942886: Prepare oidc token for playbook execution in executor. https://review.opendev.org/c/zuul/zuul/+/942886 | 08:21 | |
@morucci:matrix.org | Hi Folks, do you have a schedule to tag the next version of Zuul ? I'm asking because we hit quite a lot (120 times in the last 7 days) the issue that might be fixed by https://opendev.org/zuul/zuul/commit/4e07779c5411b711e990d5a96ce28d85d2189258 | 08:21 |
---|---|---|
@apevec:matrix.org | uhh PS1 July 2023 and merged March 2025 | 09:09 |
-@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 946748: zuul-web: fix traceback in "job" endpoint if a job doesn't have variants https://review.opendev.org/c/zuul/zuul/+/946748 | 10:01 | |
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 946754: Capitalize AWS image filter key/value arguments https://review.opendev.org/c/zuul/zuul/+/946754 | 11:07 | |
@clarkb:matrix.org | Looks like the updated base container image script did fix image builds for zuul | 13:20 |
@fungicide:matrix.org | ironically, the "official" python container images on dockerhub were completely broken by the same problem. in their build process they relied on ensurepip which installed an older version of setuptools bundled in cpython, but since ensurepip doesn't install wheel they were separately installing an unconstrained version of that so ended up installing 0.46.1 which then broke the installed setuptools | 13:28 |
@jim:acmegating.com | fbo: no schedule as always, but probably within the next couple of weeks. there's still a bunch of stuff in flux. | 13:35 |
@morucci:matrix.org | Thanks for the insights, then we will backport the change in our images in the meantime | 13:46 |
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/zuul] 946754: Capitalize AWS image filter key/value arguments https://review.opendev.org/c/zuul/zuul/+/946754 | 13:55 | |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 946792: Slow processing of failed nodescan connections https://review.opendev.org/c/zuul/zuul/+/946792 | 17:40 | |
@f2ked:matrix.org | tips on debugging? when using `zuul-web` trying to get project info and I get this exception | 18:13 |
``` | ||
ERROR cherrypy.error.139717006660944: [req: 5fd57bea0ddb482888ddfc8f851fd2d1] [09/Apr/2025:18:08:18] HTTP | ||
ERROR cherrypy.error.139717006660944: Traceback (most recent call last): | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cprequest.py", line 659, in respond | ||
ERROR cherrypy.error.139717006660944: self._do_respond(path_info) | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cprequest.py", line 718, in _do_respond | ||
ERROR cherrypy.error.139717006660944: response.body = self.handler() | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/lib/encoding.py", line 223, in __call__ | ||
ERROR cherrypy.error.139717006660944: self.body = self.oldhandler(*args, **kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/zuul/web/__init__.py", line 936, in json_handler | ||
ERROR cherrypy.error.139717006660944: value = cherrypy.serving.request._json_inner_handler(*args, **kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__ | ||
ERROR cherrypy.error.139717006660944: return self.callable(*self.args, **self.kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/zuul/web/__init__.py", line 1922, in project | ||
ERROR cherrypy.error.139717006660944: md = tenant.layout.getProjectMetadata(project.canonical_name).toDict() | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: AttributeError: 'NoneType' object has no attribute 'toDict' | ||
INFO cherrypy.access.139717006660944: [req: 5fd57bea0ddb482888ddfc8f851fd2d1] XXX - - [09/Apr/2025:18:08:18] "GET /api/tenant/XXX-tenant/project/opendev.org/zuul/zuul-jobs HTTP/1.1" 500 825 "http://XXX-zuul-web01.XXX.com:9000/t/XXX-tenant/project/opendev.org/zuul/zuul-jobs" "XXX" | ||
``` | ||
@f2ked:matrix.org | * tips on debugging? when using `zuul-web` trying to get project info and I get this exception (redacted `XXX`) | 18:14 |
``` | ||
ERROR cherrypy.error.139717006660944: [req: 5fd57bea0ddb482888ddfc8f851fd2d1] [09/Apr/2025:18:08:18] HTTP | ||
ERROR cherrypy.error.139717006660944: Traceback (most recent call last): | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cprequest.py", line 659, in respond | ||
ERROR cherrypy.error.139717006660944: self._do_respond(path_info) | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cprequest.py", line 718, in _do_respond | ||
ERROR cherrypy.error.139717006660944: response.body = self.handler() | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/lib/encoding.py", line 223, in __call__ | ||
ERROR cherrypy.error.139717006660944: self.body = self.oldhandler(*args, **kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/zuul/web/__init__.py", line 936, in json_handler | ||
ERROR cherrypy.error.139717006660944: value = cherrypy.serving.request._json_inner_handler(*args, **kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/cherrypy/_cpdispatch.py", line 54, in __call__ | ||
ERROR cherrypy.error.139717006660944: return self.callable(*self.args, **self.kwargs) | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: File "/usr/local/lib/python3.11/site-packages/zuul/web/__init__.py", line 1922, in project | ||
ERROR cherrypy.error.139717006660944: md = tenant.layout.getProjectMetadata(project.canonical_name).toDict() | ||
ERROR cherrypy.error.139717006660944: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
ERROR cherrypy.error.139717006660944: AttributeError: 'NoneType' object has no attribute 'toDict' | ||
INFO cherrypy.access.139717006660944: [req: 5fd57bea0ddb482888ddfc8f851fd2d1] XXX - - [09/Apr/2025:18:08:18] "GET /api/tenant/XXX-tenant/project/opendev.org/zuul/zuul-jobs HTTP/1.1" 500 825 "http://XXX-zuul-web01.XXX.com:9000/t/XXX-tenant/project/opendev.org/zuul/zuul-jobs" "XXX" | ||
``` | ||
@jim:acmegating.com | f2ked: it's probably not you, i think that's a bug in master | 18:21 |
@f2ked:matrix.org | thanks! | 18:31 |
@f2ked:matrix.org | I'm still stuck on [this pipeline check](https://matrix.to/#/!yuuvjJSOEGSfTzxOjK:opendev.org/$4j8IFalWIGw-Bbe8ENFsIePHuNdC1EUr0d1IC6m763U?via=opendev.org&via=matrix.org&via=fedora.im) from yesterday.. I do not see the message that fungi suggests.. any other tips.. | 18:33 |
I'm concerned that I just have my references crossed | ||
@clarkb:matrix.org | you confirmed that you have debug logs in your log files? I would expect similar messages if you have debug enabled | 18:36 |
@clarkb:matrix.org | then the other thing is to check that you are looking at the correct logfile | 18:37 |
@clarkb:matrix.org | would be the scheduler log for the things you are looking at | 18:37 |
@f2ked:matrix.org | we have instrumented some of this code and it appears we don't have any `pipeline_manager`s to match against even thought pipelines are being parsed | 18:39 |
@f2ked:matrix.org | so we don't event get a change to check the messahe | 18:39 |
@f2ked:matrix.org | * so we don't event get a chance to check the messahe | 18:39 |
@f2ked:matrix.org | * so we don't event get a chance to check the message | 18:40 |
@clarkb:matrix.org | I would expect there to be errors logged if you have errors in the config. But also pipelines may need to be in trusted repo config and maybe yours aren't so are being ignored? | 18:40 |
@f2ked:matrix.org | it is in a repo listed under `tenant.source.config-projects` | 18:43 |
@f2ked:matrix.org | and | 18:44 |
``` | ||
INFO zuul.TenantParser: Loading configuration from XXX-zuul-config/zuul.d/pipelines.yaml@main | ||
``` | ||
is the right one | ||
@clarkb:matrix.org | ya that looks correct to me | 18:45 |
@clarkb:matrix.org | any errors after that message? | 18:45 |
@f2ked:matrix.org | none :( | 18:45 |
@f2ked:matrix.org | am I right that the pipeline tr | 18:48 |
``` | ||
trigger: | ||
XXX-gerrit: | ||
``` | ||
should match the connection in `zuul.conf` | ||
``` | ||
[connection "XXX-gerrit"] | ||
driver=gerrit | ||
``` | ||
@f2ked:matrix.org | * am I right that the pipeline | 18:48 |
``` | ||
trigger: | ||
XXX-gerrit: | ||
``` | ||
should match the connection in `zuul.conf` | ||
``` | ||
[connection "XXX-gerrit"] | ||
driver=gerrit | ||
``` | ||
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 946818: Avoid 500 on /project with no project configs https://review.opendev.org/c/zuul/zuul/+/946818 | 18:49 | |
@clarkb:matrix.org | yes I believe so. Its saying look for these triggers on that connection | 18:49 |
@jim:acmegating.com | f2ked: that particular bug you hit suggests that you have a project defined in a tenant with no project config stanzas, which could be a cause for items not being enqueued in the pipeline. | 18:51 |
@f2ked:matrix.org | here is my simple tenant | 18:57 |
``` | ||
- tenant: | ||
name: XXX-tenant | ||
source: | ||
XXX-gerrit: | ||
config-projects: | ||
- XXX-zuul-config | ||
untrusted-projects: | ||
- my-proj: | ||
include-branches: | ||
- master | ||
opendev.org: | ||
untrusted-projects: | ||
- zuul/zuul-jobs: | ||
include: | ||
- job | ||
``` | ||
@clarkb:matrix.org | f2ked: does my-proj have any pipelines and jobs configured on its master branch? | 19:10 |
@f2ked:matrix.org | there is no zuul anything in the master branch, we are trying to get it working before we merge it | 19:12 |
@f2ked:matrix.org | oohh also `XXX-zuul-config`'s "master" branch is called "main".. is that significant? | 19:14 |
@f2ked:matrix.org | hmmm... https://zuul-ci.org/docs/zuul/latest/tenants.html#attr-tenant.config-projects.%3Cproject%3E.load-branch | 19:16 |
@clarkb:matrix.org | f2ked: the config you pasted above says include-branches master not main. | 19:33 |
@clarkb:matrix.org | f2ked: but also what corvus said earlier is until your project has any config there is nothing to do | 19:33 |
@clarkb:matrix.org | this is why you got the zuul-web error that you pasted | 19:33 |
@clarkb:matrix.org | if you configured jobs that run when that trigger is triggered then you should see something happen hopefully | 19:33 |
@f2ked:matrix.org | `my-proj` does have `master` since it is legacy. `XXX-zuul-config` uses `main` | 19:34 |
@f2ked:matrix.org | kk I guess I'll merge just this once without testing 😬 | 19:35 |
@clarkb:matrix.org | you can start with just the noop job | 19:35 |
@clarkb:matrix.org | it doesn't actually do anything zuul just says success and returns | 19:35 |
@clarkb:matrix.org | but that should be sufficient to exercise the pipeline | 19:36 |
@f2ked:matrix.org | > this is why you got the zuul-web error that you pasted | 19:41 |
even for unrelated projects? | ||
@f2ked:matrix.org | * > this is why you got the zuul-web error that you pasted | 19:41 |
even for unrelated projects? | ||
@clarkb:matrix.org | I don't know | 19:47 |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 946792: Slow processing of failed nodescan connections https://review.opendev.org/c/zuul/zuul/+/946792 | 19:58 | |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 946852: WIP: Add niz cleanup https://review.opendev.org/c/zuul/zuul/+/946852 | 22:39 | |
@f2ked:matrix.org | FYI: circling back, merging into `my-project@main` and performing a `full-reconfigure` got us pipelines we needed.. thank all! | 22:43 |
@jim:acmegating.com | f2ked: great! there's some discussion about the nuances of the bootstrapping process in the quickstart tutorial; in retrospect it sounds like that may have been what you were dealing with: https://zuul-ci.org/docs/zuul/latest/tutorials/quick-start.html#configure-zuul-pipelines | 22:50 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!