| *** ykarel_ is now known as ykarel | 04:03 | |
| ykarel | Thanks fungi for checking | 04:04 |
|---|---|---|
| opendevreview | Merged openstack/pbr master: Drop Jammy testing https://review.opendev.org/c/openstack/pbr/+/989937 | 08:51 |
| dtantsur | Hi folks! How do I debug a build like https://zuul.opendev.org/t/openstack/build/95ca70378023460595755ec737bc751f which fails with RETRY_LIMIT without any logs? | 11:24 |
| frickler | dtantsur: well I do see a full set of logs there, like e.g. https://10769f0369a546e0b81a-f2cb8655ffdf7ed1058c2e519d278ca2.ssl.cf2.rackcdn.com/openstack/95ca70378023460595755ec737bc751f/job-output.txt ? | 12:08 |
| *** ricolin_ is now known as ricolin | 12:24 | |
| *** TheJulia_ is now known as TheJulia | 12:25 | |
| *** dviroel_ is now known as dviroel | 12:52 | |
| opendevreview | Ivan Anfimov proposed openstack/project-config master: Add translation-jobs to watcher-dashboard https://review.opendev.org/c/openstack/project-config/+/992648 | 13:38 |
| opendevreview | Ivan Anfimov proposed openstack/project-config master: Add translation-jobs to watcher-dashboard https://review.opendev.org/c/openstack/project-config/+/992648 | 13:41 |
| *** agalica_ is now known as agalica | 14:02 | |
| dtantsur | frickler: (got kicked out IRC, not sure if there was an answer) I fixed the problem that caused retries, but I still don't see any logs in https://zuul.opendev.org/t/openstack/build/0f8b64ae839447cf8171474d00803254/logs | 14:07 |
| dtantsur | does it look normal to you? | 14:07 |
| fungi | dtantsur: it loads a list of logs for me | 14:08 |
| dtantsur | Dev console: Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://8851bd8f28ca490ebec6-b2aa11a8e0c554ee7a8f8052466e6a93.ssl.cf1.rackcdn.com/openstack/0f8b64ae839447cf8171474d00803254/job-output.json.gz. (Reason: CORS request did not succeed). Status code: (null). | 14:08 |
| fungi | check your browser console for errors maybe? the dashboard is javascript that fetches the log info from swift endpoints | 14:09 |
| fungi | yep, that could be it | 14:09 |
| dtantsur | is it on my side or on your? | 14:09 |
| fungi | good question, i'd expect my browser to reject it similarly, zuul includes cors info in the swift upload api call so it'll be set by the provider's servers | 14:10 |
| dtantsur | It seems unstable. Another build log opened successfully just a few minutes ago, now it shows the same error Oo | 14:11 |
| fungi | firefox by any chance? i see some recent update broke http/1.1 fallback and seems to be causing cors requests to sometimes fail | 14:12 |
| dtantsur | definitely firefox.. | 14:12 |
| * fungi tests with ff | 14:12 | |
| fungi | with ff 151.0.2-1 as packaged in debian/sid it's loading for me still | 14:13 |
| dtantsur | firefox-151.0.2-1.fc43.x86_64 should be the same code base, interesting | 14:14 |
| fungi | are you behind a proxy? maybe through a full-tunnel vpn? possible something inline is breaking the request | 14:14 |
| dtantsur | well, Red Hat VPN should not be a full-tunnel, but I did have issues with it in the past | 14:17 |
| dtantsur | oh, wait, I'm not connected to VPN right now. so no :( | 14:17 |
| fungi | good, one less thing to have to rule out | 14:17 |
| fungi | the other ones that you saw work and then start failing, were they also to rackspace's swift or were some at ovh? we distribute uploads randomly between them | 14:18 |
| fungi | possible something's semi-broken at rackspace, i guess | 14:18 |
| dtantsur | the page opens in chromium, so at least it's not my connection, I guess | 14:18 |
| dtantsur | I've seen both rackspace and OVH so far | 14:19 |
| fungi | okay, so not a provider-specific swift issue at least | 14:20 |
| dtantsur | works on Firefox ESR (freshly downloaded) | 14:23 |
| dtantsur | interstingly, ESR shows this error only for https://8851bd8f28ca490ebec6-b2aa11a8e0c554ee7a8f8052466e6a93.ssl.cf1.rackcdn.com/openstack/0f8b64ae839447cf8171474d00803254/job-output.json.gz, which does not seem to exist indeed | 14:23 |
| dtantsur | so I think my Firefox somehow fails to access the files | 14:23 |
| fungi | very weird | 14:23 |
| fungi | anyway, it's a direct fetch from the browser to a swift object in a public cloud provider, i wouldn't expect there to be a lot that could go wrong in there | 14:24 |
| dtantsur | Ehhhhh, hell. Should have looked at the requests tab earlier. "Blocked by NoScript". Sorry for wasting your time. | 14:24 |
| dtantsur | (why do I even have NoScript?) | 14:24 |
| fungi | bwahahahaha! no it's fine really, good to know that there are browser extensions that could silently cause this | 14:25 |
| dtantsur | It literally never did until an hour ago, this is why I could not suspect it | 14:25 |
| dtantsur | wtf | 14:25 |
| fungi | at least the next time someone reports this symptom, i'll have another suggestion for something to check | 14:26 |
| dtantsur | TIL! | 14:26 |
| clarkb | yes I think "use incognito/disable all plugins" is going to have to become more of a consistent first step. THis isn't the first imte we've had a plugin create issues | 14:47 |
| opendevreview | Seongsoo Cho proposed openstack/project-config master: i18n: Add new Zuul job for Weblate migration testing https://review.opendev.org/c/openstack/project-config/+/961499 | 15:31 |
| frickler | ah, I had this issue with noscript earlier, too. corvus posted some workaround (enable some additional request type iirc), which helped for some time, but that stopped working again a couple of days ago. simply clicking on the "View Log" link works anyway on the zuul build view | 15:39 |
| clarkb | you can probably disable it for certain sites too? | 15:50 |
| dtantsur | true, but you need to also enable any sites the page might use | 15:51 |
| dtantsur | Now, folks, I could use some help with configuring depends-on on github sites. Currently, if I use depends-on, I get "Error: Project github.com/metal3-io/baremetal-operator does not have the default branch master" on all jobs that do NOT declare baremetal-operator in required-projects. | 15:52 |
| dtantsur | Is there anything I can do about it? | 15:52 |
| dtantsur | is default-branch something I could add to the items in untrusted-projects? | 15:55 |
| dtantsur | "The Gerrit and GitHub drivers will automatically use the default branch as specified for the repository in their respective systems as a default value for this setting" - from https://zuul-ci.org/docs/zuul/latest/config/project.html - doesn't actually happen, does it? | 15:57 |
| fungi | it's true for configuration loading, but not as a fallback for branch matching on changes in other repos i don't think, so your jobs may need to specify a branch override on the respective required-projects entries for the job definition | 15:59 |
| dtantsur | fungi: I don't think I can create copies of all jobs we use.. I mean, I can, but it's going to be really ugly | 16:00 |
| dtantsur | especially with standard templates | 16:00 |
| fungi | i think it can be done in a variant rather than doing inheritance. where is your required-projects list being added for these jobs? | 16:00 |
| dtantsur | fungi: we inherit a lot of jobs from standard templates, we don't define required-projects for them. Think, pep8, cover, docs, etc | 16:01 |
| opendevreview | Dmitry Tantsur proposed openstack/project-config master: Set the default branch for Metal3 projects https://review.opendev.org/c/openstack/project-config/+/992711 | 16:02 |
| dtantsur | is ^^^ going to work? | 16:02 |
| fungi | but, like, pep8 jobs aren't going to be doing cross-project testing with the github repos are they? | 16:03 |
| dtantsur | fungi: yeah, but depends-on affects all jobs on the project, not just the one that define required-projects. THis is how it looks: https://zuul.opendev.org/t/openstack/buildset/b4f4771ef4da4fc88bc5aea252a36180 | 16:03 |
| clarkb | I think default-branch goes in the project: block not the tenant config | 16:05 |
| fungi | huh, yeah i don't know why zuul would care about branches on a repo that doesn't load configuration and isn't a required-project for the job, but maybe it's just a missing optimization | 16:06 |
| clarkb | depends-on creates an implicit required-project iirc | 16:06 |
| clarkb | if you look at the zuul vars for things that depends on both projects will probably be listed | 16:06 |
| dtantsur | :( | 16:06 |
| fungi | oh | 16:07 |
| clarkb | I would have expected the github driver to auto detect that | 16:07 |
| fungi | yep, i forgot about that | 16:07 |
| dtantsur | yeah, https://zuul-ci.org/docs/zuul/latest/config/project.html#attr-project.default-branch claims that | 16:07 |
| clarkb | I know gerrit does which is why we haven't had issues with the new repos using main | 16:07 |
| clarkb | https://opendev.org/zuul/zuul/src/branch/master/zuul/driver/github/githubconnection.py#L726-L741 thsi appears to be what would set it on an event for repository info. But I don't know if that is actually called or if we need to trigger things on the github side to get that info? | 16:09 |
| clarkb | https://opendev.org/zuul/zuul/src/branch/master/zuul/driver/github/githubconnection.py#L413 this is where it gets dispatched | 16:10 |
| clarkb | so we need a "repository" revent to come in from github whatever that means | 16:10 |
| dtantsur | I guess it works if we *edit* the default branch. But it's already there. | 16:10 |
| clarkb | I'ev asked in the zuul matrix room if we're interpreting this correctly | 16:12 |
| dtantsur | thank you! | 16:12 |
| clarkb | but I think the fallback of setting default-branch in a project stanza should work | 16:13 |
| dtantsur | At least https://review.opendev.org/c/openstack/project-config/+/992711 passed the validation, so it's not too broken :) | 16:19 |
| clarkb | the validation there is minimal because project-config is a trusted repo so we can't do speculative things on it. I suspect zuul will simply ignore that config if we land it | 16:24 |
| clarkb | corvus thinks that a tenant reconfiguration may fix the problem with the default branches | 16:24 |
| clarkb | ok `zuul-scheduler tenant-reconfigure openstack` is the suggested fix. fungi any reason to not proceed with running that now? (it may pause things while it does the reconfiguration | 16:26 |
| fungi | sounds fine to me | 16:27 |
| fungi | yeah, the theory in the zuul matrix room makes sense | 16:29 |
| clarkb | dtantsur: ^ that reconfiguration is running now. I'll let you know when zuul reports it is complete and then you can rerun the setps that had problems | 16:36 |
| dtantsur | thanks! | 16:45 |
| clarkb | dtantsur: it is done now if you want to retry | 16:48 |
| clarkb | ok corvus doesnt' think the reconfigure is sufficeint. We need a project block to force zuul to load the metadata for the project. Sounds like we don't even need to set default-branch in that block just having the block should load it | 17:01 |
| clarkb | alternatively override checkout which was mentioned previously | 17:01 |
| clarkb | I posted a review on 992711 with these details as I think that change can be udpated to add the project stanza block | 17:05 |
| dtantsur | clarkb: you mean, a project with just "name: metal3-io/baremetal-operator" etc? | 17:23 |
| dtantsur | and if yes, can I use wildcards like https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml#L27-L28? | 17:26 |
| * dtantsur will continue tomorrow | 17:35 | |
| clarkb | dtantsur: yes and yes. You need a project with just a name and I think the wildcard should work too | 17:37 |
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Add openstack-python3-client-library-jobs template https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/992769 | 21:49 |
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Add openstack-python3-client-library-jobs template https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/992769 | 21:58 |
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Add openstack-tox-py315 job https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/992771 | 21:58 |
| opendevreview | Stephen Finucane proposed openstack/openstack-zuul-jobs master: Test python3.15 (non-voting) for clients, libraries in 2026.2 https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/992772 | 21:58 |
| opendevreview | Stephen Finucane proposed openstack/pbr master: Add classifiers for latest Python https://review.opendev.org/c/openstack/pbr/+/989388 | 22:54 |
| opendevreview | Stephen Finucane proposed openstack/pbr master: Remove more unused code https://review.opendev.org/c/openstack/pbr/+/989389 | 22:54 |
| opendevreview | Stephen Finucane proposed openstack/pbr master: Remove need for setup.cfg, setup.py https://review.opendev.org/c/openstack/pbr/+/989390 | 22:54 |
| opendevreview | Stephen Finucane proposed openstack/pbr master: Hook in LocalSDist override https://review.opendev.org/c/openstack/pbr/+/989391 | 22:54 |
| opendevreview | Stephen Finucane proposed openstack/pbr master: Populate pyproject.toml file https://review.opendev.org/c/openstack/pbr/+/989392 | 22:54 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!