opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 01:34 |
---|---|---|
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 03:11 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 03:13 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 03:14 |
opendevreview | Harry Kominos proposed openstack/diskimage-builder master: feat: Add new autoupdates element https://review.opendev.org/c/openstack/diskimage-builder/+/924069 | 03:40 |
tonyb | fungi: I have a POC patch in requirements that does something kinda like that. | 05:44 |
tonyb | fungi: I feel like the job structure is a little "deep", I'm a little concerned that we'd want (untrusted) jobs in (untrusted) repos using a job that's protected from a trusted repo which I think might expose us to potential secret disclousure | 05:46 |
frickler | hmm, I'm again seeing a large backlog in event processing for periodic-stable. there's also a lot of messages in zuul debug log saying "<class 'zuul.model.Branch'> does not support dependencies" which might be related? | 05:54 |
frickler | | 2282594 | zuul | 2001:4800:7819:103:be76:4eff:fe04:42c2:37712 | zuul | Query | 85 | Sending data | SELECT STRAIGHT_JOIN zuul_build.id AS zuul_build_id, zuul_build.end_time AS zuul_build_end_time | 06:21 |
frickler | sadly I cannot access cacti to judge how db load might have changed over the last two days, but ^^ indicates a relation to the latest change IMO | 06:22 |
frickler | mysql seems to be almost continously busy with queries of the above type and they seem to be sending data for about 3 minutes each | 06:24 |
opendevreview | Simon Westphahl proposed zuul/zuul-jobs master: Increase max. Zookeeper client connections in cfg https://review.opendev.org/c/zuul/zuul-jobs/+/924128 | 08:17 |
frickler | this is affecting other pipelines, too, like https://zuul.opendev.org/t/openstack/buildset/3ee591b2d0234866b842bc1cfd112cc8 was finished at 8:40, but the actual merge happened 10 minutes later | 08:55 |
*** sfinucan is now known as stephenfin | 09:01 | |
*** elodilles is now known as elodilles_afk | 10:00 | |
qwebirc37772 | https://plugins.jenkins.io/file-parameters/, for JJB to support this file parameter should we write a new plugin or can integrate it with existing file definition? | 11:09 |
raghavendra | Hello | 11:13 |
*** elodilles_afk is now known as elodilles | 12:07 | |
corvus | https://review.opendev.org/924152 should address the current delays | 13:35 |
opendevreview | Harry Kominos proposed openstack/diskimage-builder master: feat: Add new autoupdates element https://review.opendev.org/c/openstack/diskimage-builder/+/924069 | 13:35 |
fungi | thanks corvus!!! | 13:35 |
opendevreview | Curt Moore proposed opendev/glean master: Add ability to parse DNS configuration from all potential locations https://review.opendev.org/c/opendev/glean/+/924071 | 14:08 |
opendevreview | Curt Moore proposed opendev/glean master: Add ability to parse DNS configuration from all potential locations https://review.opendev.org/c/opendev/glean/+/924071 | 14:12 |
opendevreview | Curt Moore proposed opendev/glean master: Add ability to set MTU for RH based systems https://review.opendev.org/c/opendev/glean/+/924066 | 14:16 |
opendevreview | Curt Moore proposed opendev/glean master: Add ability to set MTU for RH based systems https://review.opendev.org/c/opendev/glean/+/924066 | 14:35 |
corvus | i'm restarting the schedulers/webs | 15:15 |
fungi | thanks! | 15:27 |
corvus | #status log restarted zuul schedulers/web to pick up 924152 | 15:32 |
opendevstatus | corvus: finished logging | 15:32 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 16:29 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 17:37 |
opendevreview | Curt Moore proposed opendev/glean master: Specify proper interface type https://review.opendev.org/c/opendev/glean/+/924070 | 19:24 |
frickler | I can take a deeper look myself tomorrow, but maybe someone sees the answer right away: why is this build ending in retry instead of failing? https://zuul.opendev.org/t/openstack/build/44ba40aee514457eba533cce6951525c | 19:26 |
jrosser | frickler: i have seen some surprising reties on osa jobs just now - i don't really understand what is happening | 19:35 |
fungi | frickler: all i can figure is that ansible thinks it lost contact with the node | 19:35 |
fungi | i'll check the executor's service log for details | 19:36 |
fungi | fatal: [primary]: FAILED! => {"changed": true, "msg": "non-zero return code", "rc": 2, "stderr": "Shared connection to 23.253.108.73 closed. | 19:39 |
fungi | also TASK [get df disk usage] returned RESULT unreachable | 19:41 |
fungi | for all 3 nodes | 19:41 |
noonedeadpunk | hey folks! we're seeing a retry_limit on failures happening during the `run` step of zuul. Have you spotted smth like that as well? Just trying to understand if it's our bug or smth off with zuul | 20:17 |
noonedeadpunk | ie: https://zuul.opendev.org/t/openstack/build/78637cede4234d139c0d24bcdb43840d | 20:17 |
noonedeadpunk | and it;s failing during RUN part: https://zuul.opendev.org/t/openstack/build/78637cede4234d139c0d24bcdb43840d/log/job-output.txt#6830 | 20:18 |
noonedeadpunk | Like it claims `Host unreachable` but I don't see anything like that in output log... | 20:20 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 20:46 |
fungi | noonedeadpunk: this looks like the same thing frickler and jrosser were talking about. i looked in the executor logs and it's like the nodes are becoming unreachable from ansible's perspective | 21:09 |
fungi | any chance all three of you are talking about jobs for the same exact project? | 21:09 |
fungi | maybe not, looks like kolla-ansible vs openstack-ansible. i wonder what they might share in common | 21:10 |
jrosser | an embedded ansible possibly | 21:32 |
opendevreview | James E. Blair proposed zuul/zuul-jobs master: prepare-workspace-git: Add allow deleting current branch https://review.opendev.org/c/zuul/zuul-jobs/+/917539 | 22:11 |
opendevreview | Jay Faulkner proposed openstack/diskimage-builder master: [gentoo] Fix+Update CI for 23.0 profile https://review.opendev.org/c/openstack/diskimage-builder/+/923985 | 22:49 |
opendevreview | James E. Blair proposed opendev/system-config master: Run zuul-launcher https://review.opendev.org/c/opendev/system-config/+/924188 | 22:51 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!