*** rlandy is now known as rlandy|out | 01:27 | |
*** akahat is now known as akahat|ruck | 04:37 | |
*** ysandeep|away is now known as ysandeep | 04:49 | |
*** jpena|off is now known as jpena | 07:34 | |
*** ysandeep is now known as ysandeep|lunch | 08:22 | |
*** ysandeep|lunch is now known as ysandeep | 09:00 | |
*** rlandy|out is now known as rlandy|rover | 10:20 | |
*** anbanerj is now known as frenzyfriday | 10:26 | |
*** ysandeep is now known as ysandeep|afk | 10:34 | |
opendevreview | Ananya proposed openstack/ci-log-processing master: Adding overcloud_deploy.log.txt.gz to the list of files downloaded by logscraper https://review.opendev.org/c/openstack/ci-log-processing/+/858306 | 12:00 |
---|---|---|
*** ysandeep|afk is now known as ysandeep | 12:03 | |
opendevreview | Jeremy Stanley proposed openstack/project-config master: Move queues from pipeline to project level https://review.opendev.org/c/openstack/project-config/+/858307 | 12:19 |
opendevreview | Jeremy Stanley proposed openstack/project-config master: Move queues from pipeline to project level https://review.opendev.org/c/openstack/project-config/+/858307 | 12:33 |
opendevreview | Merged openstack/project-config master: Move queues from pipeline to project level https://review.opendev.org/c/openstack/project-config/+/858307 | 12:51 |
opendevreview | Lukas Piwowarski proposed openstack/ci-log-processing master: WIP: Add index with individual test results https://review.opendev.org/c/openstack/ci-log-processing/+/858373 | 13:01 |
opendevreview | Dr. Jens Harbott proposed openstack/devstack-gate master: [CI] Move queue setting to project level https://review.opendev.org/c/openstack/devstack-gate/+/858376 | 13:09 |
*** soniya is now known as soniya|afk | 13:11 | |
*** prometheanfire is now known as Guest931 | 13:29 | |
*** Guest772 is now known as dasm | 13:30 | |
-opendevstatus- NOTICE: As of the weekend, Zuul only supports queue declarations at the project level; if expected jobs aren't running, see this announcement: https://lists.opendev.org/pipermail/service-announce/2022-September/000044.html | 13:38 | |
eolivare | hi anybody knows why these jobs started failing due to NODE_FAILURE recently? | 13:48 |
eolivare | https://zuul.opendev.org/t/openstack/builds?project=x%2Ftobiko&result=NODE_FAILURE&skip=0 | 13:48 |
fungi | eolivare: looks like those may all use nodesets relying on "nestedvirt" labels, so it's possible we're having trouble satisfying those node requests (only a subset of our providers support them) | 13:56 |
eolivare | slaweq, ^^ maybe we should configure tobiko-infrared and tobiko-infrared-fedora as non-voting temporarily? | 13:58 |
slaweq | eolivare yes, we can probably do that to unblock our gate | 13:59 |
fungi | it does look like we're intermittently failing to satisfy the node requests for those, it's not consistent: https://zuul.opendev.org/t/openstack/builds?job_name=tobiko-infrared-fedora&project=x/tobiko | 14:03 |
eolivare | fungi, slaweq this is the nodeset used by the jobs failing since Saturday: https://opendev.org/x/tobiko/src/branch/master/zuul.d/infrared.yaml#L122 | 14:37 |
eolivare | fedora-36 nodes | 14:37 |
fungi | eolivare: but intermittently? so it's not that we're completely failing to boot those images i guess | 14:41 |
eolivare | fungi, https://zuul.opendev.org/t/openstack/builds?job_name=tobiko-infrared&job_name=tobiko-infrared-fedora&project=x%252Ftobiko&skip=0 | 14:42 |
eolivare | 3 pass vs 4 fail today | 14:43 |
fungi | currently we have 3 fedora-36 nodes in use in iweb-mtl01 and one that's been in a ready state there for a few days | 14:44 |
fungi | wait, no, those are in a building state, not in use | 14:44 |
fungi | i've deleted the days-old ready node so that it doesn't confuse things (no idea why it wasn't getting used by any jobs) | 14:46 |
fungi | yeah, looks like we're seeing failures to boot fedora-36 at least in iweb-mtl01 | 14:46 |
fungi | it's trying to boot one in inmotion-iad3 now | 14:47 |
eolivare | fungi++ thanks, I'll recheck my patch | 14:47 |
fungi | the one in inmotion-iad3 went ready pretty quickly | 14:47 |
fungi | seems like it may be that we're having trouble booting recent fedora-36 images in some providers but not others | 14:48 |
*** ysandeep is now known as ysandeep|dinner | 14:58 | |
fungi | yeah, saw a boot failure for one in rax-ord now | 14:58 |
opendevreview | Jeremy Stanley proposed openstack/project-config master: Add missing fedora-36 label to nl01 https://review.opendev.org/c/openstack/project-config/+/858397 | 15:07 |
fungi | eolivare: slaweq: i think that ^ should help, but may not the the only problem | 15:07 |
eolivare | fungi, ack | 15:09 |
clarkb | fedora-36 was going to drop bios support iirc. But then everyone said "but cloud" and they didn't make that change | 15:11 |
clarkb | But it makes me wonder if some other similar change did end up goingthrough that broke us. | 15:12 |
fungi | possible. once 858397 rolls out and the noise level from that is reduced, i'll see if i can spot more problems | 15:15 |
*** dulek_ is now known as dulek | 15:28 | |
opendevreview | Merged openstack/project-config master: Add missing fedora-36 label to nl01 https://review.opendev.org/c/openstack/project-config/+/858397 | 15:38 |
*** ysandeep|dinner is now known as ysandeep | 16:02 | |
*** ysandeep is now known as ysandeep|out | 16:03 | |
*** jpena is now known as jpena|off | 16:28 | |
*** dasm is now known as dasm|off | 22:00 | |
*** rlandy|rover is now known as rlandy|out | 22:50 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!