Friday, 2021-12-10

opendevreviewMerged openstack/project-config master: give starlingx-release branch and tag powers in metrics-server-armada-app  https://review.opendev.org/c/openstack/project-config/+/82132100:20
clarkbfwiw I think zuul is all caught up now00:30
fungiyeah, i saw some stuff complete in the last few minutes00:33
*** ysandeep|out is now known as ysandeep01:38
opendevreviewOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/82136002:33
opendevreviewMerged openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/82136003:08
*** pojadhav|out is now known as pojadhav|rover03:50
ianw#status log meetpad is currently down for some unexpected maintenance.  there is no fixed time frame, however it is likely to be restored tomorrow during US hours05:27
opendevstatusianw: finished logging05:27
*** marios is now known as marios|ruck06:23
opendevreviewIan Wienand proposed openstack/diskimage-builder master: Use OpenDev mirrors for 8-stream CI builds  https://review.opendev.org/c/openstack/diskimage-builder/+/82097806:26
kevinzfungi:  Oh,  sorry about that,  I will check  now06:52
kevinzAll the  leak instances have  been cleaned, just check06:55
kevinzSorry about that06:55
fricklerkevinz: thank you, this seems to look pretty fine now https://grafana.opendev.org/d/S1zTp6EGz/nodepool-linaro?orgId=107:17
*** ysandeep is now known as ysandeep|lunch07:34
kevinzfrickler: np:-)07:55
*** ysandeep|lunch is now known as ysandeep09:41
*** ysandeep is now known as ysandeep|afk10:35
*** pojadhav- is now known as pojadhav|rover11:02
*** ysandeep|afk is now known as ysandeep11:04
*** rlandy__ is now known as rlandy|ruck11:08
*** pojadhav- is now known as pojadhav|rover11:33
*** pojadhav|rover is now known as pojadhav|rover|afk11:33
*** jpena|off is now known as jpena12:05
gthiemongeHi Folks, do we have a centos-9-stream nodepool? I don't see anything in https://zuul.opendev.org/t/openstack/nodes, but I'm sure there were some nodes yesterday12:58
*** bhagyashris_ is now known as bhagyashris13:31
fungigthiemonge: they're only really going to be listed there when jobs are in progress using them13:34
gthiemongeoh ok, I'm trying to setup a job for c9s: https://review.opendev.org/c/openstack/octavia/+/816370 and I got NODE_FAILUREs with the centos-9-stream nodepool13:43
fungigthiemonge: there's a node label for centos-9-stream but i don't think anyone's added a named nodeset for it. you can just add an anonymous nodeset like https://opendev.org/openstack/puppet-openstack-integration/src/branch/master/zuul.d/integration.yaml#L40-L4313:48
fungigthiemonge: if you want a named nodeset to reuse, propose the addition with the others at https://opendev.org/opendev/base-jobs/src/branch/master/zuul.d/nodesets.yaml13:49
fungii'll double-check there's not already one awaiting review13:49
fungiyeah, i don't see one there yet13:50
gthiemongeok, I have "label: nested-virt-centos-9-stream" in a depends-on commit, but this one doesn't exist13:51
fungii don't think that specific label exists, no13:51
fungiyou could probably add it with the others in the files at https://opendev.org/openstack/project-config/src/branch/master/nodepool13:52
gthiemongeok thanks! I'll take a look13:57
opendevreviewRiccardo Pittau proposed openstack/diskimage-builder master: Install only python3 pip in debian bullseye  https://review.opendev.org/c/openstack/diskimage-builder/+/82056314:12
*** pojadhav is now known as pojadhav|afk14:59
*** ykarel is now known as ykarel|away15:24
opendevreviewMerged zuul/zuul-jobs master: Add fips version of jobs needed for OpenStack  https://review.opendev.org/c/zuul/zuul-jobs/+/81638515:40
funginot urgent, but we got a slew of notifications that certs for many of our services are expiring in 29 days, so it's possible our let's encrypt renewal jobs didn't run or were delayed. if we get more notifications for the same systems over the weekend we can look into it next week16:01
*** ysandeep is now known as ysandeep|out16:04
*** marios|ruck is now known as marios|out17:01
fungi#status notice The Gerrit service on review.opendev.org is being quickly restarted for a configuration adjustment, and should return momentarily17:25
opendevstatusfungi: sending notice17:25
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is being quickly restarted for a configuration adjustment, and should return momentarily17:25
opendevreviewClark Boylan proposed opendev/system-config master: Remove melody  https://review.opendev.org/c/opendev/system-config/+/82143017:27
*** jpena is now known as jpena|off17:59
opendevreviewClark Boylan proposed opendev/system-config master: Remove melody  https://review.opendev.org/c/opendev/system-config/+/82143018:00
timburke_since switching some centos-8 jobs to centos-8-stream, i feel like i've seen an uptick in failures that look like "Couldn't resolve host name for https://mirrors.fedoraproject.org/metalink?repo=epel-8&..." -- has anyone else seen this?18:50
clarkbtimburke_: Hrm are we not mirroring epel for stream so it falls back to the normal mirrors?18:50
clarkbif so that could explain it as you're at the mercy of external infrastructure at that point18:51
fungior we're not configuring it to correctly use our epel mirrors if so18:51
fungilike the jobs are running with epel for 8 rather than stream 8 so being ignored18:52
timburke_fwiw, we do have a task involving epel (https://github.com/openstack/liberasurecode/blob/master/roles/install_isal/tasks/main.yaml#L6-L12)19:00
timburke_and that lines up with where the job fails when it does: https://zuul.opendev.org/t/openstack/build/14dceb2d40f4489a80188b9fb2c084cf/console19:01
timburke_but the same job sometimes passes *and never mentions that step*: https://zuul.opendev.org/t/openstack/build/de35f1f16f6f4ff1a7c78dc43272efa2/console19:02
timburke_weirder and weirder! looking at logs, it *does* get run, but it doesn't show up in that console view: https://zuul.opendev.org/t/openstack/build/de35f1f16f6f4ff1a7c78dc43272efa2/log/job-output.txt#468-46919:03
clarkbI think someone mentioned that dnf tasks in ansible don't go into the console view19:04
clarkbansible doesn't emit the necessary attributes19:04
fungiand it uses a separate metadata type for its errors, or something like that?19:05
fungitempts me to replace all the dnf tasks in zuul-jobs with shell19:05
opendevreviewMerged opendev/system-config master: Remove melody  https://review.opendev.org/c/opendev/system-config/+/82143020:00
opendevreviewJeremy Stanley proposed opendev/system-config master: No lookups in Gerrit's log4j2 message formatting  https://review.opendev.org/c/opendev/system-config/+/82144620:09
fungi#status notice The Gerrit service on review.opendev.org is being restarted again for a plugin change, and should be back shortly20:15
opendevstatusfungi: sending notice20:15
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted again for a plugin change, and should be back shortly20:16
timburke_huh. OK, one more interesting data point on that centos-8-stream issue i've seeing: the normal jobs seem to be fine (https://zuul.opendev.org/t/openstack/builds?job_name=liberasurecode-unittests-centos-8-stream&project=openstack/liberasurecode), it's the FIPS-mode jobs that are spotty (https://zuul.opendev.org/t/openstack/builds?job_name=liberasurecode-unittests-centos-8-stream-fips&project=openstack/liberasurecode)21:57
opendevreviewMerged opendev/system-config master: No lookups in Gerrit's log4j2 message formatting  https://review.opendev.org/c/opendev/system-config/+/82144622:13

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!