Thursday, 2024-05-23

fungi2024-05-23 00:33:49.298 | > Selecting previously unselected package dns-root-data.01:23
fungimuch more like it01:23
fungiit's finalizing the image versions now so should be uploading shortly01:23
Clark[m]fungi: what did you have to do to get a new build? Delete an old one?01:24
fungino, for whatever reason it ignored my image-build command that time. when i ran it again after the building one became ready, it started building the new one just fine01:25
fungibut i do wonder whether it has to do with there being two ready images vs just one01:25
fungianyway, it's checksumming now01:27
fungishould start uploading any moment01:27
fungiunfortunately the latest build landed on the other builder, so had to populate the cache all over again01:32
opendevreviewMerged openstack/project-config master: Clean up unused labels from nl02 config  https://review.opendev.org/c/openstack/project-config/+/92019004:23
fricklero.k., some zuul-noble-jobs passing now, others need fixes, like bindep: "No package matching 'python-dev' is available", pretty sure we have a fix for that for bookworm already, too04:40
opendevreviewQihui Zhao proposed openstack/project-config master: to create a repo under cfn for a new-initiated sub-group cfn-security  https://review.opendev.org/c/openstack/project-config/+/92026408:41
opendevreviewMerged openstack/project-config master: to create a repo under cfn for a new-initiated sub-group cfn-security  https://review.opendev.org/c/openstack/project-config/+/92026414:26
clarkbI've got a noble zuul-jobs fixup change in the works should haev it pushed shortly15:46
clarkbjust currently battling with ubuntu pacakge sea4rch to determine why pkg-config is not in build essential anymore (or at least that is my assumption)_15:46
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020515:53
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029915:53
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029916:28
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020516:28
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029917:01
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020517:01
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029917:37
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020517:37
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029917:54
opendevreviewClark Boylan proposed zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020517:54
opendevreviewMerged zuul/zuul-jobs master: Ombibus set of fixups for Ubuntu Noble  https://review.opendev.org/c/zuul/zuul-jobs/+/92029918:54
Clark[m]fungi: any chance there are emails in the openstack discuss moderation queue? I got an email directly that hasn't shown up in my mailing list inbox18:58
Clark[m]Want to make sure there isn't some other issue18:59
Clark[m]Hrm actually it is in the archive. Maybe it is an issue on my side18:59
fungiClark[m]: by default, mm3 tries to avoid sending you duplicate copies of messages, mainly when there's an address in to or cc which is also subscribed19:00
fungicheck the archive to confirm, and if you want the duplicate copies i think it's a checkbox in your list subscription settings19:00
Clark[m]Oh neat. That breaks my filtering rules unfortunately. There is also the trove email that I don't think I got today19:01
Clark[m]The one I first got suspicious about is the dib one19:01
fungithe dib one did go through moderation19:01
fungibut i approved it hours ago and saw the list copy arrive19:01
Clark[m]Ok I don't think I got that one delivered I wonder what is up with my subscription delivery19:02
Clark[m]Oh wait sorry dib is explained by deduplication 19:02
Clark[m]Trove is the one I see in the archive and not locally19:02
fungiif your mail client has the ability to dynamically set reply-to and/or mail-followup-to headers when you're replying on mailing lists, that can be a workaround to reduce the replies that end up cc'ing you19:02
fungianother possibility with the trove e-mail is that it ended up caught in a spam filter, or the server is being greylisted and the message just hasn't reached you yet, or could be delays in the outbound mta queue on the lists server19:03
fungi`exim4 -bp` on lists.o.o will show you the current deferral queue19:04
fungithe message ids can be matched to entries in /var/log/exim/mainlog or content and deferral log files in /var/spool/exim if you need details19:05
Clark[m]Ok I'm currently consuming lunch but will dig more19:05
fungiand yeah, i don't personally like that mm3 changed the default to deduplicate when mm2 defaulted to not deduplicating, but since it's per-user configurable i don't have much room to complain ;)19:06
Clark[m]I did an explicit search for the trove message and now it loads. Maybe this is merely a client caching issue19:07
opendevreviewMerged zuul/zuul-jobs master: Add ubuntu-noble testing  https://review.opendev.org/c/zuul/zuul-jobs/+/92020519:08
fungii also received it, arrived at lists.o.o at 18:57:56 and reached my mta at 19:05:44, so there's a 7m50s delay somewhere in there19:08
Clark[m]Ya sending openstack discuss list emails has about a 5-10 minute delay these days19:09
Clark[m]I guess I could've simply raced seeing it in the archive and getting it delivered. All seems well now and the deduplication is the only unexpected behavior which I now know about19:09
fungithe server isn't loaded at all (load average seems to be at/under 0.5 for a while), so it may just be that we need to tell mailman it can do more simultaneous deliveries or something19:10
clarkbmakes sense19:22
fungii remember seeing discussion on the users ml about it defaulting to a conservative limit in order to avoid overwhelming the mta on smaller systems19:30
fungimuch more polite than mm2 which didn't bother, and would just chuck everything at exim the moment it was received19:31
fricklerif someone has time to check why https://review.opendev.org/c/openstack/kolla-ansible/+/920294 is failing all jobs without logging results, that would be nice, otherwise I'll dig into zuul logs tomorrow, eoding now19:49
fungifrickler: FAILED! => {"msg": "The task includes an option with an undefined variable. [...]20:21
fungifrickler: i think ansible is choking on the commit message20:23
corvusshould be fixed in https://review.opendev.org/c/zuul/zuul/+/920361 Fix missing unsafe marker in new build_refs var20:25
fungithanks! i was just about to post the same link20:26
clarkbfungi: with the merging of the zuul-jobs update for noble I wonder if we should suggest that people start using noble? For example for python312 jobs? I'm about to push a change up for zuul to do that now and see what happens22:02
clarkboh we need an ubuntu-noble nodeset in base jobs too22:04
* clarkb does that22:04
opendevreviewClark Boylan proposed opendev/base-jobs master: Add ubuntu-noble nodesets  https://review.opendev.org/c/opendev/base-jobs/+/92036322:05
clarkbgmann: ^ fyi we're getting close to making that an option for jobs. May be worth converting the existing py312 jobs in poenstack over to avoid building python from scratch22:18
clarkblooks like there may be a problem running the zuul py312 job though so need to figure that out22:18
clarkbah its a libffi bindep problem22:19
clarkbfungi: if you have a quick moment for https://review.opendev.org/c/openstack/diskimage-builder/+/920215 I think that is an easy bash review. I just don't want to single core approve it because it is in simple-init which has a fairly large blast radius22:26
fungiclarkb: yes on switching to noble for 3.12 but only after the default ansible version increase or when overriding ansible with a newer version, right?22:50
clarkbfungi: ya though it can be done a per job basis. In the zuul case zuul's tenant is already flipped22:52
fungiclarkb: on 920215 do we care that it's introducing stray trailing whitespace on that line? also would it make more sense to just drop the else?22:52
clarkbI don't think we care about the trailing whitespace if the bash linter (if we even run one) in dib doesn't catch it. One raeson for the noop else is to keep ianw's comment there in a clear scope22:53
clarkbbut we could drop the block if you feel strongly about it22:53
funginah, it's fine with me22:54
clarkbI do think we can add the noble nodesets nowish (they are noops until used) then announce a day for changing the default ansible version. Maybe early june? and then proceed from there22:54
clarkbreally its up to openstack to decide if they want to swap out the node for py312 jobs and set the ansible version. Or if they want ot run on noble at all. Just calling out that it is an option now22:55
clarkbIn zuul's case I expect the switch to make the job run about 10 minutes faster.22:55
fungiright, i think openstack is going to want to make that switch22:55
ianwclarkb: thanks :)  not sure what i was thinking22:56
fungiright now their 3.12 jobs are merely advisory anyway: https://governance.openstack.org/tc/reference/runtimes/2024.2.html22:57
clarkbianw: TheJulia fixed it :)22:57
TheJuliawait, what did I do?22:57
TheJuliaI'm only supposed to break things!22:57
clarkbTheJulia: the continue -> true fix in dib22:57
fungiTheJulia: fixed all the bugs22:57
TheJuliawoot!22:57
* TheJulia dances22:58
fungiwe can go home now22:58
TheJulianooooo!!! ;)22:58
fungimission complete22:58
clarkbfungi: actually zuul is using default ansible version 8 too22:58
clarkbso maybe the problem is being able to run ansible commands on noble requires newer ansible22:58
clarkbbut talkign to ansible nodes is fine with older ansible22:59
clarkbbecause the zuul jobs are definitely working22:59
fungioh, that's convenient22:59
clarkbor maybe dansmith's ansible from the distro didn't get patched updates to make it work and upstream did so for 8?22:59
fungiso yeah, let's get the nodesets added, announce availability, suggest projects doing nested ansible that they may need a newer version23:00
clarkbor just hand wave around potential compatibility problems and if seen update to newer ansible23:00
clarkbbut ya sounds like a plan23:00
fungiand in the openstack tenant we can switch the py312 jobs from pyenv to distro packaged23:00
fungiafter some heads up23:01
clarkbthe main upside is going to be removing the compile step which takes a couple minutes and getting a distro compiled python that sets a bunch more optimization flags than pyenv does by default. In theory it will make thinsg go faster23:02
fungivroom vroom23:04
opendevreviewMerged openstack/diskimage-builder master: simple-init: Swap continue for true  https://review.opendev.org/c/openstack/diskimage-builder/+/92021523:58

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!