| -@gerrit:opendev.org- Michal Nasiadka marked as active: [openstack/diskimage-builder] 988472: CI: Switch dib-devstack to use openstack.cloud https://review.opendev.org/c/openstack/diskimage-builder/+/988472 | 11:33 | |
| @fungicide:matrix.org | the mirror.ubuntu vos release (including resolute and the last month of updates for noble) started at 02:51:28 today, barring any errors it will likely continue through the weekend | 13:30 |
|---|---|---|
| @fungicide:matrix.org | huh, or not! i guess because the mirror volumes only replicate to another fileserver in the same cloud region, it copied very quickly | 14:11 |
| @fungicide:matrix.org | i'm running it again just to make sure it's a no-op | 14:11 |
| @clarkb:matrix.org | fungi: disk utilization looks reasonable which is nice | 14:44 |
| @clarkb:matrix.org | fungi: when the second pass is done should we send an email to service-announce indicating the resolute labels s hould be ready for general consumption? Maybe with a note about the python 3.14 GC issue too? | 14:45 |
| @fungicide:matrix.org | yeah, there were a handful of new packages pulled in since yesterday, but reprepro is at the point of regenerating the indices now, and grafana no longer shows the volume a month stale since the previous run | 15:08 |
| @fungicide:matrix.org | it does look like my estimate was about double what resolute actually ended up consuming, i guess because i was basing it on older releases that now include years of fixes and security updates | 15:09 |
| @fungicide:matrix.org | we could in theory add resolute arm64 mirroring at the moment without putting too much pressure on /vicepa if it's approximately the same size as amd64 (earlier comparisons indicate it may be a few percent larger, but still comparable) | 15:11 |
| @fungicide:matrix.org | but as these grow, we'll probably be under a bit of a deadline to free up space or add more storage | 15:12 |
| @clarkb:matrix.org | Makes sense | 15:32 |
| @fungicide:matrix.org | okay, not sure why that took as long as it did, maybe the first reprepro pass after adding new files needs more time for the deleteunreferenced checking and such, but it started to vos release finally | 15:54 |
| @fungicide:matrix.org | vos release finished, i guess it's open season on resolute amd64 mirrors now | 16:04 |
| @clarkb:matrix.org | fungi: do you want to send the announcement to service-annouce or should I? | 16:12 |
| @fungicide:matrix.org | i can | 16:17 |
| -@gerrit:opendev.org- Zuul merged on behalf of cid: [openstack/project-config] 984159: Ends project gating for `virtualpdu` https://review.opendev.org/c/openstack/project-config/+/984159 | 17:06 | |
| -@gerrit:opendev.org- cid proposed: [openstack/project-config] 988655: Remove VirtualPDU repository references https://review.opendev.org/c/openstack/project-config/+/988655 | 17:21 | |
| -@gerrit:opendev.org- cid proposed: [openstack/project-config] 988655: Remove VirtualPDU repository references https://review.opendev.org/c/openstack/project-config/+/988655 | 17:42 | |
| -@gerrit:opendev.org- cid proposed: [openstack/project-config] 988655: [EOL]: Remove VirtualPDU repository references https://review.opendev.org/c/openstack/project-config/+/988655 | 17:44 | |
| -@gerrit:opendev.org- Clark Boylan proposed: [opendev/system-config] 988678: Use named matches in jitsi config https://review.opendev.org/c/opendev/system-config/+/988678 | 18:42 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [opendev/system-config] 988678: Use named matches in jitsi config https://review.opendev.org/c/opendev/system-config/+/988678 | 20:34 | |
| @fungicide:matrix.org | that ^ deployed, i'll make sure stuff's still reachable | 20:42 |
| @clarkb:matrix.org | thanks | 20:43 |
| @clarkb:matrix.org | I'm almost done testing the 3.12 -> 3.13 upgrade. Then will run through the downgrade. I don't see anything unexpected yet | 20:43 |
| @fungicide:matrix.org | i'm in https://meetpad.opendev.org/isitbroken and stuff still seems to be functional as best i can tell | 20:44 |
| @clarkb:matrix.org | I can join momentarily | 20:44 |
| @clarkb:matrix.org | I'm in there and don't see you | 20:45 |
| @clarkb:matrix.org | also it doesn't look like nginx was restarted | 20:45 |
| @fungicide:matrix.org | starting back up now | 20:47 |
| @clarkb:matrix.org | looks good thanks again | 20:49 |
| @fungicide:matrix.org | no sweat | 20:49 |
| @fungicide:matrix.org | thanks for the change | 20:49 |
| @fungicide:matrix.org | i'm working on seeing if i can switch the bridge node label in the arm base job now | 20:50 |
| -@gerrit:opendev.org- Jeremy Stanley https://matrix.to/#/@fungicide:matrix.org proposed: [opendev/system-config] 988698: Use mixed arches for system-config-run-base-arm64 https://review.opendev.org/c/opendev/system-config/+/988698 | 20:58 | |
| @fungicide:matrix.org | i think that's ^ it | 20:58 |
| @clarkb:matrix.org | this is interesting while 3.12 -> 3.13 doesn't change the index schemas/versions it does change the gerrit_file_diff h2 cache version from 9 to 10 and it will prune entries out that aren't the right version | 20:59 |
| @clarkb:matrix.org | similarly when you downgrade it prunes out the newer versions stuff so that it can replace the entries with old versions | 20:59 |
| @clarkb:matrix.org | I don't think this is a big deal. Just something I noticed that is interesting | 20:59 |
| @fungicide:matrix.org | huh, yeah since it's just caches i think that's fine | 21:00 |
| @clarkb:matrix.org | ok https://etherpad.opendev.org/p/gerrit-upgrade-3.13 is updated with notes from actually running through the process to upgrade and downgrade on a held node | 21:00 |
| @clarkb:matrix.org | fungi: there are a couple things that may be working looking at. The first is I updated the commands for checking the image shas to use podman commands (since docker commands don't work anymore) and I tried to make it more clear that is a two step process (first find the image id then inspect the image id). Then second in the dowgrade process I marked two steps as not being done for this upgrade but kept them in there and struck them through with a note why we skip them | 21:01 |
| @clarkb:matrix.org | I'm curious to know if you find that to be clearly communicated in both cases where I chagned things compared to the last upgrade | 21:02 |
| @clarkb:matrix.org | I haven't seen anything concerning in this process. I think the next step is landing https://review.opendev.org/c/opendev/system-config/+/987375 and upgrading prod to 3.12.7 then I can retest with the latest images and work through the TODO items on that etherpad against the latest images | 21:03 |
| @clarkb:matrix.org | maybe we can do that tomorrow if things are calm | 21:03 |
| @fungicide:matrix.org | yeah, i can take a look tomorrow, i need to do a quick outing to pick up our grocery order but otherwise plan to be around all day | 21:48 |
| @fungicide:matrix.org | huh, testinfra failures (ssh permission denied) on system-config-run-base-arm64 now: https://zuul.opendev.org/t/openstack/build/d2df0429fd1246bf9c23514e62059523 | 21:50 |
| @fungicide:matrix.org | i'll wip the change and look closer at that tomorrow too | 21:51 |
| @clarkb:matrix.org | we might have some bad assumptions about using local connectivity or non public ips in the test infra testing | 21:55 |
| @clarkb:matrix.org | which now that bridge is on another cloud maybe creating problems? | 21:55 |
| @clarkb:matrix.org | but if we got far enough to run testinfra that implies ansible itself is working? | 21:55 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!