Wednesday, 2025-10-08

corvustonyb: awesome!  that came out of the work to upload images efficiently, so whatever we ended up doing instead of that would be in the zuul-jobs role to upload images to swift.  not sure if that helps add context.00:00
tonybcorvus: I think your patch is fine, it a) showed that the existing create_object tests aren't testing what we thought, and b) that we don't delete the file contents of a large object only the manifest.00:02
tonyball that from one kwarg addition!  value for money :)00:02
corvusoho!00:03
opendevreviewOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml  https://review.opendev.org/c/openstack/project-config/+/96255702:24
*** mrunge_ is now known as mrunge07:54
tonybfungi: In the interest of knowledge sharing, given you've done it most recently.   How does one create a new DIB release?08:26
tonybI'm guessing it's something like: git tag <version> <branch/sha/ref> ; git push gerrit <tag>08:27
tonybAnother random question.  Did we make a decision on setting togglewip in all-projects or similar?08:45
fungitonyb: basically yes, documented at https://docs.opendev.org/opendev/infra-manual/latest/drivers.html#tagging-a-release11:14
tonybahh perfect 11:15
tonybfungi: thanks11:15
fungias far as togglewip, i guess you're referring to https://review.opendev.org/95990411:16
fungithat would have been specifically for openstack, in the case of that change11:17
tonybyes that would indeed be what I'm looking for11:19
opendevreviewElod Illes proposed openstack/project-config master: Use ubuntu-noble for publish-openstack-artifacts  https://review.opendev.org/c/openstack/project-config/+/96336711:28
opendevreviewElod Illes proposed openstack/project-config master: Use ubuntu-noble for publish-openstack-artifacts  https://review.opendev.org/c/openstack/project-config/+/96336711:28
nate1738Good day everyone. I’m Nathan, an Outreachy applicant interested in the Git project. I’m new to IRC and im looking forward to working with you.11:50
tonybhey Nathan nice to meet you11:56
tonybyou should probably join the #openstack-outreachy 11:57
nate1738hey tonyb. Thanks for the guidance much appreciated. 11:59
tonybnp.12:00
*** iurygregory_ is now known as iurygregory12:08
*** ykarel_ is now known as ykarel12:56
corvusit looks like new nicks may not be be showing up in the matrix bridge again13:58
corvusi'd like to restart the launchers to pick up the fix from earlier in the week. if things go well, that will likely cause some nodes to suddenly appear in a weird state, but i expect it to self-heal.  then we should be able to delete the autoholds.13:59
corvusi'm going to restart schedulers and web as well14:03
fungithanks!14:15
corvusfungi: clarkb oops, there is still a small error: remote:   https://review.opendev.org/c/zuul/zuul/+/963399 Further fix to node assignment upgrade [NEW]        14:23
fungilooking14:24
fungilgtm, thanks for catching that14:25
clarkb+2 as well but looks like it is already gating14:49
corvuscool, hopefully i can try again today14:51
clarkbI think I'm in the correct meetpad room this time15:00
*** sfinucan is now known as stephenfin15:44
opendevreviewJay Faulkner proposed openstack/project-config master: Metalsmith retirement: end gating  https://review.opendev.org/c/openstack/project-config/+/96342216:50
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-inspector retirement: end most gating  https://review.opendev.org/c/openstack/project-config/+/96342316:53
opendevreviewMerged openstack/diskimage-builder master: Fix GRUB arm64 package names  https://review.opendev.org/c/openstack/diskimage-builder/+/96279316:56
clarkbreminder I'm popping out now but should be back later today and will check in17:57
fungii'm disappearing briefly to grab a very late lunch, but won't be long18:22
fungiokay, back19:22
corvusi have restarted zuul launchers, schedulers, and web again, and have deleted the obsolete autohold entries20:47
opendevreviewJay Faulkner proposed openstack/project-config master: Metalsmith retirement: end gating  https://review.opendev.org/c/openstack/project-config/+/96342220:54
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-inspector retirement: end most gating  https://review.opendev.org/c/openstack/project-config/+/96342320:54
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-inspector retirement: end most gating  https://review.opendev.org/c/openstack/project-config/+/96342320:55
Ramereth[m]<clarkb> "Ramereth: absolutely no rush..." <- Is this still happening? We were having database server issues right around the time you sent this.21:21
Clark[m]Ramereth[m] I can test later today if no one beats me to it21:59
fungii was just pulling it up to try again22:00
fungiRamereth[m]: i didn't retest them all, but e.g.:22:02
fungiFailed to delete image with name or ID 'dc5f7da5-4275-47c9-b185-c382a9bda7eb': HttpException: 500: Server Error for url: http://arm-openstack.osuosl.org:9292/v2/images/dc5f7da5-4275-47c9-b185-c382a9bda7eb, 500 Internal Server Error: The server has either erred or is incapable of performing the requested operation.22:02
* Ramereth[m] looks22:02
Ramereth[m]fungi: looks like a ceph permission problem. Odd I hadn't seen this before. I'll let you know once I have it fixed22:09
fungithanks Ramereth[m]! it was only a subset of old images at least22:12
opendevreviewJay Faulkner proposed openstack/project-config master: Metalsmith retirement: end gating  https://review.opendev.org/c/openstack/project-config/+/96342222:12
opendevreviewJay Faulkner proposed openstack/project-config master: ironic-inspector retirement: end most gating  https://review.opendev.org/c/openstack/project-config/+/96342322:12
Ramereth[m]fungi: please try again. I'm curious what will happen this time22:21
Ramereth[m]It should give you a different error hopefully (there's a VM ceph volume still attached to it)22:22
opendevreviewMerged openstack/project-config master: Metalsmith retirement: end gating  https://review.opendev.org/c/openstack/project-config/+/96342222:28
fungiRamereth[m]: Failed to delete image with name or ID 'dc5f7da5-4275-47c9-b185-c382a9bda7eb': ConflictException: 409: Client Error for url: http://arm-openstack.osuosl.org:9292/v2/images/dc5f7da5-4275-47c9-b185-c382a9bda7eb, 409 Conflict: Image dc5f7da5-4275-47c9-b185-c382a9bda7eb could not be deleted because it is in use: The image cannot be deleted because it is in use through the22:29
fungibackend store outside of Glance.22:29
fungiyes, different error!22:29
fungiso maybe stale bfv records?22:29
fungilooks like that image was created in 202122:32
opendevreviewMerged openstack/project-config master: ironic-inspector retirement: end most gating  https://review.opendev.org/c/openstack/project-config/+/96342322:33
Ramereth[m]fungi: looks like the VM is long gone. I removed it manually, try again please?22:49
fungiRamereth[m]: success! 22:51
fungiwhat are the odds the other 19 are in the same situation?22:51
Ramereth[m]Can you please list the UUIDs?22:52
fungiRamereth[m]: https://paste.opendev.org/show/bC0wmj2PI0SXHcuVwC3P/22:52
fungithe one on line #1 is what i was just able to delete now22:52
Ramereth[m]That one didn't have a VM attached, but I'm finding others. I'm going through each one now23:02
Ramereth[m]fungi: you should be able to delete all of them now23:06
fungithanks Ramereth[m]!23:06
fungii'm deleting them in a loop now23:07
fungiClark[m]: all the images you had listed in that paste should be gone now23:10
fungiopenstack image list doesn't return them any longer, so i think we're all set23:11
fungiand it's past time for me to be doing evening things, so i'm going to drop off for now23:11
Clark[m]Thank you both!23:47

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!