| elodilles | stephenfin: don't you want to include this to os-vif's hibiscus-milestone-1 release? https://review.opendev.org/c/openstack/os-vif/+/941586 | 09:10 |
|---|---|---|
| sean-k-mooney | elodilles: i would love if that was in m1 | 10:33 |
| sean-k-mooney | elodilles: stephenfin proably is ok with it too | 10:33 |
| sean-k-mooney | elodilles: but we need https://review.opendev.org/c/openstack/nova/+/957040 to merge first | 10:34 |
| sean-k-mooney | elodilles: so as long as it happens this cycle its fine if its not there for m1 | 10:34 |
| elodilles | sean-k-mooney: ah, i see, thanks for the info. i see that the nova patch is on the gate already, so maybe it's OK to wait for that | 10:36 |
| elodilles | (Hibiscus-1 milestone deadline was last week, but actually i've started to merge the remaining open hibiscus-1 release patches today, so we can still wait a bit) | 10:37 |
| sean-k-mooney | elodilles: we can alway do another release of os-vif | 10:37 |
| sean-k-mooney | stephen woudl liek the typehint to be in a release | 10:37 |
| sean-k-mooney | and those are merged | 10:37 |
| elodilles | sean-k-mooney: that's true, but if it's just a couple of hours waiting, then i'm OK to wait :] | 10:37 |
| elodilles | sean-k-mooney: yepp, i saw that those have merged. +1 | 10:38 |
| sean-k-mooney | i woudl sayu if its not merge by end fo day just proceed | 10:40 |
| elodilles | ACK, will do that | 10:58 |
| opendevreview | Lajos Katona proposed openstack/nova master: Fix live migration with pinned VM and iothreads https://review.opendev.org/c/openstack/nova/+/988774 | 11:58 |
| zigo | sean-k-mooney: Looks like we're affected by https://bugs.launchpad.net/nova/+bug/2028518 | 13:45 |
| zigo | It feels like it would have been nice to merge this one: https://review.opendev.org/c/openstack/nova/+/904060 | 13:45 |
| zigo | (rather than nit-picking about tests...) | 13:46 |
| sean-k-mooney | that not a nit pick and you note i idd orginally approve this. | 13:47 |
| sean-k-mooney | we generally dont accpet chagne with no testing | 13:47 |
| sean-k-mooney | zigo: the reall issue however is artom moved on form an ic role and is now a manager of one of our internal ci teams | 13:48 |
| sean-k-mooney | zigo: so the reason this has not made any progress is 1 we forgot about it and 2 no one has been working on it since | 13:48 |
| zigo | Sure, but it's very frustrating to see a valid fix from 3 years ago still not merged. | 13:49 |
| sean-k-mooney | please dont look at my open reviews then :P | 13:49 |
| sean-k-mooney | let me see if i can have ai rebase this and add the test coverage really quickly | 13:50 |
| zigo | It applies cleanly on gazpacho, FYI. | 13:51 |
| zigo | Good chance it does on master. | 13:51 |
| zigo | As for the policy to have tests: I very much support it and I thank you for making sure we follow the policy, no worries. | 13:51 |
| sean-k-mooney | yep but we at the very least need a new ci run so ill do a trivial rebase add the requested unit test and push it up | 13:51 |
| zigo | Thanks a lot ! :) | 13:52 |
| sean-k-mooney | this si kind fo one of the perfect usecase for ai. we have a patch we knew fixed the problem but it jsut needs a rebase adn trivial testing added | 13:52 |
| opendevreview | Merged openstack/nova master: Remove Linux bridge VIF support from Nova https://review.opendev.org/c/openstack/nova/+/957040 | 13:54 |
| sean-k-mooney | woot!! | 13:55 |
| sean-k-mooney | zigo: that ^ has been on my todolist for like over a year since neutron removed supprot in 2025.2? | 13:55 |
| zigo | :) | 13:56 |
| opendevreview | sean mooney proposed openstack/nova master: weights: fix TypeError in weight debug log serialization https://review.opendev.org/c/openstack/nova/+/904060 | 14:08 |
| sean-k-mooney | zigo: so i think ^ should be ok lets see what ci say | 14:11 |
| zigo | Great ! Thanks. | 14:12 |
| sean-k-mooney | we do use debug mode in ci so if that prints propelry and the output looks sane i may upgrade back to +2 but +1 for now since i have only run the unit test on that | 14:13 |
| zigo | I believe the issue is debug + json, not just debug. | 14:13 |
| sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/904060/4/nova/tests/unit/test_weights.py#87 | 14:13 |
| sean-k-mooney | shoudl hopefully validate it | 14:14 |
| sean-k-mooney | but are you sayign its more that its a problem if you have debug logging + oslo log in json mode? | 14:14 |
| sean-k-mooney | the orginal bug just mentions debug=true https://bugs.launchpad.net/nova/+bug/2028518 | 14:15 |
| sean-k-mooney | so i think the patch shoudl be sufficent but we can alwasy extened it again if needed | 14:16 |
| zigo | The bug tells about oslo.log in json mode, yeah. And that's why we're affected (we use debug + json in production, so it's easier to stream to elastic search). | 14:17 |
| sean-k-mooney | well https://bugs.launchpad.net/nova/+bug/2028518 does not mention json mode, that just about normla debug mode with an object that we happen to be serisalise as json which is slightly diffent | 14:18 |
| sean-k-mooney | zigo: do you have the ablity to test this? | 14:19 |
| zigo | Oh ok. | 14:19 |
| sean-k-mooney | you mentioned seeing it in debian? | 14:19 |
| zigo | I mentioned we have the issue in our public cloud with the scheduler.log. | 14:19 |
| sean-k-mooney | ah ok | 14:19 |
| sean-k-mooney | so we use debug logging in our downstream product as well | 14:19 |
| zigo | That'd be on Caracal, for which I just backported the patch (not your revision though). | 14:19 |
| sean-k-mooney | i.e. we have the schduler defautl to debug | 14:20 |
| sean-k-mooney | im not aware of this impacting that but that based on antelope | 14:20 |
| sean-k-mooney | how does it manifest is it jsut a traceback but otherwise it works? | 14:20 |
| sean-k-mooney | im trying to undersand why this isnt breakign us hence the question | 14:21 |
| zigo | Just traceback, VMs are still spawned, but it doesn't feel very right ! :) | 14:21 |
| sean-k-mooney | ack ok so this is likely a "silgnet issue" we are not aware of in the ci | 14:22 |
| sean-k-mooney | and yes | 14:22 |
| sean-k-mooney | i hate "standared tracebacks/errors" | 14:22 |
| sean-k-mooney | in logs | 14:22 |
| sean-k-mooney | i.e. the ones form os-brick | 14:22 |
| sean-k-mooney | so ya it woudl be good to fix and backport | 14:22 |
| sean-k-mooney | dansmith: oh we dont need to read the full stream for any format? i tought one of the vmdk or ova format need that but that is good to know | 14:53 |
| sean-k-mooney | im probaly miss rememberign but i thoguh one of the format had a triailer we needed to look at | 14:53 |
| sean-k-mooney | althogh that really just an implamtion detial even in that case as the main point of it being stream based wehre we can reject it once we know its wrogn still holds | 14:54 |
| sean-k-mooney | glance would still reject it at the first point it know tis wrong even if that is a trailer at the end of the format | 14:54 |
| dansmith | sean-k-mooney: nope :) | 14:55 |
| sean-k-mooney | cool | 14:55 |
| sean-k-mooney | we do have EndCaptureRegion however https://github.com/openstack/oslo.utils/blob/master/oslo_utils/imageutils/format_inspector.py#L106 | 14:56 |
| sean-k-mooney | that the thing i was thinking of | 14:56 |
| sean-k-mooney | which is for vmdk https://github.com/openstack/oslo.utils/blob/master/oslo_utils/imageutils/format_inspector.py#L942-L949 | 14:57 |
| dansmith | sean-k-mooney: we can capture the trailer yep | 14:57 |
| dansmith | but we don't _have_ to do that, and we also don't need to store the image to do it | 14:58 |
| sean-k-mooney | ack ok that fits with my recolection then | 14:58 |
| Uggla | Reminder, upstream meeting in ~30mn | 15:33 |
| lajoskatona | sean-k-mooney: Hi, I updated gibi's patch for iothreads (https://review.opendev.org/c/openstack/nova/+/988774 ) as the unit test failed i the right way :-) | 15:59 |
| lajoskatona | sean-k-mooney: first I can't see if the patch is related to livemigration post_failure, but it is suspicious.... | 16:00 |
| Uggla | #startmeeting nova | 16:01 |
| opendevmeet | Meeting started Mon May 18 16:01:04 2026 UTC and is due to finish in 60 minutes. The chair is Uggla. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
| opendevmeet | The meeting name has been set to 'nova' | 16:01 |
| Uggla | Hello everyone | 16:01 |
| sean-k-mooney | lajoskatona: we can chat after the meeting | 16:01 |
| sean-k-mooney | but thanks | 16:01 |
| tkajinam | o/ | 16:01 |
| lajoskatona | ack | 16:01 |
| lajoskatona | o/ | 16:01 |
| dansmith | o/ | 16:01 |
| sean-k-mooney | o/ | 16:02 |
| elodilles | o/ | 16:02 |
| Uggla | Let's start | 16:03 |
| Uggla | #topic Bugs (stuck/critical) | 16:03 |
| Uggla | #info No Critical bug | 16:03 |
| Uggla | #topic Gate status | 16:04 |
| Uggla | #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs | 16:04 |
| Uggla | #link https://etherpad.opendev.org/p/nova-ci-failures-minimal | 16:04 |
| Uggla | #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&branch=stable%2F*&branch=master&pipeline=periodic-weekly&skip=0 Nova&Placement periodic jobs status | 16:04 |
| Uggla | #info Please look at the gate failures and file a bug report with the gate-failure tag. | 16:04 |
| Uggla | #info Please try to provide a meaningful comment when you recheck | 16:04 |
| Uggla | I have not seen something bad around the gate. Please tell me if I'm wrong | 16:05 |
| Uggla | #topic Release Planning | 16:06 |
| Uggla | #link https://releases.openstack.org/hibiscus/schedule.html | 16:06 |
| Uggla | #info Nova deadlines are set in the above schedule | 16:06 |
| Uggla | #info PTG etherpad for 2026.2 is available: https://etherpad.opendev.org/p/nova-2026.2-ptg | 16:06 |
| Uggla | #info This week Thursday is first spec review day. | 16:06 |
| Uggla | #info Nova soft spec freeze is next week, please submit any new specs and BP before next Thursday EOD (28 Mai) | 16:06 |
| Uggla | #info No meeting next week due to public holiday. (most of European countries involved) | 16:06 |
| Uggla | #topic Review priorities | 16:07 |
| Uggla | #link New file for Hibiscus https://etherpad.opendev.org/p/nova-2026.2-status | 16:07 |
| Uggla | #info I have updated Launchpad and the above doc. Please ping me if you spot something missing. | 16:07 |
| Uggla | #info I have flagged the priorities in bold. | 16:07 |
| Uggla | #info Starting: https://etherpad.opendev.org/p/nova-2026.2-status#L16 interesting bugs to review. | 16:07 |
| Uggla | #info Please review 988501: Do not log metadata proxy shared secret | https://review.opendev.org/c/openstack/nova/+/988501 | 16:07 |
| Uggla | ^ please review this one from elodilles as related to security | 16:08 |
| elodilles | thx o:) | 16:08 |
| Uggla | #info Please review 471815: Expose vlan trunking in metadata/configdrive | https://review.opendev.org/c/openstack/nova-specs/+/471815 | 16:08 |
| Uggla | ^ is +2 from Sean, so it would be great to have it as we missed it several cycles. | 16:09 |
| Uggla | #topic Stable Branches | 16:10 |
| * Uggla giving the mic to elodilles | 16:10 | |
| elodilles | o/ | 16:10 |
| elodilles | #info stable gates should be OK | 16:10 |
| elodilles | #info stable branch status / gate failures tracking etherpad: https://etherpad.opendev.org/p/nova-stable-branch-ci | 16:10 |
| elodilles | please report here ^^^ in case you see any issue | 16:10 |
| * elodilles gives back the mic to Uggla | 16:10 | |
| Uggla | thx elodilles | 16:11 |
| Uggla | #topic vmwareapi 3rd-party CI efforts Highlights | 16:11 |
| Uggla | fwiesel do you have something for us ? | 16:11 |
| fwiesel | Hi, no. Nothing from my side. | 16:12 |
| fwiesel | Uggla: Back to you. | 16:12 |
| Uggla | thx fwiesel | 16:12 |
| Uggla | skipping gibi's topic because he is on PTO this week. | 16:12 |
| Uggla | #topic Nova using openstack sdk for neutron | 16:12 |
| Uggla | lajoskatona, anything to share ? | 16:12 |
| lajoskatona | No news from me | 16:12 |
| Uggla | thx lajoskatona | 16:13 |
| Uggla | #topic Ironic review priorities | 16:13 |
| Uggla | cardoe, something to share this week ? | 16:13 |
| cardoe | Just an ask about the trunk spec if folks can review it. | 16:13 |
| Uggla | by the way I have seen your request to backport https://review.opendev.org/c/openstack/nova/+/955685 | 16:14 |
| cardoe | We landed https://review.opendev.org/c/openstack/nova/+/955685 but would be curious to know if that is backportable to see how much that improves things for users rather than waiting for 2026.2 | 16:14 |
| Uggla | that sounds possible, I'll try to propose it. You would like it on 2026.1 right ? | 16:15 |
| cardoe | I'm out on vacation for a little bit coming up but once I return I'll be working on more performance items between nova/ironic and will have more to share. | 16:15 |
| cardoe | Yes. 2026.1 | 16:15 |
| Uggla | ok so I'll try to do it, so I hope, you will have it back from vacation. | 16:16 |
| elodilles | ^^^ feel free to add me as reviewer to the backport | 16:16 |
| Uggla | elodilles sure, as it will avoid me to do something wrong. | 16:16 |
| sean-k-mooney | i think it likely can be backported yes but ya it would be good to get elods input for usre | 16:16 |
| cardoe | I can create it. | 16:16 |
| elodilles | +1 | 16:16 |
| opendevreview | Doug Goldstein proposed openstack/nova stable/2026.1: Implementing get_num_instances for ironic virt driver https://review.opendev.org/c/openstack/nova/+/989002 | 16:17 |
| Uggla | cardoe ok, also the FUP doc patch would be good. | 16:18 |
| Uggla | I think we can move on. | 16:18 |
| sean-k-mooney | we might want to squah the two when backporting | 16:18 |
| sean-k-mooney | as its just comments | 16:18 |
| sean-k-mooney | but sure i woudl be ok with or without the comment fixup | 16:19 |
| Uggla | #topic Bug scrubbing | 16:19 |
| Uggla | #info up to 189 (-4) | 16:19 |
| Uggla | #link https://etherpad.opendev.org/p/nova-bug-triage-roster | 16:19 |
| Uggla | #link https://etherpad.opendev.org/p/nova-bug-triage-roster | 16:19 |
| Uggla | #link https://truc.uggla.fr/ to follow the trend. | 16:19 |
| cardoe | I would need the topic removed from https://review.opendev.org/c/openstack/nova/+/985785 for gerrit to be happy squashing the backport. | 16:20 |
| Uggla | Next meeting (this week): [public] Upstream bug triage. Wednesday, May 20 · 15:30 – 16:00 UTC. Video call link: meet.google.com/zjr-rxus-hzj | 16:20 |
| Uggla | ^ I made this one recurrent (every week). Note I could cancel from time to time if our internal bug triage is taking too long | 16:21 |
| Uggla | #topic Open discussion | 16:21 |
| Uggla | We have one topic from sean: | 16:21 |
| Uggla | (sean) libvirt driver support for managed flag via cyborg pci attachment handle. | 16:21 |
| * Uggla giving t he mic to sean-k-mooney | 16:22 | |
| sean-k-mooney | so the main question is simple | 16:22 |
| sean-k-mooney | i am currnetly writing a cyborg spec to supprto vfio-varint driver for pci passthough in cyborg | 16:22 |
| sean-k-mooney | the same as we did in nova a few cycles ago | 16:22 |
| sean-k-mooney | this requires a very trivial change to nova in the libvirt driver to pass teh managed=True|False flag | 16:23 |
| sean-k-mooney | are we ok with detailign this only in the cybrog spec and haveing a whishlist bug ro specless bluepirnt on the nova side | 16:23 |
| sean-k-mooney | or do we need somethign behiond that? | 16:23 |
| dansmith | managed=true is a pci whitelist flag right now for static devices yeah? | 16:24 |
| sean-k-mooney | i.e. we coudl incorperate this isnto the nova spec for cybrog manged timesliced gpus (mdevs) | 16:24 |
| sean-k-mooney | dansmith: yep | 16:24 |
| dansmith | and you want to be able to let cyborg control that flag for things it provides via accelerator handle (whatever we call them)? | 16:24 |
| sean-k-mooney | yep | 16:24 |
| sean-k-mooney | just adding a boolean to that respocne object | 16:25 |
| dansmith | which basically just controls what we tell libvirt about the device right? | 16:25 |
| sean-k-mooney | with a new microversion of coucse on the cybrog api side | 16:25 |
| sean-k-mooney | yep | 16:25 |
| dansmith | makes sense to me | 16:25 |
| sean-k-mooney | currently it jsut has the pci adress | 16:25 |
| * Uggla ok with a specless BP. | 16:25 | |
| sean-k-mooney | so we woudl jsut be addeding a managed=True|false boolean ot it as well | 16:25 |
| sean-k-mooney | i have the cybrog spec locally with the minimal change to the libvirt driver detailed | 16:27 |
| sean-k-mooney | ill push it shortly | 16:27 |
| sean-k-mooney | ah | 16:27 |
| sean-k-mooney | #link https://review.opendev.org/c/openstack/cyborg-specs/+/989003 | 16:27 |
| sean-k-mooney | https://review.opendev.org/c/openstack/cyborg-specs/+/989003/1/specs/2026.2/approved/support-vfio-variant-driver-managed-mode.rst#161 | 16:28 |
| *** haleyb|out is now known as haleyb | 16:28 | |
| sean-k-mooney | so that is the minimal change for nova | 16:28 |
| Uggla | sean-k-mooney, can you ping me as soon as you have done the BP, I'll update the status etherpad. | 16:28 |
| sean-k-mooney | sure i can create it after the meeting | 16:29 |
| sean-k-mooney | but i just wanted to confirm we were ok wwith that for trackign if we are then ill go do the thing | 16:29 |
| Uggla | no hurries. (at least for me) dansmith are you ok ? | 16:29 |
| dansmith | yeah | 16:30 |
| Uggla | do we need another core to approve or we are good ? | 16:31 |
| sean-k-mooney | we can loop back to this next week if we like where there are more around | 16:32 |
| dansmith | I think PTL can make the call about BP/spec/etc, | 16:32 |
| dansmith | but I'd say proceed as if we're good and let someone else complain if they want | 16:32 |
| sean-k-mooney | ill create the blueprint now and we can see if we are happy with the text | 16:32 |
| dansmith | I doubt anyone will | 16:32 |
| Uggla | We could ask forgiveness as pythonista. ;) | 16:34 |
| Uggla | anything else to discuss ? | 16:34 |
| Uggla | seems not, so I think we are done for today | 16:35 |
| Uggla | Time to close, thanks for joining this meeting. Have a nice day/evening. | 16:35 |
| Uggla | #endmeeting | 16:35 |
| opendevmeet | Meeting ended Mon May 18 16:35:50 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:35 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/nova/2026/nova.2026-05-18-16.01.html | 16:35 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/nova/2026/nova.2026-05-18-16.01.txt | 16:35 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/nova/2026/nova.2026-05-18-16.01.log.html | 16:35 |
| lajoskatona | o/ | 16:35 |
| elodilles | thanks o/ | 16:36 |
| Uggla | dansmith ok with the pace ^ | 16:36 |
| dansmith | Uggla: A+ | 16:38 |
| dansmith | especially with light attendance, good to keep it moving, thanks | 16:39 |
| sean-k-mooney | Uggla: https://blueprints.launchpad.net/nova/+spec/support-vfio-variant-driver-managed-mode-via-cyborg | 16:40 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Consolidate vTPM and ephemeral encryption secret creation https://review.opendev.org/c/openstack/nova/+/912094 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: libvirt: Add optional 'description' kwarg to create_secret() https://review.opendev.org/c/openstack/nova/+/919986 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Follow up for encryption secret create consolidation https://review.opendev.org/c/openstack/nova/+/921586 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Remove use of (hw:|hw_)ephemeral_encryption_format https://review.opendev.org/c/openstack/nova/+/921343 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Add EncryptDetails object for ephemeral encryption https://review.opendev.org/c/openstack/nova/+/921344 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Add database migration to ALTER encryption_options https://review.opendev.org/c/openstack/nova/+/921587 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support create with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/870932 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Validate key manager create access in API https://review.opendev.org/c/openstack/nova/+/919989 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Clean up unused ephemeral encryption libvirt secrets https://review.opendev.org/c/openstack/nova/+/919990 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: libvirt: "Auto heal" ephemeral encryption secrets on guest launch https://review.opendev.org/c/openstack/nova/+/919991 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support (resize|cold migration) with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/870933 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support live migration with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/905512 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support rebuild with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/870939 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Add Glance standardized encryption image properties https://review.opendev.org/c/openstack/nova/+/921345 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support encrypted source images for qcow2 https://review.opendev.org/c/openstack/nova/+/919992 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Add encryption support to qemu-img rebase https://review.opendev.org/c/openstack/nova/+/870936 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Add backing_encryption_secret_uuid to BlockDeviceMapping https://review.opendev.org/c/openstack/nova/+/907960 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support encrypted backing files for qcow2 https://review.opendev.org/c/openstack/nova/+/907961 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support rescue with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/873675 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support snapshot with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/870937 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: Support cross cell resize with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/909595 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: libvirt: Introduce support for raw with LUKS https://review.opendev.org/c/openstack/nova/+/884313 | 17:13 |
| opendevreview | Pavlo Shchelokovskyy proposed openstack/nova master: libvirt: Introduce support for rbd with LUKS https://review.opendev.org/c/openstack/nova/+/889912 | 17:13 |
| sean-k-mooney | melwitt: ^ :) i guess that the rebase of your series that ye were chatting about on the mailing list | 17:14 |
| sean-k-mooney | although i dont think there is a reporposal of the spec is there? | 17:14 |
| lajoskatona | sean-k-mooney: o/ , so for the iothread patch from gibi (https://review.opendev.org/c/openstack/nova/+/988774 ) which I updated to fix the failing unit test | 17:31 |
| lajoskatona | sean-k-mooney: the nova-multi-cell failure (test_instance_boot_after_snapshot_deletion) seems unrelated, but I have to dig the nova-live-migration as to tell the truth I am not sure what that job is doing, the tempest part is green, but the the job-output seems like has much more than tempest.... | 17:33 |
| sean-k-mooney | lajoskatona: so the post failure in the live migraiton job was not releated | 17:33 |
| sean-k-mooney | the test actully passed but the scp of the logs fialed | 17:34 |
| sean-k-mooney | lajoskatona: right os after the tempest test runs in the live mgiration job | 17:34 |
| sean-k-mooney | we also have playbooks that test evaucate and a few other things | 17:34 |
| sean-k-mooney | those also appared to have passed so i rechecked the job to confirm it was just a log upload issue | 17:34 |
| sean-k-mooney | 2026-05-18 13:15:38.440961 | compute1 | ERROR | 17:35 |
| sean-k-mooney | 2026-05-18 13:15:38.441225 | compute1 | { | 17:35 |
| sean-k-mooney | 2026-05-18 13:15:38.441296 | compute1 | "msg": "ssh: connect to host 23.253.56.19 port 22: Connection timed out\r\nrsync: connection unexpectedly closed (0 bytes received so far) [Receiver]\nrsync error: unexplained error (code 255) at io.c(232) [Receiver=3.2.7]\n", | 17:35 |
| sean-k-mooney | 2026-05-18 13:15:38.441357 | compute1 | "rc": 255 | 17:35 |
| sean-k-mooney | 2026-05-18 13:15:38.441417 | compute1 | } | 17:35 |
| sean-k-mooney | that i think was the actual reason it fiald but ill check again when it reports back | 17:35 |
| sean-k-mooney | ah the live migration job in the recheck has already passed https://zuul.opendev.org/t/openstack/build/ea322beec7b145c49f2316d6b1b5ec7e | 17:36 |
| sean-k-mooney | so ya it was just a network blip on teh ci vms | 17:37 |
| sean-k-mooney | lajoskatona: if your intreested in whta th job was doing we run this as a post playbook in the job https://github.com/openstack/nova/blob/master/playbooks/nova-live-migration/post-run.yaml which invokes this role to test evacuate https://github.com/openstack/nova/blob/master/roles/run-evacuate-hook/tasks/main.yaml | 17:41 |
| lajoskatona | sean-k-mooney: thanks, I check these good to look exotic non-neutron jobs sometimes :-) | 17:52 |
| sean-k-mooney | so form a neutron perspective | 17:52 |
| sean-k-mooney | nova-live-migration tests live migration with ovn | 17:52 |
| sean-k-mooney | nova-next tests live migraiton with ml2/ovs and the ovs firewall driver | 17:53 |
| sean-k-mooney | and nova-alt-config tests ml2/ovs with the iptabels firewall driver | 17:53 |
| sean-k-mooney | all with local nova storage | 17:53 |
| sean-k-mooney | and nova-live-migration-ceph is ovn + cpeh for the vm storage | 17:53 |
| sean-k-mooney | so we try to cover the most common cofnigurations | 17:54 |
| blanson[m] | Hello guys, quick question. I'm seeing a seemingly "normal" alert on my rabbitmq cluster for nova because scheduler_fanout stream queue il pilling up with nova_instance_info messages ? from what I could read in the code this is normal, expected behavior ? Is it up to the operator to tweaks retention on this queue to not have it pile up to infinity ? | 18:20 |
| blanson[m] | https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2428 <- this specifically from my understanding produces those messages which are never consumed ? or is something broken on my end ? | 18:21 |
| sean-k-mooney | soh those are consumed by the schduelr if you have that enabled | 19:03 |
| blanson[m] | I see, but it's not consumed by default ? in which case retention policy should be fine ? | 19:08 |
| sean-k-mooney | blanson[m]: sorry was disctrcted | 19:35 |
| sean-k-mooney | blanson[m]: i woudl have to confirm but i belive this is contole by https://docs.openstack.org/nova/latest/configuration/config.html#filter_scheduler.track_instance_changes | 19:36 |
| sean-k-mooney | blanson[m]: and by defautl these are both sent by the compute nodes and consubed by the schduler | 19:36 |
| blanson[m] | I arrived to the same bit of code by digging, I will give that a try to see if that indeed starts consumming messages, thank you ! | 19:37 |
| sean-k-mooney | however if you have multiple cells then it may not work | 19:37 |
| sean-k-mooney | blanson[m]: the other thing that is related to this si you shoudl only enable notificaion if there is a consumer in general | 19:40 |
| sean-k-mooney | if you have notificaion enabel dits ecpected tha tyou either have a consumer for those or you have implemetin a retaion policy on rabbit ectra to discard them after a given treashold | 19:41 |
| sean-k-mooney | blanson[m]: actully looking again https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.scheduler_instance_sync_interval i sthe confgi to contol this and you can disble it by seting that to -1 | 19:42 |
| blanson[m] | I will have a look into the track_instance_change, but my next plan was to indeed disable the whole thing otherwise ! thank you very much ! | 19:48 |
| blanson[m] | well, apparently that's an oslo_messaging/rabbitmq issue. I had the correct consumer configuration on the scheduler side, but messages in stream fanout queues are never ack'd. as per https://docs.openstack.org/openstack-ansible/latest/user/messaging/messaging.html#managing-rabbitmq-stream-policy tthose keep piling up until 500MB unless there is a retention policy on the rabbitmq side. TIL ! | 20:28 |
| opendevreview | sean mooney proposed openstack/nova master: weights: fix TypeError in weight debug log serialization https://review.opendev.org/c/openstack/nova/+/904060 | 22:30 |
| opendevreview | sean mooney proposed openstack/nova master: weights: add regression test for JSON log TypeError (bug 2028518) https://review.opendev.org/c/openstack/nova/+/989029 | 22:30 |
| opendevreview | Merged openstack/nova master: Add regression test for bug #2134375 https://review.opendev.org/c/openstack/nova/+/984900 | 23:37 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!