16:01:42 #startmeeting nova 16:01:42 Meeting started Tue Apr 1 16:01:42 2025 UTC and is due to finish in 60 minutes. The chair is Uggla. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:01:42 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:01:42 The meeting name has been set to 'nova' 16:01:50 Hello everyone 16:02:23 o/ 16:02:26 o/ 16:02:42 o/ 16:02:52 o/ 16:03:00 o/ 16:03:41 o/ 16:03:44 #topic Bugs (stuck/critical) 16:03:54 #info No Critical bug 16:04:05 #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster 16:04:26 anything about bugs ? 16:05:22 #topic Gate status 16:05:32 #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs 16:05:38 #link https://etherpad.opendev.org/p/nova-ci-failures-minimal 16:05:52 #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&branch=stable%2F*&branch=master&pipeline=periodic-weekly&skip=0 Nova&Placement periodic jobs status 16:05:59 #info Please look at the gate failures and file a bug report with the gate-failure tag. 16:06:04 so technially osc-placment gate is blocked without https://review.opendev.org/c/openstack/osc-placement/+/946031 16:06:05 #info Please try to provide meaningful comment when you recheck 16:06:33 we need that on master and stable/2025.1 16:06:52 tldr without a bindep file the tox-docs job fails on noble 16:07:22 specificly because libpcre3-dev is not installed 16:07:41 it only affect the jobs so not blocking the release 16:08:08 sean-k-mooney: add me as reviewer to the stable patch and I'll +2 it o:) 16:08:29 and thanks for the fix! 16:08:44 sure. ill propsoe it once its on master. it came up when reviewing https://review.opendev.org/c/openstack/osc-placement/+/943759 16:08:51 +1 16:08:57 thx for the fix sean-k-mooney ! 16:09:06 we didnt have any osc-placement change this cycle that im aware of 16:09:17 so not have release notes for a few days is pretty low impact 16:09:33 sean-k-mooney: ACK 16:09:42 so no need to rush but good to do before we forget about it 16:10:53 sure, anything else about the gate topic ? 16:11:07 not form me, we can move on i think 16:11:14 yep 16:11:14 I'll try to review the bindep patch 16:11:27 we did this before iirc 16:11:45 we had to fix a diffent bindep issue for nova 16:11:53 it was not including the test profile 16:12:01 that got fixed a few weeks ago 16:12:49 #topic Release Planning 16:12:57 #link https://releases.openstack.org/epoxy/schedule.html 16:13:24 #info Nova deadlines are set in the above schedule 16:13:38 #link 945904: 2025.1 Epoxy final releases for cycle-with-rc projects | https://review.opendev.org/c/openstack/releases/+/945904 16:13:50 #link https://releases.openstack.org/flamingo/schedule.html 16:14:05 #info Remaining post RC1: update min servion version for a SLURP or non-SLURP release : https://review.opendev.org/c/openstack/nova/+/944018/ 16:14:28 #info Nova Flamingo deadlines will be discussed at the PTG. 16:15:19 Epoxy should be released tomorrow if I'm not wrong. 16:15:27 \o/ 16:15:37 ~o~ 16:15:41 nice 16:16:13 yepp, we start the machinery tomorrow 16:16:32 btw @elodilles I have +1 the patch above. 16:16:45 thanks Uggla o/ 16:18:01 #topic Review priorities 16:18:13 #info Flamingo priorities will be discussed at the PTG. 16:18:45 #topic PTG planning 16:18:53 #info Next PTG will be held on Apr 7-11 16:19:14 #link https://etherpad.opendev.org/p/nova-2025.2-ptg 16:19:55 I think we have collected all the topics, the agenda is draft for the moment. I think I will finalize it tomorrow. 16:20:38 Today, there's a new and rather unexpected topic on the table for the PTG. 16:20:45 Rumor has it that it originates from a secret TC meeting focused on improving our resilience against supply chain attacks. 16:20:52 Uggla: the glance ptl was just pinging me about a session with glance about location api and a couple other things 16:20:59 As a result, we have a new top priority for the next development cycle — replacing the eventlet removal initiative. 16:21:17 It has been officially decided to begin rewriting Nova, starting with the scheduler component, in Brainfuck (https://en.wikipedia.org/wiki/Brainfuck). 16:21:26 The minimalist nature of the language, combined with its near-total unreadability, provides an unparalleled level of protection against malicious code injections. 16:21:32 A working PoC is already available here: https://www.jdoodle.com/ia/1FbD 16:22:03 Yep, @dansmith he contacted me for a new cross team meeting. 16:22:19 okay good 16:22:30 I put it on the etherpad at the bottom 16:22:59 * gibi hopes there is a mandatory formatter in the brainfuck compiler 16:23:16 Btw, will we have a full nova PTG day on Monday to front load stuff while we have? 16:23:18 * dansmith scowls at gibi 16:23:50 yes we have booked the full week Monday to Friday 16:24:10 ack 16:24:33 I'll try to clarify the full agenda by tomorrow. 16:25:06 Monday we may start later and cover only the retro. 16:25:31 hmmm, April gotcha 16:25:43 We have a question from mikal 16:25:49 sean mooney proposed openstack/osc-placement master: Add bindep.txt for ubunutu 24.04 support https://review.opendev.org/c/openstack/osc-placement/+/946031 16:25:56 mikal: Sean suggested on IRC at https://meetings.opendev.org/irclogs/%23openstack-nova/latest.log.html#t2025-03-25T19:01:27 that a "specless blueprint" might be sufficient to finish off the SPICE VDI work. I've therefore created https://blueprints.launchpad.net/nova/+spec/libvirt-spice-vdi, but wont be able to attend the meeting due to timezones. Could y'all discuss and decide if I need to propose something for the PTG / require a spec / or if this 16:25:57 is sufficient to finish off this work? Thanks! 16:26:50 ya so basicaly we did approve the usb and sound device changes as part of spice direct 16:26:58 but we didnt have time to land it 16:27:30 so since the code is written if there are no objections i was suggeting proceed with a specless blueprint unless peole had design concerns 16:27:39 if there are no changes compared to the approved spec then I'm fine with it 16:27:41 mikal said they can attend part of the ptg 16:27:59 so we could cover it a the start of one fo the sessions fi needed 16:28:35 sean-k-mooney, it is unclear in the message he said he won't be able to attend. 16:28:58 i htink they can atted if its first thign but it will be midnight for them 16:29:12 so if we can handel this async over eamil or approve and just move to gerrit 16:29:18 it will work a lot better for them 16:29:25 last time, he was able to join on a late evening for him 16:29:37 but we need to give him a specific time 16:29:58 like Friday 1pm if that works for him 16:30:39 so do we want to defer approving https://blueprints.launchpad.net/nova/+spec/libvirt-spice-vdi until we chat with them in the ptg? 16:30:52 ill note that while that has spice in the name 16:30:55 I have nothing against approving it 16:30:56 this applie to vnc also 16:31:02 yep I will set it as early as possible. sean-k-mooney are you ok to discuss this topic if Mikal won't join 16:31:15 sure 16:31:30 cool 16:32:22 any concerns about the specless BP for Mikal ? 16:32:52 ill note that we only need a ptg session fi we have open design questons. 16:33:24 I don't have any concerns 16:33:43 so i guess we can go for it. 16:34:11 go for it 16:34:23 sean-k-mooney, I will set the topic for the agenda, maybe it will be quick if it is crystal clear. 16:34:40 ack 16:35:00 something else you want to discuss for the PTG prep ? 16:35:47 am just an fyi im double booked with watcher 16:36:00 so ill attend where i can 16:36:12 ping if im not there and you would like my input 16:36:21 i tried to leave comment in the doc already 16:36:29 sean-k-mooney, ok sure thx. 16:36:44 I close this topic by saying we will not have this meeting next week due to the vPTG. 16:36:56 #topic Stable Branches 16:36:57 i'm not sure i mentioned it before. if my topic is selected for the ptg topics, i prefer 14utc or later. 16:37:23 masahito, yes, this is somewhere in my mind. 16:37:30 thanks. 16:37:35 #info stable/2024.* gates broken with nova-ceph-multistore job failure (test case test_volume_upload fails - No image found with ID...) 16:37:41 #info stable branch status / gate failures tracking etherpad: https://etherpad.opendev.org/p/nova-stable-branch-ci 16:38:08 elodilles, the floor is yours 16:38:16 yeah, i couldn't identify the root cause yet for that job failure yet ^^^ :( 16:38:42 so if anyone has any idea, it is appreciated o:) 16:39:24 stable/2023.2 gate is fine, and afaik stable/2025.1, too, but not 100% on that 16:39:57 and that is all i can say now 16:41:14 the iso patch has been rechecked again... 16:41:22 still hiting that volume bug 16:41:37 i havent looked at it yet either ill admit 16:42:10 i assume cinder of glance shoudl be seeing the same failure? 16:42:48 I think I saw it on stable/2025.1 also (have not checked if it is same or different?) https://review.opendev.org/c/openstack/devstack/+/945239/comments/231d655b_52020b94 16:43:40 * elodilles clicks but review.o.o is slow nowadays here :/ 16:43:46 that still the nova job 16:44:00 i was hopign that was a non nova one showing the same issue 16:44:30 gmann: looks like same 16:44:53 looks the same yes. 16:45:09 dansmith: do you know off the top of your head if there is anything special about the nova-ceph-multistore job that woudl cause no image found on volume upload? 16:45:30 volume upload to glance? 16:45:49 presumable yes 16:46:09 not really, that seems sort of impossible, 16:46:16 since you create first and then upload 16:46:19 (and the devstack patch merged successfully on 27th March, so it either not fully blocking or it was fixed on stable/2025.1 somehow) 16:46:30 seems like glance fail to import image? 16:46:32 #link https://zuul.opendev.org/t/openstack/build/54c93553fc6c4797b25077fb29a89338/log/controller/logs/screen-g-api.txt#12807 16:47:33 953cc449-8f49-4d56-ab3e-49b54f49f937 failed to import image 833ccb36-83b8-41a7-b932-86884e4cdfc0 to the filesystem.: NoneType: None 16:47:47 is this a multinode setup? 16:47:53 with glance-remote configured? 16:48:13 that sort of looks like it can't do import because it can't look up the configured self-reference url of a node that did the stage, maybe? 16:48:31 its multinode and multi store but im note sure if that also means multiple glance apis 16:48:50 oh no 16:48:53 its single node 16:48:57 but multiple backends 16:49:03 yeah, single node and no g-api-r service 16:50:05 that must be the import-from-http test and not volume upload then 16:50:44 its empest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload[id-d8f1ca95-3d5b-44a3-b8ca-909691c9532d,image] 16:50:52 https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_54c/openstack/54c93553fc6c4797b25077fb29a89338/testr_results.html 16:51:57 its a post to POST https://10.0.18.121/volume/v3/volumes/5726aafd-b7f7-4dbd-be64-265076f0efbb/action so asking cidner to upload the voluem to glance 16:51:59 Body: {"os-volume_upload_image": {"image_name": "tempest-VolumesActionsTest-Image-2109450379", "disk_format": "raw"}} 16:52:12 I also don't expect volume upload to use import 16:53:03 sean-k-mooney: I meant the failed task that gmann linked to 16:53:30 let's not debug it here 16:53:30 oh ok 16:53:31 Uggla: I think we can close the meeting and let the folks continue troubleshooting 16:53:41 ya 16:53:42 I think there are some image delete request in log 16:53:47 #link https://zuul.opendev.org/t/openstack/build/54c93553fc6c4797b25077fb29a89338/log/controller/logs/screen-g-api.txt#19062 16:53:51 yeah let's debug later 16:54:08 yep can we looks at that after the meeting ? 16:54:24 sure 16:54:25 I skip the vmwareapi 3rd-party CI efforts Highlights as fwiesel is ooo this week. 16:54:37 Latest topic 16:54:43 #topic Open discussion 16:55:00 If there is not, I'll close the meeting. 16:55:21 anything more to discuss ? 16:55:51 3... 16:56:13 2... 16:56:38 1... 16:56:51 . 16:57:14 thanks all 16:57:16 #endmeeting