16:01:07 #startmeeting nova 16:01:07 Meeting started Tue Oct 1 16:01:07 2024 UTC and is due to finish in 60 minutes. The chair is bauzas. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:01:07 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:01:07 The meeting name has been set to 'nova' 16:01:14 hey everyone 16:01:19 o/ 16:01:50 o/ 16:01:56 #link https://wiki.openstack.org/wiki/Meetings/Nova#Agenda_for_next_meeting 16:02:01 o/ 16:02:56 ok let's start 16:03:04 #topic Bugs (stuck/critical) 16:03:08 #info No Critical bug 16:03:14 #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster 16:03:20 anything else ? 16:04:22 ok looks not 16:04:25 moving on 16:04:30 #topic Gate status 16:04:36 #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs 16:04:41 #link https://etherpad.opendev.org/p/nova-ci-failures-minimal 16:04:47 #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status 16:04:53 #info Please look at the gate failures and file a bug report with the gate-failure tag. 16:04:57 #info Please try to provide meaningful comment when you recheck 16:05:08 o/ 16:05:09 about the periodics, we have a failure on the c9s job 16:05:19 #link https://zuul.openstack.org/build/0e3b92cd874e4f29b4b252b6f4acb8e9 16:05:55 2024-09-28 08:43:49.610448 | controller | + lib/rpc_backend:install_rpc_backend:61 : sudo systemctl --now enable rabbitmq-server 16:05:57 2024-09-28 08:43:49.646533 | controller | Failed to enable unit: Unit file rabbitmq-server.service does not exist. 16:06:08 looks like there is a regression 16:06:16 probably something people already know ? 16:07:24 Is that seen in master ? 16:07:30 https://zuul.openstack.org/build/0e3b92cd874e4f29b4b252b6f4acb8e9/log/job-output.txt#4894 16:07:50 no, stable/2024.2 16:08:18 but, sec, checking master 16:08:30 * gibi joins late 16:08:40 CentOS9 - Error: Unable to find a match: rabbitmq-server 16:08:54 when installing 'dnf install -y rabbitmq-server' 16:08:55 I've not seen it in puppet jobs so I guess it's not a general problem. 16:09:38 indeed, that's weird, master job run worked fine 16:09:42 No match for argument: centos-release-openstack-2024.2 16:09:47 https://zuul.openstack.org/builds?job_name=tempest-integrated-compute-centos-9-stream&project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly&skip=0 16:09:48 I guess it's not yet created 16:09:56 I remember there were some discussions about it in #rdo 16:10:11 I guess we can leave it now until devstack is updated or RDO publishes 2024.2 contents completely 16:10:15 okay, let's then defer this discussion to next week 16:10:28 we'll see whether this fails again 16:10:44 thanks tkajinam for the help 16:10:44 +1 16:10:50 moving on 16:10:59 nothing else about our gate stability ? 16:11:05 context : I wasn't around this week 16:11:37 nothing I'm aware of 16:11:49 ya it sound like the rdo release has not happend yet 16:12:12 we might be able to pin to the 2024.1 content as a workaround 16:12:12 okay, then moving to the next topic 16:12:26 sean-k-mooney: this is a periodic job, we can wait until next week 16:12:37 ah then yes lets move on 16:12:47 #topic Release Planning 16:12:53 #link https://releases.openstack.org/dalmatian/schedule.html 16:12:58 #info Dalmatian GA planned tomorrow 16:13:08 \o/ 16:13:08 that will probably help RDO ^ 16:13:17 #link https://releases.openstack.org/epoxy/schedule.html 16:13:33 as a reminder, we don't have yet nova deadlines for Epoxy, that will be discussed at the PTG 16:13:54 #topic Review priorities 16:14:02 #link https://etherpad.opendev.org/p/nova-2025.1-status 16:14:22 I need to do some homework and add the already approved blueprints in therre 16:15:30 at least gibi's series on igb is there 16:15:40 sounds like a quickwin 16:15:48 #topic PTG planning 16:15:54 #info as a reminder, we'll meet (virtually) at the PTG on Oct 21-25 2024 16:16:00 #info Please register yourself to the virtual PTG 16:16:07 #link https://etherpad.opendev.org/p/nova-2025.1-ptg 16:16:16 please add your topics to the above etherpad 16:16:34 the more we have before the PTG, the better we are prepared and I can write some agenda :) 16:16:56 we'll have the Austin room for the week 16:17:04 (but I think I already said that last week) 16:17:28 any questions about the PTG ? 16:17:54 bauzas: will we have Asia slot? 16:18:05 for the translations docs thing with ian and sungsoo, there is a TC topic about it 16:18:28 gibi: I don't think so, seongsoo and ian had their topic in the TC etherpad 16:18:47 I'll clarify that tonight during the TC meeting 16:19:15 OK, so TC won't have an Asia slot either? 16:19:31 unless of course I see a few topics in the nova PTG etherpad where the owners are in Asian TZ 16:19:52 gibi: that's the question I'll ask tonight :D 16:20:03 cool:) 16:20:30 I'm fine with addressing the translation issues as a cross-project discussion 16:20:42 but I can propose nova for some experimental work 16:20:50 me too, I just need to know in advance if there is an extra schedule 16:21:07 yeah, I want to prepare my mornings :) 16:21:23 should be hopefully settled next week 16:21:32 those sweet lazy mornings of the PTG week :) 16:21:54 for the moment, we stick with the usual slots that are 1300-1700UTC Tues to Fri 16:22:18 ack 16:22:44 #topic Stable Branches 16:22:48 elodilles: heya 16:22:56 #info stable/202*.* gates seem to be OK 16:23:09 at least i'm not aware of any issue :) 16:23:20 and some patches merged, so probably OK 16:23:27 #info note, that stable/2023.1 (antelope) will transition to unmaintained/2023.1 in a month 16:23:45 we might want a release in 1 or 2 weeks ^^^ 16:23:55 time flies 16:23:56 *final* stable/2023.1 release 16:23:58 yepp 16:24:18 and that's all from me about stable for now 16:24:24 one open thought 16:24:44 but I don't want to start a flamewar now 16:24:49 :) 16:25:17 once we unmaintain 2023.1, we will only have one SLURP release 16:25:21 that's maintained 16:25:28 * gibi prepares the torches 16:26:31 giving an extra month before the flag would help people who *really* follow upstream stable support envelope to have more time to upgrade to C 16:27:07 * bauzas awaits the tomatoes 16:27:23 can we move this along? 16:27:32 * gibi hands a torch to bauzas 16:27:40 I don't know, that's a blind question 16:29:24 you know what ? that's not the right place to discuss that and I first need to check the releases support envelopes 16:30:31 but honestly, my thought was about the fact that I can imagine a SLURP release having a shortly longer support envelope than a non-SLURP one (and don't think about LTSes, that's not what I'm thinking) 16:31:01 aw, moving on 16:31:09 bauzas: well, now i'm a bit unsure as well. but i'll check the resolution... 16:31:18 #topic vmwareapi 3rd-party CI efforts Highlights 16:31:18 (unmaintained) 16:31:27 fwiesel: around ? 16:31:53 Not much to update from my side. Still looking into the flakyness of the CI (occasional port failing to get bound) 16:32:16 dansmith: Gentle reminder about the open comment: https://review.opendev.org/c/openstack/nova/+/910627?tab=comments 16:32:21 Otherwise, that's from my side. 16:32:29 cool 16:33:00 and thanks for the update, g'luck with the flakyness 16:33:07 #topic Open discussion 16:33:13 (tkajinam): How can we restore https://review.opendev.org/c/openstack/nova/+/845660 ? 16:33:39 tkajinam: your time 16:33:56 I noticed I left that stale for long and I'm willing to resume that work 16:34:42 the current problem is that os-brick silently falls back to single path connection in case multipath is not running. os-brick introduce the capability to hard-fail in case mulitpath is not running and that is configurable in cinder and glance, but is not in nova 16:34:49 fwiesel: ack, but it's not blocking anything 16:35:11 tkajinam: yeah make sense to pick that up 16:35:28 my main question here is whether this can be spec-less bp or need spec 16:35:53 would there be an upgrade impact ? 16:36:18 no. the option is disabled by default so the existing behavior is kept during upgrade. 16:36:44 seems like fully backward compatible opt-in behavior 16:36:46 dansmith: No, the comment not. I assumed you were volunteering for the second required review core review and hoped I addressed everything outsstanding. 16:36:53 so for me it is OK to have it as specless 16:36:59 on a rolling upgrade case, you'd then have *some* computes that would fail instance creations while some others not ? 16:36:59 yes > full backward compatible. 16:37:35 bauzas: the compute agent will fail to start up if you opt-in to the new behavior but failed to install multipathd 16:37:52 then a doc would be sufficient 16:38:14 do you plan to change the behaviour in a later cycle ? 16:38:36 no. I think we can keep the behavior optional. that's consistent with cinder and glance for now. 16:39:18 then I'm indeed cool with a specless BP, provided we document the option correctly (only turn that flag on if you installed multipathd) 16:40:19 any disagreements ? 16:41:19 so, 16:41:44 #agreed https://blueprints.launchpad.net/nova/+spec/enforce-multipath approved as specless 16:41:59 next item 16:42:02 (tkajinam): Python 3.8 support being removed 16:42:03 sean-k-mooney, in case you have any remaining concerns then please let me know ^^^ 16:42:20 this is again my topic :-P 16:42:51 so as I wrote we are removing python 3.8 support from oslo. This is the timeline we agreed earlier and would move the whole projects to drop python 3.8 support 16:43:32 AFAIK py38 job was removed from most of the nova/placement repos but there are a few remaining in placement I'm trying to replace. if you can review the change and also double-check the other repos, that would be nice 16:43:40 py3.8 upstream support is planned end of Nov, right? 16:43:57 upstream support end* 16:44:20 https://devguide.python.org/versions/ it's reaching its EOL this month 16:44:29 oh this month 16:44:43 so py3.8 is already EOL when Epoxy is released 16:45:00 https://governance.openstack.org/tc/reference/runtimes/2025.1.html 16:45:15 that's not in our runtimes, so I'm cool 16:45:55 tkajinam: if that's review support you need for your patches, bug me 16:46:20 One thing I want to get agreement about is the min version enforced by python_requires in setup.cfg 16:46:32 we can also add your patches in the status etherpad 16:46:37 which actually defines the min python version during installation 16:47:06 do we have a choice here given the Epoxy runtimes ? 16:47:10 My own opinion is that we should bump min to 3.9, because we no longer test 3.8 and we don't aim to fix compatibility with it 16:47:35 yeah, if we don't test it then it is broken 16:47:41 so bump to 3.9 16:48:16 we had issues in the past when we too early dropped a version and some thing went to error, 16:48:34 but i guess with py38 we are probably beyond that line :) 16:48:37 don't ask me to send you the pypi query that shows the number of "py2.7 supported" projects 16:48:53 maybe not merge it before tomorrow final 2024.2 Dalmatian release? :D 16:48:53 elodilles: this was due to some oslo libs 16:49:06 py38 removal has been discussed for very long time and it was even removed from testing in 2024.2 . 16:49:17 and this was also happening very late in the development cycle 16:49:34 yepp 16:49:41 how many projects import nova.* ? 16:50:07 I believe we gave all projects enough time to migrate job and now it's time to force any lagging projects to do their migration. 16:50:17 +1 16:50:25 bauzas, I'm aware of none, but I've not checked external projects really. 16:50:42 well, Blazar did that a decade ago :D 16:50:49 anyway 16:50:51 As I said we may have new releases from oslo in M1 which drops py38 support. that would allow us to catch problems early 16:51:11 +1 16:51:17 I'd say that oslo librairies should may be the latest to change their min versions 16:51:42 or drop it early in the cycle 16:51:45 but we're way in advance, so we can cut the cord now and see which projects fail the gap 16:52:07 elodilles: sure, and then it will become a TC discussion :D 16:52:21 like, project X CI fails, why ? 16:52:27 anyway 16:52:39 :) 16:53:09 tkajinam: from my sole angle of view which is the Nova project, I'd say you can safely bump our min_version in the descriptor, including os-vif and the clients 16:53:19 ok 16:53:42 I'll submit the bump and see how it goes. 16:53:42 anyything else then ? 16:53:50 no :-) thanks for your time. 16:53:55 tkajinam: and don't hesitate to bug me then 16:54:14 tkajinam: thanks for doing the cleanup 16:54:51 yup, thanks indeed 16:55:04 anything else to discuss ? 16:55:05 I just want to point out this patch of mine, which fixes a long-running transgression with us lying to glance about volume snapshots: https://review.opendev.org/c/openstack/nova/+/930754 16:55:35 as far as I could tell while looking, the snap we create for volumes is not useful for actually booting from and was added for a completely unrelated reason ages ago 16:55:46 so i think we might want to consider not doing that anymore if there is no reason 16:56:14 if there is, then we're going to need to consider what we want to do there when we stop allowing nova to boot from unformatted (i.e. raw) images in the future 16:56:27 but I have a lot of history summarized there with links if anyone wants to have a look 16:56:51 that's blocking glance work because we fail in tempest tests to snapshot BFV instances since glance rejects nova's lies that we're uploading a qcow2 when we're clearly not 16:56:56 dansmith: fwiw, I trust you on that yet another image backend story 16:57:06 please trust but verify :) 16:57:17 anyway, no time to discuss in depth now, I need to run to something else but wanted to point it out 16:57:35 dansmith: thanks for the heads up, I have to read your excellent commit message... 16:58:35 dansmith: I'll carefully verify your commit msg then 16:58:38 thanks 16:59:45 bauzas: I feel we are done 16:59:54 yup, and we're on time 17:00:02 perfect :) 17:00:11 I was doing some paperwork to add dansmith's patch into the etherpad 17:00:14 that's his fault 17:00:19 thanks all 17:00:22 #endmeeting