16:00:29 <gibi> #startmeeting nova
16:00:30 <openstack> Meeting started Thu Mar 18 16:00:29 2021 UTC and is due to finish in 60 minutes.  The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:31 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
16:00:33 <openstack> The meeting name has been set to 'nova'
16:00:36 <gibi> \o
16:00:48 <lyarwood> \o
16:00:58 <elod> o/
16:01:10 <dansmith> .
16:01:49 * kashyap waves and lurks
16:02:09 <gibi> #topic Bugs (stuck/critical)
16:02:25 <gibi> no critical bugs
16:02:36 <gibi> no wallaby-rc-potential bugs
16:02:47 <gibi> #link 17 new untriaged bugs (-1 since the last meeting): #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New
16:03:20 <gibi> any specific bug we need to talk about?
16:04:10 <gibi> #topic Gate status
16:04:27 <gibi> It was pretty hard to push through all the approved patches
16:04:55 <gibi> I saw mostly cinder related issues
16:05:09 <dansmith> jungleboyj: ^ :)
16:05:11 <lyarwood> I've been unable to prove what is actually going on with the detach issues btw
16:05:23 <gmann> o/
16:05:28 <lyarwood> I still think it's realted to tgtd
16:05:31 <jungleboyj> ack
16:05:36 <lyarwood> and my lioadm change is ready to go
16:05:38 <dansmith> lyarwood: I've been bringing up the cinder issues in the tc meeting for a while
16:05:50 <dansmith> I think post release it might "take a village" to help with some of that
16:05:51 <lyarwood> dansmith: just volume detach or others as well?
16:05:59 <dansmith> lyarwood: there are lots of delete-related fails
16:06:15 <dansmith> this kind of thing: Details: Volume 64dbe7da-4b46-46b3-aeac-759b52ee39ee failed to delete and is in error_deleting status,
16:06:33 <gibi> I agree that post release we should focus on fixing these
16:06:40 <lyarwood> dansmith: yeah that can happen if the detach failed I think
16:06:59 <dansmith> lyarwood: well, I see it in cinder-only tests I think, where it never gets attached to a server, that I know of
16:07:06 <lyarwood> ah kk
16:07:11 <dansmith> like when snapshots are done or something
16:07:20 <dansmith> but I haven't kept super tight notes on it I guess
16:07:24 <lyarwood> https://bugs.launchpad.net/cinder/+bug/1917750 is what I was talking about
16:07:26 <openstack> Launchpad bug 1917750 in Cinder "Running parallel iSCSI/LVM c-vol backends is causing random failures in CI" [High,In progress] - Assigned to Lee Yarwood (lyarwood)
16:07:36 <lyarwood> https://review.opendev.org/c/openstack/devstack/+/779624 being the change I've suggested to move to lioadm
16:07:36 <dansmith> yeah
16:08:17 <gibi> any other gate issue we need to talk about?
16:08:57 <gibi> #topic Release Planning
16:09:05 <gibi> Feature Freeze was last week
16:09:10 <gibi> Everything has been merged that was approved til FF.
16:09:18 <gibi> FFE is granted for the VDPA series which mostly landed since. We have one outstanding patch blocking unsupported server lifecycle operations with VDPA #link https://review.opendev.org/c/openstack/nova/+/780333/5
16:09:39 <gibi> let's get backt to this patch at the end ^^
16:09:59 <gmann> +1
16:10:11 <gibi> the rpc 6.0 major bump is proposed by bauzas #link https://review.opendev.org/c/openstack/nova/+/761452
16:10:30 <bauzas> oh shit, trampled by the dst shift \o
16:10:53 <gibi> I think the patch is ready to land
16:10:55 <bauzas> (even if we haven't shifted already, but...)
16:11:06 <gibi> hence my +2
16:11:48 <bauzas> the grenade jobs seem happy with it, at least.
16:12:06 <bauzas> the multinode one being the most important
16:12:09 <gibi> I'm happy too :) and dansmith was mostly happy in ps11 and since then only small changes was made
16:12:49 <gibi> moving on
16:12:54 <gibi> We implemented 13 out of the 20 (65%) approved blueprints in Wallaby. This is a better result than in the last cycle.
16:12:56 <bauzas> also, if people want to review, that would be awesome as it looks to me that not a lot of people know how to provide a new major API version
16:14:45 <dansmith> yep, was mostly happy
16:14:55 <dansmith> I will try to get to it before EOD today, but not super likely
16:15:12 <gibi> dansmith: ack thanks
16:15:21 <gibi> from the release perspective the next step is to provide an RC1 next week
16:15:32 <gibi> the deadline is Thursday
16:15:52 <gibi> Here is the release tracking ether pad #link https://etherpad.opendev.org/p/nova-wallaby-rc-potential with TODOs
16:15:53 <gibi> please use wallaby-rc-potential tag on bugs that you consider warranting a new RC if fixed
16:15:58 <gibi> bauzas volunteered to write the reno prelude
16:16:07 <gibi> that also due next week
16:16:09 <bauzas> yup, I started ^
16:16:12 <gibi> cool
16:16:48 <gibi> anything else about the release?
16:16:57 <bauzas> gibi: I guess you wrote the cycle highlights ?
16:17:05 <gibi> bauzas: yep that is done, merged
16:17:10 <bauzas> kk
16:17:34 <gibi> the VDPA amendment of the highlgith is open and I will unblock it once the VDPA patches land
16:17:44 <bauzas> gtk
16:18:11 <bauzas> also, I'll try to look at open bugfixes during the week
16:18:38 <gibi> yep, it is bugtriage and bugfix time
16:19:01 <gibi> #topic PTG planning
16:19:07 <gibi> PTG will be held April 19-23, 2021
16:19:12 <gibi> Use the PTG etherpad to collect topics: #link https://etherpad.opendev.org/p/nova-xena-ptg
16:19:19 <gibi> Please fill the doodle about the timing of the nova slots before end of this week #link https://doodle.com/poll/ib2eu3c4346iqii3
16:19:29 <kashyap> gibi: (Thx for the new bugs links there; there are some that look slightly worrisome.  But they're not very repetable so far, though)
16:20:50 <gibi> kashyap: do you suspect some of those are regressed in Wallaby?
16:21:23 <kashyap> gibi: Not by Nova code itself ... but Nova might've uncovered "integration" bugs w/ libvirt and QEMU
16:21:32 <kashyap> E.g. thisn annoying "tight loop' bug - https://bugs.launchpad.net/nova/+bug/1902276
16:21:33 <openstack> Launchpad bug 1902276 in OpenStack Compute (nova) "libvirtd going into a tight loop causing instances to not transition to ACTIVE" [Undecided,New]
16:22:00 <kashyap> This is Wallaby-only; and Nova and upstream CI is good at uncovering these kind of bugs over the years.
16:22:28 <kashyap> But we can talk about it on -nova channel; don't want to hold up the meeting
16:23:07 <gibi> kashyap: ack
16:23:33 <gibi> if this is a wallaby regression the please tag it with wallaby-rc-potential
16:23:47 <gibi> anything else about the PTG planning?
16:24:48 <lyarwood> oh just that I've added a cinder cross project section
16:24:54 <lyarwood> did you want me to reach out to them about this?
16:25:41 <gibi> lyarwood: yes please, it would be nice to have the cross project discussions on Wednesday on the PTG
16:25:49 <gibi> if possible
16:25:51 * lyarwood makes a note
16:25:54 <gibi> but we can be flexible
16:25:55 <lyarwood> ack I'll reach out and ask
16:26:09 <gibi> thanks
16:26:27 <gibi> #topic Stable Branches
16:26:33 <gibi> copying from the agenda
16:26:37 <gibi> gate of stable/victoria is broken (nova-ceph-multistore job), Lee has fixes which are approved (bug: https://bugs.launchpad.net/glance/+bug/1919993 )
16:26:38 <openstack> Launchpad bug 1919993 in Glance "test_image_web_download_import_with_bad_url failing within nova-ceph-multistore on stable/victoria" [Undecided,New]
16:26:42 <gibi> gate of rest of the stable branches should be OK
16:26:48 <gibi> nova victoria (22.2.0), ussuri (21.2.0), train (20.6.0) was released on Monday
16:26:51 <gibi> EOM
16:27:18 <gibi> thanks elod for the summary
16:27:25 <elod> np
16:27:32 <gibi> anything else from stable to adD?
16:27:39 <lyarwood> Nope, thanks
16:27:40 <elod> nothing from me
16:27:54 <gibi> #topic Sub/related team Highlights
16:27:59 <gibi> Libvirt (bauzas)
16:28:07 <bauzas> nothing to report, sir.
16:28:36 <gibi> tanks
16:28:42 <gibi> #topic Open discussion
16:28:46 <gibi> nothing on the agenda
16:28:48 <gibi> but I have a topic
16:29:19 <gibi> we have the patch that blocks unsupporte dVM lifecycle ops with VDPA  https://review.opendev.org/c/openstack/nova/+/780333/
16:29:30 <gibi> and it got stuck on the HTTP response code
16:29:41 <gmann> Yeah we are doing 400, 409, and 403 for 'feature not implemented'.
16:29:51 <gmann> I added this a topic to discuss in PTG, L267 https://etherpad.opendev.org/p/nova-xena-ptg
16:30:01 <gmann> so that we find one consistent and discuss in detail
16:31:00 <gmann> for 780333, I am ok with any approach either 409 or 400 and after PTG discussion we can change it for all the existing APIs.
16:31:25 <gibi> gmann: OK, so we can land the patch as is today and then fix the return code in X?
16:31:34 <gmann> changing the return code to any consistent one will not require microversion bump
16:31:45 <gibi> along with fixing the other 409 and 403 return codes
16:31:47 <gmann> gibi: yeah, fix for all the APIs  'feature not implemented'.
16:31:51 <gmann> yeah
16:32:05 <gibi> OK, that seems like a good compromise
16:32:16 <gmann> yeah there is no point to block this.
16:32:39 <gibi> any objection?
16:32:53 <gibi> to return 409 now?
16:33:17 <gmann> I have converted my -1 to +2
16:33:28 <gibi> thank you gmann stephenfin sean-k-mooney for the discussion
16:33:43 <kashyap> gibi: Commenting out of sequence: On the earlier bug, just read through our comments again.  It's not a regression yet; could still be an env issue w/ the Octavia project's CI.
16:33:43 <stephenfin> nw. Good to get this sorted. Thanks all for the input
16:34:01 <gibi> kashyap: ack
16:34:34 <gibi> gmann, stephenfin: OK I will +W the patch after the meeting and queue up the func test and reno patch behind it
16:34:43 <gmann> +1, thanks
16:34:55 <gibi> any other topic for today?
16:36:42 <gibi> if not then thanks for joining
16:36:48 <gibi> o/
16:37:08 <gmann> thanks
16:37:10 <gibi> #endmeeting