16:00:15 <gibi> #startmeeting nova
16:00:16 <openstack> Meeting started Thu Dec 10 16:00:15 2020 UTC and is due to finish in 60 minutes.  The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:00:17 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
16:00:19 <openstack> The meeting name has been set to 'nova'
16:00:29 <stephenfin> o/
16:01:10 <gibi> o/
16:01:43 <gibi> #topic Bugs (stuck/critical)
16:02:07 <gibi> No critical bug (I guess we forgot to mark the gate blocker bugs as critical)
16:02:20 <gibi> but lets talk about the gate a bit later
16:02:30 <gibi> #link 22 new untriaged bugs (+8 since the last meeting): #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New
16:02:38 <bauzas> \o
16:02:41 <gibi> this is a heavy increase
16:02:49 <stephenfin> oof, for sure
16:02:50 <gibi> we need to look at the untriaged bgugs
16:03:12 <bauzas> no promise but...
16:03:17 <gibi> yeah, same here
16:03:18 <gibi> :)
16:03:25 <gibi> first I put out the fires then maybe
16:03:55 <gibi> any specific bug we need to talk about today? (not the gate blocker ones as those will come in the next topic)
16:04:46 <gibi> #topic Gate status
16:04:54 <gibi> there are many blockers rigth now
16:05:07 <gibi> Gate on master is blocked due to #link https://bugs.launchpad.net/nova/+bug/1907522
16:05:08 <openstack> Launchpad bug 1907522 in OpenStack Compute (nova) "test_*_with_qos_min_bw_allocation fails in the nova-multi-cell job with: nova.exception.MigrationPreCheckError: Migration pre-check error: Failed to create port bindings for host <host>" [High,Triaged] - Assigned to Balazs Gibizer (balazs-gibizer)
16:05:20 <gibi> thanks melwitt for reporting it
16:05:26 <gibi> We need to disable cross cell resize with qos ports tests as the implementation is simply missing. See #link https://review.opendev.org/c/openstack/nova/+/766471
16:05:53 <stephenfin> I just approved that
16:05:57 <gibi> stephenfin: thanks
16:06:01 <stephenfin> Sorry for not getting to it sooner
16:06:22 <gibi> stephenfin: no worries zool haven't reported it back for that yet, but it will report ERROR I see now
16:06:22 <bauzas> we need to backport it, right?
16:06:26 <gmann> o/
16:06:28 <gibi> bauzas: yes
16:06:49 <gibi> Is there anything else blocking the masteR?
16:06:51 <bauzas> victoria to ussuri ?
16:06:56 <bauzas> or train too ?
16:07:00 <gibi> bauzas: up until train I guess
16:07:03 <gibi> bauzas: I will double check
16:07:06 <bauzas> kk
16:07:42 <gibi> if nothing else on the master then moving to stable where the situation is even more complicated
16:07:44 <bauzas> if that relates to resize, we merged it in train, irrc
16:08:04 <gibi> bauzas: yes and yes then
16:08:31 <gibi> so on stable
16:08:34 <gibi> Gate on stable/victoria..stein is blocked due to lower-constraint job fails
16:08:52 <gibi> #link https://bugs.launchpad.net/nova/+bug/1907117
16:08:54 <openstack> Launchpad bug 1907117 in OpenStack Compute (nova) victoria "Could not find a version that satisfies the requirement packaging>=20.4 (from oslo-utils)" [High,In progress] - Assigned to Lee Yarwood (lyarwood)
16:09:16 <gibi> but also
16:09:25 <gibi> Gate on stable/victoria..train is blocked due to nova-multi-cell job fails: #link https://bugs.launchpad.net/nova/+bug/1907511 and due to #link https://bugs.launchpad.net/nova/+bug/1907522
16:09:27 <openstack> Launchpad bug 1907511 in OpenStack Compute (nova) victoria "nova-multi-cell fails on stable branches with: Failed to compute_task_migrate_server: 'NoneType' object has no attribute 'version'" [Undecided,In progress] - Assigned to melanie witt (melwitt)
16:09:28 <openstack> Launchpad bug 1907522 in OpenStack Compute (nova) "test_*_with_qos_min_bw_allocation fails in the nova-multi-cell job with: nova.exception.MigrationPreCheckError: Migration pre-check error: Failed to create port bindings for host <host>" [High,Triaged] - Assigned to Balazs Gibizer (balazs-gibizer)
16:09:57 <gibi> to work around the double block there is a patch that fixes the first bug and disables the nova-multi-cell job temporarly
16:10:08 <gibi> #link https://review.opendev.org/c/openstack/nova/+/765749
16:10:54 <gibi> I will re-enable the nova-multi-cell job on stable when I backport the qos test blacklist patch from master to stable
16:11:16 <gmann> i think we should discuss on pinning the minor version of pip also in devstack side
16:11:39 <gibi> gmann: do you have a bug link for that ?
16:12:16 <bauzas> any help here ?
16:12:21 <bauzas> I'm a bit confused with all the patches
16:12:29 <gmann> gibi:  am thinking how it occur as pip is pined to 23.0 https://review.opendev.org/q/I1feed4573820436f91f8f654cc189fa3a21956fd
16:12:44 <gmann> or we need to pin with minor version too
16:13:14 <gibi> bauzas: lyarwood and elod are on top of the lower constraint issue and will handle the qos blacklisting
16:13:23 <lyarwood> gmann: it's not pinned within virtualenv iirc
16:13:28 <bauzas> kkk, cool then
16:13:56 <gmann> lyarwood: ah I see.
16:14:00 <lyarwood> gmann: a new version of virtualenv pulled in a later version of pip borking the lower-constraints job
16:14:03 <lyarwood> gmann: and others
16:14:18 <lyarwood> gmann: elod has a WIP series up looking at pinning it somehow
16:14:33 <elod> this one: https://review.opendev.org/q/topic:constrain-tox-install
16:14:39 <gmann> lyarwood: yeah, i think we should add for vemv also
16:15:00 <gmann> ok
16:15:08 <elod> this uses the constraints from requirements repository during ensure-tox
16:15:22 <lyarwood> I'm also looking at resolving the issues it's raised as they are real bugs with lower-constraints
16:15:26 <elod> and virtualenv is constrained
16:16:28 <lyarwood> just noticed zuul is still error'ing out some jobs
16:16:35 <lyarwood> so this is all going to take a while
16:16:59 <gibi> yes, we see "`ERROR Failed to update project None in 3s" from Zuul, infra knows about it
16:17:04 <gmann> well that is still open question on how we test the lower-constraint job. on lowest version of deps with lowest available distro or latest one which break it many times
16:17:05 <elod> yes, this issue reveals real contradictions between (test-)requirements.txt and lower-constraints, that wasn't picked up by pip with the old resolver
16:17:20 <gmann> elod: exactly
16:18:00 <lyarwood> gmann: in terms of pip I'd like to use the latest version with the fixed dep resolver
16:18:09 <gibi> OK there is one more problem on stable
16:18:11 <gibi> Gate on stable/train..pike is blocked due to broken bandit release
16:18:23 <gibi> which is also being worked on as far as I know
16:18:58 <elod> gibi: with this series: https://review.opendev.org/q/topic:bug%252F1907438
16:18:58 <lyarwood> gibi: yeah it's looking more likely that the 1.6.3 release is going to be yanked now and replaced by a non-universal 1.6.4 release
16:19:12 <elod> plus  what lyarwood says ^^^ :)
16:19:51 <lyarwood> at least it isn't rc :)
16:20:05 <gibi> elod, lyarwood: ack thanks
16:20:06 <elod> indeed :]
16:20:18 <gibi> any other gate issue we need to be aware off?
16:20:29 <lyarwood> oh I think that's enough fire for one meeting ^_^
16:20:39 <elod> we will see ;)
16:20:46 <gibi> lyarwood: definitely
16:21:03 <gibi> then moving on
16:21:04 <gibi> #topic Release Planning
16:21:09 <gibi> Wallaby Milestone 1 was last week. Milestone 2 is 22nd of Jan
16:21:41 <gibi> so after all the fires we should progress with features :)
16:21:57 <gibi> any other release specific thing to discuss?
16:22:50 <lyarwood> gibi: I assume we will not have another spec review day until the new year?
16:23:07 <gibi> lyarwood: I'm not planning, we have 11 approved bps that is plenty
16:23:32 <gibi> but if some spec  needs review then let me know
16:23:40 <gibi> or ping other fellow cores
16:23:46 <lyarwood> gibi: ack understood, I've got a libvirt specific spec to write for the ephemeral encryption bp, I'll ping people about it in the coming week
16:24:00 <gibi> lyarwood: ack,
16:24:22 <gibi> #topic Stable Branches
16:24:29 <gibi> elod's note: due to multiple gate issues, mostly fire fighting work is happening
16:24:46 <gibi> anything else about stable?
16:25:17 <lyarwood> nothing from me
16:25:20 <gibi> #topic Sub/related team Highlights
16:25:26 <gibi> Libvirt (bauzas)
16:25:35 <bauzas> nothing to report, sir.
16:25:52 <gibi> ack
16:25:52 <gibi> #topic Open discussion
16:25:57 <gibi> nothing on the agenada
16:25:58 <gibi> agenda
16:26:02 <gibi> but I have one
16:26:24 <gibi> I will be out between 21st of Dec and 4th of Jan. So I will not chair the nova meeting
16:26:44 <gibi> if no objections then I will cancel the meetings inbetween
16:26:59 <gibi> if there is objections then we need a chair :D
16:27:04 <stephenfin> cancel it
16:27:17 <stephenfin> most people will be in the same boat I suspect
16:27:26 <gibi> yepp
16:27:30 <gmann> yeah, cancel is ok
16:27:52 <gibi> OK, anything else for today to discuss?
16:28:27 <stephenfin> not from me
16:28:41 <gibi> then let's go back to firefighting mode
16:28:50 <gibi> thank you all for joining today
16:29:08 <gibi> #endmeeting