Thursday, 2021-04-15

*** mlavalle has quit IRC00:04
*** baojg has quit IRC00:30
*** baojg has joined #openstack-meeting-300:31
*** ianychoi has joined #openstack-meeting-300:46
*** hemanth_n has joined #openstack-meeting-302:40
*** psachin has joined #openstack-meeting-303:39
*** lajoskatona has joined #openstack-meeting-305:48
*** slaweq has quit IRC05:55
*** slaweq_ has joined #openstack-meeting-305:55
*** slaweq_ is now known as slaweq05:55
*** eolivare has joined #openstack-meeting-306:09
*** ralonsoh has joined #openstack-meeting-306:10
*** baojg has quit IRC06:28
*** slaweq_ has joined #openstack-meeting-306:30
*** slaweq has quit IRC06:36
*** slaweq_ is now known as slaweq06:36
*** tosky has joined #openstack-meeting-307:46
*** hemanth_n has quit IRC08:32
*** slaweq has quit IRC08:51
*** slaweq has joined #openstack-meeting-308:51
*** baojg has joined #openstack-meeting-309:45
*** baojg has quit IRC10:02
*** baojg has joined #openstack-meeting-310:03
*** psahoo has joined #openstack-meeting-310:12
*** e0ne has joined #openstack-meeting-310:24
*** baojg has quit IRC10:24
*** baojg has joined #openstack-meeting-310:26
*** e0ne has quit IRC10:37
*** baojg has quit IRC10:55
*** baojg has joined #openstack-meeting-310:57
*** psachin has quit IRC11:00
*** baojg has quit IRC11:04
*** baojg has joined #openstack-meeting-311:05
*** psahoo_ has joined #openstack-meeting-311:28
*** psachin has joined #openstack-meeting-311:29
*** psahoo has quit IRC11:31
*** yamamoto has quit IRC11:51
*** baojg has quit IRC11:59
*** yamamoto has joined #openstack-meeting-311:59
*** baojg has joined #openstack-meeting-312:00
*** yamamoto has quit IRC12:04
*** e0ne has joined #openstack-meeting-312:08
*** baojg has quit IRC12:36
*** baojg has joined #openstack-meeting-312:38
*** yamamoto has joined #openstack-meeting-312:46
*** yamamoto has quit IRC12:57
*** e0ne has quit IRC13:24
*** e0ne has joined #openstack-meeting-313:26
*** e0ne has quit IRC13:26
*** e0ne has joined #openstack-meeting-313:28
*** e0ne has quit IRC14:02
*** e0ne has joined #openstack-meeting-314:03
*** lassimus has joined #openstack-meeting-314:57
*** belmoreira has joined #openstack-meeting-314:57
*** lassimus has quit IRC15:07
*** lassimus has joined #openstack-meeting-315:29
*** lassimus has quit IRC15:33
*** mlavalle has joined #openstack-meeting-315:36
*** lassimus has joined #openstack-meeting-315:38
*** chuan137 has joined #openstack-meeting-315:50
*** psahoo_ has quit IRC15:53
*** psahoo has joined #openstack-meeting-315:57
*** AlysonR has joined #openstack-meeting-315:59
gibi#startmeeting nova16:00
openstackMeeting started Thu Apr 15 16:00:24 2021 UTC and is due to finish in 60 minutes.  The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: nova)"16:00
openstackThe meeting name has been set to 'nova'16:00
gibio/16:00
*** elod has joined #openstack-meeting-316:00
*** lassimus has quit IRC16:01
gansoo/16:01
lyarwoodo/16:01
elodo/16:02
gibi#topic Bugs (stuck/critical)16:02
*** openstack changes topic to "Bugs (stuck/critical) (Meeting topic: nova)"16:02
gibiNo Critical bugs16:02
bauzas\o16:02
gibi#link 18 new untriaged bugs (+4 since the last meeting): #link https://bugs.launchpad.net/nova/+bugs?search=Search&field.status=New16:02
gibiIt seems that the gerrit - launchpad integration started to work so bug status expected to be updated automatically from gerrit again.16:02
gibiDetails: #link http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2021-04-15.log.html#t2021-04-15T14:28:2116:02
dansmitho/16:02
stephenfino/16:02
gibiis there any specific bug we need to talk about?16:03
*** lassimus has joined #openstack-meeting-316:03
stephenfinThere's that gate bug, but I guess we'll get to it shortly16:03
gibiyupp16:03
gibianything else on bug side?16:03
gibi#topic Gate status16:04
*** openstack changes topic to "Gate status (Meeting topic: nova)"16:04
gibiWe have a high failure rate in the live migration job due to #link https://bugs.launchpad.net/tempest/+bug/192425816:04
openstackLaunchpad bug 1924258 in tempest "test_live_migration_with_trunk fails intermittently" [Undecided,In progress] - Assigned to Lajos Katona (lajos-katona)16:04
gibistephenfin: Is this you wanted to add? ^^16:05
gibiit just got a WIP patch #link https://review.opendev.org/c/openstack/tempest/+/78646516:05
stephenfinthat's the one16:05
gibiany other gate issue we should know about?16:06
gmanno/16:06
gibi#topic Release Planning16:07
*** openstack changes topic to "Release Planning (Meeting topic: nova)"16:07
gibiWallaby has been released16:07
gibiThank you all who made it happen! \o/16:07
gibiWallaby project update call happened today, the recording is available here: #link https://www.youtube.com/watch?v=tZ2bfdF0fOg16:07
gibiWe need two patches to land to fully open the master to Xena16:07
gibi#link https://review.opendev.org/c/openstack/nova/+/78217116:07
gibi#link https://review.opendev.org/c/openstack/nova/+/77892316:07
gibineeds some eyes from cores ^^16:08
gibiany other release info?16:08
stephenfinI'm +2 on both of those now16:09
gibistephenfin: thanks!16:10
stephenfinneeds another +2 for https://review.opendev.org/c/openstack/nova/+/78217116:10
gibi#topic PTG planning16:10
*** openstack changes topic to "PTG planning (Meeting topic: nova)"16:10
gibiPTG is next week!16:10
gibitopics: #link https://etherpad.opendev.org/p/nova-xena-ptg16:10
bauzasI miss you all folks16:10
gibime too16:10
*** lajoskatona has quit IRC16:10
* bauzas needs to prepare the PTG... by filling up his keg16:11
gibirecent updates in the ptg schedule:16:11
gibiA small neutron - nova cross project is booked for Friday 15:00 UTC, we have only one topic.16:11
gibiAlso there was a request for an interop session from Arkady and it is booked to Wednesday 14:00 UTC16:11
gibiI did a minimal reorg on the nova topics but the basic rule that we well go from top to bottom and potentially defer topics if the author / expert is not available.16:11
gibiif anybody has a topic that needs special timing then let me know and I will note it16:12
gibiand try to schedule it16:12
gibiptg bot is up to date #link http://ptg.openstack.org/ptg.html16:12
gibinext week we will skip the weekly meeting due to PTG16:13
gibianything else about next week and the PTG?16:14
gibi#topic Stable Branches16:15
*** openstack changes topic to "Stable Branches (Meeting topic: nova)"16:15
gibistable/wallaby is open for bug fix backports16:15
gibistable gates should be OK from Wallaby till Pike (stackviz post-task workarounds are merged)16:15
gibiEOM16:15
gibithanks elod for the update16:15
elodnp16:15
gibianything else on stable?16:16
elodnothing else from me16:16
gmann+116:17
bauzashow are the stable branch jobs ?16:17
gmannit should be green now after stackviz workaround and grenade stable/train fixes16:18
*** psahoo has quit IRC16:18
gmannthis on pike merged 5 days ago, so should be all green https://review.opendev.org/c/openstack/nova/+/72305516:19
elodyes, as I saw they are OK, thanks for the fixes16:19
bauzasthanks16:20
gibi#topic Sub/related team Highlights16:20
*** openstack changes topic to "Sub/related team Highlights (Meeting topic: nova)"16:20
gibiLibvirt (bauzas)16:20
*** lassimus87 has joined #openstack-meeting-316:20
bauzaswell, mnaser filed a complaint about how bad I write libvirt features16:21
bauzasso, now, in order to avoid jail, I have to work on https://bugs.launchpad.net/nova/+bug/1900800 and deliver appropriate backports16:21
openstackLaunchpad bug 1900800 in OpenStack Compute (nova) "VGPUs is not recreated on host reboot" [Low,Confirmed] - Assigned to Sylvain Bauza (sylvain-bauza)16:21
bauzasthat's it.16:21
gibiI saw you found a way forward about it16:21
bauzas(this was a joke, to be 100% clear)16:22
bauzasmoving on16:22
gibi#topic Open discussion16:22
*** openstack changes topic to "Open discussion (Meeting topic: nova)"16:23
lassimus87I'd like to discuss adding support for guests with arch != host arch. I'm tracking @stephenfin and others topics in ptg etherpad. I have a working concept here: https://review.opendev.org/c/openstack/nova/+/772156. I've been afk for the last few weeks waiting out the wallaby release period, so I have some new merge conflicts to resolve. I'm16:23
lassimus87bringing it up here because there seems to be differing opinions on the direction of nova regarding emulation support.16:23
gibilassimus87: could you open up what are the differing options?16:23
*** mlavalle has quit IRC16:23
*** _mlavalle_1 has joined #openstack-meeting-316:24
bauzasthis rings me a bell.16:24
lassimus87"Only conflict is if we ever wanted to support non-host guests using these architectures but that seems to be a non-goal of nova?(maybe we shoudl rephsase this as dropping supprot for 32bit hosts) that might be a valid cross project goal." --@stephenfin from the xena ptg notes16:24
bauzasbelmoreira was interested in this, if I recall correctly16:24
*** lassimus has quit IRC16:24
*** lassimus87 is now known as lassimus16:24
lassimusokay I got my nick back :)16:24
stephenfinI think this would be worth discussing at the PTG, if possible16:25
stephenfinMy point there is that we tend to conflate host and guest architectures, since we've haven't support host != guest architecture for some time now16:25
lassimusI'm fine waiting to discuss until the PTG. I'm new to the nova dev community, so I didn't want to add discussion directly to etherpad16:26
gibilassimus: feel free to add discussion to the ptg etherpad16:26
stephenfinWe have checks for things like MIPS, which no new hardware is being made for, which means we could drop the host architecture support, but I'm not sure if we can drop the guest architecture support16:26
stephenfinso yeah, a good PTG topic16:26
gibilassimus: will you be able to join us during the PTG next week?16:27
lassimusawesome. I'll add some thoughts on etherpad, and I look forward to hashing it out next week16:27
lassimusyes16:27
gibilassimus: I will make sure to ping you when we reach this topic next week16:27
lassimusperfect16:28
gibiI do feel that we had guest != host request from CERN so you are not alone16:28
bauzasright, hence my courtesy ping to belmoreira :)16:28
gibibauzas: ++16:28
lassimusmy customer is the Georgia Cyber Center, and some other minor interested parties16:28
gibilassimus: cool16:29
bauzasthat's a reasonable ask, but we need to discuss the design16:29
* artom thought there was a massive emulation performance penalty on that, last time he checked16:29
artomThough I guess it depends on the specific arch's16:29
bauzasartom: yup, from my recollection16:29
lassimusperformance isn't always the goal16:29
bauzasbut there are good reasons now to mix them up16:29
artomSo I am a bit curious what use cases don't mind the perf hit16:29
bauzasspec up !16:29
bauzas:p16:29
bauzasunkidding, sounds a good PTG discussion16:30
gibiartom: I can imagine a CI system functional testing arch specific app in a cheap way16:30
gibippc tend to be expensive16:30
lassimusyeah, I'm happy to brain dump here, but it seems like a better fit for the PTG16:30
gibisure, lets do the braindumping next week16:30
gibiany other topic for today?16:31
gansogibi: o/ my topic is on the agenda16:31
gibiganso: ohh, I missed that, please tell us16:31
gansotopic: update on bug 1821755 (ganso)16:31
openstackbug 1821755 in OpenStack Compute (nova) "live migration break the anti-affinity policy of server group simultaneously" [Medium,In progress] https://launchpad.net/bugs/1821755 - Assigned to Boxiang Zhu (bxzhu-5355)16:31
gansoso, I've brought this up in a meeting previously about addressing this bug16:31
*** psahoo has joined #openstack-meeting-316:32
gansobut I leaned towards a redesign of the (anti-)affinity functionality in placement16:32
gansoI spent a significant amount of effort on that and hit several struggles. It can be done, but the amount of work and complexity has increased far beyond what I initially estimated16:32
bauzasaffinity in placement is a can of worms16:33
gansobauzas: yea, looks like I hit some of those worms xD16:33
gansotherefore I decided to take a step back and try a simpler alternative16:33
artomAngry worms, with teeth and spikes and venomous stingers16:33
bauzasI thought we said we should model the affinity between RPs as a distance between them16:33
gansovoi-la https://review.opendev.org/c/openstack/nova/+/78416616:33
gansobasically I took inspiration from a previous attempt on solving the bug (https://review.openstack.org/651969)16:34
gansoand did some things differently16:34
bauzasganso: I discover the bug, what's the problem ?16:34
gansoin my testing I was not able to reproduce the issue for anti-affinity any longer16:34
gansobauzas: sorry I didn't understand your question?16:35
bauzasdon't we have the late affinity check ?16:35
bauzason the compute service16:35
gibibauzas: I think this patch now adds the late affinity check for live migration16:35
bauzasor have we removed it?16:35
gansobauzas: oh ok, so the problem is that there are race conditions that violate the policy when doing concurrent migrations (live or cold)16:35
artombauzas, yeah, we only have that check for boot, and no other move operation16:35
bauzasartom: really? I'm surprised16:35
artomI'm not :P16:36
gansobauzas: the existing check worked only for when creating instances, and it doesn't account for instances are being migrated to that host16:36
bauzasactually reading mriedem's comment16:36
bauzasokay, this sounds a decent review request then16:36
gibiyeah, I queued it up to my review list16:37
artomI mean, I agree the "correct" way to do it would be placement16:37
artomAnything else is hax.16:37
*** e0ne has quit IRC16:37
artomOTOH, the former is hard, and the latter is much quicker and easier16:37
gibiand I agree that affinity and placement is a hard topic so I have no problem having a hax in the meantime16:37
gansothere is a lengthy discussion on the gerrit page, I tried to address all comments with as much detail as I can to move this forward. There is also a summary of my work in the redesign in one of the comments (the lenghiest one)16:37
gansogibi, artom: so, the patch I'm proposing only addresses anti-affinity, not affinity16:38
gibiganso: thanks for picking this work up I will try to get to it tomorrow16:38
gansothose are 2 different can of worms, and I found the affinity ones to be the most venomous ones :P16:38
bauzasganso: which is what the late-affinity check is doing16:38
bauzasviolating the affinity policy isn't a race for a single compute16:39
gansodoing both through placement is a huge amount of work. Doing just one leaves things hanging and incomplete, possibly requiring another redesign for implementing the other one16:39
bauzasyou just don't see the race as both instances are spreaded16:39
bauzasganso: I totally agree and I fundamentally disagree with sean-k-mooney's objection :)16:40
bauzassad he isn't here :)16:40
gansobauzas: yea I use 5 computes in my lab, makes it much easier to reproduce and visualize the violations16:40
gansothat's all I had. Thanks all and looking forward to your reviews :)16:41
gibiganso: thanks for working on the bug16:41
bauzasyup16:41
gibianything else for today?16:41
*** _mlavalle_1 has quit IRC16:42
gibiif not then I thank all of you to join today16:42
gibiI will have glass of vine for the wallaby release. thanks again to make that happen16:43
gibinot the wine, the release :D16:43
gibi#endmeeting16:43
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:43
openstackMeeting ended Thu Apr 15 16:43:56 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:43
openstackMinutes:        http://eavesdrop.openstack.org/meetings/nova/2021/nova.2021-04-15-16.00.html16:43
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/nova/2021/nova.2021-04-15-16.00.txt16:44
openstackLog:            http://eavesdrop.openstack.org/meetings/nova/2021/nova.2021-04-15-16.00.log.html16:44
*** lassimus has quit IRC16:44
elodthanks o/16:44
elodand enjoy the wine :D16:44
*** psahoo has quit IRC16:52
*** yamamoto has joined #openstack-meeting-316:53
*** eolivare has quit IRC16:55
*** eolivare has joined #openstack-meeting-316:59
*** mlavalle has joined #openstack-meeting-317:05
*** AlysonR has left #openstack-meeting-317:07
*** ralonsoh has quit IRC17:12
*** eolivare has quit IRC17:14
*** yamamoto has quit IRC17:18
*** belmoreira has quit IRC17:42
*** lajoskatona has joined #openstack-meeting-317:51
*** lajoskatona has quit IRC18:01
*** BakaKuna has joined #openstack-meeting-318:11
*** lajoskatona has joined #openstack-meeting-318:14
*** belmoreira has joined #openstack-meeting-318:34
*** e0ne has joined #openstack-meeting-319:03
*** e0ne has quit IRC19:04
*** e0ne has joined #openstack-meeting-319:05
*** baojg has quit IRC19:16
*** baojg has joined #openstack-meeting-319:18
*** e0ne has quit IRC19:24
*** baojg has quit IRC19:50
*** baojg has joined #openstack-meeting-319:52
*** macz_ has joined #openstack-meeting-319:55
*** lajoskatona has quit IRC20:14
*** chuan137 has quit IRC20:18
*** BakaKuna has quit IRC21:04
*** belmoreira has quit IRC21:23
*** yamamoto has joined #openstack-meeting-322:31
*** tosky has quit IRC22:34
*** yamamoto has quit IRC22:35
*** yamamoto has joined #openstack-meeting-322:36
*** macz_ has quit IRC23:16
*** macz_ has joined #openstack-meeting-323:20
*** macz_ has quit IRC23:25

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!