Wednesday, 2020-03-11

*** brinzhang has quit IRC00:04
*** igordc has joined #openstack-nova00:12
*** gyee has quit IRC00:13
openstackgerritMerged openstack/nova master: Don't overwrite greenthread-local context in host manager  https://review.opendev.org/58233200:28
*** tosky has quit IRC00:28
melwittrm_work: if you're around, do you recall what version you tried your test with re: your comment on this bug? https://bugs.launchpad.net/nova/+bug/186319000:29
openstackLaunchpad bug 1863190 in OpenStack Compute (nova) "Server group anti-affinity no longer works" [Undecided,New]00:29
*** iurygregory has quit IRC01:17
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: Add retry_on_deadlock to migration_update DB API  https://review.opendev.org/71221201:22
*** TxGirlGeek has quit IRC01:27
*** tbachman has quit IRC01:27
*** tbachman has joined #openstack-nova01:28
*** tbachman_ has joined #openstack-nova01:34
*** tbachman has quit IRC01:35
*** tbachman_ is now known as tbachman01:35
*** brinzhang has joined #openstack-nova01:38
*** mlavalle has quit IRC01:38
*** larainema has joined #openstack-nova01:53
*** lbragstad_ has quit IRC01:56
*** TxGirlGeek has joined #openstack-nova01:56
*** lbragstad_ has joined #openstack-nova01:58
*** zhanglong has joined #openstack-nova02:07
*** happyhemant has quit IRC02:09
*** hongbin has joined #openstack-nova02:20
*** hongbin has quit IRC02:39
openstackgerritmelanie witt proposed openstack/nova master: Add config option for neutron client retries  https://review.opendev.org/71222602:43
*** lbragstad_ has quit IRC02:57
*** mkrai has joined #openstack-nova02:57
*** TxGirlGeek has quit IRC03:03
*** psachin has joined #openstack-nova03:26
*** igordc has quit IRC03:30
*** udesale has joined #openstack-nova05:07
openstackgerritMerged openstack/nova stable/queens: libvirt: Ignore DiskNotFound during update_available_resource  https://review.opendev.org/71127905:07
*** Liang__ has joined #openstack-nova05:09
*** evrardjp has quit IRC05:35
*** evrardjp has joined #openstack-nova05:35
rm_workmelwitt: so that was on rocky -- but we figured out that we had build retries set to 0 so it would never retry, thus breaking that logic05:36
*** links has joined #openstack-nova05:36
rm_workAnd with soft antiaffinity, obviously it would just "work" and so given certain packing schemes, we're almost guaranteed to have them land on the same host, which seems kinda dumb05:37
rm_workThe conclusion we came to is that relying on the retry behavior to fix schedule races did not seem like a good approach05:38
rm_workAnd that there should be better more up front ways of handling that kind of locking05:38
rm_workOctavia does similar locking using DB logic05:39
*** tetsuro has joined #openstack-nova05:52
*** rcernin has quit IRC05:58
*** brinzhang has quit IRC06:19
rm_workmelwitt: johnsom could detail some of that more probably06:19
*** ratailor has joined #openstack-nova06:26
*** ratailor has quit IRC07:07
*** dpawlik has joined #openstack-nova07:17
*** ratailor has joined #openstack-nova07:18
*** iurygregory has joined #openstack-nova07:29
*** maciejjozefczyk has joined #openstack-nova07:49
*** ccamacho has joined #openstack-nova07:57
*** damien_r has joined #openstack-nova07:58
*** tesseract has joined #openstack-nova08:02
*** slaweq has joined #openstack-nova08:03
*** tkajinam has quit IRC08:14
*** psachin has quit IRC08:15
*** mkrai has quit IRC08:18
*** mkrai has joined #openstack-nova08:25
*** tosky has joined #openstack-nova08:28
*** amoralej|off is now known as amoralej08:31
*** sapd1_x has quit IRC08:36
*** ralonsoh has joined #openstack-nova08:47
*** tetsuro has quit IRC08:49
*** gouthamr has quit IRC08:49
*** mgoddard has quit IRC08:49
*** gouthamr has joined #openstack-nova08:50
*** mgoddard has joined #openstack-nova08:50
*** vishalmanchanda has joined #openstack-nova08:56
*** dtantsur|afk is now known as dtantsur08:56
*** rpittau|afk is now known as rpittau08:58
*** xek has joined #openstack-nova09:01
*** zhanglong has quit IRC09:03
*** belmoreira has joined #openstack-nova09:13
*** ociuhandu has joined #openstack-nova09:16
*** martinkennelly has joined #openstack-nova09:16
*** udesale_ has joined #openstack-nova09:27
*** udesale has quit IRC09:30
*** ociuhandu has quit IRC09:38
*** derekh has joined #openstack-nova09:42
*** ccamacho has quit IRC09:44
*** ociuhandu has joined #openstack-nova09:50
*** mkrai_ has joined #openstack-nova10:05
*** mkrai has quit IRC10:08
-openstackstatus- NOTICE: The mail server for lists.openstack.org is currently not handling emails. The infra team will investigate and fix during US morning.10:26
*** brinzhang has joined #openstack-nova10:37
*** martinkennelly has quit IRC10:48
*** martinkennelly has joined #openstack-nova10:48
openstackgerritStephen Finucane proposed openstack/nova master: vif: Remove dead code  https://review.opendev.org/70314610:49
stephenfinbauzas: Any chance you could blast these through this morning? https://review.opendev.org/#/c/703973/ https://review.opendev.org/#/c/703974/10:50
stephenfinFinal two patches for nova-net removal10:51
stephenfinbauzas: and if you're doing that, there's another dead easy one here https://review.opendev.org/#/c/686997/10:52
openstackgerritLee Yarwood proposed openstack/nova master: images: Move qemu-img info calls into privsep  https://review.opendev.org/70689710:52
openstackgerritLee Yarwood proposed openstack/nova master: images: Allow the output format of qemu-img info to be controlled  https://review.opendev.org/70689810:52
openstackgerritLee Yarwood proposed openstack/nova master: virt: Pass request context to extend_volume  https://review.opendev.org/70689910:52
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Correctly resize encrypted LUKSv1 volumes  https://review.opendev.org/70690010:52
*** tbachman has quit IRC10:53
lyarwoodsean-k-mooney: ^ removed run_as_root and made it clear that the new func is privileged10:55
openstackgerritLee Yarwood proposed openstack/nova master: DNM - Test TEMPEST_EXTEND_ATTACHED_ENCRYPTED_VOLUME  https://review.opendev.org/70759310:56
bauzasstephenfin: will try10:58
*** ccamacho has joined #openstack-nova11:00
*** priteau has joined #openstack-nova11:02
openstackgerritBrin Zhang proposed openstack/nova master: Add new default roles in os-instance-actions policies  https://review.opendev.org/70647011:11
*** zhanglong has joined #openstack-nova11:13
*** udesale_ has quit IRC11:17
*** ttx has quit IRC11:17
*** maciejjozefczyk_ has joined #openstack-nova11:17
*** maciejjozefczyk has quit IRC11:18
*** ttx has joined #openstack-nova11:19
*** ttx has quit IRC11:19
*** ttx has joined #openstack-nova11:28
*** martinkennelly has quit IRC11:37
*** nicolasbock has joined #openstack-nova11:38
*** martinkennelly has joined #openstack-nova11:44
sean-k-mooneylyarwood: yep reviewing your series now11:56
sean-k-mooneyand ya its clearer what you are doing11:56
*** rpittau is now known as rpittau|bbl11:58
lyarwoodsean-k-mooney: ack thanks12:02
*** udesale has joined #openstack-nova12:02
lyarwoodstephenfin: ^ when you have time later could you hit https://review.opendev.org/#/q/topic:bug/1861071 again, I'll rebase the followups once this lands now to avoid extra churn in the gate.12:11
stephenfinsure. ping me again if I don't have it done by EOD :)12:12
* lyarwood cracks whip12:12
lyarwoodsure thing12:12
lyarwoodand thanks obviously :)12:12
*** ociuhandu has quit IRC12:15
sean-k-mooneylyarwood: i think i reviewed them all12:19
sean-k-mooneyit looks like the chain is broken into 3 seriese so they shoudl all be rebased back into one12:19
sean-k-mooneyor at least be rebased so they are update with the bottom 4 patches12:20
*** tbachman has joined #openstack-nova12:21
*** zhanglong has quit IRC12:24
*** zhanglong has joined #openstack-nova12:26
*** ociuhandu has joined #openstack-nova12:27
*** ociuhandu has quit IRC12:29
*** ociuhandu has joined #openstack-nova12:30
*** tbachman has quit IRC12:30
lyarwoodsean-k-mooney: yup, I'll rebase the rest later today, just switching to something else for a whil.e12:30
*** belmoreira has quit IRC12:31
*** tbachman has joined #openstack-nova12:31
*** ociuhandu_ has joined #openstack-nova12:32
*** nweinber has joined #openstack-nova12:32
*** ociuhandu has quit IRC12:35
*** zhanglong has quit IRC12:36
*** mkrai_ has quit IRC12:42
brinzhangjohnthetubaguy: https://review.opendev.org/#/c/706470/ I used your suggestion, that looks like ok for me, I was update that you can review again if you have time ^^12:46
brinzhanggmann: you can review this patch, and move the problem from your list I asked before12:48
luyaogibi: are you around?13:06
openstackgerritBrin Zhang proposed openstack/nova master: Granular GET os-instance-actions API policies  https://review.opendev.org/71179113:07
gibiluyao: hi!13:07
luyaogibi: Would you like review the vpmem live migration support? I need someone help me confirm if the implementations is OK. :D13:08
luyaohttps://review.opendev.org/#/q/topic:support-live-migration-with-virtual-persistent-memory+(status:open+OR+status:merged)13:08
gibiluyao: sure. I can try. I have to finish the review of the cyborg integration first but then I can look at your series13:08
luyaogibi: Thank you. looking forward for your comments. FYI.  I don't add enough testcases now, if the implementation is acceptable, I'll do that.13:11
gibiluyao: OK, I will keep that in mind13:12
brinzhangluyao: I will tyr to check your patch tomorrow ^^13:12
luyaobrinzhang: Thanks, welcome. :D13:13
brinzhangluyao: I already add that to me review list, and will do later13:13
brinzhangWe would like this feature13:14
*** ociuhandu_ has quit IRC13:15
luyaobrinzhang: Great.13:16
*** ociuhandu has joined #openstack-nova13:17
*** jraju__ has joined #openstack-nova13:17
*** links has quit IRC13:18
*** lbragstad_ has joined #openstack-nova13:18
*** irclogbot_1 has quit IRC13:22
*** irclogbot_0 has joined #openstack-nova13:23
openstackgerritBalazs Gibizer proposed openstack/nova master: [Community goal] Update contributor documentation  https://review.opendev.org/71242013:26
gibistephenfin: ussuri community goal doc change ^^13:27
gibistephenfin: I feel you will have comments about it13:27
*** amoralej is now known as amoralej|lunch13:40
*** zhanglong has joined #openstack-nova13:40
*** ociuhandu has quit IRC13:41
*** dave-mccowan has joined #openstack-nova13:41
*** maciejjozefczyk_ is now known as maciejjozefczyk13:41
*** ociuhandu has joined #openstack-nova13:43
*** dave-mccowan has quit IRC13:46
*** ccamacho has quit IRC13:46
*** ociuhandu has quit IRC13:48
*** ratailor has quit IRC13:49
*** zigo has quit IRC13:49
*** lbragstad_ is now known as lbragstad13:52
openstackgerritSylvain Bauza proposed openstack/nova master: Pass allocations to virt drivers when reverting resize  https://review.opendev.org/71211813:53
*** Liang__ is now known as LiangFang13:56
*** dave-mccowan has joined #openstack-nova13:57
*** liuyulong has joined #openstack-nova13:58
*** ccamacho has joined #openstack-nova13:59
*** vishalmanchanda has quit IRC14:00
*** amoralej|lunch is now known as amoralej14:14
*** brinzhang has quit IRC14:15
*** brinzhang has joined #openstack-nova14:16
dansmithgibi: thoughts on the vmware deprecation patch? I'm glad it got some attention raised, but we've been a long time without vmware ci and despite some response, I feel like we probably need a deadline or something to make sure something happens14:16
dansmithI'm not even sure when the last time the vmware ci commented on a nova change, but I feel like it's been a *long* time14:17
*** TxGirlGeek has joined #openstack-nova14:18
*** mriedem has joined #openstack-nova14:19
*** ociuhandu has joined #openstack-nova14:22
sean-k-mooneydansmith: we could merge the patch propose a revert and hold it until m3. if the ci is running by m3 we merge the revert if not then leave it14:23
dansmithyep, we could also convert this to just a quality warning, merge that now, and hold the deprecation warning on the ci14:24
dansmithwhich i think is what we did for xen14:24
*** sapd1_x has joined #openstack-nova14:25
gmannbrinzhang: i will check after coffee.14:25
brinzhanggmann: cool, thanks14:26
*** ociuhandu has quit IRC14:27
mriedemwe merged the deprecation warning for xen in train, it wasn't contingent14:30
dansmithokay when I was looking for examples, I found a "merge quality warning" for one of the drivers before a deprecation14:33
gibidansmith: we can merge a deprecation warning without causing extra problem to hemna and undeprecate if vmware ci magicly shows up14:33
mriedemlooks like dan's patch has at least gotten the necessary attention,14:33
mriedemwhether that holds or not i guess we'll see14:33
dansmithgibi: ack, well, that's what I've got up, so maybe go vote on that :)14:34
gibithe real break happens if we delete something14:34
gibidansmith: will do14:34
mriedemyeah the people -1ing the change are saying "please don't delete it"14:34
mriedemwhich isn't what the patch does14:34
dansmithmriedem: I quote you: " After three months since the quality warning change merged [1]14:34
dansmith    there has still been no progress in finding a maintainer for"14:34
mriedemthey can -1 the patch to remove the driver in a later release if it gets to that point14:34
dansmithhttps://github.com/openstack/nova/commit/af280ffe3098b84123eae218989ea056e9935bf114:35
dansmithbut I'd rather go straight to deprecation,14:35
mriedemgood thing i was so verbose in my commit messages :)14:35
dansmithand then we can avoid removing it if CI shows up, and un-deprecate if it looks like CI will stick around14:36
mriedemi think there is more than enough ammo for vmware deprecation based on repeated attempts in the ML to figure out what's going on with CI over the last several years,14:36
dansmithagree, and like I said, I'd be kinda surprised if it really works in U after all the provider stuff14:36
dansmithworking in queens I totally believe14:37
*** ociuhandu has joined #openstack-nova14:37
jkulikfyi, we (SAP) reached out to VMware to get a statement on their upstream approach. they weren't ready for one, yet.14:37
mriedemi forget her name but i was sending emails about the lack of CI back when the old project manager was involved14:38
dansmithIMHO, to keep it we need more than just CI too.. we need support for devstack problems, like the one referenced on the mailing list and general confidence that it's working for more than just trivial CI configurations14:38
mriedemjkulik: as far as i know vmware hasn't had an "upstream" team in awhile14:38
mriedemcdent was the last closest person to that for nova at least14:38
dansmithand honestly, it has always been a fight to keep them involved, which is pretty exhausting14:39
mriedemi'm sure that team would say it was exhausting dealing with us as well :)14:39
mriedem"what do you mean my bug fix needs tests?!"14:39
jkulikas far as I heard: yes, they found it exhausting.14:41
mriedemheh14:41
*** vishalmanchanda has joined #openstack-nova14:41
dansmithyeah I have no doubt14:41
mriedemi mean, quality control, who needs it14:42
mriedempsh14:42
jkulikmain problem seems to be, that they have their own product based on openstack which works fine for them14:42
mriedemVIO14:42
mriedemright?14:42
jkulikyes14:42
mriedemsure, with patches14:42
dansmithand that's cool, but we don't need to keep a broken driver in our tree, especially with people asking on the ML why it doesn't work14:42
mriedemso you buy that thing and you're stuck with them for support b/c of the patches14:42
jkuliksure, they need to make money off it14:43
jkulikotherwise everybody could just install openstack ;)14:43
* gibi voted with a +2 but holds +W for a day or so 14:43
sean-k-mooneyjkulik: our they could enforce an upstream first poicy for all freatres and backports14:43
sean-k-mooney*or14:43
jkulikwhich they obviously still make money from, because you'd still have VMware hypervisors and stuff14:43
jkuliktbh, upstream first is hard.14:44
* jkulik looks at the patches accumulating in our environment14:44
sean-k-mooneyit can be but its generally worth it. i thnik the quality of the final solution is typically better14:44
sean-k-mooneybut it is a higher barrier to entry for enableing a feature14:45
jkulikI agree. But some things you can't upstream and once you're down that road, you're not that willing to upstream the rest.14:45
mriedemdepends on where you want to invest time and money, up front or on the backside dealing with maintaining a fork14:45
*** zhanglong has quit IRC14:46
dansmithjkulik: we're not arguing that they shouldn't have a downstream.. we're arguing that if they want their base in the upstream, there's a minimum bar and we're not going to do their maintenance for free, that's all14:46
dansmithwe all make money from openstack one way or the other, nobody here doesn't recognize that14:46
mriedemand getting the team culture in place for people that aren't used to having their code reviewed14:46
mriedemi make $0 from openstack now14:46
mriedemwtf am i even doing in this conversation? :)14:46
jkuliksorry :D14:47
dansmithmriedem: well, the 5th year senior that still hangs around campus being the exception :)14:47
mriedemi get older, nova stays the same....wait14:47
lyarwoodhaha14:47
dansmithLOLOL14:47
jkulikI think my main problem is, that I can't convince VMware to do the maintenance upstream and need that driver to work ;)14:47
mriedemjkulik: so can SAP have one or two developers that start working on it?14:48
mriedemit's not like vmware is the only company that can work on that driver14:48
dansmithjkulik: I want lots of things for free too14:48
mriedemit's been on life support for years14:48
sean-k-mooneyjkulik: do you consume the driver directly form upstream or via the vio product14:49
jkulikI can talk to my managers about it, but given our team size, it'll basically still be life-support.14:49
jkulikfrom upstream directly14:49
sean-k-mooneyok makes sense14:49
*** mkrai_ has joined #openstack-nova14:50
dansmithjkulik: you know every time we make a change to the virt drivers, we have to make a change to the vmware one, and with no tests, we don't know if it works or not right? that's a lot of burden for us, and if you look at all the changes to that driver in the last two years, it's just that.. guesses.14:51
jkulikdansmith: yes. I totally get that.14:51
jkulikin addition, VMware doesn't work like libvirt at all in too many cases.14:51
dansmithyup :/14:52
sean-k-mooneythe current vmware driver talks to vspher too right rather then to esxi14:53
mriedemat least we don't have the 1:M host:node thing with that driver anymore14:53
mriedemdoesn't mean a single node isn't hosting 1K instances which crash the RT14:53
sean-k-mooneyso while esxi can be used without a licnce vsphere cant so we cant do first party ci even if we and the capastity to maintain it14:54
jkulikthe driver talks to vsphere, one nova node is a cluster (multiple hypervisors), but nova doesn't know about it14:54
mriedemwhich has been a major pain point with the vmware team over the years, trying to change the nova architecture to handle that type of scale on a single node14:54
mriedemjkulik: yeah i know14:54
mriedemto nova it's a node with several thousand VMs potentially14:54
jkulikyes14:54
mriedemunlike libvirt with maybe a couple dozen14:54
dansmith...which is why I'm dubious about all the placement stuff really working these days14:54
jkulikwe recently ran into a problem with that concept, trying to deploy really big VMs14:55
sean-k-mooneydansmith: well we added the same host migrate thing last cycle right?14:55
hemnaso the driver won't work in U ?14:55
sean-k-mooneyso at least at that point it worked14:55
sean-k-mooneybut ya not sure placment will imporve performance or schduling in anyway14:55
dansmithhemna: we have no idea14:55
dansmithsean-k-mooney: which?14:55
jkulikwhich is the main pain point ... not knowing if stuff even works14:56
hemnasorry I haven't been following nova as much lately, but has there been a change that would cause the driver to not work?14:56
dansmithhemna: lots of them14:56
*** mlavalle has joined #openstack-nova14:57
hemna:(14:57
dansmithsean-k-mooney: actually the second to last one had a report from vmware ci that said it failed14:58
dansmithsean-k-mooney: https://review.opendev.org/#/c/681004/14:58
mriedemhemna: you know how cinder has/had a pretty aggressive rule about deprecating volume drivers with no reporting/reliable ci in just a single release?14:59
*** lbragstad_ has joined #openstack-nova14:59
mriedemthe vmware ci has been pretty much a no show for *years*14:59
hemnayah, I think we are changing from that though slowly14:59
hemna:(14:59
mriedemsure, because fewer maintainers to care14:59
mriedemand cinder also has like 100 damn drivers14:59
hemnaok, well it would be in our interest to keep it in tree, so maybe we can twist some arms with our support with vmware14:59
sean-k-mooneydansmith: i was refering to mriedem COMPUTE_SAME_HOST_COLD_MIGRATE changes https://github.com/openstack/nova/commit/4921e822e73383af0c8da4c5e3acfaa021eafe6814:59
sean-k-mooneydansmith: that was the last entirly vmware specific feature i recall15:00
dansmithsean-k-mooney: vmware failed on that15:00
sean-k-mooneyoh ok15:00
dansmithI don't think that was for vmware specifically, IIRC15:00
mriedemit wasn't15:00
mriedemit's just the only driver that will report that trait15:01
dansmithright15:01
mriedemfor libvirt it means you can configure the api to allow same-host RESIZE but prevent the API from telling the scheduler "oh sure send cold migrations there also"15:01
sean-k-mooneyah ok i was just looking at the release note and it mentioned  ``VMwareVCDriver`` sepecifclaly15:01
mriedemand then those fail15:01
*** lbragstad has quit IRC15:01
sean-k-mooneyah ok15:02
dansmithsean-k-mooney: I think this was because we knew we had broken their same-host-migrate requirement so we were trying to add a thing to make it possible for them again15:02
sean-k-mooneyright which is an example of use trying to maintain a driver we cant properly test15:03
sean-k-mooney/use/us15:03
dansmithyup,15:03
dansmithso we definitely broke them, and then merged something to try to unbreak them, but without tests, hard to say if it even works15:04
jkulikwhat I get from the discussion: our team should interact more with upstream and we should try to create a CI ASAP ourselves, if we want the driver to continue to live upstream15:04
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove MIN_LIBVIRT_MULTIATTACH  https://review.opendev.org/71023815:04
jkulikand keep it running :)15:05
mriedemtbc https://review.opendev.org/#/c/695220/ wasn't about a placement related regression,15:05
mriedemit was a latent bug since forever15:05
mriedemi just finally got around to fixing it *using* placement15:05
sean-k-mooneysure you were fixing https://bugs.launchpad.net/nova/+bug/174869715:06
openstackLaunchpad bug 1748697 in OpenStack Compute (nova) "Cold migration fails when the filter only returns the host where the vm is located and the vm status is set to ERROR" [Low,Fix released] - Assigned to Matt Riedemann (mriedem)15:06
dansmithyup15:06
stephenfinlyarwood: got the last of those os-hypervisors backports for you here, if you have time https://review.opendev.org/#/c/711670/15:06
gibijkulik: if you can show some movement around that CI during early Victoria then I think that will help us not deleting the driver from tree15:06
lyarwoodstephenfin: ack'd15:07
sean-k-mooneyit looks like there is a limvied free verion of vsphere too https://www.vmware.com/products/vsphere-hypervisor.html im not sure if that would be useable for ci but if the end user lisence agreement allowed it it might be possible to create a first party ci.15:11
hemnadansmith do you guys have a page/docs for setting up a nova CI? in case we have to try and do it ourselves to report upstream15:11
dansmithhemna: I think the infra team might have some general docs, but I'm not sure we have nova specific ones.. but I'm really the wrong person to ask15:12
gibihemna: there is a generic infra doc https://docs.openstack.org/infra/system-config/third_party.html15:12
hemnaok thanks.  I had setup a cinder CI ages ago and it's non trivial to manage15:12
sean-k-mooneythe zull docs are pretty useful too.15:12
*** eharney has quit IRC15:20
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add online migration for legacy NUMA objects  https://review.opendev.org/53741415:27
mriedemhemna: there are also some relatively recent blogs that i've seen, e.g. https://01.org/openstack/blogs/manjeets/2019/how-test-open-source-hardware-drivers-zuul-v3-and-docker-compose15:27
mriedemfrom what i remember it sounded like zuulv3 made it quite a bit simpler15:27
hemnamriedem thank you.   I'll check it out15:28
sean-k-mooneymriedem: they have an example docker compose that deploy zuul/nodepool/gerrit and all the other infra for dev15:28
hemnasean-k-mooney that would be nice15:28
sean-k-mooneywhich is useful if you want to work on createign a job but i havent read the blog so im not sure if they have a production guide15:29
gibidansmith: could you add me to the NovaDrivers launchpad group15:31
dansmithgibi: I dunno, can I? :)15:31
* dansmith looks15:31
gibiat least you are in the group15:31
gibiefried_gone, mriedem: ^^ could you help if dansmith cannot?15:32
dansmithgibi: "owner: openstack administrators"15:32
dansmithI don't think we can do it15:32
dansmithwhat do you need it for?15:32
gibiaccording to the process we need LP milestones defined (at least we had for train) but we don't have them for ussuri at all15:33
dansmithah okay15:33
gibibtw https://launchpad.net/~nova-drivers/+members shows that you are a member but not an admin. so I guess I need and admin15:33
dansmithYep, I can't add15:35
openstackgerritStephen Finucane proposed openstack/nova master: objects: Add online migration for legacy NUMA objects  https://review.opendev.org/53741415:35
gibidansmith: thanks for trying15:35
gibimelwitt: could you add me to https://launchpad.net/~nova-drivers/+members ?15:36
mriedemi can sec15:36
gibimriedem: thanks!15:36
mriedemcrap, "Claudio Hollanda (gibi) has been added as a member of this team."15:36
dansmithseems like it's only these people https://launchpad.net/~openstack-admins15:36
mriedemdouble crap "Dobos Balázs (balazs) has been added as a member of this team."15:36
mriedemgibi: what is your launchpad id?15:37
gibibalazs-gibizer15:37
mriedemok done15:37
gibiI was late for the LP party15:37
dansmithmriedem: am I missing where that's done or do you have more powers?15:37
gibimriedem: thanks a bunch15:37
dansmithoh, I see,15:38
dansmithI'm not an admin for that group, just a member15:38
mriedemdansmith: you are now15:38
dansmithah, I see now.. sweet, thanks15:38
mriedemcould probably drop mikal and laski from that group15:43
mriedemi mean, single tear and all15:43
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Use virDomainBlockCopy to swap volumes with Libvirt >= 5.10.0  https://review.opendev.org/69683415:45
*** gyee has joined #openstack-nova15:47
*** tbachman has quit IRC15:51
*** sapd1_x has quit IRC15:51
*** dtantsur is now known as dtantsur|brb15:53
*** zigo has joined #openstack-nova15:53
*** TxGirlGeek has quit IRC15:55
*** TxGirlGeek has joined #openstack-nova15:55
*** eharney has joined #openstack-nova15:58
*** maciejjozefczyk has quit IRC16:07
*** tbachman has joined #openstack-nova16:07
gmannbrinzhang: done.16:16
gmannpolicy are not changed for its name etc need not to add in deprecation separately, base rule deprecation handle the deprecation for them.16:19
gmannwe are using base rule for our policies check_str so that common things like deprecation for common check_str and override by operator are easy to do.16:20
*** belmoreira has joined #openstack-nova16:21
*** mkrai_ has quit IRC16:22
openstackgerritMerged openstack/nova stable/train: Fix os-keypairs pagination links  https://review.opendev.org/71189516:25
*** belmoreira has quit IRC16:39
*** udesale has quit IRC16:41
*** rpittau|bbl is now known as rpittau16:43
*** damien_r has quit IRC16:53
*** ociuhandu has quit IRC17:07
*** nicolasbock has quit IRC17:14
*** nicolasbock has joined #openstack-nova17:20
openstackgerritGhanshyam Mann proposed openstack/nova master: Cleanup test for system reader and reader_or_owner rules  https://review.opendev.org/71251517:22
*** martinkennelly has quit IRC17:31
*** tbachman has quit IRC17:32
*** evrardjp has quit IRC17:35
*** evrardjp has joined #openstack-nova17:35
*** bnemec has quit IRC17:38
*** bnemec has joined #openstack-nova17:39
*** tbachman has joined #openstack-nova17:43
*** jraju__ has quit IRC17:48
*** tbachman has quit IRC17:49
*** tbachman has joined #openstack-nova17:53
*** eharney has quit IRC17:55
*** vishalmanchanda has quit IRC18:00
*** priteau has quit IRC18:03
*** derekh has quit IRC18:07
*** eharney has joined #openstack-nova18:08
*** dtantsur|brb is now known as dtantsur18:24
*** amoralej is now known as amoralej|off18:33
*** tesseract has quit IRC18:43
openstackgerritmelanie witt proposed openstack/nova master: Add config option for neutron client retries  https://review.opendev.org/71222618:55
openstackgerritmelanie witt proposed openstack/nova master: Add config option for neutron client retries  https://review.opendev.org/71222618:56
*** klindgren has quit IRC18:59
openstackgerritMerged openstack/nova master: Handle unset 'connection_info'  https://review.opendev.org/68699719:03
openstackgerritMerged openstack/nova master: nova-net: Remove unnecessary exception handling, mocks  https://review.opendev.org/70397319:03
openstackgerritMerged openstack/nova master: nova-net: Remove unused nova-network objects  https://review.opendev.org/69715619:03
*** klindgren has joined #openstack-nova19:04
*** eharney has quit IRC19:16
*** ociuhandu has joined #openstack-nova19:17
*** adriant has quit IRC19:20
*** ociuhandu has quit IRC19:21
openstackgerritSundar Nadathur proposed openstack/nova master: Create and bind Cyborg ARQs.  https://review.opendev.org/63124419:22
openstackgerritSundar Nadathur proposed openstack/nova master: Pass accelerator requests to each virt driver from compute manager.  https://review.opendev.org/69858119:22
openstackgerritSundar Nadathur proposed openstack/nova master: Compose accelerator PCI devices into domain XML in libvirt driver.  https://review.opendev.org/63124519:22
openstackgerritSundar Nadathur proposed openstack/nova master: Delete ARQs for an instance when the instance is deleted.  https://review.opendev.org/67373519:22
openstackgerritSundar Nadathur proposed openstack/nova master: Enable hard/soft reboot with accelerators.  https://review.opendev.org/69794019:22
openstackgerritSundar Nadathur proposed openstack/nova master: Enable start/stop of instances with accelerators.  https://review.opendev.org/69955319:22
openstackgerritSundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait.  https://review.opendev.org/69955419:22
openstackgerritSundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls.  https://review.opendev.org/70422719:22
openstackgerritSundar Nadathur proposed openstack/nova master: Block unsupported instance operations with accelerators.  https://review.opendev.org/67472619:22
openstackgerritSundar Nadathur proposed openstack/nova master: Add cyborg tempest job.  https://review.opendev.org/67099919:22
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Use oslo.utils >= 4.1.0 to fetch format-specific image data  https://review.opendev.org/71078519:36
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Always provide the size in bytes when calling virDomainBlockResize  https://review.opendev.org/70759019:36
openstackgerritLee Yarwood proposed openstack/nova master: images: Remove Libvirt specific configurable use from qemu_img_info  https://review.opendev.org/70759119:36
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Remove QEMU_VERSION_REQ_SHARED  https://review.opendev.org/71023919:36
openstackgerritLee Yarwood proposed openstack/nova master: images: Make JSON the default output format of calls to qemu-img info  https://review.opendev.org/71167919:36
*** adriant has joined #openstack-nova19:38
*** rpittau is now known as rpittau|afk19:40
*** dtantsur is now known as dtantsur|afk19:40
*** ralonsoh has quit IRC19:44
*** tbachman has quit IRC19:44
*** ociuhandu has joined #openstack-nova19:52
*** slaweq has quit IRC19:53
*** ociuhandu has quit IRC19:56
*** ociuhandu has joined #openstack-nova19:56
*** tbachman has joined #openstack-nova20:06
*** ociuhandu has quit IRC20:06
*** ociuhandu has joined #openstack-nova20:09
*** ociuhandu has quit IRC20:14
*** tbachman has quit IRC20:31
*** eharney has joined #openstack-nova20:33
fungianybody have any recent experience with using the vsphere virt driver? or know someone who might be able to reply to http://lists.openstack.org/pipermail/openstack-discuss/2020-March/013066.html20:37
fungithe author of that post is privately random e-mailing osf staff now trying to find out who has experience with it20:38
melwittfungi: maybe try KeithMnemonic20:42
fungithanks melwitt!20:42
fungigranted they started out e-mailing the contact address for the openstack website, until several of us suggested they reach out to the openstack-discuss ml20:43
fungiso i'm not sure i'd wish this on anyone20:44
sean-k-mooney fungi well we did spend like 30 mins disucssing should we deprecated teh driver eailer20:44
fungithat sounds like legitimate details to me ;)20:44
sean-k-mooneyhttp://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2020-03-11.log.html#t2020-03-11T14:16:5520:45
sean-k-mooneyfungi: the issue is the vmware ci has not been running/passing for months and we dont actully know if it still works20:46
melwittyeah, I could see deprecating it. we deprecated the xen driver last year I think20:46
sean-k-mooneyfungi: we think it does but there is no one active that works on it20:46
sean-k-mooneylooking at https://wiki.openstack.org/wiki/ThirdPartySystems/VMware_CI20:47
sean-k-mooneySalvatore Orlando  and Sihan Wang were the main contacts20:47
fungiyeah, i haven't seen either of then in irc in ages20:48
sean-k-mooneybut i dont think salv-orlando has been active for like 2+ years20:48
*** nweinber has quit IRC20:48
fungiright, that matches my recollection20:48
melwittI have seen gkotton relatively recently I feel like ... on gerrit20:48
melwittand like https://review.opendev.org/#/q/project:openstack/oslo.vmware that's the only hints I see that there are people working on it20:51
* melwitt bbl20:52
fungithanks, passing all that along20:58
dansmithfungi: glad to know that foundation staff are getting hounded21:00
fungiwe're usually the first folks who get contacted by users who don't know where to find contact information21:01
mriedemgary left vmware21:01
mriedemawhile back21:01
mriedemfyi21:01
dansmithfungi: not because I'm glad you're feeling the pain, but glad that it forms some justification that vmware isn't around to support it being in upstream21:01
dansmithfungi: after that email went 5 days with no response I posted the deprecation patch21:01
fungiin theory this is what a user committee is for, but...21:01
dansmithfungi: which lo and behold had people out of the woodwork21:01
funginobody out of the woodwork enough to answer the e-mail though21:02
dansmithright21:02
dansmithjust out of the woodwork to beg to keep it in tree for marketing reasons (my embellishment)21:02
fungii just feel bad about it in part because i suggested they contact openstack-discuss21:02
dansmithin this case, that's the right thing to do, they're trying to get upstream nova to work with upstream devstack21:03
fungiyep21:03
dansmithwe can't really help them though, because we have no idea if it's even supposed to work21:03
dansmithCI hasn't voted in ages, and last it did, it reported error21:03
fungioh, i totally agree21:03
sean-k-mooneyi could reply and ask them to provide the n-cpu log because there initall email was just "devstack failed because n-cpu did not start"21:03
fungimore just sad that there are users who have been effectively abandoned by the folks who were maintaining the driver21:04
sean-k-mooneybut honestly i know almost nothing baout vmware so unless its a really really dumb error i wont be able to help21:04
fungisean-k-mooney: right, it's entirely possible the issue they're running into isn't even vmware-specific, but mentioning vmware in any question is a quick way to turn off most people's brains21:05
dansmithwell, I think it's more likely that one of the many virt-related changes lately have caused that driver to not even be able to report resources properly21:05
mriedemsean-k-mooney: i need you for some other hardware acceleration related wild goose chases actually21:05
sean-k-mooneywell i did look at the main but it was just teh error you get whenever the compute service is not started properly21:05
dansmithIMHO, the overstretched nova team doesn't need to be spending any time trying to maintain (and help users) for a driver we can't even test21:06
sean-k-mooneymriedem: haha if someone offeres you enginering samples of hardware and will pay you to look at it run21:06
dansmithwe should be communicating clearly that we expect it's broken21:06
sean-k-mooneypre alpha hardware sucks21:06
* fungi wholeheartedly agrees21:06
dansmithfungi: feel free to comment: https://review.opendev.org/#/c/712101/21:07
dansmithfungi: even if "even I was asked for help because clearly there's no resources for users"21:07
fungii'm trying to find nice ways to more or less say that in my reply to the private e-mail this user has sent me, without putting words in anyone's mouths and instead just linking to the currently available public resources21:08
sean-k-mooneyfungi: you could link to the irc logs of this conversation21:08
dansmithfungi: link them to the patch saying "It looks like you shouldn't expect this to work, sorry, we're working on getting the messaging out... $link"21:08
fungidansmith: sean-k-mooney: yes, both of those things, thanks!21:09
fungithough since xuel@vmware.com has volunteered in https://review.opendev.org/712101 to receive requests for assistance, i'll mention that in my reply21:16
melwittmriedem: ack, thanks didn't know that21:26
*** rcernin has joined #openstack-nova21:28
melwitthoo dang devstack worked the first time. yesss21:28
sean-k-mooneymelwitt: that normally works for me if i am using a clean vm and i have done an os update and rebooted first21:29
melwitt*devstack with ceph plugin21:29
sean-k-mooneyah21:29
melwittI had a hell of a time last time. this time all smooth21:29
melwittcause if it fails in the middle for any reason, restarting it didn't seem to work. just keeps tripping over itself21:30
melwittrestarting meaning run ./stack.sh again21:30
sean-k-mooneydid you run clean.sh or unstack before runing stack again21:30
melwittI didn't21:31
sean-k-mooneyya thats proably your issue21:31
melwittdo those still work ok? that was why I hesitated, didn't want to make it worse. but, I ended up having to start all over from scratch anyway so I should have tried it21:31
sean-k-mooneyunstack works fine. clean more or less works fine but ocationally it misses files21:32
melwittok, good to know21:32
sean-k-mooneyunstack is much safer to run21:32
sean-k-mooneythen clean21:32
dansmithyeah I try to fix bugs in ./clean.sh when I find them21:32
dansmithlike in cyborg lately21:32
* melwitt learning intensifies21:33
sean-k-mooneyif you just run stack twice you can get into weird race condition where agents are running but you recrate the db and things break21:33
sean-k-mooneyactully speaking of cyborg i should rebase my patch for there devstack plugin21:40
*** xek has quit IRC21:42
*** TxGirlGeek has quit IRC21:44
*** tbachman has joined #openstack-nova21:58
*** mriedem has left #openstack-nova22:02
*** tbachman_ has joined #openstack-nova22:03
*** tbachman has quit IRC22:03
*** tbachman_ is now known as tbachman22:03
*** ociuhandu has joined #openstack-nova22:04
*** dave-mccowan has quit IRC22:05
*** dpawlik has quit IRC22:11
*** dave-mccowan has joined #openstack-nova22:11
*** spatel has joined #openstack-nova22:12
*** TxGirlGeek has joined #openstack-nova22:13
*** spatel has quit IRC22:17
*** _erlon_ has quit IRC22:31
*** jrosser has quit IRC22:31
*** dustinc has quit IRC22:31
*** portdirect has quit IRC22:31
*** larainema has quit IRC22:31
*** rm_work has quit IRC22:31
*** CeeMac has quit IRC22:31
*** _erlon_ has joined #openstack-nova22:33
*** rm_work has joined #openstack-nova22:33
*** portdirect has joined #openstack-nova22:34
*** jrosser has joined #openstack-nova22:36
*** cz3 has quit IRC22:36
*** guilhermesp has quit IRC22:36
*** jungleboyj has quit IRC22:36
*** mnaser has quit IRC22:36
*** gmann has quit IRC22:36
*** bcm has quit IRC22:36
*** donnyd has quit IRC22:36
*** fyx has quit IRC22:36
*** fyx has joined #openstack-nova22:38
*** larainema has joined #openstack-nova22:38
*** mnaser has joined #openstack-nova22:39
*** jungleboyj has joined #openstack-nova22:40
*** dustinc has joined #openstack-nova22:40
*** CeeMac has joined #openstack-nova22:40
*** gmann has joined #openstack-nova22:40
*** guilhermesp has joined #openstack-nova22:41
*** ociuhandu has quit IRC22:42
*** cz3 has joined #openstack-nova22:42
*** ociuhandu has joined #openstack-nova22:43
*** donnyd has joined #openstack-nova22:44
*** bcm has joined #openstack-nova22:45
*** rajinir has quit IRC22:46
*** luyao has quit IRC22:46
*** arne_wiebalck has quit IRC22:46
*** irclogbot_0 has quit IRC22:47
*** irclogbot_0 has joined #openstack-nova22:48
*** ociuhandu has quit IRC22:48
*** openstackstatus has quit IRC22:48
*** mnasiadka has quit IRC22:50
*** coreycb has quit IRC22:50
*** rajinir has joined #openstack-nova22:50
*** luyao has joined #openstack-nova22:51
*** arne_wiebalck has joined #openstack-nova22:51
*** coreycb has joined #openstack-nova22:54
*** mnasiadka has joined #openstack-nova22:54
*** ildikov has quit IRC22:56
*** tonyb[m] has quit IRC22:56
*** pas-ha has quit IRC22:56
*** knikolla has quit IRC22:56
*** csatari has quit IRC22:56
*** ildikov has joined #openstack-nova22:59
*** pas-ha has joined #openstack-nova22:59
*** csatari has joined #openstack-nova23:00
*** knikolla has joined #openstack-nova23:01
*** tonyb[m] has joined #openstack-nova23:01
*** tkajinam has joined #openstack-nova23:01
*** dave-mccowan has quit IRC23:08
*** dave-mccowan has joined #openstack-nova23:11
*** tosky has quit IRC23:44
*** eharney has quit IRC23:47
*** KeithMnemonic has quit IRC23:51
*** KeithMnemonic has joined #openstack-nova23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!