Thursday, 2019-02-28

*** hongbin has quit IRC00:00
*** macza_ has quit IRC00:03
openstackgerritChris Friesen proposed openstack/nova master: Flavor extra spec and image properties validation  https://review.openstack.org/62070600:04
*** sdake has joined #openstack-nova00:04
*** dave-mccowan has quit IRC00:07
*** mriedem has quit IRC00:13
*** mriedem has joined #openstack-nova00:19
*** ircuser-1 has quit IRC00:25
*** lbragstad has quit IRC00:32
*** takashin has joined #openstack-nova00:43
*** agopi has joined #openstack-nova00:48
*** ileixe has joined #openstack-nova00:54
openstackgerritMatt Riedemann proposed openstack/nova master: Stop using "nova" in API samples when creating a server  https://review.openstack.org/63987400:57
mriedemuff da00:57
*** _hemna has joined #openstack-nova00:59
*** sdake has quit IRC01:08
openstackgerritMerged openstack/os-vif master: add additional check and gate jobs for os-vif  https://review.openstack.org/63973201:17
*** betherly has joined #openstack-nova01:17
*** betherly has quit IRC01:22
*** _fragatina has quit IRC01:22
*** _hemna has quit IRC01:35
*** gyee has quit IRC01:38
*** liuyulong_ has quit IRC01:47
*** itlinux has quit IRC01:54
*** ileixe has quit IRC01:59
*** ileixe has joined #openstack-nova02:00
*** gbarros has joined #openstack-nova02:03
mriedemyonglihe: comments inline https://review.openstack.org/#/c/621474/02:06
*** sdake has joined #openstack-nova02:09
*** Dinesh_Bhor has joined #openstack-nova02:09
*** betherly has joined #openstack-nova02:10
*** betherly has quit IRC02:14
openstackgerritZhenyu Zheng proposed openstack/nova master: Add compute service support for attach/detach root volume  https://review.openstack.org/61475002:14
openstackgerritArtom Lifshitz proposed openstack/nova master: Introduce live_migration_claim()  https://review.openstack.org/63566902:19
openstackgerritArtom Lifshitz proposed openstack/nova master: New objects for NUMA live migration  https://review.openstack.org/63482702:19
openstackgerritArtom Lifshitz proposed openstack/nova master: LM: add support for sending NUMAMigrateData to the source  https://review.openstack.org/63482802:19
openstackgerritArtom Lifshitz proposed openstack/nova master: LM: add support for updating NUMA-related XML on the source  https://review.openstack.org/63522902:19
openstackgerritArtom Lifshitz proposed openstack/nova master: RPC changes to prepare for NUMA live migration  https://review.openstack.org/63460502:19
openstackgerritArtom Lifshitz proposed openstack/nova master: NUMA live migration support  https://review.openstack.org/63460602:19
mriedemgdi artom02:21
mriedemhttps://review.openstack.org/#/c/634606/36/nova/conductor/tasks/live_migrate.py@17702:22
yonglihemriedem: how about i remove the avaliable zone from request and ignore the returned 'nova' avaliable zone in api-sample?02:24
mriedemyonglihe: if you remove the availability_zone=nova from the server create request, the response will correctly be az=nova02:26
mriedembut that's fine02:26
mriedemjust remove the az from the request02:26
yongliheok then.02:26
yonglihemriedem:  we can not use self.sg_uuid in generalize_subs, because the api sample json verified failed while running it next time.02:30
*** hongbin has joined #openstack-nova02:32
mriedemI'm not sure why you even need generalize_subs since you are doing this in the tests:02:35
mriedemsubs['sg_uuid'] = self.sg_uuid02:35
mriedemas noted, if you just change the template to use %(uuid)s then you don't need the sg_uuid variable02:35
mriedemi know the api samples functional tests are frustrating...02:35
mriedemthere is a lot of black magic involved in making them work02:36
yongliheyeah, I tried, only if I put it in generalize_stub it works..., i changed the template use %(uuid)s, it might conflict with other uuid? i don't know, I gonna try if that works. thanks.02:38
*** dcdawg has joined #openstack-nova02:39
mriedem%(uuid)s is just a regex matcher02:40
mriedemso any uuid will pass02:40
mriedemor should02:40
mriedemyonglihe: see how far you get and push up your changes. if i find more stuff i'll just make the changes myself so we can get this approved.02:41
*** itlinux has joined #openstack-nova02:41
yonglihethanks, i think then it gonna works, i'm working on that.02:42
*** dcdawg has quit IRC02:43
*** sdake has quit IRC02:46
*** Dinesh_Bhor has quit IRC02:49
yongliheuse 'uuid' instead of 'sg_uuid' ruined response checking. https://www.irccloud.com/pastebin/2YH9pvmK/use%20'uuid'%20instead%20of%20'sg_uuid'%20ruined%20response%20checking.02:52
*** Dinesh_Bhor has joined #openstack-nova02:53
*** gbarros has quit IRC02:59
*** psachin has joined #openstack-nova03:02
*** wolverineav has quit IRC03:06
*** dave-mccowan has joined #openstack-nova03:07
*** udesale has joined #openstack-nova03:15
*** sdake has joined #openstack-nova03:16
*** sdake has quit IRC03:17
*** sdake has joined #openstack-nova03:23
*** sdake has quit IRC03:23
mriedemgibi: bauzas: questions inline for the reshaper functional test https://review.openstack.org/#/c/631559/1203:24
mriedemyonglihe: i can't see the full paste03:24
mriedemi mean the actual error response03:24
mriedemyonglihe: the %(uuid)s has to be in the response template, not the request03:25
mriedemfor the request you have to actually pass the server group uuid03:25
yongliheohh, i got..03:25
*** takamatsu has quit IRC03:25
mriedemin the response template you're saying, i don't care what the server group id is, just that it's present and it's a uuid03:26
mriedemin the request you need to actually pass, via subs, the server group id in the server create request03:26
yonglihei did add to a wrong place..03:27
*** sdake has joined #openstack-nova03:27
yongliheps, we do need own _test_servers_post to pass the sg_uuid in the request template.03:29
*** itlinux has quit IRC03:29
mriedemok. i guess we could pass an extra_subs parameter to _post_server to deal with that but it's up to you03:31
mriedemanyway, i need to shut down for the day, i will look at your changes in the morning03:31
*** dave-mccowan has quit IRC03:32
*** mriedem has quit IRC03:32
*** itlinux has joined #openstack-nova03:33
openstackgerritYongli He proposed openstack/nova master: Adds the server group info into show server detail API.  https://review.openstack.org/62147403:33
yongliheget some rest, take care, thanks.03:34
*** sdake has quit IRC03:40
*** wolverineav has joined #openstack-nova03:40
*** awalende has joined #openstack-nova03:43
*** tbachman has quit IRC03:44
*** wolverineav has quit IRC03:47
*** awalende has quit IRC03:47
*** markvoelker has joined #openstack-nova03:48
*** tbachman has joined #openstack-nova03:50
openstackgerritZhenyu Zheng proposed openstack/nova master: Detach/Attach root volume API changes  https://review.openstack.org/62398103:55
*** wolverineav has joined #openstack-nova04:08
*** spsurya has joined #openstack-nova04:14
*** wolverineav has quit IRC04:17
*** markvoelker has quit IRC04:20
*** ileixe has quit IRC04:23
*** betherly has joined #openstack-nova04:26
*** betherly has quit IRC04:31
*** _fragatina has joined #openstack-nova04:54
*** ileixe has joined #openstack-nova05:00
*** takamatsu has joined #openstack-nova05:05
*** takamatsu has quit IRC05:10
*** zhubx has quit IRC05:13
*** zhubx has joined #openstack-nova05:13
*** wolverineav has joined #openstack-nova05:14
*** hongbin has quit IRC05:16
*** markvoelker has joined #openstack-nova05:17
*** wolverineav has quit IRC05:19
*** sridharg has joined #openstack-nova05:25
*** ShilpaSD has quit IRC05:27
*** ratailor has joined #openstack-nova05:28
*** itlinux has quit IRC05:28
*** sdake has joined #openstack-nova05:29
*** _fragatina has quit IRC05:41
*** brinzhang has joined #openstack-nova05:41
*** liuyulong_ has joined #openstack-nova05:45
*** markvoelker has quit IRC05:51
*** ileixe has quit IRC05:52
*** ileixe has joined #openstack-nova05:52
*** psachin has quit IRC05:58
*** psachin has joined #openstack-nova06:00
*** sdake has quit IRC06:02
openstackgerritmelanie witt proposed openstack/nova master: Add user_id field to InstanceMapping  https://review.openstack.org/63335006:05
openstackgerritmelanie witt proposed openstack/nova master: Populate InstanceMapping.user_id during migrations and schedules  https://review.openstack.org/63857406:05
openstackgerritmelanie witt proposed openstack/nova master: Add online data migration for populating user_id  https://review.openstack.org/63335106:05
openstackgerritmelanie witt proposed openstack/nova master: Add get_counts() to InstanceMappingList  https://review.openstack.org/63807206:05
openstackgerritmelanie witt proposed openstack/nova master: WIP Count instances from mappings and cores/ram from placement  https://review.openstack.org/63807306:05
openstackgerritmelanie witt proposed openstack/nova master: Use instance mappings to count server group members  https://review.openstack.org/63832406:05
*** zhubx has quit IRC06:08
*** zhubx has joined #openstack-nova06:08
*** janki has joined #openstack-nova06:15
*** sdake has joined #openstack-nova06:22
*** moshele has joined #openstack-nova06:24
*** sdake has quit IRC06:26
*** ivve has joined #openstack-nova06:36
*** liuyulong_ has quit IRC06:38
openstackgerritBoxiang Zhu proposed openstack/nova master: Convert to raw format into rbd volume  https://review.openstack.org/63808006:40
*** sdake has joined #openstack-nova06:42
*** markvoelker has joined #openstack-nova06:48
*** Luzi has joined #openstack-nova06:50
*** mdbooth_ has joined #openstack-nova06:50
cfriesenalex_xu: any chance you could take another look at https://review.openstack.org/#/c/620706/ ?06:52
*** mdbooth has quit IRC06:53
openstackgerritMerged openstack/nova master: Use the correct mdev allocated from the pGPU  https://review.openstack.org/63659106:55
alex_xucfriesen: I guess I didn't express myself again https://review.openstack.org/#/c/620706/24/nova/compute/api.py@624, I mean using get_best_cpu_toplogy instead of _get_cpu_topology_constraints, not rename the method06:57
cfriesenalex_xu: ah, I understand now.  will take a look06:58
*** _hemna has joined #openstack-nova07:00
*** tkajinam_ has joined #openstack-nova07:02
alex_xucfriesen: thanks07:04
*** tkajinam has quit IRC07:05
*** _hemna has quit IRC07:05
*** dpawlik has joined #openstack-nova07:08
openstackgerritChris Friesen proposed openstack/nova master: Add emulated TPM support to Nova  https://review.openstack.org/63136307:09
openstackgerritChris Friesen proposed openstack/nova master: Split up _is_storage_shared_with() in libvirt driver  https://review.openstack.org/63993307:09
openstackgerritChris Friesen proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.openstack.org/63993407:09
cfriesenalex_xu: we can't call get_best_cpu_topology() because the values for "allow_threads" and possibly "numa_topology" are not known07:15
*** sdake has quit IRC07:15
openstackgerritTakashi NATSUME proposed openstack/nova master: Fix an error when generating a host ID  https://review.openstack.org/63993607:17
cfriesensean-k-mooney: https://review.openstack.org/#/c/639934 is now the top of three commits for emulated vTPM.07:18
*** sdake has joined #openstack-nova07:18
*** sdake has quit IRC07:19
*** brinzhang has quit IRC07:20
*** markvoelker has quit IRC07:20
*** brinzhang has joined #openstack-nova07:21
alex_xucfriesen: we needn't pass those two parameter, we just want the check in the _get_possible_cpu_topologies07:21
alex_xucfriesen: oh, vmware driver need allow_threads as False07:22
alex_xusounds like we have to check the valid cpu topo in the last stage07:25
cfriesenalex_xu: I think the only real risk is that we might hit exception.ImageVCPULimitsRangeImpossible later on07:25
alex_xucfriesen: yes, that is one I thought we can check in the beginning also07:26
cfriesenif we called it with the default allow_threads=True, it would at least tell us if it's even possible on a libvirt host.  It might still fail on a vmware host07:28
alex_xuyes07:28
cfriesenit would mean doing extra work to enumerate and sort the possible topologies though07:28
*** ircuser-1 has joined #openstack-nova07:29
cfriesenif you think it's worth it I'm willing to change it07:29
cfriesenor maybe we could try for a follow-up patch to do it more efficiently07:30
cfriesenmaybe a flag to bail out as soon as we find one possibility and avoid the sorting07:31
alex_xucfriesen: that three level loop is terrible, and sounds like we have no limit on the max value07:31
alex_xuit is ok for flavor, since it is admin api07:33
cfriesenmaybe merge this as-is and then work on figuring out an efficient way to check for exception.ImageVCPULimitsRangeImpossible ?07:33
alex_xuyes, it is ok. another thing is '_get_cpu_topology_constraints' is private method with '_' prefix07:34
alex_xucfriesen: also for https://review.openstack.org/#/c/620706/24/nova/compute/api.py@626, I didn't mean get rid of validate_numa flag, I mean get rid of line 3572 "image['status'] = 'active'"07:38
cfriesenfor _get_cpu_topology_constraints(), are you suggesting to remove the prefix?07:39
alex_xuyes, but it can be a followup refactor patch07:39
cfriesenif you look at the final version, you can see I did get rid of what was at 3572 by creating a new function _validate_flavor_image_nostatus()07:41
cfriesenand calling it from the resize code path07:41
alex_xugreat, I will take a look at07:43
cfriesengotta go to bed.  goodnight.07:51
*** ratailor has quit IRC07:51
*** ccamacho has joined #openstack-nova07:59
*** tesseract has joined #openstack-nova08:00
*** igordc has quit IRC08:00
*** zhubx has quit IRC08:07
*** zhubx has joined #openstack-nova08:08
*** awalende has joined #openstack-nova08:11
openstackgerritZhenyu Zheng proposed openstack/nova master: Detach/Attach root volume API changes  https://review.openstack.org/62398108:15
*** markvoelker has joined #openstack-nova08:18
*** imacdonn_ has quit IRC08:18
*** imacdonn_ has joined #openstack-nova08:18
*** tssurya has joined #openstack-nova08:19
gibibauzas: i've started looking into mriedem's questions in the reshape functional test patch. Let me know if you are about to change something in that patch08:21
bauzasgibi: I first need to look at those08:21
*** bhagyashris has joined #openstack-nova08:22
*** zhubx has quit IRC08:26
*** zhubx has joined #openstack-nova08:26
gibibauzas: If you are OK with that then I will go and fix mriedem's comments in there08:28
*** takashin has left #openstack-nova08:30
gibibauzas: or shall I post the fix as a followup?08:31
*** pcaruana has joined #openstack-nova08:32
bauzasgibi: /me looking08:33
bauzasgiven I already updated your change, which is on top, I'm fine with you updating it08:33
bauzasno need for a FUP unless those are nits and we already have a +208:33
gibibauzas: we already have +2 from efried08:34
bauzasoh my bad08:35
bauzaswell, your choice08:35
*** mvkr has joined #openstack-nova08:35
gibibauzas: OK08:35
bauzasI think we can certainly get efried approving it again08:35
*** ralonsoh has joined #openstack-nova08:36
bauzasgibi: ideally, we could also squash efried's patch into it08:36
*** helenafm has joined #openstack-nova08:37
*** tkajinam_ has quit IRC08:38
gibibauzas: I would ask efried about before we squash08:38
bauzasyup, i agree08:38
bauzasor add him as co-author if you wanna be quick08:39
*** tosky has joined #openstack-nova08:39
bauzasgibi: I also need to write a new change, so I -W'd https://review.openstack.org/#/c/599208/1808:40
bauzasI'm on it08:40
bauzasshould be quick hopefully08:40
gibibauzas: OK08:41
*** ratailor has joined #openstack-nova08:42
*** markvoelker has quit IRC08:50
*** jaosorior has joined #openstack-nova09:06
*** ttsiouts has joined #openstack-nova09:11
*** elod has quit IRC09:12
*** sdake has joined #openstack-nova09:15
*** phasespace has joined #openstack-nova09:21
*** udesale has quit IRC09:28
*** udesale has joined #openstack-nova09:29
*** derekh has joined #openstack-nova09:35
openstackgerritBhagyashri Shewale proposed openstack/nova master: Ignore root_gb for BFV in simple tenant usage API  https://review.openstack.org/61262609:37
*** bhagyashris has quit IRC09:42
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions  https://review.openstack.org/53741409:45
*** sdake has quit IRC09:46
*** markvoelker has joined #openstack-nova09:47
openstackgerritBalazs Gibizer proposed openstack/nova master: Add functional test for libvirt vgpu reshape  https://review.openstack.org/63155909:47
*** rcernin has quit IRC09:48
openstackgerritStephen Finucane proposed openstack/nova master: Modify PciDevice.uuid generation code  https://review.openstack.org/53048709:48
openstackgerritStephen Finucane proposed openstack/nova master: Add an online migration for PciDevice.uuid  https://review.openstack.org/53090509:48
stephenfingibi, bauzas: Fancy putting this through? https://review.openstack.org/#/c/608407/09:49
openstackgerritBalazs Gibizer proposed openstack/nova master: FUP: docs nit  https://review.openstack.org/63964709:49
*** dtantsur|afk is now known as dtantsur09:49
gibistephenfin: looking09:49
gibistephenfin: done09:51
stephenfin\o/ ta09:51
*** panda|ruck|off is now known as panda|ruck09:51
openstackgerritStephen Finucane proposed openstack/nova master: Summarize output of sample configuration generator  https://review.openstack.org/62501409:51
bauzashah, got one hour meeting from some tax credit https://www.impots.gouv.fr/portail/international-professionnel/tax-incentives09:52
bauzasfolks, in case you wanna relocate in France, consider it twice before moving09:52
openstackgerritBalazs Gibizer proposed openstack/nova master: Test proper allocation of devices during reshape  https://review.openstack.org/63985409:53
stephenfinlyarwood: Fancy taking a look at this today? https://review.openstack.org/#/c/626369/09:53
gibibauzas: if you have any idea about https://review.openstack.org/#/c/631559/13/nova/tests/unit/virt/libvirt/fakelibvirt.py@1548 then tell me. The current test works if I return nothing but I shoudl return some nvidia-11 mdev_type there09:54
bauzasgibi: looking09:55
bauzashah09:56
bauzasgibi: it's because of https://github.com/openstack/nova/blob/master/nova/virt/libvirt/host.py#L89309:56
lyarwoodstephenfin: sure09:56
bauzasgibi: sec, giving you the right XML that I used for my UTs10:00
bauzasgibi: try this one https://github.com/openstack/nova/blob/master/nova/tests/unit/virt/libvirt/test_driver.py#L298-L32210:02
bauzasgibi: AFAIR, the libvirt docs is probably badly writtent10:02
bauzaswritten*10:03
openstackgerritStephen Finucane proposed openstack/nova master: Summarize output of sample configuration generator  https://review.openstack.org/62501410:04
openstackgerritStephen Finucane proposed openstack/nova master: conf: Remove 'disable_libvirt_livesnapshot' option  https://review.openstack.org/62693210:06
*** elod has joined #openstack-nova10:10
gibibauzas: thanks. let me try10:10
openstackgerritStephen Finucane proposed openstack/nova master: Update docs, API samples for noVNC 1.0.0  https://review.openstack.org/55017310:12
openstackgerritZhenyu Zheng proposed openstack/nova master: Detach/Attach root volume API changes  https://review.openstack.org/62398110:13
stephenfinlyarwood: Looks like Ubuntu 19.04 will finally switch to noVNC 1.0, but that leaves this patch in limbo til 20.04 is out at least. I wonder if I should just abandon it or insert a TODO instead? https://review.openstack.org/#/c/550173/10:14
stephenfin(Ubuntu 19.04 assertion made based on https://packages.ubuntu.com/search?keywords=novnc)10:14
lyarwoodstephenfin: I've already bumped the package in Fedora 28 FWIW10:15
* lyarwood clicks10:15
openstackgerritgaryk proposed openstack/nova master: Better handle live migration abort  https://review.openstack.org/63544010:16
lyarwoodstephenfin: so with the fedora package at least both URLs should still work10:16
stephenfinlyarwood: Oh, really? Symlink?10:17
lyarwoodstephenfin: I'd abandon and return to this with 20.0410:17
lyarwoodstephenfin: yeah10:17
lyarwoodstephenfin: https://src.fedoraproject.org/rpms/novnc/blob/master/f/novnc.spec#_3610:18
stephenfinNice. I'll abandon that for now so. Trying to clean up my list of open patches (there are a few)10:18
openstackgerritgaryk proposed openstack/nova master: Better handle live migration abort  https://review.openstack.org/63544010:20
gibibauzas: still seeing some strange behavior, I will push a separate patch up so you can also look at it in parallel10:21
bauzasgibi: okay10:21
bauzasgibi: thanks for helping out10:21
*** markvoelker has quit IRC10:21
stephenfinbauzas, gibi: Actually, input time. I've done two different things in similar scenarios https://review.openstack.org/#/c/626932/ https://review.openstack.org/#/c/608407/10:22
openstackgerritBalazs Gibizer proposed openstack/nova master: handle mdev_type device in fakelibvirt  https://review.openstack.org/63997410:22
gibibauzas: ^^10:22
stephenfinbauzas, gibi: Both refer to config options that workaround bugs in older libvirt versions that we no longer support. In the former, I just dropped it. In the latter, I did the full deprecation cycle. Thoughts on which is preferable?10:23
bauzasstephenfin: I'm in favor of being gentle with our ops10:23
*** udesale has quit IRC10:24
*** udesale has joined #openstack-nova10:24
bauzasstephenfin: what's the libvirt min version we support ?10:25
bauzaskashyap: ^?10:25
gibistephenfin: the config driver format config still works even if it is not needed to set to vfat10:25
stephenfinbauzas: 3.010:25
gibistephenfin: so there keeping the config is meaningful10:25
gibistephenfin: would disable_libvirt_livesnapshot still disable the snapshot in Stein if we keep it?10:26
gibiif yes, then I would just deprecate that config too10:26
stephenfingibi: Yeah, it would. I'll deprecate that instead so10:26
bauzasstephenfin: the problem is that we provided a flag which, even if tied to a specific version, allows a specific behaviour10:26
bauzasstephenfin: so people can use it even if they have newer libvirt10:27
* gibi goes to fetch something edible10:27
*** sdake has joined #openstack-nova10:35
openstackgerritStephen Finucane proposed openstack/nova master: conf: Deprecate 'disable_libvirt_livesnapshot' option  https://review.openstack.org/62693210:37
stephenfinbauzas, gibi: Updated to deprecate instead of remove outright, if you fancy hitting that too ^10:37
* stephenfin -> reviews10:38
openstackgerritYongli He proposed openstack/nova master: Adds the server group info into show server detail API.  https://review.openstack.org/62147410:39
*** sridharg has quit IRC10:39
*** wolverineav has joined #openstack-nova10:42
kashyapbauzas: Hi10:42
kashyapbauzas: Was briefly AFK; it's documented in the driver.py :-)10:42
openstackgerritYongli He proposed openstack/nova master: Adds the server group info into show server detail API.  https://review.openstack.org/62147410:42
*** ccamacho has quit IRC10:43
openstackgerritStephen Finucane proposed openstack/nova master: docs: Dedupe controller install guides  https://review.openstack.org/63871510:43
openstackgerritStephen Finucane proposed openstack/nova master: docs: Dedupe compute install guides  https://review.openstack.org/63871610:43
kashyapbauzas: Currently these:10:43
kashyapMIN_LIBVIRT_VERSION = (3, 0, 0)10:43
kashyapMIN_QEMU_VERSION = (2, 8, 0)10:43
openstackgerritStephen Finucane proposed openstack/nova master: conf: Call out where pci.alias should be set  https://review.openstack.org/62444510:44
*** wolverineav has quit IRC10:46
*** ccamacho has joined #openstack-nova10:49
*** dpawlik has quit IRC11:00
*** cdent has joined #openstack-nova11:00
*** agopi has quit IRC11:06
*** erlon has joined #openstack-nova11:08
*** ttsiouts has quit IRC11:10
*** ttsiouts has joined #openstack-nova11:10
*** mikal has quit IRC11:15
*** ttsiouts has quit IRC11:15
*** markvoelker has joined #openstack-nova11:18
*** ileixe has quit IRC11:18
*** sdake has quit IRC11:18
*** sdake has joined #openstack-nova11:19
*** Dinesh_Bhor has quit IRC11:23
*** brinzh has joined #openstack-nova11:28
*** brinzhang has quit IRC11:29
*** brinzhang has joined #openstack-nova11:31
*** brinzh has quit IRC11:33
*** tbachman has quit IRC11:41
*** mkarpiarz has joined #openstack-nova11:44
mkarpiarzHi. Can someone please take a look at https://bugs.launchpad.net/nova/+bug/1780225/comments/3?11:46
openstackLaunchpad bug 1780225 in OpenStack Compute (nova) "Libvirt error when using --max > 1 with vGPU" [High,Confirmed] - Assigned to Sylvain Bauza (sylvain-bauza)11:46
*** _fragatina has joined #openstack-nova11:46
mkarpiarzI can see 2 ways of fixing this11:46
mkarpiarz1. Store the list of available mediated devices in some global structure.11:48
mkarpiarz2. Let the instance fail in launch and return back to spawn(), so it can check available devices again.11:49
*** markvoelker has quit IRC11:50
mkarpiarzAny other ideas?11:51
*** dpawlik has joined #openstack-nova11:52
openstackgerritLee Yarwood proposed openstack/nova master: WIP context: Ensure templated connection URLs are rendered before use  https://review.openstack.org/63960711:54
*** sdake has quit IRC11:55
*** ttsiouts has joined #openstack-nova12:09
openstackgerritMerged openstack/nova master: conf: Deprecated 'config_drive_format'  https://review.openstack.org/60840712:12
*** brinzhang has quit IRC12:13
*** _pewp_ has quit IRC12:16
*** _pewp_ has joined #openstack-nova12:16
*** hemna has quit IRC12:17
*** hemna has joined #openstack-nova12:19
*** ratailor has quit IRC12:28
openstackgerritArtom Lifshitz proposed openstack/nova master: CONF.enable_numa_live_migration is not needed >= Stein  https://review.openstack.org/64002112:32
openstackgerritBalazs Gibizer proposed openstack/nova master: Add remove_resources_from_instance_allocation to report client  https://review.openstack.org/63965312:35
gibiefried: fixed nits and replied about the retry in ^^12:36
*** ccamacho has quit IRC12:38
*** sridharg has joined #openstack-nova12:41
openstackgerritsean mooney proposed openstack/nova master: Add free for claimed, allocated devices  https://review.openstack.org/61612012:43
openstackgerritsean mooney proposed openstack/nova master: Allow per-port modification of vnic_type and profile  https://review.openstack.org/60736512:43
openstackgerritsean mooney proposed openstack/nova master: Add get_instance_pci_request_from_vif  https://review.openstack.org/61992912:43
openstackgerritsean mooney proposed openstack/nova master: SR-IOV Live migration indirect port support  https://review.openstack.org/62011512:43
openstackgerritsean mooney proposed openstack/nova master: libvirt: auto detach/attach sriov ports on migration  https://review.openstack.org/62958912:43
sean-k-mooneyresolved minor merge conflict and rebased to master otherwise no other changes in that series12:43
*** panda|ruck is now known as panda|ruck|lunch12:44
*** tacco has joined #openstack-nova12:46
*** markvoelker has joined #openstack-nova12:47
taccohi there.. i have a issue with a redeployed hypervisor.. after deployment i see a "ResourceProviderCreationFailed: Failed to create resource provider" error when trying to start nova or migrating a instance to this hypervisor https://pastebin.com/zMHUUYEW12:47
yaawanghi, could anyone please take a review on https://review.openstack.org/#/c/637834/, this a patch about libvirt cpu models select :-)12:55
*** erlon has quit IRC12:58
*** ccamacho has joined #openstack-nova13:06
*** dave-mccowan has joined #openstack-nova13:10
*** mchlumsky has joined #openstack-nova13:13
*** erlon has joined #openstack-nova13:15
*** tbachman has joined #openstack-nova13:17
*** rtjure has joined #openstack-nova13:17
*** markvoelker has quit IRC13:20
*** zhubx has quit IRC13:23
*** zhubx has joined #openstack-nova13:23
*** lchabert has quit IRC13:29
*** gbarros has joined #openstack-nova13:29
*** panda|ruck|lunch is now known as panda|ruck13:30
openstackgerritLee Yarwood proposed openstack/nova master: WIP context: Ensure templated connection URLs are rendered before use  https://review.openstack.org/63960713:31
artomsean-k-mooney, wait, we can have nested virt in nodepool now? mnaser, is vexxhost doing that now?13:33
mnaserartom: weā€™re doing it but13:33
sean-k-mooneyartom: technically. the ci jobs will still try to disable it but we can renable it13:33
mnaserIā€™m trying not to broadcast it too much13:33
artommnaser, oops, sorry :)13:34
mnaserI want the jobs that use it are jobs that need to use it, not.. just do it can be faster13:34
mnaserSo Magnum is a case where it was useful and thatā€™s why we added it13:34
artommnaser, well, NUMA live migration *needs* to use it :)13:34
sean-k-mooneymnaser: i brought it up in the context of testing nuam aware live migration13:34
mnaserYeah then Iā€™d be supportive of it13:34
artommnaser, sweet!13:35
sean-k-mooneyartom: as i said it would have to be non voting however13:35
yonglihemriedem:  alex_xu:  https://review.openstack.org/621474   updated per all comments. I have to have rest. have a good one everyone.13:35
artomsean-k-mooney, yeah that's fine, we have to start somewhere13:35
artomEven just being able to trigger a job manually that posts publicly would be a great first step13:35
sean-k-mooneyartom: if ovh/packet reenable it in the future we might be able to make it voting eventually13:36
*** imacdonn_ has quit IRC13:36
artomsean-k-mooney, baby steps :)13:36
sean-k-mooneyartom: well you could start by adding it to the experimental pipeline13:36
sean-k-mooneythat requires a comment ot trigger it13:36
artomsean-k-mooney, wouldn't I have to start by moving whitebox to the openstack namespace?13:36
sean-k-mooneyyes13:37
sean-k-mooneyi ment after that13:37
sean-k-mooneyand you know after we write all the tests13:37
artomHey, I have some written already :)13:37
sean-k-mooneydid you look at the list i gave in the email13:38
artomYeah13:38
sean-k-mooneyfeel free to automate those while i test them13:38
artomsean-k-mooney, that'll kinda depend on whether the absence of func tests is a blocker for mriedem13:38
artomIf it is, those take priority before FF13:39
sean-k-mooneyyep13:39
artomOther than that timing issue, I'll happily hax those up13:39
*** gbarros has quit IRC13:39
*** moshele has quit IRC13:40
sean-k-mooneyartom: once you get the first functional test working i suspect the rest will be fairly staight forward13:43
sean-k-mooneyif you can add the functional test as a follow up that will reduce churn and make my testing eaisier13:44
*** gbarros has joined #openstack-nova13:44
artomsean-k-mooney, yep, good idea. I can start with the tests in a new patch on top, and we can squash later13:44
sean-k-mooneyyep or even just keep it on top13:45
sean-k-mooneysquashing them to keep them with the feature code is nice but i dont think its required13:45
*** gbarros has quit IRC13:46
*** dpawlik has quit IRC13:51
*** _pewp_ has quit IRC13:53
*** lchabert has joined #openstack-nova13:53
*** _pewp_ has joined #openstack-nova13:53
*** lbragstad has joined #openstack-nova13:54
*** awaugama has joined #openstack-nova13:58
sean-k-mooneymnaser: by they way do you use kvm on ubuntu 18.04 for vexhost?14:00
mnasersean-k-mooney: centos 714:00
sean-k-mooneyah ok14:00
mnaserbut we've managed to get the perfect combo for functional nested virt14:00
mnaserthanks a lot to the kata containers folks14:00
sean-k-mooneythere is a bug in the ubunut 18.04 kernel that breaks nested virt14:00
sean-k-mooneyi had to replace mine with the mainline 4.20 kernel to fix issues14:01
mnaseryeah our ci is worked out pretty often both by magnum and kata and their nested virt has been super stable14:01
*** jmlowe has quit IRC14:01
*** itlinux has joined #openstack-nova14:01
*** betherly has joined #openstack-nova14:02
sean-k-mooneyya i went with ubuntu 18.04 because kolla-ansibel source deploys work better on ubuntu then centos in my previos experience14:02
sean-k-mooneymnaser: do ye use openstack ansible for your production installation14:03
mnasersean-k-mooney: yeah14:03
*** moshele has joined #openstack-nova14:03
sean-k-mooneyi must get around to checking that out at some point but since its working im not going to touch it untill i need to upgrade :)14:03
*** mmethot has joined #openstack-nova14:06
*** mdbooth_ is now known as mdbooth14:08
*** itlinux has quit IRC14:08
mdboothbauzas: Do you recall why rebuild is forced to be on the same host? Is it just because the way rebuild is written doesn't allow for a migration, or is it fundamental to the intent of rebuild? Or some other reason?14:10
*** jistr is now known as jistr|call14:11
sean-k-mooneymdbooth: why would a rebuild ever need to migrate if the image does not change14:12
sean-k-mooneyif the image does change we hit the schulder14:12
mdboothbauzas: I ask because I was looking at the attach/detach root volume patches. They look fine, but shelve/unshelve is just distasteful, so having it as the only available option seems undesirable. Reading the original spec, it sounds to me like they want to rebuild on a different host...14:12
mdboothWhich is an evacuate#14:12
mdboothEvacuate with a different root volume.14:12
mdboothHmm14:12
mnasersean-k-mooney: be happy to help you get setup on OSA14:13
mdboothsean-k-mooney: Yes, we hit the scheduler but constrain it to return the original host or return NoValidHost14:13
*** awaugama has quit IRC14:13
*** mriedem has joined #openstack-nova14:13
mdboothRebuild on a different host with a different root volume...14:14
sean-k-mooneymnaser: its more just i have not taken the time to try it out. i learn how kolla ansible worked a few years ago and it served well enough for my personal needs14:14
sean-k-mooneymdbooth: ah ok14:14
*** dpawlik has joined #openstack-nova14:14
bauzasmdbooth: because it doesn't ask for other resources, just for an image14:14
bauzasunless you evacuate :)14:14
mdboothbauzas: Given that evacuate exists, I'm guessing most of this is already wired up.14:15
bauzasyeah, that's actually the change in between evacuate and rebuild14:15
mdboothIn fact: cold migrate with a different root volume.14:16
bauzasevacuate is just the same rebuild path but with a different API action :)14:16
bauzashum no14:16
bauzascold migrate != evacuate14:16
bauzasevacuate == rebuild(different_host)14:16
mdboothbauzas: Hmm, no. It doesn't consider a change of image.14:16
mdboothBut I was thinking that you might have a root volume and ephemeral disks, in which case you might want to migrate them.14:17
*** jmlowe has joined #openstack-nova14:17
*** jmlowe has quit IRC14:17
*** markvoelker has joined #openstack-nova14:18
*** wolverineav has joined #openstack-nova14:18
mdboothbauzas: So, going back to the original question, why do we go to lengths to ensure that rebuild doesn't change host?14:19
bauzasmdbooth: I'm not the rebuild specialist14:20
*** phasespace has quit IRC14:20
bauzassome others hitted so many times issues with rebuild that they're more knowledgable than me, like... mriedem ? :)14:20
mdboothbauzas: Ah, sorry. I pinged you because you were co-author in a patch which added this constraint.14:20
mdboothmriedem was the other author.14:20
bauzasknowledgable * (not sure it's a word)14:20
mdboothbauzas: Yeah, it's a word. Pretty sure that's not how you spell it, but I wouldn't have called you on it as I'm not 100% sure myself ;)14:21
*** wolverineav has quit IRC14:22
mriedemwhat is the question?14:23
mriedemwhy doesn't rebuild migrate?14:23
mriedemwhy do we validate the image against the scheduler when it changes?14:23
mriedembecause build is on the same host14:23
mriedemwhy? because that's the way it originated14:23
mdboothmriedem: Yeah. Specifically why does it go to length to prevent a change of host even when calling the scheduler?14:23
mdboothmriedem: Right, that was my first guess.14:23
mriedemthen over the years it turned out it was buggy and to maintain the api contract but resolve those bugs we had to build stuff into it14:24
mdboothSo there's no fundamental reason that it shouldn't, it's just that the control flow doesn't support it.14:24
mriedemi wasn't around when rebuild was added14:24
sean-k-mooneymdbooth: it calls the schudler to validate the current host is still valide as changeing the image means the image metadata could invaldate the current host14:24
mriedemfwiw,14:24
mriedemit's also got a latent bug where the image can change numa topology which does not send new numa topology limits to the compute service to do a resource claim14:25
sean-k-mooneymdbooth: you can rebuild instance with sriov14:25
mriedembecause rebuild doesn't do any resource claim, because it was assumed that the flavor never changed (because it doesn't in the api) and the scheduler wouldn't be used14:25
sean-k-mooneyactully it cold migration ignore that14:25
mriedemso over time we added more features to nova (numa support) which broke existing flows14:25
mdboothmriedem: Going up a level, I was just considering the shelve/unshelve approach for attach/detach root volume. While that's obviously great if it allows the user to do something which is currently impossible, it still requires shelve/unshelve. I was considering if it could also be added to some other less nasty operation.14:25
mriedemwhat is nasty about shelve/unshelve?14:26
mriedemi don't see how that's any nastier than trying to make rebuild trigger a migration14:26
mriedemlots of people actually want the stop operation to be a shelve14:26
mdboothI specifically don't like the way shelve/unshelve abuses the image cache.14:26
mdboothProbably fixing that would be simpler, I guess.14:27
sean-k-mooneythats specifcally for non bvf instances right. bfv instnace should not mess with the image cache14:28
mdboothHowever, if all the user is trying to do is DR an instance (from the spec), going via glance isn't the most efficient solution.14:28
openstackgerritJim Rollenhagen proposed openstack/nova master: Fix typo in vmware get_info docstring  https://review.openstack.org/64004214:29
openstackgerritJim Rollenhagen proposed openstack/nova master: Remove TypeError handling for get_info  https://review.openstack.org/64004314:29
*** jmlowe has joined #openstack-nova14:29
mdboothThat's a point... in the DR case you'd presumably be evacuating anyway, so you still couldn't evacuate with a different root volume.14:29
sean-k-mooneymdbooth: that depend some of the usescase in the spec impliend at least to me that the remote fail over sigt may not have direct conectivity at the hyperviosr level. e.g. a migrtion to the second sight may now actully work14:30
sean-k-mooney*sigt -> site sight->site14:31
mdboothShelve/unshelve is *extremely* space inefficient. You're basically storing a flattened snapshot at the point of shelve in the image cache forever.14:32
mdboothBut not for BFV, I guess.14:32
sean-k-mooneymdbooth: doesnt ath depend on your glance backend14:32
mdboothsean-k-mooney: No. It might depend on Nova's imagebackend, though.14:33
sean-k-mooneyah right. i was thinking it might be effienet on ceph backed glance but may ceph imagebackend would help14:34
sean-k-mooneye.g. for non bfv instnaces14:34
mdboothI don't think we're at all clever about shelve of ceph instance to ceph glance.14:35
mdboothAnd ceph glance to ceph instance is efficient but problematic.14:35
efriedgibi, bauzas: Sorry, I meant to mention it in the change set - feel free to squash.14:38
*** awaugama has joined #openstack-nova14:41
bauzasefried: thanks14:41
*** markvoelker has quit IRC14:50
artommriedem, hey, just to get a feel for what I should concentrate on next, is the absence of func tests for NUMA live migration a blocker? If so, I'll start on that now, otherwise, I'll advance integration testing - and can add func tests after FF?14:55
artom(Assuming it merges, that is - but that's just my carebear optimism ;)14:56
*** mlavalle has joined #openstack-nova14:56
mriedemartom: did you see my comments about the compute service version check in the conductor task?14:56
artommriedem, did, and addressed in a new patch on top14:56
artom(Figured it's legit to split them for easier reviewing)14:57
mriedemartom: ok i didn't know how your integration testing could have even been working with that code the way it was, unless you were enabling that workaround14:57
artommriedem, that's... actually a good question14:57
artomBecause I sure as hell didn't set enable_numa_live_migration, and its default is False, right?14:58
mriedemcorrect14:58
artomAnd yet my integration tests *do* work, because they caught a logic flaw and failed when the pinning of 2 instances ended up overlapping14:58
mriedemwere you testing with that patch reverted?14:59
sean-k-mooneythere is a bug14:59
artommriedem, nope :/14:59
sean-k-mooneyin the numa migration config code14:59
sean-k-mooneyhttps://review.openstack.org/#/c/63535014:59
mriedemyou mean this if hypervisor_type != obj_fields.HVType.KVM:14:59
sean-k-mooneymriedem: artom cfriesen found and fixed it14:59
sean-k-mooneyyep it will be QEMU not kvm15:00
mriedemright so the blocker config doesn't actually do anything15:00
sean-k-mooneyright15:00
artomI swear I see stuff like that and I can't help but think "we're all just morons"15:00
artomNothing against anyone, and I'm including myself in that group15:00
taccohi there.. i have a issue with a redeployed hypervisor.. after deployment i see a "ResourceProviderCreationFailed: Failed to create resource provider" error when trying to start nova or migrating a instance to this hypervisor https://pastebin.com/zMHUUYEW15:01
artomAt least we found and fixed it before release :)15:01
taccoany idea?15:01
sean-k-mooneyits not merged yet. imgoing to recheck the patch. that said if we merger your code this is not needed15:01
artomsean-k-mooney, still needed for anything but full Stein deployments15:01
artomSee https://review.openstack.org/#/c/640021/ :)15:02
sean-k-mooneyya that is ture15:02
mriedemartom: it's already been backported to stable/rocky15:02
artommriedem, the CONF workaround? *sigh*15:02
sean-k-mooneyya so we will have to backport the fix too but sice its currently a noop it wont break anything15:03
*** awalende has quit IRC15:04
sean-k-mooneyits annoying but thats all15:04
*** awalende has joined #openstack-nova15:04
mriedemartom: yes https://review.openstack.org/#/q/I217fba9138132b107e9d62895d699d238392e76115:05
mriedemme thinks we should probably start an rc-potential etherpad...15:05
sean-k-mooneycfriesen: do you have time to repsin that by the way? if not ill add https://review.openstack.org/#/c/635350 to my list and ill file a bug15:05
mriedembecause there is just too much crap flying around for me to keep in my brain15:05
artommriedem, you mean rc blocker?15:06
* mdbooth found 2 typos in a comment: -2 please abandon15:07
mriedemhttps://etherpad.openstack.org/p/nova-stein-rc-potential15:08
mriedemmelwitt: ^15:08
sean-k-mooneyartom: not so much blocker but might warrent a second rc or shoudl be merged after ff as part of an rc15:08
artommriedem, so, sorry to pester, but the func tests blocker thing wasn't resolved15:09
*** awalende has quit IRC15:09
mriedemyou want closure from me in other words?15:09
artommriedem, heh, yeah. A sense of priorities, o wise leader :)15:10
mriedemwell i personally think it's pretty risky to land something as complicated as live migration with numa without some functional tests, but at the same time, i guess if it turns out to have bugs then they just get fixed and we trust your integration testing downstream15:12
cfriesensean-k-mooney: will respin15:12
*** ivve has quit IRC15:13
mriedemin general i loathe landing anything related to pci/numa/sriov when we have no 3rd party integration testing for it15:13
cfriesenwe'll be doing integration testing for live migration too15:13
dansmithmriedem: I too think it's fairly risky15:13
sean-k-mooneycfriesen: ok it just need a bug added.15:13
sean-k-mooneycfriesen: so it can be backported15:13
dansmithI haven't really had time to go back through it from a holistic "how do these pieces fit together" sort of view15:14
artommriedem, I know :/ Which is why I want to replace the Intel CI with something that's actually maintained15:14
cfriesendansmith: mriedem: totally risky.  but is it likely to break anything other than things that are already broken?15:14
dansmithbreaking live migration at all is a really bad thing to do15:14
dansmithcfriesen: yes?15:14
artomdansmith, basic live migration is tested in the gate though, right?15:15
mriedemyes,15:15
dansmithartom: during several partial upgrade situations?15:15
mriedemso if worst case scenario you break live migration with numa instances, well, those were already broken anyway - and if you're using that config (once fixed) you can't even initiate it15:15
artomNo :(15:15
mriedemdansmith: yes15:15
artomYes?15:15
mriedemthe live migration + grenade job15:15
dansmithmriedem: we have one right?15:15
artom\o/15:15
mriedemruns n-1 live migration back and forth15:15
mriedemit's non-voting15:15
artomWe should *really* check its output on the NUMA LM patches then15:16
dansmithmriedem: but not on systems that will report this stuff, even for non-numa flavors I think15:16
mriedemhttps://review.openstack.org/#/c/637231/15:16
mriedemdansmith: correct we don't do any numa stuff in the gate15:16
sean-k-mooneyartom: i would start on the functional tests and we can add the whitebox tempest test after ff15:17
dansmithit's not just numa-having instances,15:17
dansmithit's that everyone's systems report numa stuff, and if any of this works on a numaless guest instance for CI but is weird on a real system... we won't have coverage of that15:17
mriedemmrhillsman: would it be possible to use openlab for numa testing for nova?15:17
sean-k-mooneyartom: wether they are a blocker on not is seperate form if we should write them an i think we would all like to see functional tests for this eventually15:17
artomsean-k-mooney, oh yeah, they'll be there15:18
dansmithalso, some amount of live migration of numa-having instances works today but just doesn't claim or do the right thing, right?15:19
artomI'm wondering more "what gives others better confidence in the code to help it merge, automated integration tests that you have to run manually in your own env, or func tests?"15:19
dansmithif we were to break that in a way that doesn't let people move their instances in an emergency, even if the numaness gets messed up, that's still a big problem I think15:19
mrhillsmanmriedem yes sir15:19
sean-k-mooneydansmith: if the cpus are free on the destination then today everything works for pinned instance15:20
sean-k-mooneysimilarly for hugepage instnace15:20
dansmithright15:20
sean-k-mooneythe clamims get updated too i think15:21
dansmithso if we break that in this because we didn't test it on real systems... that's not "the situation can't get worse" to me15:21
sean-k-mooneythey are either healed by the periodic task or done explicitly i cant remember15:21
*** itlinux has joined #openstack-nova15:21
mrhillsmanso long as we can provide what is needed. filling out https://github.com/theopenlab/openlab/issues/new?template=test-request.md with what is needed is required15:22
artomsean-k-mooney, periodic task15:22
*** amorin has joined #openstack-nova15:23
mriedemmrhillsman: ah cool ok, i'll put this in our ptg agenda for discussion to see what minimum levels of testing we'd hope to get15:24
sean-k-mooneymrhillsman: do numa testing we would need either nested virt on a host with at least 2 numa nodes or a dual numa beremetal host15:24
mriedemmrhillsman: btw, who writes the tests? or is tempest used?15:24
cfriesensean-k-mooney: mriedem: hypervisor check bug is https://bugs.launchpad.net/nova/+bug/181809215:24
openstackLaunchpad bug 1818092 in OpenStack Compute (nova) "hypervisor check in _check_instance_has_no_numa() is broken" [Undecided,New]15:24
sean-k-mooneycfriesen: cool can you add "Close-Bug: 1818092" to the commit in your patch15:25
cfriesenyup, doing it now15:25
sean-k-mooneyawsome15:25
mrhillsmanmriedem you or some volunteers would15:25
* artom volunteers15:26
sean-k-mooneymriedem: we hope to move the redhat whitebox tempest plugin to openstack namespace15:26
artomUnless it's like, in Perl or JS or something.15:26
mrhillsmanthere is a lot of flexibility in how that works15:26
*** Luzi has quit IRC15:27
mrhillsmani think adding to the ptg is good if it is not a priority right now15:27
mriedemyup done L77 https://etherpad.openstack.org/p/nova-ptg-train15:27
mrhillsmancool, i will be sure to be there15:28
mriedemmaybe chenrui's team can help a bit, i.e. Kevin_Zheng since he is familiar with nova15:28
mrhillsman++15:28
openstackgerritChris Friesen proposed openstack/nova master: fix up numa-topology live migration hypervisor check  https://review.openstack.org/63535015:30
*** moshele has quit IRC15:30
cfriesensean-k-mooney: mriedem: there you go ^15:31
*** awalende has joined #openstack-nova15:32
mriedemstephenfin: i saw your patch to deprecate config_drive_format for vfat15:34
mriedemstephenfin: and it reminded me of this https://review.openstack.org/#/c/567860/15:34
cfriesenanyone know why requirements-check is failing for https://review.openstack.org/#/c/631363 ?  It says "Package 'os-traits' is constrained to 0.4.0 which does not match the minimum version specifier 0.11.0 in requirements.txt"15:35
mriedemstephenfin: i'm not 100% but i don't think we actually test live migration in the gate with a config drive on the instance15:35
bauzasmriedem: yeah we agreed on following the deprecation path this morning15:35
mriedemstephenfin: it would be good to have that wrinkle somewhere15:35
mriedembauzas: sure i understand, but that's not my point15:35
bauzasok15:35
mriedemmy point is we don't test live migration + config drive15:35
openstackgerritMerged openstack/nova master: conf: Call out where pci.alias should be set  https://review.openstack.org/62444515:35
mriedemi don't think15:35
mriedemso we might want to consider forcing config drive in our nova-live-migration job,15:36
mriedemor the grenade live migration job15:36
mriedemi think we also do everything with qcow2 image backend15:37
*** awalende has quit IRC15:37
mriedemand in https://review.openstack.org/#/c/567860/ i changed it to use raw15:37
mriedemwhich is another wrinkle we don't really touch15:37
cfriesenokay, why do we specify minimum package versions in both lower-constraints *and* requirements.txt?15:39
mriedemtonyb: ^15:40
janguttercfriesen: because the computer likes repetition because the computer likes repetition (paranoia reference)15:40
janguttercfriesen: I found this ( https://docs.openstack.org/project-team-guide/dependency-management.html ) a while ago and I'm not 100% sure.15:42
openstackgerritChris Friesen proposed openstack/nova master: Add emulated TPM support to Nova  https://review.openstack.org/63136315:42
openstackgerritChris Friesen proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.openstack.org/63993415:42
sean-k-mooneycfriesen: proably pinned in upperconstraitns15:44
cfriesensean-k-mooney: turns out I missed updating lower_constraints15:44
sean-k-mooneyoh ok15:44
sean-k-mooneyi chekcked that but you had already fixed it when i did i guess15:45
cfriesensean-k-mooney: don't know if you saw my comment last night....this patch series ^ is working as far as local resize with emulated TPM.15:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove port allocation during detach  https://review.openstack.org/62242115:46
*** markvoelker has joined #openstack-nova15:47
sean-k-mooneycfriesen: im reworking https://review.openstack.org/#/c/602432/ but that is next on my list15:48
cfriesencool.  I'm working on adding more unit tests to bring it up to the proper level.15:49
*** _fragatina has quit IRC15:51
*** janki has quit IRC15:52
*** itlinux_ has joined #openstack-nova15:54
openstackgerritBalazs Gibizer proposed openstack/nova master: Add remove_resources_from_instance_allocation to report client  https://review.openstack.org/63965315:54
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove port allocation during detach  https://review.openstack.org/62242115:54
gibimriedem, jaypipes: the bottom two patches are up to date ^^ (and I think they are ready to fly)15:55
mriedemlooking15:55
openstackgerritMatt Riedemann proposed openstack/nova master: Test live migration with config drive  https://review.openstack.org/56786015:55
*** dpawlik has quit IRC15:55
*** itlinux has quit IRC15:56
*** jistr|call is now known as jistr16:00
gibimriedem: regarding filing InstancePCIRequest.requester_id with flavor.flavorid or network_id . Which one do you prefere? Fill it properly (e.g. use flavor.flavorid) or keep it None and fill it only when it is needeD?16:01
mriedemgibi: i haven't yet looked at how that is used,16:02
mriedemand i saw avolkov asked about a requester_type,16:02
*** sapd1 has quit IRC16:02
mriedemmy one worry is that we have something in that field which isn't a port_id, but we assume it's a port_id and then something fails later because it turns out it was a flavor or network16:03
mriedemso maybe it's better to not set it for flavor/network in order to avoid confusion about when it can be used16:03
mriedemi guess you are future-proofing for when flavor resources are in a RequestGroup in the RequestSpec?16:04
gibimriedem: InstancePCIRequest.requester_id is matched against RequestGroup.requester_id16:04
gibimriedem: in https://review.openstack.org/#/c/623543/34/nova/compute/manager.py16:04
gibiso it is a bit of future proofing yes, but now I feel it would be better to keep it empty16:05
gibiso I think I will remove the flavor.id and netwokr_id bits16:05
openstackgerritEric Fried proposed openstack/nova master: WIP: Use aggregate_add_host in nova-manage  https://review.openstack.org/64008016:05
efriedmriedem: This bud's for you ^16:05
efried...bud16:05
mriedemgibi: that is probably safest16:06
efriedmriedem: LMK if you're on board with it conceptually and I'll fix up the testes.16:06
gibimriedem: OK, cool16:06
efriedmriedem: in particular, if you think I should split out the aggregate_add_host signature change.16:07
*** itlinux_ has quit IRC16:07
mriedemgibi: worst case is we'd set the InstancePCIRequest.request_id to a flavor.flavorid (which makes sense if the pci request comes via the flavor), and then we try finding the matching request group mapping and it's not found, so we just wasted time looking for something that we never setup16:07
gibimriedem: agreed16:07
mriedemwell, i guess worst case is ^ and we log something like "couldn't find mapping" or raise or something16:07
gibimriedem: it was to early to add it16:07
mriedemyou're ahead of your time16:07
gibiyeah16:07
mriedemefried: i can't digest that right now16:08
efriedmriedem: No urgency16:08
*** udesale has quit IRC16:13
*** mrch_ has quit IRC16:14
*** ttsiouts has quit IRC16:16
*** dave-mccowan has quit IRC16:17
*** ircuser-1 has quit IRC16:18
*** ircuser-1 has joined #openstack-nova16:19
*** wolverineav has joined #openstack-nova16:19
*** markvoelker has quit IRC16:21
*** ttsiouts has joined #openstack-nova16:21
*** IvensZambrano has joined #openstack-nova16:23
*** wolverineav has quit IRC16:23
openstackgerritBalazs Gibizer proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531016:24
gibijaypipes, mriedem: and the third one is up-to-date as well16:25
*** psachin has quit IRC16:28
mriedemgibi: +2 on https://review.openstack.org/#/c/622421/ - nits inline so it's up to you if you want to address those quick or follow up16:29
*** Sundar has joined #openstack-nova16:29
gibimriedem: I think I can respin it real quick16:30
*** dpawlik has joined #openstack-nova16:30
* mriedem stands by16:30
*** itlinux has joined #openstack-nova16:32
gibimriedem: FYI ALLOCATIN for https://review.openstack.org/#/c/622421/32/nova/network/neutronv2/api.py@1734 need a rebase first.16:33
*** dpawlik has quit IRC16:34
melwitto/16:34
mriedemgibi: yup16:35
mriedemgibi: i'll fast re-approve your bottom change16:35
gibimriedem: coolio16:36
mriedemcfriesen: comments in https://review.openstack.org/#/c/635350/16:36
cfriesenokay, will do16:36
mriedemedleafe: i'm glad you picked up on the az name struggle in https://review.openstack.org/#/c/639874/ :)16:38
openstackgerritsean mooney proposed openstack/nova master: libvirt: delegate ovs plug to os-vif  https://review.openstack.org/60243216:40
*** hamzy has quit IRC16:40
edleafemriedem: As an east coast native, I felt slighted. :(16:40
*** macza has joined #openstack-nova16:41
*** moshele has joined #openstack-nova16:42
mriedemaz=rochester-ne16:42
mriedemthere16:42
mriedemlocally sourced16:42
edleafeno16:43
mriedemaz=building25-floor3-mens-br16:43
edleafeaz=teaneck-ne16:43
*** jmlowe has quit IRC16:43
openstackgerritChris Friesen proposed openstack/nova master: fix up numa-topology live migration hypervisor check  https://review.openstack.org/63535016:45
*** moshele has quit IRC16:45
openstackgerritBalazs Gibizer proposed openstack/nova master: Add remove_resources_from_instance_allocation to report client  https://review.openstack.org/63965316:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Remove port allocation during detach  https://review.openstack.org/62242116:46
openstackgerritBalazs Gibizer proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531016:46
gibimriedem: fixed ^^16:47
mriedemok +2 on https://review.openstack.org/#/c/622421/ now16:50
mriedemjaypipes: ^16:50
openstackgerritMerged openstack/nova master: docs: ComputeDriver.update_provider_tree in nova  https://review.openstack.org/63337516:52
*** helenafm has quit IRC16:53
cfriesencan mock.patch.object change an object data member (not a function)?16:54
*** ttsiouts has quit IRC16:54
*** dtantsur is now known as dtantsur|afk16:55
*** itlinux has quit IRC16:56
*** itlinux has joined #openstack-nova16:56
*** tssurya has quit IRC16:57
jaypipesmriedem: yeah, I'm in-progress on that review.16:57
*** ttsiouts has joined #openstack-nova16:58
efriedcfriesen: Yes?16:58
cfriesenefried: can you point me to an example?16:58
*** ttsiouts has quit IRC16:59
*** betherly has quit IRC16:59
cfriesenefried: do I use ".return_value" or something else?16:59
efriedcfriesen: http://paste.openstack.org/show/746513/16:59
mriedemgibi: just a question on https://review.openstack.org/#/c/625310/16:59
gibilooking16:59
*** ttsiouts has joined #openstack-nova16:59
cfriesenefried: sweet, thanks17:00
efriedyw17:00
mriedemcfriesen: you can also create the attribute if it might not exist17:00
mriedemhttps://docs.python.org/3/library/unittest.mock.html#unittest.mock.patch create=True17:00
mriedemnormally shouldn't have to use that though17:00
gibimriedem: you are correct17:00
gibimriedem: it would be better to move the requester_id = request_net.port_id down where it is used17:01
gibimriedem: let me fix it17:01
mriedemgibi: you might want to wait for jaypipes review to finish17:01
gibimriedem: OK17:02
*** ttsiouts has quit IRC17:04
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: Add support for microversion 2.70 - expose device tags  https://review.openstack.org/63677917:07
mriedemmelwitt: can you look at ^ again17:07
mriedemtakashin's comments should be addressed17:07
melwittyep, looking17:08
mriedemdansmith: you want to send cells v1 docs to their watery grave? https://review.openstack.org/#/c/636718/17:09
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Avoid BadRequest error log on volume attachment  https://review.openstack.org/64011017:10
dansmithmriedem: only if I can go with them17:10
mriedemi'm struggling to make an under-the-sea merman joke here17:10
*** moshele has joined #openstack-nova17:10
mriedemhttps://i.imgur.com/qiJRWMM.gif17:11
melwittlol17:14
mriedemgibi: oh i guess jay is reviewing the port detach / deallocate change, so feel free to respin the pci request one17:14
*** dpawlik has joined #openstack-nova17:15
gibiI did the fix locally, and I will publish it before I leave. which is in ~15 minutes17:15
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: Avoid BadRequest error log on volume attachment  https://review.openstack.org/64011617:16
mriedemgibi: ok then we have 3 more patches to get to what i think is the target goal for stein which is the microversion change17:16
mriedemhow are you feeling about the rest of the changes to that point?17:16
gibimriedem: correct. If we can merge the microversion patch then I'm happy. However heal port allocation is _after_ the microversion patch so that might make people sad17:17
mriedemi think that is backportable17:17
mriedemsince it's an edge case17:17
gibimriedem: yeah, I hope so17:17
gibimriedem: the microversion patch itself is small and formal but needs some API doc17:18
*** markvoelker has joined #openstack-nova17:18
gibimriedem: however I can add doc after FF17:18
mriedemsure. i imagine we'll want some more involved docs about this somewhere, probably nova user docs17:18
mriedembecause the spec is going to be overwhelming for a user to try and figure out how this all works17:18
stephenfinmriedem: Missed the ping earlier, but I'll take a shot at https://review.openstack.org/#/c/567860/ tomorrow17:18
gibimriedem: rubasov started creating a networking doc for the whole17:19
stephenfinnotifications on Cinnamon suuuuck17:19
gibimriedem: I will add to it17:19
*** dpawlik has quit IRC17:19
sean-k-mooneystephenfin: you dont like the way they pop up in the corner of the screen17:19
stephenfinsean-k-mooney: Not at all. It's pretty but they're no in your face enough17:20
stephenfinNor are they duplicated across all screens17:20
gibimriedem: the other two patches handing an edge case (two PF on the same compute connected to the same physnet) and it needs an extra tag in the passthrough_whitelist config17:20
sean-k-mooneystephenfin: well that is why i like them i hate os notification and i tolerater there because they are non intrusive17:20
gibimriedem: stephenfin has some issue with that which I trying to explain away right now17:20
openstackgerritChris Friesen proposed openstack/nova master: Add emulated TPM support to Nova  https://review.openstack.org/63136317:21
*** ccamacho has quit IRC17:22
cfriesenThis ^ should be ready to review now17:22
mriedemcfriesen: throw it in runways17:25
mriedemhttps://etherpad.openstack.org/p/nova-runways-stein17:25
mriedemkashyap: have you looked at this at all? https://review.openstack.org/#/c/637834/17:25
mriedemi know you like to think about cpu models17:26
*** wolverineav has joined #openstack-nova17:27
gibistephenfin: I've just replied to your concerns about the pf_interface_name tag in https://review.openstack.org/#/c/625311/25/doc/source/admin/networking.rst@26617:28
openstackgerritBalazs Gibizer proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531017:29
gibimriedem: ^^ fixed17:29
* gibi is leaving for today17:30
*** marst has joined #openstack-nova17:30
*** mrch_ has joined #openstack-nova17:30
mriedemgibi: are you sure? https://review.openstack.org/#/c/625310/28..2917:30
mriedemyou only changed the commit message17:30
gibimriedem: looking17:31
gibiforget to add the cahnge to the commit17:31
gibi:/17:31
openstackgerritBalazs Gibizer proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531017:31
mriedemgit review should not allow you to push if you have pending local changes17:31
mriedembut ok :)17:31
*** wolverineav has quit IRC17:31
mriedemi get a rebase conflict if i try doing that17:31
gibimriedem: I never tried to use git review as that hides to much17:31
mriedemso you're both ahead of your time,17:32
mriedemand stuck in the past17:32
gibi:D17:32
gibiyeah17:32
gibisort of17:32
*** munimeha1 has joined #openstack-nova17:32
gibiI hope it is good now as I have to run17:33
gibitalk to you tomorrow17:33
mriedemit's not, but i'll fix it :)17:33
gibimriedem: OK, thanks :)17:33
melwittfore17:33
openstackgerritmelanie witt proposed openstack/nova master: Add online data migration for populating user_id  https://review.openstack.org/63335117:34
openstackgerritmelanie witt proposed openstack/nova master: Add get_counts() to InstanceMappingList  https://review.openstack.org/63807217:34
openstackgerritmelanie witt proposed openstack/nova master: WIP Count instances from mappings and cores/ram from placement  https://review.openstack.org/63807317:34
openstackgerritmelanie witt proposed openstack/nova master: Use instance mappings to count server group members  https://review.openstack.org/63832417:34
mriedemi laugh at your measly 4 patches17:34
melwitthmph!17:35
mriedemneed i remind you https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/cross-cell-resize17:35
melwittno, I know I can't compete17:35
*** _fragatina has joined #openstack-nova17:36
*** wolverineav has joined #openstack-nova17:37
*** panda|ruck is now known as panda|ruck|off17:42
*** gyee has joined #openstack-nova17:44
*** derekh has quit IRC17:46
*** artom has quit IRC17:47
openstackgerritMatt Riedemann proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531017:48
*** markvoelker has quit IRC17:51
*** moshele has quit IRC18:01
*** jmlowe has joined #openstack-nova18:02
*** moshele has joined #openstack-nova18:05
*** Sundar has quit IRC18:05
*** sridharg has quit IRC18:08
*** igordc has joined #openstack-nova18:09
mriedemfor people to think about prior to the nova meeting http://lists.openstack.org/pipermail/openstack-discuss/2019-February/003356.html18:09
*** itlinux has quit IRC18:13
*** hamzy has joined #openstack-nova18:13
*** itlinux has joined #openstack-nova18:15
openstackgerritMerged openstack/nova master: ironic: partition compute services by conductor group  https://review.openstack.org/63500618:18
aspiersefried, mriedem: is this the new understanding? https://pasteboard.co/I3hSwZ5.jpg18:24
efriedaspiers: couple things...18:25
efriedCUSTOM_ traits owned by drivers are not deprecated (did you mean "discouraged"?). There will always be custom traits for things that are dynamic in nature. To use an example that some people hate, CUSTOM_<PCI_ADDRESS>18:26
aspiersgotcha, I didn't know about those18:27
efriedaspiers: When you include the bottom middle bubble in the "things manipulated by admin", you mean that it's *possible* for them to muck with it, but they shouldn't, and we'll "heal" it, per your note at the top.18:29
aspiersright18:29
aspiersI'll clarify that18:29
*** wolverineav has quit IRC18:30
*** wolverineav has joined #openstack-nova18:30
efriedCool.18:31
efriedThe only other note is use of the word "never" on the right hand side. The top two middle bubbles are supposed to be "exclusive" - i.e. traits that are owned by the driver are a *subset* of the traits the driver will actually *set*.18:31
efriedaspiers: So like, I'm not sure if you did this on purpose, but the space in the intersection of the big bubbles, but outside of the three middle bubbles, is that set.18:31
efried...assuming that yellow bubbles are things that are set, and stuff outside of yellow bubbles is things that are unset.18:32
efriedNow in theory, the driver will "always" know what's in that set, and "always" switch off a trait from that set if the admin switches it on.18:32
aspiersah no, stuff outside yellow bubbles is unspecified other stuff, or nothing at all18:33
efriedBut knowing the full list of things in that space is... hard.18:33
efriedokay, then does what I'm saying above make sense?18:33
aspiersmy brain hasn't grokked it yet18:33
aspiersgive me a few secs :)18:33
*** wolverineav has quit IRC18:33
*** wolverineav has joined #openstack-nova18:33
efriedThere's a set of traits the driver owns. A subset of that will be turned on (by the driver). Anything in there that's turned on by the driver, and turned off by the admin, will get turned back on. Conversely, anything in there that's *not* turned on by the driver, but turned on by the admin, is *supposed* to be switched back off by the driver.18:34
aspiershrm, you are saying the driver will set traits which it *doesn't* own?18:34
*** ralonsoh has quit IRC18:34
efriedno, I'm saying it will switch *off* traits that it *does* own but doesn't think *should* be on. I.e. same logic as for the capability traits.18:34
efriedbut I have low confidence that drivers will succeed in doing that with 100% accuracy.18:35
aspiersStill not sure I understand. Is your point that outside of the new caps->traits code, there are other driver-owned traits for which the driver *should* override admin changes, but currently might not?18:37
efriedWhat we really ought to do is come up with a namespacing convention so that this ^ can be done more accurately. E.g. compute is allowed to switch off anything set by the admin that's [CUSTOM_]COMPUTE_*. And conversely, compute has to leave alone anything not in that namespace that the admin sets.18:37
efriedaspiers: Well, yes, "currently might not" because bug, not by design.18:38
efriedA pedantic example: Let's say compute decorates a pGPU provider with CUSTOM_PCI_ADDRESS_00_01_02_03. Obviously it should be nonsensical for the admin to decorate the same RP with a trait like CUSTOM_PCI_ADDRESS_FF_AA_BB_CC. So compute should notice that second one and switch it off.18:39
efriedbut how will it know?18:40
aspiersright, that makes a lot more sense with a concrete example18:40
efriednamespacing on every possible infix like _PCI_ADDRESS_ would be craziness. Hence the need for namespacing of some kind. But we don't have that convention in place yet.18:40
efriedI guess we'll burn that bridge when we cross it.18:40
aspiersso technically my note with the arrow currently only refers to some of the things in the intersection of the two big bubbles, not all of them18:41
aspiersso not the top middle yellow bubble for a start18:41
efriedbut it's a correct theory :)18:42
aspiersright, it's describing what *should* happen but not what the patch achieves18:42
efriedWhat this patch achieves is the above philosophy for capability-based standard traits only18:42
efried...which, by the way, are namespaced COMPUTE_* :)18:43
efried(though probably not with as much intent as I've described)18:43
aspiersok, let me try to tweak the diagram based on all this18:44
aspiersgive me a few mins18:44
*** tssurya has joined #openstack-nova18:44
*** sdake has joined #openstack-nova18:44
efriedI think a different angle on your venn diagram would be for everything in the bubbles to be traits; then a bubble within that would be compute-owned traits; then a bubble that overlaps the border of compute-owned would be "traits that are switched on".18:46
aspiersoriginally it was all traits18:46
aspiersbut then I wanted to put capabilities on there to show that not all capabilities get mapped to traits18:46
efriedyeah, that can be done.18:47
efriedI don't have a drawing program handy, gr.18:47
aspiersthis is in google drawings, so you do18:47
aspiersin fact you can even help me fix it in real-time :)18:47
*** markvoelker has joined #openstack-nova18:47
* efried learns how to use google drawings18:49
aspiersthere's not much to learn :)18:49
efriedI started drawing circles and can't figure out how to get them to be transparent. Off to a good start.18:51
mriedemjroll: rebase? https://review.openstack.org/#/c/636326/118:52
*** mvkr has quit IRC18:52
aspiershaha18:55
efriedaspiers: combine top two middle bubbles?18:55
aspiersoh yeah, could do18:55
aspierswell18:56
efried"Compute-owned custom/standard traits"18:56
aspiersthe point was to emphasise that there can be standard traits not from capabilities18:56
aspiersIf we combine them, this point is not nearly as clear18:56
efriedokay.18:56
aspiersI'll export to pasteboard.ca and update the commit message18:57
efriedwhat this diagram still lacks is the concept of *unsetting*.18:57
aspiershrm18:57
aspiersTrue, it also conflates providing traits with owning them, which is the other side of the same coin18:57
efriedSo a yellow bubble is a set of traits, but incorporates them being set or unset on the provider.18:57
efriedhow did you make your bubbles transparent?18:58
aspiersI don't think they are18:58
efriedah, found it.18:58
aspiersOh, the big ones18:58
aspiersYeah, custom colour18:58
efriedWell, otherwise you can't see the overlap - yeah18:59
aspiersUrgh, this could get way more complicated if we distinguish set from unset19:00
aspierswe have to double the number of small bubbles19:00
aspierstrait bubbles, at least - not the caps ones19:01
aspiersnot sure it's worth the effort19:01
aspiersfor an image in a commit message19:01
aspiersthis was mainly to check my understanding and ensure we're on the same page19:01
aspierswhich I think we are19:01
*** artom has joined #openstack-nova19:02
efriedaspiers: Yeah, I don't think we have to get this perfect19:03
efriedaspiers: And we don't have to combine all those concepts in the same diagram.19:03
efriedI just shared you the one I'm doing that just has the set/unset concept.19:03
efriedit's not as pretty as yours.19:03
aspierschecking19:04
efriedso the way to read this is: all capability traits are owned by compute; some are set and some are not.19:04
efriedOf *all* traits owned by compute, some are set and some are not19:04
efriedOf all traits that are set, some are compute-owned and some are not.19:05
*** IvensZambrano has quit IRC19:05
jrollmriedem: does it need it?19:06
*** tssurya has quit IRC19:06
efriedjroll: yah19:06
jrolloh you're right19:07
openstackgerritJim Rollenhagen proposed openstack/nova master: Ironic: bump minimum API version to 1.38  https://review.openstack.org/63632619:07
jrollin the future, anyone is welcome to push the rebase button for me :P19:07
*** itlinux has quit IRC19:07
efriedaspiers: a bit busy with that last addition, but I think it's right19:08
efriedall capability traits are standard traits19:09
efriedall capability traits are owned by compute19:09
efriednot all capability traits are set at any given time19:09
aspiersefried: I disagree with your most recent edit19:12
aspiersefried: if the admin sets a trait, then it becomes supported, the driver will not unset it19:12
aspiersefried: and if the admin unsets a trait, then it becomes unsupported, the driver will not set it19:12
aspiersI think my previous text was more accurate19:13
efried"becomes unsupported" - this is a snapshot19:13
efriedthings becoming (un)supported or becoming standard etc. simply move the lines; they don't change the semantics.19:14
aspiersI'm not sure you got the point19:14
*** pcaruana has quit IRC19:14
aspiersthere are other scenarios, e.g.19:14
aspiers1. admin sets a trait19:14
efrieduh, except I think those are backwards.19:15
efriedugh, I guess it depends how you're looking at it.19:15
aspiers2. operator upgrades nova to introduce this patch to the deployment19:15
aspiers3. nova-compute restarts19:15
aspiers4. driver does not unset the trait, because it was supposed to be there19:16
*** dpawlik has joined #openstack-nova19:16
efriedokay, sure, that's getting off into the weeds and not the point.19:16
aspiersthe "will be" statements on this diagram make it span a period of time19:16
aspiersyeah sorry, that wasn't a good illustration19:17
efriedWords like "unsupported" and "by the admin" can't be expected to encompass every possible nuance.19:17
aspiersthe point is, the values in the capabilities dict are booleans representing whether the capability is supported19:18
aspiersand whether the driver will set or unset the traits depends on those booleans19:18
efriedcorrect19:18
aspierswhereas your text makes it sound like it only depends on whether the traits were previously set by the admin or by the driver19:18
aspiers"if (un)set by admin" is not the correct condition19:19
aspiers"if deemed (un)supported by the driver" is the correct condition19:19
efriedRight, this diagram is coming from the assumption that we started in a steady state of capability supported-ness and code level.19:19
aspiersthe driver doesn't care who previously set or unset the trait19:19
aspierswhereas the text suggests it does19:19
efriedworks for me.19:20
efriedI feel we've reached the point of diminishing returns here. It has been a useful exercise. Feel free to tweak this diagram/text and paste it off somewhere and use it, or not.19:20
*** dpawlik has quit IRC19:20
aspiersAgreed19:20
*** whoami-rajat has quit IRC19:20
aspiersI think I finally understand what you mean about steady state19:20
efriedbut for heaven's sake, if you're going to use this diagram, make it pretty with colors like yours.19:20
aspiersLOL19:20
*** markvoelker has quit IRC19:21
* efried lunches19:21
openstackgerritMatt Riedemann proposed openstack/nova master: Adds the server group info into show server detail API.  https://review.openstack.org/62147419:23
mriedemalex_xu: i'm +2 on this now ^19:23
openstackgerritChris Friesen proposed openstack/nova master: Add emulated TPM support to Nova  https://review.openstack.org/63136319:24
openstackgerritChris Friesen proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.openstack.org/63993419:24
*** _fragatina has quit IRC19:29
cfriesenspeaking of runways...could I get another look at https://review.openstack.org/#/c/620706/ ?  Alex was supposed to review it again last night but didn't get around to it.19:30
*** _fragatina has joined #openstack-nova19:31
*** _alastor_ has joined #openstack-nova19:31
*** _fragatina has quit IRC19:38
*** wolverineav has quit IRC19:39
*** wolverineav has joined #openstack-nova19:40
*** tbachman has quit IRC19:43
*** moshele has quit IRC19:45
cfriesenmdbooth: you around?  not sure what you meant by your comment in https://review.openstack.org/#/c/616692/20/nova/tests/unit/virt/libvirt/test_utils.py19:47
*** wolverineav has quit IRC19:48
aspiersefried, mriedem: new version https://pasteboard.co/I3iqqNm.jpg19:48
aspiersjaypipes, artom: you might care too19:48
*** wolverineav has joined #openstack-nova19:48
aspiersnow I have to make the code actually match the diagram :)19:49
artomaspiers, is that a Venn diagram? It looks like one, but if I try to parse it like it makes no sense19:49
aspiersartom: yes it is19:50
*** dpawlik has joined #openstack-nova19:50
artomaspiers, ah, ok, on second pass it makes more sense19:50
jaypipesaspiers: that is venntastic.19:51
aspiers:)19:51
aspiersalmost as venntastic as that pun19:51
mriedemyowser19:52
mriedemif this code ever lands we should probably have that in the docs somewhere19:52
openstackgerritChris Friesen proposed openstack/nova master: Improve libvirt image and snapshot handling  https://review.openstack.org/61669219:52
artomaspiers, how are some COMPUTE_* traits *not* set on RPs?19:53
*** wolverineav has quit IRC19:53
artomOr did you mean "set on RPs by the admin"?19:53
aspiersartom: if they don't apply? not all traits are set on everything all the time :)19:53
artomOh, you're using "set" as in actually set, not "capable of being set"19:54
aspiersyes19:54
artomI swear, I dunno what is it about placement19:54
aspiersmriedem: don't scare me with conditional clauses like "if this code ever lands" :-p19:54
*** dpawlik has quit IRC19:54
artomEvery time it's a rabbithole of endless taxonomy and modelling debate19:54
melwittthat diagram is art. and agreed please add it to docs along with patch19:54
aspiersmelwitt: where would it belong?19:55
artomaspiers, anyways, yeah, seems to make sense, I'll wait for the code :)19:55
melwittaspiers: do we have any existing driver capability doc? if so, there. if not, maybe we could make a new doc. and in that case, it could be a follow on patch19:56
jaypipesartom: yes. Nova's NUMA code is much clearer than placement's modeling.19:56
aspiersNow I'm wondering why this diagram attracted so much attention, vs. silence for my other two diagrams in the commit message :)19:57
melwittwould just be nice to capture helpful diagrams like that somewhere19:57
aspiersmelwitt: I didn't notice any on a brief scan the other day19:57
artomjaypipes, hah, I'm not saying the code is bad19:57
melwittwell, I happened to click on this one and haven't read your commit message yet19:57
aspiersmelwitt: I also made https://pasteboard.co/I25qICd.png19:58
artomjaypipes, I'm observing that placement monopolizes discussions every time it's brought up19:58
artomEven in our RH team call this morning19:58
aspiersmelwitt: yeah, I was wondering more about the people who *have* already reviewed it ;-)19:59
melwittaspiers: heh. well, it's not _that_ important about the diagrams, just a general sentiment of, it would be nice if we had more pictures in our docs for features we have. and since you already made those. another thing to throw on the TODO list20:00
aspiersmelwitt: agreed, happy to add to docs. I would have already included in the review if I had found a good place for them20:01
jaypipesaspiers: I haven't reviewed the patch yet.20:01
jaypipesaspiers: been languishing in my endless review queue...20:02
efriedaspiers: You still have another rev forthcoming, though, right?20:02
jaypipesapologies.20:02
melwittaspiers: yeah. don't worry much about it, just another TODO for the pile of neverending TODOs :)20:02
aspiersjaypipes: no worries ;)20:02
aspiersefried: yes, working on it right now20:02
efriedcool20:03
aspiersefried: I was planning to fix the issues, then submit, and only then rebase and submit again, to keep rebase changes in a separate patchset20:03
aspiersmakes sense?20:03
efriedaspiers: ++, hate having to review rebase+updates in same PS.20:03
* aspiers longs for Gerrit 2.1620:03
aspiersefried: one day we will not have to worry about that any more20:04
aspierso/~ one day ... o/~20:04
efriedyeah, it wasn't long ago that the rebase PS would include all the files from the rebase.20:04
efried...from all the intervening commits20:04
*** tbachman has joined #openstack-nova20:04
efriedso where we are now is at least an improvement on that.20:04
aspierswell, "long ago" depends very much on whether you are using the timeline of our Gerrit deployments, or the upstream Gerrit releases ;-)20:05
aspiersbut yeah, I know you meant the former20:05
aspiersI kinda want to volunteer for the infra team *just* to get us on 2.1620:05
aspiersbut I don't have time :-(20:05
*** sdake has quit IRC20:07
aspiersmelwitt: would it go under "Nova Major Subsystems"? https://docs.openstack.org/nova/latest/contributor/index.html20:07
aspiersa new doc called "resource provider trees" or something like that?20:07
*** tbachman has quit IRC20:08
*** tbachman has joined #openstack-nova20:09
*** ttsiouts has joined #openstack-nova20:09
melwittaspiers: yeah, AFAIK, we don't have any nova docs about traits yet. is it only useful to nova contributors or to more ppl? if it's more, then it wouldn't be under contributor/20:12
aspiersmelwitt: I think some would, some wouldn't - depends on whether it's internals20:12
aspiersIMHO this Venn diagram is borderline either way20:13
aspiersI could do a more user-facing version20:13
melwittno, I think it's ok, was just sanity checking. I think a new subsystem doc would make sense, like you suggested20:14
*** tbachman has quit IRC20:15
aspiersmelwitt: any ideas about the title?20:15
openstackgerritMatt Riedemann proposed openstack/nova master: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64018120:16
openstackgerritMatt Riedemann proposed openstack/nova master: Make nova-grenade-live-migration voting and gate  https://review.openstack.org/64018220:16
openstackgerritMatt Riedemann proposed openstack/nova master: Make nova-grenade-live-migration voting and gating  https://review.openstack.org/64018220:17
mriedemflavors docs talked about traits https://docs.openstack.org/nova/latest/user/flavors.html20:17
mriedemso you'd likely want some reference to how system-driven traits and user-driven traits overlap20:18
aspiersmriedem: good point, thanks20:18
mriedemi'm not sure contributor is really the right place for that information,20:19
mriedemsince it is user facing20:19
mriedemuser/admin20:19
*** wolverineav has joined #openstack-nova20:19
mriedemi mean we have https://docs.openstack.org/nova/latest/user/#maintenance20:19
*** tbachman has joined #openstack-nova20:19
mriedemand https://docs.openstack.org/nova/latest/reference/#internals20:19
mriedemthe latter is where provider tree is documented20:20
mriedemhttps://docs.openstack.org/nova/latest/reference/update-provider-tree.html20:20
mriedemso you'd also link from ^ likely20:20
mriedemi'd probably throw something under reference/internals like the upt stuff, and reference from wherever it makes sense, like the flavors doc20:21
*** umbSublime has joined #openstack-nova20:21
mriedem"Note that there are compute-managed traits. Details about those can be found <here>."20:21
mriedemsome of those compute traits also link to the feature support matrix ... https://docs.openstack.org/nova/latest/user/support-matrix.html#operation_device_tags20:22
*** tesseract has quit IRC20:22
mriedemaspiers: i'd worry about documentation later :)20:22
aspiersyup20:23
*** wolverineav has quit IRC20:24
*** tbachman has quit IRC20:25
*** wolverineav has joined #openstack-nova20:30
*** wolverineav has quit IRC20:37
*** wolverineav has joined #openstack-nova20:38
*** wolverineav has quit IRC20:38
*** wolverineav has joined #openstack-nova20:38
*** hamzy has quit IRC20:39
*** hamzy has joined #openstack-nova20:43
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Fix legacy-grenade-dsvm-neutron-multinode-live-migration  https://review.openstack.org/64018620:44
openstackgerritMatt Riedemann proposed openstack/nova master: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64018120:47
openstackgerritMatt Riedemann proposed openstack/nova master: Make nova-grenade-live-migration voting and gating  https://review.openstack.org/64018220:47
*** cdent has quit IRC20:48
melwittnova meeting in 10 minutes20:50
artomOh hey, I can actually this one20:51
artomUsually it's smack in the middle of daycare taxi time20:51
* artom accidentally a word20:54
*** takashin has joined #openstack-nova20:55
openstackgerritmelanie witt proposed openstack/nova master: Add online data migration for populating user_id  https://review.openstack.org/63335120:58
openstackgerritmelanie witt proposed openstack/nova master: Add get_counts() to InstanceMappingList  https://review.openstack.org/63807220:58
openstackgerritmelanie witt proposed openstack/nova master: WIP Count instances from mappings and cores/ram from placement  https://review.openstack.org/63807320:58
openstackgerritmelanie witt proposed openstack/nova master: Use instance mappings to count server group members  https://review.openstack.org/63832420:58
openstackgerritMatt Riedemann proposed openstack/nova master: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64018120:59
openstackgerritMatt Riedemann proposed openstack/nova master: Make nova-grenade-live-migration voting and gating  https://review.openstack.org/64018220:59
*** wwriverrat has joined #openstack-nova21:00
*** erlon has quit IRC21:01
*** sdake has joined #openstack-nova21:04
*** igordc has quit IRC21:09
openstackgerritMatt Riedemann proposed openstack/nova stable/rocky: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64019121:09
*** igordc has joined #openstack-nova21:09
*** dave-mccowan has joined #openstack-nova21:11
*** tbachman has joined #openstack-nova21:14
*** wolverineav has quit IRC21:18
*** dave-mccowan has quit IRC21:22
*** sdake has quit IRC21:23
*** sdake has joined #openstack-nova21:24
*** wolverineav has joined #openstack-nova21:25
*** wolverineav has quit IRC21:28
*** s10 has joined #openstack-nova21:28
*** wolverineav has joined #openstack-nova21:28
*** wolverineav has quit IRC21:29
*** wolverineav has joined #openstack-nova21:35
*** rchurch has joined #openstack-nova21:36
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: Fix legacy-grenade-dsvm-neutron-multinode-live-migration  https://review.openstack.org/64019721:41
openstackgerritMatt Riedemann proposed openstack/nova stable/queens: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64019821:42
*** artom has quit IRC21:44
*** hamzy has quit IRC21:47
*** markvoelker has joined #openstack-nova21:48
marstHello. I've installed devstack (with minimal local.conf), how do I create several fake hypervisors? I remember there was a blog post from someone with 1000 hypervisors, but can't find it.21:49
*** mchlumsky has quit IRC21:50
marstJust trying to teach people how nova-scheduler filters work21:50
marst(but first need to understand it myself)21:50
*** dpawlik has joined #openstack-nova21:51
mriedemmarst: this would get you partway https://review.openstack.org/#/c/507918/21:51
*** wolverineav has quit IRC21:51
mriedemthe main things are (1) use the fake virt driver (2) noop quota driver and (3) $NUMBER_FAKE_NOVA_COMPUTE21:52
mriedemeven with that if you create too many fake computes you can run out of resources on a single host21:52
marstmriedem: Thanks a lot!! This is perfect!21:52
mriedemin fact i think i changed devstack so that if you use the fake virt driver, you get the noop quota driver automatically21:53
mriedemhttps://review.openstack.org/#/c/571933/21:53
mriedemyeah so you just need to say VIRT_DRIVER=fake and NUMBER_FAKE_NOVA_COMPUTE=whatever21:54
marstmriedem: awesome! thank you!21:54
mriedemnop21:54
mriedem*np21:54
* mriedem should probably document this in the devstack docs21:54
mriedemi think i've gone up to 20 fake computes with an 8vcpu/8gb ram host and it was ok, but more than that and it starts to fall over,21:55
mriedembecause it's using ncpu/2 API workers for conductor/scheduler/api services on the single host21:55
*** dpawlik has quit IRC21:55
mriedemyou can set API_WORKERS=1 to trim that down21:55
mriedemso bunch of computes, 1 process per controller service21:55
mriedemi also create servers with networks=none so i don't hit port quota in neutron21:56
marstmriedem: Will give it a try tonight. Thanks a lot once again! :)21:57
mriedemnp21:57
*** slaweq has quit IRC21:58
openstackgerritJim Rollenhagen proposed openstack/nova master: ironic: check fresh data when sync_power_state doesn't line up  https://review.openstack.org/63669922:00
openstackgerritJim Rollenhagen proposed openstack/nova master: Remove TypeError handling for get_info  https://review.openstack.org/64004322:00
jrollefried: you owe me back a +2 :P22:00
*** wolverineav has joined #openstack-nova22:01
*** slaweq has joined #openstack-nova22:04
*** _fragatina has joined #openstack-nova22:07
*** wolverineav has quit IRC22:09
*** slaweq has quit IRC22:09
*** slaweq has joined #openstack-nova22:11
*** sdake has quit IRC22:13
*** slaweq has quit IRC22:16
*** markvoelker has quit IRC22:22
*** slaweq has joined #openstack-nova22:25
*** s10 has quit IRC22:27
*** wolverineav has joined #openstack-nova22:28
*** wolverineav has quit IRC22:29
*** wolverineav has joined #openstack-nova22:29
*** dpawlik has joined #openstack-nova22:29
*** slaweq has quit IRC22:30
mriedemmarst: you inspired me https://review.openstack.org/64020522:32
mriedemfeedback appreciated on if any of that doesn't work for you22:32
*** wolverineav has quit IRC22:33
*** dpawlik has quit IRC22:34
openstackgerritMatt Riedemann proposed openstack/nova stable/pike: Move legacy-grenade-dsvm-neutron-multinode-live-migration in-tree  https://review.openstack.org/64020722:38
*** wolverineav has joined #openstack-nova22:45
*** slaweq has joined #openstack-nova22:45
marstmriedem: thank you! I'll try it, but pretty sure it'll work as expected.22:45
mriedemeasy +w https://review.openstack.org/#/c/635350/522:46
*** wolverineav has quit IRC22:49
*** slaweq has quit IRC22:51
tonybcfriesen: because they have different consumers and a requirements file is different from a constraints file22:53
tonybcfriesen: I get it's a little duplication but is it really that bad?  How would you chnage it?22:54
*** luksky has joined #openstack-nova22:55
*** tkajinam has joined #openstack-nova22:55
efriedjroll: done, thanks for the squash.22:59
jrollefried: np, thanks for the reviews22:59
*** wolverineav has joined #openstack-nova23:01
efriedmriedem: I'm gonna leave stephenfin to that +W. I would nitpick it to death.23:02
mriedemyar matey23:02
*** luksky has quit IRC23:03
*** awalende has joined #openstack-nova23:05
openstackgerritMatt Riedemann proposed openstack/nova stable/ocata: Drop legacy-grenade-dsvm-neutron-multinode-live-migration  https://review.openstack.org/64021923:06
*** wolverineav has quit IRC23:07
melwittmriedem: want to make sure this is kosher for backporting (ironic driver virt api change) https://review.openstack.org/63669923:07
mriedemwell i can certainly look23:08
*** wolverineav has joined #openstack-nova23:08
*** wolverineav has quit IRC23:08
*** wolverineav has joined #openstack-nova23:08
cfriesentonyb: I just was surprised because I was upversioning os-traits and didn't realize it needed to be changed in two places.23:09
*** awalende has quit IRC23:10
cfriesentonyb: seems silly to specify "I need at least version 0.11.0 of os-traits" in two different ways.23:10
melwittmriedem: I just looked at it. TypeError handled but no warning log for out-of-tree people. I made a comment23:10
melwittmaybe that's overkill for helping out-of-tree. it's mentioned in the reno already23:10
cfriesentonyb: I can live with it of course. :)23:10
*** slaweq has joined #openstack-nova23:11
mriedemmelwitt: same, plus it's broken23:12
mriedemmelwitt: you'd handle the type error and then get another error for an undefined variable23:13
melwittohh23:13
melwittouch23:13
*** threestrands has joined #openstack-nova23:13
openstackgerritAdam Spiers proposed openstack/nova master: Convert driver supported capabilities to compute node provider traits  https://review.openstack.org/53849823:13
mriedemwell maybe not23:13
mriedemoh i guess we'd just fallback to doing what we did before right?23:14
*** vishwanathj has quit IRC23:14
*** slaweq has quit IRC23:15
aspiersmriedem, efried: fixed version is now uploaded https://review.openstack.org/#/c/538498/19..20//COMMIT_MSG23:15
aspiersmriedem, efried: now I will rebase and fix the conflict23:15
mriedemjroll: check my logic in here https://review.openstack.org/#/c/636699/23:15
melwittseems like it would fall back, given that vm_power_state is passed into the method and the new code just overwrites it if the driver can pull from not cache23:16
mriedemyeah ok23:17
openstackgerritAdam Spiers proposed openstack/nova master: Convert driver supported capabilities to compute node provider traits  https://review.openstack.org/53849823:17
*** artom has joined #openstack-nova23:17
aspiersmriedem, efried: now rebased in patch set 2123:18
*** markvoelker has joined #openstack-nova23:18
efriedaspiers: looking. Will try to get it done before I have to leave for class...23:19
aspiersefried: thanks :)23:19
efriedelse maƱana23:20
*** wolverineav has quit IRC23:23
*** markvoelker has quit IRC23:24
*** markvoelker has joined #openstack-nova23:24
efriedaspiers: Done, that was pretty easy.23:25
efriedgreat work there, Adam, really appreciate you picking that up and sticking with it through all our waffling.23:26
aspiers:)23:26
openstackgerritAdam Spiers proposed openstack/nova master: Convert driver supported capabilities to compute node provider traits  https://review.openstack.org/53849823:28
aspiersefried: nit addressed23:29
*** wolverineav has joined #openstack-nova23:29
openstackgerritMerged openstack/python-novaclient master: Add support for microversion 2.70 - expose device tags  https://review.openstack.org/63677923:29
efriedaspiers: +2 again. Assuming others don't notice, we've asserted a design statement there about trait namespacing :)23:30
mriedemmelwitt: Kevin_Zheng: artom: dansmith: see if we're in agreement with this summary of the nova meeting discussion about the root volume detach/attach + tag issue http://lists.openstack.org/pipermail/openstack-discuss/2019-February/003367.html23:30
aspiersefried: right ;-)23:30
Kevin_Zhengmriedem: thanks for putting this up, I agree with the current agreement23:32
melwittmriedem: yeah, matches my understanding. I get that it's not great to go half-baked, but I tend toward it being nicer to make some progress and not have to dump context and start all over again from a mental standpoint. reloading the concept is still necessary but I personally still find it easier when partial support has landed, vs not23:34
*** itlinux has joined #openstack-nova23:39
*** sapd1 has joined #openstack-nova23:41
*** itlinux_ has joined #openstack-nova23:41
*** marst has quit IRC23:42
*** itlinux has quit IRC23:43
mriedemKevin_Zheng: so i didn't look yet, but you added the code to change the RequestSpec.image when attaching a new root volume?23:57
mriedemso that unshelve will schedule properly?23:57
Kevin_ZhengYeah I did that and also added a test23:58
mriedemhttps://review.openstack.org/#/c/623981/21/nova/tests/functional/test_attach_detach_root_volume.py23:58
*** tbachman has quit IRC23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!