Tuesday, 2019-08-20

*** markvoelker has quit IRC00:01
*** brinzhang has joined #openstack-nova00:13
*** gyee has quit IRC00:36
openstackgerritMerged openstack/nova master: Move iptables rule fetching and setting to privsep.  https://review.opendev.org/63650800:46
openstackgerritMerged openstack/nova master: Move dnsmasq restarts to privsep.  https://review.opendev.org/63928000:46
*** altlogbot_1 has quit IRC00:46
*** altlogbot_3 has joined #openstack-nova00:48
openstackgerritBrin Zhang proposed openstack/python-novaclient master: Microversion 2.77: Support Specifying AZ to unshelve  https://review.opendev.org/66513600:53
openstackgerritGhanshyam Mann proposed openstack/nova master: Update api-ref for 2.75 to add config_drive in server update response  https://review.opendev.org/67732401:08
*** bhagyashris has joined #openstack-nova01:11
*** igordc has quit IRC01:11
*** hongbin has joined #openstack-nova01:24
*** dviroel_ has quit IRC01:42
*** markvoelker has joined #openstack-nova01:51
*** markvoelker has quit IRC01:55
openstackgerritTakashi NATSUME proposed openstack/nova stable/ocata: Fix misuse of nova.objects.base.obj_equal_prims  https://review.opendev.org/67629502:01
openstackgerritTakashi NATSUME proposed openstack/nova stable/stein: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67732902:23
*** BjoernT has joined #openstack-nova02:25
openstackgerritTakashi NATSUME proposed openstack/nova stable/rocky: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67733002:38
*** ricolin has joined #openstack-nova02:39
*** mkrai has joined #openstack-nova02:53
openstackgerritTakashi NATSUME proposed openstack/nova stable/rocky: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67733003:02
*** spsurya has joined #openstack-nova03:03
*** jdillaman has quit IRC03:17
openstackgerritTakashi NATSUME proposed openstack/nova stable/queens: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67737803:41
*** BjoernT has quit IRC03:42
*** psachin has joined #openstack-nova03:43
*** mkrai has quit IRC03:50
*** hongbin has quit IRC03:51
*** mkrai has joined #openstack-nova03:52
openstackgerritTakashi NATSUME proposed openstack/nova stable/pike: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67737903:53
*** udesale has joined #openstack-nova04:02
*** tkajinam has quit IRC04:09
*** tkajinam has joined #openstack-nova04:16
*** tkajinam has quit IRC04:17
*** tkajinam has joined #openstack-nova04:18
openstackgerrithuanhongda proposed openstack/nova master: Fix for auth during live-migration (2)  https://review.opendev.org/66986704:21
openstackgerritTakashi NATSUME proposed openstack/nova stable/ocata: Fix 'has_calls' method calls in unit tests  https://review.opendev.org/67738304:38
*** ratailor has joined #openstack-nova04:46
openstackgerritTakashi NATSUME proposed openstack/nova stable/stein: Fix wrong assertions in unit tests  https://review.opendev.org/67738804:55
openstackgerritMerged openstack/nova master: Move router advertisement daemon restarts to privsep.  https://review.opendev.org/63928104:57
*** stakeda has joined #openstack-nova04:59
openstackgerritTakashi NATSUME proposed openstack/nova stable/rocky: Fix wrong assertions in unit tests  https://review.opendev.org/67738905:04
*** janki has joined #openstack-nova05:10
openstackgerritTakashi NATSUME proposed openstack/nova stable/queens: Fix wrong assertions in unit tests  https://review.opendev.org/67739005:14
*** maciejjozefczyk has joined #openstack-nova05:17
openstackgerritTakashi NATSUME proposed openstack/nova stable/pike: Fix wrong assertions in unit tests  https://review.opendev.org/67739205:31
*** jaosorior has joined #openstack-nova05:32
*** ratailor_ has joined #openstack-nova05:35
*** ratailor__ has joined #openstack-nova05:38
*** ratailor has quit IRC05:38
*** ratailor_ has quit IRC05:40
openstackgerritTakashi NATSUME proposed openstack/nova stable/ocata: Fix wrong assertions in unit tests  https://review.opendev.org/67739305:45
*** markvoelker has joined #openstack-nova05:55
*** markvoelker has quit IRC06:05
*** markvoelker has joined #openstack-nova06:06
*** markvoelker has quit IRC06:10
*** mkrai has quit IRC06:12
*** mkrai_ has joined #openstack-nova06:12
*** udesale has quit IRC06:33
*** udesale has joined #openstack-nova06:34
*** rcernin has quit IRC06:35
*** damien_r has joined #openstack-nova06:50
*** hongbin has joined #openstack-nova06:52
*** hongbin has quit IRC06:56
openstackgerritGhanshyam Mann proposed openstack/python-novaclient master: Microversion 2.75 - Multiple API cleanup changes  https://review.opendev.org/67627507:01
*** udesale has quit IRC07:01
*** aojea has joined #openstack-nova07:02
*** udesale has joined #openstack-nova07:02
*** dpawlik has joined #openstack-nova07:08
*** trident has quit IRC07:16
*** trident has joined #openstack-nova07:24
*** psachin has quit IRC07:25
*** ivve has joined #openstack-nova07:36
*** xek has joined #openstack-nova07:39
*** ricolin has quit IRC07:39
*** bhagyashris has quit IRC07:39
*** ricolin has joined #openstack-nova07:39
*** _cale_kim has joined #openstack-nova07:46
*** ratailor has joined #openstack-nova07:50
*** ratailor__ has quit IRC07:50
*** ralonsoh has joined #openstack-nova07:55
*** ociuhandu has joined #openstack-nova07:58
*** ociuhandu has quit IRC07:59
*** ociuhandu has joined #openstack-nova08:00
*** priteau has joined #openstack-nova08:06
*** jaosorior has quit IRC08:16
*** jangutter has joined #openstack-nova08:16
*** panda has quit IRC08:18
*** panda has joined #openstack-nova08:20
*** ratailor_ has joined #openstack-nova08:24
*** bhagyashris has joined #openstack-nova08:25
*** ratailor has quit IRC08:27
*** derekh has joined #openstack-nova08:28
*** tkajinam has quit IRC08:32
*** shilpasd has joined #openstack-nova08:40
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442008:56
openstackgerritAdam Spiers proposed openstack/nova master: Extract SEV-specific bits on host detection  https://review.opendev.org/63633408:57
openstackgerritAdam Spiers proposed openstack/nova master: Add <launchSecurity> and <driver iommu='on' /> to config.py  https://review.opendev.org/63631808:57
openstackgerritAdam Spiers proposed openstack/nova master: Apply SEV-specific guest config when SEV is required  https://review.opendev.org/64456508:57
*** takashin has left #openstack-nova09:00
openstackgerritAdam Spiers proposed openstack/nova master: Enable booting of libvirt guests with AMD SEV memory encryption  https://review.opendev.org/66661609:00
*** jchhatbar has joined #openstack-nova09:06
*** jchhatbar has quit IRC09:06
*** jchhatbar has joined #openstack-nova09:07
*** janki has quit IRC09:07
*** jchhatbar has quit IRC09:07
*** janki has joined #openstack-nova09:08
sean-k-mooney... awsome my test passes on py27 and py36 but not py37. this will be fun09:13
sean-k-mooneyanyone spot anything in https://review.opendev.org/#/c/666914/7/nova/tests/unit/test_utils.py@26609:14
*** ociuhandu_ has joined #openstack-nova09:15
*** rcernin has joined #openstack-nova09:15
*** ociuhandu_ has quit IRC09:16
sean-k-mooneyoh its the inital assert09:17
sean-k-mooneyself.assertEqual(utils._TRAITS_CACHE, {})09:17
sean-k-mooneyon python 27 and 36 applying @mock.patch.dict(utils._TRAITS_CACHE, clear=True) to the class patches it in every function but i guess its not working in py3709:18
aspierssean-k-mooney: oh that's interesting, just like what we were talking about yesterday09:20
sean-k-mooneyyesterday as in have the mock apply to all functions09:21
sean-k-mooneyin a class09:21
aspiersyes09:21
sean-k-mooneyit might still be applying but the sematics of clear=True may have been broken but in any case it broken09:21
aspiersany chance you could test https://review.opendev.org/#/c/666616/31/nova/tests/unit/virt/libvirt/test_driver.py@23813 on py37?09:22
aspiersI don't have a py37 environment09:22
aspiersoh wait, I do09:22
sean-k-mooneyadding the mock to the class was a way of sutbing out the field without needed to add a patcher and cleanup function in __init__09:23
aspiersI found a way to apply a mock to all tests in a class, but efried hated it (and he was right, it's fugly)09:23
aspiershttps://review.opendev.org/#/c/666616/23/nova/tests/unit/virt/libvirt/test_driver.py@2355509:23
aspiersbut it does work at least09:24
aspiersyou call __enter__() during setUp() and __exit__() during tearDown()09:24
* aspiers downloads nova onto his box with 3.709:24
aspiersbrb09:24
sean-k-mooneyaspiers: there are cleaner ways09:25
sean-k-mooneyill test it locally with my change and then ill comment on yours09:26
*** aojea has quit IRC09:28
*** aojea has joined #openstack-nova09:28
sean-k-mooneywell that is annoying  my original code passes locally so i guess i need top use the gate to test this.09:41
openstackgerritsean mooney proposed openstack/nova master: Libvirt: report storage bus traits  https://review.opendev.org/66691409:43
*** jaosorior has joined #openstack-nova09:47
*** ratailor__ has joined #openstack-nova09:53
*** ociuhandu has quit IRC09:54
*** ratailor_ has quit IRC09:56
*** bhagyashris has quit IRC10:06
*** udesale has quit IRC10:16
yaawangstephenfin: Hi, can you take a look at the patch: https://review.opendev.org/#/c/670298, it's a part of spec vCPU model selection. :)10:16
*** udesale has joined #openstack-nova10:17
*** priteau has quit IRC10:18
*** ociuhandu has joined #openstack-nova10:27
*** rcernin has quit IRC10:28
*** cervigni has joined #openstack-nova10:30
cervignihello guys, I am trying to have the VGPU feature working on rhel7 but I always hit this issue10:30
cervigni2019-08-20 18:28:10.527 17202 ERROR nova.virt.libvirt.driver [req-031bc6f7-be61-406b-aefd-020a24e76f5e d7ef7ad4b0424f78a5010503b095ae84 35d0e97603b04dadaee6dfafbd19e5f9 - default default] [instance: 9300b931-12e5-421a-a8ae-ef1854d4cb38] Failed to start libvirt guest: libvirtError: internal error: qemu unexpectedly closed the monitor: 2019-08-20T10:28:10.301572Z qemu-kvm: -device vfio-pci,id=hostdev0,sysfsdev=/sys/bus/mdev/devices/a0543cde-3934-10:30
cervigni460f-8994-6be8c80fe417,display=off,bus=pci.0,addr=0x6: vfio error: a0543cde-3934-460f-8994-6be8c80fe417: error getting device from group 81: Input/output error10:30
cervigniwhat can this be related to? I intalled the vGPU drivers, flavor is correct, vgpu is set to nvidia-10610:31
sean-k-mooneyhave you enabled the iommu on the host10:31
cervigniGRUB_CMDLINE_LINUX="crashkernel=auto spectre_v2=retpoline rd.lvm.lv=rhel/root rd.lvm.lv=rhel/swap rhgb quiet intel_iommu=on iommu=pt modprobe.blacklist=nouveau"10:31
cervigniyes10:31
cervigniis there anything else I should enable/disable?10:32
sean-k-mooneyis there a traceback in the libvirt instacne log10:32
cervigniyes10:32
cervigni2019-08-20T10:28:10.301572Z qemu-kvm: -device vfio-pci,id=hostdev0,sysfsdev=/sys/bus/mdev/devices/a0543cde-3934-460f-8994-6be8c80fe417,display=off,bus=pci.0,addr=0x6: vfio error: a0543cde-3934-460f-8994-6be8c80fe417: error getting device from group 81: Input/output error10:32
cervigniVerify all devices in group 81 are bound to vfio-<bus> or pci-stub and not already in use10:32
cervigni2019-08-20 10:28:10.318+0000: shutting down, reason=failed10:32
sean-k-mooneyah i know what happening then10:33
cervignireally?10:33
sean-k-mooneyfor sriov or vgpus to work all devices in the same iommu group need to use the same driver10:33
cervigniI had exactly the same issue with ubuntu. I moved to rhel7 because I thought that was the issue10:33
sean-k-mooneyso you need to due a few things first you need to check what device are part of iommu group 8110:34
sean-k-mooneyand ensure that tey are all bound to vfio-pci10:34
sean-k-mooneyfor example but the gpu and the gpus onboard audio contoller10:34
sean-k-mooneythey are two different pcie endpoint that share the same iommu group in most cases10:35
*** ociuhandu has quit IRC10:35
aspiersstephenfin: why does test-requirements.txt have psycopg2 at all? is postgres still supported?10:35
cervigniIOMMU Group 81:10:36
cervignilspci: -s: Invalid slot number10:36
sean-k-mooneyif you intalled the card in a pci slot connected to the chipset via the dmi bridge rahter then then directly to the cpu that could also cause the same issue were you are sharing an iommu groupe between multiple devices10:36
cervigniuhm that is definitely a wrong group10:36
sean-k-mooneythat is not how you check10:36
stephenfinaspiers: I recall cfriesen mentioning something about them caring about postgres in the distant pass, but I honestly can't say any more than that10:36
stephenfinyaawang: Sure thing10:36
aspiersstephenfin: about who caring?10:36
stephenfinWindriver10:36
aspiersoh10:36
aspiersSUSE used to use pg for OpenStack, but ditched it quite a while ago10:37
stephenfin*Wind River?10:37
stephenfinYeah, I've no idea if it even works nowadays10:37
sean-k-mooneycervigni: give me a sec and ill see if i can get the command10:37
aspiersYeah X-D  Windriver makes me think of DLLs *shudder*10:37
aspiersstephenfin: seems dumb that I have to install pg_config to run unit tests10:38
stephenfinOr build docs10:38
stephenfinor do anything, really10:38
cervignithanks10:38
stephenfintbh, we shouldn't even need the MySQL dependencies for that10:38
aspierstrue10:39
sean-k-mooneycervigni: this is not the exact command but more or less does what you want10:39
*** _cale_kim has quit IRC10:39
sean-k-mooneyhttp://paste.openstack.org/show/760302/10:40
sean-k-mooneyyou will want to pipe that to less and check iommu group 8110:41
*** dosaboy has quit IRC10:42
cervignithat is the same of what I pasted earlier, for IOMMU group 81 (where the problem comes from)10:42
sean-k-mooneyyou can also just do  ls /sys/kernel/iommu_groups/81/devices/10:42
cervigniit reports only a lspci: -s: Invalid slot number10:42
*** ganso has quit IRC10:42
sean-k-mooneyyes -s take a pci address not iommu group number10:42
*** bbowen has quit IRC10:42
sean-k-mooneythey are totally different things10:42
cervigniok10:42
sean-k-mooneywhat do you get for "ls /sys/kernel/iommu_groups/81/devices/"10:43
cervigni[root@compute-r6-h28 ~]# ls /sys/kernel/iommu_groups/81/devices/a0543cde-3934-460f-8994-6be8c80fe417/10:43
cervignidriver  iommu_group  mdev_type  nvidia  power  remove  subsystem  uevent10:43
*** spatel has joined #openstack-nova10:45
*** spatel has quit IRC10:50
openstackgerritStephen Finucane proposed openstack/nova master: docs: Note use of 'nova-manage db sync --config-file'  https://review.opendev.org/67129810:56
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document global options for nova-manage  https://review.opendev.org/67744310:56
openstackgerritStephen Finucane proposed openstack/nova master: config: Explicitly register 'remote_debug' CLI opts  https://review.opendev.org/67744410:56
*** macz has joined #openstack-nova11:04
*** tesseract has joined #openstack-nova11:08
*** ociuhandu has joined #openstack-nova11:08
*** ociuhandu has quit IRC11:09
*** macz has quit IRC11:09
*** ociuhandu has joined #openstack-nova11:09
*** udesale has quit IRC11:18
*** dave-mccowan has joined #openstack-nova11:19
*** ganso has joined #openstack-nova11:24
*** dosaboy has joined #openstack-nova11:28
openstackgerritStephen Finucane proposed openstack/nova master: Move calls to ovs-vsctl to privsep.  https://review.opendev.org/63928211:34
openstackgerritStephen Finucane proposed openstack/nova master: Move setting of device trust to privsep.  https://review.opendev.org/63928311:34
openstackgerritStephen Finucane proposed openstack/nova master: Move final bridge commands to privsep.  https://review.opendev.org/63958011:34
openstackgerritStephen Finucane proposed openstack/nova master: Cleanup the _execute shim in nova/network.  https://review.opendev.org/63958111:34
openstackgerritStephen Finucane proposed openstack/nova master: We no longer need rootwrap.  https://review.opendev.org/55443811:34
openstackgerritStephen Finucane proposed openstack/nova master: Cleanup no longer required filters and add a release note.  https://review.opendev.org/63982611:34
openstackgerritStephen Finucane proposed openstack/nova master: Address nits from privsep series  https://review.opendev.org/67721011:34
openstackgerritStephen Finucane proposed openstack/nova master: WIP! Stop passing 'root_helper' argument to os-brick  https://review.opendev.org/67745111:34
*** markvoelker has joined #openstack-nova11:35
*** markvoelker has quit IRC11:40
*** tbachman has quit IRC11:43
*** bbowen has joined #openstack-nova11:44
*** ociuhandu has quit IRC11:54
*** ociuhandu has joined #openstack-nova11:54
*** markvoelker has joined #openstack-nova11:57
*** rpittau|afk is now known as rpittau12:05
*** tbachman has joined #openstack-nova12:13
*** ociuhandu has quit IRC12:24
*** ratailor__ has quit IRC12:27
*** dviroel_ has joined #openstack-nova12:36
*** dviroel_ is now known as dviroel12:39
*** dviroel has left #openstack-nova12:40
*** jaosorior has quit IRC12:43
openstackgerritAdam Spiers proposed openstack/nova master: Track libvirt host/domain capabilities for multiple machine types  https://review.opendev.org/67315112:43
openstackgerritAdam Spiers proposed openstack/nova master: Track libvirt host/domain capabilities for multiple machine types  https://review.opendev.org/67315112:46
openstackgerritAdam Spiers proposed openstack/nova master: Extract new base class for provider usage functional tests  https://review.opendev.org/67696412:50
openstackgerritAdam Spiers proposed openstack/nova master: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported  https://review.opendev.org/63868012:50
openstackgerritAlexandra Settle proposed openstack/nova stable/rocky: Fixing broken links  https://review.opendev.org/67746012:51
*** mriedem has joined #openstack-nova12:53
alex_xuaspiers: the line 697-701 of https://review.opendev.org/#/c/673151/11/nova/virt/libvirt/host.py is about the why we need that set of machine type?12:53
aspiersalex_xu: We need to cover the main variants12:54
alex_xuaspiers: ok, so the pc and q35 can cover all the cases, right?12:54
aspiersyes12:54
aspiersthis is mentioned in the commit message12:55
alex_xuaspiers: thanks, i see now12:55
alex_xuaspiers: is it too arch specific?12:55
alex_xualthough I didn't see other arch need this method12:55
aspierspc / q35 are not hardcoded12:55
aspiersalex_xu: they come from utils.get_default_machine_type() and libvirt's getCapabilities12:56
alex_xuI mean in other arch, it is also about default and canonical covering all the cases12:56
aspiersso other architectures will get a different set12:56
aspiersyes, correct12:56
alex_xuok, I'm just going to trust the libvirt and platform experts12:57
aspiersthat's why I had to remove 'bamboo' from the fixture12:57
*** ociuhandu has joined #openstack-nova12:57
sean-k-mooneybamboo as a fake arch or machine type :)12:58
alex_xuhah12:58
aspiersbecause the static fixtures for getDomainCapabilities on ppc did not return correct values for bamboo12:58
sean-k-mooneyi can see both working12:58
*** ociuhandu has quit IRC12:58
aspiersbamboo is a real machine type for ppc12:58
sean-k-mooneyreally ok12:58
*** ociuhandu has joined #openstack-nova12:58
sean-k-mooneybut ya its not in the static data we are using right12:59
openstackgerritMatt Riedemann proposed openstack/nova master: Update api-ref for 2.75 to add config_drive in server update response  https://review.opendev.org/67732412:59
alex_xuaspiers: so the only complain is no unittest for host.py change, but I'm ok with a followup.12:59
aspiershttps://review.opendev.org/#/c/673151/13/nova/tests/unit/virt/libvirt/fakelibvirt.py@167312:59
*** jaosorior has joined #openstack-nova12:59
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668413:01
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668413:01
aspiersalex_xu: hmm that's a good point13:02
*** jdillaman has joined #openstack-nova13:04
*** spatel has joined #openstack-nova13:05
*** BjoernT has joined #openstack-nova13:05
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: Microversion 2.75 - Multiple API cleanup changes  https://review.opendev.org/67627513:08
*** owalsh has quit IRC13:09
mriedemfinal 2 patches for 2.75 https://review.opendev.org/#/q/topic:bp/api-consistency-cleanup+status:open13:10
alex_xuaspiers: the spec said the trait "a) it cannot be used yet, only in the future when SEV support is fully implemented,"...that confuse me13:11
alex_xuis there any update for the exist spec, we need that trait again?13:11
sean-k-mooneyalex_xu: we will need that trait only when intels mktme feature is supported13:12
aspiersright13:12
sean-k-mooneyneed is also a strong word there in that it is only needed if you specifica want SEV13:13
sean-k-mooneyif you jsut want encyrpetd memory you use the resouce class on its own13:13
alex_xusean-k-mooney: they share same resource class?13:13
aspiersMKTME is not implemented yet13:14
aspiersbut we expect it to use the same resource class13:14
alex_xuok, i see now13:14
aspiersthe MKTME spec is still in draft13:14
alex_xuyea, I didn't follow that spec13:14
aspiersbut the resource class is not used directly by users/operators, only internally13:15
alex_xubut I "should"13:15
aspiersexternally they use hw:mem_encryption extra spec and hw_mem_encryption image property13:15
aspiersand that gets translated in the RequestSpec to resources:MEM_ENCRYPTION_CONTEXT=113:15
sean-k-mooneygiven that one is an intel only tech and the other is an amd only tech we do not expec a singel RP to have inventoies fo both so 1 resouce class and 2 traits for what is effectvly the same thing form a guest point of view13:15
aspiersright13:16
alex_xugot it13:16
openstackgerritAdam Spiers proposed openstack/nova master: Add extra spec parameter and image property for memory encryption  https://review.opendev.org/66442013:17
sean-k-mooneyby the way these keystone auth issues "keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL" if i rebase my patch these should go away right13:18
sean-k-mooneythey are unrelated to my code in anycase so ill assume its as a result of keystone/sdk changes13:21
*** brinzhang has quit IRC13:21
*** brinzhang has joined #openstack-nova13:21
sean-k-mooneyaspiers: by the way https://review.opendev.org/#/c/666914/7..8/nova/tests/unit/test_utils.py resolved my python 3.7 failure just in case you hit similar issues.13:22
sean-k-mooneymock.patch.dict works slightly different then some of the other patch function so you might not have issues13:23
aspierssean-k-mooney: nice, thanks.13:23
aspiersthis should work for my patch_{open,exists} too13:23
*** artom has quit IRC13:24
sean-k-mooneyyep i commented on that13:24
sean-k-mooneyon the older revision13:24
*** artom has joined #openstack-nova13:28
*** cz2 has joined #openstack-nova13:30
*** zhubx has quit IRC13:32
aspierssaw that, thanks13:32
*** zhubx has joined #openstack-nova13:33
*** udesale has joined #openstack-nova13:35
openstackgerritsean mooney proposed openstack/nova master: Libvirt: report storage bus traits  https://review.opendev.org/66691413:38
openstackgerritsean mooney proposed openstack/nova master: libvirt: use domain capablites to get supported device models  https://review.opendev.org/66691513:38
sean-k-mooneyill be rebasing ^ after i update the last patch in the series13:39
*** zhubx has quit IRC13:40
*** zhubx has joined #openstack-nova13:40
*** ociuhandu has quit IRC13:41
*** owalsh has joined #openstack-nova13:41
*** eharney has joined #openstack-nova13:42
*** udesale has quit IRC13:42
*** udesale has joined #openstack-nova13:43
*** mkrai_ has quit IRC13:43
*** ociuhandu has joined #openstack-nova13:46
*** ralonsoh has quit IRC13:48
*** udesale has quit IRC13:50
openstackgerritAlexandra Settle proposed openstack/nova stable/rocky: [stable-only] Fixing broken links  https://review.opendev.org/67746013:51
alex_xusean-k-mooney: efried mriedem https://etherpad.openstack.org/p/vpmems-non-virt-driver-specific13:54
alex_xu^ I'm wating for Luyao ensure her code, but that is the basic idea13:54
efriedalex_xu: Whereas it would be nice to be able to do without data model changes, I think this makes sense and makes a number of things much simpler.13:55
*** ralonsoh has joined #openstack-nova13:55
alex_xuefried: \o/13:55
mnaserhttps://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#scheduling-considerations13:56
mnaseris the note a bit contradicting, if i understand correctly, setting aggregate allocation ratios doesnt work in the scheduler anymore?13:57
mnaserso AggregateCoreFilter is technically useless?13:57
mriedemhttps://review.opendev.org/#/c/673496/13:57
mnaserok13:57
mnasermakes sense now13:57
mriedemmaybe "The AggregateCoreFilter, AggregateDiskFilter and AggregateRamFilter filters allow overriding per-compute allocation ratios by setting an allocation ratio value using host aggregate metadata. This provides a convenient way to manage a group of compute hosts with similar allocation ratios while leaving the configuration settings alone." should just be removed13:58
mnaseryeah it seems to tell you "this is how to solve this problem.  note, it doesn't work"13:58
mriedembecause it's essentially saying, "before ocata, ^ was true, but since ocata it's not"13:58
mnaserso for a stein cloud, i can just update the placement service aggregate then?13:58
mriedemyou have to set the allocation ratio on each provider in the placement aggregate13:59
mriedemmel has a convenience cli patch for doing this, sec13:59
mriedemhttps://review.opendev.org/#/c/640898/13:59
mriedemso since pike your compute host aggregates and provider aggregates should be automatically mirrored,13:59
mriedemthe thing that isn't is the compute host aggregate allocation ratio metadata, since placement resource provider aggregates don't have metadata14:00
mnaseroh neat, and technically i shouldn't worry about nova re-overriding it because it only adds it when the rp is first registered, right?14:00
mriedemif you change the allocation ratio config on a nova-compute it would be updated in placement14:00
mriedemthat's where https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#usage-scenarios comes in14:00
mnaseroh i thought we now had initial_foo14:00
mriedemb/c some people (cern) want to manage allocation ratios in config always,14:01
mriedemand others (mgagne) want to manage allocation ratios in an API always14:01
mriedemconfig trumps api14:01
mnaserhmm okay, so either stick to initial_foo and leave others empty or foo14:01
mriedemif config is set14:01
mriedemyes14:01
mnaseryeah makes sense, i think ill stick to config for now14:01
mriedemyou just described scenario 214:02
*** janki has quit IRC14:04
*** ricolin has quit IRC14:04
*** bbowen_ has joined #openstack-nova14:05
*** bbowen has quit IRC14:05
*** liuyulong has joined #openstack-nova14:06
mriedemok i see how the note got mixed in and is confusing, will push a patch to clean that up14:06
cfriesenstephenfin: aspiers: we don't care about postgres anymore. :)14:07
mriedembut mnaser does now14:07
mnaserOh I don't either14:07
mnaserIt was just a pita to run tests locally14:08
mnaserAnd someone mentioned something about needing postgres libs so some postgres tests run14:08
sean-k-mooneyalex_xu: ill come back to your etherpad in a bit just going to finish the thing i was in the middle of14:08
alex_xusean-k-mooney: thanks!14:09
mriedemmnaser: oh :)14:11
openstackgerritMatt Riedemann proposed openstack/nova master: doc: remove confusing docs about aggregate allocation ratios  https://review.opendev.org/67747214:11
mriedemmnaser: also ^14:11
*** dave-mccowan has quit IRC14:12
mnaserif we dont care about postgres ill gladly update that change to remove it entirely -- https://review.opendev.org/#/c/676684/14:12
mriedemcfriesen said he, and by extension windriver/starlingx, don't care about postgres anymore14:12
mriedemthat doesn't mean we're just ripping it out, there are others that use it i think14:13
mriedemwe have a job in the experimental queue to test with pg on-demnd14:13
mriedemi think cdent dabbles with pg as well14:13
stephenfinopenstack-discuss post time?14:13
mriedemwhy?14:13
mriedemit's already been discussed, several times,14:13
mriedemincluding with a TC resolution years ago14:13
mriedemand people came to the "meh, it's not hurting, so who cares"14:14
stephenfinmnaser, aspiers and I, for a start14:14
stephenfinidk, feels odd to keep testing something that no one uses or cares about14:15
mriedemwhat is prompting this coming up?14:15
mriedemwe test and fix pg on demand when there is an issue someone reports, because there are people using it14:15
mnaseri assume when i ran unit tests locally and psycopg2 failed to build cause i was missing headers14:15
mriedemjust because they aren't daily upstream contributors doesn't mean people are'nt using it, or that it's broken14:15
mnaserso i was like "well i scanned the source code and couldnt find any references, why is it in requirements?"14:15
mnaserand someone explianed something about some sort of test path that happened if the library was found14:16
mnaserand someone asked cfriesen if they used postgres and here we are, afaik14:16
mriedemit's really a bindep thing for the opportunistic schema migration tests14:16
mnaserhttps://review.opendev.org/#/c/676684/ means we dont have to carry it anymore14:16
mriedemwe can just as easily remove mysql from test-requirements14:16
stephenfinI must say it'd be nice not to need to install those to build our docs. What happened to the idea to move them into 'extras', like oslo.db does?14:18
stephenfinI didn't know there were actually people using postgres though. I thought it was just cfriesen, tbh :)14:18
*** tbachman has quit IRC14:18
mriedemprometheanfire also uses pg14:19
mriedemand huawei14:19
*** mkrai_ has joined #openstack-nova14:21
mnaserstephenfin: i think to build docs we use doc/requirements.txt now?14:21
mnaserso you shouldn't need to install it.. i think?14:22
stephenfinmnaser: apidoc :(14:22
stephenfinthat introspects the code so you need nova to be installed, which brings in all the dependencies14:22
mnaserah gotcha14:22
mnaserhmm14:23
mriedemwe don't publish an api module index14:23
mriedemin our docs14:23
mnaserbut we dont have psycopg in requirements, only in test-requirements i think14:23
mnaserno db driver exists in requirements afaik14:23
mriedemif we're building an api doc, it's a waste of time14:23
mriedemmnaser: correct. -1 on the lower-constraints thing, otherwise i'd be +2.14:24
*** tbachman has joined #openstack-nova14:24
mriedemmight as well address efried's comments as well14:24
stephenfinmriedem: We do. See doc/source/reference/services.rst and doc/source/reference/services.rst14:24
stephenfindoc/source/reference/notifications.rst14:25
stephenfin145:.. automodule:: nova.notifications.objects.base14:25
stephenfindoc/source/reference/services.rst14:25
stephenfin31:.. automodule:: nova.service14:25
stephenfin41:.. automodule:: nova.manage14:25
mriedemoh god, we could just remove that14:25
stephenfinno argument from me (y)14:25
mriedemthat's probably a relic from when you could extend that stuff via config out of tree14:25
mriedemwe removed that eons ago14:26
stephenfineven the notifications stuff?14:26
mriedemew this https://docs.openstack.org/nova/latest/reference/notifications.html#the-nova-notifications-objects-base-module14:26
mriedemthat's actually useful for contributors adding new versioned notifications14:27
mriedemis there a way to only build part of the api doc and not all of it?14:27
*** jmlowe has joined #openstack-nova14:27
stephenfinnot that I'm aware of, but that autodoc package is really tough to grok14:28
openstackgerritStephen Finucane proposed openstack/nova master: WIP: Move DB, virt driver deps to 'extras'  https://review.opendev.org/67747514:29
stephenfinmnaser, mriedem, aspiers: WIP but I think that would do the trick ^14:29
*** mlavalle has joined #openstack-nova14:30
prometheanfireif I had to do it again...14:30
efriedalex_xu, sean-k-mooney: I think we now need to write a crisp discussion-free version of the design points as refined.  I recommend either creating a new etherpad or shunting the current content down and doing it above.14:31
aspiersstephenfin: cool! how do you use extras?14:31
stephenfinprometheanfire: I'd do it with you? 🎶14:31
stephenfinaspiers: 'cd nova; pip install .[mysql]'14:32
sean-k-mooneyefried: yes we do.14:32
aspiersstephenfin: what is that voodoo syntax! :)14:32
stephenfinor 'pip install .[mysql,postgres,foo]'14:32
sean-k-mooneyefried: over all do you think this is a workable direction14:32
aspiersnever seen that before14:32
alex_xuefried: got it14:32
stephenfinnow you know :)14:33
sean-k-mooneystephenfin: that is install the python module in the current folder with the [] extras packages listed in the brackets right14:33
stephenfinfwiw, that's what pbr is doing for 'doc/requirements.txt' under the hood14:33
stephenfinit just generates a docs extra14:33
stephenfinsean-k-mooney: correctamundo14:33
stephenfinit also works with packages for PyPI, e.g. 'pip install oslo.db[mysql]'14:34
stephenfin*from14:34
sean-k-mooneyalex_xu: i think it would be useful if you used both pmem and vgpus as example of how this could be used14:35
alex_xusean-k-mooney: good idea14:35
efriedsean-k-mooney: Workable, yes. Whether it's going to get by mriedem and dansmith is another question. But let's have that crisp writeup for them to look at so they don't have to try to follow our chicken-scratch stream of consciousness14:37
openstackgerritMohammed Naser proposed openstack/nova master: requirements: move to using psycopg2-binary  https://review.opendev.org/67668414:38
mnasermriedem: ^ good call on lower-constraints14:38
*** tbachman has quit IRC14:40
*** dpawlik has quit IRC14:41
openstackgerritMatt Riedemann proposed openstack/nova master: Libvirt: add support for vPMU configuration.  https://review.opendev.org/67133814:42
mriedemsean-k-mooney: i fixed up some nits in the libvirt driver tests https://review.opendev.org/#/c/671338/1314:43
mriedem+214:43
*** aojea has quit IRC14:43
mriedemstephenfin: i'm +2 on the vpmu change now https://review.opendev.org/#/c/671338/1314:43
stephenfin(y)14:43
mriedemsean-k-mooney: you still need to update this v14:43
mriedemhttps://review.opendev.org/#/c/675182/214:43
sean-k-mooneymriedem: thanks :)14:43
sean-k-mooneyis that the glance change14:43
mriedemyes14:43
sean-k-mooneyits on the todo list for today14:43
sean-k-mooneyim just finishing up myu prefilter change based on stephenfin commenst14:44
sean-k-mooneythen ill update both glance patches14:44
*** tbachman has joined #openstack-nova14:45
sean-k-mooneystephenfin: ill address your comments on the deprecation patch after all of that is done ^14:46
*** zhubx has quit IRC14:48
mriedemmelwitt: so abandon https://review.opendev.org/#/c/675218/ at this point yeah?14:48
*** zhubx has joined #openstack-nova14:48
aspiersalex_xu: does https://review.opendev.org/#/c/638680/46/nova/tests/functional/libvirt/test_report_cpu_traits.py@92 make sense now?14:49
*** zhubx has quit IRC14:50
mriedemmelwitt: actually https://review.opendev.org/#/c/507486/67/nova/db/sqlalchemy/api.py@557214:50
*** zhubx has joined #openstack-nova14:51
*** mkrai_ has quit IRC14:51
sean-k-mooneyaspiers im changeing how some of that works by the way.14:52
mriedemheh yeah in PS65 you had this:14:52
*** bbowen__ has joined #openstack-nova14:52
mriedemmeta = MetaData(get_engine(context=context, use_slave=True))14:52
aspierssean-k-mooney: some of which?14:52
sean-k-mooneyhow the libvirt driver reports traits14:52
aspierssean-k-mooney: I'm just reviewing your patch now14:52
aspierssean-k-mooney: you mean https://review.opendev.org/#/c/666915/8/nova/virt/libvirt/driver.py ?14:53
*** artom has quit IRC14:54
sean-k-mooneythat and the general helper function i have intoduced to remove most of the bolier plate14:54
*** bbowen_ has quit IRC14:54
sean-k-mooneyaspiers: hopefully the chagne wont conflict or wont confict too badly just wanted you to be aware14:57
aspierssean-k-mooney: I don't think it will conflict because the SEV trait is provided via a capability14:57
sean-k-mooneyok14:58
aspiersfingers crossed anyway, because you are just ahead of me on the runway X-D14:58
*** openstackstatus has quit IRC14:58
*** openstack has joined #openstack-nova15:01
*** ChanServ sets mode: +o openstack15:01
sean-k-mooneysure i am vauguly aware that the new version of lxml broke things15:01
sean-k-mooneyi had thought that there was a larger patch that capped 4 or 5 libs floating around somewhere15:02
*** s1061123 has quit IRC15:03
*** pvradu has joined #openstack-nova15:03
*** nweinber_ has joined #openstack-nova15:03
sean-k-mooneyefried: this is the ml thread http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008562.html15:05
efriedyes15:05
sean-k-mooneyi think the bug present in how we compare xmls as equal or somthing like that15:06
*** nweinber has quit IRC15:06
sean-k-mooneyso i dont think it breaks the libvirt dirver but does break our unit tests15:06
*** tbachman has quit IRC15:06
efriedsean-k-mooney: in short, we either need to see if we can fix this in nova, or blacklist the lxml version(s) and open bugs against them and eventually uncap if/when they fix etc etc.15:06
sean-k-mooneywe likely shoudl be able to fix it in nova. ill see if i can repoduce this later today.15:07
efriedthanks sean-k-mooney. It just looks like attr ordering. We could probably resolve it in XMLMatcher, I would think.15:08
efriedI'm actually kind of surprised that that's not already taken into account there.15:08
sean-k-mooneycurrent upper-constratis is set to 4.3.4? so we dont hit this15:08
efriedor maybe those tests aren't using XMLMatcher.15:08
efriedsean-k-mooney: that's the point, prometheanfire is trying to get u-c to the latest published versions and running into this.15:08
sean-k-mooneyyep i know but we simply would not uncapp them in Train if that was not fixed by m315:09
sean-k-mooneywe should be able to fix it if its not too pervasive before then15:09
sean-k-mooneyit could be that it broke the XMLMatcher i just vaguly recall talking to prometheanfire about this so need to look at the actull error first to load context15:10
prometheanfireya, think we talked about it, wasn't it an ordering thing?15:12
sean-k-mooneyyep15:12
sean-k-mooneyi think so15:12
*** icarusfactor has quit IRC15:12
sean-k-mooneyonce  i reporduce it it will likely be a simple fix15:13
sean-k-mooneyeither use the matcher if its using it already or fix the matcher15:13
sean-k-mooneywe created the xmlmatcher to ignore order15:13
sean-k-mooneyunlike other markup formate whitespace in xml and order is technically signifcant15:14
prometheanfirejust made https://review.opendev.org/677480 for you to submit reviews against to test (if you want)15:14
sean-k-mooneyya i saw i can just add a depens on to make sure it passes15:15
efriedprometheanfire: Any particular temest test I should look at for the websockify thing?15:15
efriedtempest*15:15
prometheanfireI'm not sure for that one15:15
efriedso I can pare down the jobs and conserve resources15:15
efriedokay, I'll just run 'em all then.15:15
openstackgerritEric Fried proposed openstack/nova master: DNM: Test websockify 0.9.0  https://review.opendev.org/67748315:15
prometheanfirekk, if you want to wait for https://review.opendev.org/677479 you can15:15
openstackgerritEric Fried proposed openstack/nova master: DNM: Test websockify 0.9.0  https://review.opendev.org/67748315:16
efriedoh, is that going to run something tempestuous?15:16
efriedI made --^ depend on it15:16
sean-k-mooneyefried: i am going to loudly ignore that ....15:17
sean-k-mooneythats such a dad joke15:17
prometheanfireit does :D15:17
efriedsean-k-mooney: non sequitur? Assume we're talking about aspiers's python-rather-than-bash thing now?15:17
openstackgerritmelanie witt proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware  https://review.opendev.org/50748615:18
openstackgerritmelanie witt proposed openstack/nova master: Verify archive_deleted_rows --all-cells in post test hook  https://review.opendev.org/67284015:18
*** tbachman has joined #openstack-nova15:18
*** spatel has quit IRC15:18
sean-k-mooneyi assume the horrible pun between tempestuous and tempest was intentionally because if it wasnt that even worse some how15:19
openstackgerritMerged openstack/nova master: Update api-ref for 2.75 to add config_drive in server update response  https://review.opendev.org/67732415:19
prometheanfirewe do include a general tempest test in our test suite15:19
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional recreate test for bug 1823370  https://review.opendev.org/65042415:20
openstackbug 1823370 in OpenStack Compute (nova) "Evacuations are not restricted to the source cell during scheduling" [Medium,In progress] https://launchpad.net/bugs/1823370 - Assigned to Matt Riedemann (mriedem)15:20
openstackgerritMatt Riedemann proposed openstack/nova master: Restrict RequestSpec to cell when evacuating  https://review.opendev.org/65042915:20
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Use RequestSpec.requested_destination when rebuilding with new image  https://review.opendev.org/65037615:20
sean-k-mooneyprometheanfire: did you have a patch that put all the constratis fixes into one by the way or were they just listed in the email15:21
*** artom has joined #openstack-nova15:23
prometheanfireno, generally the global-reqs nightly update will include it15:23
prometheanfirethat's where I see it generally15:23
sean-k-mooneyok i might have been looking at an automated patch15:25
*** ivve has quit IRC15:26
*** spatel has joined #openstack-nova15:28
*** spatel has quit IRC15:28
*** zhubx has quit IRC15:29
efriedstephenfin: Where was https://review.opendev.org/#/c/677444/1/doc/source/cli/nova-manage.rst rendering before? I don't see it anywhere in https://docs.openstack.org/nova/latest/cli/nova-manage.html15:31
stephenfinefried: https://review.opendev.org/#/c/677443/15:31
efriedo15:32
stephenfinI didn't want that patch to block the docs patch15:32
stephenfinplus the docs one might be worth backporting15:32
openstackgerritMatt Riedemann proposed openstack/python-novaclient master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/66679215:33
efriedstephenfin: So the CLI remote_debug options... no longer work in that top patch?15:33
stephenfinefried: For nova-manage, nova-policy and nova-status, but they never actually worked there15:34
stephenfinBecause there's no "service" to debug15:34
efriedokay, that makes sense. So why bother documenting them in that middle patch?15:35
efriedOr should we at least say "These don't work, don't try to use them"?15:35
stephenfinI wanted to be complete, but perhaps I should just drop them15:35
stephenfinDropping them is probably the wiser option, actually15:35
stephenfin(never documenting them, that is)15:36
efried++15:37
*** tbachman has quit IRC15:41
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document global options for nova-manage  https://review.opendev.org/67744315:42
openstackgerritStephen Finucane proposed openstack/nova master: config: Explicitly register 'remote_debug' CLI opts  https://review.opendev.org/67744415:42
stephenfindonezo15:43
efriedstephenfin: we may have crossed in the mail, there was another comment on the middle one15:43
stephenfinefried: Hmm, there shouldn't be another '--version' parameter any more. I killed that15:44
openstackgerritGhanshyam Mann proposed openstack/nova master: Add new default roles in os-services API policies  https://review.opendev.org/64848015:44
stephenfinlooks like there's more cleanup to do \o/15:45
* stephenfin gets tea15:45
stephenfinand red pen15:45
*** gyee has joined #openstack-nova15:45
mriedemmnaser: are you working around this in stein right now https://review.opendev.org/#/q/topic:bug/1839560+branch:stable/stein or is getting that in pretty critical for you?15:47
stephenfinsean-k-mooney: One easy follow-up on https://review.opendev.org/#/c/671338/ but it's +W'd15:48
*** nweinber__ has joined #openstack-nova15:48
*** pvradu has quit IRC15:50
*** macz has joined #openstack-nova15:51
sean-k-mooneyya i get a littel confused where that works and where it does not. e.g. does not in release notes but does in docs but not in someting else i tried15:51
*** nweinber_ has quit IRC15:51
stephenfinsean-k-mooney: Inside 'doc/source', it works. Everywhere else, it does not15:52
stephenfinThat's because 'doc', 'releasenotes', 'api-ref' and 'api-guide' are all separate doc builds with their own indexes15:53
sean-k-mooneyit was the api ref i think i tried to use it in15:54
sean-k-mooneyok so just docs15:54
stephenfinyeah, no go there15:54
*** udesale has joined #openstack-nova16:00
*** maciejjozefczyk has quit IRC16:09
*** maciejjozefczyk has joined #openstack-nova16:14
*** tbachman has joined #openstack-nova16:16
*** rpittau is now known as rpittau|afk16:17
*** markvoelker has quit IRC16:17
*** maciejjozefczyk has quit IRC16:26
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document global options for nova-manage  https://review.opendev.org/67744316:26
openstackgerritStephen Finucane proposed openstack/nova master: config: Explicitly register 'remote_debug' CLI opts  https://review.opendev.org/67744416:26
openstackgerritStephen Finucane proposed openstack/nova master: docs: Correct 'nova-manage db sync' documentation  https://review.opendev.org/67750816:26
openstackgerritStephen Finucane proposed openstack/nova master: WIP: docs: Rewrite nova-manage docs to use proper directives  https://review.opendev.org/67750916:26
openstackgerritStephen Finucane proposed openstack/nova master: docs: Correct 'nova-manage db sync' documentation  https://review.opendev.org/67750816:30
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document global options for nova-manage  https://review.opendev.org/67744316:30
openstackgerritStephen Finucane proposed openstack/nova master: config: Explicitly register 'remote_debug' CLI opts  https://review.opendev.org/67744416:30
openstackgerritStephen Finucane proposed openstack/nova master: WIP: docs: Rewrite nova-manage docs to use proper directives  https://review.opendev.org/67750916:30
*** owalsh_ has joined #openstack-nova16:32
*** markvoelker has joined #openstack-nova16:33
*** owalsh has quit IRC16:35
*** spsurya has quit IRC16:36
openstackgerritStephen Finucane proposed openstack/nova master: fakelibvirt: Stop distinguishing between NUMA, non-NUMA  https://review.opendev.org/67557016:41
openstackgerritStephen Finucane proposed openstack/nova master: objects: Rename 'nova.objects.instance_numa_topology'  https://review.opendev.org/67178916:41
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove unnecessary try-catch around 'getCPUMap'  https://review.opendev.org/67179016:41
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Remove unnecessary argument  https://review.opendev.org/67439616:41
openstackgerritStephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions  https://review.opendev.org/53741416:41
openstackgerritStephen Finucane proposed openstack/nova master: claims: Remove useless caching  https://review.opendev.org/67179116:41
openstackgerritStephen Finucane proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option  https://review.opendev.org/67179216:41
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement  https://review.opendev.org/67179316:41
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Rename exception argument  https://review.opendev.org/67179516:41
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.get_host_numa_usage_from_instance'  https://review.opendev.org/67179716:41
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.host_topology_and_format_from_host'  https://review.opendev.org/67179816:41
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.instance_topology_from_instance'  https://review.opendev.org/67179916:41
openstackgerritStephen Finucane proposed openstack/nova master: Rework 'hardware.numa_usage_from_instances'  https://review.opendev.org/67256516:41
openstackgerritStephen Finucane proposed openstack/nova master: tests: Split NUMA object tests  https://review.opendev.org/67233616:41
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available'  https://review.opendev.org/67269316:41
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell'  https://review.opendev.org/67439516:41
openstackgerritStephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs  https://review.opendev.org/67180016:41
openstackgerritStephen Finucane proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields'  https://review.opendev.org/67410316:41
sean-k-mooneyjust on or two patches incoming is see16:42
stephenfinI put my own series into merge conflict16:42
sean-k-mooneynice16:42
stephenfinMust start annoying people to get the  trivial patches that I've frontloaded merged16:42
stephenfinThat's tomorrow's work though16:42
*** ivve has joined #openstack-nova16:42
sean-k-mooneystephenfin: thats the pcpu series16:43
stephenfinsean-k-mooney: Want to hit https://review.opendev.org/#/c/675570/ again (it was a trivial rebase due to commit 85ea4f703)16:43
stephenfinYarp16:43
openstackgerritsean mooney proposed openstack/nova master: Libvirt: report storage bus traits  https://review.opendev.org/66691416:43
openstackgerritsean mooney proposed openstack/nova master: libvirt: use domain capabilities to get supported device models  https://review.opendev.org/66691516:43
openstackgerritsean mooney proposed openstack/nova master: Add transform_image_metadata request filter  https://review.opendev.org/66577516:43
stephenfindecision on upgrades still TBD16:43
sean-k-mooneysure ill take a look now16:44
sean-k-mooneyah you rebased it so too i see16:44
stephenfinHad to. I need that later in the series16:45
sean-k-mooneyi would still like to murder cpu_nodes with fire at some point and rename it to numa_nodes... but ignoring that16:45
sean-k-mooneyits look fine to me16:45
stephenfinHmm, probably should have fixed that while I was at it16:45
stephenfinOh well. Next time ¯\_(ツ)_/¯16:45
sean-k-mooneyits at the bottom of the serires so lets not16:46
sean-k-mooneywe can fix it in a follow up patch16:46
sean-k-mooneyeventually16:46
openstackgerritStephen Finucane proposed openstack/nova master: docs: Rewrite host aggregate, availability zone docs  https://review.opendev.org/66713316:49
openstackgerritStephen Finucane proposed openstack/nova master: docs: Scrub available quotas  https://review.opendev.org/67012516:52
openstackgerritStephen Finucane proposed openstack/nova master: docs: Rewrite quotas documentation  https://review.opendev.org/66716516:52
*** owalsh_ is now known as owalsh16:55
openstackgerritStephen Finucane proposed openstack/nova master: doc: Trivial fixes to API version history  https://review.opendev.org/64956116:55
openstackgerritEric Fried proposed openstack/nova master: Add emulated TPM support to Nova  https://review.opendev.org/63136316:59
*** derekh has quit IRC16:59
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Rename exception argument  https://review.opendev.org/67179517:02
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.get_host_numa_usage_from_instance'  https://review.opendev.org/67179717:02
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.host_topology_and_format_from_host'  https://review.opendev.org/67179817:02
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hardware.instance_topology_from_instance'  https://review.opendev.org/67179917:02
openstackgerritStephen Finucane proposed openstack/nova master: Rework 'hardware.numa_usage_from_instances'  https://review.opendev.org/67256517:02
openstackgerritStephen Finucane proposed openstack/nova master: tests: Split NUMA object tests  https://review.opendev.org/67233617:02
openstackgerritStephen Finucane proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option  https://review.opendev.org/67179217:02
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement  https://review.opendev.org/67179317:02
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available'  https://review.opendev.org/67269317:02
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell'  https://review.opendev.org/67439517:02
openstackgerritStephen Finucane proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs  https://review.opendev.org/67180017:02
openstackgerritStephen Finucane proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields'  https://review.opendev.org/67410317:02
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait  https://review.opendev.org/67557117:02
openstackgerritStephen Finucane proposed openstack/nova master: Remove 'hw:cpu_policy', 'hw:mem_page_size' extra specs from API samples  https://review.opendev.org/67533817:02
openstackgerritStephen Finucane proposed openstack/nova master: scheduler: Flatten 'ResourceRequest.from_extra_specs', 'from_image_props'  https://review.opendev.org/67489417:02
openstackgerritStephen Finucane proposed openstack/nova master: Add support for translating CPU policy extra specs, image meta  https://review.opendev.org/67180117:02
openstackgerritStephen Finucane proposed openstack/nova master: libvirt: Fold in argument to '_update_provider_tree_for_vgpu'  https://review.opendev.org/67672917:02
openstackgerritStephen Finucane proposed openstack/nova master: Add reshaper for PCPU  https://review.opendev.org/67489517:02
*** nweinber_ has joined #openstack-nova17:03
openstackgerritEric Fried proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files  https://review.opendev.org/63993417:04
*** udesale has quit IRC17:04
*** nweinber__ has quit IRC17:06
*** gyee has quit IRC17:09
mnasermriedem: working around it by telling folks to not set baremetal machines into maintenance mode17:09
*** tesseract has quit IRC17:10
sean-k-mooneymnaser: does that not require you to use the iroic api and therefor have admin acess17:13
sean-k-mooneyso what everyou your working aound i assume you can jsut tell the vxhost admins dont do that untill its fixed17:14
mnasersean-k-mooney: yes exactly its more of an operator side workaround so its a lot easier than a user facing workaround17:14
sean-k-mooneymnaser: what the issue out of interest17:15
mnasersean-k-mooney: setting a node to 'in maintenance' makes it not show up anymore in the api request to get active nodes from nova-compute so nova marks tyhe service as deleted17:15
mnaserbut if you remove the flag, the node comes back up, and then it fails to be added to the db because there is already a record with the same uuid17:16
sean-k-mooneyoh ok and are you getting duplicate errors when its marked as no longer in maintas in placemnet17:16
sean-k-mooneyya ok that makes sense17:16
mnaseryeah, this is because of a recent change where uuids now uses ironic uuid17:16
sean-k-mooneyit also feel like that is pretty latent behavior17:16
sean-k-mooneyrecent as in rocky ish17:17
mnaseryes that was a recent addition17:17
mnaserhttps://review.opendev.org/#/c/571535/ rocky indeed17:17
sean-k-mooneyya i dont think we have many customer deployint that yet17:17
sean-k-mooneymost are on queens17:17
sean-k-mooneywell i lie most are proably on newton untill that is EOL in deceber then most will be on queens17:18
*** ociuhandu has quit IRC17:18
*** gyee has joined #openstack-nova17:22
*** nweinber__ has joined #openstack-nova17:22
*** nweinber_ has quit IRC17:25
*** ralonsoh has quit IRC17:28
*** boxiang has joined #openstack-nova17:34
*** factor has joined #openstack-nova17:34
*** tesseract has joined #openstack-nova17:45
*** brinzhang_ has joined #openstack-nova17:47
*** igordc has joined #openstack-nova17:48
*** brinzhang has quit IRC17:50
openstackgerritMerged openstack/nova master: Add functional recreate test for bug 1823370  https://review.opendev.org/65042418:06
openstackbug 1823370 in OpenStack Compute (nova) "Evacuations are not restricted to the source cell during scheduling" [Medium,In progress] https://launchpad.net/bugs/1823370 - Assigned to Matt Riedemann (mriedem)18:06
*** maciejjozefczyk has joined #openstack-nova18:19
*** maciejjozefczyk has quit IRC18:28
*** jmlowe has quit IRC18:29
*** markvoelker has quit IRC18:34
*** factor has quit IRC18:40
*** jmlowe has joined #openstack-nova18:55
donnydmnaser: just ran into this issue this morning on FN19:06
donnydA node didn't want to clean, was thrown into maintenance and then had to pull it from nova db to get it schedulable again19:08
mnaseryep19:11
openstackgerritMerged openstack/python-novaclient master: Microversion 2.75 - Multiple API cleanup changes  https://review.opendev.org/67627519:11
*** brinzhang_ has quit IRC19:18
openstackgerritMerged openstack/python-novaclient master: API microversion 2.76: Add 'power-update' external event  https://review.opendev.org/66679219:28
*** maciejjozefczyk has joined #openstack-nova19:48
*** mriedem has quit IRC19:50
*** bbowen__ has quit IRC19:51
*** mriedem has joined #openstack-nova19:54
mriedemefried: i guess t-2 should be closed out in lp huh19:58
mriedemas of july 2519:58
mriedemi closed out the bps for 2.75 and 2.7620:00
*** maciejjozefczyk has quit IRC20:03
*** ash2307 has joined #openstack-nova20:07
efriedmriedem: I don't know what you're saying.20:07
mriedemefried: the t-2 milestone in launchpad for nova is still open20:08
mriedemeven though we're past the t-2 (fake-ish) milestone20:08
mriedemhttps://wiki.openstack.org/wiki/Nova/Train_Release_Schedule20:08
mriedemmelwitt: https://review.opendev.org/#/c/672840/8 is busted - you remove the call to archive20:08
mriedem*removed20:08
mriedemi think my comment in PS4 caused the confusion, i just meant to remove the $conf passed to the bash function since we didn't need it anymore20:08
efriedmriedem: I didn't know launchpad tracked "milestones". How do I look at that?20:09
efried(and, not to put too fine a point on it, but does anyone care?)20:09
mriedemhttps://launchpad.net/nova/+series20:10
mriedemefried: not really since the release team stopped doing milestone releases,20:10
mriedemwe really only have them for internal tracking20:11
efriedso... I can go into it and uncheck Active and that's it?20:11
mriedemi.e. t-2, nova-spec freeze20:11
mriedemin the past i've created a release20:11
mriedemwhich closes it out20:11
melwittmriedem: argh, sorry. I saw the commands were in a function and then I promptly didn't realize that was the func call. will fix20:11
mriedemefried: i'm not sure if marking it as inactive just removes it from targeting for bugs and blueprints but still shows up in history20:12
mriedemsince we don't create an actual release (we don't tag the repo), marking as not active is probably more correct20:12
* efried tries20:12
efriedmade it disappear from the little flow charty thingy.20:13
*** markvoelker has joined #openstack-nova20:15
*** markvoelker has quit IRC20:16
*** markvoelker has joined #openstack-nova20:16
mriedemi still see it here https://launchpad.net/nova/train20:17
mriedembut not marked active https://launchpad.net/nova/+milestone/train-220:17
mriedemwhich means,20:17
mriedemit doesn't show up as a milestone target either, which is what we want20:18
mriedemso we're good20:18
*** boxiang has quit IRC20:21
*** zhubx has joined #openstack-nova20:21
*** zhubx has quit IRC20:22
efried\o/20:23
*** factor has joined #openstack-nova20:26
openstackgerritEric Fried proposed openstack/nova master: objects: Rename 'nova.objects.instance_numa_topology'  https://review.opendev.org/67178920:38
openstackgerritEric Fried proposed openstack/nova master: libvirt: Remove unnecessary try-catch around 'getCPUMap'  https://review.opendev.org/67179020:38
openstackgerritEric Fried proposed openstack/nova master: libvirt: Remove unnecessary argument  https://review.opendev.org/67439620:38
openstackgerritEric Fried proposed openstack/nova master: objects: Remove legacy '_from_dict' functions  https://review.opendev.org/53741420:38
openstackgerritEric Fried proposed openstack/nova master: claims: Remove useless caching  https://review.opendev.org/67179120:38
openstackgerritEric Fried proposed openstack/nova master: trivial: Rename exception argument  https://review.opendev.org/67179520:38
openstackgerritEric Fried proposed openstack/nova master: Remove 'hardware.get_host_numa_usage_from_instance'  https://review.opendev.org/67179720:38
openstackgerritEric Fried proposed openstack/nova master: Remove 'hardware.host_topology_and_format_from_host'  https://review.opendev.org/67179820:38
openstackgerritEric Fried proposed openstack/nova master: Remove 'hardware.instance_topology_from_instance'  https://review.opendev.org/67179920:38
openstackgerritEric Fried proposed openstack/nova master: Rework 'hardware.numa_usage_from_instances'  https://review.opendev.org/67256520:38
openstackgerritEric Fried proposed openstack/nova master: tests: Split NUMA object tests  https://review.opendev.org/67233620:38
openstackgerritEric Fried proposed openstack/nova master: Add '[compute] cpu_dedicated_set' option  https://review.opendev.org/67179220:38
openstackgerritEric Fried proposed openstack/nova master: libvirt: Start reporting PCPU inventory to placement  https://review.opendev.org/67179320:38
openstackgerritEric Fried proposed openstack/nova master: libvirt: '_get_(v|p)cpu_total' to '_get_(v|p)cpu_available'  https://review.opendev.org/67269320:38
openstackgerritEric Fried proposed openstack/nova master: trivial: Rewrap definitions of 'NUMACell'  https://review.opendev.org/67439520:38
openstackgerritEric Fried proposed openstack/nova master: hardware: Differentiate between shared and dedicated CPUs  https://review.opendev.org/67180020:38
openstackgerritEric Fried proposed openstack/nova master: objects: Rename 'fields' import to 'obj_fields'  https://review.opendev.org/67410320:38
openstackgerritEric Fried proposed openstack/nova master: libvirt: Start reporting 'HW_CPU_HYPERTHREADING' trait  https://review.opendev.org/67557120:38
melwittmriedem: the archive command should go after 'set -e' too right? or no?20:38
melwittoh, it shouldn't bc we expect it to return 1 several times20:39
mriedemmelwitt: i think it can because the functions will only return a non-0 if they fail20:40
*** eharney has quit IRC20:40
melwittmriedem: oh, I see. the function, not the individual commands. ok thanks20:41
mriedemthat's one issue i've meant to cleanup in that script is if the archive or purge fails the script wouldn't actually fail and the job wouldnt' fail20:41
melwittyeah, I see20:42
openstackgerritMatt Riedemann proposed openstack/nova master: Deprecate Aggregate[Core|Ram|Disk]Filters  https://review.opendev.org/67349620:42
openstackgerritMatt Riedemann proposed openstack/nova master: Deprecate Aggregate[Core|Ram|Disk]Filters  https://review.opendev.org/67349620:45
mriedemsean-k-mooney: stephenfin: i've addressed comments in ^ and am +2 now20:45
openstackgerritmelanie witt proposed openstack/nova master: Verify archive_deleted_rows --all-cells in post test hook  https://review.opendev.org/67284020:48
*** bbowen__ has joined #openstack-nova20:51
mriedemefried: looking at the grenade failures in https://review.opendev.org/#/c/676684/, it appears to be segfaults killing q-svc20:55
mriedemAug 20 15:53:30 ubuntu-bionic-rax-dfw-0010301045 kernel: /usr/bin/python[21875]: segfault at a9 ip 000055aee57ec9e4 sp 00007ffed66329d8 error 4 in python2.7[55aee5716000+301000]20:55
mriedemwhich i've seen locally but not so much in the gate20:56
efriedmriedem: segfault + switch-to-something-called-binary == suspicious20:56
mriedembut these jobs aren't even using postgresql20:56
efriedI didn't go back and check the previous failures20:56
efriedbut it seemed like *all* the grenade jobs failed *every* patch set.20:57
efried(anecdotal ^ )20:57
mriedemthe pips are installed20:58
mriedempsycopg2==2.8.3 psycopg2-binary==2.8.320:58
efriedAnyway, I have a definite -1 on the requirements-check problem. If the grenade thing turns out to be unrelated, great.20:58
mriedemthe good news is there are hits in logstash20:58
mriedemhttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22Unexpected%20exception%20in%20API%20method%3A%20ConnectFailure%3A%20Unable%20to%20establish%20connection%20to%5C%22%20AND%20message%3A%5C%22v2.0%2Fports%3Fdevice_id%5C%22%20AND%20message%3A%5C%22('Connection%20aborted.'%2C%20BadStatusLine('No%20status%20line%20received%20-%20the%20server%20has%20closed%20the%20connection'%2C))%5C%22%20AND%20tags20:58
mriedem5C%22screen-n-api.txt%5C%22&from=7d20:58
mriedemthe bad news is they are only on that one change20:58
efriedis that bad news?20:58
efriedIt seems like it would be further evidence that the problem is *there*.20:58
*** my_nd has joined #openstack-nova21:02
mriedemwell it's not good news21:02
*** nweinber__ has quit IRC21:02
mriedemi've seen this same thing in my devstack vms i've created lately b/c there is too much filling up a single 8gb ram/8vpu vm even after stripping the services to pretty bare bone21:03
mriedemclarkb has posted about it in the ML so it's a known issue21:03
mriedembut not many people working on it21:03
efriedis it possible that the -binary thingy is just sucking up too much memory?21:05
my_ndhi there, is there a way to configure a compute node to use only some % of their available resources to host instances?21:07
mriedemmy_nd: yes, you can configured reserved cpu, ram and disk for the host21:10
mriedemhttps://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.reserved_host_cpus21:10
mriedemhttps://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.reserved_host_disk_mb21:11
mriedemhttps://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.reserved_host_memory_mb21:11
my_ndthanks mriedem21:12
mriedemefried: postgresql shouldn't even be running21:13
mriedemi don't see it in https://a6b55b727208d469fce9-a76e08006e67cd388b33580b35bd0960.ssl.cf2.rackcdn.com/676684/7/check/nova-grenade-live-migration/8626716/logs/screen-peakmem_tracker.txt.gz anyway21:13
mriedemmysqld is in there21:13
mriedemunfortunately peakmemtracker seems to die before we start seeing segfaults21:16
mriedemtop memory usage is unsurprisingly mysqld, neutron, and nova (api and compute)21:16
efriedI can't make that logstash query work, because it split lines on me. Can you paste just the text from the query box?21:18
mriedemmessage:"Unexpected exception in API method: ConnectFailure: Unable to establish connection to" AND message:"v2.0/ports?device_id" AND message:"('Connection aborted.', BadStatusLine('No status line received - the server has closed the connection',))" AND tags:"screen-n-api.txt"21:18
efriedor you can just tell me: are there hits from the earlier patch sets?21:18
mriedem6 and 7 yes21:18
efriedmm21:19
mriedemnothing really changed much since PS5 though...21:19
efriedthose are all from nova-grenade-live-migration.21:19
efriedhow did the other grenades fail?21:20
*** xek has quit IRC21:20
*** markvoelker has quit IRC21:22
mriedemsimilar, but in one case the grenade script calling neutron api directly rather than proxying through nova21:23
mriedem2019-08-20 15:42:11.965 | + /opt/stack/new/grenade/projects/70_cinder/resources.sh:destroy:265 :   openstack floating ip unset --port 172.24.5.75 2019-08-20 15:42:15.779 | Unable to establish connection to http://104.239.175.129:9696/v2.0/floatingips/172.24.5.75: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))21:23
mriedemAug 20 15:42:15.153161 ubuntu-bionic-rax-iad-0010301032 neutron-server[11166]: INFO oslo_service.service [-] Child 24291 killed by signal 1121:23
mriedemAug 20 15:42:15 ubuntu-bionic-rax-iad-0010301032 kernel: /usr/bin/python[22305]: segfault at a9 ip 0000000000585794 sp 00007ffd8b90c5b8 error 4 in python3.6[400000+3bf000]21:24
*** bnemec has quit IRC21:27
*** shilpasd has quit IRC21:29
*** tesseract has quit IRC21:32
efriedIs there a unifying logstash search to rule them all?21:32
*** markvoelker has joined #openstack-nova21:35
efriedmessage:"Unable to establish connection to" AND tags:"screen-n-api.txt"21:35
efried with 7d21:35
efriedgives me 64 hits on three different grenade jobs on both of those patches and no others21:35
efried(that one and its now-abandoned successor)21:36
efriedThat would be enough for me to say, "sorry, this -binary thing is no good".21:36
*** markvoelker has quit IRC21:40
*** ivve has quit IRC21:42
mriedemyeah there were hits on the now abandoned patch that was on top of the -binary one too21:47
mriedemsuper weird21:47
openstackgerritMatt Riedemann proposed openstack/nova master: Delete InstanceMapping in conductor if BuildRequest is already deleted  https://review.opendev.org/66643821:52
*** my_nd has quit IRC21:56
mriedemdansmith: would be nice to get this in https://review.opendev.org/#/c/673620/ so we can drop the service uuid online data migration in U21:57
dansmithmriedem: hmm, we've had other blocker migrations since havana that didn't get added to that special list21:59
*** rcernin has joined #openstack-nova22:00
mriedemi know, and they don't do anything22:00
dansmithwhy do you need to add yours there then?22:01
mriedemhttps://review.opendev.org/#/c/673620/1/nova/tests/unit/db/test_migrations.py@73022:01
mriedembecause it's cleaner?22:01
mriedemmy guess is that skip list came after the older blocker migrations22:01
dansmithI don't think so,22:01
dansmithI think I added that a long time ago22:02
*** trident has quit IRC22:02
mriedemok yeah https://review.opendev.org/#/c/122162/ vs https://review.opendev.org/#/c/174480/22:03
mriedembut having said that, i'm not sure why it matters22:03
mriedemit's just making sure there is a method for the migration, but the method just passes so...22:03
mriedemthe actual test is in another module22:03
dansmithwell, it's more just the principle of the case where nothing should be added to those exclusion lists in the future, and I don't think you need to22:04
mriedemif you're +2 besides that will you fast approve if i make that change?22:04
dansmithyeah22:04
dansmithsorry22:05
*** markvoelker has joined #openstack-nova22:10
mriedemnp, i have to rebase anyway22:10
*** trident has joined #openstack-nova22:11
dansmithmriedem: you meant soon right? :)22:14
*** zbr has quit IRC22:14
*** markvoelker has quit IRC22:15
openstackgerritMatt Riedemann proposed openstack/nova master: Add blocker migration for completing services.uuid migration  https://review.opendev.org/67362022:15
mriedemthar she blar22:15
*** zbr has joined #openstack-nova22:16
dansmithgot it22:18
*** markvoelker has joined #openstack-nova22:29
*** BjoernT has quit IRC22:46
*** markvoelker has quit IRC22:48
*** tkajinam has joined #openstack-nova22:55
mriedemthanks23:04
*** mriedem has quit IRC23:05
sean-k-mooneymriedem: ack, thanks for updating the deprecation patch. i had planned to throw up a [WIP:U] patch to actully delete the thing in u but that is still future23:05
sean-k-mooneyjust missed him hehe23:05
*** markvoelker has joined #openstack-nova23:12
*** zbr has quit IRC23:22
*** markvoelker has quit IRC23:22
*** zbr has joined #openstack-nova23:23
*** mlavalle has quit IRC23:29
*** takashin has joined #openstack-nova23:39
openstackgerritDustin Cowles proposed openstack/nova master: Public method to retrieve custom resource providers  https://review.opendev.org/67602923:41
openstackgerritDustin Cowles proposed openstack/nova master: WIP: Load the custom resource providers to resource tracker  https://review.opendev.org/67652223:41
*** takashin has quit IRC23:42
*** takashin has joined #openstack-nova23:45
*** macz has quit IRC23:48
*** brinzhang has joined #openstack-nova23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!