Wednesday, 2018-04-11

cfriesenmriedem: aww, shucks.00:00
mriedemKevin_Zheng: i tested it out and invalidated the bug, details are in the bug - looks like we handle it appropriately by default; it's ignored as a query parameter, and you get a 400 if you try to sort on 'fault'00:02
*** priteau has joined #openstack-nova00:03
*** priteau has quit IRC00:03
*** tetsuro has joined #openstack-nova00:04
*** yamahata has joined #openstack-nova00:07
*** itlinux has joined #openstack-nova00:07
tetsurogood morning00:12
*** zhurong has joined #openstack-nova00:21
*** liuzz has joined #openstack-nova00:25
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in test_virt_drivers.py  https://review.openstack.org/55987800:27
gmannmriedem: yea, it is not in valid sort key as well as in ignore list also so this gives 400 - https://github.com/openstack/nova/blob/94b150bd79e5dfb4bdbb1aa9437c103ad5b80543/nova/api/openstack/compute/schemas/servers.py#L37900:28
gmanntetsuro: morning00:30
*** dpawlik has joined #openstack-nova00:33
*** Dinesh_Bhor has joined #openstack-nova00:33
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Parameter verification for servers.inc (2/3)  https://review.openstack.org/55064800:33
*** gyee has quit IRC00:33
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Parameter verification for servers.inc (3/3)  https://review.openstack.org/55065900:33
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Fix parameter order in rebuild  https://review.openstack.org/52971800:34
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in tests/unit/test_utils.py  https://review.openstack.org/55788300:34
*** dpawlik has quit IRC00:37
*** yamamoto has joined #openstack-nova00:43
*** artom has joined #openstack-nova00:45
*** dave-mccowan has joined #openstack-nova00:47
*** odyssey4me has quit IRC00:47
*** odyssey4me has joined #openstack-nova00:47
*** yamamoto has quit IRC00:48
mriedemif anyone wants to chase down a functional test race bug over breakfast https://bugs.launchpad.net/nova/+bug/176287600:49
openstackLaunchpad bug 1762876 in OpenStack Compute (nova) "KeyError during move operation functional tests" [Medium,Confirmed]00:49
*** mriedem has quit IRC00:49
*** felipemonteiro__ has joined #openstack-nova00:50
*** germs has quit IRC00:51
*** germs has joined #openstack-nova00:52
*** germs has quit IRC00:52
*** germs has joined #openstack-nova00:52
naichuansmriedem: Hi, Matt. Currently we have no test environments about live-migration in citrix CI, but we do have test jobs about it in Citrix XenRT, it is a internal test environment. And all the test related with the two patches are passed.https://review.openstack.org/#/c/489451/ and https://review.openstack.org/#/c/554154/00:55
*** jichen has joined #openstack-nova00:55
*** germs has quit IRC00:56
naichuansefried: Thank you for the feedback. Will follow up blueprint nested-resource-providers-allocation-candidates00:56
*** Dinesh__Bhor has joined #openstack-nova00:58
*** Dinesh_Bhor has quit IRC01:00
*** jackie-truong has joined #openstack-nova01:06
*** licanwei has joined #openstack-nova01:11
*** sahid has quit IRC01:11
*** zhaochao has joined #openstack-nova01:12
*** sahid has joined #openstack-nova01:13
*** wolverineav has quit IRC01:13
*** wolverin_ has joined #openstack-nova01:13
*** fragatina has quit IRC01:13
*** harlowja has quit IRC01:14
*** salv-orl_ has joined #openstack-nova01:14
*** fragatina has joined #openstack-nova01:14
*** fragatin_ has joined #openstack-nova01:16
*** salv-orlando has quit IRC01:17
*** fragatina has quit IRC01:18
*** gjayavelu has quit IRC01:19
*** fragatin_ has quit IRC01:20
*** tiendc has joined #openstack-nova01:21
*** takashin has quit IRC01:23
*** felipemonteiro__ has quit IRC01:25
*** suresh12 has quit IRC01:29
openstackgerritJackie Truong proposed openstack/nova master: Implement certificate_utils  https://review.openstack.org/47994901:31
openstackgerritJackie Truong proposed openstack/nova master: Add trusted_image_certificates to REST API  https://review.openstack.org/48620401:31
openstackgerritJackie Truong proposed openstack/nova master: Add certificate validation docs  https://review.openstack.org/56015801:31
Kevin_Zhengmriedem strange, I thought that one went well..01:31
*** wolverin_ has quit IRC01:32
*** wolverineav has joined #openstack-nova01:32
*** wolverin_ has joined #openstack-nova01:35
*** wolverineav has quit IRC01:36
*** huanxie has joined #openstack-nova01:37
*** hongbin has joined #openstack-nova01:40
*** wolverin_ has quit IRC01:40
*** phuongnh has joined #openstack-nova01:42
*** germs has joined #openstack-nova01:44
*** germs has quit IRC01:44
*** germs has joined #openstack-nova01:44
*** yamamoto has joined #openstack-nova01:44
*** yamamoto has quit IRC01:50
*** wolverineav has joined #openstack-nova01:54
*** wolverineav has quit IRC01:58
*** dougshel_ has quit IRC01:59
*** zhurong has quit IRC02:00
*** wolverineav has joined #openstack-nova02:01
eanderssonHow does database pools work with workers? Does the conductor have one db pool per proccess?02:08
eanderssonand is the nova_api different?02:08
*** hiro-kobayashi has joined #openstack-nova02:10
*** nicolasbock has quit IRC02:14
*** Dinesh__Bhor has quit IRC02:18
*** claudiub has quit IRC02:19
*** Dinesh__Bhor has joined #openstack-nova02:20
*** sdague has quit IRC02:23
*** bingqianglin has joined #openstack-nova02:32
*** germs has quit IRC02:32
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in unit/api/openstack/compute/test_hosts.py  https://review.openstack.org/55926602:33
*** takashin has joined #openstack-nova02:43
*** yamamoto has joined #openstack-nova02:47
*** tiendc has quit IRC02:47
*** r-daneel has joined #openstack-nova02:47
*** andreas_s has joined #openstack-nova02:49
*** yamamoto has quit IRC02:52
*** sambetts|afk has quit IRC02:53
*** andreas_s has quit IRC02:54
*** sambetts_ has joined #openstack-nova02:54
*** dave-mccowan has quit IRC02:56
*** juggsmcb has joined #openstack-nova02:56
*** tiendc has joined #openstack-nova02:57
openstackgerritJackie Truong proposed openstack/nova master: Implement certificate_utils  https://review.openstack.org/47994902:57
openstackgerritJackie Truong proposed openstack/nova master: Add trusted_image_certificates to REST API  https://review.openstack.org/48620402:57
openstackgerritJackie Truong proposed openstack/nova master: Add certificate validation docs  https://review.openstack.org/56015802:57
*** psachin has joined #openstack-nova03:00
*** juggsmcb has quit IRC03:03
*** imacdonn has quit IRC03:08
*** imacdonn has joined #openstack-nova03:08
*** psachin has quit IRC03:09
*** madhaviy has joined #openstack-nova03:10
*** fragatina has joined #openstack-nova03:20
openstackgerritMerged openstack/nova master: PowerVM: Add proc_units_factor conf option  https://review.openstack.org/55468803:21
*** fragatina has quit IRC03:22
*** fragatina has joined #openstack-nova03:23
*** psachin has joined #openstack-nova03:26
openstackgerritNguyen Hai proposed openstack/nova-specs master: Enhance nova-specs webpage and clean up repo  https://review.openstack.org/55180203:30
*** tuanla____ has joined #openstack-nova03:31
*** tuanla____ has quit IRC03:33
*** tuanla____ has joined #openstack-nova03:33
*** vipul has quit IRC03:33
*** udesale has joined #openstack-nova03:34
*** suresh12 has joined #openstack-nova03:39
*** dikonoor has joined #openstack-nova03:48
*** yamamoto has joined #openstack-nova03:48
*** suresh12 has quit IRC03:49
*** yamamoto has quit IRC03:53
*** hongbin has quit IRC03:59
*** hiro-kobayashi has quit IRC04:02
*** fragatina has quit IRC04:06
*** fragatina has joined #openstack-nova04:06
*** hshiina has joined #openstack-nova04:09
*** madhaviy has quit IRC04:11
*** felipemonteiro__ has joined #openstack-nova04:13
*** takashin has quit IRC04:17
openstackgerritJackie Truong proposed openstack/nova master: Implement certificate_utils  https://review.openstack.org/47994904:21
openstackgerritJackie Truong proposed openstack/nova master: Add trusted_image_certificates to REST API  https://review.openstack.org/48620404:21
*** jaosorior has joined #openstack-nova04:21
openstackgerritJackie Truong proposed openstack/nova master: Add certificate validation docs  https://review.openstack.org/56015804:21
*** harlowja has joined #openstack-nova04:23
*** sree has joined #openstack-nova04:26
*** udesale has quit IRC04:26
*** jackie-truong has quit IRC04:29
*** dpawlik has joined #openstack-nova04:33
*** suresh12 has joined #openstack-nova04:36
*** abhishekk has joined #openstack-nova04:37
*** vladikr has quit IRC04:37
*** dpawlik has quit IRC04:38
*** ssurana has joined #openstack-nova04:40
*** udesale has joined #openstack-nova04:45
*** stakeda has joined #openstack-nova04:46
openstackgerritNakanishi Tomotaka proposed openstack/nova master: Test Compute API in multiple cells  https://review.openstack.org/56026004:46
*** udesale has quit IRC04:46
*** madhaviy has joined #openstack-nova04:47
*** udesale has joined #openstack-nova04:47
*** yamamoto has joined #openstack-nova04:50
*** felipemonteiro_ has joined #openstack-nova04:51
*** felipemonteiro__ has quit IRC04:54
*** trinaths has joined #openstack-nova04:55
*** yamamoto has quit IRC04:55
*** zhaochao has quit IRC04:58
*** gjayavelu has joined #openstack-nova04:58
*** dineshbhor__ has joined #openstack-nova04:58
*** Dinesh__Bhor has quit IRC04:59
*** felipemonteiro_ has quit IRC05:02
*** dineshbhor__ has quit IRC05:12
*** Dinesh_Bhor has joined #openstack-nova05:12
*** sridharg has joined #openstack-nova05:15
*** zhaochao has joined #openstack-nova05:17
*** dikonoor has quit IRC05:24
*** tbachman has quit IRC05:25
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create  https://review.openstack.org/52031305:25
*** links has joined #openstack-nova05:29
*** suresh12 has quit IRC05:34
*** Eran_Kuris has joined #openstack-nova05:35
*** harlowja has quit IRC05:35
*** ratailor has joined #openstack-nova05:35
*** sidx64 has joined #openstack-nova05:36
*** markvoelker_ has quit IRC05:39
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create  https://review.openstack.org/52031305:40
*** takashin has joined #openstack-nova05:40
*** armaan has quit IRC05:42
*** armaan has joined #openstack-nova05:44
*** wolverineav has quit IRC05:46
*** trinaths has quit IRC05:46
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in test_neutron_security_groups.py  https://review.openstack.org/56026705:48
openstackgerritTetsuro Nakamura proposed openstack/nova-specs master: Return resources of entire trees in Placement  https://review.openstack.org/55946605:49
*** yamamoto has joined #openstack-nova05:52
*** yamamoto has quit IRC05:57
*** tbachman has joined #openstack-nova05:58
*** rodolof has joined #openstack-nova06:01
*** kholkina has joined #openstack-nova06:02
openstackgerritMichael Still proposed openstack/nova master: Sync xenapi and libvirt on what flags to pass e2fsck.  https://review.openstack.org/55407806:03
openstackgerritMichael Still proposed openstack/nova master: Move xenapi partition copies to privsep.  https://review.openstack.org/55360506:03
openstackgerritMichael Still proposed openstack/nova master: Move image conversion to privsep.  https://review.openstack.org/55443706:03
openstackgerritMichael Still proposed openstack/nova master: We don't need utils.trycmd any more.  https://review.openstack.org/55443906:03
openstackgerritMichael Still proposed openstack/nova master: We no longer need rootwrap.  https://review.openstack.org/55443806:03
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P):Get vgpu info from `allocations`  https://review.openstack.org/52171706:04
*** suresh12 has joined #openstack-nova06:06
openstackgerritTetsuro Nakamura proposed openstack/nova-specs master: Return resources of entire trees in Placement  https://review.openstack.org/55946606:07
*** rodolof has quit IRC06:08
*** rodolof has joined #openstack-nova06:09
*** suresh12 has quit IRC06:11
*** sree has quit IRC06:11
*** sree has joined #openstack-nova06:12
*** sree has quit IRC06:13
*** sree has joined #openstack-nova06:13
*** sahid has quit IRC06:14
*** sahid has joined #openstack-nova06:15
*** hiro-kobayashi has joined #openstack-nova06:15
*** tbachman has quit IRC06:16
*** evin has joined #openstack-nova06:17
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/54877206:18
*** dikonoor has joined #openstack-nova06:18
*** trinaths has joined #openstack-nova06:18
*** armaan has quit IRC06:19
*** tbachman has joined #openstack-nova06:19
*** armaan has joined #openstack-nova06:20
*** sree has quit IRC06:22
*** sree has joined #openstack-nova06:22
*** sree has quit IRC06:24
*** armaan has quit IRC06:24
*** dikonoor has quit IRC06:24
*** sree has joined #openstack-nova06:25
*** armaan has joined #openstack-nova06:25
*** sree has quit IRC06:26
*** sree has joined #openstack-nova06:27
*** hemna_ has quit IRC06:29
*** jhesketh_ is now known as jhesketh06:29
*** sree has quit IRC06:31
*** priteau has joined #openstack-nova06:32
*** belmoreira has joined #openstack-nova06:33
*** Dinesh__Bhor has joined #openstack-nova06:35
*** Dinesh_Bhor has quit IRC06:36
*** sidx64_ has joined #openstack-nova06:38
*** dpawlik has joined #openstack-nova06:39
*** sidx64 has quit IRC06:40
*** trinaths has quit IRC06:40
*** ragiman has joined #openstack-nova06:41
*** sree has joined #openstack-nova06:43
*** sidx64 has joined #openstack-nova06:43
*** sidx64_ has quit IRC06:43
*** dpawlik has quit IRC06:44
*** slaweq has joined #openstack-nova06:47
*** sree has quit IRC06:48
*** yamamoto has joined #openstack-nova06:53
*** alexchadin has joined #openstack-nova06:53
*** janki has joined #openstack-nova06:54
*** AlexeyAbashkin has joined #openstack-nova06:54
*** AlexeyAbashkin has quit IRC06:55
*** AlexeyAbashkin has joined #openstack-nova06:56
*** AlexeyAbashkin has quit IRC06:57
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support compute node resource provider update and create  https://review.openstack.org/52104106:57
*** AlexeyAbashkin has joined #openstack-nova06:57
*** yamamoto has quit IRC06:59
*** dpawlik has joined #openstack-nova06:59
*** sree has joined #openstack-nova07:05
*** trinaths has joined #openstack-nova07:06
*** rcernin has quit IRC07:06
*** trinaths has quit IRC07:06
*** yamamoto has joined #openstack-nova07:08
*** amoralej|off is now known as amoralej07:08
*** damien_r has joined #openstack-nova07:08
*** bingqianglin has quit IRC07:09
*** damien_r has quit IRC07:09
*** damien_r has joined #openstack-nova07:09
*** trinaths has joined #openstack-nova07:10
*** maciejjozefczyk has quit IRC07:10
*** ccamacho has joined #openstack-nova07:10
*** sree has quit IRC07:10
*** Dinesh__Bhor has quit IRC07:12
*** zhurong has joined #openstack-nova07:12
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support compute node resource provider update and create  https://review.openstack.org/52104107:12
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Add microversion to support extra_specs in flavor API.  https://review.openstack.org/55415907:13
openstackgerritYikun Jiang (Kero) proposed openstack/nova-specs master: Complex (Anti)-Affinity Policies  https://review.openstack.org/54692507:18
openstackgerritBence Romsics proposed openstack/osc-placement master: Add nested resource providers (v1.14)  https://review.openstack.org/54667507:19
openstackgerritBence Romsics proposed openstack/osc-placement master: Limit allocation candidates (v1.15, v1.16)  https://review.openstack.org/54804307:19
openstackgerritBence Romsics proposed openstack/osc-placement master: Allocation candidates parameter: required (v1.17)  https://review.openstack.org/54832607:19
*** ssurana has quit IRC07:21
*** Dinesh__Bhor has joined #openstack-nova07:22
*** avolkov has joined #openstack-nova07:24
*** trinaths has quit IRC07:25
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 1  https://review.openstack.org/56029607:27
*** tesseract has joined #openstack-nova07:28
*** claudiub has joined #openstack-nova07:29
*** gcb has joined #openstack-nova07:30
*** andreas_s has joined #openstack-nova07:34
*** liuzz_ has joined #openstack-nova07:35
*** liuzz has quit IRC07:35
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 2  https://review.openstack.org/56029907:38
*** mgoddard has joined #openstack-nova07:40
*** belmoreira has quit IRC07:42
*** xinliang has quit IRC07:42
*** xinliang has joined #openstack-nova07:43
takashinmriedem: Are you around?07:44
takashinmriedem: Could you look https://bugs.launchpad.net/nova/+bug/1762941 ?07:44
openstackLaunchpad bug 1762941 in OpenStack Compute (nova) "testtools.matchers._impl.MismatchError: 'completed' != u'running' in test_bug_1718512.TestRequestSpecRetryReschedule.test_resize_with_reschedule_then_live_migrate" [Undecided,New]07:44
*** belmoreira has joined #openstack-nova07:46
*** caisan_ has joined #openstack-nova07:47
*** yamamoto has quit IRC07:49
*** ralonsoh has joined #openstack-nova07:54
*** tssurya has joined #openstack-nova07:54
*** jpena|off is now known as jpena07:55
*** sree has joined #openstack-nova07:58
*** ktibi has joined #openstack-nova08:01
*** markvoelker has joined #openstack-nova08:01
*** tianhui_ has joined #openstack-nova08:03
*** tianhui has quit IRC08:05
*** takashin has left #openstack-nova08:05
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 2  https://review.openstack.org/56029908:06
*** sree has quit IRC08:08
*** zhurong has quit IRC08:08
*** trinaths has joined #openstack-nova08:09
*** lucas-afk is now known as lucasagomes08:11
*** pcaruana has joined #openstack-nova08:13
*** yamamoto has joined #openstack-nova08:13
*** yamamoto has quit IRC08:15
*** mdbooth has joined #openstack-nova08:16
*** belmoreira has quit IRC08:17
*** yamamoto has joined #openstack-nova08:19
*** mdnadeem has joined #openstack-nova08:20
*** belmoreira has joined #openstack-nova08:21
*** aloga_ has joined #openstack-nova08:22
*** ratailor has quit IRC08:24
*** ratailor has joined #openstack-nova08:27
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P):Get vgpu info from `allocations`  https://review.openstack.org/52171708:28
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 1  https://review.openstack.org/56029608:28
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support compute node resource provider update and create  https://review.openstack.org/52104108:28
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 2  https://review.openstack.org/56029908:34
*** annp has quit IRC08:35
*** madhaviy has quit IRC08:36
*** trinaths has quit IRC08:38
openstackgerritAndrey Volkov proposed openstack/osc-placement master: RP list: member_of and resources parameters (v1.3, v1.4)  https://review.openstack.org/51118308:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: RP delete inventories (v1.5)  https://review.openstack.org/51464208:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: CLI for traits (v1.6)  https://review.openstack.org/51464308:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Resource class set (v1.7)  https://review.openstack.org/51464408:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9)  https://review.openstack.org/51464608:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: CLI allocation candidates (v1.10)  https://review.openstack.org/51464708:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: New dict format of allocations (v1.11, v1.12)  https://review.openstack.org/54281908:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Transactionally update allocations (v1.13)  https://review.openstack.org/54667408:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Add nested resource providers (v1.14)  https://review.openstack.org/54667508:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Limit allocation candidates (v1.15, v1.16)  https://review.openstack.org/54804308:39
openstackgerritAndrey Volkov proposed openstack/osc-placement master: Allocation candidates parameter: required (v1.17)  https://review.openstack.org/54832608:39
*** derekh has joined #openstack-nova08:40
*** annp has joined #openstack-nova08:42
*** ratailor is now known as rtailor08:44
*** zhurong has joined #openstack-nova08:50
openstackgerritLei Zhang proposed openstack/nova master: Add method to get cpu traits  https://review.openstack.org/56031708:52
*** yamamoto has quit IRC08:54
*** madhaviy has joined #openstack-nova08:54
*** yamamoto has joined #openstack-nova08:56
*** yamamoto has quit IRC08:58
*** yamamoto has joined #openstack-nova08:58
*** stakeda has quit IRC08:59
*** ttsiouts has joined #openstack-nova09:00
*** licanwei has left #openstack-nova09:01
*** madhaviy has quit IRC09:03
*** madhaviy has joined #openstack-nova09:04
*** hiro-kobayashi has quit IRC09:05
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: Initial change set of z/VM driver  https://review.openstack.org/52338709:06
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: Spawn and destroy function of z/VM driver  https://review.openstack.org/52765809:06
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add snapshot function  https://review.openstack.org/53424009:06
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add power actions  https://review.openstack.org/54334009:06
openstackgerritjichenjc proposed openstack/nova master: z/VM Driver: add get console output  https://review.openstack.org/54334409:06
*** tuanla____ has quit IRC09:14
*** phuongnh has quit IRC09:14
*** tiendc has quit IRC09:14
*** phuongnh has joined #openstack-nova09:15
*** tuanla____ has joined #openstack-nova09:15
*** tiendc has joined #openstack-nova09:15
*** lpetrut has joined #openstack-nova09:16
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 1  https://review.openstack.org/56029609:19
*** aloga_ has quit IRC09:20
*** Dinesh__Bhor has quit IRC09:24
*** gjayavelu has quit IRC09:35
kashyapmdbooth: Hi, would you happen to have a minute to debug a unit test failure that's driving me nuts?09:38
kashyapmdbooth: That's the one: http://paste.openstack.org/show/718887/09:39
*** dpawlik has quit IRC09:39
mdboothkashyap: Not this morning I'm afraid09:39
kashyapmdbooth: Ah, no problem.09:39
* kashyap is stepping through PDB, disregard me09:39
*** cdent has joined #openstack-nova09:40
*** tuanla____ has quit IRC09:40
*** annp has quit IRC09:40
*** dpawlik has joined #openstack-nova09:40
*** tuanla____ has joined #openstack-nova09:40
*** annp has joined #openstack-nova09:40
mdboothkashyap: Without any kind of in depth look, and assuming you're just seeing teeth-gnashing weirdness, I suggest either:09:43
mdbooth* You're not mocking what you think you're mocking09:43
*** yamamoto has quit IRC09:43
mdbooth* self._host.has_min_version returns something disgustingly pythonic with obtuse notions of true and false09:43
*** yamamoto has joined #openstack-nova09:44
*** AlexeyAbashkin has quit IRC09:44
*** mgoddard has quit IRC09:44
kashyapmdbooth: I think it's the former; the "mock" thing.09:45
kashyapI ran through PDB, and both: libvirt_driver.MIN_VIRTUOZZO_VERSION (from the test) and the MIN_VIRTUOZZO_VERSION from driver.py print the same version09:45
kashyapAnyway; thanks for the look.09:47
*** alexchadin has quit IRC09:47
*** alexchadin has joined #openstack-nova09:48
*** alexchadin has quit IRC09:48
openstackgerritYikun Jiang (Kero) proposed openstack/nova master: Add microversion to support extra_specs in flavor API.  https://review.openstack.org/55415909:48
*** alexchadin has joined #openstack-nova09:49
*** alexchadin has quit IRC09:49
mdboothkashyap: You're mocking driver._conn btw09:49
mdboothBut the test uses driver._host09:49
mdbooths/test/code/09:49
* kashyap looks09:49
*** alexchadin has joined #openstack-nova09:50
*** alexchadin has quit IRC09:50
*** alexchadin has joined #openstack-nova09:50
*** sahid has quit IRC09:50
*** alexchadin has quit IRC09:51
*** alexchadin has joined #openstack-nova09:51
mdboothkashyap: Unfortunately your problem is vastly more interesting than what I'm actually supposed to be doing.09:51
*** alexchadin has quit IRC09:51
* mdbooth tries to ignore it09:51
kashyap:-)09:51
*** alexchadin has joined #openstack-nova09:52
* kashyap is trying to fix the unit test fallout of bumping versions09:52
openstackgerritZhenyu Zheng proposed openstack/nova master: Deduplicate notification samples Rocky - 2  https://review.openstack.org/56029909:52
mdboothkashyap: Don't assume that the previous unit test was correct. It may have worked only by coincidence. This isn't uncommon.09:53
kashyapThis doesn't fly either:09:54
kashyap+        with mock.patch.object(driver.init_host, 'getVersion') \09:54
kashyap+        as mock_getver:09:54
kashyapmdbooth: Sigh, yeah, I recall johnthetubaguy saying our MIN_VERSIONS testing has been a "joke"09:54
mdboothdriver.init_host is a function09:54
mdboothThat doesn't really make sense09:54
* kashyap tries to stop being stupid09:55
mdboothIf you look at Host.has_min_version09:55
mdboothSee that _version_check gets version from conn.getLibVersion09:56
kashyapAah, I remove that:09:56
mdboothWhere conn is returned by Host.get_connection()09:56
*** alexchadin has quit IRC09:56
*** tetsuro has quit IRC09:57
* kashyap looks closer09:57
mdboothYou need the return value of Host.get_connection() to return an object whose getLibVersion() method returns your test value09:58
mdboothYou can do that with Mock09:58
mdboothI wonder if you can also do it with FakeVirtAPI09:59
kashyap(Hmm, yeah: host.has_min_version --> _version_check --> getLibVersion)09:59
kashyapmdbooth: Yeah, if we can do it with the FakeVirtAPI, shouldn't I go that route, instead?09:59
mdboothIt looks like you can just mock fakelibvirt.FAKE_LIBVIRT_VERSION10:00
mdboothAnd it will do what you want10:00
* mdbooth gets back to work10:00
kashyapmdbooth: NOte that we'd like to check: MIN_VIRTUOZZO_VERSION is OK.10:00
kashyapBut thanks for the walk through10:00
kashyapHey, this is also "work", but yeah, "someone else's work", though :P10:01
mdbooth^^^ is how to change the value it's testing against10:01
kashyapmdbooth: Noted; will play a bit more and see where I arrive10:02
*** mgoddard has joined #openstack-nova10:02
*** tuanla____ has quit IRC10:03
*** phuongnh has quit IRC10:03
*** tuanla____ has joined #openstack-nova10:03
*** phuongnh has joined #openstack-nova10:04
*** sree has joined #openstack-nova10:05
openstackgerritChen Hanxiao proposed openstack/nova master: trivial: fix a comment typo  https://review.openstack.org/56034910:08
*** tiendc has quit IRC10:09
*** sree has quit IRC10:09
*** tiendc has joined #openstack-nova10:10
openstackgerritStephen Finucane proposed openstack/os-vif master: Add lower-constraints job  https://review.openstack.org/55605610:11
*** tuanla____ has quit IRC10:14
*** annp has quit IRC10:14
*** tuanla____ has joined #openstack-nova10:14
*** annp has joined #openstack-nova10:15
*** sree has joined #openstack-nova10:15
*** haha1 has joined #openstack-nova10:16
*** alexchadin has joined #openstack-nova10:23
*** rajinir has quit IRC10:25
*** lpetrut has quit IRC10:27
*** lpetrut has joined #openstack-nova10:30
kashyapmdbooth: Thanks for the idea!  It seemed to have worked.10:32
*** caisan_ has quit IRC10:35
*** armaan has quit IRC10:36
*** annp has quit IRC10:36
*** armaan has joined #openstack-nova10:36
*** nicolasbock has joined #openstack-nova10:37
*** abhishekk has quit IRC10:38
*** haha1 has quit IRC10:39
*** haha1 has joined #openstack-nova10:39
*** AlexeyAbashkin has joined #openstack-nova10:40
*** madhaviy has quit IRC10:43
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: Support live migration in pooled multi-nodes environment  https://review.openstack.org/48945110:44
*** madhaviy has joined #openstack-nova10:44
*** moshele has joined #openstack-nova10:45
*** alexchadin has quit IRC10:45
*** ccamacho has quit IRC10:46
*** ccamacho has joined #openstack-nova10:48
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION for "Rocky"  https://review.openstack.org/55878310:50
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_{LIBVIRT_KVM,QEMU}_S390_VERSION  https://review.openstack.org/56036310:50
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_KVM_PPC64_VERSION  https://review.openstack.org/56036410:50
openstackgerritKashyap Chamarthy proposed openstack/nova master: libvirt: Drop MIN_LIBVIRT_VIRTUOZZO_VERSION  https://review.openstack.org/56036510:50
*** alexchadin has joined #openstack-nova10:50
*** dougshelley66 has joined #openstack-nova10:52
*** sdague has joined #openstack-nova10:58
*** phuongnh has quit IRC11:02
*** madhaviy has quit IRC11:03
*** alexchadin has quit IRC11:03
*** madhaviy has joined #openstack-nova11:04
*** tuanla____ has quit IRC11:05
openstackgerritMerged openstack/nova master: make metadata doc up to date  https://review.openstack.org/55961311:10
openstackgerritMerged openstack/nova master: Log a more useful error when neutron isn't configured  https://review.openstack.org/55911111:10
openstackgerritMerged openstack/nova master: doc: add a link in the install guides about configuring neutron  https://review.openstack.org/55911511:10
openstackgerritMerged openstack/nova master: Log a more useful error when cinder auth isn't configured  https://review.openstack.org/55939911:11
*** xinliang has quit IRC11:11
openstackgerritMerged openstack/nova master: Move test_report_client out of placement namespace  https://review.openstack.org/55891111:11
openstackgerritMerged openstack/nova master: Update the Cell filters section of the scheduler docs  https://review.openstack.org/55910811:11
*** dpawlik_ has joined #openstack-nova11:13
*** dpawlik has quit IRC11:13
*** yamamoto has quit IRC11:18
*** sahid has joined #openstack-nova11:21
*** xinliang has joined #openstack-nova11:22
*** yamamoto has joined #openstack-nova11:25
*** sahid has quit IRC11:26
*** sahid has joined #openstack-nova11:28
*** sambetts_ is now known as sambetts11:28
*** yamamoto has quit IRC11:30
*** madhaviy has quit IRC11:33
*** yamamoto has joined #openstack-nova11:34
*** tbachman has quit IRC11:35
*** mdbooth has quit IRC11:37
*** dougshel_ has joined #openstack-nova11:38
*** armaan has quit IRC11:39
*** yamamoto has quit IRC11:39
*** armaan has joined #openstack-nova11:39
*** dougshelley66 has quit IRC11:41
*** tbachman has joined #openstack-nova11:43
*** jpena is now known as jpena|lunch11:46
*** tbachman has quit IRC11:47
*** QianYu has joined #openstack-nova11:51
*** QianYu_ has joined #openstack-nova11:54
*** QianYu has quit IRC11:54
*** madhaviy has joined #openstack-nova12:01
*** amoralej is now known as amoralej|lunch12:01
*** QianYu_ has quit IRC12:02
*** edmondsw has joined #openstack-nova12:08
*** QianYu has joined #openstack-nova12:10
*** QianYu has quit IRC12:12
*** liverpooler has joined #openstack-nova12:12
*** odyssey4me has quit IRC12:14
*** odyssey4me has joined #openstack-nova12:14
*** alexchadin has joined #openstack-nova12:15
*** QianYu has joined #openstack-nova12:16
*** QianYu has quit IRC12:16
*** yamamoto has joined #openstack-nova12:21
*** sean-k-mooney has joined #openstack-nova12:23
*** yamamoto has quit IRC12:25
*** AlexeyAbashkin has quit IRC12:25
*** dougshelley66 has joined #openstack-nova12:25
*** AlexeyAbashkin has joined #openstack-nova12:25
*** gcb has quit IRC12:27
*** AlexeyAbashkin has quit IRC12:30
efriedmikal: Are you satisfied with the response/rework at https://review.openstack.org/#/c/527658/31/nova/virt/zvm/configdrive.py@44 ?12:31
efriedIt looks to me like the (guest) format is indeed iso9660, which I think is what you wanted to make sure of.12:31
*** yamamoto has joined #openstack-nova12:34
*** AlexeyAbashkin has joined #openstack-nova12:34
*** madhaviy has quit IRC12:35
*** dave-mccowan has joined #openstack-nova12:35
*** mdbooth has joined #openstack-nova12:37
*** liverpooler has quit IRC12:37
*** liverpooler has joined #openstack-nova12:37
*** burt has joined #openstack-nova12:40
*** tiendc has quit IRC12:40
*** mvk has quit IRC12:40
*** hshiina is now known as hshiina|afk12:41
*** tbachman has joined #openstack-nova12:43
*** vladikr has joined #openstack-nova12:45
*** tbachman_ has joined #openstack-nova12:46
*** tbachman has quit IRC12:47
*** tbachman_ is now known as tbachman12:47
*** READ10 has joined #openstack-nova12:49
*** dpawlik_ has quit IRC12:50
jichenefried: thanks for raising this question to mikal, yes, as mentioned in the patch, we use tgz as is09660 and consume it later by mounting it to VM as iso9660 format before cloud-init take action12:50
*** jpena|lunch is now known as jpena12:50
*** _ix has joined #openstack-nova12:53
*** dpawlik has joined #openstack-nova12:53
*** pchavva has joined #openstack-nova12:54
*** salv-orl_ has quit IRC12:54
*** felipemonteiro has joined #openstack-nova12:54
*** ccamacho is now known as ccamacho|lunch12:57
*** tbachman_ has joined #openstack-nova12:57
*** dpawlik has quit IRC12:57
*** armaan has quit IRC12:58
*** lyan has joined #openstack-nova12:58
*** lyan is now known as Guest2564812:58
*** armaan has joined #openstack-nova12:58
*** jaypipes has joined #openstack-nova12:59
*** tbachman has quit IRC12:59
*** tbachman_ is now known as tbachman12:59
*** amoralej|lunch is now known as amoralej13:01
*** armaan has quit IRC13:03
openstackgerritMerged openstack/nova master: Cleanup tempest-dsvm-cells-rc blacklist  https://review.openstack.org/55340113:05
*** psachin has quit IRC13:05
*** mriedem has joined #openstack-nova13:06
*** felipemonteiro_ has joined #openstack-nova13:07
*** rtailor has quit IRC13:07
*** _ix has quit IRC13:09
*** felipemonteiro has quit IRC13:10
*** _ix has joined #openstack-nova13:11
*** mvk has joined #openstack-nova13:11
openstackgerritMerged openstack/nova master: Cleanup _get_request_spec_for_select_destinations for live migrate  https://review.openstack.org/55938113:15
*** felipemonteiro_ has quit IRC13:15
*** felipemonteiro__ has joined #openstack-nova13:15
*** _ix has quit IRC13:16
*** _ix has joined #openstack-nova13:16
*** READ10 has quit IRC13:16
*** maciejjozefczyk has joined #openstack-nova13:17
*** jbernard has quit IRC13:18
*** caisan has joined #openstack-nova13:20
*** READ10 has joined #openstack-nova13:21
*** jbernard has joined #openstack-nova13:23
openstackgerritZhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware  https://review.openstack.org/50748613:24
*** dpawlik has joined #openstack-nova13:25
*** dillaman has joined #openstack-nova13:26
*** maciejjozefczyk has quit IRC13:26
*** _ix has quit IRC13:29
*** sidx64 has quit IRC13:30
*** gcb has joined #openstack-nova13:33
*** esberglu has joined #openstack-nova13:35
*** sidx64 has joined #openstack-nova13:35
openstackgerritjichenjc proposed openstack/nova master: uncap eventlet in nova  https://review.openstack.org/56042013:36
bhagyashrisjaypipes: Hi,13:41
*** david-lyle has joined #openstack-nova13:41
mriedemsahid: are you also working on the metadata api changes for https://review.openstack.org/#/q/topic:bp/sriov-trusted-vfs+(status:open+OR+status:merged) ? i don't want to merge too much of that series before the metadata api patch is up13:41
jichenmriedem: not sure https://review.openstack.org/560420 is the right way to do ... but my previous zvm patches failed due to requirement.txt . or we need wait for the automatic process of requirements update?13:42
mriedemjichen: i didn't think there was an automated reqs update anymore13:44
mriedemi haven't tried to follow that thread13:44
*** alexchadin has quit IRC13:44
sahidmriedem: i'm a bit under pressure with the specs i have to work on and my downstream work... I need to build an on a SRIOV to test what you have indicated on the review then I will work on the metadata thing13:44
sahidbut yes it's my plan13:44
mriedemsahid: ok thanks13:44
jichenmriedem: ok , I don't have too much background on that stuff, anyway, I followed their patch and updated nova accordingly13:45
jichenhopefully anyone can take a look13:45
*** dklyle has quit IRC13:45
mriedemjichen: https://review.openstack.org/#/c/559367/ is merged13:46
mriedemso it seems we don't need this in nova?13:46
*** hongbin has joined #openstack-nova13:47
jichenmriedem , no , I guess that's the reason caused my issue http://logs.openstack.org/87/523387/32/check/requirements-check/408e28c/job-output.txt.gz, Doug replied in ML and say that's a correct error ...13:47
*** david-lyle has quit IRC13:47
*** zz9pzza has quit IRC13:48
jichenso I assume we need some changes but not too much experience here13:48
mriedemok that's a different change https://review.openstack.org/#/c/523387/13:48
*** madhaviy has joined #openstack-nova13:48
mriedemok i can try to sort this out, i know it's late for you13:48
jichenok, thank you for your help13:48
openstackgerritMerged openstack/nova master: libvirt: handle DiskNotFound during update_available_resource  https://review.openstack.org/55306713:50
openstackgerritMerged openstack/nova master: Update ImageMetaProp object to expose traits  https://review.openstack.org/55779513:50
jaypipesbhagyashris: did you need something?13:51
*** udesale has quit IRC13:51
*** armaan has joined #openstack-nova13:51
efriedmriedem: I noticed your reference to https://wiki.openstack.org/wiki/NovaAPIRef#Parameter_Verification in a patch.  I have to say I don't agree that the ordering (required=>optional=>by-microversion) should be strictly followed where it doesn't make sense.  For example, here https://review.openstack.org/#/c/517757/7/placement-api-ref/source/allocation_candidates.inc it makes more logical sense to order them this way.  If I13:52
efriedwould be after limits, the granulars would be after member_of... IMO it's better if it's in the most sensible logical order for users of the latest microversion.13:52
*** jichen has quit IRC13:53
bhagyashrisjaypipes: Jus want to inform few thing regarding the shared resource provider that we have discussed earlier, I have done some testing and analysis.13:53
bhagyashrisjaypipes: s/Jus/just13:54
*** felipemonteiro_ has joined #openstack-nova13:54
mriedemefried: you'll have to debate that with sdague13:54
mriedemi assume microversions come last in order because we are trying to write api ref docs for the lowest common denominator13:55
efriedmriedem: Maybe placement is different.13:55
mriedemplacement is always different13:55
*** ttx has quit IRC13:55
*** caisan has quit IRC13:55
efriedmriedem: I'm not necessarily suggesting action (like an edit of the guidelines).  Just something I noticed and wanted to get off my chest.13:56
efriedThanks for listening :)13:56
*** ttx has joined #openstack-nova13:57
*** tbachman has quit IRC13:57
bhagyashrisjaypipes: I have tested the scenario and here are the observation http://paste.openstack.org/show/718936/13:57
*** sdague has quit IRC13:57
*** tbachman has joined #openstack-nova13:58
*** links has quit IRC13:58
*** felipemonteiro__ has quit IRC13:58
efriedbhagyashris: Woot!  That looks just like it should!13:58
jaypipesefried: indeed, after commenting out the "compute node sets DISK_GB inventory item automatically" code.13:59
bhagyashrisefried, jaypipes: Based on the current analysis, it appears that compute node shouldn't report it's own resources in inventory if it's configured to use it from shared resource providers but currently, compute node doesn't have any mechanism to report selective resources in inventory.13:59
*** eharney has joined #openstack-nova14:00
*** udesale has joined #openstack-nova14:00
jaypipesbhagyashris: correct. the original idea was to use the aggregates information in the ProviderTree to determine whether to report "local disk" or not.14:00
openstackgerritSteve Noyes proposed openstack/nova master: Enables MySQL Cluster Support for Nova  https://review.openstack.org/44664314:00
jaypipesbhagyashris: efried can share some information with you about the aggregate tracking in the ProviderTree object14:00
efriedjaypipes: You're saying that if we find a sharing provider for a given RC, we should *remove* that RC from the compute node's inventory??14:01
jaypipesefried: I'm saying that was my original idea, yeah.14:01
bhagyashrisefried, jaypipes: There is a TODO note here : https://github.com/openstack/nova/blob/master/nova/scheduler/filter_scheduler.py#L212-L216 that the first allocation request object is use to claim resources14:01
jaypipes(that's why I originally added the aggregate tracking in the reportclient to begin with)14:01
efriedbhagyashris: jaypipes: Do we have any evidence that the virt driver actually *used* the shared storage to make the disk?14:02
*** jistr is now known as jistr|mtg14:02
jaypipesbhagyashris: yes, but that's more about the use case where we have both shared and local disk and can't decide which to consume from. what efried and I are discussing is how to signal to the compute node not to report local disk if it sees a sharing provider of disk.14:02
efriedor has that piece not been hooked up yet?14:02
bhagyashrisefried, jaypipes: yeah that is the best idea and that will not need to make any change at sch side14:02
*** ccamacho|lunch is now known as ccamacho14:02
jaypipesefried: well, that's an entirely different question :)14:02
efriedBut an important one, you'll agree.14:03
jaypipesefried: and I see no reason why it wouldn't.14:03
bhagyashrisjaypipes: yeah totally agree with you point14:03
efriedDoesn't do us much good to have the alloc come from the right place if the storage still comes from the wrong place.14:03
jaypipesefried: it's the same reason why pinning of CPU resources still works even though VCPU is tracked in placement.14:03
jaypipesefried: in other words, assignment != allocation14:03
efriedjaypipes: So you're saying that by virtue of whatever existing code recognized the flavor request as wanting the storage to come from shared... is still working.14:04
efriedI don't know what that mechanism is, but if that's the case... fine.14:04
jaypipesefried: don't confuse a request for 10TB of disk with block device configuration information.14:04
efriedah, the bdm somehow identifies the source of the disk space?14:05
*** caisan has joined #openstack-nova14:05
jaypipesefried: no. nothing really knows whether the source of the disk space is shared. it's just that /var/lib/instances is on mounted shared storage.14:05
jaypipesefried: that's pretty much the reason why shared storage resource accounting has been so wonky.14:06
efriedohh.14:06
efriedSo in this setup, there really *is* no local storage.14:06
jaypipesefried: there totally *could* be. no way to know other than manually commenting out that code right now.14:06
openstackgerritMerged openstack/nova master: Update wording in @safe_connect placement warnings  https://review.openstack.org/56003914:06
bhagyashrisjaypipes: yeah that way I have tested14:07
*** madhaviy has quit IRC14:07
jaypipesefried: for the record, we used to determine if "the node was on shared storage" by literally attempting to write a file from two different compute hosts to a single location and checking if each node could read it.14:07
jaypipesefried: IIRC, this was during live migration setup.14:08
efriedjaypipes: So here's where the virt driver would need to recognize whether the storage is shared or not, and if so, create* the sharing provider and put the DISK_GB inventory there instead of the compute node RP.14:08
efried(*create, co-create, make sure it exists, etc.)14:08
jaypipesefried: not sure if we still do that, but that's how it used to be.14:08
*** diga has joined #openstack-nova14:08
jaypipesefried: no, the idea was never to have a compute node create the sharing provider.14:08
efrieddon't focus on that bit.14:08
jaypipesefried: the admin would do that, since they know they are setting up shared storage for a set of nodes.14:09
efriedwell, okay; I'm also thinking about the PowerVM case, where we *do* want the driver to co-manage creation of the sharing provider.14:09
efriedbecause that would also be a non-hacky way to get rid of the compute node RP's DISK_GB inventory :)14:10
efriedBecause we can't just blindly remove it (outside of the virt driver) based on the presence of an aggregated provider of the same RC.14:10
jaypipesefried: I don't understand that last sentence.14:11
efriedWe may legitimately have both shared and local at the same time.  We may legitimately want the virt driver to do that management, etc.14:11
*** tbachman has quit IRC14:11
jaypipesefried: why would you want the virt driver on a single compute node managing disk resources for multiple compute nodes?14:11
efriedjaypipes: I'm just saying if we're going to fiddle with the compute RP's DISK_GB inventory based on existence of sharing DISK_GB providers, that logic needs to be fully owned by the virt driver.  We can't assume things outside of that scope.14:11
jaypipesefried: sure. the process of fiddling with any resources that are owned by that compute node (and its children) should of course be controlled by the virt driver.14:12
efriedjaypipes: In the PowerVM case, it's because we can; and because we can, it means we don't need any outside agent (human or code) manitaining that sharing RP.14:13
jaypipesefried: I don't agree that a single compute node should control inventory on shared disk providers, though.14:13
jaypipesefried: then powervm can do that I guess.14:13
jaypipesefried: obviously libvirt won't :)14:13
efriedIt won't be a single compute node; it'll all the compute nodes attached to that sharing provider.14:13
*** salv-orlando has joined #openstack-nova14:13
efriedco-managing the SSP.14:13
jaypipesefried: right, because it's a clustered hypervisor manager.14:13
efried...because they already co-manage the SSP (outside of the auspices of openstack)14:13
efriedyeah, that.14:14
jaypipesin any case...14:14
efriedSo anyway, I'm saying I'm on board with the idea if we state it like this:14:14
efriedBecause libvirt (somehow) knows that the storage it's looking at is shared, libvirt's impl of update_provider_tree shall remove the DISK_GB inventory from the compute node RP.14:15
efriedPerhaps the (somehow) is signalled by the operator having created the sharing provider and associated it via aggregate with the compute node.14:15
efriedlibvirt's u_p_t will look for that and, if found, nix the compute RP's DISK_GB inventory.14:16
efriedDoes that gel with your thinking?14:16
*** kholkina has quit IRC14:16
efriedzero part of this involves nova code outside of the libvirt driver.14:16
jaypipesefried: that is precisely my thinking, yes.14:17
*** cristicalin has joined #openstack-nova14:17
*** tbachman has joined #openstack-nova14:17
efriedjaypipes: Cool beans.  bhagyashris, are you on the hook for proposing that code?  I can help you understand how to make it work.14:18
bhagyashrisefried: ok means the CN RP DISK_GB inventory will be remove if the shared resource provider is configured14:19
efriedbhagyashris: Yes.  The part I was unclear on at first was that that would be done within the libvirt compute driver's implementation of update_provider_tree.14:19
*** jobewan has joined #openstack-nova14:19
efried...which I bet hasn't been proposed yet.14:20
mriedemfyi if you see test_resize_with_reschedule_then_live_migrate failing in functional tests, it's https://bugs.launchpad.net/nova/+bug/176287614:21
openstackLaunchpad bug 1762876 in OpenStack Compute (nova) "test_resize_with_reschedule_then_live_migrate intermittently failing; migration is not yet complete" [High,Confirmed] - Assigned to Matt Riedemann (mriedem)14:21
mriedemi'm working on a fix14:21
mriedemapparently the instance status goes to ACTIVE before the migration is completed14:22
bhagyashrisefried: ok. so for this is there any bp or bug reported? Actually i am not fully aware about update_provider_tree part but i will start to understand that part and will get to know14:24
bhagyashrisefried: I just tested few things and put my observations and analysis14:24
efriedbhagyashris: There's a blueprint around update_provider_tree.  It's substantially completed, and ready for virt drivers to start using it.14:25
openstackgerritStephen Finucane proposed openstack/nova master: Make NetworkAPI an abstract base class  https://review.openstack.org/56044014:25
openstackgerritEric Fried proposed openstack/nova master: Remove :return from update_provider_tree docstring  https://review.openstack.org/56044214:25
efriedjaypipes: Fast approve-worthy ^14:25
jaypipesefried: done14:27
efriedjaypipes: Thanks.  Not sure how I missed that.14:27
jaypipesefried: you didn't. I did.14:27
efried:)14:28
*** mlavalle has joined #openstack-nova14:30
openstackgerritEric Fried proposed openstack/nova master: WIP: libvirt: get_inventory => update_provider_tree  https://review.openstack.org/56044414:30
efriedjaypipes, bhagyashris: ^14:30
efriedThat would go under 'co-authorship candidate' in our fancy etherpad, cause I don't know from libvirt.14:31
efriedBut now it can be used as the basis for what we discussed above.14:31
*** tianhui_ has quit IRC14:32
*** tianhui has joined #openstack-nova14:33
*** vladikr has quit IRC14:33
mriedemgibi_awa1: my wedding gift to you is going to be bugs to discuss during the notifications meeting :) https://wiki.openstack.org/wiki/Meetings/NovaNotification#Agenda14:33
*** itlinux has quit IRC14:34
*** vladikr has joined #openstack-nova14:34
*** dklyle has joined #openstack-nova14:35
*** dklyle has quit IRC14:36
*** david-lyle has joined #openstack-nova14:36
*** hemna_ has joined #openstack-nova14:39
*** amodi has joined #openstack-nova14:44
openstackgerritMatt Riedemann proposed openstack/nova master: Fix race fail in test_resize_with_reschedule_then_live_migrate  https://review.openstack.org/56045414:45
mriedemdansmith: efried: ^ fixes a regression i introduced14:45
openstackgerritsahid proposed openstack/nova master: libvirt: add support for virtio-net rx/tx queue sizes  https://review.openstack.org/48499714:47
openstackgerritsahid proposed openstack/nova master: libvirt: move version to string in utils  https://review.openstack.org/56045514:47
openstackgerritsahid proposed openstack/nova master: libvirt: refactor get_base_config to accept host arg  https://review.openstack.org/56045614:47
efriedmriedem: Reviewed.14:47
*** sdague has joined #openstack-nova14:47
*** dklyle has joined #openstack-nova14:47
*** david-lyle has quit IRC14:47
*** evin has quit IRC14:47
mriedemthanks14:48
efriedbhagyashris, jaypipes: Is there a bug for the double-reporting of DISK_GB?14:48
bhagyashrisefried: Don't know exactly. I have just fetch your patch https://review.openstack.org/560444 and checked inventory table records14:50
*** felipemonteiro_ has quit IRC14:50
efriedbhagyashris: Oh - does it work??14:50
*** felipemonteiro_ has joined #openstack-nova14:50
bhagyashrisefried: but still it showing the DISK_GB record in inventory table as i  configured the shared resource provider14:51
efriedbhagyashris: Yup, that's expected.  The above patch should have been a straight swap.14:51
efriedbhagyashris: But this one....14:51
openstackgerritEric Fried proposed openstack/nova master: WIP: libvirt: Don't report DISK_GB if sharing  https://review.openstack.org/56045914:51
efriedjaypipes:  bhagyashris ^14:51
*** rajinir has joined #openstack-nova14:51
efried...should do the thing we were talking about.14:51
efriedbhagyashris: Since you seem to be set up to try this easily,  would you mind...?14:51
openstackgerritMerged openstack/nova master: api-ref: Parameter verification for servers.inc (2/3)  https://review.openstack.org/55064814:51
openstackgerritMerged openstack/nova master: api-ref: Parameter verification for servers.inc (3/3)  https://review.openstack.org/55065914:55
*** moshele has quit IRC14:55
*** markvoelker has quit IRC14:55
*** markvoelker has joined #openstack-nova14:56
bhagyashrisefried: so it's not working so don't know why it's not14:56
*** Eran_Kuris has quit IRC14:56
bhagyashris efried: let me check with this patch change https://review.openstack.org/56045914:57
*** zz9pzza has joined #openstack-nova14:58
openstackgerritMerged openstack/nova master: api-ref: Fix parameter order in rebuild  https://review.openstack.org/52971814:58
*** markvoelker has quit IRC15:00
*** _ix has joined #openstack-nova15:01
*** armaan has quit IRC15:08
*** Guest25648 has quit IRC15:08
*** Guest25648 has joined #openstack-nova15:08
*** ratailor has joined #openstack-nova15:08
*** armaan has joined #openstack-nova15:09
*** jistr|mtg is now known as jistr15:10
bhagyashrisefried: we will need to use that update_provider_tree() method in https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L89015:11
*** germs has joined #openstack-nova15:11
*** germs has quit IRC15:11
*** germs has joined #openstack-nova15:11
efriedbhagyashris: Yup, see https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L88115:11
bhagyashrisefried: so that it will get the proper inv_data and will update here https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L89215:11
efriedbhagyashris: Is it not getting invoked?15:12
efried(Did you remember to restart your compute service?  :)15:12
bhagyashrisyes i restart n-cpu15:13
*** Spazmotic1 has joined #openstack-nova15:13
bhagyashrisbut it's giving problem in second patch now that the provider_tree has no attribute data15:14
efriedbhagyashris: Well, there *is* no get_inventory in the libvirt driver anymore, so if you're seeing inventory at all, it must have come from here.15:14
efriedbhagyashris: I didn't run any of this code, even in a unit test context, so I very well may have effed something up.  Are you seeing an exception?15:15
*** germs has quit IRC15:16
bauzasefried: jaypipes: thanks for the early reviews of https://review.openstack.org/#/c/552924/715:16
bauzasefried: jaypipes: I think I need to understand more how numbered request groups would work15:17
*** Spaz-Home has quit IRC15:17
bhagyashrisefried: I saw this exception at n-cpu Apr 11 20:46:08 openstack-VirtualBox nova-compute[5703]: ERROR nova.compute.manager [None req-b17184a8-7d31-4c3d-9b8b-d1f1ddb6860e None None] Error updating resources for node openstack-VirtualBox.: AttributeError: 'ProviderData' object has no attribute 'data'15:17
bhagyashrisApr 11 20:46:08 openstack-VirtualBox nova-compute[5703]: ERROR nova.compute.manager Traceback (most recent call last):15:17
bhagyashrisApr 11 20:46:08 openstack-VirtualBox nova-compute[5703]: ERROR nova.compute.manager   File "/opt/stack/nova/nova/compute/manager.py", line 7311, in update_available_resource_for_node15:17
bhagyashrisApr 11 20:46:08 openstack-VirtualBox nova-compute[5703]: ERROR nova.compute.manager     rt.update_available_resource(context, nodename)15:17
efriedbhagyashris: okay, fixing...15:17
*** germs has joined #openstack-nova15:17
*** germs has quit IRC15:17
*** germs has joined #openstack-nova15:17
efriedwhoops, that was a flub15:17
openstackgerritEric Fried proposed openstack/nova master: WIP: libvirt: Don't report DISK_GB if sharing  https://review.openstack.org/56045915:18
efriedbhagyashris: ^15:18
efriedbauzas: Have you memorized the granular spec?15:20
bauzasefried: tbh, I need to look at it again15:20
openstackgerritMatt Riedemann proposed openstack/nova master: RT: replace _instance_in_resize_state with _is_trackable_migration  https://review.openstack.org/56046715:21
mriedemthis was a fun bit of history ^15:21
efriedbauzas: Numbered request groups work like this:15:21
efriedResources specified *within* a single numbered request group are *guaranteed* to land on the *same* provider.15:21
efriedResources specified in *different* numbered request groups may or may not land on same/different providers.15:21
bauzasefried: I thought asking resources1:STH=1&resources2:STH_ELSE=2 would make those two things on separate RPs15:21
efriedbauzas: That has been a source of confusion, but no.15:21
bauzasok, that's the second assumption I made15:21
bauzasI made wrong15:22
bauzasbut may or may not is not really a big deal to me15:22
efriedbauzas: We will eventually need that semantic - and "deliberate sharding" would be a use case driving it - but we don't have it with the spec as currently written.15:22
bauzasthe first assumption is crucial to me15:22
bauzasthe second one (different groups leading or not on same RP) is not really important to me15:22
bauzaswhat I want is affinity, not anti-affinity15:23
*** evin has joined #openstack-nova15:23
efriedbauzas: Perfect.15:23
efriedbauzas: In case you missed it, I summarized four use cases and what we can/can't do about them.  It's at the top part of my review.15:23
bauzaseither customers care about NUMA specifics and then numbered req groups is the perfect answer15:23
bauzasor, they don't care about NUMA specifics, and then they don't care where the resources land15:23
efried(I know sometimes those don't get seen because folks dive right into the comments within the file)15:23
*** belmoreira has quit IRC15:23
efriedbauzas: Good15:24
bauzasefried: I saw your top-level comment, yup15:24
bauzasthanks for that, appreciated15:24
*** andreas_s has quit IRC15:24
bauzasI sometimes do that to justify a -115:24
bauzaswhen for example there are 30 comments but only one means -1 to me15:24
efriedbauzas: So the use case you *don't* care about is my third bullet.15:24
*** andreas_s has joined #openstack-nova15:24
bauzascorrect15:25
bauzasefried: I gave one example of NUMA affinity for vGPUs15:25
bauzashttps://devblogs.nvidia.com/performance-portability-gpus-cpus-openacc/15:25
bauzasefried: just for your context understanding ^15:25
kashyapmriedem: When you get a moment, a small update on this: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bump_min_libvirt_and_qemu15:25
efriedbauzas: Right; that's my second bullet.  If that's a critical use case, then we need to invent something more.15:25
kashyapmriedem: There's about 14 patches that I need to queue in that drop the compat code.  Right now there are only 415:25
efriedbauzas: Concept of "same subtree"15:26
kashyapmriedem: I am resolving broken tests as I find them.  4 more to go (that are bit more involved, noted them here: https://review.openstack.org/#/c/558783/7)15:26
kashyapmriedem: Finally, a question on unit tests for you here: https://review.openstack.org/#/c/560365/15:26
bauzasefried: why ?15:26
bauzasefried: VGPU is a standard class15:26
bauzaslike VCPU and MEMORY_MB15:27
efriedBecause VGPU and VCPU are in different resource providers.15:27
efriedbauzas: So you can't put them in the same numbered request group.15:27
bauzasefried: that will depend on the operator15:27
kashyapmriedem: Also, I can understand if you are of the view of: "I won't touch them until Zuul is +1 on them, and you've dropped all no-more-relevant compat code" :-)15:27
efriedbauzas: And if you put them in different request groups, they aren't guaranteed to land on the same NUMA node.15:27
bhagyashrisefried: it's working now :)15:27
efriedbhagyashris: Like, fully working?  Like the DISK_GB is being reported by the sharing provider and not by the compute node provider?15:28
bauzasefried: but if they want NUMA affinity for VGPUs, then the doc will say : enable the conf opt saying "I want VCPU and VGPU to be NUMA specific"15:28
bauzasefried: in that case, they will be on the same RP15:28
bauzasefried: which will make the thing work15:28
mriedemkashyap: i'd prefer to not dig into those until tests are passing15:28
bauzasefried: we could later add a new param that specifically request the notion of the "subtree" parenting, but I leave that out of that spec then15:29
efriedbauzas: It would.  But saying that the VGPU inventory has to be on the same RP as the VCPU inventory - that's not a restriction that's going to remain viable for very long.15:29
kashyapmriedem: Sure, that's perfectly fine.  I will be able to full spend time on it only from Friday afternoon onwards.15:29
bauzasefried: sure, but I don't want to boil the ocean and keep the NUMA spec minimalist15:29
bhagyashrisefried: yes it removes the CN RP DISK_GB inventory from inventory table and now it's reporting the resource against the CN and shared RP :)15:29
efriedbhagyashris: WOHOO!  jaypipes ^^15:29
bauzasefried: I can leave a note explaining the caveat, and someone in the future (possibly being me) could write another spec describing the problem and the solution15:30
efriedbauzas: Okay, then the spec needs to state that restriction, for sure, cause that's significant.15:30
bauzasefried: that's correct, I'll amend the spec accordingly and explicitely state the limitation, exactly like I did for huge pages15:30
bauzasefried: thanks for your help!15:30
bhagyashrisefried: thanks for your inputs :) Now it's EOD for me leaving...15:31
efriedbauzas: TBC: the restriction means that the ascii diagram you've shown on L125 (where the VGPU and VF inventories are separated from the VCPU/PCUP/MEMORY_MB) will *not* work.15:31
*** sridharg has quit IRC15:31
bauzasthat's right, I need to amend the diagram too15:31
efriedbauzas: Cool cool.15:31
*** ratailor has quit IRC15:31
efriedbhagyashris: Thank you very much for working this.15:31
*** rodolof has quit IRC15:32
efriedjaypipes: To summarize, bhagyashris validated that these two patches DTRT wrt sharing DISK_GB for libvirt: https://review.openstack.org/560444 https://review.openstack.org/56045915:32
jaypipesefried: DTRT?15:33
jaypipesdo the right thign?15:33
efriedyes15:33
jaypipesyou kids...15:33
*** yamahata has quit IRC15:33
jaypipesefried, bhagyashris: ok, cool. that's kind of exactly what I expected. :)15:33
*** lpetrut_ has joined #openstack-nova15:34
efriedjaypipes: Now somebody ought to finish up the tests on those patches and put 'em to bed.15:35
*** lpetrut has quit IRC15:36
*** andreas_s has quit IRC15:38
*** zhaochao has quit IRC15:38
*** edmondsw has quit IRC15:39
*** idlemind has quit IRC15:41
*** idlemind has joined #openstack-nova15:42
jaypipesbauzas: you realize that https://devblogs.nvidia.com/performance-portability-gpus-cpus-openacc/ is not talking about CPU and GPU sharing memory, right?15:42
bauzasright15:42
bauzasit's about portability15:43
*** andreas_s has joined #openstack-nova15:43
bauzasmemory isn't shared on a SOC for a nvidia card15:43
bauzasso you're right, that's a separate memory map15:43
*** r-daneel has quit IRC15:44
jaypipesbauzas: you wrote "I have many internal customers that are actually very interested in having NUMA affinity for having the GPU memory close as possible to the NUMA memory controller used by the virtual CPU" <-- that is just not the case.15:44
jaypipesbauzas: either that, or your internal customers don't actually know what they're asking for.15:45
bauzasjaypipes: I can certainly ask them for clarification about their needs15:45
jaypipesbauzas: in any case, that wasn't the reason for the -1 :) was just mentioning the use case could have been tighter.15:46
openstackgerritMatt Riedemann proposed openstack/nova master: Remove RequestContext.instance_lock_checked  https://review.openstack.org/55437815:46
bauzasjaypipes: yeah, no worries, I got it15:47
bauzasjaypipes: and tbh, I appreciate you challenging me on the need15:47
bauzasbecause it helps me understand why my customers are pushing for it15:47
bauzasinstead of just be a typey typey box15:48
*** suresh12 has joined #openstack-nova15:48
jaypipesbauzas: yeah, the checkboxy thing is a big problem.15:49
*** itlinux has joined #openstack-nova15:50
*** moshele has joined #openstack-nova15:53
*** ragiman has quit IRC15:54
mriedemmikal: i'm sure this pains you, but apparently the nova-net refactoring broke nova-lxd https://review.openstack.org/#/c/559190/ which apparently also broke openstack-ansible https://review.openstack.org/#/c/559354/15:55
*** suresh12 has quit IRC15:55
mriedem:(15:55
*** hamzy has quit IRC15:55
*** gyee has joined #openstack-nova15:56
jaypipestssurya: you need any assistance on writing the func test asked for by dansmith on https://review.openstack.org/#/c/554920/?15:57
melwittdansmith: for the runways end dates, were you thinking they include the end date? that is, would we remove things *on* the end date or the day after? I was thinking the day after15:57
*** caisan has quit IRC15:57
tssuryajaypipes: I have been working on it for sometime with not much luck15:57
*** andreas_s has quit IRC15:57
dansmithmelwitt: shrug, probably EOD on the day yeah15:58
dansmithwhich is today I know15:58
jaypipestssurya: feel free to push what you've got and I can help out.15:58
tssuryajaypipes : so if you have some time, help appreciated15:58
jaypipesnp15:58
melwittdansmith: yeah, okay. I was thinking similar, that the end date should include that day. I'll move things after EOD15:58
dansmithmelwitt: your EOD is pretty late, so I think that'll work nice15:58
melwittagreed15:59
*** lucasagomes is now known as lucas-afk15:59
*** patriciadomin has quit IRC16:00
*** patriciadomin has joined #openstack-nova16:01
*** yamahata has joined #openstack-nova16:05
*** cristicalin has quit IRC16:05
*** ktibi has quit IRC16:05
*** harlowja has joined #openstack-nova16:05
*** fragatina has quit IRC16:05
*** fragatina has joined #openstack-nova16:06
mriedemooo i broke nova-lxd too https://review.openstack.org/#/q/I751fcb7532679905c4279744919c6cce84a11eb416:09
mriedemodyssey4me: that's awesome that nova can unwittingly break nova-lxd and other out of tree virt drivers, which then in turn breaks OSA16:10
mriedemodyssey4me: i'm sort of surprised that OSA's voting jobs don't exclude out of tree drivers16:11
sean-k-mooneymriedem: isnt there a thirdpart ci for nova-lxd16:11
mriedemsean-k-mooney: no, nova-lxd is not in tree16:11
sean-k-mooneymriedem: yes but i would have expected there to be a non gating thrid party ci to test it even when its out of tree16:12
*** andreas_s has joined #openstack-nova16:12
*** armaan has quit IRC16:12
mriedemwhy would we care?16:12
*** armaan has joined #openstack-nova16:12
mriedemif you're out of tree, you're out of tree, and we don't block in-tree changes because of that16:12
mriedembest we do at times is put something in the ML as a heads up for known internal interface changes16:12
bauzasthat remembers me some pg discussion...16:14
sean-k-mooneynot run by nova run by the maintiners of nova-lxd e.g. canonical16:14
bauzaswhich I think we cleary made the statement that non-supported things for a project are potentially subject to break16:15
mriedembauzas: we have jobs we can run for pg testing if we ant16:15
mriedem*want16:15
bauzashence other projects gating on that project shouldn't really support that too16:15
sean-k-mooneymriedem: oh im not expecting nova to block in tree change i just expcting that nova-lxd team could benifit form know that its broken16:15
*** damien_r has quit IRC16:15
mriedemthere is a neutron job in the experimental queue that runs with pg16:15
mriedemsean-k-mooney: nova-lxd team can listen on nova changes, run jobs and post results for failures somewhere if they want to detect them early16:16
bauzasmriedem: I'm not saying it's impossible16:17
bauzasmriedem: just that we broke ceilometer once16:17
bauzasbecause ceilo was gating something we don't test16:17
mriedemsure, i'm sure ceilometer broke us once indirectly too when they were part of tempest, 3 years ago16:17
bauzasand the result was like a best-effort fix and a summit discussion that led to "come and help us make pg first-grade if your production runs on something we don't test"16:18
mriedemthere is nothing 2nd grade about pg wrt nova16:18
bauzasI think we're diverting anyway16:18
*** mgoddard has quit IRC16:19
bauzasI just tried to explain that I feel you shouldn't blame yourself for breaking ansible if they gate on something we don't test16:19
dansmithmriedem: this seems like a legit "stop the bleeding" patch for stable.. I saw you reviewed it once, but.. are you cool with it? https://review.openstack.org/#/c/54356916:19
bauzaswe can certainly fix that tho16:19
mriedembauzas: i don't really blame myself :)16:19
sahidmriedem: if you have a moment that one looks ready and important enough for some use-cases https://review.openstack.org/#/c/553072/16:19
mriedemsucks for odyssey4me though16:19
mriedemjesus, did the red hat team bug meeting just end?16:20
bauzasmriedem: I agree, and that requires a fix16:20
bauzasmriedem: nah, not bugs16:20
bauzasbut yes, meeting ended16:20
*** Eran_Kuris has joined #openstack-nova16:21
mriedemdansmith: i've just been putting off going through it again because it's hairy on stable16:21
mriedemi'm not opposed to it no16:21
dansmithit's big,16:21
dansmithbut it doesn't seem that hairy16:21
mriedemthe fact it was re-introducing a regression in the earlier PS indicates to me it's hairy16:21
dansmithit's checking a thing and raising an exception to avoid you killing data puppies16:22
*** AlexeyAbashkin has quit IRC16:22
dansmithokay I guess I don't quite know what that means16:22
mriedemhttps://review.openstack.org/#/c/543569/1/nova/virt/libvirt/driver.py@121616:22
mriedemmeaning it's easy to break stuff16:23
dansmithah I see16:23
mriedemanyway, i told lyarwood i'd go through it again last week and forgot16:23
dansmithweyall.. data corruption seems more bad16:23
*** janki has quit IRC16:23
mriedemand with no more eol, we have time to fix it if breaks something16:23
dansmithby "time" you mean "forever and ever" right?16:24
odyssey4memriedem eh? what sucks for me? :)16:24
*** andreas_s has quit IRC16:25
*** masayukig has joined #openstack-nova16:29
*** sree has quit IRC16:29
*** dikonoor has joined #openstack-nova16:30
*** andreas_s has joined #openstack-nova16:30
*** cristicalin has joined #openstack-nova16:31
*** mgoddard has joined #openstack-nova16:34
openstackgerritsahid proposed openstack/nova master: libvirt: move version to string in utils  https://review.openstack.org/56045516:35
*** udesale has quit IRC16:35
mriedemdansmith: i'll trade you https://review.openstack.org/#/c/536722/16:35
dansmithmriedem: seems a little lopsided16:36
*** felipemonteiro_ has quit IRC16:36
*** Spaz-Home has joined #openstack-nova16:36
*** r-daneel has joined #openstack-nova16:37
mriedemsahid: comments inline16:39
*** Spazmotic1 has quit IRC16:40
*** wolverineav has joined #openstack-nova16:40
openstackgerritMerged openstack/nova master: Expose shutdown retry interval as config setting  https://review.openstack.org/55248316:41
dansmithmriedem: you okay with this? https://review.openstack.org/#/c/484997/14/nova/conf/libvirt.py16:44
dansmithI suggested something similar, but not exactly this.. although this works and is easier than what I suggested16:44
dansmithit gets us config load-time verification of that parameter16:44
dansmithinstead of at runtime16:44
dansmithbut I don't think we have anywhere else that we subclass an opt (even though that's suggested by the oslo docs AFAICT)16:45
mriedemyou just pulled me out of https://review.openstack.org/#/c/543569/16:45
dansmithit needs only a glance16:46
mriedemso does https://review.openstack.org/#/c/560454/16:46
mriedemagree with load-time config validation16:47
mriedemwouldn't it be simple to do a subclass inline in that module16:47
mriedem?16:47
*** sahid has quit IRC16:49
dansmithmriedem: wrong link?16:49
*** andreas_s has quit IRC16:49
*** suresh12 has joined #openstack-nova16:49
*** suresh12 has quit IRC16:50
mriedemno, i asked for a review on that earlier - since it's kicking things out of CI on master16:50
*** lpetrut has joined #openstack-nova16:51
dansmithI'm confused16:51
*** lpetrut_ has quit IRC16:51
dansmithmriedem: melwitt tssurya: do we need a cells meeting today? I have nothing new16:51
mriedemyou asked me to review lee's thing, then while i was doing that, you asked me to look at sahid's thing, so in kind i threw that bug fix at you while you were reviewing sahid's thing :)16:51
dansmithand I reviewed some of tssurya's patches to make myself feel better this morning16:52
mriedemi dont think i have anything16:52
tssuryame niether16:52
melwittI was just about to ask that. I don't think I have anything either16:52
tssuryadansmith: thanks for the reviews16:52
mriedemi reviewed tssurya's patch to delete RPs and host mappings when we delete compute services but my comments weren't controversial16:52
dansmithsweet, cancelled thusly16:52
tssuryajaypipes: I am still working on the func test, haven't got very far (dangling between understanding service fixtures) , however I will try again tomorrow and ping you if it becomes too much for me16:53
*** andreas_s has joined #openstack-nova16:54
mriedemtssurya: i can probably help with that,16:54
mriedemcould be a patch before yours in the series to show that we didn't delete HMs and RPs when we deleted a compute service, and then yours could build on top to assert that we do16:54
dansmithyeah I like that16:55
dansmithI would call that "mriedem style"16:55
mriedemit would also keep the fix patch smaller16:55
mriedemlike gangham style?16:55
imacdonnI can certainly related to getting all tangled up in fixtures :/16:55
imacdonnrelate*16:55
dansmithmriedem: similar, yeah16:55
tssuryamriedem: that would be really awesome for me, writing the test_services from stratch is causing me a headache because its my first go16:55
*** _pewp_ has quit IRC16:56
tssuryaimacdonn: :)16:56
*** lpetrut has quit IRC16:57
*** tesseract has quit IRC16:59
imacdonnmriedem dansmith speaking of which ... I tried to implement that compute-is-configured-to-use-placement check based on auth_type, but I'm back in unit-test hell ... 27 tests that start a compute service trip on it .. and if I set auth_type in the conf fixture, a bazillion other tests fail ... some due to auth_url not set16:59
*** gjayavelu has joined #openstack-nova17:00
*** _pewp_ has joined #openstack-nova17:01
*** sree has joined #openstack-nova17:03
*** andreas_s has quit IRC17:03
openstackgerritEric Berglund proposed openstack/nova master: PowerVM Driver: Localdisk  https://review.openstack.org/54930017:04
*** jdillaman has quit IRC17:05
*** AlexeyAbashkin has joined #openstack-nova17:07
*** harlowja has quit IRC17:07
*** tssurya has quit IRC17:07
*** sree has quit IRC17:07
mriedemdansmith: lyarwood: done https://review.openstack.org/#/c/543569/17:08
*** andreas_s has joined #openstack-nova17:08
*** mgoddard has quit IRC17:08
* mriedem goes to brush off all that hair17:09
*** diga has quit IRC17:10
mriedemdansmith: you should hit https://review.openstack.org/#/c/559987/ while we wait for lee to fix that up17:10
dansmithya17:11
*** cristicalin has quit IRC17:13
*** mdnadeem has quit IRC17:13
*** ssurana has joined #openstack-nova17:13
*** sidx64 has quit IRC17:14
*** jpena is now known as jpena|off17:16
*** hamzy has joined #openstack-nova17:18
mriedemdansmith: left some replies in https://review.openstack.org/#/c/536722/ based on earlier discussions17:19
mriedemas for the cleanup routine, i think some of that is going to have to just be impl trial and error, but i left some ideas17:19
dansmithmriedem: how is it not a new rpc call?17:20
dansmithoh because live_migration_abort() I guess?17:20
mriedemyes17:20
mriedemread the rest of my comment :)17:20
mriedemthere is one thing i'm not totally sure about, and it's that http://pythonhosted.org/futures/#concurrent.futures.Executor.shutdown says "If wait is False then this method will return immediately and the resources associated with the executor will be freed when all pending futures are done executing. Regardless of the value of wait, the entire Python program will not exit until all pending futures are done executing."17:21
cfriesenmelwitt: lyarwood: I'm seeing something weird on Pike:  http://paste.openstack.org/show/718967/   Basically heat creates an instance and attaches volumes to it, then on stack teardown it runs into problems detaching the volume from the instance.  Eventually the token times out and it retries, only this time libvirt doesn't actually recognize the specified device (making me wonder whether it had actually been detached at this17:21
cfriesenpoint.)17:21
mriedemhowever, if we do the done callback and Futures.cancel() thing i laid out, i think the pool will exit once we cancel those futures17:21
dansmithmriedem: so the thing that sucks about that, IMHO,17:22
dansmithis it's a cast, and we could check the status of the migration before we make that call, but it might be different when it would land on the compute and do its thing17:22
dansmithwhich maybe isn't a problem because it's just less permissive not more17:22
*** andreas_s has quit IRC17:22
mriedemdansmith: yeah, worst case is the api races and then the compute ignores the abort request, because i think it's ultimately the libvirt driver that has to ack the abort request17:23
dansmithmriedem: and we'd have to have the migration in rpcapi in order to know the status and whether or not we need to abort based on theversion we're pinned to17:23
mriedemoh because we don't pass the migration record itself to live_migration_abort, just the id17:24
dansmithright17:24
mriedemhmm, well, we have to bump the compute service version anyway, so we can do that in the same version bump17:25
*** hemna_ has quit IRC17:25
*** hemna_ has joined #openstack-nova17:25
melwittcfriesen: I think you might need this https://review.openstack.org/#/c/51500817:25
mriedemi was just looking that up :)17:25
dansmithmriedem: well you don't actually have to change the rpc call, you just have to change the interface to the rpcapi method17:25
dansmithmriedem: or you do it based on service version in compute/api before you get that far17:26
cfriesenmelwitt: looks promising, thanks17:26
mriedemdansmith: right so pass migration object to rpcapi method, if can't send new version, send migration.id17:26
mriedemright?17:26
mriedemand if it can't send the new version and the migration status is not 'running' it should blow up17:26
mriedemwhich i think avoids us needing to do an explicit service version check in the API method17:27
*** gjayavelu has quit IRC17:27
dansmithmriedem: no, pass migration to rpcapi, and it always sends migration id, but raises if the version is old and state is not "running" or whatever17:27
mriedemah yeah17:27
mriedemok17:27
*** dillaman has quit IRC17:27
mriedembut these are impl details right? does the spec need this level of detail?17:27
mriedemi assume it will be me and you reviewing the code17:27
*** andreas_s has joined #openstack-nova17:27
dansmithmriedem: well, I dunno, it papered over a lot of this17:28
mriedemok, up to you if you want to ask for more detail17:28
mriedemif you do, i'd say link this irc conversation in there so Kevin_Zheng has it17:28
*** sree has joined #openstack-nova17:29
*** hemna__ has joined #openstack-nova17:29
*** hemna__ has quit IRC17:29
dansmithwell, since it's not as big of a change as I was thinking (just clarifying we're re-using the same) I guess I can just go ahead and approve it and see if he'll come back around to add some stuff17:29
*** abhishekk has joined #openstack-nova17:29
*** yamamoto has quit IRC17:29
*** wolverineav has quit IRC17:29
*** wolverineav has joined #openstack-nova17:30
melwittcfriesen: this is the redhat bz where we ran into the problem. I think it was during a similar thing, a heat stack delete failing at the detach step for "not found" https://bugzilla.redhat.com/show_bug.cgi?id=150559517:30
openstackbugzilla.redhat.com bug 1505595 in openstack-nova "Nova assumes that a volume is fully detached from the compute if the volume is not defined in the instance's libvirt definition" [High,Modified] - Assigned to sferdjao17:30
*** jdillaman has joined #openstack-nova17:31
*** sree has quit IRC17:33
cfriesenmelwitt: sounds even more promising.  what do you think of the idea of heat detecting the failure-to-detach by polling the instance action events?17:33
*** wolverineav has quit IRC17:34
mriedemcfriesen: that's how i implemented the tempest test for extend volume - pool instance action events until the extend volume action is complete17:35
mriedem*poll17:35
mriedemhttps://github.com/openstack/tempest/blob/e5d343178334f9d7630e77289e3945e7ccd06cc1/tempest/api/volume/test_volumes_extend.py#L9017:36
melwitthm, I was thinking it might be simpler to poll the presence of the attachments by GET to os-volume_attachments and don't proceed to the next step until they are gone17:36
*** mdbooth has quit IRC17:36
melwittbut I guess that wouldn't tell you detail about the status17:36
mriedemyeah you could end up polling for a long time17:37
mriedemyou'd have to build in a timeout17:37
cfriesencurrently it seems to keep polling until  the token times out17:37
mriedemyou likely need a timeout either way https://github.com/openstack/tempest/blob/e5d343178334f9d7630e77289e3945e7ccd06cc1/tempest/api/volume/test_volumes_extend.py#L16017:37
mriedemsome cloud providers have 24 hour token timeouts don't they?17:38
mriedemor maybe that was years ago17:38
cfriesenin this case it was an hour17:38
mriedemif a volume detach isn't done in 5 minutes something is fubar17:38
cfriesenbut then it naively retries and hits the other failure that I think will be adresssed by the commit melwitt pointed out17:38
mriedemeven a minute really17:38
*** dikonoor has quit IRC17:38
*** XueFeng has quit IRC17:38
*** ralonsoh has quit IRC17:39
*** lpetrut has joined #openstack-nova17:40
cfriesenmelwitt: the method you describe is what it seems to be doing currently, it's calling self.client().volumes.get_server_volume(server_id, attach_id) and looking for the "not found" exception.17:41
*** andreas_s has quit IRC17:42
mriedemcfriesen: if sahid's patch fixes your issue in pike, you can propose https://review.openstack.org/#/c/546655/ for stable/pike17:42
melwittI see17:42
cfriesenmriedem: ack17:42
openstackgerritMerged openstack/nova-specs master: Allow abort live migrations in queued status  https://review.openstack.org/53672217:42
*** dtruong_ has joined #openstack-nova17:45
*** dtruong_ has quit IRC17:45
*** dtruong_ has joined #openstack-nova17:46
*** dtruong_ has joined #openstack-nova17:47
*** suresh12 has joined #openstack-nova17:47
*** dtruong_ has joined #openstack-nova17:48
*** dtruong has quit IRC17:48
*** yamamoto has joined #openstack-nova17:49
*** yamamoto has quit IRC17:50
*** yamamoto has joined #openstack-nova17:50
*** harlowja has joined #openstack-nova17:52
*** armaan has quit IRC17:54
*** armaan has joined #openstack-nova17:54
*** andreas_s has joined #openstack-nova17:55
*** sambetts is now known as sambetts|afk17:55
openstackgerritMerged openstack/nova master: Marker reset option for nova-manage map_instances  https://review.openstack.org/53950117:57
openstackgerritMerged openstack/nova master: Imported Translations from Zanata  https://review.openstack.org/54877217:57
*** yamamoto has quit IRC17:57
*** wolverineav has joined #openstack-nova17:58
*** edmondsw has joined #openstack-nova17:59
*** jdillaman has quit IRC18:01
*** dillaman has joined #openstack-nova18:03
*** dklyle has quit IRC18:06
*** andreas_s has quit IRC18:10
*** dillaman has quit IRC18:12
*** cburgess_ is now known as cburgess18:13
*** andreas_s has joined #openstack-nova18:14
*** sree has joined #openstack-nova18:14
*** yamamoto has joined #openstack-nova18:16
*** yamamoto has quit IRC18:18
*** felipemonteiro_ has joined #openstack-nova18:18
*** sree has quit IRC18:19
openstackgerritDan Smith proposed openstack/nova master: libvirt: refactor get_base_config to accept host arg  https://review.openstack.org/56045618:21
*** huanxie has quit IRC18:23
*** huanxie has joined #openstack-nova18:23
*** yamamoto has joined #openstack-nova18:25
*** andreas_s has quit IRC18:28
openstackgerritEric Berglund proposed openstack/nova master: PowerVM Driver: vSCSI volume driver  https://review.openstack.org/52609418:30
openstackgerritEric Berglund proposed openstack/nova master: PowerVM Driver: Snapshot  https://review.openstack.org/54302318:30
openstackgerritEric Berglund proposed openstack/nova master: PowerVM Driver: DiskAdapter parent class  https://review.openstack.org/54905318:30
*** claudiub has quit IRC18:31
*** armaan has quit IRC18:31
*** armaan has joined #openstack-nova18:31
*** yamamoto has quit IRC18:34
*** gjayavelu has joined #openstack-nova18:34
*** cz2 has quit IRC18:35
*** yamamoto has joined #openstack-nova18:38
*** armaan has quit IRC18:38
*** armaan has joined #openstack-nova18:39
*** yamamoto has quit IRC18:40
*** dustfalling has joined #openstack-nova18:42
dustfallingDoes anyone knows if it possible for nova to pass individual local drives as block device to VM, for use cases like big data?18:43
*** abhishekk has quit IRC18:46
*** mvk has quit IRC18:46
dansmithdustfalling: see channel topic, but using the LVM ephemeral driver is about as close as you can get18:54
dustfallingthank you, dansmith18:55
*** dklyle has joined #openstack-nova18:55
*** pcaruana has quit IRC18:55
*** moshele has quit IRC18:59
*** priteau has quit IRC19:00
*** cz2 has joined #openstack-nova19:02
*** salv-orlando has quit IRC19:07
*** salv-orlando has joined #openstack-nova19:07
*** tssurya has joined #openstack-nova19:07
*** tbachman has quit IRC19:09
*** salv-orlando has quit IRC19:11
*** mdbooth has joined #openstack-nova19:15
*** moshele has joined #openstack-nova19:16
*** tbachman has joined #openstack-nova19:19
cfriesenwas there ever a concensus reached about how to deal with https://bugs.launchpad.net/nova/+bug/1558880 ?  It seems to have been stalled for a long time now without any clear path forward.19:20
openstackLaunchpad bug 1558880 in OpenStack Compute (nova) "instance can not resize ephemeral in mitaka" [Medium,In progress] - Assigned to Nazeema Begum (nazeema123)19:20
*** mvk has joined #openstack-nova19:23
*** tbachman_ has joined #openstack-nova19:24
melwittcfriesen: doesn't look like it. mdbooth had some ideas in comment 15. I hadn't seen the bug before you mentioned it19:25
*** tbachman_ has quit IRC19:25
*** wolverineav has quit IRC19:25
*** avolkov has quit IRC19:25
*** tbachman has quit IRC19:25
*** tbachman has joined #openstack-nova19:28
openstackgerritMerged openstack/nova stable/pike: libvirt: Allow to specify granular CPU feature flags  https://review.openstack.org/55970219:28
*** tbachman has quit IRC19:29
*** wolverineav has joined #openstack-nova19:31
*** READ10 has quit IRC19:31
*** fragatina has quit IRC19:37
*** fragatina has joined #openstack-nova19:37
openstackgerritArvind Nadendla proposed openstack/nova master: update scheduler to use image-traits  https://review.openstack.org/56059619:40
*** moshele has quit IRC19:41
*** fragatina has quit IRC19:42
*** sidx64 has joined #openstack-nova19:44
*** sidx64_ has joined #openstack-nova19:46
*** edmondsw has quit IRC19:47
*** QianYu has joined #openstack-nova19:47
*** QianYu has quit IRC19:48
*** sidx64 has quit IRC19:49
*** eharney has quit IRC19:49
*** mdbooth has quit IRC19:49
*** tssurya has quit IRC19:51
openstackgerritEric Berglund proposed openstack/nova master: PowerVM Driver: Localdisk  https://review.openstack.org/54930019:55
*** suresh12 has quit IRC19:56
openstackgerritEric Berglund proposed openstack/nova master: WIP: PowerVM: Cold Migrate & Resize  https://review.openstack.org/55358319:56
*** salv-orlando has joined #openstack-nova19:56
*** tssurya has joined #openstack-nova19:57
mriedemdansmith: fyi, for https://review.openstack.org/#/c/560596/ we'll have to think about rebuild + new image with required traits...19:58
mriedemas much as no one wants to think about that19:58
*** mdbooth has joined #openstack-nova19:58
*** claudiub has joined #openstack-nova20:02
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for deleting a compute service  https://review.openstack.org/56062620:02
mriedemtssurya: ^ i'll rebase your change on top of it20:02
*** jafeha has joined #openstack-nova20:04
*** suresh12 has joined #openstack-nova20:04
*** jafeha__ has quit IRC20:05
*** suresh12 has quit IRC20:08
*** jobewan has quit IRC20:10
*** suresh12 has joined #openstack-nova20:12
tssuryamriedem: thanks a lot, oh nice I wasted so much of time in trying to see if the service fixture could return the service object also,, not sure why I didn't think of just querying it using get_services after the compute service is creeated20:13
*** fragatina has joined #openstack-nova20:13
mriedemfor the most part, we want functional tests to interact with the REST API20:14
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for deleting a compute service  https://review.openstack.org/56062620:14
openstackgerritMatt Riedemann proposed openstack/nova master: Cleanup RP and HM records while deleting a compute service.  https://review.openstack.org/55492020:14
tssuryamriedem: yea makes sense, I am completely naive :( will practise writing these things more20:14
efriedmriedem: test_resize_with_reschedule_then_live_migrate is that bug you fixed earlier with the waiting for migration to complete?20:15
mriedemefried: yes20:15
mriedemhttp://status.openstack.org/elastic-recheck/#176287620:16
efriedmriedem: was gonna ask if it merged, but I see it's trying to get through the gate.20:16
efriedI rechecked it.20:16
mriedemok looks like test_parallel_evacuate_with_server_group is also racy20:17
efriedwhee20:17
tssuryamriedem: totally appreciate the detailed comments on why you are doing what you are doing specially the fixtures .20:19
*** markvoelker has joined #openstack-nova20:20
mriedemthe setUp is mostly copy/paste from other similar functional tests20:20
mriedembut thanks, i'll take all that credit20:20
tssuryamriedem: I know, that's what I did took most of it from test_servers like Dan said20:21
*** wolsen_ has joined #openstack-nova20:21
*** zioproto_ has joined #openstack-nova20:21
*** geekinutah_ has joined #openstack-nova20:21
*** NobodyCam_ has joined #openstack-nova20:21
tssuryahowever I got tangled up20:21
*** ameade_ has joined #openstack-nova20:21
*** icey_ has joined #openstack-nova20:21
arvindn05mriedem: incase of rebuild, can we make a allocation request to placement without resources and only traits(will require API behaviour change, new microversion?) and make sure the host list returned contains the host we are currently doing a rebuild of?20:21
*** kmalloc_ has joined #openstack-nova20:21
mriedemorangutangled? https://www.amazon.com/Orangutangled-Sudipta-Bardhan-Quallen/dp/147784717020:22
arvindn05mriedem: if that sounds like a good startergy...i can pursure the code changes required while that other patch is being merged....20:22
tssuryamriedem: :P20:22
mriedemarvindn05: i think that is over-complicating things20:23
mriedemto modify the allocation_candidates API to ignore resources20:23
arvindn05hmm....ok...any suggestions?20:24
mriedemif anything, we'd want to change GET /allocation_candidates to pass in a specific root provider uuid20:24
mriedemhowever....placement might say, "sorry no more room"20:24
*** toanster has joined #openstack-nova20:24
arvindn05i though it could be useful for other cases where the user might want to take an inventory of RP's with specific traits etc20:24
*** dtruong_ has quit IRC20:24
mriedemthe user can do that via GET /resource_providers20:24
*** dtruong has joined #openstack-nova20:25
*** kmalloc_ has quit IRC20:25
mriedemhmm, i'm not sure how allocation_candidates is going to work here, since i guess it would have to make resources optional,20:25
mriedemotherwise you can hit the bug that hongbin is fixing20:25
mriedemif the compute is full20:25
*** kmalloc_ has joined #openstack-nova20:25
arvindn05exactly...20:25
*** kmalloc_ is now known as notmorgan20:26
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for deleting a compute service  https://review.openstack.org/56062620:26
openstackgerritMatt Riedemann proposed openstack/nova master: Cleanup RP and HM records while deleting a compute service.  https://review.openstack.org/55492020:26
mriedemarvindn05: well, this is why your spec needs to be amended like i asked for20:26
*** notmorgan has quit IRC20:26
*** notmorgan has joined #openstack-nova20:26
*** notmorgan has quit IRC20:26
*** notmorgan has joined #openstack-nova20:26
*** fanzhang_ has joined #openstack-nova20:27
*** kmalloc has quit IRC20:27
*** andreaf_ has joined #openstack-nova20:27
arvindn05oh...didnt realize you were asking for ammending the spec...my assumption was to use the code review phase for addressing since it was a bug fix20:27
*** notmorgan is now known as kmalloc20:27
mriedemwhat is a bug fix?20:28
*** johnthetubaguy_ has joined #openstack-nova20:28
*** fanzhang has quit IRC20:28
*** mordred has quit IRC20:28
*** toan has quit IRC20:28
*** icey has quit IRC20:28
*** andreaf has quit IRC20:28
*** NobodyCam has quit IRC20:28
*** wolsen has quit IRC20:28
*** zioproto has quit IRC20:28
*** geekinutah has quit IRC20:28
*** johnsom has quit IRC20:28
*** ameade has quit IRC20:28
*** ArchiFleKs has quit IRC20:28
*** johnthetubaguy has quit IRC20:28
mriedemhongbin's patch is a bug fix20:28
*** geekinutah_ is now known as geekinutah20:28
*** icey_ is now known as icey20:28
*** zioproto_ is now known as zioproto20:28
mriedemyou're adding a new feature20:28
*** NobodyCam_ is now known as NobodyCam20:28
*** ameade_ is now known as ameade20:28
*** wolsen_ is now known as wolsen20:28
*** johnsom has joined #openstack-nova20:29
*** andreaf_ is now known as andreaf20:29
*** ArchiFleKs has joined #openstack-nova20:29
*** mordred has joined #openstack-nova20:30
arvindn05got it. Thanks for letting me know...i thought specs need to be ammended for larger changes....i can propose an amendment to the spec20:30
*** jackie-truong has joined #openstack-nova20:30
mriedemarvindn05: if we have to make an API change to GET /allocation_candidates, then it's a larger change, and all API changes require a spec anyway20:31
*** bandini has quit IRC20:31
mriedemdansmith: melwitt: i would like to phone a friend on https://review.openstack.org/#/c/554920/6/nova/api/openstack/compute/services.py@22620:32
dansmithhah20:32
melwittheh, awesome reference20:32
*** bandini has joined #openstack-nova20:33
*** mdbooth has quit IRC20:33
mriedemre: is it ok to cascade delete the resource provider while the service has instances on it20:33
arvindn05mriedem: API change is just my first proposal...i would really like to avoid it if i can with a much more localized fix...but you are right its better to be discussed on the spec in case we need to make that API change20:33
dansmithmriedem: we currently allow them to do this anyway right?20:33
dansmithmriedem: deleting the resource provider doesn't affect the quota20:33
dansmithmriedem: it just avoids us leaking data in placement20:34
melwittwell, thinking ahead where we want to ask placement for cores/ram allocation usage20:34
*** liverpooler has quit IRC20:34
mriedemdansmith: we currently allow admins to delete compute services that have instances running on them, yes20:34
melwittit seems like we shouldn't nuke allocations if instances are still alive, right?20:34
dansmithso that creates the quota issue20:34
mriedembut we don't currently delete the resource provider (and allocations)20:34
mriedemand since the compute doesn't heal allocations,20:35
mriedemeven if you bring the compute back up, those instances are screwed and the resource provider for that node isn't going to report proper inventory20:35
mriedems/inventory/consumption/20:35
melwittlike, instances are still consuming resources from placement20:35
dansmithinstances don't consume from placement,20:35
dansmithbut yes, they'll be consuming from a provider that is no longer present20:36
mriedemit seems to me that if the node has instances with allocations in placement, we shouldn't delete the resource provider in that case20:36
dansmithmriedem: that's still true today right? if you delete it, you'll end up with a compute node that looks to be empty in placement20:36
mriedemdansmith: i guess the node uuid would change wouldn't it20:36
melwittwell, this cascade is talking about deleting the allocations too right? I thought we need to keep the allocations as long as the instance is alive, no?20:36
mriedemso you'd have a new provider20:36
dansmithso you just leak data today20:36
dansmithyou still get out of sync the same way, but with leaked data you can never clean up20:37
dansmithso maybe we should block the service delete, but that's separate from if we're deleting the service, we should delete the RP I think20:37
*** liverpooler has joined #openstack-nova20:38
mriedemi can't parse that sentence20:39
dansmithmeaning,20:39
dansmithif we're going to delete the service (and thus compute node), we should delete the RP in placement20:39
dansmithbut20:39
dansmithif we want to block deleting the service because of instances, then that's fine and it would also block the RP20:39
melwittif we want to be able to count quota usage for cores and ram from placement allocations (which we do, so we can handle cell down, and that's the right place to count cores and ram anyway), then deleting allocations when a service is deleted if instances are still running associated with that service is going to mess that up20:39
tssuryaso we should allow a service delete only if doesn't have any living instances  on that compute node ?20:40
dansmithmelwitt: that's the same concern as deleting instances before the service for today's counting method20:40
*** evin has quit IRC20:40
dansmithmelwitt: and if we don't delete the RP when we delete the service, you have no way of going back to delete the allocations you leaked later,20:41
mriedemwell, you have ways, but not fun ways20:41
dansmithwell, maybe you can by instance uuid, but you can't delete them by compute node uuid in bulk20:41
dansmithyeah20:41
openstackgerritJackie Truong proposed openstack/nova master: Implement certificate_utils  https://review.openstack.org/47994920:41
openstackgerritJackie Truong proposed openstack/nova master: Add trusted_image_certificates to REST API  https://review.openstack.org/48620420:41
openstackgerritJackie Truong proposed openstack/nova master: Add certificate validation docs  https://review.openstack.org/56015820:41
mriedemyou'd have to take all instances that were running on that host, find their allocations, and then remove any against RPs that no longer exist20:41
melwittokay, I'm not getting the "same concern with today's counting method" part yet20:42
dansmithso I guess the question is.. why do we allow you to delete the service today with instances on it?20:42
*** liverpooler has quit IRC20:42
mriedemyeah i'm trying to get there20:42
dansmithbecause that would cause accounting trouble in the RT the way it was when that was added20:42
melwittif you delete instances before the service today, the allocations will be deleted when you delete the instances, which is fine20:42
dansmithif you just delete the service, then we'll still count those instances for quota, yes, is that what you mean?20:43
mriedemexcluding placement, if you delete the service and later restart it, we'll create a new service, but the RT will still look up instances on that service via host and nodename yeah?20:43
efriedjohnthetubaguy_: I think your -1 on https://review.openstack.org/#/c/553605/ is moot now, yes?  The flag changes are being done in the previous patch, and what you were seeing in PS6 was a bad rebase.20:44
dansmithbut you've broken things now, like you can't find the cell that the instance's host is in anymore20:44
dansmithso you might not be able to delete instances20:44
melwittI think you meant the opposite, deleting the service before the instances. with counting today, we count from the instances table so it works. but it would break if we were counting from placement20:44
efriedjohnthetubaguy_: That delta is no longer there (that file is unchanged by this patch)20:44
dansmithsure, what I mean is, other things will break if you delete the service before the instances I think20:44
melwittI see20:44
mriedemquota counting uses instance mappings right?20:44
mriedemto find the cell they are in20:44
melwittyes20:45
dansmithI guess delete will as well, not host mapping20:45
mriedemi'm not sure what other things will break for the instance if the host mapping is gone20:45
dansmithalright maybe not20:45
dansmiththat said,20:45
dansmithI don't think that we should not delete in placement if we're deleting our record of what those allocations are,20:45
dansmithbecause then they're leaked20:46
dansmithand my point being,20:46
dansmithwe should tie the deleting of those to deleting of our service (and thus our record of how to find them)20:46
dansmithit seems weird to me to let people delete the service with instances on it,20:46
dansmithbut I guess it might not fail anything today because we use the hostname as they key20:46
mriedemi'm totally fine with deleting the resource provider if we're going to delete the service and compute node20:47
dansmithwe kindof have to20:47
mriedemi'm trying to parse if you're confirming what tssurya asked, "so we should allow a service delete only if doesn't have any living instances  on that compute node ?"20:47
melwittyeah, I agree we can't be leaking the allocations. but so far I'm leaning to we should block service delete if there are instances. I'm concerned about losing allocation records for instances in that case20:47
mriedemthe easy thing to do here is not delete anything if there are instances on the node20:48
dansmithmelwitt: yeah, I'm saying I think that makes the most sense, I'd just like to figure out why that wasn't done way back when20:48
dansmithmaybe because it would re-heal and so meh,20:48
dansmithbut today that's not the case20:48
melwittyeah, okay. I'd also like to know20:48
mriedemdansmith: right, because "if you delete the service and later restart it, we'll create a new service, but the RT will still look up instances on that service via host and nodename yeah?"20:48
dansmithyes, I mean,20:49
tssuryamelwitt: umm another doubt on quota counting - we don't use inst_mappings right ? we just query through all the cells DBs instances tables ? -> https://github.com/openstack/nova/blob/master/nova/quota.py#L132520:49
mriedemhttps://github.com/openstack/nova/blob/2c5da2212c3fa3e589c4af171486a2097fd8c54e/nova/compute/resource_tracker.py#L71420:49
dansmithdeleting the service today which deletes the compute node will break all manner of stuff, if not deleting instances and quotas, because we'll get a new compute node uuid20:49
dansmithbut likely just placement-forward things where the uuid started to be a thing20:50
mriedemyeah. if we block the service delete, you have options to not f*ck yourself,20:50
mriedemlike migrate the instance20:50
melwitttssurya: oh, yep, you're right. I forgot ... cause we have to be able to get all instances for a project/user combo and we can't know that from instance_mappings (because it lacks user_id). but we could have done a pruning by project_id based on instance_mappings20:50
tssuryamelwitt: which is what we plan to do once we have your spec in :D20:50
mriedemthis is sort of like the "should we allow AZ renames for aggregates with hosts that have instances on them"20:51
mriedemknowing that if you do ^ you'll likely break some stuff20:51
dansmithyeah20:51
melwitttssurya: heh, yeah :)20:51
*** QianYu has joined #openstack-nova20:51
mriedemok so is this considered a separate bug?20:51
*** mdbooth has joined #openstack-nova20:51
mriedemor do we roll it into the same fix?20:52
dansmithit's a separate patch IMHO20:52
*** yamamoto has joined #openstack-nova20:52
*** pchavva has quit IRC20:52
dansmithwhich is why I was saying they're two different concerns20:52
mriedemthat's kind of what i was thinking, it would be easier that way anyway20:52
melwitt+1 to separate patches20:52
mriedemwe can build on the same functional test base i started20:52
tssuryasure20:53
dansmithyeah20:53
mriedemtssurya: you want me to open a separate bug?20:53
tssuryamriedem: yea20:53
mriedemalso, it's 11pm there right?20:54
tssuryaI will put up a patch tomorrow20:54
mriedemdo you get to bill belmiro for overtime?20:54
tssuryamriedem: yes its 11pm :)20:54
tssuryahaha no20:54
*** edmondsw has joined #openstack-nova20:54
tssuryathis is me learning stuff from the veterans :P20:55
*** sree has joined #openstack-nova20:55
*** QianYu has quit IRC20:55
*** dougshelley66 has quit IRC20:55
*** yamamoto has quit IRC20:56
*** edmondsw has quit IRC20:59
*** sree has quit IRC21:00
*** jackie-truong has quit IRC21:00
*** slaweq has quit IRC21:08
*** slaweq has joined #openstack-nova21:09
*** AlexeyAbashkin has quit IRC21:10
*** sidx64_ has quit IRC21:11
*** slaweq has quit IRC21:13
*** r-daneel has quit IRC21:15
*** r-daneel has joined #openstack-nova21:15
*** tssurya has quit IRC21:16
openstackgerritMerged openstack/nova master: Remove mox in tests/unit/test_utils.py  https://review.openstack.org/55788321:22
*** jackie-truong has joined #openstack-nova21:25
*** dougshelley66 has joined #openstack-nova21:25
*** mdbooth has quit IRC21:25
*** salv-orlando has quit IRC21:38
*** jackie-truong has quit IRC21:38
*** salv-orlando has joined #openstack-nova21:38
*** salv-orlando has quit IRC21:43
*** esberglu has quit IRC21:47
*** rcernin has joined #openstack-nova21:49
*** idlemind has quit IRC21:49
mriedemcdent: edleafe: oh seers of http status code wisdom, hear my call, shall thou return a 400 or 409 for https://bugs.launchpad.net/nova/+bug/1763183 ?21:52
openstackLaunchpad bug 1763183 in OpenStack Compute (nova) "DELETE /os-services/{service_id} does not block for hosted instances" [High,Triaged] - Assigned to Matt Riedemann (mriedem)21:52
mriedemi think 40921:52
cdenti feel like I should have some kind of a 409phone21:53
* cdent reads21:53
mriedemoh and if 409, guess what, @wsgi.expected_errors((400, 404))21:53
mriedemwe get to have a microversion debate21:53
mriedemalex_xu: ^21:53
*** mdbooth has joined #openstack-nova21:53
mriedemalthough, it's an admin api...21:54
edleafemriedem: 400 usually means that you can make the call succeed by fixing the parameters, etc21:54
cdentmriedem: yes 40921:54
cdentbecause of what edleafe just said21:54
cdentthe server has to change to make things work, not the request21:55
cdentbut if the server does change, then things might work when you try later21:55
mriedemyeah 409 is correct, but need to figure out if i can get by the existing expected errors decorator21:55
mriedembut i think with the legal caveat in https://docs.openstack.org/nova/latest/contributor/microversions.html#when-a-microversion-is-not-needed 3rd bullet21:55
mriedemwe maybe can21:55
*** lpetrut has quit IRC21:56
*** Guest25648 has quit IRC21:57
*** _ix has quit IRC21:57
*** felipemonteiro_ has quit IRC22:02
*** itlinux has quit IRC22:03
*** gjayavelu has quit IRC22:05
*** itlinux has joined #openstack-nova22:06
*** cdent has quit IRC22:07
*** hamzy has quit IRC22:07
*** itlinux has quit IRC22:07
mriedemoh my22:08
mriedemthis is the issue that keeps on giving22:08
mriedemhttps://bugs.launchpad.net/nova/+bug/167975022:10
openstackLaunchpad bug 1679750 in OpenStack Compute (nova) queens "Allocations are not cleaned up in placement for instance 'local delete' case" [Medium,Confirmed]22:10
mriedemefried: seems delete_resource_provider should fail if delete_allocation_for_instance returns False...22:17
efried...22:18
efriedmriedem: 404 means there were no allocations for that consumer.  Which is fine in the context of delete_resource_provider.  Am I misunderstanding something?22:19
*** mlavalle has quit IRC22:19
mriedemgetting a 40922:19
mriedemand now i know why22:19
efried409 is gonna mean generation conflict.22:19
mriedemno it's not that22:19
efriedAnd sorry, I missed that we return False for any 4xx22:19
efriedmriedem: I think 404 should return True (or somehow otherwise be ignorable) and any other 4xx should be a failure in delete_resource_provider - agreed.22:20
mriedemso i'm not actually calling this https://github.com/openstack/nova/blob/fe976dcc559d059589a9ccf953a28e855abf50fb/nova/scheduler/client/report.py#L192022:20
mriedembecause the list of instances is empty, because the compute service is down so when i delete the instance, the api removes it 'locally' but doesn't cleanup allocations22:20
mriedembecause of bug 167975022:20
openstackbug 1679750 in OpenStack Compute (nova) queens "Allocations are not cleaned up in placement for instance 'local delete' case" [Medium,Confirmed] https://launchpad.net/bugs/167975022:20
mriedemthen https://github.com/openstack/nova/blob/fe976dcc559d059589a9ccf953a28e855abf50fb/nova/scheduler/client/report.py#L1922 fails with ResourceProviderInUse and we pass22:21
efriednoyce22:21
efriedmriedem: Me, I would rewrite a cascading RP deletion routine that doesn't rely on nova-isms.22:22
efriedYou pass it a provider name/UUID and it goes after all related records, period.22:22
efriedI thought we had that somewhere already.22:22
mriedemi just need to fix that bug22:22
mriedemwhich has been around forever22:22
mriedemi'm actually happy my test fails here, because the cascade silent fail means we're not doing something right22:23
efriedmriedem: Do you need help writing a real cascading delete in report client?22:23
mriedemno22:23
mriedemi need to fix that bug in the api local delete case to cleanup allocations in placement when the compute service is down22:24
mriedemwill be more clear when i post this code22:24
efriedWhich you're going to need to do by getting placement to delete allocations based on the resource providers, not the instances.22:24
mriedemno22:24
mriedemwe're deleting the instance22:24
mriedemwe know the consume22:24
mriedem*consumer, so we get the allocations to delete22:25
mriedemhttps://developer.openstack.org/api-ref/placement/#delete-allocations22:25
cfriesenwhen doing a "git cherry-pick -x" do we generally preserve any conflicts or remove them from the commit message?22:25
cfriesenfor backporting22:25
efriedcfriesen: preserve (and explain if necessary)22:26
mriedemcfriesen: i leave the conflicts in the commit message and make a note about what they are to help reviewers22:26
openstackgerritMatt Riedemann proposed openstack/nova master: Add functional test for deleting a compute service  https://review.openstack.org/56062622:26
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Cleanup RP and HM records while deleting a compute service.  https://review.openstack.org/55492022:26
openstackgerritMatt Riedemann proposed openstack/nova master: Block deleting compute services which are hosting instances  https://review.openstack.org/56067422:26
mriedemefried: ^ should make it more clear22:26
efriedmriedem: ack, will look maƱana22:26
*** andreas_s has joined #openstack-nova22:26
mriedemmanana iguana? https://www.amazon.com/Manana-Iguana-Ann-Whitford-Paul/dp/082341980022:26
mriedem2 childrens books references in one day22:27
mriedemthose are for dansmith and jaypipes btw22:27
*** mdbooth has quit IRC22:27
*** tbachman has joined #openstack-nova22:30
-openstackstatus- NOTICE: zuul was restarted to updated to the latest code; you may need to recheck changes uploaded or approvals added between 21:30 and 21:4522:30
*** andreas_s has quit IRC22:31
jaypipesewww22:35
mriedemthere goes a gate reset so that functional test fix is going to be awhile yet22:36
*** mriedem is now known as mriedem_afk22:36
*** salv-orlando has joined #openstack-nova22:39
*** derekh has quit IRC22:40
*** jafeha__ has joined #openstack-nova22:41
*** jafeha has quit IRC22:42
*** felipemonteiro_ has joined #openstack-nova22:42
*** edmondsw has joined #openstack-nova22:43
*** salv-orlando has quit IRC22:43
*** yamamoto has joined #openstack-nova22:46
*** edmondsw has quit IRC22:48
*** yamamoto has quit IRC22:50
*** tobasco has quit IRC22:50
*** yamamoto has joined #openstack-nova22:51
*** hongbin has quit IRC22:53
*** _ix has joined #openstack-nova22:54
*** yamamoto has quit IRC22:56
*** mdbooth has joined #openstack-nova22:56
*** yamamoto has joined #openstack-nova22:57
*** tobasco has joined #openstack-nova22:58
openstackgerritEric Fried proposed openstack/nova master: test.stub_object  https://review.openstack.org/56068323:01
*** yamamoto has quit IRC23:01
*** gjayavelu has joined #openstack-nova23:03
*** yamamoto has joined #openstack-nova23:03
*** slaweq has joined #openstack-nova23:09
*** sree has joined #openstack-nova23:11
*** slaweq has quit IRC23:14
*** sree has quit IRC23:16
*** randomhack has joined #openstack-nova23:18
*** pchavva has joined #openstack-nova23:19
*** suresh12 has quit IRC23:19
*** suresh12 has joined #openstack-nova23:20
*** suresh12 has quit IRC23:24
*** _ix has quit IRC23:29
openstackgerritChris Friesen proposed openstack/nova stable/pike: libvirt: disconnect volume from host during detach  https://review.openstack.org/56069023:30
*** mdbooth has quit IRC23:31
*** pchavva has quit IRC23:31
*** gjayavelu has quit IRC23:34
*** claudiub has quit IRC23:35
*** takashin has joined #openstack-nova23:38
*** salv-orlando has joined #openstack-nova23:40
openstackgerritTakashi NATSUME proposed openstack/nova master: api-ref: Example verification for servers.inc  https://review.openstack.org/52952023:42
*** felipemonteiro_ has quit IRC23:42
*** suresh12 has joined #openstack-nova23:45
*** salv-orlando has quit IRC23:45
*** yamamoto has quit IRC23:47
*** owalsh is now known as owalsh_afk23:47
*** mdbooth has joined #openstack-nova23:48
gmannsdague: can you feedback on this comment (one of TODO from you) - https://review.openstack.org/#/c/529520/18/api-ref/source/servers.inc@76523:50
gmannsdague: i feel single latest sample response file is good enough instead of separate sample files per request attribute for update23:51
openstackgerritTakashi NATSUME proposed openstack/nova master: Remove mox in test_neutron_security_groups.py  https://review.openstack.org/56026723:51
*** moshele has joined #openstack-nova23:54
*** haha1 has quit IRC23:57
*** yinxq has joined #openstack-nova23:58
*** moshele has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!