*** moshele has quit IRC | 00:00 | |
*** lifeless_ has joined #openstack-nova | 00:01 | |
*** chyka has joined #openstack-nova | 00:01 | |
*** lifeless has quit IRC | 00:02 | |
*** Sukhdev_ has quit IRC | 00:03 | |
*** fragatina has quit IRC | 00:05 | |
*** fragatina has joined #openstack-nova | 00:05 | |
*** shaohe_feng has quit IRC | 00:06 | |
*** bigdogstl has joined #openstack-nova | 00:06 | |
*** chyka has quit IRC | 00:06 | |
*** shaohe_feng has joined #openstack-nova | 00:06 | |
openstackgerrit | Tsuyoshi Nagata proposed openstack/nova master: openstack server add volume fails over 26vols https://review.openstack.org/567472 | 00:09 |
---|---|---|
*** fragatina has quit IRC | 00:10 | |
*** liverpooler has joined #openstack-nova | 00:11 | |
*** bigdogstl has quit IRC | 00:11 | |
*** fragatina has joined #openstack-nova | 00:13 | |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Do not import oslo_service for log_options https://review.openstack.org/572231 | 00:14 |
*** masuberu has joined #openstack-nova | 00:15 | |
*** shaohe_feng has quit IRC | 00:16 | |
*** shaohe_feng has joined #openstack-nova | 00:17 | |
*** bigdogstl has joined #openstack-nova | 00:17 | |
*** fragatina has quit IRC | 00:17 | |
*** masber has quit IRC | 00:19 | |
*** cdent has quit IRC | 00:20 | |
*** swamireddy has quit IRC | 00:24 | |
*** bigdogstl has quit IRC | 00:24 | |
*** shaohe_feng has quit IRC | 00:26 | |
*** bigdogstl has joined #openstack-nova | 00:26 | |
*** shaohe_feng has joined #openstack-nova | 00:27 | |
*** liverpooler has quit IRC | 00:28 | |
*** hiro-kobayashi has joined #openstack-nova | 00:29 | |
*** yassine_ has quit IRC | 00:33 | |
*** bigdogstl has quit IRC | 00:33 | |
*** bigdogstl has joined #openstack-nova | 00:34 | |
*** Nel1x has joined #openstack-nova | 00:35 | |
*** moshele has joined #openstack-nova | 00:35 | |
*** shaohe_feng has quit IRC | 00:36 | |
*** rcernin_ has joined #openstack-nova | 00:37 | |
*** rcernin has quit IRC | 00:37 | |
*** yassine_ has joined #openstack-nova | 00:38 | |
*** bigdogstl has quit IRC | 00:39 | |
*** shaohe_feng has joined #openstack-nova | 00:39 | |
*** bigdogstl has joined #openstack-nova | 00:41 | |
*** tetsuro has joined #openstack-nova | 00:42 | |
*** bigdogstl has quit IRC | 00:46 | |
*** shaohe_feng has quit IRC | 00:47 | |
*** shaohe_feng has joined #openstack-nova | 00:49 | |
*** shaohe_feng has quit IRC | 00:57 | |
*** hongbin has joined #openstack-nova | 00:57 | |
*** shaohe_feng has joined #openstack-nova | 00:58 | |
*** bigdogstl has joined #openstack-nova | 00:58 | |
*** tiendc has joined #openstack-nova | 01:00 | |
*** Dinesh_Bhor has joined #openstack-nova | 01:02 | |
*** bigdogstl has quit IRC | 01:03 | |
*** phuongnh has joined #openstack-nova | 01:03 | |
*** harlowja has quit IRC | 01:07 | |
*** shaohe_feng has quit IRC | 01:07 | |
*** mdnadeem has joined #openstack-nova | 01:07 | |
*** shaohe_feng has joined #openstack-nova | 01:07 | |
*** dpawlik has joined #openstack-nova | 01:10 | |
*** bigdogstl has joined #openstack-nova | 01:12 | |
*** dpawlik has quit IRC | 01:14 | |
*** shaohe_feng has quit IRC | 01:17 | |
*** shaohe_feng has joined #openstack-nova | 01:18 | |
*** moshele has quit IRC | 01:19 | |
*** bigdogstl has quit IRC | 01:20 | |
*** shaohe_feng has quit IRC | 01:28 | |
*** shaohe_feng has joined #openstack-nova | 01:28 | |
openstackgerrit | tianhui proposed openstack/nova master: Fix bug for hypervisors https://review.openstack.org/572063 | 01:31 |
*** shaohe_feng has quit IRC | 01:38 | |
*** shaohe_feng has joined #openstack-nova | 01:38 | |
*** suresh12 has quit IRC | 01:39 | |
*** r-daneel has joined #openstack-nova | 01:43 | |
*** zhaochao has joined #openstack-nova | 01:47 | |
*** shaohe_feng has quit IRC | 01:48 | |
*** shaohe_feng has joined #openstack-nova | 01:51 | |
*** namnh has joined #openstack-nova | 01:53 | |
*** cdent has joined #openstack-nova | 01:56 | |
*** shaohe_feng has quit IRC | 01:58 | |
*** shaohe_feng has joined #openstack-nova | 01:59 | |
*** vladikr has quit IRC | 01:59 | |
*** Dinesh__Bhor has joined #openstack-nova | 02:00 | |
*** Tom-Tom has joined #openstack-nova | 02:00 | |
*** namnh_ has joined #openstack-nova | 02:02 | |
*** namnh has quit IRC | 02:02 | |
*** namnh_ has quit IRC | 02:02 | |
*** namnh has joined #openstack-nova | 02:03 | |
*** Dinesh_Bhor has quit IRC | 02:03 | |
*** armaan_ has joined #openstack-nova | 02:05 | |
*** klindgren_ has joined #openstack-nova | 02:05 | |
*** klindgren__ has quit IRC | 02:06 | |
*** armaan has quit IRC | 02:06 | |
*** Hazelesque has quit IRC | 02:08 | |
*** shaohe_feng has quit IRC | 02:09 | |
*** Hazelesque has joined #openstack-nova | 02:09 | |
*** pvc has joined #openstack-nova | 02:09 | |
pvc | hi | 02:09 |
*** shaohe_feng has joined #openstack-nova | 02:09 | |
*** yamamoto has joined #openstack-nova | 02:15 | |
openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Fix wrong commands in launch-from-volume doc https://review.openstack.org/572241 | 02:16 |
*** shaohe_feng has quit IRC | 02:19 | |
pvc | Filter PciPassthroughFilter returned 0 hosts | 02:19 |
*** shaohe_feng has joined #openstack-nova | 02:20 | |
*** itlinux has joined #openstack-nova | 02:21 | |
*** liuzz has joined #openstack-nova | 02:23 | |
*** cdent has quit IRC | 02:27 | |
*** gongysh has joined #openstack-nova | 02:27 | |
*** shaohe_feng has quit IRC | 02:29 | |
*** shaohe_feng has joined #openstack-nova | 02:33 | |
*** suresh12 has joined #openstack-nova | 02:34 | |
*** tianhui_ has quit IRC | 02:35 | |
*** tianhui has joined #openstack-nova | 02:35 | |
*** lifeless_ has quit IRC | 02:38 | |
*** suresh12 has quit IRC | 02:38 | |
*** lifeless has joined #openstack-nova | 02:39 | |
*** shaohe_feng has quit IRC | 02:39 | |
*** shaohe_feng has joined #openstack-nova | 02:42 | |
*** phuongnh has quit IRC | 02:43 | |
*** phuongnh has joined #openstack-nova | 02:43 | |
pvc | qemu unexpectedly | 02:45 |
pvc | libvirtError: internal error: qemu unexpectedly closed the monitor: 2018-06-05T02:43:47.447602Z qemu-kvm: -device vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio error: 0000:01:00.0: group 1 is not viable | 02:45 |
*** rodolof has quit IRC | 02:46 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Use ThreadPoolExecutor for max_concurrent_live_migrations https://review.openstack.org/563505 | 02:48 |
*** swamireddy has joined #openstack-nova | 02:48 | |
pvc | gibi | 02:48 |
pvc | libvirtError: internal error: qemu unexpectedly closed the monitor: 2018-06-05T02:43:47.447602Z qemu-kvm: -device vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio error: 0000:01:00.0: group 1 is not viable | 02:48 |
*** shaohe_feng has quit IRC | 02:50 | |
*** shaohe_feng has joined #openstack-nova | 02:51 | |
*** fragatina has joined #openstack-nova | 02:52 | |
*** dave-mccowan has quit IRC | 02:54 | |
*** fragatina has quit IRC | 02:56 | |
pvc | Hi all can some help me vfio error: 0000:01:00.0: group 1 is not viable | 02:56 |
*** fragatina has joined #openstack-nova | 02:57 | |
*** vivsoni has quit IRC | 02:57 | |
*** vivsoni has joined #openstack-nova | 02:57 | |
*** shaohe_feng has quit IRC | 03:00 | |
*** alex_xu has quit IRC | 03:00 | |
*** alex_xu has joined #openstack-nova | 03:01 | |
*** GonZo2000 has joined #openstack-nova | 03:01 | |
*** GonZo2000 has quit IRC | 03:01 | |
*** GonZo2000 has joined #openstack-nova | 03:01 | |
*** shaohe_feng has joined #openstack-nova | 03:01 | |
*** GonZo2000 has quit IRC | 03:06 | |
*** Nel1x has quit IRC | 03:06 | |
*** GonZo2000 has joined #openstack-nova | 03:07 | |
*** yassine_ has quit IRC | 03:07 | |
*** shaohe_feng has quit IRC | 03:10 | |
*** shaohe_feng has joined #openstack-nova | 03:11 | |
*** fragatina has quit IRC | 03:13 | |
*** shaohe_feng has quit IRC | 03:20 | |
*** yassine_ has joined #openstack-nova | 03:21 | |
*** hoonetorg has quit IRC | 03:23 | |
*** shaohe_feng has joined #openstack-nova | 03:25 | |
*** tianhui has quit IRC | 03:27 | |
*** tianhui has joined #openstack-nova | 03:28 | |
*** fragatina has joined #openstack-nova | 03:29 | |
*** shaohe_feng has quit IRC | 03:31 | |
*** shaohe_feng has joined #openstack-nova | 03:32 | |
*** mdnadeem has quit IRC | 03:34 | |
*** GonZo2000 has quit IRC | 03:38 | |
*** esbergl__ has quit IRC | 03:38 | |
*** hoonetorg has joined #openstack-nova | 03:40 | |
*** yamahata has quit IRC | 03:41 | |
*** shaohe_feng has quit IRC | 03:41 | |
*** shaohe_feng has joined #openstack-nova | 03:42 | |
*** udesale has joined #openstack-nova | 03:44 | |
*** lpetrut has joined #openstack-nova | 03:48 | |
*** myrat has joined #openstack-nova | 03:48 | |
*** suresh12 has joined #openstack-nova | 03:51 | |
*** shaohe_feng has quit IRC | 03:51 | |
*** bigdogstl has joined #openstack-nova | 03:55 | |
*** shaohe_feng has joined #openstack-nova | 03:56 | |
*** bigdogstl has quit IRC | 04:00 | |
*** germs has quit IRC | 04:01 | |
*** shaohe_feng has quit IRC | 04:01 | |
*** germs has joined #openstack-nova | 04:02 | |
*** germs has quit IRC | 04:02 | |
*** germs has joined #openstack-nova | 04:02 | |
*** shaohe_feng has joined #openstack-nova | 04:02 | |
*** germs has quit IRC | 04:06 | |
*** shaohe_feng has quit IRC | 04:12 | |
*** shaohe_feng has joined #openstack-nova | 04:13 | |
*** mdnadeem has joined #openstack-nova | 04:17 | |
*** lpetrut has quit IRC | 04:20 | |
*** shaohe_feng has quit IRC | 04:22 | |
*** links has joined #openstack-nova | 04:22 | |
*** shaohe_feng has joined #openstack-nova | 04:23 | |
*** fragatina has quit IRC | 04:26 | |
*** tianhui_ has joined #openstack-nova | 04:27 | |
*** tianhui has quit IRC | 04:30 | |
*** gongysh has quit IRC | 04:31 | |
*** abhishekk has joined #openstack-nova | 04:31 | |
*** shaohe_feng has quit IRC | 04:32 | |
*** shaohe_feng has joined #openstack-nova | 04:33 | |
*** mdnadeem has quit IRC | 04:36 | |
*** mdnadeem has joined #openstack-nova | 04:37 | |
*** vivsoni has quit IRC | 04:38 | |
*** moshele has joined #openstack-nova | 04:39 | |
*** klindgren_ has quit IRC | 04:41 | |
*** vivsoni has joined #openstack-nova | 04:42 | |
*** shaohe_feng has quit IRC | 04:42 | |
*** shaohe_feng has joined #openstack-nova | 04:43 | |
*** moshele has quit IRC | 04:44 | |
*** sapd has quit IRC | 04:45 | |
*** sapd has joined #openstack-nova | 04:45 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/nova master: libvirt: Don't report DISK_GB if sharing https://review.openstack.org/560459 | 04:47 |
*** shaohe_feng has quit IRC | 04:53 | |
*** shaohe_feng has joined #openstack-nova | 04:53 | |
*** Dinesh__Bhor has quit IRC | 04:59 | |
*** AlexeyAbashkin has joined #openstack-nova | 05:00 | |
*** gyee has quit IRC | 05:00 | |
*** shaohe_feng has quit IRC | 05:03 | |
*** hiro-kobayashi has quit IRC | 05:04 | |
*** lpetrut has joined #openstack-nova | 05:04 | |
*** mvk has joined #openstack-nova | 05:05 | |
*** shaohe_feng has joined #openstack-nova | 05:06 | |
*** hongbin has quit IRC | 05:06 | |
*** ccamacho has quit IRC | 05:07 | |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Do not import oslo_service for log_options https://review.openstack.org/572231 | 05:10 |
*** suresh12 has quit IRC | 05:11 | |
*** shaohe_feng has quit IRC | 05:13 | |
*** psachin has joined #openstack-nova | 05:14 | |
*** lpetrut has quit IRC | 05:15 | |
*** lpetrut has joined #openstack-nova | 05:16 | |
*** shaohe_feng has joined #openstack-nova | 05:16 | |
*** salv-orlando has joined #openstack-nova | 05:17 | |
*** salv-orlando has quit IRC | 05:17 | |
*** AlexeyAbashkin has quit IRC | 05:17 | |
*** psachin has quit IRC | 05:22 | |
*** shaohe_feng has quit IRC | 05:23 | |
*** lpetrut has quit IRC | 05:25 | |
pvc | hi | 05:27 |
pvc | hi | 05:27 |
pvc | can i ask? | 05:28 |
*** shaohe_feng has joined #openstack-nova | 05:30 | |
*** shaohe_feng has quit IRC | 05:34 | |
*** shaohe_feng has joined #openstack-nova | 05:35 | |
openstackgerrit | Merged openstack/nova stable/ocata: libvirt: Report the virtual size of RAW disks https://review.openstack.org/568382 | 05:38 |
*** sar has joined #openstack-nova | 05:39 | |
*** lifeless has quit IRC | 05:40 | |
*** AlexeyAbashkin has joined #openstack-nova | 05:41 | |
*** lifeless has joined #openstack-nova | 05:41 | |
*** gongysh has joined #openstack-nova | 05:43 | |
*** Dinesh_Bhor has joined #openstack-nova | 05:43 | |
*** AlexeyAbashkin has quit IRC | 05:44 | |
*** AlexeyAbashkin has joined #openstack-nova | 05:44 | |
*** shaohe_feng has quit IRC | 05:44 | |
*** suresh12 has joined #openstack-nova | 05:45 | |
*** shaohe_feng has joined #openstack-nova | 05:46 | |
*** fragatina has joined #openstack-nova | 05:46 | |
*** Eran_Kuris has joined #openstack-nova | 05:46 | |
*** ccamacho has joined #openstack-nova | 05:46 | |
*** ccamacho has quit IRC | 05:49 | |
*** suresh12 has quit IRC | 05:50 | |
*** myrat has quit IRC | 05:51 | |
*** Dinesh_Bhor has quit IRC | 05:51 | |
*** shaohe_feng has quit IRC | 05:54 | |
*** Dinesh_Bhor has joined #openstack-nova | 05:54 | |
*** moshele has joined #openstack-nova | 05:57 | |
*** shaohe_feng has joined #openstack-nova | 05:57 | |
*** AlexeyAbashkin has quit IRC | 05:59 | |
*** Eran_Kuris has quit IRC | 06:02 | |
*** germs has joined #openstack-nova | 06:03 | |
*** germs has quit IRC | 06:03 | |
*** germs has joined #openstack-nova | 06:03 | |
*** pooja-jadhav is now known as pooja_jadhav | 06:04 | |
*** mdnadeem has quit IRC | 06:04 | |
*** shaohe_feng has quit IRC | 06:04 | |
*** shaohe_feng has joined #openstack-nova | 06:05 | |
*** abhishekk_ has joined #openstack-nova | 06:06 | |
*** abhishekk_ has quit IRC | 06:07 | |
*** hamdyk has joined #openstack-nova | 06:07 | |
*** abhishekk_ has joined #openstack-nova | 06:07 | |
*** germs has quit IRC | 06:08 | |
*** abhishekk has quit IRC | 06:08 | |
*** links has quit IRC | 06:08 | |
*** ispp has joined #openstack-nova | 06:12 | |
*** jaosorior has joined #openstack-nova | 06:14 | |
*** isssp has quit IRC | 06:14 | |
*** Eran_Kuris has joined #openstack-nova | 06:14 | |
*** shaohe_feng has quit IRC | 06:15 | |
*** shaohe_feng has joined #openstack-nova | 06:18 | |
*** ccamacho has joined #openstack-nova | 06:19 | |
*** shaohe_feng has quit IRC | 06:25 | |
*** shaohe_feng has joined #openstack-nova | 06:26 | |
*** links has joined #openstack-nova | 06:26 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: WIP abort live migration in queue. https://review.openstack.org/568542 | 06:30 |
*** salv-orlando has joined #openstack-nova | 06:32 | |
*** salv-orlando has quit IRC | 06:32 | |
*** salv-orlando has joined #openstack-nova | 06:33 | |
*** andreas_s has joined #openstack-nova | 06:33 | |
*** Luzi has joined #openstack-nova | 06:34 | |
*** shaohe_feng has quit IRC | 06:35 | |
*** mdnadeem has joined #openstack-nova | 06:36 | |
*** shaohe_feng has joined #openstack-nova | 06:37 | |
*** armaan_ has quit IRC | 06:44 | |
*** armaan has joined #openstack-nova | 06:44 | |
*** tssurya has joined #openstack-nova | 06:45 | |
*** shaohe_feng has quit IRC | 06:45 | |
*** shaohe_feng has joined #openstack-nova | 06:46 | |
openstackgerrit | tianhui proposed openstack/nova master: Fix bug to doc https://review.openstack.org/572268 | 06:47 |
*** salv-orlando has quit IRC | 06:52 | |
*** artom has joined #openstack-nova | 06:54 | |
*** pcaruana has joined #openstack-nova | 06:54 | |
*** shaohe_feng has quit IRC | 06:56 | |
*** dpawlik has joined #openstack-nova | 06:56 | |
*** shaohe_feng has joined #openstack-nova | 06:56 | |
*** yamamoto_ has joined #openstack-nova | 06:57 | |
*** slaweq has joined #openstack-nova | 06:59 | |
*** lpetrut has joined #openstack-nova | 06:59 | |
*** yamamoto has quit IRC | 07:00 | |
*** blkart has quit IRC | 07:02 | |
*** blkart has joined #openstack-nova | 07:02 | |
*** alexchadin has joined #openstack-nova | 07:03 | |
*** pcaruana is now known as pcaruana|worksho | 07:03 | |
*** shaohe_feng has quit IRC | 07:06 | |
*** oyrogerg has joined #openstack-nova | 07:07 | |
*** oyrogerg has left #openstack-nova | 07:08 | |
*** shaohe_feng has joined #openstack-nova | 07:08 | |
*** abhishekk_ has quit IRC | 07:09 | |
*** sar has quit IRC | 07:11 | |
openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Microversion 2.63 - Use new format policy in server group https://review.openstack.org/567534 | 07:11 |
openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: Initial change set of z/VM driver https://review.openstack.org/523387 | 07:12 |
openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: Spawn and destroy function of z/VM driver https://review.openstack.org/527658 | 07:12 |
openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add snapshot function https://review.openstack.org/534240 | 07:12 |
openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add power actions https://review.openstack.org/543340 | 07:12 |
openstackgerrit | jichenjc proposed openstack/nova master: z/VM Driver: add get console output https://review.openstack.org/543344 | 07:12 |
*** sahid has joined #openstack-nova | 07:12 | |
*** ratailor has joined #openstack-nova | 07:14 | |
*** abhishekk has joined #openstack-nova | 07:14 | |
*** janki has joined #openstack-nova | 07:15 | |
*** mdnadeem has quit IRC | 07:16 | |
*** mdnadeem has joined #openstack-nova | 07:16 | |
*** dpawlik has quit IRC | 07:16 | |
*** shaohe_feng has quit IRC | 07:16 | |
*** shaohe_feng has joined #openstack-nova | 07:17 | |
*** rajinir has quit IRC | 07:18 | |
openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Fix wrong commands in launch-from-volume doc https://review.openstack.org/572241 | 07:20 |
*** dpawlik has joined #openstack-nova | 07:21 | |
*** shaohe_feng has quit IRC | 07:26 | |
*** shaohe_feng has joined #openstack-nova | 07:27 | |
openstackgerrit | Chris Dent proposed openstack/nova master: Re-base placement object unit tests on NoDBTestCase https://review.openstack.org/572279 | 07:28 |
openstackgerrit | Chris Dent proposed openstack/nova master: Move db using provider unit tests to functional https://review.openstack.org/572280 | 07:28 |
openstackgerrit | Chris Dent proposed openstack/nova master: Move db using allocation unit tests to functional https://review.openstack.org/572281 | 07:28 |
openstackgerrit | Chris Dent proposed openstack/nova master: Remove nova dependencies from test_resource_provider https://review.openstack.org/572282 | 07:28 |
*** shaohe_feng has quit IRC | 07:37 | |
*** amoralej|off is now known as amoralej | 07:37 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/python-novaclient master: Modify novaclient to support basic attributes. https://review.openstack.org/572285 | 07:39 |
*** lifeless has quit IRC | 07:40 | |
*** shaohe_feng has joined #openstack-nova | 07:41 | |
*** lifeless has joined #openstack-nova | 07:42 | |
*** shaohe_feng has quit IRC | 07:47 | |
*** shaohe_feng has joined #openstack-nova | 07:47 | |
*** pcaruana|worksho is now known as pcaruana | 07:50 | |
*** jpena|off is now known as jpena | 07:50 | |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create https://review.openstack.org/520313 | 07:56 |
*** shaohe_feng has quit IRC | 07:57 | |
*** shaohe_feng has joined #openstack-nova | 07:57 | |
tssurya | good morning gibi, whenever you have the time could you confirm the comment from mriedem in this spec https://review.openstack.org/#/c/557369/1/specs/rocky/approved/handling-down-cell.rst regarding the Notifications impact ? | 08:01 |
tssurya | thanks in advance! | 08:01 |
*** germs has joined #openstack-nova | 08:04 | |
*** germs has quit IRC | 08:04 | |
*** germs has joined #openstack-nova | 08:04 | |
*** AlexeyAbashkin has joined #openstack-nova | 08:05 | |
*** shaohe_feng has quit IRC | 08:07 | |
*** myrat has joined #openstack-nova | 08:08 | |
*** germs has quit IRC | 08:08 | |
*** shaohe_feng has joined #openstack-nova | 08:08 | |
*** ttsiouts has joined #openstack-nova | 08:09 | |
*** Tom-Tom_ has joined #openstack-nova | 08:15 | |
*** priteau has joined #openstack-nova | 08:15 | |
*** mgoddard has joined #openstack-nova | 08:16 | |
*** shaohe_feng has quit IRC | 08:18 | |
*** Tom-Tom has quit IRC | 08:19 | |
*** shaohe_feng has joined #openstack-nova | 08:19 | |
*** ttsiouts has quit IRC | 08:22 | |
jangutter | Good morning! In the spirit of spec review day, is anyone interested in reviewing a spec for a $network $thingy? As a pleasant side effect, hopefully one more legacy VIF can be moved to os-vif. https://review.openstack.org/#/c/567148/ | 08:22 |
*** mdbooth has joined #openstack-nova | 08:25 | |
*** priteau has quit IRC | 08:25 | |
*** shaohe_feng has quit IRC | 08:28 | |
*** sambetts_ is now known as sambetts|afk | 08:28 | |
*** shaohe_feng has joined #openstack-nova | 08:30 | |
*** ttsiouts has joined #openstack-nova | 08:31 | |
*** ttsiouts has quit IRC | 08:32 | |
*** andreas_s has quit IRC | 08:33 | |
*** ralonsoh has joined #openstack-nova | 08:33 | |
*** andreas_s has joined #openstack-nova | 08:34 | |
openstackgerrit | jichenjc proposed openstack/nova master: Enhance api-guide general info some updates https://review.openstack.org/561773 | 08:34 |
*** ttsiouts has joined #openstack-nova | 08:35 | |
*** namnh has quit IRC | 08:37 | |
openstackgerrit | jichenjc proposed openstack/nova master: Trivial: let internal use only func has _ prefix https://review.openstack.org/572304 | 08:37 |
*** shaohe_feng has quit IRC | 08:38 | |
*** shaohe_feng has joined #openstack-nova | 08:39 | |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Fix some wrong urls in doc https://review.openstack.org/571147 | 08:39 |
*** ralonsoh_ has joined #openstack-nova | 08:42 | |
*** ralonsoh has quit IRC | 08:44 | |
*** ratailor has quit IRC | 08:44 | |
*** ratailor has joined #openstack-nova | 08:45 | |
*** derekh has joined #openstack-nova | 08:46 | |
*** priteau has joined #openstack-nova | 08:48 | |
*** shaohe_feng has quit IRC | 08:48 | |
*** shaohe_feng has joined #openstack-nova | 08:49 | |
*** salv-orlando has joined #openstack-nova | 08:49 | |
*** hiro-kobayashi has joined #openstack-nova | 08:50 | |
openstackgerrit | jichenjc proposed openstack/nova master: Enhance api-guide general info some updates https://review.openstack.org/561773 | 08:54 |
*** salv-orlando has quit IRC | 08:55 | |
gibi | tssurya: good morning! looking... | 08:58 |
*** shaohe_feng has quit IRC | 08:59 | |
*** shaohe_feng has joined #openstack-nova | 09:00 | |
*** owalsh_ is now known as owalsh | 09:08 | |
*** shaohe_feng has quit IRC | 09:09 | |
*** ttsiouts has quit IRC | 09:10 | |
*** shaohe_feng has joined #openstack-nova | 09:11 | |
*** alexchadin has quit IRC | 09:13 | |
*** gongysh has quit IRC | 09:14 | |
*** shaohe_feng has quit IRC | 09:19 | |
*** sar has joined #openstack-nova | 09:20 | |
*** shaohe_feng has joined #openstack-nova | 09:20 | |
*** alexchadin has joined #openstack-nova | 09:22 | |
*** lifeless has quit IRC | 09:25 | |
*** mdnadeem has quit IRC | 09:26 | |
*** mdnadeem has joined #openstack-nova | 09:26 | |
*** sar has quit IRC | 09:28 | |
*** issp has joined #openstack-nova | 09:28 | |
*** lifeless has joined #openstack-nova | 09:29 | |
*** shaohe_feng has quit IRC | 09:29 | |
*** takashin has left #openstack-nova | 09:30 | |
*** shaohe_feng has joined #openstack-nova | 09:30 | |
gibi | tssurya: left couple of comments. But I agree with Matt that there is no notification impact | 09:31 |
tssurya | gibi: thanks :) | 09:31 |
*** mdnadeem has quit IRC | 09:33 | |
*** bigdogstl has joined #openstack-nova | 09:35 | |
*** blkart has quit IRC | 09:36 | |
*** blkart has joined #openstack-nova | 09:36 | |
*** Tom-Tom_ has quit IRC | 09:37 | |
pvc | hi gibi | 09:38 |
*** Tom-Tom has joined #openstack-nova | 09:38 | |
pvc | i sucessfully launch an instance with GPU | 09:38 |
pvc | but there is a time that my hypervisor is going down | 09:38 |
pvc | gibi and i cant access the instance on it | 09:38 |
*** bigdogstl has quit IRC | 09:40 | |
*** shaohe_feng has quit IRC | 09:40 | |
*** Tom-Tom_ has joined #openstack-nova | 09:40 | |
*** sambetts|afk is now known as sambetts] | 09:41 | |
*** shaohe_feng has joined #openstack-nova | 09:41 | |
*** sambetts] is now known as sambetts | 09:41 | |
openstackgerrit | Lee Yarwood proposed openstack/nova stable/queens: Allow cinderv2 endpoints within the request context catalog https://review.openstack.org/572213 | 09:41 |
*** Dinesh_Bhor has quit IRC | 09:42 | |
*** Tom-Tom has quit IRC | 09:42 | |
*** andreas_s has quit IRC | 09:44 | |
*** Tom-Tom_ has quit IRC | 09:45 | |
*** andreas_s has joined #openstack-nova | 09:45 | |
*** mdnadeem has joined #openstack-nova | 09:45 | |
*** stakeda has quit IRC | 09:46 | |
*** ttsiouts has joined #openstack-nova | 09:47 | |
*** jiteka has quit IRC | 09:48 | |
*** hiro-kobayashi has quit IRC | 09:50 | |
*** shaohe_feng has quit IRC | 09:50 | |
*** eandersson has quit IRC | 09:50 | |
*** salv-orlando has joined #openstack-nova | 09:51 | |
*** shaohe_feng has joined #openstack-nova | 09:52 | |
*** ttsiouts has quit IRC | 09:52 | |
*** salv-orlando has quit IRC | 09:55 | |
openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Add 'numa-aware-vswitches' spec https://review.openstack.org/541290 | 09:56 |
*** andreas_s has quit IRC | 09:59 | |
*** sar has joined #openstack-nova | 10:00 | |
*** shaohe_feng has quit IRC | 10:00 | |
*** shaohe_feng has joined #openstack-nova | 10:01 | |
*** ttsiouts has joined #openstack-nova | 10:04 | |
*** germs has joined #openstack-nova | 10:04 | |
*** sar has quit IRC | 10:05 | |
openstackgerrit | Theodoros Tsioutsias proposed openstack/nova-specs master: Add PENDING vm state https://review.openstack.org/554212 | 10:08 |
*** zcorneli_ has joined #openstack-nova | 10:08 | |
*** germs has quit IRC | 10:09 | |
*** shaohe_feng has quit IRC | 10:10 | |
*** zcorneli has quit IRC | 10:11 | |
*** shaohe_feng has joined #openstack-nova | 10:15 | |
*** mdnadeem has quit IRC | 10:20 | |
*** shaohe_feng has quit IRC | 10:21 | |
*** shaohe_feng has joined #openstack-nova | 10:22 | |
openstackgerrit | Theodoros Tsioutsias proposed openstack/nova-specs master: Enable rebuild for instances in cell0 https://review.openstack.org/554218 | 10:27 |
*** abhishekk has quit IRC | 10:30 | |
*** shaohe_feng has quit IRC | 10:31 | |
*** shaohe_feng has joined #openstack-nova | 10:32 | |
*** bpoulos has joined #openstack-nova | 10:37 | |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Implement certificate_utils https://review.openstack.org/479949 | 10:37 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Plumb trusted_certs through libvirt driver image paths https://review.openstack.org/561262 | 10:37 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add trusted_image_certificates to REST API https://review.openstack.org/486204 | 10:37 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add notification support for trusted_certs https://review.openstack.org/563269 | 10:37 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add certificate validation docs https://review.openstack.org/560158 | 10:37 |
*** sahid has quit IRC | 10:38 | |
*** Bhujay has joined #openstack-nova | 10:38 | |
*** shaohe_feng has quit IRC | 10:41 | |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Plumb trusted_certs through libvirt driver image paths https://review.openstack.org/561262 | 10:42 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add trusted_image_certificates to REST API https://review.openstack.org/486204 | 10:42 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add notification support for trusted_certs https://review.openstack.org/563269 | 10:42 |
openstackgerrit | Brianna Poulos proposed openstack/nova master: Add certificate validation docs https://review.openstack.org/560158 | 10:42 |
*** rcernin_ has quit IRC | 10:42 | |
*** sahid has joined #openstack-nova | 10:42 | |
*** shaohe_feng has joined #openstack-nova | 10:42 | |
*** alexchadin has quit IRC | 10:45 | |
*** alexchadin has joined #openstack-nova | 10:46 | |
openstackgerrit | Lee Yarwood proposed openstack/nova stable/pike: libvirt: slow live-migration to ensure network is ready https://review.openstack.org/559032 | 10:46 |
*** andreas_s has joined #openstack-nova | 10:48 | |
*** alexchadin has quit IRC | 10:50 | |
*** shaohe_feng has quit IRC | 10:51 | |
*** shaohe_feng has joined #openstack-nova | 10:52 | |
*** tbachman has quit IRC | 10:52 | |
*** ttsiouts has quit IRC | 10:55 | |
*** alexchadin has joined #openstack-nova | 10:56 | |
*** rnoriega has quit IRC | 10:57 | |
*** weshay has quit IRC | 10:57 | |
*** weshay has joined #openstack-nova | 10:58 | |
*** rnoriega has joined #openstack-nova | 10:58 | |
*** shaohe_feng has quit IRC | 11:02 | |
*** jpena is now known as jpena|lunch | 11:04 | |
openstackgerrit | Lee Yarwood proposed openstack/nova stable/ocata: libvirt: slow live-migration to ensure network is ready https://review.openstack.org/559034 | 11:04 |
*** shaohe_feng has joined #openstack-nova | 11:05 | |
*** bpoulos has quit IRC | 11:05 | |
*** links has quit IRC | 11:09 | |
*** liuzz has quit IRC | 11:12 | |
*** lifeless has quit IRC | 11:12 | |
*** shaohe_feng has quit IRC | 11:12 | |
*** lifeless has joined #openstack-nova | 11:13 | |
*** shaohe_feng has joined #openstack-nova | 11:13 | |
*** ianw has quit IRC | 11:13 | |
*** phuongnh has quit IRC | 11:13 | |
pvc | hi anyone | 11:15 |
pvc | can help me | 11:15 |
*** pooja_jadhav has quit IRC | 11:16 | |
*** bhagyashri_s has quit IRC | 11:16 | |
*** bhagyashri_s has joined #openstack-nova | 11:17 | |
*** pooja_jadhav has joined #openstack-nova | 11:17 | |
*** udesale has quit IRC | 11:17 | |
gibi | pvc: "but there is a time that my hypervisor is going down" this is not specific enough for me to be able to help troubleshooting it | 11:17 |
*** udesale has joined #openstack-nova | 11:17 | |
pvc | gibi i have an instance residing on that hypervisor | 11:18 |
pvc | with gpu on it | 11:18 |
pvc | then my hypervisor always restarting i dont know why | 11:18 |
pvc | compute host that have a PCI passthrough | 11:19 |
*** edmondsw has joined #openstack-nova | 11:19 | |
*** shaohe_feng has quit IRC | 11:22 | |
*** shaohe_feng has joined #openstack-nova | 11:23 | |
*** udesale has quit IRC | 11:23 | |
*** links has joined #openstack-nova | 11:25 | |
openstackgerrit | Chen Hanxiao proposed openstack/nova master: sync_guest_time: use the proper errno https://review.openstack.org/572346 | 11:26 |
*** tetsuro has quit IRC | 11:26 | |
*** yamamoto_ has quit IRC | 11:29 | |
*** ianw has joined #openstack-nova | 11:32 | |
*** shaohe_feng has quit IRC | 11:32 | |
*** shaohe_feng has joined #openstack-nova | 11:33 | |
*** yamamoto has joined #openstack-nova | 11:35 | |
*** myrat has quit IRC | 11:35 | |
*** alexchadin has quit IRC | 11:36 | |
*** AlexeyAbashkin has quit IRC | 11:36 | |
*** ttsiouts has joined #openstack-nova | 11:37 | |
gibi | pvc: have you tried to dig into your hypervisor logs to see why it restarted? | 11:41 |
*** dtantsur is now known as dtantsur|brb | 11:41 | |
*** shaohe_feng has quit IRC | 11:43 | |
*** myrat has joined #openstack-nova | 11:43 | |
*** shaohe_feng has joined #openstack-nova | 11:44 | |
*** AlexeyAbashkin has joined #openstack-nova | 11:46 | |
*** shaohe_feng has quit IRC | 11:53 | |
*** shaohe_feng has joined #openstack-nova | 11:54 | |
*** amoralej is now known as amoralej|lunch | 11:56 | |
*** tiendc has quit IRC | 11:56 | |
*** yamamoto has quit IRC | 11:58 | |
*** jpena|lunch is now known as jpena | 11:59 | |
*** shaohe_feng has quit IRC | 12:03 | |
*** tbachman has joined #openstack-nova | 12:03 | |
*** shaohe_feng has joined #openstack-nova | 12:05 | |
*** germs has joined #openstack-nova | 12:05 | |
*** tbachman has quit IRC | 12:08 | |
*** hamdyk has quit IRC | 12:09 | |
*** germs has quit IRC | 12:10 | |
*** shaohe_feng has quit IRC | 12:13 | |
*** shaohe_feng has joined #openstack-nova | 12:15 | |
*** tbachman has joined #openstack-nova | 12:16 | |
*** eharney has joined #openstack-nova | 12:16 | |
*** eandersson has joined #openstack-nova | 12:19 | |
*** jitek4 has joined #openstack-nova | 12:20 | |
*** shaohe_feng has quit IRC | 12:24 | |
*** shaohe_feng has joined #openstack-nova | 12:25 | |
*** liverpooler has joined #openstack-nova | 12:27 | |
*** andreas_s has quit IRC | 12:29 | |
*** andreas_s has joined #openstack-nova | 12:30 | |
*** andreas_s has quit IRC | 12:30 | |
*** andreas_s has joined #openstack-nova | 12:30 | |
*** armaan has quit IRC | 12:32 | |
*** shaohe_feng has quit IRC | 12:34 | |
*** shaohe_feng has joined #openstack-nova | 12:36 | |
*** finucannot is now known as stephenfin | 12:44 | |
*** yamamoto has joined #openstack-nova | 12:44 | |
*** shaohe_feng has quit IRC | 12:44 | |
*** shaohe_feng has joined #openstack-nova | 12:45 | |
*** lyan has joined #openstack-nova | 12:45 | |
*** nmathew has joined #openstack-nova | 12:46 | |
*** mriedem has joined #openstack-nova | 12:46 | |
*** brault has quit IRC | 12:46 | |
*** hemna_ has joined #openstack-nova | 12:47 | |
*** ttsiouts has quit IRC | 12:48 | |
*** ttsiouts has joined #openstack-nova | 12:49 | |
ttsiouts | gibi: Thanks for the comments on the PENDING state spec! | 12:50 |
ttsiouts | gibi: Whenever you have some time I wanted to ask you something before I update it.. | 12:50 |
*** amoralej|lunch is now known as amoralej | 12:51 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 12:51 |
gibi | ttsiouts: I have now 10 minutes before I have to join a call | 12:51 |
ttsiouts | I'll try to make it quick | 12:52 |
ttsiouts | :) | 12:52 |
ttsiouts | I wanted to ask about the note on scheduler hints.. | 12:52 |
ttsiouts | The intention was to not include them in the payload | 12:53 |
ttsiouts | but it would be really helpful to have the forced_nodes/hosts | 12:53 |
gibi | ttsiouts: I think it is a reasonable need for your Reaper to know those | 12:54 |
*** dave-mccowan has joined #openstack-nova | 12:54 | |
ttsiouts | gibi: awesome! | 12:54 |
gibi | ttsiouts: if other cores are OK to include the hints I will not block this on the hints | 12:54 |
*** shaohe_feng has quit IRC | 12:54 | |
ttsiouts | gibi: thank you very much!! I will update the spec | 12:55 |
*** pchavva has joined #openstack-nova | 12:56 | |
gibi | ttsiouts: cool. thanks for pushing that spec forward | 12:58 |
*** shaohe_feng has joined #openstack-nova | 12:59 | |
*** mchlumsky has joined #openstack-nova | 12:59 | |
openstackgerrit | Jay Pipes proposed openstack/nova-specs master: Standardize CPU resource tracking https://review.openstack.org/555081 | 13:00 |
bhagyashri_s | efried: Hi, | 13:00 |
*** andreas_s has quit IRC | 13:00 | |
gibi | ttsiouts: you can ignore my rebuild in cell0 question in the PENDING spec as I now found your other spec about rebuild in cell0 :) | 13:01 |
*** andreas_s has joined #openstack-nova | 13:01 | |
*** andreas_s has quit IRC | 13:01 | |
jaypipes | gibi: crap... just saw your comments on the cpu-resources spec. :) | 13:01 |
*** andreas_s has joined #openstack-nova | 13:01 | |
jaypipes | gibi: will answer on the last revision. | 13:01 |
*** vladikr has joined #openstack-nova | 13:02 | |
*** andreas_s has quit IRC | 13:02 | |
*** andreas_s has joined #openstack-nova | 13:03 | |
*** gbarros has quit IRC | 13:04 | |
*** andreas_s has quit IRC | 13:05 | |
*** shaohe_feng has quit IRC | 13:05 | |
gibi | jaypipes: no problem | 13:05 |
*** shaohe_feng has joined #openstack-nova | 13:05 | |
*** throwsb1 has joined #openstack-nova | 13:06 | |
efried | bhagyashri_s: Hello | 13:07 |
bhagyashri_s | efried, jaypipes, bauzas: Addressed review comments on https://review.openstack.org/#/c/560459/ could you please help to review Thank you :) | 13:07 |
efried | ack | 13:07 |
bauzas | ack | 13:07 |
*** sar has joined #openstack-nova | 13:08 | |
bhagyashri_s | efried, jaypipes, bauzas: thank you :) | 13:09 |
*** andreas_s has joined #openstack-nova | 13:09 | |
*** dtantsur|brb is now known as dtantsur | 13:10 | |
*** jbernard has quit IRC | 13:10 | |
*** jbernard has joined #openstack-nova | 13:11 | |
*** jbernard has quit IRC | 13:11 | |
*** jbernard has joined #openstack-nova | 13:12 | |
*** r-daneel has quit IRC | 13:12 | |
*** andreas_s has quit IRC | 13:13 | |
*** shaohe_feng has quit IRC | 13:15 | |
*** shaohe_feng has joined #openstack-nova | 13:16 | |
jangutter | Good $timezone! In the spirit of spec review day, is anyone interested in reviewing a spec for a $network $thingy? As a pleasant side effect, hopefully one more legacy VIF can be moved to os-vif. https://review.openstack.org/#/c/567148/ | 13:17 |
*** andreas_s has joined #openstack-nova | 13:18 | |
*** jbernard has quit IRC | 13:19 | |
*** jbernard has joined #openstack-nova | 13:19 | |
*** sar has quit IRC | 13:20 | |
*** armaan has joined #openstack-nova | 13:21 | |
*** moshele has quit IRC | 13:21 | |
*** shaohe_feng has quit IRC | 13:25 | |
*** andreas_s has quit IRC | 13:26 | |
*** esberglu has joined #openstack-nova | 13:26 | |
*** andreas_s has joined #openstack-nova | 13:27 | |
*** shaohe_feng has joined #openstack-nova | 13:27 | |
*** andreas_s has quit IRC | 13:32 | |
*** shaohe_feng has quit IRC | 13:35 | |
*** shaohe_feng has joined #openstack-nova | 13:36 | |
*** eharney has quit IRC | 13:40 | |
*** andreas_s has joined #openstack-nova | 13:41 | |
mriedem | johnthetubaguy: tssurya: dansmith: we might need to setup a call at some point for the 'handling a down' cell spec https://review.openstack.org/#/c/557369/ | 13:43 |
mriedem | lots of questions for me on that right now | 13:43 |
dansmith | okay | 13:43 |
*** andreas_s has quit IRC | 13:44 | |
*** yamamoto has quit IRC | 13:44 | |
mriedem | dansmith: you should run through the comments and discussion in there and then see what you think about a call | 13:45 |
*** ttsiouts has quit IRC | 13:45 | |
*** andreas_s has joined #openstack-nova | 13:45 | |
*** shaohe_feng has quit IRC | 13:46 | |
dansmith | mriedem: okay, before I do, do you know anything about the functional.libvirt.test_pci_sriov_servers tests? | 13:46 |
dansmith | I seem to have destabilized them as they pass in isolation but not on top of my patch when run with everything else | 13:46 |
*** shaohe_feng has joined #openstack-nova | 13:46 | |
dansmith | looks like vladik wrote them initially | 13:47 |
dansmith | maybe stephenfin knows about them? | 13:47 |
stephenfin | dansmith: It's been a while since I touched them | 13:47 |
dansmith | stephenfin: http://logs.openstack.org/95/572195/1/check/nova-tox-functional/cbf4f55/testr_results.html.gz | 13:47 |
dansmith | get that most of the time when running in parallel, but they pass when I run them by themselves | 13:48 |
dansmith | which smells like a bad mock | 13:48 |
stephenfin | Yeah, looks like there's some global state getting trashed | 13:48 |
*** andreas_s has quit IRC | 13:49 | |
naichuans | efried: Hi, Eric, do you have any suggestion about vgpu rp delete? I posted a new patch | 13:49 |
*** andreas_s has joined #openstack-nova | 13:51 | |
*** andreas_s has quit IRC | 13:51 | |
*** mlavalle has joined #openstack-nova | 13:52 | |
stephenfin | dansmith: Nothing jumps out at me :/ | 13:53 |
dansmith | nothing about that patch should be affecting global state to make that a legit failure, so I dunno | 13:53 |
dansmith | if I run just that one module in parallel it fails, | 13:54 |
dansmith | so it must be something internal to that | 13:54 |
*** andreas_s_ has joined #openstack-nova | 13:54 | |
dansmith | and not from another test | 13:54 |
stephenfin | It's always _that_ test that fails, right? | 13:54 |
*** vladikr has quit IRC | 13:54 | |
stephenfin | Or a variety of the tests from that module? | 13:54 |
dansmith | yes, but only in parallel with the other tests in that file | 13:54 |
efried | naichuans: not having looked at your update yet, the way I figured you would do it is: | 13:54 |
efried | - Construct a set of all providers in the tree whose names start with your prefix (GPUG_ or VGPU_ or whatever it was). | 13:54 |
efried | - Construct a set of all providers you *expect* there to be - i.e. the ones you've discovered from the host_data. | 13:54 |
efried | - Subtract the second set from the first. This is the set of providers you need to delete. | 13:54 |
efried | - For each provider that needs to be deleted, check for allocations. If you don't find any, you can delete the provider. If you do find allocations... I think you just have to set reserved=total and leave the provider there. | 13:54 |
dansmith | if I run just that test, it passes | 13:54 |
stephenfin | gotcha | 13:54 |
*** vladikr has joined #openstack-nova | 13:55 | |
dansmith | stephenfin: there's another one in another file under libvirt/ there that also fails occasionally, but they seem to be unrelated | 13:55 |
*** Eran_Kuris has quit IRC | 13:55 | |
*** READ10 has joined #openstack-nova | 13:56 | |
*** shaohe_feng has quit IRC | 13:56 | |
dansmith | stephenfin: is that message indicating that some mock for the system's pinnable CPUs is not set and so it's empty? or something? | 13:56 |
stephenfin | That message indicates you're trying to pin an instance but the CPUs aren't available | 13:57 |
stephenfin | Generally because they're pinned to something else | 13:57 |
naichuans | efried: OK, looks a acceptable choice, thanks. | 13:57 |
dansmith | stephenfin: that list will be empty like that if the cpus are pinned elsewhere? | 13:57 |
stephenfin | Yup | 13:57 |
*** suresh12 has joined #openstack-nova | 13:58 | |
*** andreas_s_ has quit IRC | 13:58 | |
*** ttsiouts has joined #openstack-nova | 13:58 | |
dansmith | so like another test not having deleted a server or something? | 13:58 |
mriedem | stephenfin: if you want, i can address my nits in https://review.openstack.org/#/c/541290/ | 13:58 |
dansmith | although they should all be getting an empty db | 13:58 |
stephenfin | You're saying I want to take CPUs Y from the total host set of X | 13:58 |
stephenfin | mriedem: Go for it | 13:59 |
stephenfin | mriedem: and thanks | 13:59 |
*** shaohe_feng has joined #openstack-nova | 13:59 | |
* mriedem goes for it | 13:59 | |
*** r-daneel has joined #openstack-nova | 13:59 | |
stephenfin | dansmith: It could also be that we're booting two instances consecutively from different tests | 14:00 |
dansmith | but they should have different databases and not see each other | 14:00 |
stephenfin | except, yeah, each test gets its own sqlite DB | 14:00 |
stephenfin | Hmm | 14:00 |
mriedem | do the fake hosts/nodes in the tests have the same name? | 14:00 |
mriedem | because the nova.tests.unit.virt.fake set_nodes or whatever is global | 14:01 |
mriedem | one of the tests might not be resetting the fake node on cleanup? | 14:01 |
dansmith | yeah | 14:01 |
dansmith | I don't see them using fake set_nodes | 14:01 |
dansmith | unless it's somewhere else | 14:01 |
mriedem | parent class? | 14:02 |
dansmith | I don't think so.. they | 14:02 |
dansmith | are starting their own compute service for some reason | 14:02 |
*** armaan has quit IRC | 14:02 | |
dansmith | maybe so they can control the topology | 14:02 |
stephenfin | dansmith: Yeah, that | 14:03 |
*** awaugama has joined #openstack-nova | 14:03 | |
*** armaan has joined #openstack-nova | 14:03 | |
stephenfin | That's stored in nova.objects.compute_node.ComputeNode.numa_topology, which I think is created on startup for nova-compute | 14:04 |
dansmith | and they don't do fake node set in the parent class(es) | 14:04 |
*** germs has joined #openstack-nova | 14:06 | |
tssurya | mriedem: yea that spec is going crazy | 14:06 |
*** shaohe_feng has quit IRC | 14:06 | |
dansmith | stephenfin: hmm, just got two failures from that module in one run, so something is definitely wonky there | 14:06 |
stephenfin | dansmith: Yeah, I'm taking a look at it now | 14:07 |
dansmith | I really can't think of why my patch would be affecting this kind of thing | 14:07 |
*** shaohe_feng has joined #openstack-nova | 14:07 | |
*** suresh12 has quit IRC | 14:08 | |
*** rodolof has joined #openstack-nova | 14:08 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Add 'numa-aware-vswitches' spec https://review.openstack.org/541290 | 14:09 |
mriedem | stephenfin: fyi https://review.openstack.org/#/c/541290/17..18/specs/rocky/approved/numa-aware-vswitches.rst | 14:09 |
mriedem | stephenfin: also, i haven't gone through the code series in detail yet, but it would be best if the api changes for this come at the end of the series | 14:10 |
mriedem | so build everything from the bottom up | 14:10 |
stephenfin | mriedem: Which API? | 14:10 |
stephenfin | The neutron one? | 14:10 |
mriedem | i.e. create_pci_requests_for_sriov_ports populating InstanceNUMANetworks to set in the RequestSpec comes last | 14:10 |
stephenfin | gotcha | 14:11 |
mriedem | yeah | 14:11 |
*** germs has quit IRC | 14:11 | |
mriedem | then nothing gets 'turned on' until the end | 14:11 |
dansmith | oh, I bet I know something related | 14:11 |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create https://review.openstack.org/520313 | 14:11 |
*** andreas_s has joined #openstack-nova | 14:12 | |
*** andreas_s has quit IRC | 14:12 | |
*** ccamacho has quit IRC | 14:12 | |
*** ccamacho1 has joined #openstack-nova | 14:12 | |
*** andreas_s has joined #openstack-nova | 14:12 | |
*** andreas_s has quit IRC | 14:13 | |
*** andreas_s has joined #openstack-nova | 14:13 | |
dansmith | stephenfin: I'm calling update_available_resource() now after build success or failure.. is there something that might not be set up that would prevent that from working or something? | 14:14 |
stephenfin | dansmith: Well, reverting that chunk "fixes" things | 14:16 |
dansmith | the update? | 14:16 |
stephenfin | aye | 14:16 |
*** shaohe_feng has quit IRC | 14:16 | |
stephenfin | at least, locally | 14:17 |
stephenfin | I've run it a few times and it passed each time with the HEAD~ version of that file | 14:17 |
dansmith | I see it failing during _delete_server, FWIW, but I wonder if delete just fails because the create left something in a bad state | 14:17 |
dansmith | stephenfin: so....the update fails because we have a half-created instance with topology that we can't satisfy, yeah? | 14:18 |
*** shaohe_feng has joined #openstack-nova | 14:18 | |
dansmith | seems like we'd hit this in real life if that's the case, if a periodic ran during a failed schedule or something | 14:18 |
dansmith | because that update call happens all over the place | 14:18 |
stephenfin | Like you said, it could be a buggy test too | 14:19 |
dansmith | well, I'm not really sure where to go from here | 14:19 |
dansmith | this is kinda like the bug we saw with the DiskNotFound, | 14:20 |
dansmith | where that error for a single instance will block nova from updating the RT for everything on the host | 14:20 |
stephenfin | Hmm, now I can't get the tests to _fail_ again | 14:21 |
dansmith | so maybe we should catch this exception somewhere, log it at error and allow the RT to proceed? | 14:21 |
mriedem | the functional tests shouldn't need to do their own delete server, unless they are intentionally trying to make sure the server is gone - because the test tearDown will wipe the db | 14:21 |
dansmith | mriedem: yeah | 14:21 |
*** hongbin has joined #openstack-nova | 14:21 | |
dansmith | removing that might make the test failure go away, but it feels kinda dirty | 14:22 |
dansmith | although the test checks that the instance goes active, so.. | 14:23 |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): Add API to support vgpu resource provider create https://review.openstack.org/520313 | 14:23 |
mriedem | well, the test waits for the server to be != 'BUILD' | 14:24 |
mriedem | which has always bugged me | 14:24 |
mriedem | oh update_available_resource_for_node | 14:24 |
mriedem | oops | 14:24 |
mriedem | end_status='ACTIVE' i see | 14:24 |
stephenfin | dansmith: Yeah, I think that's what's happening | 14:25 |
dansmith | stephenfin: what? | 14:25 |
mriedem | what is calling update_available_resource_for_node ? | 14:25 |
dansmith | mriedem: update_available_resource() is, which is what I'm calling from build_success/failure | 14:25 |
stephenfin | dansmith: you're now calling 'update_available_resource' which iterates through instances to extra their numa_topology | 14:25 |
stephenfin | and updates utilization based on that | 14:25 |
dansmith | stephenfin: oh and hitting the incomplete instance or something? | 14:26 |
stephenfin | yeah, I'd imagine so | 14:26 |
dansmith | so that's a bug in the actual code then, yeah? | 14:26 |
mriedem | seems weird that the stacktrace in the test failure doesn't include _build_succeeded | 14:26 |
dansmith | mriedem: yeah, idk why that is | 14:26 |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P):Get vgpu info from `allocations` https://review.openstack.org/521717 | 14:26 |
openstackgerrit | Naichuan Sun proposed openstack/nova master: xenapi(N-R-P): support compute node resource provider update https://review.openstack.org/521041 | 14:27 |
*** shaohe_feng has quit IRC | 14:27 | |
*** itlinux has quit IRC | 14:27 | |
dansmith | so removing the _delete_server call from that test seems to make it happy, but I think it's still failing to do that update under the covers, we're just not seeing it or whatever | 14:27 |
*** shaohe_feng has joined #openstack-nova | 14:27 | |
dansmith | yeah, so I get a NUMAServersTest failure now in _delete | 14:29 |
stephenfin | dansmith: This line is probably getting called multiple times https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L948-L951 | 14:29 |
dansmith | that's multiple lines.. do you mean L949? | 14:30 |
stephenfin | So we're double freeing, kind of. This is starting to feel familiar but I'm not sure why | 14:30 |
stephenfin | yup | 14:30 |
*** dklyle has joined #openstack-nova | 14:30 | |
dansmith | okay, but that shouldn't be a problem with repeated calls to update_available_resource()... since it starts fresh when it does that right? | 14:30 |
stephenfin | Well if compute is thinking the instance is gone, it could be freeing on the first call to that function (the one you added) and then attempting to do so again on our call (the API call to delete) | 14:32 |
stephenfin | which triggers this, I imagine? https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L1127 | 14:32 |
dansmith | mriedem: you know, unrelated (kinda) to this test failure, we could just increase the counter and depend on the next periodic run of update_available_resources() to update our counter, | 14:32 |
dansmith | which means we might be failbait for 60s or whatever you have that timer set to, but then we'll update our stuff and get pulled out | 14:33 |
dansmith | which would save a bunch of cpu and db updates on each build | 14:33 |
dansmith | stephenfin: not sure that's how that works.. update_available_resource can run at whatever interval it's set to.. it should be idempotent, generating a fresh view of resources all the time, never having partial side effects or anything like that | 14:34 |
*** shaohe_feng has quit IRC | 14:37 | |
*** shaohe_feng has joined #openstack-nova | 14:38 | |
stephenfin | dansmith: Right but...dodgy tests. Perhaps that was never triggered before (the interval would be too short) | 14:38 |
mriedem | dansmith: yeah....also, _update_available_resource is going to take the big COMPUTE_RESOURCE_SEMAPHORE lock | 14:39 |
mriedem | when all you really wanted to do was update the compute_node.stats field | 14:39 |
dansmith | stephenfin: well, I don't see how the tests would cause this to be broken.. I think it has to be broken in the code and we just never poke this (and notice) in tests right? | 14:39 |
dansmith | mriedem: yeah, the more I think about it, that'd be a better approach | 14:39 |
mriedem | OR | 14:39 |
dansmith | mriedem: and would remove a ton of unit test noise I had to add | 14:39 |
mriedem | RT.abort_instance_claim could do the build failure count | 14:40 |
mriedem | but, if we fail before we get to the instance claim, then that won't count the build failure | 14:40 |
mriedem | but abort_instance_claim does update the compute node record | 14:41 |
dansmith | yeah, that runs before where I'm increasing right? | 14:41 |
mriedem | yes | 14:41 |
dansmith | that's why Isaid in my comment just now that the next instance failure would update it for us | 14:41 |
dansmith | which I think is reasonable lazy update behavior to avoid the synchronous update | 14:41 |
dansmith | plus, 60s by default | 14:41 |
*** derekh has quit IRC | 14:44 | |
*** tidwellr has joined #openstack-nova | 14:44 | |
*** jiteka has joined #openstack-nova | 14:44 | |
mriedem | yeah that makes sense | 14:44 |
*** yamamoto has joined #openstack-nova | 14:45 | |
dansmith | aight, well, that likely removes this from my path, | 14:45 |
*** jitek4 has quit IRC | 14:45 | |
dansmith | although I still am concerned that something ain't right in that numa accounting path | 14:45 |
*** eandersson_ has joined #openstack-nova | 14:45 | |
*** eandersson has quit IRC | 14:45 | |
dansmith | although it will make my testing a little harder to make deterministic | 14:46 |
dansmith | you know, I had this thing for functional tests that let me trigger periodics reliably that got shot down with fire....... | 14:46 |
*** ivve has joined #openstack-nova | 14:46 | |
*** sar has joined #openstack-nova | 14:47 | |
*** shaohe_feng has quit IRC | 14:47 | |
mriedem | i'll assume i wasn't on the firing end of that | 14:47 |
*** lpetrut has quit IRC | 14:49 | |
dansmith | nope | 14:49 |
*** rodolof has quit IRC | 14:50 | |
*** shaohe_feng has joined #openstack-nova | 14:50 | |
*** yamamoto has quit IRC | 14:51 | |
*** sar has quit IRC | 14:52 | |
*** mriedem has quit IRC | 14:53 | |
efried | melwitt: We got a dashboard or anything for spec reviewing? | 14:53 |
*** mriedem has joined #openstack-nova | 14:53 | |
*** yamamoto has joined #openstack-nova | 14:56 | |
*** shaohe_feng has quit IRC | 14:57 | |
*** rodolof has joined #openstack-nova | 14:58 | |
*** cdent has joined #openstack-nova | 14:58 | |
*** slaweq_ has joined #openstack-nova | 14:58 | |
stephenfin | efried: I use https://goo.gl/EjSxKw | 14:58 |
*** slaweq has quit IRC | 14:58 | |
efried | stephenfin: Thanks! | 14:58 |
stephenfin | efried: The tail end | 14:59 |
*** shaohe_feng has joined #openstack-nova | 14:59 | |
efried | is that all the specs we got? That ain't so bad :) | 14:59 |
stephenfin | It's limited at 20, so no :) | 14:59 |
stephenfin | there's the full one https://review.openstack.org/#/q/project:openstack/nova-specs+status:open | 15:00 |
*** yamamoto has quit IRC | 15:01 | |
*** Luzi has quit IRC | 15:03 | |
*** tbachman has quit IRC | 15:03 | |
*** dpawlik has quit IRC | 15:03 | |
*** pcaruana has quit IRC | 15:05 | |
*** shaohe_feng has quit IRC | 15:08 | |
openstackgerrit | Surya Seetharaman proposed openstack/nova-specs master: Handling a down cell https://review.openstack.org/557369 | 15:08 |
*** tbachman has joined #openstack-nova | 15:09 | |
*** shaohe_feng has joined #openstack-nova | 15:10 | |
*** zhaochao has quit IRC | 15:16 | |
*** shaohe_feng has quit IRC | 15:18 | |
*** artom has quit IRC | 15:18 | |
*** shaohe_feng has joined #openstack-nova | 15:19 | |
*** itlinux has joined #openstack-nova | 15:19 | |
openstackgerrit | Theodoros Tsioutsias proposed openstack/nova-specs master: Add PENDING vm state https://review.openstack.org/554212 | 15:19 |
*** ccamacho1 has quit IRC | 15:19 | |
*** fragatina has quit IRC | 15:20 | |
*** imacdonn has joined #openstack-nova | 15:20 | |
*** fragatina has joined #openstack-nova | 15:20 | |
*** mike99201 has left #openstack-nova | 15:21 | |
*** andreas_s has quit IRC | 15:21 | |
*** andreas_s has joined #openstack-nova | 15:22 | |
*** udesale has joined #openstack-nova | 15:24 | |
*** tbachman has quit IRC | 15:24 | |
mriedem | this is my specs review dashboard http://tiny.cc/2g1sty | 15:25 |
*** Bhujay has quit IRC | 15:26 | |
*** udesale has quit IRC | 15:26 | |
*** udesale has joined #openstack-nova | 15:27 | |
*** shaohe_feng has quit IRC | 15:28 | |
*** udesale has quit IRC | 15:28 | |
*** shaohe_feng has joined #openstack-nova | 15:29 | |
*** slaweq has joined #openstack-nova | 15:29 | |
*** nguyenhai93 has joined #openstack-nova | 15:29 | |
*** tbachman has joined #openstack-nova | 15:29 | |
*** udesale has joined #openstack-nova | 15:29 | |
*** udesale has quit IRC | 15:30 | |
*** andreas_s has quit IRC | 15:31 | |
*** nguyenhai_ has quit IRC | 15:32 | |
*** slaweq_ has quit IRC | 15:33 | |
*** tidwellr has quit IRC | 15:33 | |
*** udesale has joined #openstack-nova | 15:33 | |
*** udesale has quit IRC | 15:34 | |
*** ratailor has quit IRC | 15:34 | |
*** tidwellr has joined #openstack-nova | 15:34 | |
*** tbachman has quit IRC | 15:35 | |
*** lifeless_ has joined #openstack-nova | 15:35 | |
*** eharney has joined #openstack-nova | 15:35 | |
*** lifeless has quit IRC | 15:36 | |
*** tbachman has joined #openstack-nova | 15:36 | |
stephenfin | Can someone with +2 for nova-specs put this in? The guy has been refreshing it pretty much continuously since March and it's valid IMO https://review.openstack.org/#/c/551802/ | 15:36 |
*** janki has quit IRC | 15:37 | |
*** shaohe_feng has quit IRC | 15:38 | |
*** ttsiouts has quit IRC | 15:39 | |
*** klindgren_ has joined #openstack-nova | 15:39 | |
*** shaohe_feng has joined #openstack-nova | 15:39 | |
*** ttsiouts has joined #openstack-nova | 15:44 | |
*** mchlumsky has quit IRC | 15:45 | |
*** mchlumsky has joined #openstack-nova | 15:47 | |
*** shaohe_feng has quit IRC | 15:49 | |
*** shaohe_feng has joined #openstack-nova | 15:50 | |
*** jmlowe has quit IRC | 15:50 | |
*** Phuongnh has joined #openstack-nova | 15:51 | |
*** nmathew has quit IRC | 15:52 | |
*** wwriverrat_ has joined #openstack-nova | 15:53 | |
*** dpawlik has joined #openstack-nova | 15:53 | |
*** wwriverrat has quit IRC | 15:55 | |
*** wwriverrat_ is now known as wwriverrat | 15:55 | |
*** chyka has joined #openstack-nova | 15:56 | |
*** tssurya has quit IRC | 15:57 | |
*** bigdogstl has joined #openstack-nova | 15:57 | |
*** yamamoto has joined #openstack-nova | 15:58 | |
*** dpawlik has quit IRC | 15:58 | |
mdbooth | mriedem: If I've read it correctly, AttachVolumeMultiAttachTest.test_volume_swap_with_multiattach seems to test something which I'd expect us to forbid, because it can't work. | 15:59 |
*** shaohe_feng has quit IRC | 15:59 | |
mdbooth | It looks like we attach a volume to 2 servers | 15:59 |
*** shaohe_feng has joined #openstack-nova | 16:00 | |
mdbooth | Then do a swap volume to a new volume on one of the servers | 16:00 |
*** gyee has joined #openstack-nova | 16:00 | |
mdbooth | The problem is, IIUC that's a block migration, and there's no way for the block migration on server 1 to know about writes on server 2 | 16:01 |
mdbooth | So the resulting data on volume2 attached to server1 is going to be inconsistent, and there's nothing you can do about it in either guest | 16:01 |
*** bigdogstl has quit IRC | 16:02 | |
* mdbooth thought we just forbid swap volumey things on multiattach volumes | 16:02 | |
mriedem | stephenfin: done | 16:02 |
mdbooth | forbade? | 16:02 |
*** yamamoto has quit IRC | 16:03 | |
stephenfin | mriedem: cheers | 16:03 |
mdbooth | forbode? No, definitely not. Perhaps appropriate, though. | 16:03 |
mriedem | mdbooth: cinder forbids a retype to/from multiattach capability for an in-use volume | 16:03 |
mriedem | also on a call atm | 16:03 |
mriedem | THE call | 16:03 |
mdbooth | mriedem: np | 16:03 |
*** links has quit IRC | 16:03 | |
*** slaweq_ has joined #openstack-nova | 16:05 | |
*** germs has joined #openstack-nova | 16:07 | |
*** germs has quit IRC | 16:07 | |
*** germs has joined #openstack-nova | 16:07 | |
*** tidwellr has quit IRC | 16:09 | |
*** germs has quit IRC | 16:09 | |
*** slaweq has quit IRC | 16:09 | |
*** slaweq_ is now known as slaweq | 16:09 | |
*** germs has joined #openstack-nova | 16:09 | |
*** germs has quit IRC | 16:09 | |
*** germs has joined #openstack-nova | 16:09 | |
*** shaohe_feng has quit IRC | 16:09 | |
*** germs has quit IRC | 16:09 | |
*** shaohe_feng has joined #openstack-nova | 16:10 | |
*** germs has joined #openstack-nova | 16:10 | |
openstackgerrit | Merged openstack/nova-specs master: Follow the new PTI for document build https://review.openstack.org/551802 | 16:13 |
*** bpoulos has joined #openstack-nova | 16:15 | |
*** ttsiouts has quit IRC | 16:15 | |
*** shaohe_feng has quit IRC | 16:19 | |
*** shaohe_feng has joined #openstack-nova | 16:20 | |
*** brault has joined #openstack-nova | 16:22 | |
*** tidwellr has joined #openstack-nova | 16:24 | |
*** suresh12 has joined #openstack-nova | 16:25 | |
*** brault_ has joined #openstack-nova | 16:27 | |
*** harlowja has joined #openstack-nova | 16:28 | |
*** Phuongnh has quit IRC | 16:29 | |
*** brault has quit IRC | 16:29 | |
*** Phuongnh has joined #openstack-nova | 16:29 | |
melwitt | efried: yeah, no specific dashboard. just whatever you normally like to use for specs | 16:29 |
*** shaohe_feng has quit IRC | 16:30 | |
*** shaohe_feng has joined #openstack-nova | 16:31 | |
openstackgerrit | Merged openstack/nova master: Fix bug for hypervisors https://review.openstack.org/572063 | 16:35 |
openstackgerrit | Merged openstack/nova master: Fix bug to doc https://review.openstack.org/572268 | 16:36 |
*** shaohe_feng has quit IRC | 16:40 | |
*** shaohe_feng has joined #openstack-nova | 16:40 | |
mriedem | dansmith: i know i say this every 3 days, but i think stephenfin's numa aware vswitches spec is ready to go https://review.openstack.org/#/c/541290/ | 16:40 |
efried | We should really have a spec review day so we can merge that thing. | 16:41 |
dansmith | mriedem: can I skip this one and wait three days until it's ready again? | 16:42 |
mriedem | no | 16:42 |
*** brault has joined #openstack-nova | 16:43 | |
*** issp has quit IRC | 16:44 | |
dansmith | damn | 16:45 |
*** harlowja has quit IRC | 16:45 | |
*** brault_ has quit IRC | 16:47 | |
dansmith | I feel like the proof is in the code anyway and I'm out of steam on the spec | 16:48 |
*** Phuongnh has quit IRC | 16:48 | |
dansmith | so, damn the torpedoes | 16:48 |
*** Phuong_nh has joined #openstack-nova | 16:48 | |
mriedem | yeah i already went through the code series this morning and made notes on the patches about what needs to change | 16:49 |
mriedem | at a high level | 16:49 |
*** yamamoto has joined #openstack-nova | 16:50 | |
*** shaohe_feng has quit IRC | 16:50 | |
*** shaohe_feng has joined #openstack-nova | 16:51 | |
openstackgerrit | Merged openstack/nova stable/queens: Allow cinderv2 endpoints within the request context catalog https://review.openstack.org/572213 | 16:52 |
*** bigdogstl has joined #openstack-nova | 16:53 | |
*** brault has quit IRC | 16:53 | |
*** artom has joined #openstack-nova | 16:54 | |
openstackgerrit | Merged openstack/nova-specs master: Add 'numa-aware-vswitches' spec https://review.openstack.org/541290 | 16:56 |
*** brault has joined #openstack-nova | 16:57 | |
*** pchavva has quit IRC | 16:57 | |
*** jaosorior has quit IRC | 16:58 | |
*** brault has quit IRC | 16:59 | |
*** cdent has quit IRC | 16:59 | |
*** cdent_ has joined #openstack-nova | 16:59 | |
*** yamamoto has quit IRC | 17:00 | |
*** pchavva has joined #openstack-nova | 17:00 | |
*** shaohe_feng has quit IRC | 17:00 | |
*** shaohe_feng has joined #openstack-nova | 17:01 | |
*** Phuong_nh has quit IRC | 17:01 | |
*** masuberu has quit IRC | 17:02 | |
*** masuberu has joined #openstack-nova | 17:02 | |
*** slaweq has quit IRC | 17:04 | |
*** slaweq has joined #openstack-nova | 17:04 | |
*** artom has quit IRC | 17:07 | |
efried | bhagyashri_s: Greate work on https://review.openstack.org/#/c/560459/ -- just a couple of minor things and I think it's ready to go. I'm going to have to let other cores (probably bauzas and jaypipes) approve it, since I contributed to the fix. | 17:10 |
*** ralonsoh_ has quit IRC | 17:10 | |
*** jpena is now known as jpena|off | 17:10 | |
*** shaohe_feng has quit IRC | 17:11 | |
*** shaohe_feng has joined #openstack-nova | 17:12 | |
*** cdent_ is now known as cdent | 17:13 | |
*** lpetrut has joined #openstack-nova | 17:13 | |
*** armaan has quit IRC | 17:15 | |
*** armaan has joined #openstack-nova | 17:15 | |
*** tidwellr has quit IRC | 17:17 | |
*** shaohe_feng has quit IRC | 17:21 | |
*** myrat_ has joined #openstack-nova | 17:21 | |
*** vivsoni_ has joined #openstack-nova | 17:22 | |
*** tssurya has joined #openstack-nova | 17:22 | |
*** myrat has quit IRC | 17:23 | |
*** shaohe_feng has joined #openstack-nova | 17:24 | |
*** dtantsur is now known as dtantsur|afk | 17:24 | |
*** suresh12 has quit IRC | 17:25 | |
*** ivve has quit IRC | 17:25 | |
*** rajinir has joined #openstack-nova | 17:26 | |
*** lifeless has joined #openstack-nova | 17:26 | |
*** yamahata has joined #openstack-nova | 17:27 | |
*** AlexeyAbashkin has quit IRC | 17:28 | |
*** lifeless_ has quit IRC | 17:28 | |
*** amoralej is now known as amoralej|off | 17:28 | |
*** isq has joined #openstack-nova | 17:29 | |
*** pchavva has quit IRC | 17:29 | |
*** dpawlik has joined #openstack-nova | 17:30 | |
openstackgerrit | Chris Friesen proposed openstack/nova-specs master: Add support for emulated virtual TPM https://review.openstack.org/571111 | 17:31 |
*** lpetrut has quit IRC | 17:31 | |
*** shaohe_feng has quit IRC | 17:31 | |
*** shaohe_feng has joined #openstack-nova | 17:32 | |
*** tidwellr has joined #openstack-nova | 17:35 | |
*** sahid has quit IRC | 17:35 | |
*** isssp has joined #openstack-nova | 17:35 | |
*** sambetts is now known as sambetts|afk | 17:36 | |
*** dpawlik has quit IRC | 17:36 | |
*** dpawlik has joined #openstack-nova | 17:36 | |
*** dpawlik has quit IRC | 17:39 | |
*** ispp has quit IRC | 17:40 | |
*** shaohe_feng has quit IRC | 17:41 | |
*** shaohe_feng has joined #openstack-nova | 17:43 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: mention that you can't re-parent a resource provider https://review.openstack.org/572501 | 17:45 |
*** ccamacho has joined #openstack-nova | 17:46 | |
*** vivsoni_ has quit IRC | 17:48 | |
*** shaohe_feng has quit IRC | 17:52 | |
*** shaohe_feng has joined #openstack-nova | 17:52 | |
*** armaan has quit IRC | 17:53 | |
*** armaan has joined #openstack-nova | 17:53 | |
*** lpetrut has joined #openstack-nova | 17:55 | |
*** tbachman has quit IRC | 17:55 | |
*** yamamoto has joined #openstack-nova | 17:56 | |
*** armaan has quit IRC | 17:58 | |
*** ccamacho has quit IRC | 18:00 | |
*** jmlowe has joined #openstack-nova | 18:01 | |
*** yamamoto has quit IRC | 18:02 | |
*** shaohe_feng has quit IRC | 18:02 | |
*** shaohe_feng has joined #openstack-nova | 18:02 | |
*** bigdogstl has quit IRC | 18:04 | |
*** bigdogstl has joined #openstack-nova | 18:09 | |
*** suresh12 has joined #openstack-nova | 18:10 | |
*** myrat_ has quit IRC | 18:12 | |
*** suresh12_ has joined #openstack-nova | 18:12 | |
*** shaohe_feng has quit IRC | 18:12 | |
*** shaohe_feng has joined #openstack-nova | 18:12 | |
*** suresh12 has quit IRC | 18:13 | |
*** mgoddard has quit IRC | 18:16 | |
openstackgerrit | Dan Smith proposed openstack/nova master: Change consecutive build failure limit to a weigher https://review.openstack.org/572195 | 18:18 |
*** shaohe_feng has quit IRC | 18:22 | |
*** shaohe_feng has joined #openstack-nova | 18:23 | |
*** jmlowe has quit IRC | 18:30 | |
*** shaohe_feng has quit IRC | 18:33 | |
*** shaohe_feng has joined #openstack-nova | 18:33 | |
*** jmlowe has joined #openstack-nova | 18:34 | |
*** bigdogstl has quit IRC | 18:40 | |
*** edmondsw has quit IRC | 18:41 | |
*** EmilienM is now known as EmilienM|PTO | 18:43 | |
*** mvk has quit IRC | 18:43 | |
*** shaohe_feng has quit IRC | 18:43 | |
*** shaohe_feng has joined #openstack-nova | 18:45 | |
*** tbachman has joined #openstack-nova | 18:49 | |
*** shaohe_feng has quit IRC | 18:53 | |
*** shaohe_feng has joined #openstack-nova | 18:55 | |
mriedem | dansmith: melwitt: tssurya: on the handling a down cell spec, https://review.openstack.org/#/c/557369/ - i'm thinking that if the user is filtering or paging while listing instances, we need to ignore down cells | 18:55 |
mriedem | because we can't provide accurate results in that case | 18:55 |
mriedem | not that we're providing much in the way of results with just a flat 'nova list', but at least it's a dump of all instances (under the default limit) with minimal fields specified | 18:56 |
dansmith | you mean sorting? | 18:56 |
melwitt | yeah, either that or do the minimal shell of an instance thing for those in down cells | 18:56 |
tssurya | mriedem: yes makes sense, | 18:57 |
mriedem | dansmith: no, filtering | 18:57 |
dansmith | if they're sorting we can't really show the shells, | 18:57 |
dansmith | since we don't know what the sort key value is | 18:57 |
mriedem | sorting kind of goes out the window as well | 18:57 |
dansmith | same for filtering I guess | 18:57 |
mriedem | melwitt: the minimal shell is the problem when filtering | 18:57 |
tssurya | if its the default sorting, I think it uses created_at, | 18:57 |
*** pchavva has joined #openstack-nova | 18:57 | |
mriedem | if i'm doing 'nova list --status PAUSED', don't show me 4 PAUSED instances and 100 UNKNOWN instances | 18:57 |
melwitt | oh | 18:57 |
melwitt | yeah | 18:58 |
dansmith | right | 18:58 |
mriedem | if i do: nova list --all-tenants | 18:58 |
mriedem | then sure, give me the dump | 18:58 |
*** eharney has quit IRC | 18:58 | |
*** yamamoto has joined #openstack-nova | 18:58 | |
mriedem | tssurya: yes by default we sort by created_at in desc order https://github.com/openstack/nova/blob/master/nova/api/openstack/common.py#L143 | 18:59 |
mriedem | which we can achieve with the instance mappings records | 18:59 |
tssurya | mriedem: yes | 18:59 |
*** links has joined #openstack-nova | 18:59 | |
mriedem | if i'm sorting by status and i have UNKNOWN minimals, then i guess those just get sorted too | 18:59 |
tssurya | so let's just support simple and plain nova list and if any additional arguments are specified, we give 500 ? | 18:59 |
tssurya | so that its consistent | 19:00 |
mriedem | no, i'm saying if there are filter parameters, we do what we can with the cells that respond, but ignore the ones that dont | 19:00 |
mriedem | i honestly don't know how this is going to be used in all cases, or what's really needed | 19:00 |
tssurya | right, | 19:01 |
mriedem | like, does the caller need some indication that there are down cells? if so, would returning a new header help with that? | 19:01 |
mriedem | but a non-admin user shouldn't know there are down cells | 19:01 |
dansmith | I think the most important thing is to avoid a 500 when there's a down cell, | 19:01 |
dansmith | the more info we can return the better, | 19:01 |
dansmith | but even if we skip everything in a down cell, that's incremental progress, then returning shells when they wouldn't be otherwise filtered out is progress on top of that, etc | 19:02 |
mriedem | agree, and i think the first part of that could be done as a bug fix and backported | 19:02 |
dansmith | yep | 19:02 |
tssurya | users shouldn't know anything about cells, however in order to avoid 500, if like mriedem said about filters, -> i.e to still process output from up cells, it would be inconsistent right ? | 19:03 |
tssurya | I mean not the right results | 19:03 |
*** yamamoto has quit IRC | 19:03 | |
mriedem | if i'm a user and i get instances back with just a bunch of UNKNOWN values, i'm goign to know my instance is in a down cell | 19:03 |
tssurya | yes this is if its plain nova list, | 19:03 |
*** shaohe_feng has quit IRC | 19:03 | |
tssurya | if we do this with nova list --status PAUSED then ? | 19:04 |
*** shaohe_feng has joined #openstack-nova | 19:04 | |
tssurya | like you said above, if we display results only from up cells and ignore down ones, it means we are missing stuff | 19:04 |
tssurya | we will not be showing any UNKNOWNS there right ? | 19:04 |
mriedem | i don't know of a better way to say "don't know" w/o just not including those results | 19:04 |
dansmith | if an instance is in a down cell, its state is UNKNOWN, | 19:05 |
dansmith | so if you asked for PAUSED, then UNKNOWN is not matching the filter | 19:05 |
tssurya | okay not status I mean other filters | 19:05 |
tssurya | like --marker | 19:06 |
dansmith | if you get a marker to an instance that is in a cell that goes down between pages, then you have to fail | 19:06 |
tssurya | I guess what I am trying to say is at some point we can't avoid a 500 ? | 19:06 |
tssurya | okay, yes | 19:06 |
dansmith | if you know an instance provided as a marker is in a down cell, then a 500 is appropriate | 19:06 |
*** edmondsw has joined #openstack-nova | 19:07 | |
dansmith | that might be the only case though.. are there others you think warrant a 500? | 19:07 |
mriedem | i don't know if we'd 400 on that today or not | 19:07 |
mriedem | usually we'd get marker not found and return a 400 | 19:07 |
dansmith | right, but that would be wrong here | 19:07 |
dansmith | because we know it exists, we just can't get to it | 19:07 |
tssurya | --availability-zone, like matt was saying in the spec ? | 19:08 |
dansmith | that would be similar to 503 Proxy Error | 19:08 |
dansmith | if you're just filtering by az, then you return shells for the things in there right? | 19:08 |
mgagne | mriedem: currently trying to deploy queens, ++ for policy deprecation warnings. grrrreatly appreciated. | 19:08 |
tssurya | dansmith: I honestly don't know at this point | 19:09 |
mriedem | mgagne: thank johnthetubaguy and gmann for those | 19:09 |
tssurya | dansmith: I will try to go through all the nova list args and see | 19:10 |
dansmith | tssurya: I think you probably will just have to consider the appropriate behavior for each | 19:10 |
mgagne | johnthetubaguy, gmann: I greatly appreciate the work you have done with policy deprecation warnings. it's of great help when upgrading ++ | 19:10 |
dansmith | for most, shell instances or omission is the best idea I think, | 19:11 |
mriedem | i assume that filtering on az would be the same as status - we can't know, so ignore those results in a down cell | 19:11 |
dansmith | 500 for marker | 19:11 |
tssurya | dansmith: ack, | 19:11 |
dansmith | mriedem: oh right, duh, I forgot we couldn't know the instances in there | 19:11 |
dansmith | mriedem: we know hosts and instances in hosts, so we could work it out I guess | 19:11 |
mriedem | i don't think we know instances in hosts from the api | 19:12 |
dansmith | er, no | 19:12 |
dansmith | right | 19:12 |
dansmith | I was thinking instance->cell->host->az, but that's not fine-grained enough | 19:12 |
dansmith | obvi | 19:12 |
tssurya | mriedem: right so we print one shell for the down cell and print the results from the rest | 19:12 |
*** edmondsw_ has joined #openstack-nova | 19:12 | |
tssurya | this way users can know that the result is not fully right | 19:13 |
dansmith | hmm? | 19:13 |
dansmith | one shell per down cell? | 19:13 |
dansmith | I think you just have to leave out all shells for instances you can't tell are in an az | 19:13 |
tssurya | dansmith: oh okay | 19:13 |
tssurya | that wfm as well | 19:13 |
mriedem | would be helpful if we weren't talking about CLI UX wrt REST API semantics | 19:14 |
*** shaohe_feng has quit IRC | 19:14 | |
mriedem | would we ignore down cells if we're paging? let's say i've got 3 cells, A, B and C. my marker is in A, B is down, but C is up, so i get some instances from A, skip B and get the rest of the page from C with a new marker in C? | 19:15 |
dansmith | if you're doing no sort or filter, you could show B instances too | 19:15 |
*** edmondsw has quit IRC | 19:15 | |
dansmith | if you are, then you have to skip | 19:15 |
*** shaohe_feng has joined #openstack-nova | 19:16 | |
mriedem | ok posted some edge case stuff in the spec | 19:17 |
tssurya | mriedem: thanks, will have a look | 19:17 |
mriedem | also, i'm annoyed that i feel the need to qualify "edge case" lately as "not computers at the edge of a network, but rare scenarios" | 19:17 |
dansmith | heh | 19:18 |
tssurya | so we are going for a new API response ? | 19:18 |
melwitt | MFIN EDGE | 19:18 |
mriedem | tssurya: doesn't sound like it | 19:18 |
tssurya | and since we were on the topic of markers, I have this bug https://bugs.launchpad.net/nova/+bug/1773945 | 19:18 |
openstack | Launchpad bug 1773945 in OpenStack Compute (nova) "nova client servers.list crashes with bad marker" [Undecided,New] - Assigned to Surya Seetharaman (tssurya) | 19:18 |
tssurya | couldn't figure out what the issue is | 19:18 |
tssurya | if any of you have ideas | 19:19 |
*** AlexeyAbashkin has joined #openstack-nova | 19:19 | |
mriedem | i saw something really weird the other day with markers | 19:19 |
mriedem | with osc | 19:19 |
mriedem | which uses nova python API bindings | 19:20 |
tssurya | oh | 19:20 |
mriedem | i was creating some instances when rabbitmq dropped | 19:20 |
mriedem | and i think it might have been what takashi said in the bug report, "if the record of the marker VM instance exists in the cell | 19:21 |
mriedem | but the 'cell_mapping' in the InstanceMapping of the marker VM instance is null (None), | 19:21 |
mriedem | the issue occurs." | 19:21 |
tssurya | but this would happen only during schedule time right ? | 19:21 |
tssurya | I thought takashi was right too at first | 19:22 |
mriedem | rabbit died during scheduling | 19:22 |
*** Alexey_Abashkin has joined #openstack-nova | 19:22 | |
tssurya | ah :D | 19:22 |
mriedem | the weird thing is when i was debugging the CLI, it was passing a marker | 19:22 |
mriedem | and i don't know where that marker was coming from | 19:22 |
dansmith | tssurya: is that bug not just that the marker gets deleted during the paging? | 19:22 |
dansmith | oh, no, we do read_deleted=yes it | 19:23 |
tssurya | yea | 19:23 |
*** AlexeyAbashkin has quit IRC | 19:23 | |
*** Alexey_Abashkin is now known as AlexeyAbashkin | 19:23 | |
dansmith | so maybe we should check if the marker has a null cell mapping and log that case/ | 19:24 |
dansmith | either way, not much we can do there | 19:24 |
tssurya | dansmith: yep I agree, | 19:24 |
*** shaohe_feng has quit IRC | 19:24 | |
tssurya | I just never thought there would be case without any BuildRequest and NULL InstanceMapping | 19:24 |
*** liverpooler has quit IRC | 19:24 | |
dansmith | or, we just scan every cell! (no not really) | 19:25 |
*** pchavva has quit IRC | 19:25 | |
*** bigdogstl has joined #openstack-nova | 19:25 | |
*** shaohe_feng has joined #openstack-nova | 19:25 | |
*** armaan has joined #openstack-nova | 19:26 | |
*** itlinux has quit IRC | 19:26 | |
*** armaan has quit IRC | 19:26 | |
tssurya | dansmith: I also wanted to ask another thing about have a new option --cell-name to nova service-list ; how you would feel about this, but we could also do this in tomorrow's cells meeting if you are busy now | 19:27 |
*** armaan has joined #openstack-nova | 19:27 | |
dansmith | tssurya: I don't want that, no | 19:27 |
dansmith | tssurya: put them in an aggregate and have a way to list via aggregate or something | 19:27 |
tssurya | right I thought so :), just tried my luck :D | 19:28 |
dansmith | or use nova-manage | 19:28 |
tssurya | yep, thanks! | 19:28 |
*** READ10 has quit IRC | 19:28 | |
dansmith | gdi, why does zuul hate me? | 19:29 |
*** bigdogstl has quit IRC | 19:30 | |
mriedem | tssurya: so this should only be called if the client passes in a marker https://github.com/openstack/nova/blob/f902e0d5d87fb05207e4a7aca73d185775d43df2/nova/compute/instance_list.py#L56-L73 | 19:30 |
*** rodolof has quit IRC | 19:30 | |
mriedem | which when i ran openstack --debug service list, i saw it was passing a marker, but i wasn't | 19:30 |
tssurya | mriedem: yes | 19:30 |
dansmith | oh, it's python3 that hates me | 19:30 |
mriedem | so is there something in novaclient that always gets a marker? | 19:30 |
tssurya | oh no, we pass a marker | 19:30 |
mriedem | we? | 19:31 |
*** rodolof has joined #openstack-nova | 19:31 | |
tssurya | I mean a marker is passed only if we give it via the CLI | 19:31 |
tssurya | what you are saying seems strange, but I haven't tested that | 19:31 |
tssurya | tested/observed | 19:32 |
melwitt | does getting MarkerNotFound mean that a marker had to have been passed? because the bug reporter was using servers.list() python API and got MarkerNotFound | 19:32 |
*** janki has joined #openstack-nova | 19:32 | |
mriedem | right, and when i was doing openstack server list, i wasn't passing a marker, | 19:32 |
tssurya | melwitt: that's what I thought so too, | 19:32 |
mriedem | but i ran it with debug and saw it was doing GET /servers/ with a marker | 19:32 |
melwitt | that would mean that somewhere in servers.list() novaclient is automatically passing a marker. I guess it would if it were paging on its own | 19:33 |
mriedem | novaclient does do that | 19:33 |
mriedem | until it doesn't get any more results | 19:33 |
melwitt | yeah, that's what I'm referring to, the fact that it does that if the list is > api limit | 19:33 |
mriedem | i only had 2 instances | 19:33 |
melwitt | oh | 19:33 |
mriedem | i think it will happen at any point if you have one of these messed up mappings | 19:34 |
tssurya | mriedem: hmm yea, true at some point even we have NULL cell_mappings | 19:34 |
*** shaohe_feng has quit IRC | 19:34 | |
mriedem | https://github.com/openstack/python-novaclient/blob/10.2.0/novaclient/v2/servers.py#L863 | 19:34 |
melwitt | I missed why/how that is normal | 19:34 |
melwitt | if an instance is in the middle of being scheduled, it shouldn't have an instance_mapping yet | 19:35 |
tssurya | melwitt: it will have an instance_mapping but with a NULL cell_mapping | 19:36 |
mriedem | we create the empty instance mapping in the api | 19:36 |
melwitt | oh, I see. so any instance in the middle of scheduling would have the null marker | 19:36 |
melwitt | didn't realize that | 19:37 |
*** shaohe_feng has joined #openstack-nova | 19:37 | |
mriedem | https://github.com/openstack/nova/blob/f902e0d5d87fb05207e4a7aca73d185775d43df2/nova/compute/api.py#L913 | 19:37 |
mriedem | an instance during scheduling will have a build request | 19:37 |
dansmith | right, and we page those out of BRs not out of the cell anyway | 19:37 |
mriedem | once we pick a host, we update the instance mapping for the cell and delete the build request | 19:37 |
*** suresh12_ has quit IRC | 19:37 | |
mriedem | https://github.com/openstack/nova/blob/f902e0d5d87fb05207e4a7aca73d185775d43df2/nova/conductor/manager.py#L1236-L1239 | 19:37 |
melwitt | ah, thanks. I can never remember this | 19:38 |
*** AlexeyAbashkin has quit IRC | 19:38 | |
tssurya | dansmith: yes which us why I was confused | 19:38 |
mriedem | i also want to say i remember a novaclient patch recently that changed the default limit/paging behavior when listing instances | 19:38 |
tssurya | is* | 19:38 |
mriedem | so maybe someone regressed something | 19:38 |
mriedem | https://review.openstack.org/#/c/534222/ | 19:38 |
openstackgerrit | Dan Smith proposed openstack/nova master: Change consecutive build failure limit to a weigher https://review.openstack.org/572195 | 19:38 |
*** pchavva has joined #openstack-nova | 19:39 | |
mriedem | i guess i never commented on that, but i don't know why it was needed, | 19:40 |
mriedem | you can pass limit=-1 for no limit | 19:40 |
melwitt | yeah, the bug is saying the paging loop was ending prematurely for some reason | 19:40 |
mriedem | heh, "I'm not sure how this happened but I can't reproduce the problem now. It seems to work as expected with `--limit -1`." | 19:42 |
mriedem | from the author of the change, in the backport that was -1ed by me https://review.openstack.org/#/c/543968/ | 19:43 |
melwitt | guh | 19:43 |
mriedem | so before https://review.openstack.org/#/c/534222/ if you don't specify a limit, we'd get up to max_limit instances (default 1000) and then stop | 19:44 |
mriedem | now, we get up to max_limit instances, and then query again until we don't get any more results | 19:44 |
mriedem | which, if the marker for the 2nd query ends up being a busted instance mapping, nova list is perma broken | 19:44 |
*** shaohe_feng has quit IRC | 19:45 | |
mriedem | i kind of just want to revert that change... | 19:45 |
mriedem | if i create 10 instances and set CONF.api.max_limit to 5, and run nova list, i should get 5 instances, and if i run nova list --limit -1, i should get 10 | 19:45 |
melwitt | the old behavior wouldn't be able to return a non-existent marker? | 19:45 |
mriedem | if you have a broken instance mapping, we still have a problem on the server side, | 19:46 |
*** links has quit IRC | 19:46 | |
mriedem | but with what i was hitting when i hit this over the weekend, i couldn't get around it | 19:46 |
*** shaohe_feng has joined #openstack-nova | 19:46 | |
*** awaugama has quit IRC | 19:46 | |
mriedem | because the last instance in my list was the busted marker | 19:46 |
mriedem | and i think i only had 2 instances | 19:46 |
tssurya | regarding the broken instance_mapping, we could just check if its broken and print a LOG or something | 19:47 |
mriedem | i don't even think i was able to delete the server w/o getting into the database | 19:47 |
*** mvenesio has joined #openstack-nova | 19:47 | |
mriedem | tssurya: we could....but that will reset your page which is not what the user expects either | 19:48 |
mriedem | really it should probably be a 500 | 19:48 |
tssurya | mriedem: hmm, maybe | 19:49 |
*** eharney has joined #openstack-nova | 19:49 | |
tssurya | yea since its broken | 19:49 |
melwitt | mriedem: oh, weird, I thought the default without passing --limit would have been -1 | 19:50 |
melwitt | (old behavior) | 19:51 |
*** suresh12 has joined #openstack-nova | 19:51 | |
*** shaohe_feng has quit IRC | 19:55 | |
*** shaohe_feng has joined #openstack-nova | 19:55 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Revert "Fix listing of instances above API max_limit" https://review.openstack.org/572539 | 19:57 |
*** bigdogstl has joined #openstack-nova | 19:58 | |
*** jangutter has quit IRC | 19:59 | |
*** yamamoto has joined #openstack-nova | 19:59 | |
mgagne | mriedem: am I right in assuming the allocations healer requires cellsv2 ? | 19:59 |
mriedem | yes | 20:00 |
*** sar has joined #openstack-nova | 20:00 | |
mriedem | it relies on the cell mappings in the api db to find the instances in each cell | 20:01 |
mgagne | ok, just trying to figure out how I will be able to test without updating the whole planet or doing the actual work ;) | 20:01 |
mgagne | like, can I just import our prod database and run migrations and then the script for example. | 20:01 |
mriedem | mgagne: you mean a backup test copy of your prod db? | 20:02 |
mgagne | (with some "minor" details to be addressed) | 20:02 |
mriedem | mgagne: what do you have for cell mappings right now? just cell0> | 20:03 |
mriedem | ? | 20:03 |
mgagne | kind of. import somewhere, run release db migration to queens. then migrate somehow to cellsv2 (since it's required?) and run the healer with a dummy placement api. | 20:03 |
*** bigdogstl has quit IRC | 20:03 | |
mgagne | nothing, I'm running mitaka. | 20:03 |
mgagne | trying to find a simpler way to get to queens with prod data | 20:04 |
mgagne | if cellsv2 is required, I will just find a way to make it happen. | 20:04 |
mriedem | mgagne: have you read through https://docs.openstack.org/nova/latest/user/cells.html#upgrade-with-cells-v1 ? | 20:05 |
*** yamamoto has quit IRC | 20:05 | |
*** shaohe_feng has quit IRC | 20:05 | |
mriedem | the cell mappings are going to be 1:1 with your child ells | 20:05 |
mriedem | *cells | 20:05 |
mriedem | plus cell0 | 20:05 |
mgagne | kind of but never went through it yet. I will read and see how far I can go. | 20:05 |
mriedem | you'll have num(child_cell) + 1 cell mappings in the api db | 20:06 |
mgagne | my main concern is with online data migration and maybe nova-compute exporting resources to placement ? | 20:06 |
mriedem | nova-compute will start reporting inventory and allocation information to placement in ocata | 20:06 |
*** shaohe_feng has joined #openstack-nova | 20:06 | |
mriedem | if you're going straight to queens, nova-compute will not be reporting allocation information to placement, the scheduler does that | 20:06 |
mgagne | right so I need to run the actual service at least once | 20:06 |
mriedem | in queens, nova-compute will report inventory to placement on startup | 20:07 |
mriedem | in queens, the allocations will not be automatically posted for existing instances, which is why you need the heal_allocations CLI | 20:07 |
mriedem | but before you can run that, you need (1) the cell mappings created for each of your cells (2) the instances mapped to the cells | 20:08 |
mgagne | yes, will create mapping | 20:08 |
mgagne | my concern is with resources being exported by compute node before. right? | 20:08 |
*** r-daneel has quit IRC | 20:08 | |
mriedem | i'm not sure what that means | 20:09 |
mriedem | the cell mappings and placement stuff are unrelated | 20:09 |
mgagne | I mean, you need providers to be created somehow first? | 20:09 |
mgagne | I'm not that familiar with placement terminology btw | 20:09 |
mriedem | yes, you'll need the compute nodes reporting into placement before heal_allocations can run | 20:09 |
*** edmondsw_ is now known as edmondsw | 20:10 | |
mriedem | heal allocations will iterate the cell mappings looking for instances that have a host but don't have allocations in placement, and then attempt to post allocations to plcaement for the given instance and compute node - so yeah you need the compute nodes reporting as providers into placement first | 20:10 |
mgagne | ok, that's what I wanted to understand. got it | 20:10 |
*** lpetrut has quit IRC | 20:12 | |
mriedem | btw, i think you can still do all of the cells v2 stuff (cell mappings, host mappings, instance mappings) and placement stuff in queens with the caching scheduler still in place - we have an experimental ci job that does that | 20:13 |
mriedem | well, we have a cells v1 job that does that too | 20:13 |
mgagne | yea, that's my plan. getting to queens, import database and run the tool and see how it goes | 20:14 |
mriedem | i think once you get all of the allocations healed, you can drop the caching scheduler and disable cells v1 | 20:14 |
mriedem | would be ideal if you could even kick the tires with a single child cell test env to get used to this before doing it | 20:15 |
*** shaohe_feng has quit IRC | 20:15 | |
*** shaohe_feng has joined #openstack-nova | 20:16 | |
mgagne | yea. I guess so. I need to test with Ironic too... but I thought I needed cells v2 ? I'm not sure what you mean by "drop the caching scheduler and disable cells v1" | 20:17 |
*** hemna_ has quit IRC | 20:18 | |
*** dpawlik has joined #openstack-nova | 20:22 | |
*** chyka_ has joined #openstack-nova | 20:22 | |
*** pchavva has quit IRC | 20:23 | |
*** bigdogstl has joined #openstack-nova | 20:24 | |
*** shaohe_feng has quit IRC | 20:26 | |
mriedem | mgagne: the goal is to not using the caching scheduler or cells v1 since both are deprecated | 20:26 |
*** chyka has quit IRC | 20:26 | |
mriedem | you need cells v2 since ocata yes | 20:26 |
mgagne | right | 20:26 |
*** shaohe_feng has joined #openstack-nova | 20:26 | |
mriedem | the IronicHostManager is also deprecated since pike | 20:26 |
mriedem | placement + custom resource classes removes the need for the ironic host manager in the scheduler and the Exact* filters | 20:27 |
mriedem | but that's another thing you can deal with separately before rocky | 20:27 |
mriedem | melwitt: this is the last day for https://review.openstack.org/#/q/topic:bp/granular-placement-policy+status:open in the runway, has all +2s, could use another core to go through it | 20:28 |
mgagne | right. I'm trying to get in a state where I can test your patch with production data without spending 900 man hours to get there. I think with your help I got enough info to kick start the process. | 20:28 |
mgagne | 1) Create test environment with Nova Mitaka+CellsV1 2) Import production database 3) Upgrade to Nova Queens, with FFU or whatever process I will find. 4) Migrate to CellsV2 5) Test allocation healer 6) Profit | 20:30 |
*** bigdogstl has quit IRC | 20:32 | |
mriedem | mgagne: yeah, 3 and 4 are going to get fuzzy | 20:33 |
mgagne | can't wait =) | 20:33 |
mriedem | there is a blocker migration in ocata that won't let you finish the api db sync until you have cell0 for example | 20:33 |
mriedem | i just mean, 3 and 4 are kind of co-dependent | 20:34 |
mgagne | good to know, will add that step | 20:34 |
mriedem | once you get to ocata+ you can also run the nova-status upgrade check CLI | 20:34 |
mgagne | ok, so ocata will require some steps for cellsv2 | 20:34 |
mriedem | to check your progress | 20:34 |
mriedem | yup | 20:34 |
mgagne | cool, can't wait to test that tool too | 20:34 |
*** throwsb1 has quit IRC | 20:35 | |
*** shaohe_feng has quit IRC | 20:36 | |
*** itlinux has joined #openstack-nova | 20:36 | |
*** shaohe_feng has joined #openstack-nova | 20:37 | |
*** jmlowe has quit IRC | 20:41 | |
*** brault has joined #openstack-nova | 20:42 | |
melwitt | mriedem: ack | 20:43 |
mriedem | i'm +2 on the vmware live migration spec if another specs core wants to put it in https://review.openstack.org/#/c/299207/ - i'm ok with holding up the merge of the actual code until the multinode vmware 3rd party ci job shows up | 20:44 |
melwitt | that reminds me of the zvm spec amendment, still not approved | 20:44 |
*** liverpooler has joined #openstack-nova | 20:44 | |
melwitt | but that's not subject to spec freeze | 20:45 |
melwitt | I don't think, anyway | 20:45 |
*** r-daneel has joined #openstack-nova | 20:45 | |
*** shaohe_feng has quit IRC | 20:46 | |
*** shaohe_feng has joined #openstack-nova | 20:47 | |
*** lifeless has quit IRC | 20:51 | |
*** lifeless has joined #openstack-nova | 20:51 | |
*** bpoulos has quit IRC | 20:52 | |
*** bigdogstl has joined #openstack-nova | 20:53 | |
*** shaohe_feng has quit IRC | 20:56 | |
mriedem | nova list --limit -1 works like a charm http://paste.openstack.org/show/722757/ | 20:57 |
*** dpawlik has quit IRC | 20:58 | |
*** dpawlik has joined #openstack-nova | 20:58 | |
*** bigdogstl has quit IRC | 20:58 | |
*** shaohe_feng has joined #openstack-nova | 20:59 | |
*** yamamoto has joined #openstack-nova | 21:01 | |
melwitt | mriedem: kinda wonder why that's not the default. I guess so you have to opt into paging | 21:01 |
*** yamamoto has quit IRC | 21:05 | |
*** shaohe_feng has quit IRC | 21:07 | |
*** suresh12 has quit IRC | 21:07 | |
mriedem | frickler: are you happy with this now? https://review.openstack.org/#/c/312626/ | 21:07 |
mriedem | i see you've done quite a bit of review on it already | 21:07 |
*** shaohe_feng has joined #openstack-nova | 21:07 | |
*** suresh12 has joined #openstack-nova | 21:07 | |
mriedem | melwitt: idk, for a smaller cloud with <1000 instances it's not going to be a problem, | 21:08 |
mriedem | for a public cloud the admin probably wants to opt into getting back a million records | 21:08 |
melwitt | yeah, good point | 21:08 |
*** slaweq has quit IRC | 21:10 | |
*** tssurya has quit IRC | 21:10 | |
mriedem | anyway, that patch made around ~400 LOC change for something that wasn't even broken | 21:12 |
mriedem | no release note on the behavior change either | 21:12 |
*** tssurya has joined #openstack-nova | 21:12 | |
melwitt | those are the best | 21:13 |
*** esberglu has quit IRC | 21:16 | |
*** dave-mccowan has quit IRC | 21:16 | |
*** shaohe_feng has quit IRC | 21:17 | |
*** tssurya has quit IRC | 21:17 | |
*** shaohe_feng has joined #openstack-nova | 21:19 | |
*** rodolof has quit IRC | 21:19 | |
*** janki has quit IRC | 21:23 | |
melwitt | mriedem: I proposed adding the nova-lvm job to pike (as experimental) and it passed (phew) https://review.openstack.org/572130 | 21:24 |
melwitt | the ocata one however is busted, but on a cinder problem AFAICT, not the nova regression/fix https://review.openstack.org/572132 | 21:24 |
*** lifeless has quit IRC | 21:25 | |
*** shaohe_feng has quit IRC | 21:27 | |
*** priteau has quit IRC | 21:27 | |
*** shaohe_feng has joined #openstack-nova | 21:28 | |
*** bigdogstl has joined #openstack-nova | 21:28 | |
mriedem | ok | 21:29 |
mriedem | mgagne: a couple of questions for clarification in your spec https://review.openstack.org/#/c/312626/ | 21:31 |
melwitt | gah why can I never find the novaclient cli command list reference | 21:31 |
mriedem | melwitt: i don't think there is one | 21:31 |
mriedem | you're welcome | 21:31 |
melwitt | oh, to make people use osc. I see how it is | 21:31 |
mriedem | https://docs.openstack.org/python-novaclient/pike/cli/index.html | 21:31 |
mriedem | no, i think just because it never existed | 21:32 |
melwitt | it existed, unless I dreamed it | 21:32 |
melwitt | I shall google | 21:32 |
melwitt | some more | 21:32 |
mriedem | https://docs.openstack.org/mitaka/cli-reference/nova.html ? | 21:33 |
melwitt | yeah, that's what I'm thinking of. maybe we didn't import that when things got decentralized | 21:33 |
mriedem | so it existed in the central docs repo | 21:33 |
mriedem | yeah must not have | 21:33 |
melwitt | probably to discourage use of the novaclient CLI | 21:33 |
mriedem | no, probably just because no one imported the docs | 21:34 |
mriedem | it was on the projects to do that | 21:34 |
*** edmondsw has quit IRC | 21:34 | |
mriedem | https://docs.openstack.org/ocata/cli-reference/nova.html | 21:34 |
mriedem | https://docs.openstack.org/pike/cli-reference/nova.html | 21:34 |
*** edmondsw has joined #openstack-nova | 21:34 | |
*** bigdogstl has quit IRC | 21:34 | |
melwitt | okay, I thought maybe someone decided it wasn't a great idea because we want to encourage osc use. I could see that point of view | 21:34 |
melwitt | but, I do know that boot from volume created from image is not possible in osc in one command, still something that needs to be fixed. and there are probably other things people still need novaclient CLI for | 21:35 |
*** dpawlik has quit IRC | 21:35 | |
mriedem | https://bugs.launchpad.net/python-novaclient/+bug/1775281 | 21:36 |
openstack | Launchpad bug 1775281 in python-novaclient "nova command line reference is gone since Pike" [Undecided,New] | 21:36 |
mriedem | there is a bunch of stuff that is in the nova CLI that's not in OSC | 21:36 |
melwitt | yeah | 21:36 |
mriedem | so purposefully hiding the nova cli docs would be a dick move | 21:36 |
mriedem | which i don't think was the case, it was just laziness | 21:36 |
*** tidwellr has quit IRC | 21:37 | |
melwitt | yeah, I agree that it would be best to host them in our tree | 21:37 |
*** shaohe_feng has quit IRC | 21:37 | |
mriedem | https://github.com/openstack/openstack-manuals/blob/before-migration/doc/cli-reference/source/nova.rst | 21:37 |
*** edmondsw has quit IRC | 21:38 | |
melwitt | thanks for finding that | 21:39 |
melwitt | and opening the bug | 21:39 |
*** r-daneel_ has joined #openstack-nova | 21:39 | |
*** r-daneel has quit IRC | 21:39 | |
*** r-daneel_ is now known as r-daneel | 21:39 | |
*** shaohe_feng has joined #openstack-nova | 21:41 | |
openstackgerrit | Mathieu Gagné proposed openstack/nova-specs master: Multiple Fixed-IPs support in network information https://review.openstack.org/312626 | 21:43 |
*** bigdogstl has joined #openstack-nova | 21:45 | |
*** lifeless has joined #openstack-nova | 21:47 | |
*** shaohe_feng has quit IRC | 21:48 | |
*** tidwellr has joined #openstack-nova | 21:48 | |
*** shaohe_feng has joined #openstack-nova | 21:48 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Import nova CLI reference from openstack-manuals https://review.openstack.org/572567 | 21:50 |
mriedem | melwitt: there you go | 21:50 |
*** itlinux has quit IRC | 21:53 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Add a note in the nova CLI reference about using OSC https://review.openstack.org/572569 | 21:54 |
melwitt | \o/ | 21:54 |
*** shaohe_feng has quit IRC | 21:58 | |
*** shaohe_feng has joined #openstack-nova | 21:59 | |
*** yamamoto has joined #openstack-nova | 22:02 | |
*** itlinux has joined #openstack-nova | 22:03 | |
*** brault has quit IRC | 22:03 | |
*** tidwellr has quit IRC | 22:06 | |
*** yamamoto has quit IRC | 22:06 | |
*** shaohe_feng has quit IRC | 22:08 | |
*** shaohe_feng has joined #openstack-nova | 22:09 | |
*** itlinux has quit IRC | 22:13 | |
*** shaohe_feng has quit IRC | 22:18 | |
*** r-daneel has quit IRC | 22:21 | |
*** shaohe_feng has joined #openstack-nova | 22:21 | |
*** mvenesio has quit IRC | 22:23 | |
*** rcernin has joined #openstack-nova | 22:25 | |
*** shaohe_feng has quit IRC | 22:29 | |
*** shaohe_feng has joined #openstack-nova | 22:29 | |
openstackgerrit | Chris Dent proposed openstack/nova master: WIP: Spike a direct interface to placement https://review.openstack.org/572576 | 22:36 |
*** shaohe_feng has quit IRC | 22:39 | |
*** shaohe_feng has joined #openstack-nova | 22:39 | |
*** boris_42_ has joined #openstack-nova | 22:47 | |
*** shaohe_feng has quit IRC | 22:49 | |
*** shaohe_feng has joined #openstack-nova | 22:50 | |
mriedem | simondodsley_: some comments in your spec https://review.openstack.org/#/c/340168/ | 22:50 |
mriedem | mostly just needs to be cleaned up and add some more detail | 22:50 |
mriedem | otherwise this probably didn't even require a spec | 22:50 |
*** bigdogstl has quit IRC | 22:53 | |
melwitt | mriedem: trying to understand this part about the policy check moving ... where did it used to be? https://review.openstack.org/#/c/565578/10/nova/tests/functional/api/openstack/placement/gabbits/resource-classes.yaml | 22:57 |
melwitt | with the move, it fails with 406 but doesn't that mean it passes the policy check when it shouldn't? (406 normally comes from further down the API, right?) | 22:58 |
mriedem | melwitt: https://review.openstack.org/#/c/524425/16/nova/api/openstack/placement/handler.py@217 | 22:59 |
*** shaohe_feng has quit IRC | 22:59 | |
mriedem | melwitt: the policy check used to happen before we got to the handler code, | 22:59 |
mriedem | but now the policy check happens in each handler | 22:59 |
mriedem | and that happens after the content type checks | 23:00 |
melwitt | I see, thank you | 23:00 |
*** shaohe_feng has joined #openstack-nova | 23:00 | |
*** bigdogstl has joined #openstack-nova | 23:00 | |
mriedem | https://review.openstack.org/#/c/565578/10/nova/api/openstack/placement/handlers/resource_class.py@116 | 23:00 |
openstackgerrit | Merged openstack/nova stable/ocata: libvirt: handle DiskNotFound during update_available_resource https://review.openstack.org/571432 | 23:01 |
openstackgerrit | Merged openstack/nova master: Fix some wrong urls in doc https://review.openstack.org/571147 | 23:01 |
melwitt | ++ thanks | 23:01 |
mriedem | once you get past that, the rest of these are all pretty mechanical | 23:02 |
mriedem | https://review.openstack.org/#/c/524425/ was the majority of the meat of the series | 23:02 |
*** yamamoto has joined #openstack-nova | 23:03 | |
*** edmondsw has joined #openstack-nova | 23:03 | |
melwitt | sweet | 23:04 |
*** bigdogstl has quit IRC | 23:05 | |
cdent | mriedem: you might be interested in some of my comments in the commit message on https://review.openstack.org/572576 which is the way it is in part because of easy way to manage context and policy | 23:06 |
*** edmondsw has quit IRC | 23:07 | |
*** bigdogstl has joined #openstack-nova | 23:07 | |
*** yamamoto has quit IRC | 23:07 | |
*** threestrands has joined #openstack-nova | 23:08 | |
*** shaohe_feng has quit IRC | 23:10 | |
*** harlowja has joined #openstack-nova | 23:10 | |
*** bigdogstl has quit IRC | 23:12 | |
*** shaohe_feng has joined #openstack-nova | 23:14 | |
openstackgerrit | Eric Fried proposed openstack/nova-specs master: WIP: Spec: Handling Reshaped Provider Trees https://review.openstack.org/572583 | 23:17 |
*** shaohe_feng has quit IRC | 23:20 | |
openstackgerrit | Merged openstack/nova master: [placement] Do not import oslo_service for log_options https://review.openstack.org/572231 | 23:21 |
*** bigdogstl has joined #openstack-nova | 23:22 | |
melwitt | mriedem: why does https://review.openstack.org/570621 need to use scope types whereas the others don't? | 23:23 |
*** shaohe_feng has joined #openstack-nova | 23:23 | |
mriedem | melwitt: it was the first place that it was obvious in the series; there was some discussion about it in https://review.openstack.org/#/c/524425/16 | 23:25 |
mriedem | so after that i did it for the rest and then filled the gap at the end | 23:25 |
mriedem | cdent: ack | 23:25 |
melwitt | I see, okay | 23:25 |
mriedem | going for a bike ride | 23:25 |
*** mriedem is now known as mriedem_afk | 23:25 | |
*** hongbin has quit IRC | 23:27 | |
*** mlavalle has quit IRC | 23:28 | |
*** chyka_ has quit IRC | 23:29 | |
*** shaohe_feng has quit IRC | 23:30 | |
*** shaohe_feng has joined #openstack-nova | 23:31 | |
*** takashin has joined #openstack-nova | 23:31 | |
*** bigdogstl has quit IRC | 23:31 | |
*** trungnv_ has quit IRC | 23:38 | |
*** annp has quit IRC | 23:38 | |
*** trungnv_ has joined #openstack-nova | 23:38 | |
*** annp has joined #openstack-nova | 23:38 | |
gmann | mgagne: glad to know that :) thanks | 23:39 |
*** shaohe_feng has quit IRC | 23:40 | |
*** shaohe_feng has joined #openstack-nova | 23:42 | |
*** bigdogstl has joined #openstack-nova | 23:44 | |
*** bigdogstl has quit IRC | 23:49 | |
*** shaohe_feng has quit IRC | 23:51 | |
openstackgerrit | Merged openstack/python-novaclient master: Import nova CLI reference from openstack-manuals https://review.openstack.org/572567 | 23:51 |
*** shaohe_feng has joined #openstack-nova | 23:52 | |
*** lifeless has quit IRC | 23:54 | |
openstackgerrit | Chris Dent proposed openstack/nova master: Optional separate database for placement API https://review.openstack.org/362766 | 23:55 |
openstackgerrit | Chris Dent proposed openstack/nova master: Isolate placement database config https://review.openstack.org/541435 | 23:55 |
openstackgerrit | Chris Dent proposed openstack/nova master: Ensure that os-traits sync is attempted only at start of process https://review.openstack.org/553857 | 23:55 |
*** lifeless has joined #openstack-nova | 23:56 | |
*** tetsuro has joined #openstack-nova | 23:56 | |
openstackgerrit | Merged openstack/python-novaclient master: Add a note in the nova CLI reference about using OSC https://review.openstack.org/572569 | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!