| *** yangyapeng has quit IRC | 00:02 | |
| *** takashin has joined #openstack-nova | 00:02 | |
| *** yangyapeng has joined #openstack-nova | 00:02 | |
| *** yamahata has quit IRC | 00:03 | |
| *** gmann_afk is now known as gmann | 00:06 | |
| *** yangyapeng has quit IRC | 00:07 | |
| *** ijw has quit IRC | 00:07 | |
| *** ijw has joined #openstack-nova | 00:08 | |
| *** sree has joined #openstack-nova | 00:08 | |
| *** Swami has quit IRC | 00:08 | |
| *** yamahata has joined #openstack-nova | 00:12 | |
| *** sree has quit IRC | 00:12 | |
| *** sbezverk has joined #openstack-nova | 00:16 | |
| *** edmondsw has joined #openstack-nova | 00:16 | |
| *** edmondsw has quit IRC | 00:21 | |
| *** gouthamr has joined #openstack-nova | 00:24 | |
| *** smatzek has joined #openstack-nova | 00:25 | |
| *** sballe_ has quit IRC | 00:25 | |
| *** smatzek has quit IRC | 00:29 | |
| *** andreas_s has joined #openstack-nova | 00:31 | |
| *** andreas_s has quit IRC | 00:35 | |
| *** Apoorva_ has joined #openstack-nova | 00:36 | |
| *** Apoorva has quit IRC | 00:39 | |
| *** Apoorva_ has quit IRC | 00:40 | |
| *** thorst has joined #openstack-nova | 00:46 | |
| *** thorst has quit IRC | 00:46 | |
| *** jichen has joined #openstack-nova | 00:47 | |
| *** jichen has quit IRC | 00:48 | |
| *** jichen has joined #openstack-nova | 00:48 | |
| *** AlexeyAbashkin has joined #openstack-nova | 00:49 | |
| *** AlexeyAbashkin has quit IRC | 00:53 | |
| *** sbezverk has quit IRC | 00:55 | |
| *** priteau has joined #openstack-nova | 00:59 | |
| *** phuongnh has joined #openstack-nova | 01:00 | |
| *** priteau has quit IRC | 01:04 | |
| *** gjayavelu has quit IRC | 01:04 | |
| *** liusheng has joined #openstack-nova | 01:05 | |
| openstackgerrit | Jackie Truong proposed openstack/nova master: Implement certificate_utils https://review.openstack.org/479949 | 01:06 |
|---|---|---|
| *** sbezverk has joined #openstack-nova | 01:08 | |
| *** hemna_ has quit IRC | 01:10 | |
| *** yamahata has quit IRC | 01:10 | |
| *** litao__ has joined #openstack-nova | 01:12 | |
| *** liusheng has quit IRC | 01:13 | |
| *** liusheng has joined #openstack-nova | 01:15 | |
| *** yangyapeng has joined #openstack-nova | 01:16 | |
| *** baoli has joined #openstack-nova | 01:18 | |
| *** yamamoto has quit IRC | 01:26 | |
| *** baoli has quit IRC | 01:27 | |
| *** cheneydc has joined #openstack-nova | 01:32 | |
| *** Shunli has joined #openstack-nova | 01:38 | |
| *** baoli has joined #openstack-nova | 01:38 | |
| *** abhishek has quit IRC | 01:39 | |
| *** ijw has quit IRC | 01:41 | |
| *** ijw has joined #openstack-nova | 01:41 | |
| *** larainema has joined #openstack-nova | 01:42 | |
| *** baoli has quit IRC | 01:43 | |
| *** ijw has quit IRC | 01:44 | |
| *** sdague has quit IRC | 01:44 | |
| *** AlexeyAbashkin has joined #openstack-nova | 01:46 | |
| *** kaisers has quit IRC | 01:48 | |
| *** kaisers has joined #openstack-nova | 01:49 | |
| *** psachin has joined #openstack-nova | 01:49 | |
| *** AlexeyAbashkin has quit IRC | 01:50 | |
| *** edmondsw has joined #openstack-nova | 01:51 | |
| *** nikhil has quit IRC | 01:54 | |
| *** hongbin has joined #openstack-nova | 01:55 | |
| openstackgerrit | Zhenyu Zheng proposed openstack/nova-specs master: Improve the performance of filtering instances by IP. https://review.openstack.org/509326 | 01:59 |
| *** kukacz has quit IRC | 02:00 | |
| *** kukacz has joined #openstack-nova | 02:01 | |
| *** thorst has joined #openstack-nova | 02:02 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/510324 | 02:05 |
| *** hshiina has joined #openstack-nova | 02:05 | |
| *** thorst has quit IRC | 02:07 | |
| *** baoli has joined #openstack-nova | 02:07 | |
| *** baoli has quit IRC | 02:12 | |
| *** acormier has quit IRC | 02:14 | |
| *** thorst has joined #openstack-nova | 02:17 | |
| *** thorst has quit IRC | 02:19 | |
| *** baoli has joined #openstack-nova | 02:25 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 02:29 |
| *** gouthamr has quit IRC | 02:31 | |
| *** markvoelker has quit IRC | 02:39 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 02:40 |
| *** andreas_s has joined #openstack-nova | 02:40 | |
| *** gcb has joined #openstack-nova | 02:43 | |
| *** yingjun has joined #openstack-nova | 02:46 | |
| *** andreas_s has quit IRC | 02:49 | |
| *** yamahata has joined #openstack-nova | 02:50 | |
| *** junbo has quit IRC | 02:52 | |
| *** edmondsw has quit IRC | 02:53 | |
| *** nicolasbock has quit IRC | 02:53 | |
| *** andreas_s has joined #openstack-nova | 02:59 | |
| *** priteau has joined #openstack-nova | 03:00 | |
| *** vladikr has quit IRC | 03:01 | |
| *** vladikr has joined #openstack-nova | 03:01 | |
| *** mtreinish has quit IRC | 03:02 | |
| *** priteau has quit IRC | 03:05 | |
| *** vladikr_ has quit IRC | 03:06 | |
| *** vladikr has quit IRC | 03:07 | |
| *** vladikr_ has joined #openstack-nova | 03:07 | |
| *** mtreinish has joined #openstack-nova | 03:07 | |
| *** vladikr has joined #openstack-nova | 03:07 | |
| *** trinaths has joined #openstack-nova | 03:10 | |
| *** trungnv has quit IRC | 03:11 | |
| *** trinaths1 has joined #openstack-nova | 03:11 | |
| *** gouthamr has joined #openstack-nova | 03:12 | |
| *** andreas_s has quit IRC | 03:12 | |
| *** thorst has joined #openstack-nova | 03:12 | |
| *** thorst has quit IRC | 03:12 | |
| *** trinaths has quit IRC | 03:14 | |
| *** yuchenghui has joined #openstack-nova | 03:14 | |
| *** baoli has quit IRC | 03:17 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and timestamp filtering support for os-migrations API https://review.openstack.org/506030 | 03:18 |
| *** trungnv has joined #openstack-nova | 03:19 | |
| *** links has joined #openstack-nova | 03:24 | |
| *** mdnadeem has joined #openstack-nova | 03:26 | |
| *** vladikr_ has quit IRC | 03:26 | |
| *** vladikr has quit IRC | 03:26 | |
| *** vladikr_ has joined #openstack-nova | 03:27 | |
| *** vladikr has joined #openstack-nova | 03:27 | |
| *** gbarros has joined #openstack-nova | 03:32 | |
| *** udesale has joined #openstack-nova | 03:35 | |
| *** mdnadeem has quit IRC | 03:37 | |
| *** mdnadeem has joined #openstack-nova | 03:38 | |
| *** yamamoto has joined #openstack-nova | 03:39 | |
| *** yamamoto_ has joined #openstack-nova | 03:44 | |
| *** hshiina has quit IRC | 03:45 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 03:46 |
| *** yamamoto has quit IRC | 03:47 | |
| *** trinaths has joined #openstack-nova | 03:53 | |
| *** dave-mccowan has quit IRC | 03:54 | |
| *** trinaths1 has quit IRC | 03:56 | |
| *** diga has joined #openstack-nova | 03:59 | |
| *** suresh12 has joined #openstack-nova | 03:59 | |
| *** hshiina has joined #openstack-nova | 04:01 | |
| *** sree has joined #openstack-nova | 04:03 | |
| *** yamamoto_ has quit IRC | 04:03 | |
| *** hongbin has quit IRC | 04:04 | |
| *** vks1 has joined #openstack-nova | 04:06 | |
| *** Shunli has quit IRC | 04:07 | |
| *** vivsoni_ has joined #openstack-nova | 04:07 | |
| *** armax has quit IRC | 04:08 | |
| *** armax has joined #openstack-nova | 04:08 | |
| *** armax has quit IRC | 04:08 | |
| *** armax has joined #openstack-nova | 04:09 | |
| *** armax has quit IRC | 04:09 | |
| *** armax has joined #openstack-nova | 04:10 | |
| *** armax has quit IRC | 04:10 | |
| *** vks1 has quit IRC | 04:10 | |
| *** vivsoni has quit IRC | 04:10 | |
| *** claudiub|2 has joined #openstack-nova | 04:15 | |
| *** vladikr has quit IRC | 04:20 | |
| *** vladikr has joined #openstack-nova | 04:20 | |
| *** vladikr_ has quit IRC | 04:20 | |
| *** vladikr_ has joined #openstack-nova | 04:21 | |
| *** yamamoto has joined #openstack-nova | 04:21 | |
| *** trinaths1 has joined #openstack-nova | 04:25 | |
| *** trinaths has quit IRC | 04:26 | |
| *** smatzek has joined #openstack-nova | 04:27 | |
| *** vladikr has quit IRC | 04:28 | |
| *** vladikr has joined #openstack-nova | 04:28 | |
| *** vladikr_ has quit IRC | 04:28 | |
| *** vks1 has joined #openstack-nova | 04:29 | |
| *** vladikr_ has joined #openstack-nova | 04:29 | |
| *** smatzek has quit IRC | 04:31 | |
| *** hoonetorg has quit IRC | 04:37 | |
| *** markvoelker has joined #openstack-nova | 04:39 | |
| *** edmondsw has joined #openstack-nova | 04:39 | |
| *** brault_ has joined #openstack-nova | 04:42 | |
| *** edmondsw has quit IRC | 04:44 | |
| *** abhi89 has joined #openstack-nova | 04:44 | |
| *** brault has quit IRC | 04:44 | |
| *** trungnv has quit IRC | 04:45 | |
| *** hoonetorg has joined #openstack-nova | 04:50 | |
| *** vladikr has quit IRC | 04:52 | |
| *** vladikr has joined #openstack-nova | 04:53 | |
| *** lpetrut_ has joined #openstack-nova | 04:54 | |
| *** gouthamr has quit IRC | 04:56 | |
| *** thorst has joined #openstack-nova | 04:56 | |
| *** vvargaszte has joined #openstack-nova | 04:59 | |
| *** thorst has quit IRC | 05:00 | |
| *** priteau has joined #openstack-nova | 05:00 | |
| *** vladikr has quit IRC | 05:02 | |
| *** vladikr_ has quit IRC | 05:02 | |
| *** vladikr has joined #openstack-nova | 05:03 | |
| *** vladikr_ has joined #openstack-nova | 05:03 | |
| *** priteau has quit IRC | 05:05 | |
| *** vvargaszte has quit IRC | 05:06 | |
| *** markvoelker has quit IRC | 05:14 | |
| *** gbarros has quit IRC | 05:15 | |
| *** acormier has joined #openstack-nova | 05:16 | |
| *** acormier has quit IRC | 05:20 | |
| *** vladikr has quit IRC | 05:24 | |
| *** vladikr has joined #openstack-nova | 05:24 | |
| *** vladikr_ has quit IRC | 05:25 | |
| *** vladikr_ has joined #openstack-nova | 05:25 | |
| *** lpetrut_ has quit IRC | 05:26 | |
| *** ratailor has joined #openstack-nova | 05:32 | |
| *** vladikr has quit IRC | 05:32 | |
| *** vladikr_ has quit IRC | 05:32 | |
| *** vladikr has joined #openstack-nova | 05:32 | |
| *** vladikr_ has joined #openstack-nova | 05:33 | |
| *** suresh12 has quit IRC | 05:34 | |
| *** suresh12 has joined #openstack-nova | 05:34 | |
| *** suresh12 has quit IRC | 05:35 | |
| *** suresh12 has joined #openstack-nova | 05:36 | |
| *** suresh12 has quit IRC | 05:40 | |
| *** yuchenghui has quit IRC | 05:55 | |
| *** udesale__ has joined #openstack-nova | 06:03 | |
| *** udesale has quit IRC | 06:03 | |
| *** udesale has joined #openstack-nova | 06:06 | |
| *** udesale__ has quit IRC | 06:07 | |
| *** Oku_OS-away is now known as Oku_OS | 06:08 | |
| *** markvoelker has joined #openstack-nova | 06:11 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove glance usage inside compute https://review.openstack.org/511392 | 06:18 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 06:18 |
| *** phani_ has joined #openstack-nova | 06:19 | |
| *** brad[] has quit IRC | 06:20 | |
| *** yamahata has quit IRC | 06:20 | |
| phani_ | I am want to expose SSE4.2 cpu flags to VM spawned with openstack. I Updated nova.conf with "cpu_mode = custom, cpu_model = Nehalem" and set the meta data for nova flavor with CLI : nova flavor-key m1.medium set hw:cpu_model=Nehalem. But the VM does not get the SSE4.2 cpu flags. The compute node CPU has the SS4.2 flags. I am using devstak stable/pike | 06:20 |
| *** ratailor_ has joined #openstack-nova | 06:20 | |
| phani_ | Please hlep me. Is there anything i am missing | 06:20 |
| *** josecastroleon has quit IRC | 06:21 | |
| *** josecastroleon has joined #openstack-nova | 06:22 | |
| *** ratailor has quit IRC | 06:24 | |
| *** vladikr has quit IRC | 06:24 | |
| *** vladikr_ has quit IRC | 06:24 | |
| *** vladikr has joined #openstack-nova | 06:24 | |
| *** vladikr_ has joined #openstack-nova | 06:25 | |
| openstackgerrit | David Rabel proposed openstack/nova master: VMware: add support for graceful shutdown of instances https://review.openstack.org/494169 | 06:27 |
| *** phuongnh has quit IRC | 06:27 | |
| *** hshiina has quit IRC | 06:27 | |
| *** edmondsw has joined #openstack-nova | 06:28 | |
| *** diga has quit IRC | 06:28 | |
| *** Swami has joined #openstack-nova | 06:31 | |
| *** brad[] has joined #openstack-nova | 06:32 | |
| *** edmondsw has quit IRC | 06:32 | |
| *** lajoskatona has joined #openstack-nova | 06:33 | |
| *** Swami has quit IRC | 06:33 | |
| *** yamahata has joined #openstack-nova | 06:33 | |
| *** udesale has quit IRC | 06:34 | |
| *** rcernin has joined #openstack-nova | 06:35 | |
| *** udesale has joined #openstack-nova | 06:35 | |
| *** vladikr_ has quit IRC | 06:36 | |
| *** vladikr_ has joined #openstack-nova | 06:37 | |
| *** sahid has joined #openstack-nova | 06:38 | |
| *** takedakn has joined #openstack-nova | 06:41 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove glance usage inside compute https://review.openstack.org/511392 | 06:42 |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove usage of glance.generate_image_url https://review.openstack.org/511397 | 06:42 |
| *** markvoelker has quit IRC | 06:44 | |
| *** vladikr_ has quit IRC | 06:46 | |
| *** vladikr_ has joined #openstack-nova | 06:47 | |
| *** ratailor_ is now known as rtailor | 06:47 | |
| *** priteau has joined #openstack-nova | 06:52 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: rt: Implement XenAPI get_inventory() method https://review.openstack.org/339204 | 06:54 |
| *** priteau has quit IRC | 06:55 | |
| *** priteau has joined #openstack-nova | 06:55 | |
| *** thorst has joined #openstack-nova | 06:57 | |
| *** priteau has quit IRC | 06:59 | |
| *** thorst_ has joined #openstack-nova | 07:00 | |
| *** Dinesh_Bhor has quit IRC | 07:01 | |
| *** slaweq has joined #openstack-nova | 07:01 | |
| *** thorst has quit IRC | 07:01 | |
| *** rtailor has quit IRC | 07:03 | |
| *** rtailor has joined #openstack-nova | 07:04 | |
| *** thorst_ has quit IRC | 07:05 | |
| *** brault_ has quit IRC | 07:06 | |
| *** Dinesh_Bhor has joined #openstack-nova | 07:07 | |
| *** markus_z has joined #openstack-nova | 07:09 | |
| openstackgerrit | jichenjc proposed openstack/nova master: mv generate_glance_url to get_image_endpoint_url https://review.openstack.org/511400 | 07:12 |
| *** yamahata has quit IRC | 07:15 | |
| *** pcaruana has joined #openstack-nova | 07:17 | |
| *** lpetrut_ has joined #openstack-nova | 07:18 | |
| *** yangyapeng has quit IRC | 07:19 | |
| *** yangyapeng has joined #openstack-nova | 07:19 | |
| *** takashin has quit IRC | 07:24 | |
| *** flanders_ has joined #openstack-nova | 07:26 | |
| bauzas | good morning Nova | 07:28 |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove usage of glance.generate_image_url https://review.openstack.org/511397 | 07:31 |
| *** AlexeyAbashkin has joined #openstack-nova | 07:32 | |
| *** tesseract has joined #openstack-nova | 07:32 | |
| *** andreas_s has joined #openstack-nova | 07:35 | |
| openstackgerrit | Alex Xu proposed openstack/nova master: Add _get_provider_ids_with_any_trait method https://review.openstack.org/511184 | 07:40 |
| openstackgerrit | Alex Xu proposed openstack/nova master: placement: add traits support in the AllocationCandidates object https://review.openstack.org/479766 | 07:40 |
| openstackgerrit | Alex Xu proposed openstack/nova master: Put the code of generating sharing RP combinations into a method https://review.openstack.org/511407 | 07:40 |
| *** markvoelker has joined #openstack-nova | 07:41 | |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove glance usage inside compute https://review.openstack.org/511392 | 07:49 |
| openstackgerrit | jichenjc proposed openstack/nova master: Remove usage of glance.generate_image_url https://review.openstack.org/511397 | 07:49 |
| *** markus_z has quit IRC | 07:56 | |
| *** yamamoto has quit IRC | 08:05 | |
| *** sridharg has joined #openstack-nova | 08:06 | |
| *** tetsuro has joined #openstack-nova | 08:07 | |
| *** yamamoto has joined #openstack-nova | 08:08 | |
| *** markvoelker has quit IRC | 08:14 | |
| *** edmondsw has joined #openstack-nova | 08:15 | |
| *** hshiina has joined #openstack-nova | 08:16 | |
| openstackgerrit | Elod Illes proposed openstack/nova master: WIP: Transform scheduler.select_destinations notification https://review.openstack.org/508506 | 08:17 |
| *** priteau has joined #openstack-nova | 08:18 | |
| *** hshiina2 has joined #openstack-nova | 08:18 | |
| *** edmondsw has quit IRC | 08:20 | |
| *** hshiina has quit IRC | 08:21 | |
| *** markus_z has joined #openstack-nova | 08:23 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add migration_get_by_uuid in db api. https://review.openstack.org/511421 | 08:24 |
| *** ratailor_ has joined #openstack-nova | 08:27 | |
| *** rodolof has joined #openstack-nova | 08:27 | |
| *** rodolof has quit IRC | 08:28 | |
| *** rodolof has joined #openstack-nova | 08:28 | |
| *** rtailor has quit IRC | 08:30 | |
| *** rmart04 has joined #openstack-nova | 08:32 | |
| *** ralonsoh has joined #openstack-nova | 08:33 | |
| *** markus_z has quit IRC | 08:33 | |
| *** lucas-afk is now known as lucasagomes | 08:34 | |
| *** gszasz has joined #openstack-nova | 08:37 | |
| *** derekh has joined #openstack-nova | 08:38 | |
| *** brault has joined #openstack-nova | 08:40 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add migration_get_by_uuid in db api. https://review.openstack.org/511421 | 08:48 |
| *** spectr has quit IRC | 08:49 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Reproduce bug 1721652 in the functional test env https://review.openstack.org/510176 | 08:49 |
| openstack | bug 1721652 in OpenStack Compute (nova) "Evacuate cleanup fails at _delete_allocation_for_moved_instance" [High,In progress] https://launchpad.net/bugs/1721652 - Assigned to Balazs Gibizer (balazs-gibizer) | 08:49 |
| *** yamamoto has quit IRC | 08:55 | |
| *** markus_z has joined #openstack-nova | 08:56 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add snapshot id to the snapshot notifications https://review.openstack.org/453077 | 08:58 |
| *** ratailor__ has joined #openstack-nova | 08:59 | |
| *** thorst has joined #openstack-nova | 09:02 | |
| *** vladikr_ has quit IRC | 09:02 | |
| *** vladikr_ has joined #openstack-nova | 09:02 | |
| *** vladikr has quit IRC | 09:02 | |
| *** vladikr has joined #openstack-nova | 09:03 | |
| *** ratailor_ has quit IRC | 09:03 | |
| *** trinaths1 has left #openstack-nova | 09:03 | |
| *** hferenc has joined #openstack-nova | 09:04 | |
| *** thorst has quit IRC | 09:05 | |
| *** vladikr has quit IRC | 09:08 | |
| *** vladikr_ has quit IRC | 09:09 | |
| *** vladikr has joined #openstack-nova | 09:09 | |
| *** vladikr_ has joined #openstack-nova | 09:09 | |
| *** _pewp_ has quit IRC | 09:11 | |
| *** brault has quit IRC | 09:12 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add snapshot id to the snapshot notifications https://review.openstack.org/453077 | 09:13 |
| *** yamamoto has joined #openstack-nova | 09:15 | |
| *** yamamoto has quit IRC | 09:15 | |
| *** _pewp_ has joined #openstack-nova | 09:15 | |
| *** spectr has joined #openstack-nova | 09:19 | |
| *** ratailor__ is now known as rtailor | 09:22 | |
| *** ociuhandu has quit IRC | 09:23 | |
| *** brault has joined #openstack-nova | 09:27 | |
| *** logan- has quit IRC | 09:27 | |
| *** brault has quit IRC | 09:32 | |
| *** vladikr_ has quit IRC | 09:36 | |
| *** vladikr has quit IRC | 09:36 | |
| *** yingjun has quit IRC | 09:36 | |
| *** vladikr_ has joined #openstack-nova | 09:37 | |
| *** vladikr has joined #openstack-nova | 09:37 | |
| *** takedakn has quit IRC | 09:37 | |
| *** fragatina has joined #openstack-nova | 09:37 | |
| *** mvk has quit IRC | 09:37 | |
| *** phuongnh has joined #openstack-nova | 09:42 | |
| *** jichen has quit IRC | 09:43 | |
| *** vladikr_ has quit IRC | 09:44 | |
| *** yamamoto has joined #openstack-nova | 09:44 | |
| *** vladikr_ has joined #openstack-nova | 09:44 | |
| *** priteau has quit IRC | 09:53 | |
| *** yassine has quit IRC | 09:59 | |
| *** cheneydc has quit IRC | 10:01 | |
| *** thorst has joined #openstack-nova | 10:02 | |
| *** sree has quit IRC | 10:02 | |
| *** sree has joined #openstack-nova | 10:03 | |
| *** edmondsw has joined #openstack-nova | 10:04 | |
| *** andreas_s has quit IRC | 10:06 | |
| *** andreas_s has joined #openstack-nova | 10:06 | |
| *** edmondsw has quit IRC | 10:08 | |
| *** thorst has quit IRC | 10:08 | |
| *** andreas_s has quit IRC | 10:11 | |
| *** spectr has quit IRC | 10:12 | |
| *** markvoelker has joined #openstack-nova | 10:12 | |
| *** andreas_s has joined #openstack-nova | 10:20 | |
| *** brault has joined #openstack-nova | 10:20 | |
| *** abhi89 has quit IRC | 10:21 | |
| *** sbezverk has quit IRC | 10:21 | |
| *** yangyape_ has joined #openstack-nova | 10:23 | |
| *** spectr has joined #openstack-nova | 10:25 | |
| *** flanders_ has quit IRC | 10:25 | |
| *** brault has quit IRC | 10:26 | |
| *** sree has quit IRC | 10:26 | |
| *** yangyapeng has quit IRC | 10:27 | |
| openstackgerrit | Marco Chiappero proposed openstack/nova-specs master: Enable VM communication channel for power management https://review.openstack.org/511453 | 10:27 |
| *** mikal has quit IRC | 10:28 | |
| *** thingee has quit IRC | 10:28 | |
| *** yangyape_ has quit IRC | 10:28 | |
| *** thingee has joined #openstack-nova | 10:29 | |
| *** smatzek has joined #openstack-nova | 10:29 | |
| *** mikal has joined #openstack-nova | 10:30 | |
| *** udesale has quit IRC | 10:30 | |
| *** gcb has quit IRC | 10:30 | |
| *** andreas_s has quit IRC | 10:33 | |
| *** smatzek has quit IRC | 10:34 | |
| openstackgerrit | Marco Chiappero proposed openstack/nova-specs master: Enable VM communication channel for power management https://review.openstack.org/511453 | 10:37 |
| *** brault has joined #openstack-nova | 10:38 | |
| *** andreas_s has joined #openstack-nova | 10:39 | |
| *** priteau has joined #openstack-nova | 10:42 | |
| *** smatzek has joined #openstack-nova | 10:42 | |
| openstackgerrit | Jianghua Wang proposed openstack/nova master: rt: Implement XenAPI get_inventory() method https://review.openstack.org/339204 | 10:43 |
| *** markvoelker has quit IRC | 10:45 | |
| *** clayton has quit IRC | 10:49 | |
| *** clayton has joined #openstack-nova | 10:51 | |
| *** andreas_s has quit IRC | 10:53 | |
| *** edmondsw has joined #openstack-nova | 10:53 | |
| *** andreas_s has joined #openstack-nova | 10:54 | |
| *** tbachman has quit IRC | 10:56 | |
| *** andreas_s has quit IRC | 10:56 | |
| *** andreas_s has joined #openstack-nova | 10:56 | |
| *** edmondsw has quit IRC | 10:56 | |
| *** logan- has joined #openstack-nova | 10:57 | |
| *** ratailor_ has joined #openstack-nova | 10:57 | |
| *** rtailor has quit IRC | 11:01 | |
| *** AlexeyAbashkin has quit IRC | 11:01 | |
| *** sambetts|afk is now known as sambetts | 11:01 | |
| *** priteau has quit IRC | 11:02 | |
| *** priteau has joined #openstack-nova | 11:03 | |
| *** dave-mccowan has joined #openstack-nova | 11:04 | |
| *** AlexeyAbashkin has joined #openstack-nova | 11:05 | |
| openstackgerrit | Chen Hanxiao proposed openstack/nova master: libvirt: properly decode error message from qemu guest agent https://review.openstack.org/511459 | 11:05 |
| *** andreas_s has quit IRC | 11:07 | |
| *** priteau has quit IRC | 11:08 | |
| *** mvk has joined #openstack-nova | 11:08 | |
| openstackgerrit | Merged openstack/nova master: Fix connection info refresh for reboot https://review.openstack.org/511209 | 11:09 |
| *** priteau has joined #openstack-nova | 11:10 | |
| *** sdague has joined #openstack-nova | 11:11 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/nova-specs master: Network bandwidth resource provider https://review.openstack.org/502306 | 11:14 |
| *** yassine has joined #openstack-nova | 11:15 | |
| *** priteau has quit IRC | 11:16 | |
| *** gmann is now known as gmann_afk | 11:17 | |
| *** yamamoto has quit IRC | 11:27 | |
| *** brault has quit IRC | 11:29 | |
| openstackgerrit | Bob Ball proposed openstack/nova master: XenAPI: Unit tests must mock os_xenapi calls https://review.openstack.org/499573 | 11:34 |
| *** priteau has joined #openstack-nova | 11:35 | |
| *** andreas_s has joined #openstack-nova | 11:35 | |
| *** nicolasbock has joined #openstack-nova | 11:39 | |
| *** yangyapeng has joined #openstack-nova | 11:39 | |
| *** andreas_s has quit IRC | 11:39 | |
| *** yangyapeng has quit IRC | 11:39 | |
| *** yangyapeng has joined #openstack-nova | 11:40 | |
| *** andreas_s has joined #openstack-nova | 11:40 | |
| *** markvoelker has joined #openstack-nova | 11:43 | |
| *** nicolasbock has quit IRC | 11:45 | |
| openstackgerrit | Yikun Jiang proposed openstack/nova master: Add migration_get_by_uuid in db api. https://review.openstack.org/511421 | 11:48 |
| *** litao__ has quit IRC | 11:49 | |
| *** andreas_s has quit IRC | 11:49 | |
| *** yamamoto has joined #openstack-nova | 11:50 | |
| *** tetsuro has quit IRC | 11:52 | |
| openstackgerrit | Elod Illes proposed openstack/nova master: WIP: Transform scheduler.select_destinations notification https://review.openstack.org/508506 | 11:54 |
| *** nicolasbock has joined #openstack-nova | 11:58 | |
| *** andreas_s has joined #openstack-nova | 11:59 | |
| openstackgerrit | Hironori Shiina proposed openstack/nova master: ironic: Support resize and cold migration https://review.openstack.org/500677 | 12:01 |
| *** brault has joined #openstack-nova | 12:01 | |
| *** acormier has joined #openstack-nova | 12:02 | |
| mdbooth | Do we have nova functional tests which actually fire up libvirt/kvm? | 12:02 |
| *** lucasagomes is now known as lucas-hungry | 12:02 | |
| *** andreas_s has quit IRC | 12:03 | |
| *** andreas_s has joined #openstack-nova | 12:04 | |
| *** thorst has joined #openstack-nova | 12:06 | |
| *** acormier has quit IRC | 12:06 | |
| openstackgerrit | Merged openstack/nova master: Fix target_cell usage for scatter_gather_cells https://review.openstack.org/510691 | 12:07 |
| *** andreas_s has quit IRC | 12:08 | |
| *** andreas_s has joined #openstack-nova | 12:08 | |
| gibi | mdbooth: as far as I know every functional test uses the virt driver called FakeDriver so no libvirt driver is loaded and no libvirt/kvm is started in the functional env | 12:09 |
| openstackgerrit | Matthew Booth proposed openstack/nova-specs master: Add serial numbers for local disks https://review.openstack.org/511466 | 12:09 |
| mdbooth | gibi: That's what I thought, thanks. | 12:09 |
| *** edmondsw has joined #openstack-nova | 12:10 | |
| bauzas | mdbooth: the reason why I want to implement some functional tests using a LibvirtFixture | 12:10 |
| *** edmondsw_ has joined #openstack-nova | 12:10 | |
| mdbooth | bauzas: i.e. you specifically want to run libvirt/kvm? | 12:11 |
| mdbooth | Or you don't and you use LibvirtFixture to do that? | 12:12 |
| *** gcb has joined #openstack-nova | 12:12 | |
| mdbooth | iirc, LibvirtFixture monkey patches libvirt-python to be semi-usefully faked, right? | 12:12 |
| bauzas | mdbooth: no, something telling you : okay, here are my XML capabilities | 12:13 |
| bauzas | faking the host | 12:14 |
| *** edmondsw has quit IRC | 12:14 | |
| * mdbooth was just writing a spec to expose disk serial numbers for local disks. You can obviously test that in tempest. I didn't think we could do it in functional, but I thought I'd ask. | 12:15 | |
| mdbooth | Although I think we *could* test that the generated XML contains a serial number | 12:15 |
| *** markvoelker has quit IRC | 12:16 | |
| mdbooth | That might be better than tempest, tbh | 12:16 |
| gibi | bauzas: libvirt already has support for that with a test:// connection url | 12:16 |
| gibi | bauzas: but of course that would mean we have to run libvirt in the test env | 12:17 |
| *** vks1 has quit IRC | 12:19 | |
| *** liverpooler has joined #openstack-nova | 12:19 | |
| *** lifeless has quit IRC | 12:24 | |
| bauzas | gibi: I know about the libvirt fake conn | 12:24 |
| bauzas | gibi: but for example, if I want to get some specific capabilities, then meh | 12:25 |
| *** gmann_afk is now known as gmann | 12:26 | |
| *** phuongnh has quit IRC | 12:26 | |
| *** phani_ has quit IRC | 12:27 | |
| gibi | bauzas: you can specify the host capability in the test:// connection url so libvirt will report whathever you need | 12:27 |
| *** acormier has joined #openstack-nova | 12:27 | |
| *** acormier has quit IRC | 12:27 | |
| gibi | bauzas: at some point in the past I planned to build something up with this but never actually did it | 12:28 |
| *** eharney has joined #openstack-nova | 12:28 | |
| *** acormier has joined #openstack-nova | 12:28 | |
| gibi | bauzas: but totally on the side of bulding a test env that could cover the libvirt driver code | 12:28 |
| bauzas | gibi: yup, you can do that but AFAIK there is a bug about what libvirt retuens | 12:29 |
| bauzas | anyhow, I need to test | 12:30 |
| *** lifeless has joined #openstack-nova | 12:31 | |
| *** acormier has quit IRC | 12:32 | |
| *** markvoelker has joined #openstack-nova | 12:33 | |
| gibi | bauzas: if it is buggy then I understand looking at other ways to do the test. I thought libvirt community uses the test:// connection to test libvirt so I assumed it is at least as good as libvirt | 12:34 |
| bauzas | ok, I could try to do it then | 12:35 |
| bauzas | anyway, working on a separate series as of now | 12:35 |
| gibi | bauzas: I don't want to pressure anything :) | 12:35 |
| bauzas | gibi: np :) | 12:36 |
| *** udesale has joined #openstack-nova | 12:36 | |
| *** udesale has quit IRC | 12:37 | |
| *** udesale has joined #openstack-nova | 12:37 | |
| bhagyashris | johnthetubaguy: Hi, I need some guidance for patch https://review.openstack.org/#/c/409644/ ? | 12:39 |
| *** ociuhandu has joined #openstack-nova | 12:40 | |
| openstackgerrit | Hironori Shiina proposed openstack/nova master: virt/ironic: Implement rescue and unrescue https://review.openstack.org/416487 | 12:41 |
| *** links has quit IRC | 12:41 | |
| *** ratailor_ has quit IRC | 12:41 | |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Fully destroy instances during a hard reboot https://review.openstack.org/400384 | 12:42 |
| *** andreas_s has quit IRC | 12:43 | |
| *** andreas_s has joined #openstack-nova | 12:43 | |
| *** kylek3h has joined #openstack-nova | 12:44 | |
| *** kylek3h has quit IRC | 12:44 | |
| *** Yikun has quit IRC | 12:45 | |
| *** liusheng has quit IRC | 12:45 | |
| bhagyashris | johnthetubaguy: Actually as per our discussion I have bumped the api microversion and service version as well but there is one problem that is if user will request the backup image api for old microversion for example 2.45 then in that case it's raises the on my fix because as we are skipping the image creation for rotation 0 | 12:45 |
| *** liusheng has joined #openstack-nova | 12:45 | |
| *** yikun has joined #openstack-nova | 12:46 | |
| bhagyashris | johnthetubaguy: *it raises KeyError | 12:46 |
| bhagyashris | johnthetubaguy: at api side and returns the HTTP 500 internal server error | 12:46 |
| johnthetubaguy | bhagyashris: that sounds incorrect to me. You should only skip the image creation if you user requests the new API version, if you are going that way. I guess you should skip the image upload and just delete the image for the older API version. | 12:47 |
| *** kylek3h has joined #openstack-nova | 12:47 | |
| *** mriedem has joined #openstack-nova | 12:47 | |
| johnthetubaguy | bhagyashris: as mentioned before, if its a new API microversion, it will need an approved nova-spec before it can be merged. | 12:47 |
| mriedem | claudiub|2: can you take a look at these pike backports? need a final +2 https://review.openstack.org/#/q/topic:bug/1718455+branch:stable/pike | 12:48 |
| bhagyashris | johnthetubaguy: yeah i am working on nova-apec | 12:48 |
| mriedem | for other stable cores, we have a series of changes for fixes in pike starting here that need review https://review.openstack.org/#/c/509922/1 | 12:49 |
| *** takedakn has joined #openstack-nova | 12:49 | |
| mriedem | lyarwood: ^ | 12:49 |
| lyarwood | mriedem: ack | 12:49 |
| openstackgerrit | Hironori Shiina proposed openstack/nova master: virt/ironic: Implement rescue and unrescue https://review.openstack.org/416487 | 12:50 |
| *** hshiina2 has quit IRC | 12:50 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: Get auth from context for glance endpoint https://review.openstack.org/490057 | 12:52 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for cinder client https://review.openstack.org/508345 | 12:52 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for neutron client https://review.openstack.org/509892 | 12:52 |
| openstackgerrit | Eric Fried proposed openstack/nova master: Use ksa adapter for keystone conf & requests https://review.openstack.org/507693 | 12:52 |
| *** takedakn has quit IRC | 12:53 | |
| mriedem | dansmith: that person's instance 404 problem in the ML from ocata was using the wsgi stuff :) | 12:53 |
| mriedem | almost wonder if we should delete those files in ocata | 12:54 |
| *** pchavva has joined #openstack-nova | 12:54 | |
| openstackgerrit | Merged openstack/nova stable/pike: Support qemu >= 2.10 https://review.openstack.org/509774 | 12:56 |
| bhagyashris | johnthetubaguy: i am not clear about how i will skip the image creation for new api version because code to skip image creation is at /nova/compute/api/py and that is common code | 12:56 |
| mriedem | bhagyashris: pass a flag | 12:56 |
| bhagyashris | mriedem: ohh ok | 12:57 |
| mriedem | check the microversion in the REST API handler code, and pass some flag down to the compute api, with the default being backward compatible | 12:57 |
| *** andreas_s has quit IRC | 12:57 | |
| gibi | mriedem: I saw your comment and left a question about possible solution inline in https://review.openstack.org/#/c/510938/2/nova/compute/manager.py | 12:57 |
| *** lucas-hungry is now known as lucasagomes | 12:58 | |
| *** vks1 has joined #openstack-nova | 12:58 | |
| *** mdnadeem has quit IRC | 12:58 | |
| mriedem | gibi: yeah was just replying | 12:59 |
| *** lyan has joined #openstack-nova | 12:59 | |
| mriedem | i forgot that ironic and vmware support rebuild | 12:59 |
| gibi | if it just rebuild then we don't have to care (I guess) but if they support evacuation as well then we have to me smarter | 13:00 |
| mriedem | yeah i know vmware deployments use evacuate, | 13:00 |
| mriedem | because before dansmith robustified it, if you started up a 2nd nova-compute to manage the same cluster as another, it would think all of the instances were evacuated and delete them from the cluster | 13:01 |
| mriedem | which people didn't like for some reason | 13:01 |
| *** andreas_s has joined #openstack-nova | 13:01 | |
| mriedem | i fondly remember being on several customer calls at ibm because of that issue | 13:02 |
| gibi | I can imagine the how big was that dislike :) | 13:02 |
| gibi | what if I just ask for all the compute nodes for this host before the loop and look up the needed node in the loop? | 13:03 |
| *** esberglu has quit IRC | 13:03 | |
| *** abhi89 has joined #openstack-nova | 13:03 | |
| mriedem | gibi: replied inline | 13:04 |
| mriedem | you could also probably do that | 13:05 |
| mriedem | i was suggesting lookup by host/node, cache the result | 13:05 |
| gibi | OK. let's do that | 13:06 |
| *** catintheroof has joined #openstack-nova | 13:06 | |
| *** catintheroof has quit IRC | 13:06 | |
| *** catintheroof has joined #openstack-nova | 13:06 | |
| mriedem | so that made me think of something https://github.com/openstack/nova/blob/master/nova/conductor/manager.py#L752 | 13:07 |
| mriedem | if you force an evacuate for ironic or vmware, you're going to probably be busted | 13:07 |
| mriedem | because you can only specify the host, but not the node | 13:07 |
| mriedem | we just pick a node randomly from those available for the host | 13:07 |
| mriedem | probably need to make a note of that in the API, and another reason why the force flag is bad | 13:08 |
| gibi | could we be busted here as well? https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2787 | 13:08 |
| gibi | the _get_compute_info call also uses the compat call to the db | 13:08 |
| mriedem | possibly | 13:09 |
| mriedem | gibi: well, that's if you force | 13:10 |
| mriedem | if you force, scheduled_node is None | 13:10 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2762 | 13:10 |
| mriedem | so another reason why forced host evacuate won't work for ironic or vmware | 13:11 |
| mriedem | although does vmware still have multiple nodes? i can't remember | 13:11 |
| mriedem | bauzas: ^? | 13:11 |
| gibi | ahh OK | 13:11 |
| mriedem | dims: remember long ago the thing you removed for the vmware driver in nova - was that for a single compute managing multiple clusters? or something to do with a 1:M host:node mapping for vmware? | 13:13 |
| *** catintheroof has quit IRC | 13:13 | |
| mriedem | i think it was the former | 13:13 |
| *** baoli has joined #openstack-nova | 13:13 | |
| *** tbachman has joined #openstack-nova | 13:14 | |
| *** catintheroof has joined #openstack-nova | 13:14 | |
| *** artom_ is now known as artom | 13:15 | |
| openstackgerrit | priyaduggirala proposed openstack/nova master: Rename parameters in call() of nova/image/glance.py https://review.openstack.org/508533 | 13:18 |
| *** esberglu has joined #openstack-nova | 13:18 | |
| *** edmondsw_ is now known as edmondsw | 13:19 | |
| kaisers | Hi! If somebody with libvirt/assisted volume snapshot deletion experience could visit https://bugs.launchpad.net/nova/+bug/1716920 it'd be great, I'm stuck analyzing this. | 13:21 |
| openstack | Launchpad bug 1716920 in OpenStack Compute (nova) "online snapshot deletion breaks volume info and backing chain (with remotefs drivers?)" [Undecided,New] | 13:21 |
| kaisers | kashyap: ----^ | 13:21 |
| *** esberglu has quit IRC | 13:21 | |
| kashyap | kaisers: Hey, I noticed your latest update on the bug | 13:21 |
| kashyap | kaisers: Wasn't ignoring it; just was looking at something more broken elsewhere | 13:22 |
| kaisers | kashyap: no worries :) | 13:22 |
| kashyap | kaisers: You say you're back to "square one" | 13:22 |
| kaisers | I believed novas block rebase operation to be stuck but that was wrong | 13:23 |
| kashyap | From your comment#6, what did you patch there while testing? | 13:23 |
| *** esberglu has joined #openstack-nova | 13:23 | |
| kaisers | kashyap: debug log messages to see what's happening and if that operation is terminating | 13:23 |
| kaisers | it does | 13:23 |
| kaisers | I'm not sure if i read the libvirt log correctly | 13:23 |
| kaisers | (comment #7) | 13:24 |
| *** jaosorior has quit IRC | 13:27 | |
| *** vks1 has quit IRC | 13:27 | |
| *** sree has joined #openstack-nova | 13:27 | |
| kashyap | kaisers: I'll look in a bit; I have 2 calls to attend now. | 13:27 |
| kaisers | This version of the log excerpt is probably easier to read: http://paste.openstack.org/show/623456/ | 13:27 |
| kaisers | kashyap: yeah, thanks | 13:27 |
| kashyap | kaisers: But here's some past notes of what to make of libvirt debug logs: http://lists.openstack.org/pipermail/openstack-dev/2016-October/105158.html | 13:27 |
| kaisers | kashyap: will read | 13:28 |
| kashyap | If you're checking request / response; for each item (request _and_ response) libvirt will increment the ID | 13:28 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: add warning about force evacuate for ironic/vmware https://review.openstack.org/511477 | 13:29 |
| mriedem | gibi: ^ | 13:29 |
| kashyap | kaisers: Err, scratch that last line: request & corresponding response have the _same_ ID :-) Have to refer to my own notes in the e-mail | 13:29 |
| kaisers | kashyap: :) | 13:30 |
| dims | mriedem : this one? https://review.openstack.org/#/c/163426/ | 13:30 |
| mriedem | johnthetubaguy: want to hit this pike backport? https://review.openstack.org/#/c/510957/ | 13:30 |
| dims | mriedem : "map one nova-compute to one VC cluster" | 13:31 |
| mriedem | dims: yeah | 13:31 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 13:31 |
| *** sree has quit IRC | 13:31 | |
| *** gmann is now known as gmann_afk | 13:31 | |
| dims | mriedem : we switched to one nova-compute == one cluster in vCenter. earlier you could just run a single nova-compute for all the clusters in vcenter | 13:32 |
| mriedem | ok, which meant, i think, that we had a host:node ratio of 1:M | 13:33 |
| mriedem | i've added rado to https://review.openstack.org/#/c/511477/ to keep me honest | 13:33 |
| kaisers | kashyap: my core question currently is if i read correctly that lines 34-36 (in the paste) mean the backing file of drive-virtio-disk1 is set to volume-669cfd0c-5b5c-470b-8b25-4c15cc655373.a755e1fc-f5ff-4dc1-937f-c03fb5ecc2d8 . That would be correct and what i expect. If true it means that the result is either not written to disk for some reason or the backing file reference is changed back to it's previous value due to some follow u | 13:34 |
| kaisers | kashyap: but sorry for bugging on while you're busy elsewhere, 'later | 13:34 |
| mriedem | dims: ah yeah get_available_nodes only returns a single item now https://review.openstack.org/#/c/103916/13/nova/virt/vmwareapi/driver.py@389 | 13:34 |
| mriedem | since that change | 13:35 |
| kashyap | kaisers: No, it's okay; I see you're adding details to the bug | 13:35 |
| kashyap | Ah-ha, it's with remotefs! | 13:36 |
| kashyap | kaisers: You also see it with NFS? | 13:36 |
| *** vivsoni_ has quit IRC | 13:36 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: add warning about force evacuate for ironic https://review.openstack.org/511477 | 13:36 |
| mriedem | dims: maybe mogan will let you specify a host and node when forcing the evacuate of a baremetal instance | 13:36 |
| mriedem | :) | 13:36 |
| *** vivsoni has joined #openstack-nova | 13:36 | |
| *** sree has joined #openstack-nova | 13:37 | |
| dims | 🔥:) | 13:37 |
| mriedem | andreas_s: seems to be a lot of zkvm ci failures | 13:37 |
| andreas_s | mriedem: thx, let me have a look | 13:38 |
| mriedem | http://sng01.objectstorage.softlayer.net/v1/AUTH_1940ea10-6e82-4501-b2f9-eb236510e575/ibmzkvmci/510957/1/check-tempest-dsvm-neutron-full-ubuntu-xenial-s390x/203fd4a/console.log | 13:38 |
| mriedem | ^ is a totally unrelated stable/pike change | 13:38 |
| mriedem | lots of issues with volume groups and volume backups | 13:39 |
| mriedem | andreas_s: is the zkvm ci also running on cinder? | 13:39 |
| mriedem | because if not, you could probably exclude all of the tempest.api.volume tests | 13:39 |
| *** sbezverk has joined #openstack-nova | 13:39 | |
| mriedem | really just whitelist to running the tempest.api.compute tests | 13:39 |
| kaisers | kashyap: I haven't tested this with NFS, i just noticed that e.g. vzstorage CI started skipping those tests, my guess is for a similar reason. | 13:40 |
| *** burt has joined #openstack-nova | 13:40 | |
| andreas_s | mriedem: yes, it is running cinder - but sometimes the backup related tests all fail - I haven't yet figured out why this is the case.. | 13:41 |
| *** sree has quit IRC | 13:41 | |
| mriedem | andreas_s: no, i mean, is the CI also running against cinder changes? | 13:41 |
| mriedem | or just nova | 13:41 |
| andreas_s | mriedem: ah - no. just nova | 13:41 |
| mriedem | andreas_s: ok, so nova changes don't care about the results of volume api only tests | 13:42 |
| kaisers | kashyap: looking at recent NFS CI test they seem to hit the same issue: http://logs.openstack.org/27/511427/2/check/gate-tempest-dsvm-full-devstack-plugin-nfs-nv/bf61d5b/console.html | 13:42 |
| mriedem | nor image or object storage or identity api tests | 13:42 |
| mriedem | andreas_s: so you could just whitelist the zkvm ci, which only runs against nova changes, to only run the tempest.api.compute tests | 13:42 |
| kashyap | kaisers: Okay, please write a comment in the bug with the log from NFS as plain text attachment | 13:42 |
| kashyap | As these URLs will expire | 13:42 |
| andreas_s | mriedem: no scenario tests? | 13:42 |
| kaisers | kashyap: will do | 13:43 |
| *** vks1 has joined #openstack-nova | 13:43 | |
| mriedem | andreas_s: you could probably run the scenario tests, but some of them don't touch nova at all i don't think, like some of the advanced networking ones | 13:43 |
| mriedem | andreas_s: so maybe just whitelist tempest.api.compute and tempest.scenario for now | 13:43 |
| andreas_s | mriedem: skipping storage related things will definitively help to stabilize the voting pattern... | 13:43 |
| mriedem | that should help reduce some of the noise and the load | 13:43 |
| andreas_s | mriedem: ok, will do, thanks for the suggestion | 13:44 |
| mriedem | np, thanks for being responsive | 13:44 |
| mriedem | oomichi: are schema validation errors handled separately from the expected_errors decorator in this change? https://review.openstack.org/#/c/509039/ | 13:49 |
| *** gouthamr has joined #openstack-nova | 13:49 | |
| mriedem | ah i guess it is | 13:49 |
| *** smatzek has quit IRC | 13:49 | |
| dansmith | mriedem: so on that accepted thing, | 13:50 |
| mriedem | uh oh | 13:50 |
| dansmith | mriedem: I think that was improperly baking rt-level behavior into the db layer | 13:50 |
| dansmith | mriedem: way before placement of course | 13:50 |
| mriedem | nikola's patch? | 13:50 |
| dansmith | I don't think that just because it was intentional back then means it makes sense now | 13:50 |
| dansmith | yeah | 13:50 |
| *** rmart04 has quit IRC | 13:50 | |
| mriedem | i meant to go dig into the linked bug but forgot | 13:51 |
| *** smatzek has joined #openstack-nova | 13:51 | |
| kaisers | kashyap: I've to run in a min, I'll follow up on this irc log and the bug ticket when i'm back on... | 13:52 |
| kashyap | kaisers: Sure; it's best if we hash it out on the bug, too. As others can catch up on the context | 13:52 |
| *** nikhil_ has joined #openstack-nova | 13:52 | |
| mriedem | dansmith: it was related to bug https://bugs.launchpad.net/nova/+bug/1417667 | 13:52 |
| openstack | Launchpad bug 1417667 in OpenStack Compute (nova) "migration/evacuation/rebuild/resize of instance with NUMA topology needs to recalculate NUMA topology" [Medium,In progress] | 13:52 |
| mriedem | but, that's an epic thing | 13:52 |
| mriedem | so who knows | 13:52 |
| *** nikhil_ is now known as Guest48516 | 13:52 | |
| mriedem | https://review.openstack.org/#/q/topic:bug/1417667+(status:open+OR+status:merged) | 13:52 |
| mriedem | jesus | 13:52 |
| *** Guest48516 is now known as nikhil_k | 13:53 | |
| dansmith | hmm. not sure about that | 13:53 |
| mriedem | heh, "this numa feature we added doens't work, it's a bug, so let's fix it with a billion patches" | 13:53 |
| bhagyashris | johnthetubaguy, mriedem: thank you :) | 13:53 |
| *** andreas_s has quit IRC | 13:54 | |
| *** andreas_s has joined #openstack-nova | 13:55 | |
| efried | sdague (cc mordred) Regarding barbican affordance in bp/use-ksa-adapter-for-endpoints -- I've been looking into it, and I don't think Nova is the right place to tackle it. Would like to discuss when you have a few. | 13:55 |
| *** suresh12 has joined #openstack-nova | 13:56 | |
| efried | (mriedem ^ if it turns out to be the case that we don't do that, would a spec update be necessary/desirable?) | 13:56 |
| *** andreas_s has quit IRC | 13:57 | |
| * alex_xu is waiting for jaypipes | 13:57 | |
| *** andreas_s has joined #openstack-nova | 13:57 | |
| *** suresh12 has quit IRC | 13:57 | |
| mriedem | efried: if the spec says you're going to do it for barbican too and you don't, then amending the spec is fine | 13:57 |
| efried | alex_xu I think Jay is on quasi-vacation | 13:58 |
| efried | mriedem ack | 13:58 |
| *** suresh12 has joined #openstack-nova | 13:58 | |
| alex_xu | efried: ah, thanks, when he is back? | 13:58 |
| mriedem | dansmith: i don't really see anything in that series of nikola's changes, anything obvious at least, that warrants the need for including 'accepted' in that not-in-progress list, so i assume it was just something he noticed while going through that stuff | 13:58 |
| *** itlinux has joined #openstack-nova | 13:58 | |
| efried | Waidaminute... alex_xu comes back and jaypipes is gone.... Has anyone ever actually seen them in the same place at the same time? | 13:59 |
| dansmith | mriedem: yeah seems unrelated | 13:59 |
| mriedem | efried: i have actually | 13:59 |
| efried | alex_xu Not totally sure. Couple weeks? But he's been checking in spottily | 13:59 |
| efried | mriedem Yeah, I did at the PTG. Just being hilariously funny. | 13:59 |
| mriedem | talking about trusted filters and traits | 13:59 |
| *** sree has joined #openstack-nova | 14:00 | |
| alex_xu | efried: ok...thanks | 14:00 |
| efried | alex_xu You looking for SQL brainstorm collab? | 14:00 |
| efried | on traits stuff | 14:00 |
| alex_xu | efried: yea, I rewrite the trait patch as Jay suggested, want to get jay take a look whether it is he expected | 14:01 |
| bauzas | mriedem: sorry, was around | 14:01 |
| bauzas | mriedem: so, no, VMware is no longer using more than one node | 14:01 |
| efried | alex_xu Cool. I have to admit, the way you had it before was pretty baffling to me, though I'm definitely not an expert. | 14:01 |
| efried | alex_xu Which patch? | 14:02 |
| alex_xu | efried: here is one https://review.openstack.org/#/c/479766/10 | 14:02 |
| efried | ... | 14:02 |
| *** suresh12 has quit IRC | 14:02 | |
| alex_xu | yea, the sql is complex, but as jay said, do that in the python also complex... | 14:02 |
| alex_xu | efried: the original one is https://review.openstack.org/#/c/489206/ | 14:03 |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] add coverage for update of standard resource class https://review.openstack.org/511485 | 14:04 |
| efried | alex_xu We decided to call it 'required' in GET /allocation_candidates, 对吧 ? | 14:04 |
| efried | alex_xu I'm not completely up on the flow; is it getting translated from 'required' to 'traits' at some point? | 14:05 |
| alex_xu | efried: yes, I will rename it | 14:05 |
| efried | okay, cool | 14:05 |
| alex_xu | efried: 酷 | 14:05 |
| efried | :) | 14:05 |
| *** acormier has joined #openstack-nova | 14:06 | |
| mriedem | bauzas: want to have a pass at this spec? https://review.openstack.org/#/c/501017/ | 14:07 |
| mriedem | i'm going to try and go through spec reviews today | 14:07 |
| *** jaosorior has joined #openstack-nova | 14:09 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Refactor resource tracker to account for migration allocations https://review.openstack.org/506419 | 14:09 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make migration uuid hold allocations for migrating instances https://review.openstack.org/506420 | 14:09 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Make live migration hold resources with a migration allocation https://review.openstack.org/507638 | 14:09 |
| bauzas | mriedem: sure, I already looked at that one and I remember the PTG discussion | 14:11 |
| mriedem | sdague: is this looking ok for the file injection deprecation plan? https://review.openstack.org/#/c/509013/ | 14:11 |
| *** itlinux has quit IRC | 14:12 | |
| *** hamzy has quit IRC | 14:12 | |
| *** hongbin has joined #openstack-nova | 14:13 | |
| *** coreywright has quit IRC | 14:14 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Confirm that empty resources query causes 400 https://review.openstack.org/511488 | 14:17 |
| mriedem | hongbin: re https://bugs.launchpad.net/nova/+bug/1690439 | 14:20 |
| openstack | Launchpad bug 1690439 in neutron "[RFE] Deal with NetworkAmbiguous error" [Wishlist,Triaged] | 14:20 |
| *** awaugama has joined #openstack-nova | 14:20 | |
| mriedem | hongbin: i'm not aware of anyone working on adding a 'default' flag to neutron networks when there are multiple available to the tenant and one isn't specified during server create, | 14:21 |
| mriedem | arguably we could add a config option to nova to let operators say something like, default to public shared=True network or default to private tenant network | 14:21 |
| *** hemna_ has joined #openstack-nova | 14:23 | |
| *** yamamoto has quit IRC | 14:23 | |
| *** itlinux has joined #openstack-nova | 14:24 | |
| sdague | mriedem: that seems sane | 14:26 |
| *** coreywright has joined #openstack-nova | 14:27 | |
| *** psachin has quit IRC | 14:28 | |
| *** armax has joined #openstack-nova | 14:30 | |
| mriedem | sdague: cool | 14:30 |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Confirm that empty resources query causes 400 https://review.openstack.org/511488 | 14:30 |
| hongbin | mriedem: o/ | 14:31 |
| andreas_s | mriedem: just FYI - I will do the filter change in the zkvm CI by tomorrow - I first want to check if the new regex is working in our test environment before applying it... | 14:31 |
| *** itlinux has quit IRC | 14:32 | |
| hongbin | mriedem: it sounds like there are two options and people don't have consensus of which one is preferrable ? | 14:32 |
| *** andreas_s has quit IRC | 14:34 | |
| *** trinaths has joined #openstack-nova | 14:34 | |
| *** andreas_s has joined #openstack-nova | 14:35 | |
| gibi | mriedem, sdague, stephenfin: Can we somehow choose one of this two compeeting solutions? https://review.openstack.org/#/c/507253/ and https://review.openstack.org/#/c/507239/ | 14:35 |
| *** itlinux has joined #openstack-nova | 14:36 | |
| *** vivsoni has quit IRC | 14:36 | |
| *** vivsoni_ has joined #openstack-nova | 14:36 | |
| mriedem | gibi: you'll have to find an impartial 3rd party moderator | 14:37 |
| gibi | dansmith: ^^ could you help us? | 14:37 |
| sdague | make dansmith pick one :) | 14:38 |
| sdague | I'm fine with whatever he picks | 14:38 |
| dansmith | why do I have to pick? | 14:38 |
| dansmith | oh because mriedem weaseled out | 14:38 |
| dansmith | ffs | 14:38 |
| *** links has joined #openstack-nova | 14:39 | |
| gibi | and because we like your decisions | 14:39 |
| dansmith | well, tbh, I feel like mriedem's is easier for me to wrap my brain around.. while I get it's less OO, it's much easier for me to find those for a test that sets them then tons of object hierarchy, like we have with the integrated tests | 14:40 |
| *** yingjun has joined #openstack-nova | 14:43 | |
| gibi | based on the silence I think there is no objection | 14:43 |
| *** trinaths has left #openstack-nova | 14:44 | |
| gibi | dansmith: Will you +2 mriedem's patch or shall | 14:45 |
| *** suresh12 has joined #openstack-nova | 14:45 | |
| gibi | I? | 14:45 |
| dansmith | I did | 14:45 |
| gibi | dansmith: cool, thanks | 14:45 |
| openstackgerrit | Merged openstack/nova stable/pike: Add a regression test for bug 1718455 https://review.openstack.org/508590 | 14:47 |
| openstack | bug 1718455 in OpenStack Compute (nova) pike "[pike] Nova host disable and Live Migrate all instances fail." [High,In progress] https://launchpad.net/bugs/1718455 - Assigned to Matt Riedemann (mriedem) | 14:47 |
| mriedem | thanks claudiub|2 | 14:48 |
| *** Swami has joined #openstack-nova | 14:51 | |
| *** jangutter has quit IRC | 14:52 | |
| *** jangutter has joined #openstack-nova | 14:52 | |
| *** andreas_s has quit IRC | 14:53 | |
| *** yamahata has joined #openstack-nova | 14:53 | |
| -openstackstatus- NOTICE: Job log uploads are failing due to lack of inodes. Jobs also fail due to mismatches in gnutls packages. Workarounds for both in progress with proper fixes to follow. | 14:54 | |
| *** ChanServ changes topic to "Job log uploads are failing due to lack of inodes. Jobs also fail due to mismatches in gnutls packages. Workarounds for both in progress with proper fixes to follow." | 14:54 | |
| *** rcernin has quit IRC | 14:55 | |
| *** suresh12 has quit IRC | 14:55 | |
| *** hamzy has joined #openstack-nova | 14:55 | |
| *** sridharg has quit IRC | 14:57 | |
| *** lpetrut_ has quit IRC | 14:57 | |
| *** vivsoni has joined #openstack-nova | 14:58 | |
| *** vivsoni_ has quit IRC | 14:58 | |
| openstackgerrit | Sean Dague proposed openstack/nova master: Move test_uuid_sentinels to NoDBTestCase https://review.openstack.org/507253 | 14:59 |
| openstackgerrit | Sean Dague proposed openstack/nova master: Don't use mock.patch.stopall https://review.openstack.org/507527 | 14:59 |
| sdague | ok, my stuff rebased on mriedem's now | 14:59 |
| *** gszasz has quit IRC | 14:59 | |
| zioproto | mriedem: I answered on the blog to your comments. Btw I will be in Sydney if you need to talk face to face about these experiences with large number of instances. | 15:00 |
| *** Oku_OS is now known as Oku_OS-away | 15:01 | |
| *** eharney has quit IRC | 15:02 | |
| mriedem | zioproto: cool. i proposed a forum session about scale testing too, and there was a similar one for stress testing at large scale | 15:02 |
| *** andreas_s has joined #openstack-nova | 15:02 | |
| efried | sdague Regarding barbican affordance in bp/use-ksa-adapter-for-endpoints -- I've been looking into it, and I don't think Nova is the right place to tackle it. Would like to discuss when you have a few. | 15:02 |
| mriedem | i guess mine was refused http://forumtopics.openstack.org/cfp/details/55 | 15:02 |
| sdague | efried: sure, I have a slice now | 15:03 |
| sdague | efried: what's the concern? | 15:03 |
| *** lajoskatona has quit IRC | 15:03 | |
| mriedem | zioproto: this session was selected: http://forumtopics.openstack.org/cfp/details/21 | 15:03 |
| efried | sdague The opts are defined in castellan itself | 15:03 |
| efried | sdague And they're *used* within castellan itself, not directly from Nova. | 15:03 |
| sdague | oh, interesting | 15:03 |
| sdague | how much do they diverge? | 15:04 |
| efried | sdague So I could register the ksa opts in Nova with deprecations for the barbican names. And what I think would then happen is that castellan (still referring to them by their barbican names) would pick them up because the deprecations would alias them. | 15:04 |
| sdague | yeh, it would be good to get the barbican/castellan folks engaged on that to figure out what their preference is | 15:05 |
| *** jaosorior has quit IRC | 15:05 | |
| efried | wrt divergence: there's barbican_endpoint vs. endpoint_override. And api_version vs. version - BUT in the ksa stuff we've been not letting the op dictate versions for the other services - I have a util that rips those opts out. | 15:06 |
| efried | Sorry, barbican_api_version* | 15:06 |
| efried | sdague So yeah, I think long term what we want is for castellan to deprecate in favor of the ksa opts. | 15:07 |
| *** AlexeyAbashkin has quit IRC | 15:07 | |
| efried | If that happened, Nova wouldn't have to change anything. | 15:07 |
| gibi | mriedem: could you report about the notification meeting on my behalf on the nova meeting? | 15:07 |
| efried | sdague ...which I think is better than trying to force it in Nova in the interim. | 15:08 |
| efried | sdague What IRC channel would a guy use to talk to barbican/castellan folk? | 15:09 |
| efried | or should I hit the ML? | 15:09 |
| mriedem | gibi: sure | 15:10 |
| mriedem | efried: #openstack-barbican | 15:11 |
| efried | got it | 15:11 |
| mriedem | sdague: the keypair + rebuild spec updated the security impact section, i think this is what you were asking for but wanted to confirm http://docs-draft.openstack.org/21/375221/11/check/gate-nova-specs-docs-ubuntu-xenial/1f04019//doc/build/html/specs/queens/approved/rebuild-keypair-reset.html#security-impact | 15:11 |
| mriedem | basically, you can't rebuild a server for another user and update the keypair at the same time | 15:11 |
| mriedem | so don't inject user B's key into user A's serer | 15:11 |
| mriedem | *server | 15:12 |
| sdague | efried: also, if you find active people over there, please get them to come join here, because I've got a big chunk of feedback on their image singing work that needs to be there | 15:12 |
| *** sree has quit IRC | 15:12 | |
| sdague | mriedem: honestly, it's not a security issue | 15:12 |
| sdague | users don't really own servers | 15:12 |
| gibi | mriedem: thanks a lot | 15:13 |
| mriedem | so you think this is fine to do and should just be documented? | 15:13 |
| mriedem | sdague: i'm trying to think if this would be surprising behavior | 15:13 |
| sdague | mriedem: yeh, I just think we should document it | 15:14 |
| *** yamahata has quit IRC | 15:14 | |
| sdague | I think it highlights that our notion of users owning keys is actually bad | 15:15 |
| sdague | and projects should own keys | 15:15 |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/ocata: Add release note for running nova-api under wsgi in Ocata https://review.openstack.org/511503 | 15:15 |
| mriedem | dansmith: reno for ocata to maybe help with the wsgi service version thing ^ | 15:15 |
| *** andreas_s has quit IRC | 15:15 | |
| *** eharney has joined #openstack-nova | 15:15 | |
| mriedem | sdague: ok want to make that comment on here https://review.openstack.org/#/c/375221/11/specs/queens/approved/rebuild-keypair-reset.rst@89 ? | 15:16 |
| sdague | sure | 15:16 |
| mriedem | the spec writer might not have been clear on this in PS10 | 15:16 |
| mriedem | i know i wasn't really | 15:16 |
| *** takedakn has joined #openstack-nova | 15:16 | |
| *** itlinux has quit IRC | 15:17 | |
| *** yamamoto has joined #openstack-nova | 15:24 | |
| *** udesale has quit IRC | 15:27 | |
| *** suresh12 has joined #openstack-nova | 15:27 | |
| mriedem | need dane-fichter around for this one too https://review.openstack.org/#/c/312225/ | 15:28 |
| *** hferenc has quit IRC | 15:28 | |
| *** READ10 has joined #openstack-nova | 15:29 | |
| *** vivsoni has quit IRC | 15:30 | |
| *** yamamoto has quit IRC | 15:31 | |
| *** takedakn has quit IRC | 15:32 | |
| *** vivsoni has joined #openstack-nova | 15:32 | |
| *** Swami has left #openstack-nova | 15:34 | |
| *** andreas_s has joined #openstack-nova | 15:34 | |
| efried | alex_xu My review is going to be missing some depth with respect to shared RPs and aggregates. Can you help me understand the architecture of those things a bit more? | 15:34 |
| *** Swami has joined #openstack-nova | 15:35 | |
| efried | Perhaps I need to go read the shared RP spec again. Maybe it'll make more sense now. | 15:35 |
| mdbooth | dansmith: I replied to your 2 review comments on https://review.openstack.org/#/c/511466/ . If you get a chance to look again I'll update asap. Thanks! | 15:36 |
| *** vladikr_ has quit IRC | 15:36 | |
| *** vladikr has quit IRC | 15:37 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: disable numa feature when virt_type is not kvm https://review.openstack.org/465160 | 15:41 |
| *** itlinux has joined #openstack-nova | 15:42 | |
| mriedem | mdbooth: counter replied | 15:42 |
| mdbooth | mriedem: Looking, thanks. | 15:43 |
| *** andreas_s has quit IRC | 15:43 | |
| *** yamamoto has joined #openstack-nova | 15:45 | |
| *** yamamoto has quit IRC | 15:45 | |
| *** links has quit IRC | 15:47 | |
| *** andreas_s has joined #openstack-nova | 15:48 | |
| *** rodolof has quit IRC | 15:50 | |
| *** vladikr_ has joined #openstack-nova | 15:51 | |
| *** vladikr has joined #openstack-nova | 15:52 | |
| *** yamahata has joined #openstack-nova | 15:55 | |
| *** penick has joined #openstack-nova | 15:55 | |
| *** priteau has quit IRC | 15:55 | |
| *** tbachman has quit IRC | 15:56 | |
| *** links has joined #openstack-nova | 16:00 | |
| *** andreas_s has quit IRC | 16:00 | |
| *** ralonsoh has quit IRC | 16:01 | |
| sean-k-mooney | mriedem: do you have a second to discuss the multiple bindings? i have a question regarding mix old+new hosts | 16:01 |
| *** vivsoni_ has joined #openstack-nova | 16:02 | |
| *** vivsoni has quit IRC | 16:02 | |
| *** suresh12 has quit IRC | 16:02 | |
| *** suresh12 has joined #openstack-nova | 16:03 | |
| *** tbachman has joined #openstack-nova | 16:04 | |
| mriedem | sean-k-mooney: sure | 16:05 |
| mriedem | i haven't made it back to your replies in the spec yet | 16:05 |
| *** edmondsw has quit IRC | 16:05 | |
| *** erlon has quit IRC | 16:07 | |
| sean-k-mooney | mriedem: going form old to new i can add code to create the binding if they are not found in the migration data and update the xml | 16:07 |
| sean-k-mooney | mriedem: going for new to old i cannot | 16:07 |
| sean-k-mooney | mriedem: so in this case if i detect that the bindings differ e.g. source linux bridge and dest ovs should i fail the migration at that point since | 16:08 |
| openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Reset the instance keypair while rebuilding (spec) https://review.openstack.org/375221 | 16:08 |
| mriedem | sdague: updated ^ | 16:08 |
| sean-k-mooney | i know the xml will not be updated correctly | 16:08 |
| *** tbachman_ has joined #openstack-nova | 16:09 | |
| *** vivsoni_ has quit IRC | 16:09 | |
| *** masber has quit IRC | 16:09 | |
| *** andreas_s has joined #openstack-nova | 16:10 | |
| mriedem | sean-k-mooney: when going from old to new, if you create the port binding, is it just for the dest host or both the source and dest? | 16:10 |
| *** markus_z has quit IRC | 16:10 | |
| *** tbachman has quit IRC | 16:11 | |
| *** tbachman_ is now known as tbachman | 16:11 | |
| mriedem | i was kind of hoping to avoid the retype complexity in this, because that makes things weird | 16:11 |
| mriedem | one reason for doing this is to simply cut down on network downtime during live migration, | 16:11 |
| sean-k-mooney | well there will always be the source portbinding. so i would create the destination port binding on the destination host in that case and clean up the source binding if migration succeeded | 16:11 |
| mriedem | another reason is to change vif types, yes? | 16:11 |
| *** edmondsw has joined #openstack-nova | 16:12 | |
| sean-k-mooney | mriedem: yes they are the 2 main usecases | 16:12 |
| mriedem | how is there always a source port binding? i thought we didn't create port binding resources today at all? or you just mean the binding:profile in the port we already have? | 16:12 |
| mriedem | like, | 16:12 |
| sean-k-mooney | the port binding profile in the port we already have | 16:12 |
| mriedem | i thought there is literally going to be a new neutron api which is like POST /ports/{uuid}/bindings | 16:13 |
| sean-k-mooney | i need to double check but i taught that would be expsed via the new api automatically | 16:13 |
| openstackgerrit | David Rabel proposed openstack/nova master: VMware: add support for graceful shutdown of instances https://review.openstack.org/494169 | 16:13 |
| sean-k-mooney | mriedem: yes there will be https://specs.openstack.org/openstack/neutron-specs/specs/pike/portbinding_information_for_nova.html#list-bindings | 16:13 |
| mriedem | so if i do GET /ports/{id}/bindings, for existing ports it will give me at least one result based on the existing port's binding profile? | 16:13 |
| mriedem | is there some data migration that neutron is going to do for that? or just a fallback lookup in the api code? | 16:14 |
| mriedem | maybe this is already modeled and the API is just exposing it? https://specs.openstack.org/openstack/neutron-specs/specs/pike/portbinding_information_for_nova.html#data-model-changes | 16:14 |
| *** andreas_s has quit IRC | 16:14 | |
| mriedem | sean-k-mooney: so going back to your question, | 16:15 |
| mriedem | what happens today if you try live migrating an instance with a linuxbridge vif on the source host to a dest host which is using ovs? | 16:16 |
| mriedem | does vif plugging explode? | 16:16 |
| *** edmondsw has quit IRC | 16:16 | |
| sean-k-mooney | no everything works perfectly with no error... in that direction | 16:16 |
| sean-k-mooney | but you have no network connectivity | 16:16 |
| *** priteau has joined #openstack-nova | 16:16 | |
| mriedem | ok so it doesn't work | 16:16 |
| mriedem | it doesn't blow up, but it doesn't work, right? | 16:16 |
| sean-k-mooney | what libvirt did undder the hood was creat a linux bridge an plug the tap into it and neutron never knew about it | 16:17 |
| sean-k-mooney | so the live migration succeeds | 16:17 |
| sean-k-mooney | if you do a hard reboot everything gets fixed | 16:17 |
| *** suresh12 has quit IRC | 16:17 | |
| sean-k-mooney | but the bridge does not get cleaned up | 16:17 |
| sean-k-mooney | going the other way os-vif explodes if your linux bridge node does not have ovs-vsctl available | 16:18 |
| *** suresh12 has joined #openstack-nova | 16:18 | |
| *** suresh12 has quit IRC | 16:18 | |
| sean-k-mooney | if it does same thing. we create and ovs bridge called br-int and add the tap to it and the linux bridge agent never know about it so it never get wired up | 16:19 |
| mriedem | huh, seems like something we should be explicitly checking for and failing on during pre live migration | 16:19 |
| mriedem | LB and OVS aside, i mean you also have like macvtap and vhostuser and all of the other vif types | 16:20 |
| mriedem | so who know what goes wrong when migrating between those right? | 16:20 |
| sean-k-mooney | mriedem: you would think so but this actully used to work before hevana but it was a undocument "feature" so it got broken in icehouse | 16:20 |
| sean-k-mooney | mriedem: provided the vif model is still virtio then it actully works correctly if we can update the xml | 16:21 |
| mriedem | can't we just assert that if both nodes in the live migration are not new enough to do the port binding thing that we don't allow it? | 16:21 |
| mriedem | and the vif type changes i mean | 16:22 |
| sean-k-mooney | yes we can that was what i was going to suggest | 16:22 |
| mriedem | if the vif type doesn't change, then maybe we can still support the port binding thing for mixed version computes? | 16:22 |
| mriedem | although if the dest host is old we won't have a port binding to flip to active in post live migrate | 16:23 |
| sean-k-mooney | if the vif_type and vif binding_details does not change we should not need to update the xml either so we could activate the binding before live migrate | 16:23 |
| mriedem | so we can really only do the port binding if going from old to new yes? | 16:23 |
| mriedem | to reset, we plan to create the dest host port binding during pre live migration yes? | 16:24 |
| *** andreas_s has joined #openstack-nova | 16:24 | |
| sean-k-mooney | there are basically 3 cases where we have old+new. i am going to document them in the spec | 16:24 |
| mriedem | that may or may not happen if we're doing that on an old ode | 16:24 |
| mriedem | *node | 16:24 |
| mriedem | that would be helpful :) | 16:24 |
| mriedem | btw, https://docs.openstack.org/nova/latest/reference/live-migration.html is uber helpful | 16:24 |
| sean-k-mooney | yes but to reset if its an old source node it wont create the binding but we could do that in do_migrate on the destination. | 16:25 |
| mriedem | pre_live_migration runs on the dest host and i think that's where the dest host port binding was going to be created, but i'm not sure | 16:25 |
| sean-k-mooney | if you have a new source node and old destination there is no way to update the xml | 16:25 |
| mriedem | ok so we create the dest host port binding from the source node? | 16:26 |
| mriedem | live_migrate runs on the source node, calls pre_live_migration on the dest node, and then live_migrate on the source starts doing it's thing | 16:26 |
| sean-k-mooney | mriedem: ill duble check i have been confusing myself with this most of the afternoon so kindo of mixed up what happens where | 16:26 |
| mriedem | use https://docs.openstack.org/nova/latest/reference/live-migration.html | 16:27 |
| *** fragatina has quit IRC | 16:28 | |
| kashyap | kaisers: When you're back; glad you noted the correction in the bug: "1) correction regarding my last comment (#6): block commit -> blockRebase" | 16:28 |
| kashyap | kaisers: They're both completely opposite. | 16:28 |
| sean-k-mooney | right ok ill work on the spec and use https://docs.openstack.org/nova/latest/reference/live-migration.html to keep it straight | 16:29 |
| sean-k-mooney | mriedem: basically what i wanted to know was is it ok to change the sematic in the event that we need an xml update but cant do one and fail the migrate instead of migrating and haveing broken networkin that is then fixed with a hard reboot | 16:31 |
| *** itlinux has quit IRC | 16:32 | |
| mriedem | sean-k-mooney: it seems to me we shouldn't be allowing that today anyway | 16:32 |
| mriedem | so yes i'd be ok with that | 16:32 |
| *** gjayavelu has joined #openstack-nova | 16:33 | |
| *** andreas_s has quit IRC | 16:33 | |
| sean-k-mooney | ok ill capture that in the spec with the different combinations. thanks | 16:33 |
| *** suresh12 has joined #openstack-nova | 16:34 | |
| *** penick_ has joined #openstack-nova | 16:34 | |
| *** sambetts is now known as sambetts|afk | 16:34 | |
| *** suresh12 has quit IRC | 16:35 | |
| openstackgerrit | Eric Fried proposed openstack/nova-specs master: Remove barbican from scope of ksa adapter work https://review.openstack.org/511524 | 16:35 |
| efried | sdague FYI, crickets in -barbican | 16:35 |
| efried | sdague mriedem ^ updated spec accordingly. | 16:35 |
| *** Apoorva has joined #openstack-nova | 16:35 | |
| *** penick has quit IRC | 16:35 | |
| *** chyka has joined #openstack-nova | 16:39 | |
| *** jmlowe has joined #openstack-nova | 16:39 | |
| *** gyee has joined #openstack-nova | 16:41 | |
| *** vladikr_ has quit IRC | 16:42 | |
| *** vladikr has quit IRC | 16:42 | |
| *** gyee has quit IRC | 16:44 | |
| *** yamamoto has joined #openstack-nova | 16:45 | |
| *** jmlowe has quit IRC | 16:46 | |
| *** andreas_s has joined #openstack-nova | 16:46 | |
| *** smatzek has quit IRC | 16:46 | |
| *** smatzek has joined #openstack-nova | 16:47 | |
| *** oanson has quit IRC | 16:50 | |
| *** oanson has joined #openstack-nova | 16:50 | |
| *** smatzek has quit IRC | 16:51 | |
| *** yamamoto has quit IRC | 16:52 | |
| *** lucasagomes is now known as lucas-afk | 16:52 | |
| *** Swami has quit IRC | 16:53 | |
| *** yassine has quit IRC | 16:54 | |
| *** vladikr_ has joined #openstack-nova | 16:55 | |
| *** vladikr has joined #openstack-nova | 16:55 | |
| *** smatzek has joined #openstack-nova | 16:57 | |
| *** derekh has quit IRC | 16:58 | |
| *** andreas_s has quit IRC | 17:00 | |
| *** baoli has quit IRC | 17:01 | |
| openstackgerrit | Elod Illes proposed openstack/nova master: WIP: Transform scheduler.select_destinations notification https://review.openstack.org/508506 | 17:02 |
| openstackgerrit | Brianna Poulos proposed openstack/nova master: Add trusted_image_certificates to REST API https://review.openstack.org/486204 | 17:06 |
| *** priteau has quit IRC | 17:06 | |
| *** baoli has joined #openstack-nova | 17:07 | |
| *** mvk has quit IRC | 17:07 | |
| *** penick_ has quit IRC | 17:09 | |
| *** kylek3h has quit IRC | 17:09 | |
| *** kylek3h has joined #openstack-nova | 17:09 | |
| *** baoli has quit IRC | 17:09 | |
| *** baoli has joined #openstack-nova | 17:10 | |
| *** baoli has quit IRC | 17:11 | |
| *** tesseract has quit IRC | 17:11 | |
| *** baoli has joined #openstack-nova | 17:11 | |
| *** sree has joined #openstack-nova | 17:12 | |
| *** suresh12 has joined #openstack-nova | 17:13 | |
| *** ociuhandu has quit IRC | 17:14 | |
| openstackgerrit | Merged openstack/nova master: api-ref: add warning about force evacuate for ironic https://review.openstack.org/511477 | 17:17 |
| *** sree has quit IRC | 17:17 | |
| *** slaweq_ has joined #openstack-nova | 17:23 | |
| *** slaweq_ has quit IRC | 17:24 | |
| *** felipemonteiro has joined #openstack-nova | 17:26 | |
| *** links has quit IRC | 17:27 | |
| *** sree has joined #openstack-nova | 17:32 | |
| *** yingjun has quit IRC | 17:32 | |
| *** ociuhandu has joined #openstack-nova | 17:36 | |
| *** felipemonteiro has quit IRC | 17:39 | |
| *** vks1 has quit IRC | 17:39 | |
| openstackgerrit | melanie witt proposed openstack/nova stable/pike: Fix target_cell usage for scatter_gather_cells https://review.openstack.org/511538 | 17:42 |
| *** edmondsw has joined #openstack-nova | 17:46 | |
| *** Swami has joined #openstack-nova | 17:49 | |
| *** jangutter has quit IRC | 17:50 | |
| *** sree has quit IRC | 17:50 | |
| *** sree has joined #openstack-nova | 17:51 | |
| mriedem | dansmith: on this migrations API paging spec https://review.openstack.org/#/c/506030/ i don't think we need to do the elaborate scatter/gather thing like you did for instance listing probably, with the built in merge sorting and all | 17:54 |
| dansmith | mriedem: migrations are per instance right? | 17:55 |
| mriedem | we could build in the scatter/gather on it's own if we wanted, but it seems we could just merge sort the results once we pull them out of the db, the user can't pass in sort keys and this is admin-only anyway so performance shouldn't be a huge concern | 17:55 |
| dansmith | if so, there's no scattering | 17:55 |
| *** slaweq_ has joined #openstack-nova | 17:55 | |
| mriedem | not sure i follow, | 17:56 |
| mriedem | couldn't we use the scatter/gather thing on this today? https://github.com/openstack/nova/blob/master/nova/compute/api.py#L3995 | 17:56 |
| *** sree has quit IRC | 17:56 | |
| *** baoli has quit IRC | 17:56 | |
| mriedem | it would just run the db query concurrently per cell and munge the results | 17:56 |
| dansmith | mriedem: you list migrations for an instance, right? | 17:56 |
| mriedem | not this api | 17:56 |
| mriedem | this is all migrations regardless of instance | 17:56 |
| dansmith | oh | 17:56 |
| *** baoli has joined #openstack-nova | 17:57 | |
| dansmith | don't we have one that is per instance? | 17:57 |
| mriedem | we do | 17:57 |
| dansmith | *awesome* | 17:57 |
| mriedem | but paging that one would be more like paging simple tenant usage i think, | 17:57 |
| mriedem | which was weird | 17:57 |
| dansmith | anyway, | 17:57 |
| dansmith | I would think just doing linear paging for that would be fine yeah | 17:58 |
| dansmith | until someone complains | 17:58 |
| mriedem | yup cool | 17:59 |
| mriedem | only cburgess would have that many migration records to page anyway | 18:00 |
| cburgess | Do what? | 18:00 |
| mriedem | migrating like a mofo | 18:00 |
| cburgess | yes | 18:00 |
| cburgess | yes we do.. | 18:00 |
| cburgess | *sigh* | 18:00 |
| *** shaner has quit IRC | 18:00 | |
| mriedem | well then do we have the spec for you! https://review.openstack.org/#/c/506030/ | 18:00 |
| *** gjayavelu has quit IRC | 18:01 | |
| *** READ10 has quit IRC | 18:02 | |
| *** eharney has quit IRC | 18:03 | |
| *** vvargaszte has joined #openstack-nova | 18:04 | |
| *** vvargaszte has quit IRC | 18:04 | |
| *** vvargaszte has joined #openstack-nova | 18:05 | |
| *** shaner has joined #openstack-nova | 18:06 | |
| *** kfarr has joined #openstack-nova | 18:06 | |
| *** penick has joined #openstack-nova | 18:07 | |
| *** ijw has joined #openstack-nova | 18:08 | |
| *** _ix has joined #openstack-nova | 18:08 | |
| _ix | Hello friends. I can think of a way to do this, but I was hoping there might be a better way. I'm looking to determine whether some of our nodes that are believed to be running in an HA capacity are in fact running on the same hypervisors. | 18:10 |
| *** brault has quit IRC | 18:10 | |
| *** vvargaszte has quit IRC | 18:10 | |
| _ix | Is there a way to determine from the guest VM which hypervisor host it's running on, at instantiation or otherwise? | 18:10 |
| *** vvargaszte has joined #openstack-nova | 18:11 | |
| dansmith | _ix: you can do this from the nova api | 18:12 |
| *** vvargaszte has quit IRC | 18:12 | |
| _ix | I'm familiar with that approach, but I was hoping to register a custom fact with puppet, and instead just used puppetdb to keep an eye on the status of these nodes. | 18:13 |
| _ix | I would suspect that the guest never needs to know who its host is. | 18:14 |
| dansmith | or shouldn't | 18:15 |
| dansmith | I don't know that we expose the sanitized host id or not | 18:15 |
| dansmith | in metadata I mean | 18:15 |
| dansmith | I kinda expect not, but I'd have to look | 18:15 |
| mriedem | i looked, didn't see it | 18:16 |
| *** penick_ has joined #openstack-nova | 18:16 | |
| *** penick has quit IRC | 18:18 | |
| *** jdandrea has quit IRC | 18:18 | |
| *** baoli_ has joined #openstack-nova | 18:31 | |
| *** baoli has quit IRC | 18:33 | |
| mriedem | we should be able to remove the safe_connect decorator now can't we? https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L56 | 18:34 |
| mriedem | that was for the newton->ocata transition | 18:35 |
| mriedem | placement is definitely required at this point and a hard failure if it's not there | 18:35 |
| mriedem | and in ocata nova-compute doesn't start either if placement isn't configured for the compute node | 18:35 |
| dansmith | it's also confusing, | 18:37 |
| dansmith | because 404 -> None | 18:37 |
| dansmith | instead of explody | 18:37 |
| mriedem | yeah that's what made me think of it, per gibi's comment in your change | 18:43 |
| dansmith | yeah I just saw that | 18:43 |
| mriedem | shall i patchify the removification? | 18:44 |
| dansmith | if and as you wishitifcate | 18:44 |
| edleafe | dansmith: question on serializing: for returning the list of lists of Selection objects over RPC, will they be automagically primitivized? Or do they need to be manually converted? | 18:48 |
| dansmith | edleafe: should be automatic | 18:49 |
| edleafe | dansmith: thx | 18:49 |
| *** suresh12 has quit IRC | 18:49 | |
| dansmith | edleafe: because of the NovaObjectSerializer we pass to rpc setup | 18:49 |
| *** abhi89 has quit IRC | 18:57 | |
| melwitt | couple of easy reviews if anyone can look https://review.openstack.org/#/c/509968 and https://review.openstack.org/#/c/510823 | 18:57 |
| melwitt | gibi might be interested in the first one ^ | 18:59 |
| *** slaweq_ has quit IRC | 18:59 | |
| *** suresh12 has joined #openstack-nova | 19:01 | |
| *** harlowja has quit IRC | 19:03 | |
| *** slaweq_ has joined #openstack-nova | 19:03 | |
| *** suresh12_ has joined #openstack-nova | 19:04 | |
| *** suresh12 has quit IRC | 19:05 | |
| *** archit has joined #openstack-nova | 19:05 | |
| *** masber has joined #openstack-nova | 19:05 | |
| *** slaweq_ has quit IRC | 19:06 | |
| *** baoli_ has quit IRC | 19:06 | |
| *** slaweq_ has joined #openstack-nova | 19:06 | |
| mriedem | done and done | 19:06 |
| *** _ix has quit IRC | 19:07 | |
| *** _ix has joined #openstack-nova | 19:07 | |
| *** suresh12_ has quit IRC | 19:08 | |
| melwitt | thx mriedem | 19:08 |
| *** masber has quit IRC | 19:10 | |
| *** READ10 has joined #openstack-nova | 19:11 | |
| *** baoli has joined #openstack-nova | 19:11 | |
| *** suresh12 has joined #openstack-nova | 19:15 | |
| *** gouthamr has quit IRC | 19:15 | |
| *** acormier has quit IRC | 19:16 | |
| *** acormier has joined #openstack-nova | 19:16 | |
| *** suresh12 has quit IRC | 19:19 | |
| *** crushil has joined #openstack-nova | 19:20 | |
| *** acormier has quit IRC | 19:21 | |
| *** vvargaszte has joined #openstack-nova | 19:22 | |
| *** READ10 has quit IRC | 19:25 | |
| *** _ix has quit IRC | 19:26 | |
| *** mvk has joined #openstack-nova | 19:28 | |
| *** _ix has joined #openstack-nova | 19:28 | |
| *** eharney has joined #openstack-nova | 19:29 | |
| *** baoli has quit IRC | 19:29 | |
| *** baoli has joined #openstack-nova | 19:30 | |
| *** andreas_s has joined #openstack-nova | 19:35 | |
| *** _ix has quit IRC | 19:37 | |
| *** awaugama has quit IRC | 19:40 | |
| *** vvargaszte has quit IRC | 19:40 | |
| *** andreas_s has quit IRC | 19:40 | |
| *** vvargaszte has joined #openstack-nova | 19:45 | |
| *** lpetrut_ has joined #openstack-nova | 19:46 | |
| openstackgerrit | Merged openstack/nova master: Add snapshot id to the snapshot notifications https://review.openstack.org/453077 | 19:52 |
| *** baoli has quit IRC | 19:55 | |
| *** crushil has quit IRC | 19:57 | |
| *** vvargaszte has quit IRC | 19:57 | |
| *** harlowja has joined #openstack-nova | 19:57 | |
| *** pcaruana has quit IRC | 19:58 | |
| *** crushil has joined #openstack-nova | 19:59 | |
| *** baoli has joined #openstack-nova | 19:59 | |
| *** baoli has quit IRC | 19:59 | |
| *** AlexeyAbashkin has joined #openstack-nova | 20:05 | |
| *** liverpooler has quit IRC | 20:07 | |
| *** AlexeyAbashkin has quit IRC | 20:09 | |
| *** liverpooler has joined #openstack-nova | 20:10 | |
| *** liverpooler has quit IRC | 20:16 | |
| *** gouthamr has joined #openstack-nova | 20:16 | |
| *** crushil has quit IRC | 20:17 | |
| *** esberglu has quit IRC | 20:19 | |
| *** sahid has quit IRC | 20:21 | |
| *** esberglu has joined #openstack-nova | 20:22 | |
| *** _ix has joined #openstack-nova | 20:24 | |
| *** ijw has quit IRC | 20:25 | |
| *** ijw has joined #openstack-nova | 20:25 | |
| openstackgerrit | Merged openstack/nova master: Elevate existing RequestContext to get bandwidth usage https://review.openstack.org/509968 | 20:31 |
| openstackgerrit | Merged openstack/nova master: Make expected notifications output easier to read in tests https://review.openstack.org/510823 | 20:32 |
| *** kfarr has quit IRC | 20:36 | |
| *** gjayavelu has joined #openstack-nova | 20:38 | |
| *** hamzy has quit IRC | 20:40 | |
| *** Apoorva_ has joined #openstack-nova | 20:41 | |
| *** _ix has quit IRC | 20:41 | |
| *** eharney has quit IRC | 20:42 | |
| *** eharney has joined #openstack-nova | 20:43 | |
| *** Apoorva has quit IRC | 20:43 | |
| *** AlexeyAbashkin has joined #openstack-nova | 20:44 | |
| *** AlexeyAbashkin has quit IRC | 20:48 | |
| *** lpetrut_ has quit IRC | 20:49 | |
| *** takashin has joined #openstack-nova | 20:54 | |
| *** pchavva has quit IRC | 20:55 | |
| *** tssurya_ has joined #openstack-nova | 20:56 | |
| mriedem | nova tastic meeting in 1 minute | 20:59 |
| melwitt | be there or be a rhombus | 20:59 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Add alternate hosts https://review.openstack.org/486215 | 21:05 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Add Selection objects https://review.openstack.org/499239 | 21:05 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Return Selection objects from the scheduler driver https://review.openstack.org/495854 | 21:05 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Change RPC for select_destinations() https://review.openstack.org/510159 | 21:05 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: Move the claim_resources method to scheduler utils https://review.openstack.org/511357 | 21:05 |
| openstackgerrit | Ed Leafe proposed openstack/nova master: WIP - Make conductor pass and use host_lists https://review.openstack.org/511358 | 21:05 |
| *** edmondsw has quit IRC | 21:05 | |
| *** _ix has joined #openstack-nova | 21:05 | |
| *** acormier has joined #openstack-nova | 21:07 | |
| *** thorst has quit IRC | 21:08 | |
| *** _ix has quit IRC | 21:09 | |
| *** acormier has quit IRC | 21:12 | |
| *** eharney has quit IRC | 21:12 | |
| *** gouthamr has quit IRC | 21:13 | |
| *** eharney has joined #openstack-nova | 21:14 | |
| *** vladikr has quit IRC | 21:25 | |
| *** vladikr_ has quit IRC | 21:25 | |
| openstackgerrit | Merged openstack/nova master: Nix bug msg from ConfGroupForServiceTypeNotFound https://review.openstack.org/511261 | 21:27 |
| efried | woot. 5 rechecks. | 21:29 |
| *** tssurya_ has left #openstack-nova | 21:31 | |
| *** tbachman has quit IRC | 21:32 | |
| *** thorst has joined #openstack-nova | 21:33 | |
| *** eharney has quit IRC | 21:34 | |
| takashin | mriedem: Would you take a look at https://review.openstack.org/#/c/334732/ ? I fixed response codes in the spec. | 21:35 |
| *** thorst has quit IRC | 21:36 | |
| mriedem | takashin: i'll add it to my list | 21:36 |
| *** lifeless has quit IRC | 21:37 | |
| takashin | mriedem: Thank you. | 21:37 |
| mriedem | takashin: btw, you might be interested in this https://review.openstack.org/#/c/511351/ | 21:38 |
| mriedem | really anything related to migration status i'm going to send your way now | 21:38 |
| takashin | mriedem: okay. I will check it. | 21:39 |
| *** AlexeyAbashkin has joined #openstack-nova | 21:43 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Spec for flavor description https://review.openstack.org/501017 | 21:47 |
| *** AlexeyAbashkin has quit IRC | 21:47 | |
| *** esberglu has quit IRC | 21:47 | |
| *** esberglu has joined #openstack-nova | 21:48 | |
| sapd_ | Hi everybody! | 21:48 |
| *** tbachman has joined #openstack-nova | 21:49 | |
| *** slaweq_ has quit IRC | 21:50 | |
| sapd_ | I'm upgrade from openstack ocata to pike version. But I had an error when I use admin to list all server in all tenants | 21:50 |
| sapd_ | The error is: TypeError: Can't upgrade a READER transaction to a WRITER mid-transaction | 21:51 |
| mriedem | melwitt: ^ | 21:51 |
| *** esberglu has quit IRC | 21:52 | |
| sapd_ | Please help me! @@ | 21:53 |
| *** catintheroof has quit IRC | 21:53 | |
| *** catintheroof has joined #openstack-nova | 21:53 | |
| mriedem | sapd_: i think this https://review.openstack.org/#/c/511538/ | 21:54 |
| mriedem | apply that patch | 21:54 |
| *** tbachman has quit IRC | 21:55 | |
| *** catintheroof has quit IRC | 21:55 | |
| *** Apoorva_ has quit IRC | 21:55 | |
| melwitt | ah, yep. | 21:55 |
| *** gouthamr has joined #openstack-nova | 21:55 | |
| sapd_ | I saw this path. I use context.py from master branch, But It can't help me :(( | 21:55 |
| melwitt | sapd_: did you restart services after applying the patch? did you apply it to all of your API hosts? | 21:56 |
| *** jamiec has quit IRC | 21:56 | |
| mriedem | did you clean out stale pycs? | 21:56 |
| *** tbachman has joined #openstack-nova | 21:57 | |
| sapd_ | yes. I did. | 21:57 |
| sapd_ | But It doesn't change anything. | 21:58 |
| *** jgriffith has quit IRC | 21:58 | |
| *** yamamoto has joined #openstack-nova | 21:59 | |
| *** lifeless has joined #openstack-nova | 22:00 | |
| mriedem | melwitt: would that also be needed in conductor since we check quota there too? | 22:00 |
| melwitt | sapd_: do you have a trace you can pastebin? one thing that's weird is how there would be a write during a instance list | 22:00 |
| *** _ix has joined #openstack-nova | 22:00 | |
| melwitt | mriedem: yeah, you're right | 22:01 |
| *** acormier has joined #openstack-nova | 22:01 | |
| melwitt | sapd_: did you patch your nova-conductors too? | 22:01 |
| *** acormier has quit IRC | 22:01 | |
| *** acormier has joined #openstack-nova | 22:01 | |
| *** esberglu has joined #openstack-nova | 22:02 | |
| sapd_ | No I just path on nova-api! does it matter? | 22:03 |
| melwitt | sapd_: yes. nova-conductor runs the same code during instance create, so that needs to be patched too | 22:04 |
| *** _ix has quit IRC | 22:04 | |
| *** jamiec has joined #openstack-nova | 22:05 | |
| *** esberglu has quit IRC | 22:06 | |
| *** jgriffith has joined #openstack-nova | 22:06 | |
| sapd_ | Hi melwitt, I got another error after apply that path: This service is older (v16) than the minimum (v22) version of the rest of the deployment. Unable to continue. | 22:06 |
| dansmith | melwitt: that backport to pike won't affect instance listing will it? | 22:07 |
| sapd_ | root@capt-admin-1:/opt# openstack server list --project CS-Labs | 22:07 |
| sapd_ | This service is older (v16) than the minimum (v22) version of the rest of the deployment. Unable to continue. (HTTP 400) (Request-ID: req-308498b1-848c-4c2d-833a-9341e6f6586e) | 22:07 |
| dansmith | sapd_: you have some unupdated api nodes I think | 22:08 |
| melwitt | dansmith: thinking ... about whether a concurrent boot request could cause that in an instance list. it seems like not because it should be the request that wanted to write that fails | 22:09 |
| sapd_ | I have three nova-api nodes, But I stop two nodes, Only one node up now. | 22:09 |
| *** yassine has joined #openstack-nova | 22:09 | |
| melwitt | I'm currently not understanding how it's the instance list that could fail with an attempt to upgrade to write | 22:09 |
| dansmith | melwitt: instance list didn't use scatter/gather in pike | 22:09 |
| mriedem | sapd_: you're getting that when trying to start up those other 2 services? or the one that is upgraded? | 22:10 |
| * mriedem remembers thinking we should return the service version in the os-services API at some point for situations like this | 22:11 | |
| *** penick_ has quit IRC | 22:11 | |
| mriedem | although we filter out osapi_compute services from that api... | 22:11 |
| *** penick has joined #openstack-nova | 22:11 | |
| dansmith | mriedem: it's also the kind of thing that could be misinterpreted | 22:11 |
| *** acormier has quit IRC | 22:12 | |
| *** acormier has joined #openstack-nova | 22:12 | |
| melwitt | dansmith: yeah, I was thinking if an instance list is trying to use the cell cache and some other boot request comes in and mucks with the DB transaction context it could cause instance list to fail | 22:13 |
| *** mriedem1 has joined #openstack-nova | 22:14 | |
| melwitt | even if instance list isn't using scatter gather, the quota check for the boot request does | 22:14 |
| dansmith | I'm not sure what is shared between those two operations that would cause such a thing | 22:14 |
| dansmith | it'd be a pretty big problem if they were related like that no? | 22:14 |
| sapd_ | The one is upgraded, others node is not upgrade yet | 22:15 |
| melwitt | the cell cache contains the DB transaction context manager and each transaction is supposed to be one thread at a time | 22:15 |
| *** mriedem has quit IRC | 22:15 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif stable/newton: Updated from global requirements https://review.openstack.org/373293 | 22:15 |
| dansmith | melwitt: the context manager but not the context | 22:15 |
| dansmith | melwitt: just like when we had only one context manager, multiple requests from multiple users don't trample on each other | 22:16 |
| dansmith | melwitt: your fix is just making sure that we don't hand a request context to one thread an then modify that context whilst running | 22:16 |
| *** acormier has quit IRC | 22:17 | |
| melwitt | dansmith: sorry, it's confusing. but what I found is that each decorated (with context manager) DB API function creates a transaction context and before the locking was in the right place, that transaction context would be hijacked by another thread, mid-transaction | 22:17 |
| *** rodolof has joined #openstack-nova | 22:17 | |
| dansmith | melwitt: that's because we switched the context.db_connection it was using right? | 22:18 |
| dansmith | so it started something with one and then entered another oslo context managed method with a different one | 22:18 |
| dansmith | melwitt: what you're describing would mean that two users hitting the api simultaneously aren't properly isolated from each other | 22:19 |
| melwitt | dansmith: yeah ... I see what you're saying. I was looking through the oslo.db code and put print statements in there, and saw the transaction context object that's created-on-the-fly and cached per transaction was getting used by another DB access before it was finished | 22:21 |
| dansmith | melwitt: right, because we were handing them contexts that were being modified later | 22:21 |
| dansmith | melwitt: so we hand the first thread a context, | 22:21 |
| dansmith | then we change that context when we hand the second/last one its context | 22:22 |
| dansmith | so the first one and the second one are using the same context.db_connection because they share the same context object | 22:22 |
| dansmith | after your change, | 22:22 |
| dansmith | the target_cell yields a new copied context, with the change made, | 22:22 |
| dansmith | and they start their db session with that context | 22:22 |
| dansmith | *they each start | 22:23 |
| dansmith | let me say that again but hopefully more clear: | 22:24 |
| dansmith | let's say we have two cells | 22:24 |
| melwitt | haha, sorry. I have found the whole thing very confusing, even while I was working on it | 22:24 |
| *** READ10 has joined #openstack-nova | 22:24 | |
| dansmith | hang on a sec, I'm not sure the above is quite right | 22:25 |
| dansmith | it doesn't change the point, but just a sec | 22:25 |
| melwitt | k | 22:25 |
| dansmith | actually, I'm not sure about your fix really | 22:26 |
| dansmith | yeah, so I think the premise in your commit message is wrong | 22:27 |
| dansmith | you say we synchronize access to the cell cache to avoid two things using the context manager at the same time, | 22:28 |
| *** tbachman has quit IRC | 22:28 | |
| dansmith | but that's not true, | 22:28 |
| *** acormier has joined #openstack-nova | 22:28 | |
| dansmith | we synchronize it so two threads racing to populate the cache won't both create and set the cache entry | 22:28 |
| dansmith | if the cache is already populated, we just grab the results, drop out of the lock, and set it on our context | 22:28 |
| *** acormier has quit IRC | 22:28 | |
| dansmith | then we *use* it later at will, no synchronization | 22:29 |
| dansmith | # Synchronize access to the cache by multiple API workers. | 22:29 |
| dansmith | just the cache to avoid a storm of threads trying to be the first to set the cache entry | 22:29 |
| *** rodolof has quit IRC | 22:29 | |
| *** rodolof has joined #openstack-nova | 22:30 | |
| dansmith | your change should be yielding out a targeted copy of the context which is passed to the thread and never used again, | 22:30 |
| dansmith | and shouldn't be altered by the other iterations of the loop | 22:30 |
| *** mvk has quit IRC | 22:30 | |
| *** gouthamr has quit IRC | 22:30 | |
| dansmith | so I'm not sure why moving target_cell inside the thread would change anything | 22:30 |
| *** acormier has joined #openstack-nova | 22:31 | |
| melwitt | well, wasn't what you said what was happening before my change? yielding a targeted context and passing to the thread? | 22:31 |
| dansmith | I didn't parse that | 22:32 |
| melwitt | sorry. isn't that what was happening before my change? passing a targeted copy of the context to the thread? | 22:32 |
| dansmith | sorry, I meant "before your change" above | 22:32 |
| dansmith | so after your change we're doing the targeting in threads which would increase contention for that section that needs to be locked, not reduce it | 22:33 |
| dansmith | what I thought was happening when I read this change the first time was that we were targeting the context, passing it (assuming by value) and then re-targeting for the next iteration | 22:34 |
| dansmith | since you say set_target_cell in the commit message | 22:34 |
| dansmith | but we weren't | 22:34 |
| dansmith | to link this back, | 22:34 |
| dansmith | in pike's instance list, we're single-threadedly doing each list, and then moving on to the next.. so there should be no overlapping of the execution of set_target_cell() which would mean if that was the problem, it wouldn't show up in list on pike | 22:35 |
| melwitt | well, if one of the threads were populating the cache, without the change, there would be no synchronization of them doing that. right? | 22:35 |
| dansmith | I'm not sure what you mean.. if one of the threads in the scatter? | 22:36 |
| melwitt | yeah if the threads in the scatter were racing to populate the cell cache | 22:36 |
| dansmith | each one is populating a different entry, right? so they're all synchronizing on a different cell_mapping.uuid, so they're not actually locking each other out | 22:36 |
| melwitt | that must have been what I was seeing? | 22:37 |
| dansmith | I don't think so | 22:37 |
| dansmith | because ^ | 22:37 |
| melwitt | yeah, that's true. locally, what I was seeing was that an instance.save() was colliding with an instance get | 22:38 |
| *** jmlowe has joined #openstack-nova | 22:38 | |
| dansmith | if that's really happening, we have a huge problem I think, but I don't understand how that could be | 22:39 |
| melwitt | during the instance read, instance write was trying to happen in the same DB transaction | 22:39 |
| melwitt | and I saw the read was happening in the quota check (scatter gather) | 22:39 |
| melwitt | so while it was checking quota, the instance.save() of the resize (I think it was) failed mid-transaction bc it was trying to upgrade the read from the quota check to a write for the instance save | 22:40 |
| dansmith | if this is a problem, it should be a problem with a single cell right? | 22:40 |
| melwitt | yeah, the test setup was cell0 and cell1 | 22:40 |
| dansmith | what I mean is before we were doing any cell switching | 22:41 |
| melwitt | oh. yeah I mean I definitely see your point there and I currently don't understand how that isn't an issue | 22:41 |
| dansmith | I don't think this has anything to do with the number of cells you have since it's all per-cell and as we established above, the cache isn't even synchronized across all, it's just on the one cell you're trying to populate | 22:41 |
| melwitt | like, is there something different about us rolling our own green threads via spawn? | 22:41 |
| dansmith | no | 22:42 |
| dansmith | it would be in our handling of the db context manager if anything | 22:42 |
| melwitt | yeah I agree nothing to do with number of cells | 22:42 |
| dansmith | so | 22:42 |
| *** mriedem1 has quit IRC | 22:43 | |
| *** AlexeyAbashkin has joined #openstack-nova | 22:43 | |
| melwitt | I had thought it was being two threads were trying to use the same context manager at the same time, but that doesn't make sense for the old style "main context manager" that's used by everything | 22:43 |
| melwitt | like you said | 22:43 |
| *** lyan has quit IRC | 22:43 | |
| dansmith | it also doesn't make sense since both threads are using different ones | 22:43 |
| dansmith | for the two cells | 22:43 |
| dansmith | can you -W the backport or something so we don't merge this until we figure out what's going on? | 22:44 |
| *** acormier has quit IRC | 22:44 | |
| melwitt | they were using the same one in this test bc it was a unit test. untargeted context was going to same database cell0 (with my change to default to cell0) | 22:44 |
| melwitt | okay | 22:44 |
| dansmith | and you were scattering to cell0 as well? | 22:45 |
| sapd_ | I can't fix this error! | 22:45 |
| sapd_ | Can you give me any suggest :(( | 22:45 |
| *** archit has quit IRC | 22:46 | |
| melwitt | dansmith: yes. scattering to cell0 and cell1 but since it was a unit test calling resize directly, there was no targeting | 22:46 |
| melwitt | quota check scatters regardless I mean. the context passed to the resize was not targeted so it was trying to save the instance in cell0 | 22:46 |
| dansmith | melwitt: so it was a unit test, where were the get and save that were conflicting? | 22:47 |
| *** mvk has joined #openstack-nova | 22:47 | |
| *** AlexeyAbashkin has quit IRC | 22:47 | |
| dansmith | okay resize was doing the save untargeted, | 22:47 |
| melwitt | dansmith: the get was in the quota check for the new flavor, the save was trying to save the state of the instance for the resize | 22:47 |
| melwitt | right | 22:47 |
| dansmith | but how in a unit test could those be going on at the same time? | 22:48 |
| dansmith | all in the same test right? | 22:48 |
| melwitt | yeah. well, not using SpawnIsSynchonous, real green threads were started for the quota check. but the result should be waited for before proceeding to the save. | 22:49 |
| dansmith | right | 22:49 |
| melwitt | so oslo.db caches "TransactionContext" objects thread locally | 22:49 |
| melwitt | and there was on in there and it was set to read mode, then the save found it and failed when it saw the conflict of trying to do a write mode | 22:50 |
| melwitt | *one in there | 22:50 |
| dansmith | you mean you were in the save, and there was already a transaction context, and you traced that back to the scatter? | 22:51 |
| melwitt | yeah. things worked fine without the scatter involved | 22:51 |
| dansmith | what I mean is, how did you examine that transaction context to know it was from the scatter? | 22:51 |
| dansmith | and where locally does it cache it? | 22:52 |
| dansmith | like in context.db_connection.something ? | 22:52 |
| melwitt | I didn't see a way to link it to the scatter. one sec | 22:52 |
| melwitt | this https://github.com/openstack/oslo.db/blob/master/oslo_db/sqlalchemy/enginefacade.py#L997-L1041 | 22:52 |
| melwitt | is how oslo.db does a transaction scope. and what I was seeing is it pulls a transaction context by thread, if it has one, and uses that if it finds it | 22:53 |
| dansmith | that looks like it caches it in TLS, | 22:53 |
| dansmith | which is what I'd expect | 22:53 |
| melwitt | and it was finding one that was in read mode, and it tried to use it to write for the save and it blew up | 22:53 |
| dansmith | right which should mean each thread has its own context, which is the only way this could not be broken :) | 22:53 |
| dansmith | https://github.com/openstack/oslo.db/blob/master/oslo_db/sqlalchemy/enginefacade.py#L1085 | 22:54 |
| melwitt | when the transaction goes out of scope, it destroys the cached context for the thread | 22:55 |
| dansmith | right | 22:55 |
| melwitt | but it wasn't destroying it (from the read) and it was using it for a write | 22:55 |
| melwitt | tried to use it for a write | 22:55 |
| dansmith | see, if it wasn't for the report in the wild just now, | 22:56 |
| melwitt | yeah, I saw that too. I was thinking it seemed like two threads were in the transaction scope at the same time and messing up each other. which I don't really get if it's one context per thread | 22:56 |
| dansmith | well, if they share a context it makes perfect sense | 22:56 |
| dansmith | see, if it wasn't for the report in the wild just now, I'd say this was likely a bug in our overriding of some of these methods in the fixture | 22:57 |
| dansmith | however, now I'm wondering if we're doing a copy.copy() of a context with a stale per-thread transactioncontext somewhere and keeping it around | 22:57 |
| dansmith | orrrrr | 22:57 |
| melwitt | so you think handing each thread a copy of the context should fix it? I thought we're already doing that before my change | 22:57 |
| dansmith | hmm | 22:57 |
| dansmith | yeah we are | 22:57 |
| dansmith | BUUUT | 22:57 |
| dansmith | we're doing copy.copy() in target_cell(), I wonder if we need a copy.deepcopy() to avoid linking threads together by copying contexts but not deep into the db connection thing | 22:58 |
| * melwitt waits in suspense | 22:58 | |
| dansmith | like a bad std making it around campus | 22:58 |
| melwitt | hm, yeah. damn | 22:59 |
| dansmith | is that context._enginefacade_context setting that on RequestContext or TransactionContext or something else? | 22:59 |
| dansmith | I've lost track this deep in the rabbit hole | 22:59 |
| melwitt | setting the mode? | 22:59 |
| dansmith | must be requestcontext no? | 22:59 |
| dansmith | no the line I linked above, setting the thread-local thing | 23:00 |
| dansmith | also, in your example, you said your context would have already been targeted to cell0, | 23:00 |
| melwitt | oh, I see. uh, yeah it's so hard to tell. | 23:00 |
| dansmith | but you mean untargeted and thus pointing at cell0 by virtue of the config right? | 23:00 |
| dansmith | I wonder if we should do two things: | 23:00 |
| melwitt | but it's probably RequestContext like you said | 23:01 |
| melwitt | yes, untargeted but going to cell0 by config | 23:01 |
| dansmith | 1. Make target_cell freak out or log a warning if we try to target a targeted cell, at least to see if we do that anywhere | 23:01 |
| dansmith | 2. copy.deepcopy() in that mofo | 23:01 |
| dansmith | and maybe | 23:01 |
| melwitt | yeah that thing is being set on RequestContext | 23:01 |
| dansmith | 3. Check for context._enginefacade_context before the copy and log another warning | 23:02 |
| melwitt | yeah, sounds like a plan | 23:02 |
| dansmith | I'm also mildly skeptical of reproducing this in a unittest environment and not introducing other unrealistic situations, | 23:02 |
| dansmith | but since you have a reproducer for that, I guess it's the best place to start | 23:03 |
| dansmith | but I reserve the right to object to fakery | 23:03 |
| melwitt | heh | 23:03 |
| *** ChanServ changes topic to "This channel is for Nova development. For support of Nova deployments, please use #openstack. Please see: https://wiki.openstack.org/wiki/Nova/Pike_Release_Schedule" | 23:03 | |
| -openstackstatus- NOTICE: Workarounds are in place for libcurl and similar dependency errors due to stale ubuntu mirroring, and for POST_FAILURE results stemming from runaway inode utilization on the logs site; feel free to recheck failing changes for either of these problems now | 23:03 | |
| melwitt | dansmith: okay. I really have to run out for an appointment right now. did you want to run with those changes? otherwise I can try them out later after I'm back | 23:04 |
| dansmith | melwitt: i have to run too, but when I'm back I can put up a patch if you can try testing against it | 23:04 |
| *** rodolof has quit IRC | 23:05 | |
| *** rodolof has joined #openstack-nova | 23:05 | |
| melwitt | dansmith: yep, can do. thanks for the brain-crushing discussion | 23:05 |
| * dansmith makes zombie noises | 23:05 | |
| melwitt | ditto | 23:05 |
| *** archit has joined #openstack-nova | 23:09 | |
| *** rodolof has quit IRC | 23:14 | |
| *** hongbin has quit IRC | 23:15 | |
| dansmith | sapd_: anything weird about your deployment that would be a clue as to why you're seeing this? | 23:16 |
| dansmith | sapd_: that's even more puzzling tome | 23:16 |
| dansmith | sapd_: only one main cell I assume right? | 23:16 |
| sapd_ | yes. I have only one cell, cell1 and 3 dbs for nova - nova-api , nova_cell0. nova_cell1 | 23:17 |
| *** felipemonteiro has joined #openstack-nova | 23:19 | |
| dansmith | sapd_: and you see that transaction message when? on every list? when listing during other activity? | 23:20 |
| sapd_ | when I use to listing instance, though I can use horizon normal. | 23:21 |
| *** Apoorva has joined #openstack-nova | 23:23 | |
| dansmith | sapd_: does that mean | 23:24 |
| dansmith | listing from the command line only? | 23:24 |
| Kevin_Zheng | https://review.openstack.org/#/c/509326 | 23:26 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/510324 | 23:27 |
| Kevin_Zheng | mriedem ^ could you review this one again? | 23:27 |
| *** Swami has quit IRC | 23:29 | |
| *** archit has quit IRC | 23:32 | |
| *** mvk has quit IRC | 23:36 | |
| *** acormier has joined #openstack-nova | 23:36 | |
| *** thorst has joined #openstack-nova | 23:37 | |
| openstackgerrit | Merged openstack/nova stable/pike: Ensure instance can migrate when launched concurrently https://review.openstack.org/508591 | 23:37 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Deepcopy context during targeting, and sanity check some things https://review.openstack.org/511651 | 23:39 |
| *** acormier has quit IRC | 23:40 | |
| *** thorst has quit IRC | 23:42 | |
| *** AlexeyAbashkin has joined #openstack-nova | 23:42 | |
| openstackgerrit | Merged openstack/nova master: Add missing tests for _remove_deleted_instances_allocations https://review.openstack.org/496847 | 23:43 |
| *** markvoelker has quit IRC | 23:46 | |
| *** AlexeyAbashkin has quit IRC | 23:46 | |
| *** gouthamr has joined #openstack-nova | 23:46 | |
| *** suresh12 has joined #openstack-nova | 23:49 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!