| *** masber has joined #openstack-nova | 00:05 | |
| *** dave-mcc_ has joined #openstack-nova | 00:05 | |
| *** dave-mccowan has quit IRC | 00:07 | |
| *** takashin has joined #openstack-nova | 00:09 | |
| *** markvoelker has quit IRC | 00:10 | |
| *** gbarros__ has quit IRC | 00:13 | |
| *** gmann has quit IRC | 00:16 | |
| *** gmann has joined #openstack-nova | 00:16 | |
| *** kiennt has joined #openstack-nova | 00:31 | |
| *** markvoelker has joined #openstack-nova | 00:34 | |
| *** acormier has joined #openstack-nova | 00:39 | |
| *** mdnadeem has joined #openstack-nova | 00:42 | |
| *** hongbin has joined #openstack-nova | 00:43 | |
| *** zhurong has joined #openstack-nova | 00:44 | |
| *** Shunli has joined #openstack-nova | 00:50 | |
| *** hshiina has joined #openstack-nova | 00:50 | |
| *** iceyao has joined #openstack-nova | 00:51 | |
| *** gbarros has joined #openstack-nova | 00:53 | |
| *** iceyao_ has joined #openstack-nova | 00:53 | |
| *** deep-book-gk has joined #openstack-nova | 00:54 | |
| *** iceyao has quit IRC | 00:55 | |
| *** iceyao_ has quit IRC | 00:57 | |
| *** deep-book-gk has left #openstack-nova | 00:57 | |
| *** trungnv has joined #openstack-nova | 00:58 | |
| *** acormier has quit IRC | 01:03 | |
| *** phuongnh has joined #openstack-nova | 01:06 | |
| *** liusheng has joined #openstack-nova | 01:07 | |
| *** acormier has joined #openstack-nova | 01:07 | |
| *** acormier has quit IRC | 01:10 | |
| *** iceyao has joined #openstack-nova | 01:10 | |
| *** litao__ has joined #openstack-nova | 01:11 | |
| *** sdague has joined #openstack-nova | 01:16 | |
| *** mlakat has quit IRC | 01:21 | |
| *** mlakat has joined #openstack-nova | 01:22 | |
| openstackgerrit | Alex Xu proposed openstack/nova master: placement: ensure shared RP maps with correct root RP https://review.openstack.org/480379 | 01:24 |
|---|---|---|
| *** baoli has joined #openstack-nova | 01:27 | |
| *** mlakat has quit IRC | 01:30 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Update a URL https://review.openstack.org/489028 | 01:31 |
| *** mlakat has joined #openstack-nova | 01:32 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: List/show all server migration types https://review.openstack.org/489029 | 01:33 |
| *** xinliang has quit IRC | 01:34 | |
| *** edmondsw has joined #openstack-nova | 01:36 | |
| *** thorst has joined #openstack-nova | 01:37 | |
| *** saphi has joined #openstack-nova | 01:38 | |
| *** edmondsw has quit IRC | 01:40 | |
| *** yangyapeng has joined #openstack-nova | 01:41 | |
| *** thorst has quit IRC | 01:41 | |
| *** kristian__ has joined #openstack-nova | 01:48 | |
| *** slagle has joined #openstack-nova | 01:49 | |
| *** yangyape_ has joined #openstack-nova | 01:52 | |
| *** kristian__ has quit IRC | 01:52 | |
| *** acormier has joined #openstack-nova | 01:53 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Avoid chowning console logs in libvirt https://review.openstack.org/472229 | 01:54 |
| *** yangyapeng has quit IRC | 01:55 | |
| *** gouthamr has quit IRC | 02:07 | |
| *** acormier has quit IRC | 02:17 | |
| *** acormier has joined #openstack-nova | 02:18 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Enable cold migration with target host https://review.openstack.org/489031 | 02:19 |
| *** acormier has quit IRC | 02:21 | |
| *** acormier has joined #openstack-nova | 02:21 | |
| *** gbarros has quit IRC | 02:24 | |
| *** acormier has quit IRC | 02:26 | |
| *** gbarros has joined #openstack-nova | 02:29 | |
| *** johnhaan has quit IRC | 02:35 | |
| *** tuanluong has joined #openstack-nova | 02:38 | |
| *** sridharg has joined #openstack-nova | 02:39 | |
| *** thorst has joined #openstack-nova | 02:42 | |
| *** gbarros has quit IRC | 02:43 | |
| *** thorst has quit IRC | 02:47 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 02:53 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 02:53 |
| *** baoli has quit IRC | 02:58 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 03:02 |
| openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.54 - Enable cold migration with target host https://review.openstack.org/406707 | 03:06 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 03:08 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 03:08 |
| *** takashin has left #openstack-nova | 03:11 | |
| openstackgerrit | Tony Breeds proposed openstack/nova master: Update SSL cert used in testing https://review.openstack.org/489078 | 03:12 |
| *** edmondsw has joined #openstack-nova | 03:24 | |
| *** edmondsw has quit IRC | 03:28 | |
| *** yangyape_ has quit IRC | 03:35 | |
| *** yangyapeng has joined #openstack-nova | 03:35 | |
| *** baoli has joined #openstack-nova | 03:43 | |
| *** thorst has joined #openstack-nova | 03:43 | |
| *** udesale has joined #openstack-nova | 03:47 | |
| *** kbaegis has quit IRC | 03:47 | |
| *** baoli has quit IRC | 03:48 | |
| *** thorst has quit IRC | 03:48 | |
| openstackgerrit | Alex Xu proposed openstack/nova master: placement: ensure shared RP maps with correct root RP https://review.openstack.org/480379 | 03:49 |
| *** yangyape_ has joined #openstack-nova | 03:51 | |
| *** yangyapeng has quit IRC | 03:51 | |
| *** iceyao has quit IRC | 03:55 | |
| *** yangyape_ has quit IRC | 03:55 | |
| *** yangyapeng has joined #openstack-nova | 03:55 | |
| *** hshiina has quit IRC | 03:56 | |
| *** hshiina has joined #openstack-nova | 03:58 | |
| *** trinaths has joined #openstack-nova | 04:02 | |
| *** junbo has joined #openstack-nova | 04:07 | |
| *** baoli has joined #openstack-nova | 04:08 | |
| *** baoli has quit IRC | 04:13 | |
| *** kiennt_ has joined #openstack-nova | 04:14 | |
| *** eharney has quit IRC | 04:19 | |
| *** iceyao has joined #openstack-nova | 04:22 | |
| *** ircuser-1 has quit IRC | 04:23 | |
| *** iceyao has quit IRC | 04:27 | |
| *** iceyao has joined #openstack-nova | 04:28 | |
| *** udesale__ has joined #openstack-nova | 04:31 | |
| *** udesale has quit IRC | 04:33 | |
| *** udesale__ has quit IRC | 04:38 | |
| *** Dinesh_Bhor has joined #openstack-nova | 04:43 | |
| *** sridharg has quit IRC | 04:50 | |
| *** sree_ has joined #openstack-nova | 04:55 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Avoid chowning console logs in libvirt https://review.openstack.org/472229 | 04:55 |
| *** trinaths has left #openstack-nova | 04:55 | |
| *** sree_ is now known as Guest99467 | 04:55 | |
| *** hongbin has quit IRC | 05:01 | |
| *** udesale__ has joined #openstack-nova | 05:07 | |
| *** karthiks has joined #openstack-nova | 05:08 | |
| *** Nel1x has quit IRC | 05:11 | |
| *** ekuris has joined #openstack-nova | 05:14 | |
| *** psachin has joined #openstack-nova | 05:15 | |
| *** GK1wmSU has joined #openstack-nova | 05:17 | |
| *** GK1wmSU has left #openstack-nova | 05:20 | |
| *** acormier has joined #openstack-nova | 05:22 | |
| *** acormier has quit IRC | 05:26 | |
| *** zhurong has quit IRC | 05:29 | |
| *** _GK1wmSU has joined #openstack-nova | 05:30 | |
| *** kornicameister has joined #openstack-nova | 05:32 | |
| *** ratailor has joined #openstack-nova | 05:32 | |
| *** _GK1wmSU has left #openstack-nova | 05:33 | |
| *** vvargaszte has quit IRC | 05:41 | |
| *** thorst has joined #openstack-nova | 05:44 | |
| *** vvargaszte has joined #openstack-nova | 05:46 | |
| *** thorst has quit IRC | 05:49 | |
| *** kiennt_ has quit IRC | 05:49 | |
| *** kiennt has quit IRC | 05:49 | |
| *** markvoelker has quit IRC | 05:54 | |
| *** moshele has joined #openstack-nova | 05:55 | |
| *** slaweq has joined #openstack-nova | 06:02 | |
| *** kiennt has joined #openstack-nova | 06:02 | |
| *** kiennt_ has joined #openstack-nova | 06:02 | |
| *** kiennt__ has joined #openstack-nova | 06:05 | |
| *** kiennt__ has quit IRC | 06:05 | |
| *** kiennt_ has quit IRC | 06:06 | |
| *** kiennt has quit IRC | 06:06 | |
| *** mlakat has quit IRC | 06:06 | |
| *** kiennt has joined #openstack-nova | 06:06 | |
| *** slaweq has quit IRC | 06:06 | |
| *** rcernin has joined #openstack-nova | 06:11 | |
| *** Guest99467 is now known as Sree_ | 06:13 | |
| *** Sree_ is now known as Guest53758 | 06:13 | |
| *** Guest53758 has quit IRC | 06:16 | |
| *** pcaruana has joined #openstack-nova | 06:19 | |
| *** tuanluong has quit IRC | 06:19 | |
| *** trinaths has joined #openstack-nova | 06:21 | |
| *** sridharg has joined #openstack-nova | 06:23 | |
| openstackgerrit | Moshe Levi proposed openstack/nova master: hardware offload support for openvswitch https://review.openstack.org/398265 | 06:24 |
| *** amotoki__ is now known as amotoki | 06:33 | |
| *** andreas_s has joined #openstack-nova | 06:36 | |
| *** zsli_ has joined #openstack-nova | 06:40 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Avoid chowning console logs in libvirt https://review.openstack.org/472229 | 06:42 |
| *** Shunli has quit IRC | 06:43 | |
| *** zhurong has joined #openstack-nova | 06:47 | |
| *** danpawlik has joined #openstack-nova | 06:49 | |
| *** slaweq has joined #openstack-nova | 06:55 | |
| *** markus_z has joined #openstack-nova | 06:55 | |
| *** edmondsw has joined #openstack-nova | 06:59 | |
| *** edmondsw has quit IRC | 07:04 | |
| *** jaosorior has joined #openstack-nova | 07:04 | |
| *** mamandle has joined #openstack-nova | 07:04 | |
| mamandle | bauzas: A gentle reminder on https://review.openstack.org/#/c/483911/, thanks! | 07:05 |
| *** sree_ has joined #openstack-nova | 07:15 | |
| *** sree_ is now known as Guest60063 | 07:15 | |
| *** mlakat has joined #openstack-nova | 07:15 | |
| *** tuanluong has joined #openstack-nova | 07:18 | |
| *** damien_r has joined #openstack-nova | 07:20 | |
| *** moshele has quit IRC | 07:20 | |
| openstackgerrit | Gábor Antal proposed openstack/nova master: Transform instance.resize_prep notification https://review.openstack.org/465081 | 07:24 |
| *** alexchadin has joined #openstack-nova | 07:31 | |
| *** aarefiev_afk is now known as aarefiev | 07:32 | |
| openstackgerrit | Gábor Antal proposed openstack/nova master: Transform aggregate.update_prop notification https://review.openstack.org/462576 | 07:38 |
| *** phuongnh has quit IRC | 07:38 | |
| *** dtantsur|afk is now known as dtantsur | 07:41 | |
| *** mamandle has quit IRC | 07:43 | |
| *** thorst has joined #openstack-nova | 07:45 | |
| *** mamandle has joined #openstack-nova | 07:49 | |
| *** thorst has quit IRC | 07:50 | |
| *** josecastroleon has joined #openstack-nova | 07:54 | |
| *** markvoelker has joined #openstack-nova | 07:55 | |
| *** aloga has quit IRC | 07:57 | |
| *** aloga has joined #openstack-nova | 07:57 | |
| *** udesale has joined #openstack-nova | 07:58 | |
| *** moshele has joined #openstack-nova | 07:58 | |
| *** udesale__ has quit IRC | 08:00 | |
| *** josecastroleon has quit IRC | 08:00 | |
| *** alexchad_ has joined #openstack-nova | 08:00 | |
| *** josecastroleon has joined #openstack-nova | 08:00 | |
| *** yamamoto has quit IRC | 08:02 | |
| *** alexchadin has quit IRC | 08:02 | |
| *** alexchadin has joined #openstack-nova | 08:04 | |
| *** alexcha__ has joined #openstack-nova | 08:06 | |
| *** alexchad_ has quit IRC | 08:06 | |
| *** alexchadin has quit IRC | 08:08 | |
| *** derekh has joined #openstack-nova | 08:11 | |
| *** alexchadin has joined #openstack-nova | 08:12 | |
| *** ralonsoh has joined #openstack-nova | 08:12 | |
| openstackgerrit | jichenjc proposed openstack/nova master: refactory some code on get_password https://review.openstack.org/449458 | 08:13 |
| *** alexchadin has quit IRC | 08:13 | |
| *** alexchadin has joined #openstack-nova | 08:14 | |
| *** alexcha__ has quit IRC | 08:15 | |
| *** xinliang has joined #openstack-nova | 08:15 | |
| *** moshele has quit IRC | 08:16 | |
| *** jichen has joined #openstack-nova | 08:17 | |
| jichen | sfinucan: hi, could you please help to check whether https://review.openstack.org/#/c/481498/ can proceed? I guess the doc migration completed already? | 08:18 |
| *** moshele has joined #openstack-nova | 08:19 | |
| openstackgerrit | Gábor Antal proposed openstack/nova master: Add json style checking for sample notifications https://review.openstack.org/443677 | 08:27 |
| *** markvoelker has quit IRC | 08:28 | |
| *** bauwser is now known as bauzas | 08:28 | |
| *** kbaegis has joined #openstack-nova | 08:29 | |
| *** udesale__ has joined #openstack-nova | 08:31 | |
| *** udesale has quit IRC | 08:34 | |
| *** efoley has joined #openstack-nova | 08:37 | |
| *** zhurong has quit IRC | 08:41 | |
| *** Guest60063 has quit IRC | 08:45 | |
| *** reedip has joined #openstack-nova | 08:47 | |
| reedip | Hi guys | 08:47 |
| reedip | is there any way to configure User/Group ID in nova in Mitaka ? | 08:47 |
| *** edmondsw has joined #openstack-nova | 08:48 | |
| *** edmondsw has quit IRC | 08:53 | |
| kashyap | lyarwood: or any stable cores: Can you please ACK this straightforward bug fix for Newton: https://review.openstack.org/#/c/488959/ -- "libvirt: Post-migration, set cache value for Cinder volume(s)" | 08:58 |
| *** yamamoto has joined #openstack-nova | 09:02 | |
| *** yangyapeng has quit IRC | 09:04 | |
| *** aloga_ has joined #openstack-nova | 09:04 | |
| *** aloga_ has quit IRC | 09:05 | |
| *** aloga_ has joined #openstack-nova | 09:06 | |
| openstackgerrit | Béla Vancsics proposed openstack/nova master: Transform aggregate.update_metadata notification https://review.openstack.org/460625 | 09:07 |
| *** yamamoto has quit IRC | 09:08 | |
| *** yamamoto has joined #openstack-nova | 09:08 | |
| *** sambetts|afk is now known as sambetts | 09:11 | |
| openstackgerrit | Béla Vancsics proposed openstack/nova master: Transform keypair.delete notification https://review.openstack.org/463946 | 09:13 |
| *** lpetrut has joined #openstack-nova | 09:15 | |
| chohoor | Hi, driver.deallocate_networks_on_reschedule(instance) will return True or False when nova do reschedulter(/nova/compute/manager.py:1822), why only ironic driver return True but other drivers return False? | 09:18 |
| *** markvoelker has joined #openstack-nova | 09:25 | |
| *** yamamoto has quit IRC | 09:25 | |
| *** claudiub has joined #openstack-nova | 09:27 | |
| *** zsli_ has quit IRC | 09:31 | |
| *** yamamoto has joined #openstack-nova | 09:34 | |
| *** gszasz has joined #openstack-nova | 09:34 | |
| *** nicolasbock has joined #openstack-nova | 09:35 | |
| *** moshele has quit IRC | 09:36 | |
| *** zhurong has joined #openstack-nova | 09:37 | |
| *** yamamoto has quit IRC | 09:40 | |
| *** zenoway has joined #openstack-nova | 09:41 | |
| *** thorst has joined #openstack-nova | 09:46 | |
| *** aloga_ has quit IRC | 09:49 | |
| *** yamamoto has joined #openstack-nova | 09:53 | |
| openstackgerrit | Alvaro Lopez Garcia proposed openstack/nova master: Ensure that periodic reclaim cleans DB deleted instances https://review.openstack.org/323250 | 09:55 |
| *** moshele has joined #openstack-nova | 09:58 | |
| *** thorst has quit IRC | 09:58 | |
| *** mdnadeem has quit IRC | 09:59 | |
| *** markvoelker has quit IRC | 09:59 | |
| tinwood | hi folks | 10:00 |
| *** kiennt has quit IRC | 10:01 | |
| *** zenoway has quit IRC | 10:09 | |
| *** zenoway has joined #openstack-nova | 10:09 | |
| *** alexchadin has quit IRC | 10:11 | |
| *** zenoway has quit IRC | 10:13 | |
| *** claudiub has quit IRC | 10:22 | |
| *** zenoway has joined #openstack-nova | 10:25 | |
| *** claudiub has joined #openstack-nova | 10:30 | |
| *** cdent has joined #openstack-nova | 10:30 | |
| *** ralonsoh has quit IRC | 10:32 | |
| *** ralonsoh has joined #openstack-nova | 10:33 | |
| *** edmondsw has joined #openstack-nova | 10:36 | |
| openstackgerrit | Matthew Booth proposed openstack/nova master: Fix scope of errors_out_migration in resize_instance https://review.openstack.org/487495 | 10:37 |
| openstackgerrit | Matthew Booth proposed openstack/nova master: Automatically revert resize which fails on destination https://review.openstack.org/462521 | 10:37 |
| openstackgerrit | Matthew Booth proposed openstack/nova master: Fix scope of errors_out_migration in finish_resize https://review.openstack.org/487515 | 10:37 |
| openstackgerrit | Matthew Booth proposed openstack/nova master: Ensure errors_out_migration errors out migration https://review.openstack.org/479802 | 10:37 |
| *** jaosorior has quit IRC | 10:39 | |
| *** zhurong has quit IRC | 10:40 | |
| *** edmondsw has quit IRC | 10:41 | |
| *** claudiub has quit IRC | 10:46 | |
| *** _pewp_ has quit IRC | 10:47 | |
| *** zenoway has quit IRC | 10:48 | |
| *** smatzek has joined #openstack-nova | 10:49 | |
| *** _pewp_ has joined #openstack-nova | 10:50 | |
| *** jaosorior has joined #openstack-nova | 10:50 | |
| *** trinaths has left #openstack-nova | 10:51 | |
| *** zhurong has joined #openstack-nova | 10:52 | |
| *** mchiappe1o has joined #openstack-nova | 10:54 | |
| openstackgerrit | Rawan Herzallah proposed openstack/nova master: Adding NVMEoF for libvirt driver https://review.openstack.org/482640 | 10:54 |
| *** smatzek has quit IRC | 10:55 | |
| *** smatzek has joined #openstack-nova | 10:55 | |
| *** sridharg has quit IRC | 10:55 | |
| *** jichen has quit IRC | 10:56 | |
| *** markvoelker has joined #openstack-nova | 10:56 | |
| *** zenoway has joined #openstack-nova | 11:00 | |
| *** saphi has quit IRC | 11:01 | |
| *** redondo-mk has joined #openstack-nova | 11:03 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: explain payload inheritance in notification devref https://review.openstack.org/453667 | 11:03 |
| redondo-mk | Hi. I have a question regarding packstack's AIO deployment of Liberty. In my fresh deployment, instances are successfully created, end up being in "running" state but they are not reachable by icmp (security group properly). Instance have empty console log file. I've tried cirros and ubuntu. Would anyone have any hint/info to direct me towards steps how to get my instances to work properly and not just | 11:05 |
| redondo-mk | pretend that they work. In Newton I don't have this issue, don't know about Mitaka but the thing is that I need Liberty. | 11:05 |
| *** tuanluong has quit IRC | 11:08 | |
| *** xinliang has quit IRC | 11:10 | |
| *** jistr is now known as jistr|mtg | 11:12 | |
| *** alexchadin has joined #openstack-nova | 11:13 | |
| *** thorst has joined #openstack-nova | 11:13 | |
| *** acormier has joined #openstack-nova | 11:21 | |
| *** acormier has joined #openstack-nova | 11:21 | |
| *** xinliang has joined #openstack-nova | 11:23 | |
| *** markvoelker has quit IRC | 11:28 | |
| *** yamamoto has quit IRC | 11:31 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 11:35 |
| gibi_ | cdent: hi! I think I was able to make the fake virt driver work with periodic tasks enabled in ^^ but still some asserts fail | 11:36 |
| gibi_ | cdent: I will try to rebase the test top of https://review.openstack.org/#/c/488510/ to see if that helps | 11:36 |
| cdent | gibi_: cool. I'm playing around with some gabbi+tempest tests to see if I can learn anything from that side, but I'm not very close yet | 11:37 |
| *** jistr|mtg is now known as jistr | 11:39 | |
| cdent | more coffee required | 11:39 |
| gibi_ | coffee is a good idea, always :) | 11:39 |
| openstackgerrit | Sean Dague proposed openstack/nova master: Better handling of Neutron BadRequest/ Vendor specific exceptions https://review.openstack.org/278788 | 11:41 |
| *** aloga_ has joined #openstack-nova | 11:41 | |
| *** acormier has quit IRC | 11:42 | |
| *** acormier has joined #openstack-nova | 11:43 | |
| *** thorst has quit IRC | 11:43 | |
| *** acormier has quit IRC | 11:47 | |
| *** litao__ has quit IRC | 11:50 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Move execs of touch to privsep. https://review.openstack.org/489190 | 11:52 |
| *** iceyao has quit IRC | 11:55 | |
| *** mamandle has quit IRC | 12:01 | |
| *** yamamoto has joined #openstack-nova | 12:01 | |
| *** yamamoto has quit IRC | 12:04 | |
| *** lyan has joined #openstack-nova | 12:06 | |
| *** edmondsw has joined #openstack-nova | 12:06 | |
| *** tyrefors has quit IRC | 12:12 | |
| *** edmondsw has quit IRC | 12:13 | |
| *** cristicalin has joined #openstack-nova | 12:16 | |
| *** Alex_____ has joined #openstack-nova | 12:17 | |
| sdague | mikal: you still awake? | 12:18 |
| sdague | https://review.openstack.org/#/c/486831 just a comment before approve | 12:18 |
| *** udesale__ has quit IRC | 12:19 | |
| *** yamamoto has joined #openstack-nova | 12:20 | |
| *** baoli has joined #openstack-nova | 12:24 | |
| *** sridharg has joined #openstack-nova | 12:25 | |
| *** markvoelker has joined #openstack-nova | 12:26 | |
| *** baoli has quit IRC | 12:27 | |
| *** slagle has quit IRC | 12:27 | |
| *** catintheroof has joined #openstack-nova | 12:29 | |
| *** ekuris has quit IRC | 12:29 | |
| *** slagle has joined #openstack-nova | 12:29 | |
| *** markvoelker has quit IRC | 12:30 | |
| *** markvoelker has joined #openstack-nova | 12:30 | |
| *** yamamoto has quit IRC | 12:32 | |
| *** ralonsoh has quit IRC | 12:32 | |
| *** yamamoto has joined #openstack-nova | 12:33 | |
| *** yamamoto has quit IRC | 12:33 | |
| *** pchavva has joined #openstack-nova | 12:33 | |
| *** yamamoto has joined #openstack-nova | 12:33 | |
| *** aditi_puntambeka has joined #openstack-nova | 12:34 | |
| *** ratailor has quit IRC | 12:39 | |
| *** aditi_puntambeka is now known as aditipuntambekar | 12:40 | |
| *** ekuris has joined #openstack-nova | 12:45 | |
| *** tyrefors has joined #openstack-nova | 12:46 | |
| *** gbarros has joined #openstack-nova | 12:48 | |
| openstackgerrit | Alex Xu proposed openstack/nova master: placement: filtering the resource provider id when delete trait association https://review.openstack.org/489205 | 12:50 |
| openstackgerrit | Alex Xu proposed openstack/nova master: placement: The common method to filter resource providers by traits https://review.openstack.org/489206 | 12:50 |
| *** aditipuntambekar has quit IRC | 12:53 | |
| *** baoli has joined #openstack-nova | 12:56 | |
| *** liverpooler has joined #openstack-nova | 12:57 | |
| *** kylek3h has joined #openstack-nova | 12:57 | |
| *** yasemin has joined #openstack-nova | 12:59 | |
| *** baoli has quit IRC | 12:59 | |
| *** baoli has joined #openstack-nova | 13:00 | |
| *** thorst has joined #openstack-nova | 13:00 | |
| *** baoli has quit IRC | 13:00 | |
| *** zhurong has quit IRC | 13:00 | |
| *** cleong has joined #openstack-nova | 13:01 | |
| *** liverpooler has quit IRC | 13:02 | |
| *** lucasxu has joined #openstack-nova | 13:02 | |
| *** liverpooler has joined #openstack-nova | 13:03 | |
| *** mtanino has joined #openstack-nova | 13:03 | |
| *** mtanino has quit IRC | 13:03 | |
| *** baoli has joined #openstack-nova | 13:04 | |
| *** mtanino has joined #openstack-nova | 13:04 | |
| sdague | alex_xu: any more extensions remove patches need review? | 13:04 |
| *** xinliang has quit IRC | 13:05 | |
| *** liverpooler has quit IRC | 13:07 | |
| *** liverpooler has joined #openstack-nova | 13:07 | |
| *** iceyao has joined #openstack-nova | 13:08 | |
| *** randomhack has joined #openstack-nova | 13:10 | |
| *** esberglu has joined #openstack-nova | 13:13 | |
| *** edmondsw has joined #openstack-nova | 13:13 | |
| *** sree has joined #openstack-nova | 13:16 | |
| *** ralonsoh has joined #openstack-nova | 13:18 | |
| *** aloga_ has quit IRC | 13:18 | |
| yasemin | hi, i build multi node devstack stable/ocata , but controller node recognize compute node. Can you help me | 13:19 |
| *** saphi has joined #openstack-nova | 13:20 | |
| *** sree has quit IRC | 13:21 | |
| *** edmondsw has quit IRC | 13:22 | |
| *** tojuvone__ is now known as tojuvone | 13:22 | |
| *** edmondsw has joined #openstack-nova | 13:22 | |
| *** gbarros has quit IRC | 13:27 | |
| *** josecastroleon has quit IRC | 13:29 | |
| *** gouthamr has joined #openstack-nova | 13:31 | |
| *** gbarros has joined #openstack-nova | 13:32 | |
| sdague | yasemin: did you discover_hosts after the compute came up? | 13:32 |
| sdague | nova-manage cell_v2 discover_hosts --verbose | 13:33 |
| openstackgerrit | Merged openstack/python-novaclient master: doc: Remove Makefile https://review.openstack.org/480096 | 13:35 |
| *** josecastroleon has joined #openstack-nova | 13:38 | |
| edleafe- | Scheduler subteam meeting in 20 minutes in #openstack-meeting-alt | 13:40 |
| *** edleafe- is now known as edleafe | 13:40 | |
| yasemin | <sdague> i run "nova-manage --debug cell_v2 discover_hosts" command, but it is not working | 13:43 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 13:43 |
| *** gcb has joined #openstack-nova | 13:46 | |
| bauzas | mmm, I have a thought if someone is kinda seasoned with pbr | 13:47 |
| bauzas | say we ask operators to add a new entrypoint in setup.cfg, how can nova be redeployed by using it if you use a downstream package ? | 13:48 |
| *** acormier has joined #openstack-nova | 13:48 | |
| bauzas | of course, we all know we just need to either "develop" or "install" either by pip or setup.py but the question remains for other packages | 13:49 |
| bauzas | a reasonable answer can be "meh, we don't care, it's a package-specific discussion" | 13:49 |
| *** marst_ has quit IRC | 13:49 | |
| openstackgerrit | Sylvain Bauza proposed openstack/nova master: Accept any scheduler driver entrypoint https://review.openstack.org/484828 | 13:51 |
| bauzas | context being ^ | 13:52 |
| gibi_ | cdent: with Jay's https://review.openstack.org/#/c/488510 and resource_tracker on drugs I can reproduce problems with resize in a stable way with https://review.openstack.org/#/c/487958 | 13:52 |
| *** eharney has joined #openstack-nova | 13:52 | |
| openstackgerrit | Merged openstack/python-novaclient master: Update reno for stable/pike https://review.openstack.org/488799 | 13:53 |
| cdent | gibi_: excellent, looking | 13:53 |
| *** mamandle has joined #openstack-nova | 13:53 | |
| gibi_ | cdent: it seems resource clean up is missing after both confirm and revert | 13:53 |
| cdent | nice work | 13:54 |
| cdent | good timing too, we can noodle about in the scheduler meeting | 13:55 |
| *** crushil has joined #openstack-nova | 13:57 | |
| openstackgerrit | Merged openstack/nova master: hyperv: stop serial console workers while deleting vm files https://review.openstack.org/387831 | 13:57 |
| *** cristicalin has quit IRC | 13:57 | |
| *** mriedem has joined #openstack-nova | 13:58 | |
| edleafe | cdent: gibi_: just added it to my local agenda | 13:59 |
| gibi_ | edleafe: cool, I will join to the meeting | 14:00 |
| edleafe | Scheduler meeting starting now! | 14:00 |
| *** gbarros has quit IRC | 14:01 | |
| *** moshele has quit IRC | 14:02 | |
| *** ratailor has joined #openstack-nova | 14:02 | |
| *** marst has joined #openstack-nova | 14:03 | |
| *** jaypipes has joined #openstack-nova | 14:03 | |
| *** gbarros has joined #openstack-nova | 14:03 | |
| *** alexchadin has quit IRC | 14:03 | |
| openstackgerrit | Merged openstack/nova master: Stop using mox stubs in test_console_auth_tokens.py https://review.openstack.org/477374 | 14:04 |
| openstackgerrit | Merged openstack/nova master: Add oslo_concurrency=INFO to default log levels for nova-manage https://review.openstack.org/487179 | 14:04 |
| bauzas | mriedem: looks a pretty critic bug to me https://bugs.launchpad.net/nova/+bug/1707319 | 14:04 |
| openstack | Launchpad bug 1707319 in OpenStack Compute (nova) "Security group doesn't apply to existing port" [Undecided,In progress] - Assigned to hongbin (hongbin034) | 14:04 |
| bauzas | mriedem: critical* even | 14:04 |
| bauzas | mriedem: I'm trying to get when we regressed (if we regressed) | 14:05 |
| *** xyang1 has joined #openstack-nova | 14:05 | |
| mriedem | hongbin pinged me about it on saturday, i haven't looked | 14:05 |
| bauzas | mriedem: the problem is when you pass an existing NIC | 14:07 |
| bauzas | mriedem: we totally forget to check the SGs if so | 14:07 |
| bauzas | mriedem: we only do that when you ask nova to create a port | 14:07 |
| *** slaweq has quit IRC | 14:08 | |
| *** gbarros has quit IRC | 14:10 | |
| *** bnemec-pto is now known as bnemec | 14:11 | |
| *** pwiltsey has joined #openstack-nova | 14:12 | |
| *** ekuris has quit IRC | 14:13 | |
| bauzas | mriedem: thinking out loud, are security groups a nova thing or a neutron thing ? | 14:15 |
| bauzas | mriedem: looks like we proxied that to neutron, nope ? | 14:15 |
| *** adisky__ has quit IRC | 14:16 | |
| mriedem | we proxy when creating the port | 14:17 |
| bauzas | mriedem: nevermind, got my answer https://docs.openstack.org/security-guide/networking/services-security-best-practices.html | 14:19 |
| bauzas | mriedem: will invalid the bug | 14:19 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 14:20 |
| gibi_ | jaypipes: just added more printout to see the whole resource state when the test fails. The commit message no links to test results with that extra printouts . ^^ | 14:21 |
| mriedem | bauzas: can you clarify? | 14:22 |
| mriedem | https://docs.openstack.org/security-guide/networking/services-security-best-practices.html#security-groups just says nova proxies security group information to neutron | 14:22 |
| kashyap | smcginnis: Hey, thanks for looking out for Jenkins for this -- https://review.openstack.org/#/c/489198. Or do you do it by a script? :-) | 14:22 |
| bauzas | mriedem: I just made a comment | 14:23 |
| smcginnis | kashyap: Hah, nope. I took a quick look and saw it had a timeout failure. | 14:23 |
| gibi_ | jaypipes: s/no/now/ | 14:24 |
| *** awaugama has joined #openstack-nova | 14:24 | |
| kashyap | smcginnis: Ah, thank you. | 14:24 |
| smcginnis | kashyap: No problem. ;) | 14:24 |
| bauzas | mriedem: tl;dr: since the port was created beforehand directly to Neutron, you should define the SG policies at that moment | 14:24 |
| jaypipes | gibi_: ty sir | 14:25 |
| mriedem | bauzas: did you check the code? are you sure we don't attempt to update the port? | 14:26 |
| jaypipes | dansmith, cdent, gibi_: I'm wondering if we have any tests that use the libvirt driver and not the fake virt driver for resize/move operations? | 14:26 |
| mriedem | because i know we update the port, i'm just not sure what we put in the body for the PUT | 14:26 |
| dansmith | jaypipes: eh? don't we actually do moves in tempest? | 14:26 |
| cdent | there are some moves in tempest | 14:26 |
| mriedem | yes we have resize, cold migration, shelve/unshelve and live migration in tempest | 14:26 |
| jaypipes | do we see the same issue with placement not being properly updated in those tempest tests? | 14:27 |
| bauzas | mriedem: nope, we don't update the port | 14:27 |
| mriedem | resize is tested single node in single node jobs, otherwise those are all tested on multinode jobs | 14:27 |
| dansmith | maybe jaypipes means unit/functional tests? | 14:27 |
| *** hshiina has quit IRC | 14:27 | |
| bauzas | mriedem: I checked the code | 14:27 |
| bauzas | mriedem: we just ignore that | 14:27 |
| gibi_ | jaypipes: notification sample test are doing resize with FakeDriver | 14:27 |
| bauzas | mriedem: and that's at least existing from stable/newton | 14:27 |
| bauzas | it's not a regression at all | 14:27 |
| dansmith | jaypipes: I was looking at your patch and I think we probably need a debug statement when we do the remove so we know it's happening | 14:27 |
| dansmith | i.e. so we can check it in the tempest run logs | 14:28 |
| jaypipes | dansmith: totes | 14:28 |
| bauzas | mriedem: so we *could* update the port | 14:28 |
| gibi_ | jaypipes: also the server_group test has VM moves like migrate and evacuate | 14:28 |
| bauzas | mriedem: but that's just two roundtrips IMHO | 14:28 |
| gibi_ | jaypipes: e.g. https://github.com/openstack/nova/blob/master/nova/tests/functional/test_server_group.py#L367 | 14:28 |
| cdent | jaypipes, dansmith, gibi_: what we don't have in those tests is any confirmation of the state of allocations | 14:29 |
| bauzas | mriedem: since nova has SGs per instances, while neutron has per ports, it's a waste of HTTP calls IMHO | 14:29 |
| cdent | and since we're probably not running at capacity it doesn't become an issue | 14:29 |
| *** cfriesen_ has joined #openstack-nova | 14:29 | |
| gibi_ | cdent: yes, I think the only test where we assert on capacity is the new one we are troubleshooting now | 14:30 |
| dansmith | jaypipes: I don't see any "expected to find" logs in the multinode run, which would mean we were bailing out of that un-doubling | 14:30 |
| mriedem | gibi_: i think cdent is talking about tempest dsvm runs | 14:31 |
| *** imacdonn has quit IRC | 14:31 | |
| mriedem | where we aren't using fake drivers | 14:31 |
| * cdent nods | 14:31 | |
| dansmith | we wouldn't confirm allocations in a tempest job anyway | 14:32 |
| gibi_ | ahh, then please disregard my comment | 14:32 |
| openstackgerrit | Merged openstack/nova master: Remove redundant free_vcpus logging in _report_hypervisor_resource_view https://review.openstack.org/487216 | 14:32 |
| jaypipes | I'm going to add more log statements to the patch. give me a few minutes | 14:32 |
| openstackgerrit | Merged openstack/nova master: Remove unnecessary code https://review.openstack.org/488299 | 14:32 |
| *** pwiltsey has quit IRC | 14:32 | |
| kashyap | lyarwood: I know you gave +2, but do you prefer me to remove the 'Conflicts' note in the upstream backport? | 14:32 |
| *** pwiltsey has joined #openstack-nova | 14:33 | |
| lyarwood | kashyap: no it's fine, that's more of a supernit tbh | 14:33 |
| *** openstackgerrit has quit IRC | 14:33 | |
| *** pwiltsey has quit IRC | 14:33 | |
| kashyap | lyarwood: Yeah, no problem. I aim to please, so thought I'd check :-) | 14:33 |
| *** pwiltsey has joined #openstack-nova | 14:34 | |
| * cdent rebases his devstack on jaypipes (not his code, actual jay) | 14:34 | |
| *** ralonsoh_ has joined #openstack-nova | 14:34 | |
| *** zenoway has quit IRC | 14:35 | |
| *** zenoway has joined #openstack-nova | 14:36 | |
| *** ralonsoh has quit IRC | 14:38 | |
| jaypipes | cdent: gimme a few. pushing a new rev with more log statements. | 14:38 |
| cdent | roger | 14:38 |
| mdbooth | sdague: A while back mriedem asked for a functional test for https://review.openstack.org/#/c/462521/ . Happy to oblige, but I'm not so familiar with what infra we already have in functional. Any pointers? | 14:38 |
| *** zenoway has quit IRC | 14:39 | |
| *** zenoway has joined #openstack-nova | 14:39 | |
| mriedem | mdbooth: gibi has a 2 node resize functional test here https://review.openstack.org/#/c/487958/4 | 14:41 |
| mdbooth | mriedem: Looking, thanks. | 14:42 |
| bauzas | kudos to sdague | 14:42 |
| bauzas | I looked today at launchpad and for the first time of my career, saw 0 new bugs | 14:42 |
| mriedem | mdbooth: this one fakes out a resource claim failure on a compute https://github.com/openstack/nova/blob/master/nova/tests/functional/regressions/test_bug_1671648.py | 14:42 |
| bauzas | I'm pretty impressed by his ability to triage bugs so fast :) | 14:43 |
| bauzas | sdague: <3 | 14:43 |
| mdbooth | mriedem: Should be able to find a good starting point there. Thanks! | 14:44 |
| *** yamamoto has quit IRC | 14:45 | |
| *** chyka has joined #openstack-nova | 14:45 | |
| *** chyka has quit IRC | 14:46 | |
| *** openstackgerrit has joined #openstack-nova | 14:46 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: don't allocate on compute nodes https://review.openstack.org/488595 | 14:46 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: remove source provider allocs in confirm_resize() https://review.openstack.org/488510 | 14:46 |
| jaypipes | cdent, gibi, dansmith, edleafe: ok, have at it. ^ | 14:46 |
| cdent | ✔ | 14:46 |
| *** pwiltsey_ has joined #openstack-nova | 14:46 | |
| *** chyka has joined #openstack-nova | 14:46 | |
| *** pwiltsey has quit IRC | 14:47 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 14:47 |
| *** lyan has quit IRC | 14:48 | |
| * gibi_ is pasting logs... | 14:51 | |
| *** hongbin has joined #openstack-nova | 14:52 | |
| gibi_ | here is the full debug log with jaypipes new patch set http://paste.openstack.org/show/617024/ | 14:52 |
| *** psachin has quit IRC | 14:52 | |
| gibi_ | my copy paste buffer is too small | 14:52 |
| gibi_ | disregard the above link | 14:53 |
| jaypipes | gibi_: :) | 14:53 |
| jaypipes | gibi_: I was gonna say... | 14:53 |
| *** krtaylor has joined #openstack-nova | 14:54 | |
| gibi_ | is there a limit on paste.openstack.org about the size of the log? | 14:54 |
| clarkb | gibi_: yes its like 1MB or something. If you have to paste very large amounts of text I think gist.github.com allows large pastes anonymously | 14:55 |
| gibi_ | clarkb: thanks | 14:55 |
| gibi_ | it seems pastebin doesn't have such limit either | 14:56 |
| gibi_ | https://pastebin.com/0DuaUrZJ | 14:56 |
| sdague | mdbooth: looking | 14:56 |
| sdague | bauzas: thanks! | 14:56 |
| bauzas | I usually decrease by 5/6 bugs per day | 14:57 |
| bauzas | given we had 120 new ones... | 14:57 |
| bauzas | so, yeah, very impressive | 14:57 |
| *** sridharg has quit IRC | 14:58 | |
| bauzas | mriedem: had a chance to qualify the pike-rc-candidates ? | 14:58 |
| bauzas | I gave you 3 of those | 14:58 |
| *** pwiltsey_ has quit IRC | 14:58 | |
| bauzas | mriedem: I can look over the rest | 14:58 |
| *** yamahata has quit IRC | 14:58 | |
| dansmith | jaypipes: cool, that looks like it'll tell us what is happeing | 14:58 |
| *** slaweq has joined #openstack-nova | 14:58 | |
| *** lyan has joined #openstack-nova | 14:58 | |
| *** yamahata has joined #openstack-nova | 14:59 | |
| *** pwiltsey has joined #openstack-nova | 14:59 | |
| mriedem | bauzas: no | 14:59 |
| jaypipes | dansmith: cool. FYI, bhagyashris is also functionally testing shared storage with NFS and the claims-in-scheduler patch. | 14:59 |
| bauzas | mriedem: okay, will review those | 14:59 |
| bauzas | also, I need to make sure we have the claims bugs in there ^ | 14:59 |
| mriedem | i marked both claims bugs for rc | 15:00 |
| *** josecastroleon has quit IRC | 15:00 | |
| *** pwiltsey has quit IRC | 15:00 | |
| openstackgerrit | Spencer Yu proposed openstack/python-novaclient master: Nova client should retry with Retry-After value https://review.openstack.org/447766 | 15:00 |
| *** pwiltsey has joined #openstack-nova | 15:00 | |
| mriedem | https://bugs.launchpad.net/nova/+bug/1707256 | 15:01 |
| openstack | Launchpad bug 1707256 in OpenStack Compute (nova) "Scheduler report client does not account for shared resource providers" [High,Confirmed] - Assigned to Jay Pipes (jaypipes) | 15:01 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1707252 | 15:01 |
| openstack | Launchpad bug 1707252 in OpenStack Compute (nova) "Claims in the scheduler does not account for doubling allocations on resize to same host" [Medium,Confirmed] | 15:01 |
| bauzas | ack | 15:01 |
| mriedem | are the 2 i created on friday | 15:01 |
| gibi_ | jaypipes, dansmith, cdent: relevant part of the log is here http://paste.openstack.org/show/617028/ | 15:01 |
| *** rcernin has quit IRC | 15:03 | |
| *** slaweq has quit IRC | 15:03 | |
| gibi_ | it seems that the code correctly sends the stripped allocations | 15:04 |
| *** pcaruana has quit IRC | 15:04 | |
| gibi_ | but after that PUT placement still has the old allocation as well | 15:04 |
| gibi_ | does PUT /placement/allocations expected to totally overwrite the db for the instance | 15:05 |
| gibi_ | ? | 15:05 |
| *** randomhack has quit IRC | 15:05 | |
| melwitt | dansmith, mriedem: I have a fix up for a volume detach data corruption bug at https://review.openstack.org/#/c/488545/ that was caused by an earlier attempt to fix a different bug. has to be backported all the way to newton I think | 15:06 |
| mriedem | yes | 15:06 |
| mriedem | gibi_: yes | 15:06 |
| mriedem | melwitt: good lord | 15:06 |
| mriedem | i don't think the backports to newton ever landed because i also depended on them for another series | 15:07 |
| melwitt | o rly | 15:07 |
| mriedem | oh nvm https://review.openstack.org/#/c/425114/ | 15:07 |
| mriedem | must be something else then | 15:07 |
| cdent | gibi_: is there yet another PUT after the stripped one? | 15:07 |
| mriedem | i was thinking of this series i have in newton https://review.openstack.org/#/c/470347/ | 15:07 |
| mriedem | to wait for an interface to be detached | 15:08 |
| melwitt | oh, okay | 15:08 |
| cdent | gibi_: or is maybe the one with the stripped not being accepted (because of 409)? | 15:08 |
| *** randomhack has joined #openstack-nova | 15:09 | |
| gibi_ | cdent: look at line 5-7 in http://paste.openstack.org/show/617028/ | 15:09 |
| cdent | yeah, I'm there now | 15:10 |
| gibi_ | cdent: sorry 4-7 | 15:10 |
| gibi_ | cdent: 4 sends an allocation list with one item | 15:10 |
| gibi_ | but line 6 writes two allocations to the db | 15:10 |
| *** slaweq has joined #openstack-nova | 15:11 | |
| *** gbarros has joined #openstack-nova | 15:11 | |
| gibi_ | cdent: not two, three actually | 15:12 |
| mriedem | melwitt: i think i was thinking of this https://review.openstack.org/#/c/441204/ | 15:12 |
| mriedem | which is part of that newton series | 15:12 |
| mriedem | and sounds similar to what you're doing | 15:12 |
| gibi_ | cdent: but all for the same provider so this is not the problem | 15:12 |
| cdent | gibi_: right, what you are seeing there is just an artifact of the object: an REST-level allocation is made up of multiple Allocation Objects | 15:13 |
| gibi_ | cdent: yeah, I see now. sorry | 15:13 |
| *** iceyao has quit IRC | 15:13 | |
| melwitt | mriedem: oh, right. I noticed that too at some point thinking it's related but it seems like it's not, i.e. in the case of the bug I think isPersistent() will still return True | 15:13 |
| gibi_ | cdent: anyhow there is no other PUT on allocations later in the log | 15:13 |
| cdent | yeah, | 15:13 |
| *** jamesdenton has quit IRC | 15:14 | |
| *** alextricity25 has quit IRC | 15:14 | |
| *** _d34dh0r53_ has quit IRC | 15:14 | |
| melwitt | mriedem: the domain will still be persistent even if the volume had been detached from the persistent config in the past | 15:14 |
| cdent | gibi_: line 148 is demonstrating how things are wrong, correct? that's after confirm, and some time to let things settled? | 15:15 |
| cdent | so source hasn't cleaned up | 15:15 |
| *** d34dh0r53 has joined #openstack-nova | 15:16 | |
| gibi_ | cdent: yes | 15:16 |
| *** yamamoto has joined #openstack-nova | 15:16 | |
| *** mamandle has quit IRC | 15:17 | |
| *** tbachman has joined #openstack-nova | 15:17 | |
| cdent | gibi_: so the problem is somewhere near here: https://review.openstack.org/#/c/488510/4/nova/compute/resource_tracker.py@1083 | 15:17 |
| cdent | sorry, not there | 15:18 |
| cdent | 476 | 15:18 |
| *** penick has joined #openstack-nova | 15:19 | |
| gibi_ | but that is the piece of code that generates our PUT | 15:19 |
| *** jamesdenton has joined #openstack-nova | 15:19 | |
| gibi_ | and that PUT seems correct | 15:19 |
| gibi_ | to me | 15:19 |
| cdent | true | 15:19 |
| * cdent looks at the bigger paste | 15:20 | |
| *** yamamoto has quit IRC | 15:21 | |
| *** gcb has quit IRC | 15:23 | |
| *** crushil has quit IRC | 15:23 | |
| *** baoli has quit IRC | 15:26 | |
| gibi_ | I added code to https://review.openstack.org/#/c/488510/4/nova/scheduler/client/report.py@1079 to read back the allocations the code just PUT-ed | 15:26 |
| *** lucasxu has quit IRC | 15:26 | |
| gibi_ | http://paste.openstack.org/show/617031/ | 15:26 |
| gibi_ | and the GET returns both allocations after the PUT | 15:27 |
| gibi_ | so the problem is in the placement I think | 15:27 |
| cdent | wow | 15:28 |
| *** moshele has joined #openstack-nova | 15:28 | |
| cdent | that will be an exciting bug if so | 15:28 |
| * cdent looks | 15:28 | |
| dansmith | I'm missing the obvious thing | 15:28 |
| cdent | gibi_: yeah | 15:29 |
| dansmith | oh, we can't read back the allocations we just wrote in a particular place? | 15:29 |
| *** hshiina has joined #openstack-nova | 15:29 | |
| *** pwiltsey has quit IRC | 15:29 | |
| cdent | it only deletes where rp uuid and consume uuid == | 15:29 |
| cdent | not just consumer uuid | 15:29 |
| *** hshiina has quit IRC | 15:29 | |
| *** baoli has joined #openstack-nova | 15:29 | |
| bauzas | interesting | 15:29 |
| *** armax has joined #openstack-nova | 15:29 | |
| cdent | https://github.com/openstack/nova/blob/master/nova/objects/resource_provider.py#L1509-L1520 | 15:30 |
| cdent | gibi_: see what happens if you get rid of the first == in the and_ | 15:30 |
| gibi_ | checking | 15:30 |
| bauzas | yeah that will work | 15:31 |
| bauzas | obviously | 15:31 |
| cdent | dansmith: we had in our brains that we were removing all allocations for the consumer | 15:31 |
| cdent | but the code is only removing some of them | 15:31 |
| *** sree has joined #openstack-nova | 15:32 | |
| dansmith | meaning, the api is such that all should be removed, but some bug in the db side of placement prevents that from happening? | 15:32 |
| cdent | yeah | 15:32 |
| dansmith | that seems ungood | 15:32 |
| cdent | it looks like the original goal was to _only_ remove exact matches (not sure why) | 15:33 |
| cdent | (the comment says as much) | 15:33 |
| dansmith | hmm | 15:33 |
| dansmith | jaypipes seemed to think that should be fully atomic, so that seems weird | 15:33 |
| gibi_ | I can confirm that removing the rp == from the db code makes the placement API behave as expected in this particular case http://paste.openstack.org/show/617034/ | 15:33 |
| cdent | and we had three authors on that particular change, so is probably going to be hard to remember the whys and wherefores | 15:34 |
| cdent | gibi_: nice | 15:34 |
| cdent | dansmith: since we've been assuming all this time that the behavior is one thing and not the other, I think we should just change it | 15:34 |
| cdent | also I don't think there is much risk, because we haven't been doing any dual provider allocations up til now | 15:35 |
| cdent | edleafe: you listening ^ ? | 15:35 |
| cdent | brb | 15:35 |
| gibi_ | I'll let you guys to report a bug and propose a fix as my workday is over soon. | 15:36 |
| *** sree has quit IRC | 15:36 | |
| cdent | gibi_: right on, thanks very much for all your digging | 15:36 |
| * cdent makes the bug | 15:36 | |
| jaypipes | rock on, thanks gibi | 15:37 |
| dansmith | cdent: right, and I think that's the thing the api espouses anyway | 15:37 |
| *** jmlowe has quit IRC | 15:37 | |
| edleafe | cdent: sorry, distracted by meeting. Trying to follow, though | 15:38 |
| jaypipes | dansmith, cdent: so shall I remove that == rp_uuid line in a separate patch or in the same confirm_resize() patch? | 15:38 |
| cdent | edleafe: no worries, just wanted your memory if anything | 15:38 |
| dansmith | jaypipes: definitely separate | 15:38 |
| dansmith | jaypipes: we probably need to backport that right? | 15:38 |
| jaypipes | dansmith: ahead of confirm_resize() yeah? | 15:38 |
| dansmith | yeah | 15:38 |
| jaypipes | dansmith: ya | 15:38 |
| jaypipes | ok, I'm on it. | 15:39 |
| * dansmith wishes gibi_ would fix some of my bugs too | 15:39 | |
| bauzas | jaypipes: if we remove the == rp, wouldn't that be a problem for racy calls ? | 15:39 |
| *** iceyao has joined #openstack-nova | 15:39 | |
| jaypipes | bauzas: no | 15:39 |
| bauzas | jaypipes: because previously we were just supposing the generation bit to be updated | 15:39 |
| bauzas | given that generation is per RP | 15:40 |
| jaypipes | bauzas: the generation is on the RP. this code is removing allocation records. | 15:40 |
| jaypipes | bauzas: this is leftover code that was assuming a single RP for an allocation | 15:40 |
| jaypipes | 1509gg | 15:41 |
| jaypipes | ffs | 15:41 |
| cdent | the bug: https://bugs.launchpad.net/nova/+bug/1707669 | 15:43 |
| openstack | Launchpad bug 1707669 in OpenStack Compute (nova) "[placement] put allocations does not do a full overwrite of existing allocations" [High,Triaged] | 15:43 |
| *** saphi has quit IRC | 15:43 | |
| *** iceyao has quit IRC | 15:43 | |
| *** ratailor has quit IRC | 15:44 | |
| jaypipes | cdent: danke | 15:44 |
| *** crushil has joined #openstack-nova | 15:45 | |
| *** yamamoto has joined #openstack-nova | 15:48 | |
| sdague | 2 easy bugs to close - https://review.openstack.org/#/c/486642/ | 15:50 |
| sdague | https://review.openstack.org/#/c/488530/ | 15:51 |
| sdague | plus mriedem here is my nova-manage patch to do list_cells with urls by default - https://review.openstack.org/#/c/487860/ | 15:51 |
| *** vishwanathj has quit IRC | 15:53 | |
| *** vishwanathj has joined #openstack-nova | 15:53 | |
| *** gyee has joined #openstack-nova | 15:54 | |
| *** zenoway has quit IRC | 15:55 | |
| *** zenoway has joined #openstack-nova | 15:56 | |
| mriedem | sdague: wasn't the limits stuff added here https://review.openstack.org/#/c/486642/ for a security bug? | 15:58 |
| edleafe | cdent: ok, catching up. Looking through the long paste, I don't see where we clean up the allocations for the source host | 15:58 |
| mriedem | or was the security issue just that it was completely unbounded to begin with? | 15:58 |
| sdague | mriedem: yes, the security issue was completely unbounded | 15:58 |
| *** yamamoto has quit IRC | 15:58 | |
| sdague | it was originally set to 2 seconds | 15:58 |
| edleafe | We PUT the allocations for the target, but don't seem to remove the source allocs | 15:58 |
| sdague | then after that actually failed in the gate some times, it was bounced to 8 | 15:58 |
| cdent | edleafe: it was the third of three PUTs | 15:58 |
| sdague | but there are real world reports that times out in legit cases | 15:58 |
| sdague | it still gives us a backstop though so you can't make a malicious image that eats all the cpu forever | 15:59 |
| jaypipes | sdague: done | 15:59 |
| sdague | jaypipes: thank you | 16:00 |
| *** zenoway has quit IRC | 16:00 | |
| edleafe | cdent: ok, I see that now. So is that PUT not doing a true PUT? | 16:01 |
| edleafe | cdent: or just for the consumer/RP combo? | 16:01 |
| cdent | it's not doing a true put | 16:01 |
| cdent | https://bugs.launchpad.net/nova/+bug/1707669 | 16:01 |
| openstack | Launchpad bug 1707669 in OpenStack Compute (nova) "[placement] put allocations does not do a full overwrite of existing allocations" [High,Triaged] | 16:01 |
| cdent | server-side is borked | 16:02 |
| edleafe | cdent: what I'm asking is if it's just doing a true PUT for RP/consumer | 16:02 |
| edleafe | cdent: and not for consumer | 16:02 |
| edleafe | *just | 16:02 |
| cdent | edleafe: sorry, I'm not parsing you | 16:03 |
| mriedem | sdague: comments on more testing in https://review.openstack.org/#/c/487860/3/nova/tests/unit/test_nova_manage.py | 16:03 |
| *** moshele has quit IRC | 16:03 | |
| mriedem | the db url parsing has broken a few times | 16:03 |
| cdent | the bodies of the PUTs, all three, are correct, according to our expectations of how the api behaves. the api doesn't not behave as we expect | 16:03 |
| *** armax has quit IRC | 16:03 | |
| mriedem | and we have an outstanding bug for db urls with TLS info in them | 16:03 |
| *** Apoorva has joined #openstack-nova | 16:04 | |
| *** rajathagasthya has joined #openstack-nova | 16:04 | |
| sdague | mriedem: so, using urlparse we're never going to hit that, but I'm fine putting some more in there | 16:05 |
| mriedem | we were originally using urlparse | 16:06 |
| mriedem | which was causing problems | 16:06 |
| edleafe | cdent: yes I see that. Is the disconnect due to the fact that we expect when we PUT allocations for a consumer, it first removes any existing allocs for that consumer? | 16:07 |
| ralonsoh_ | stephenfin: hi, can you take a look at my question in https://review.openstack.org/#/c/427145/? PS7 | 16:07 |
| cdent | edleafe: that's the bug. we expect that, but it does not do that. what it was doing is removes only those allocations where rp uuid and consumer uuid match | 16:07 |
| cdent | which is not enough | 16:07 |
| edleafe | cdent: ok, that's what I was asking above about "or just for the consumer/RP combo?" | 16:09 |
| edleafe | I'm following now | 16:09 |
| edleafe | Is this being worked on? | 16:09 |
| edleafe | IOW, can I help? | 16:09 |
| cdent | yes, jay's integrating it in his stack | 16:09 |
| jaypipes | just running new tests now.. | 16:09 |
| edleafe | ok cool | 16:10 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Clean variable names and docs around neutron allocate_for_instance https://review.openstack.org/489267 | 16:10 |
| cdent | edleafe: I think the main thing to do is try to break stuff | 16:10 |
| mriedem | i hate the allocate_for_instance code ^ | 16:10 |
| *** lucasxu has joined #openstack-nova | 16:10 | |
| *** moshele has joined #openstack-nova | 16:10 | |
| edleafe | cdent: roger that. | 16:11 |
| mdbooth | gibi_: Just looking at https://review.openstack.org/#/c/487958/4/nova/tests/functional/test_servers.py | 16:15 |
| mdbooth | gibi_: Any idea how close that might be to landing? | 16:16 |
| mdbooth | gibi_: I need to add a test for https://review.openstack.org/#/c/462521/ and ServerMovingTests looks like an obvious place for it | 16:16 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Clean variable names and docs around neutron allocate_for_instance https://review.openstack.org/489267 | 16:17 |
| *** lyan has quit IRC | 16:17 | |
| *** rajathag_ has joined #openstack-nova | 16:18 | |
| *** chyka has quit IRC | 16:18 | |
| *** randomhack has quit IRC | 16:19 | |
| cdent | mdbooth: I think gibi_'s gone. We could potentially land that code soon if dansmith and jaypipes think it belongs alongside jay's stack, but it is primarily for testing how allocations are handled, not verifying reverts etc. Not sure if that makes it better or worse. | 16:20 |
| *** rajathagasthya has quit IRC | 16:21 | |
| *** gyee has quit IRC | 16:21 | |
| *** gyee_ has joined #openstack-nova | 16:21 | |
| jaypipes | cdent: five minutes. | 16:21 |
| *** sambetts is now known as sambetts|afk | 16:21 | |
| mdbooth | cdent: Well the setUp there creates an environment with 2 computes sufficient for running resize(), which is exactly what I need | 16:22 |
| cdent | mdbooth: yeah, it apparently also fixes some issues with doing that | 16:22 |
| *** markus_z has quit IRC | 16:22 | |
| mdbooth | cdent: I'm not surprised in the slightest there are dragons. | 16:23 |
| mdbooth | Didn't want duplicate the effort slaying them. | 16:23 |
| *** chyka has joined #openstack-nova | 16:24 | |
| cdent | indeed | 16:24 |
| *** crushil has quit IRC | 16:25 | |
| *** baoli has quit IRC | 16:26 | |
| *** baoli has joined #openstack-nova | 16:27 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: don't allocate on compute nodes https://review.openstack.org/488595 | 16:32 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: remove source provider allocs in confirm_resize() https://review.openstack.org/488510 | 16:32 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: remove existing allocs when set allocs https://review.openstack.org/489273 | 16:32 |
| jaypipes | dansmith, edleafe, cdent, gibi_: ok dokey ^ | 16:32 |
| cdent | word | 16:33 |
| jaypipes | the bird. | 16:33 |
| *** krtaylor has quit IRC | 16:34 | |
| dansmith | I just got off the phone for the first time all morning, | 16:34 |
| dansmith | so I need some food and then I'll dig in | 16:34 |
| jaypipes | dansmith: ditto. | 16:34 |
| jaypipes | about the food... | 16:34 |
| openstackgerrit | Jackie Truong proposed openstack/nova master: Add trusted certificates to InstanceExtras https://review.openstack.org/457711 | 16:35 |
| *** crushil has joined #openstack-nova | 16:36 | |
| *** edmondsw has quit IRC | 16:37 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: fix security_groups response parameter in os-security-groups https://review.openstack.org/489274 | 16:38 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: api-ref: requested security groups are not applied to pre-existing ports https://review.openstack.org/489275 | 16:38 |
| openstackgerrit | Chris Dent proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 16:38 |
| *** tbachman has quit IRC | 16:43 | |
| *** tbachman has joined #openstack-nova | 16:43 | |
| *** efried_zzz is now known as efried | 16:44 | |
| *** lyan has joined #openstack-nova | 16:46 | |
| *** david-lyle has joined #openstack-nova | 16:47 | |
| *** markvoelker has quit IRC | 16:52 | |
| *** itlinux_ has joined #openstack-nova | 16:52 | |
| *** derekh has quit IRC | 16:53 | |
| *** markvoelker has joined #openstack-nova | 16:53 | |
| cdent | mriedem, jaypipes : on the topic of "live" placement tests: http://lists.openstack.org/pipermail/openstack-dev/2017-July/120369.html | 16:55 |
| *** armax has joined #openstack-nova | 16:56 | |
| *** kbaegis has quit IRC | 17:06 | |
| *** liangy has joined #openstack-nova | 17:10 | |
| *** david-lyle has quit IRC | 17:11 | |
| *** moshele has quit IRC | 17:12 | |
| *** lyan has quit IRC | 17:13 | |
| *** david-lyle has joined #openstack-nova | 17:13 | |
| *** randomhack has joined #openstack-nova | 17:14 | |
| cdent | jaypipes: did you already have a plan in mind for https://bugs.launchpad.net/nova/+bug/1707252 or is that one still open? | 17:14 |
| openstack | Launchpad bug 1707252 in OpenStack Compute (nova) "Claims in the scheduler does not account for doubling allocations on resize to same host" [Medium,Confirmed] | 17:14 |
| *** randomhack has quit IRC | 17:15 | |
| *** lpetrut has quit IRC | 17:15 | |
| *** moshele has joined #openstack-nova | 17:19 | |
| *** randomhack has joined #openstack-nova | 17:19 | |
| *** dtp has joined #openstack-nova | 17:19 | |
| *** kbaegis has joined #openstack-nova | 17:23 | |
| *** yamahata has quit IRC | 17:23 | |
| *** efoley has quit IRC | 17:24 | |
| *** itlinux_ has quit IRC | 17:24 | |
| *** kbaegis has quit IRC | 17:24 | |
| *** kbaegis has joined #openstack-nova | 17:26 | |
| jaypipes | cdent: I'd like to see if gibi's test runs successfully with the fix for 1707669 up | 17:26 |
| cdent | i rebased that one on to your latest stuff | 17:27 |
| cdent | he said it had worked with local mods | 17:27 |
| cdent | jaypipes: if you're responding to my question about 1707252, it won't make any different will it. If you're making conversation then: ✔ | 17:28 |
| jaypipes | cdent: sorry, yeah, doesn't handle the resize same host problem. you want to handle that? | 17:29 |
| *** ralonsoh_ has quit IRC | 17:29 | |
| jaypipes | cdent: though I'm not sure how the scheduler can tell if it's a resize-to-same-host situation... | 17:29 |
| cdent | jaypipes: yes, that's part of why I haven't done it yet | 17:30 |
| jaypipes | cdent: :) | 17:30 |
| cdent | I've poked around at deeper inspection of the allocations | 17:30 |
| cdent | but anything I can think of feels very hacky | 17:30 |
| cdent | but basically: | 17:31 |
| jaypipes | yeah, same | 17:31 |
| cdent | if there are same rps in the source and dest allocs, where one of the resource classes is VCPU that signals a local resize | 17:31 |
| jaypipes | cdent: yeah, same thought I had. | 17:32 |
| jaypipes | cdent: ugly, but I suppose it would work... | 17:32 |
| jaypipes | what does dansmith think of that? | 17:32 |
| dansmith | jaypipes: I think I said that last week as the way we could tell | 17:32 |
| cdent | that's 3/3, shall I go ahead then? | 17:33 |
| dansmith | jaypipes: that goes away once we get to queens and don't have computes managing the allocations anyway right? | 17:33 |
| jaypipes | dansmith: k. still agree it's ugly though, eh? | 17:33 |
| dansmith | aside from the fact that the destination will eventually put the single one | 17:33 |
| jaypipes | dansmith: no, this needs to go in the scheduler... | 17:33 |
| dansmith | jaypipes: of course it's ugly | 17:33 |
| jaypipes | dansmith: because the scheduler is the thing that creates that "doubled-up" allocation. | 17:33 |
| dansmith | jaypipes: oh I thought you were talking about how to clean up the doubled-for-same-host allocation on the compute | 17:34 |
| *** jmlowe has joined #openstack-nova | 17:34 | |
| dansmith | jaypipes: why does the scheduler need to probe which is the compute by looking at vpcu? it just needs to add the new allocation to the existing one, and if the RPs are the same then sum the values | 17:34 |
| * cdent bourbons jmlowe | 17:34 | |
| jaypipes | dansmith: that's part of it I yeah, and that would be unnecessary once we remove the allocations on compute stuff, but there's the first step needed to actually create the doubled-up alloc in the scheduler. | 17:35 |
| jaypipes | dansmith: ack, yeah that's true. | 17:35 |
| cdent | no if the rps are the same, it might be shared | 17:36 |
| cdent | so we need a way to distinguish a same rp that is a "host" | 17:36 |
| cdent | and don't want to double the shared | 17:36 |
| openstackgerrit | Merged openstack/nova master: Add cinder keystone client opts to config reference https://review.openstack.org/488530 | 17:36 |
| dansmith | cdent: that's not necessarily true | 17:37 |
| dansmith | cdent: if you have a shared ceph provider, | 17:37 |
| dansmith | you still need a double allocation during the migration, since you copy (even if COW) the disk | 17:37 |
| cdent | the current code isn't doing that | 17:37 |
| dansmith | you don't for a live migration, but I think that's something we can ignore as the scheduler doesn't know | 17:37 |
| *** ijw has quit IRC | 17:37 | |
| cdent | if we're happy to over-allocate for the duration of the move, this gets a lot simpler | 17:38 |
| cdent | but the current code tries rather strenuously to not over-allocate, nor to be resource class conscious | 17:39 |
| openstackgerrit | Merged openstack/nova master: Increase cpu time for image conversion https://review.openstack.org/486642 | 17:39 |
| *** jmlowe has quit IRC | 17:39 | |
| dansmith | cdent: well currently things are wrong, but point me at something specific if you want :) | 17:39 |
| cdent | heh | 17:39 |
| *** jmlowe has joined #openstack-nova | 17:39 | |
| jmlowe | cdent: thank you kindly, you are on a pretty reliable 4k messages between bourbons | 17:40 |
| cdent | dansmith: in https://review.openstack.org/#/c/487589/ we added the doubling code | 17:41 |
| cdent | it doesn't double shared providers | 17:42 |
| cdent | jmlowe: i have no response to that | 17:42 |
| cdent | dansmith: are you suggesting: merge the source and dest into one, if the rps are the same, sum ? | 17:43 |
| *** kbaegis has quit IRC | 17:43 | |
| dansmith | cdent: ah I see what you mean.. however, that's the broken code | 17:44 |
| jmlowe | cdent: nova is supposed to take over managing network interfaces? | 17:44 |
| dansmith | cdent: it would assume that the whole compute is shared because there are already allocations for that node right? | 17:44 |
| cdent | dansmith: yes | 17:45 |
| dansmith | cdent: the only way around this, aside from looking for compute providers by VCPU, is to have traits, which we don't have | 17:45 |
| jmlowe | cdent: specifically adding and removing them from instances | 17:45 |
| dansmith | cdent: personally, I don't know why we wouldn't just unceremoniously allocate the additional things (summing where there are existing allocations) | 17:46 |
| dansmith | because for cold migration, resize, etc, you *do* need the doubled allocation for the shared provider, | 17:46 |
| dansmith | live migration being the only one where you don't, AfAIK | 17:46 |
| dansmith | jaypipes: right? | 17:46 |
| cdent | dansmith: I'd be happy with that | 17:46 |
| cdent | jmlowe: wat? | 17:46 |
| *** diablo_rojo has joined #openstack-nova | 17:47 | |
| diablo_rojo | mriedem, any idea how many people will be coming for Nova to the PTG? | 17:47 |
| jaypipes | dansmith: I think you're on to something here... | 17:48 |
| dansmith | diablo_rojo: how would mriedem know that? | 17:49 |
| jaypipes | dansmith: that would definitely mean the cleanup process would be ickier, though. in that confirm_resize() block we'd need to somehow figure out how to also remove the shared provider doubled allocations | 17:49 |
| dansmith | jaypipes: I think it's wrong otherwise | 17:50 |
| diablo_rojo | dansmith, being your elected leader I quessed he might have some notion :) | 17:50 |
| dansmith | diablo_rojo: I don't think his elected status means he tracks individual plans :) | 17:50 |
| dansmith | diablo_rojo: if you're asking because of ticket sales, | 17:50 |
| diablo_rojo | Just looking for an approximation. More or less than last time etc. | 17:50 |
| dansmith | diablo_rojo: we _just_ got approval for the first round of people last week, so.. | 17:50 |
| diablo_rojo | dansmith, not for ticket sales. For room allocation. | 17:50 |
| diablo_rojo | I can always put nova in a closet ;) | 17:51 |
| jmlowe | cdent: I thought I remembered something about moving the add and remove of instance nics out of neutron and into nova, could have been imagining that | 17:51 |
| diablo_rojo | dansmith, I know estimates are rough for everyone, but a general idea of how many would be a huge help. | 17:51 |
| jaypipes | diablo_rojo: 25-35 would be my guess. | 17:52 |
| cfriesen_ | question about resource tracking...why do we need the "reserved_host_cpus" config option when we already have "vcpu_pin_set"? | 17:52 |
| cdent | jaypipes: does the confirm resize have access to the flavor/requestspec/whatever against which it could compare the values of a retrieve allocation against? | 17:53 |
| diablo_rojo | jaypipes, that works. Thanks :) | 17:53 |
| jaypipes | cdent: yes. | 17:53 |
| cdent | jaypipes: actually, why compare, just write the allocation that is the result of the spec, it will cleanup the shared doubling there and then, no math required? | 17:54 |
| *** ircuser-1 has joined #openstack-nova | 17:54 | |
| dansmith | cdent: the allocation that is the result of the old flavor is non-trivial to determine.. size, yes, but RP, not so much | 17:55 |
| cdent | we don't care about the old flavor | 17:55 |
| cdent | we're going to clobber the old flavor | 17:55 |
| cdent | the allocations that resulted from the old flavor | 17:55 |
| jaypipes | cdent: because unfortunately the source host is what runs confirm_resize() and doesn't know the UUID of the dest host so the only way to do it is to look for the source host's UUID in the allocation list and delete those, leaving the others | 17:55 |
| dansmith | cdent: well, if you meant subtract the old one to get the new net, but I don't think we know enough to generate a full new one | 17:56 |
| cdent | argh! | 17:56 |
| dansmith | because yeah, that& | 17:56 |
| jaypipes | though I suppose the source host *could* look up the uUID of the dest host by looking at the Migration object | 17:56 |
| cdent | I know understand why there was so much table flipping last week | 17:56 |
| dansmith | please no | 17:56 |
| cdent | now | 17:56 |
| jaypipes | dansmith: yeah, I don't want to do that either. | 17:57 |
| jaypipes | cdent: ok, so do you have all the answers and ideas you need to work on that bug? | 17:57 |
| * dansmith blinks | 17:57 | |
| cdent | jaypipes: apparently not | 17:57 |
| cdent | as we keep dismissing solutions | 17:57 |
| *** aarefiev is now known as aarefiev_afk | 17:58 | |
| dansmith | is it time for our daily hangout? | 17:58 |
| jaypipes | cdent: well, all of these patches I pretty much consider just "hey, here's one solution to this problem, can you all check it out". | 17:58 |
| cdent | or should I just go ahead and do the the VCPU introspection | 17:58 |
| jaypipes | dansmith: I'm game | 17:59 |
| *** yamahata has joined #openstack-nova | 17:59 | |
| cdent | i've got a different hangout now :( | 17:59 |
| jaypipes | cdent: no, I think we're recommending trying the "just sum it" approach. | 17:59 |
| jaypipes | from Mr. dansmith | 17:59 |
| cdent | but we said we can't clean up the sum it approach? | 17:59 |
| dansmith | if we're the only RP in the allocations, | 18:00 |
| jaypipes | cdent: for shared providers, we will heal that on the *destination host* but after the move operation is entirely ended.. | 18:00 |
| dansmith | jaypipes: we will? | 18:00 |
| dansmith | I don't think we will | 18:00 |
| jaypipes | dansmith: yeah, because _update_usage_from_instance() will overwrite the allocations to match a single amount of the flavor. | 18:01 |
| dansmith | it can't | 18:01 |
| dansmith | until after confirm | 18:01 |
| jaypipes | right, which is what I said above, no? | 18:01 |
| dansmith | and the destination doesn't know about confirm | 18:01 |
| *** kbaegis has joined #openstack-nova | 18:01 | |
| jaypipes | dansmith: "but after the move operation is entirely ended.." | 18:01 |
| * dansmith doesn't see that | 18:02 | |
| dansmith | oh | 18:02 |
| dansmith | yeah, and you can't | 18:02 |
| dansmith | the destination host does not know when the move has ended | 18:02 |
| dansmith | jaypipes: https://hangouts.google.com/call/2phok3vj6nhipcx6gp62zvaly4u | 18:02 |
| *** ijw has joined #openstack-nova | 18:04 | |
| *** dtantsur is now known as dtantsur|afk | 18:05 | |
| *** itlinux has joined #openstack-nova | 18:06 | |
| *** kbaegis has quit IRC | 18:06 | |
| *** ijw has quit IRC | 18:06 | |
| *** ijw has joined #openstack-nova | 18:07 | |
| *** kbaegis has joined #openstack-nova | 18:07 | |
| *** liusheng has quit IRC | 18:09 | |
| *** liusheng has joined #openstack-nova | 18:09 | |
| *** moshele has quit IRC | 18:10 | |
| *** harlowja has joined #openstack-nova | 18:11 | |
| *** lpetrut has joined #openstack-nova | 18:17 | |
| cdent | dansmith, jaypipes still hanging out? | 18:23 |
| dansmith | cdent: yes | 18:24 |
| dansmith | cdent: just getting to the "wtf now?" phase | 18:24 |
| dansmith | mriedem: are you aware of a patch up that adds uuid for migration objects? | 18:30 |
| *** karthiks has quit IRC | 18:43 | |
| openstackgerrit | Merged openstack/python-novaclient master: Updated from global requirements https://review.openstack.org/488283 | 18:47 |
| chohoor | I have a question, driver.deallocate_networks_on_reschedule(instance) will return True or False when nova do reschedulter(/nova/compute/manager.py:1822), why only ironic driver return True but other drivers return False? | 18:50 |
| *** catintheroof has quit IRC | 18:59 | |
| *** penick has quit IRC | 18:59 | |
| *** catintheroof has joined #openstack-nova | 19:00 | |
| *** catintheroof has quit IRC | 19:00 | |
| *** catintheroof has joined #openstack-nova | 19:01 | |
| *** elod has quit IRC | 19:10 | |
| *** cdent has quit IRC | 19:15 | |
| *** penick has joined #openstack-nova | 19:16 | |
| *** slaweq has quit IRC | 19:19 | |
| *** slaweq has joined #openstack-nova | 19:19 | |
| *** slaweq has quit IRC | 19:24 | |
| *** edmondsw has joined #openstack-nova | 19:30 | |
| mriedem | dansmith: nope | 19:31 |
| *** edmondsw has quit IRC | 19:32 | |
| *** sree__ has joined #openstack-nova | 19:32 | |
| *** cdent has joined #openstack-nova | 19:32 | |
| *** edmondsw has joined #openstack-nova | 19:32 | |
| *** moshele has joined #openstack-nova | 19:32 | |
| *** nicolasbock has quit IRC | 19:33 | |
| mriedem | sorry, been catching up on internal things that i put off all last week | 19:34 |
| *** moshele has quit IRC | 19:35 | |
| cdent | dansmith, jaypipes: did you fix everything and make the world safe for moves? | 19:37 |
| *** sree__ has quit IRC | 19:37 | |
| dansmith | cdent: no, but we identified that suicide is the easiest path out | 19:37 |
| cdent | but it brings on many changes | 19:37 |
| cdent | dansmith, jaypipes: I have a horrible idea: proxy_id = consumer_uuid.replace(‘-‘, ‘+’) | 19:42 |
| cdent | because it’s the doubling id | 19:42 |
| *** annegentle has joined #openstack-nova | 19:45 | |
| jaypipes | cdent: that doesn't solve the problem we're currently stuck on though, w.r.t. old Ocata computes migrating instances to newer Pike computes | 19:47 |
| *** krtaylor has joined #openstack-nova | 19:47 | |
| openstackgerrit | Sean Dague proposed openstack/nova master: always show urls in list_cells https://review.openstack.org/487860 | 19:49 |
| sdague | mriedem: I added the cacert test case | 19:49 |
| sdague | but the rest of the suggested url adds are all actually invalid urls | 19:49 |
| *** annegentle has quit IRC | 19:49 | |
| sdague | I was looking at https://tools.ietf.org/html/rfc3986 to figure out why they were parsing weird | 19:50 |
| *** mtanino_ has joined #openstack-nova | 19:52 | |
| *** crushil has quit IRC | 19:53 | |
| *** cdent has quit IRC | 19:54 | |
| openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_endpoint_data() https://review.openstack.org/488137 | 19:54 |
| *** cdent has joined #openstack-nova | 19:54 | |
| *** gszasz has quit IRC | 19:54 | |
| cdent | jaypipes: that’s a less negative reaction than I was expecting | 19:55 |
| *** pchavva has quit IRC | 19:55 | |
| openstackgerrit | Sean Dague proposed openstack/nova master: always show urls in list_cells https://review.openstack.org/487860 | 19:56 |
| sdague | efried: also, the typo | 19:56 |
| sdague | efried: and, any chance you can get powervm to run this patch to figure out what the hostname mismatch problem is - https://review.openstack.org/#/c/488381/ ? | 19:59 |
| *** awaugama has quit IRC | 20:00 | |
| efried | esberglu ^^ | 20:02 |
| efried | sdague - esberglu ran our CI against that patch (with our new CI changes) and it's all good. | 20:03 |
| *** Apoorva has quit IRC | 20:03 | |
| esberglu | efried: sdague: Yep. Everything looked fine, it was an issue on our end that's resolved now | 20:03 |
| efried | sdague Possibly TMI, but the deal is: We have to do some hacking to set up our internal API to run remotely (i.e. not localhost). Before, we were waiting until after stack.sh finished, doing that hacking, and restarting the compute service. We were just accepting that it would fail to start up during stack itself. | 20:04 |
| efried | sdague Now we've figured out how to hack it before stack.sh, so the compute service should come alive during stack. | 20:04 |
| *** Apoorva has joined #openstack-nova | 20:06 | |
| *** awaugama has joined #openstack-nova | 20:07 | |
| *** cdent has quit IRC | 20:07 | |
| sdague | efried: ok, good stuff | 20:09 |
| sdague | so, I think that just leaves the ironic ordering problem | 20:09 |
| sdague | which I can special case | 20:09 |
| *** awaugama has quit IRC | 20:11 | |
| efried | sdague Is there a reason you removed the ? from the regex? | 20:12 |
| efried | sdague This will now do the wrong thing if there's an @ further along in the URL (e.g. in the querystring (which may be the only place it's legal without being escaped)) | 20:12 |
| sdague | efried: no, it's matching on nethost | 20:12 |
| sdague | the query string is out of bounds for that replacement | 20:13 |
| efried | ahhhh, cool. | 20:13 |
| *** Sukhdev has joined #openstack-nova | 20:14 | |
| *** jmlowe has quit IRC | 20:16 | |
| *** artom_ has joined #openstack-nova | 20:17 | |
| *** cdent has joined #openstack-nova | 20:18 | |
| *** annegentle has joined #openstack-nova | 20:18 | |
| *** artom has quit IRC | 20:18 | |
| *** randomhack has quit IRC | 20:19 | |
| dansmith | cdent: jaypipes: so the bottom patch in that series, | 20:20 |
| *** slaweq has joined #openstack-nova | 20:20 | |
| dansmith | to fix the allocations thing by removing the where clause.. | 20:20 |
| dansmith | doesn't seem to work for me | 20:20 |
| dansmith | gibi's test on top of that still ends up with allocations for both computes after the confirm | 20:21 |
| cdent | the way gibi_ changed it originally was less instrusive: it simply changed the existing and clause to one condition (the consumer uuid) | 20:22 |
| *** moshele has joined #openstack-nova | 20:23 | |
| cdent | which ought to be the same thing | 20:23 |
| dansmith | isn't that way jay did? | 20:23 |
| *** purplerbot has quit IRC | 20:23 | |
| cdent | i’m looking up the discussion, one sec | 20:24 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: remove source provider allocs in confirm_resize() https://review.openstack.org/488510 | 20:24 |
| jaypipes | dansmith: have a gander ^ | 20:24 |
| jaypipes | dansmith: still needs tests but I want to get your early feedback. | 20:24 |
| *** purplerbot has joined #openstack-nova | 20:25 | |
| *** thorst is now known as thorst_afk | 20:25 | |
| cdent | http://p.anticdent.org/4oEf | 20:25 |
| dansmith | jaypipes: okay but see my question above? | 20:25 |
| jaypipes | dansmith: about the bottom patch in the series? | 20:25 |
| dansmith | yes | 20:26 |
| jaypipes | dansmith: haven't looked into that yet. unrelated... | 20:26 |
| jaypipes | will do so now | 20:26 |
| cdent | dansmith: that ^ is gibi reporting on what he did, which may not be that all the tests pass but the particular situation was resolved | 20:26 |
| *** gyee_ has quit IRC | 20:26 | |
| dansmith | cdent: okay but the specific part of gibi's test that should be fixed by thebottom patch isn't | 20:26 |
| dansmith | namely, after confirm, and after PUTing a singular allocation, we still pull the doubled allocation out of placement | 20:27 |
| cdent | dansmith: yeah, and what gibi changed when he ran his local confirmation, was not exactly the same as what jaypipes did in the “bottom change" | 20:28 |
| mriedem | i'm going to poke around and see if there is anything wrong with the test | 20:28 |
| dansmith | cdent: his description seems identical to me, what did gibi do differently? | 20:29 |
| *** liverpooler has quit IRC | 20:29 | |
| *** gyee has joined #openstack-nova | 20:29 | |
| *** gyee has quit IRC | 20:29 | |
| *** gyee has joined #openstack-nova | 20:30 | |
| cdent | i’m not certain | 20:30 |
| cdent | i’m trying to get myself spun up | 20:30 |
| dansmith | okay | 20:30 |
| dansmith | I feel like this is one of those times where getting all of us in a room with a (big ass) whiteboard for a week would really help | 20:31 |
| *** mdbooth[m] has joined #openstack-nova | 20:31 | |
| mriedem | sssshhhh | 20:31 |
| dansmith | yeah, re-reading that whole discussion, it sure seems like jay's patch is what gibi did | 20:32 |
| dansmith | oh, hmm | 20:33 |
| dansmith | I think maybe he didn't update his allocations after confirming | 20:33 |
| dansmith | ah hah, yep | 20:34 |
| dansmith | mriedem: if you haven't already, I can fix this and rebase on jay's latest for everyone to see | 20:34 |
| mriedem | go nuts | 20:34 |
| jaypipes | go for it. | 20:35 |
| cdent | dansmith: ? | 20:35 |
| * cdent waits for the code | 20:35 | |
| mriedem | yeah i see it | 20:36 |
| mriedem | needs to do: allocations = self._get_allocations_by_server_uuid(server['id']) | 20:36 |
| mriedem | after confirming the resize | 20:36 |
| mriedem | before making assertions on that allocations variable | 20:36 |
| mriedem | which is stale | 20:36 |
| dansmith | cdent: check me: https://review.openstack.org/#/c/487958/7/nova/tests/functional/test_servers.py | 20:37 |
| cdent | I think when he was confirming before, it was based on the logs, | 20:37 |
| dansmith | mriedem: yeah | 20:37 |
| cdent | line? | 20:37 |
| cdent | found it | 20:37 |
| mriedem | https://review.openstack.org/#/c/487958/7/nova/tests/functional/test_servers.py@1406 | 20:37 |
| mriedem | the revert test seems ok in that regard | 20:38 |
| cdent | yeah | 20:38 |
| dansmith | I'm going to remove the resource_tracker.py change so we can get an expedited run on top of jay's stuff, | 20:38 |
| dansmith | and then we can move this to the bottom, change the assertions and build on top | 20:38 |
| mriedem | also | 20:39 |
| jaypipes | ++ | 20:39 |
| mriedem | have you noticed? ObjectActionError: Object action get_minimum_version failed because: Invalid binary prefix | 20:39 |
| dansmith | where is that? | 20:39 |
| jaypipes | must be on the latest | 20:39 |
| dansmith | yeah he must not have done nova-compute | 20:40 |
| jaypipes | since I *just* added the get_minimum_version_latest() thing | 20:40 |
| mriedem | get_minimum_version_multi takes a list | 20:40 |
| jaypipes | gah, ok | 20:40 |
| jaypipes | sec... like I said, this was just so dansmith could take a lo9oksie :) | 20:41 |
| mriedem | just use get_minimum_version | 20:41 |
| jaypipes | k | 20:41 |
| dansmith | damn I guess I probably need the virt/fake change too | 20:41 |
| mriedem | the test will also likely need the AllServicesCurrent fixture now too | 20:42 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 20:43 |
| dansmith | that's the minor fix | 20:43 |
| dansmith | I can start working this on top of master | 20:43 |
| *** cleong has quit IRC | 20:44 | |
| *** jamesdenton has quit IRC | 20:44 | |
| *** jamesdenton has joined #openstack-nova | 20:45 | |
| cdent | I will try to catch up in the morning. I have no brains left. Good luck. Good night. | 20:48 |
| *** cdent has quit IRC | 20:49 | |
| *** ijw has quit IRC | 20:51 | |
| *** ijw has joined #openstack-nova | 20:51 | |
| *** gyee has quit IRC | 20:53 | |
| *** eharney has quit IRC | 20:59 | |
| dansmith | I'm just going to push this up rebased on master so we can move forward | 20:59 |
| dansmith | jaypipes: you'll rebase on top of this and make sure this test keeps working as you make your changes, right? | 20:59 |
| dansmith | and it'd be really good if we had a single-node version of these | 20:59 |
| mriedem | i can help work on the single node one, | 21:00 |
| mriedem | also digging into the revert case | 21:00 |
| jaypipes | dansmith: yes, just ping me when you push. | 21:00 |
| *** rajathag_ is now known as rajathagasthya | 21:00 | |
| jaypipes | currentl fixing up unit tests for the service min version thing | 21:00 |
| dansmith | mriedem: what revert case? | 21:00 |
| mriedem | the revert resize test that fails | 21:01 |
| *** lpetrut has quit IRC | 21:01 | |
| dansmith | of gibi's? | 21:01 |
| mriedem | http://logs.openstack.org/58/487958/7/check/gate-nova-tox-functional-ubuntu-xenial/7f7f332/console.html#_2017-07-31_17_04_11_513991 | 21:01 |
| mriedem | yeah | 21:01 |
| dansmith | he has self.fail() at the end | 21:01 |
| dansmith | I think that's it | 21:01 |
| dansmith | passes for me without that | 21:01 |
| mriedem | hmm, ok the test was hitting this http://logs.openstack.org/58/487958/7/check/gate-nova-tox-functional-ubuntu-xenial/7f7f332/console.html#_2017-07-31_17_04_11_497592 but on the older patches in the series | 21:02 |
| *** lucasxu has quit IRC | 21:02 | |
| dansmith | jay hasn't fixed revert yet, AFAIK | 21:02 |
| dansmith | only confirm | 21:02 |
| mriedem | i think i just did locally | 21:02 |
| dansmith | okay well I have it passing on master, so we'll iterate from there | 21:03 |
| openstackgerrit | Jackie Truong proposed openstack/nova master: Add trusted_certs to instance_extra https://review.openstack.org/457711 | 21:03 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 21:03 |
| dansmith | mriedem: jaypipes ^ | 21:04 |
| dansmith | I can also try to clean up the sleep usage in there by just calling into the manager | 21:04 |
| mriedem | dansmith: jaypipes: this fixed revert for me https://review.openstack.org/#/c/488510/6/nova/compute/resource_tracker.py | 21:04 |
| mriedem | basically the same thing as confirm in the RT | 21:05 |
| *** yamamoto_ has joined #openstack-nova | 21:06 | |
| jaypipes | mriedem: sure, ok will add that. | 21:07 |
| *** imacdonn has joined #openstack-nova | 21:07 | |
| mriedem | dansmith: i think you just need to do: self.compute.manager.update_available_resource(ctxt) | 21:08 |
| dansmith | mriedem: I know | 21:08 |
| dansmith | mriedem: getting a failure on one of the conditions after doing that though | 21:08 |
| *** moshele has quit IRC | 21:09 | |
| *** felipemonteiro_ has joined #openstack-nova | 21:09 | |
| *** gyee has joined #openstack-nova | 21:10 | |
| openstackgerrit | Michael Still proposed openstack/nova master: Move execs of touch to privsep. https://review.openstack.org/489190 | 21:12 |
| *** moshele has joined #openstack-nova | 21:12 | |
| dansmith | yeah, no worky | 21:14 |
| dansmith | it's running the code | 21:14 |
| *** ijw has quit IRC | 21:14 | |
| *** ijw has joined #openstack-nova | 21:14 | |
| dansmith | and I'm running it for both of the fake hosts | 21:15 |
| *** yamamoto_ has quit IRC | 21:15 | |
| *** diablo_rojo has quit IRC | 21:15 | |
| *** smatzek has quit IRC | 21:16 | |
| *** catintheroof has quit IRC | 21:17 | |
| dansmith | heh | 21:17 |
| dansmith | it's deleting the instance allocation | 21:17 |
| dansmith | I wonder if this is just a different orientation of some races | 21:17 |
| dansmith | yeah I think if I reorder the RT runs it fails in a different way | 21:20 |
| *** takedakn has joined #openstack-nova | 21:21 | |
| cburgess | Anyone know if we have an API call to retrieve the contents of and entry in the block_device_mapping table? I can't find one but wanted to confirm before I went and did bad horrible ugly things. | 21:22 |
| openstackgerrit | Jackie Truong proposed openstack/nova master: Add trusted_certs to Instance object https://review.openstack.org/489408 | 21:23 |
| openstackgerrit | Merged openstack/nova master: Updated from global requirements https://review.openstack.org/488865 | 21:23 |
| tonyb | Any chance someone that knows SSL can look at: https://review.openstack.org/#/c/489078/ Somethign like that is needed to unblock the glanceclient update in requirements | 21:25 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 21:31 |
| dansmith | mriedem: jaypipes: pretty brutal brokenness when we explicitly run the periodics ^ :( | 21:31 |
| dansmith | almost all of the checks are commented out and replaced with "assert there is no allocation at all" | 21:32 |
| mikal | sdague: I am awake now | 21:33 |
| mikal | sdague: I replied to your reno comment. I think we do them later as we remove things, not in that cleanup patch. | 21:33 |
| mriedem | comments in ps9 | 21:33 |
| mikal | sdague: I'd also like to get that series merged really early in Queens in case it destabilizes things in confusing ways. | 21:33 |
| dansmith | mriedem: I had just removed those prints.. do you want them as log.info or is removed okay? | 21:35 |
| mriedem | removed is fine, the should be in the mismatch error anyway | 21:35 |
| mriedem | *they | 21:35 |
| *** felipemonteiro_ has quit IRC | 21:38 | |
| dansmith | mriedem: you wanna go through my latest rev quickly to see if you're okay with those changes and then I'll fix your redundancies? | 21:39 |
| mriedem | i can | 21:40 |
| mriedem | i thought you said the direct update_available_resource made everything go sideways though? | 21:40 |
| *** takedakn has quit IRC | 21:41 | |
| dansmith | that was before I realized how fscked it was with them set | 21:41 |
| mriedem | oh | 21:41 |
| dansmith | letting them run in the sleep was causing them to run twice (well 1.5 times) and so the things that worked were hard-coded for that pattern | 21:41 |
| dansmith | so it would update, delete, create in the span of the two seconds | 21:42 |
| dansmith | running them each once leaves it at update, delete | 21:42 |
| dansmith | so no allocation at all, target or source | 21:42 |
| mriedem | ok new things looks fine | 21:42 |
| dansmith | ack | 21:42 |
| *** baoli has quit IRC | 21:44 | |
| dansmith | boom ^ | 21:44 |
| dansmith | dang | 21:44 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 21:44 |
| dansmith | boom ^ | 21:44 |
| mriedem | oh you sucker | 21:45 |
| mriedem | DOUBLE BOOM! | 21:45 |
| * dansmith puts on his "who me?" face | 21:46 | |
| mriedem | SONIC BOOM?! | 21:46 |
| *** Apoorva_ has joined #openstack-nova | 21:46 | |
| tonyb | mriedem: https://www.youtube.com/watch?v=Fnmh7dF4c2U | 21:48 |
| dansmith | ah, I didn't realize what you were pointing to in that | 21:48 |
| mriedem | tonyb: exactly | 21:48 |
| *** Apoorva has quit IRC | 21:49 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 21:49 |
| dansmith | turBOOM | 21:49 |
| *** esberglu has quit IRC | 21:51 | |
| mriedem | dansmith: the commit message is a bit old now | 21:51 |
| dansmith | gdi riedeman | 21:51 |
| mriedem | well you could just leave it | 21:52 |
| mriedem | 2 n's btw | 21:52 |
| mriedem | double-n as my dad would say | 21:52 |
| mriedem | karl with a k, double-n | 21:52 |
| dansmith | gdi riedermann | 21:53 |
| mriedem | double r is more like it | 21:53 |
| * dansmith did that just for you | 21:53 | |
| dansmith | heh | 21:53 |
| mriedem | riderman as my first manager at ibm would say | 21:53 |
| mriedem | and write | 21:53 |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 21:54 |
| dansmith | hah, riderman | 21:54 |
| *** slaweq has quit IRC | 21:54 | |
| *** slaweq has joined #openstack-nova | 21:54 | |
| mriedem | so i pulled it down and ran just the test class and both tests failed | 21:55 |
| dansmith | they pass for me... | 21:55 |
| dansmith | fail how? | 21:56 |
| mriedem | i could be picking up a stale branch with the git review -d | 21:56 |
| mriedem | no that's not it | 21:56 |
| dansmith | okay I see fails if I run them in tox in parallel | 21:57 |
| *** esberglu has joined #openstack-nova | 21:57 | |
| dansmith | they pass in isolation | 21:58 |
| *** kylek3h has quit IRC | 21:58 | |
| mriedem | i'm just doing: | 21:59 |
| mriedem | tox -e functional -- nova.tests.functional.test_servers.ServerMovingTests | 21:59 |
| mriedem | this time they both passed | 21:59 |
| *** slaweq has quit IRC | 21:59 | |
| dansmith | ugh | 21:59 |
| dansmith | I just ran singles a bunch of times and saw it fail | 22:00 |
| dansmith | and it fails to assert the usage of the target, which should be stable since I run the periodics in the same order each time | 22:01 |
| dansmith | brb | 22:01 |
| mriedem | same here | 22:01 |
| *** esberglu has quit IRC | 22:02 | |
| *** itlinux has quit IRC | 22:05 | |
| mriedem | wonder if it has something to do with the _FAKE_NODES in the fake virt driver | 22:07 |
| *** esberglu has joined #openstack-nova | 22:09 | |
| dansmith | I think we're racing with other threads | 22:10 |
| *** baoli has joined #openstack-nova | 22:10 | |
| dansmith | I see when it fails that we delete the allocation, but PUT it right after, then the test fails | 22:10 |
| dansmith | because it expects it to be gone, since the periodic on the second node should delete it | 22:10 |
| *** esberglu has quit IRC | 22:14 | |
| *** annegentle has quit IRC | 22:15 | |
| *** baoli has quit IRC | 22:15 | |
| dansmith | seems to fail more often than not when I run it from tox | 22:16 |
| *** yamamoto has joined #openstack-nova | 22:16 | |
| dansmith | but passes every time when I run it with subunit.run | 22:16 |
| jaypipes | dansmith: have you pushed up another gibi patch? do I need to rebase? | 22:16 |
| dansmith | jaypipes: yes, but it's not stable and I'm not sure why | 22:16 |
| jaypipes | dansmith: that whole time.sleep(1) and manipulating the fake.set_nodes() globals is probably the culprit... | 22:20 |
| melwitt | dansmith: I think subunit.run doesn't run tests in parallel but tox does (via testr underneath) | 22:20 |
| jaypipes | dansmith: you could try adding a time.sleep(1) after the second self.start_service() call... | 22:20 |
| *** baoli has joined #openstack-nova | 22:22 | |
| *** yamamoto has quit IRC | 22:23 | |
| mriedem | i'm not sure why the first time.sleep(1) is needed after the first service starts | 22:24 |
| dansmith | melwitt: I'm running one test with tox, so should be the same | 22:24 |
| melwitt | oh, one test | 22:25 |
| dansmith | jaypipes: doesn't help | 22:26 |
| *** yamamoto has joined #openstack-nova | 22:28 | |
| *** dfisher has joined #openstack-nova | 22:28 | |
| dansmith | oh, | 22:29 |
| dansmith | I was thinking he was forcing to host1 on initial boot each time | 22:29 |
| dansmith | but he's not | 22:29 |
| *** baoli_ has joined #openstack-nova | 22:29 | |
| dansmith | so maybe it's just based on which it initially lands on and then moves to | 22:29 |
| dfisher | nova-compute doesn't use etcd3, does it? (pike b3) | 22:30 |
| dansmith | because I'm running periodics in a set order, but the actual stuff will be reversed | 22:30 |
| *** moshele has quit IRC | 22:30 | |
| *** baoli has quit IRC | 22:30 | |
| *** slaweq has joined #openstack-nova | 22:33 | |
| *** penick has quit IRC | 22:35 | |
| *** slaweq has quit IRC | 22:38 | |
| *** thorst_afk has quit IRC | 22:38 | |
| dansmith | yeah I think that makes it repeatable | 22:39 |
| *** liangy has quit IRC | 22:41 | |
| mriedem | dansmith: yeah it's random | 22:43 |
| mriedem | so toggle the update_rt call based on which host i guess? | 22:43 |
| mriedem | dfisher: nope | 22:43 |
| dansmith | mriedem: no, we need to run it both ways and make sure it behaves the same | 22:43 |
| mriedem | oh | 22:43 |
| dansmith | I shall have patchification soonly | 22:43 |
| mriedem | cool | 22:43 |
| dfisher | mriedem: i'm seeing nova service-list show my compute node but openstack hypervisor list not show it. | 22:43 |
| mriedem | dfisher: is it mapped to a cell? | 22:44 |
| mriedem | nova-manage cell_v2 discover_hosts | 22:44 |
| mriedem | --verbose | 22:44 |
| dfisher | no, it's not mapped. | 22:44 |
| dfisher | how would I map it | 22:44 |
| dfisher | ? | 22:44 |
| mriedem | dfisher: ^ | 22:46 |
| mriedem | discover_hosts | 22:46 |
| *** chyka has quit IRC | 22:46 | |
| dfisher | yeah, that's not finding it :( | 22:46 |
| *** gouthamr has quit IRC | 22:46 | |
| *** chyka has joined #openstack-nova | 22:46 | |
| dfisher | http://paste.openstack.org/show/617066/ | 22:46 |
| dansmith | dfisher: then your compute isn't checking into the cell1 db | 22:48 |
| *** kbaegis has quit IRC | 22:48 | |
| dansmith | dfisher: make sure your conductor's config is pointed at the cell1 db, matching the cell1 cell_mapping record | 22:48 |
| *** kbaegis has joined #openstack-nova | 22:49 | |
| dfisher | ok. will poke. thanks dansmith! | 22:49 |
| *** bauzas has quit IRC | 22:52 | |
| *** edmondsw has quit IRC | 22:52 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Test resize with placement api https://review.openstack.org/487958 | 22:52 |
| dansmith | mriedem: ^ see if you hate that | 22:52 |
| dansmith | should be repeatable, and keep jaypipes honest :) | 22:52 |
| *** slaweq has joined #openstack-nova | 22:55 | |
| *** acormier has quit IRC | 22:56 | |
| mriedem | dansmith: questions inline about the az stuff | 22:57 |
| *** acormier has joined #openstack-nova | 22:57 | |
| dansmith | mriedem: comments inline | 22:59 |
| mriedem | oh right forced_host | 23:00 |
| mriedem | which there used to be a docs page for that, | 23:00 |
| mriedem | but with the migration it looks like it's gone | 23:01 |
| mriedem | and our api-ref doesn't mention this wrinkle of course | 23:01 |
| *** acormier has quit IRC | 23:01 | |
| *** slaweq has quit IRC | 23:01 | |
| dansmith | I admit, I had to copy some deets out of an ask.o.o article :P | 23:03 |
| mriedem | there used to be a nice docs page called "Select hosts where instances are launched" | 23:03 |
| mriedem | and it had this information in it | 23:03 |
| mriedem | but apparently it's been deleted | 23:03 |
| mriedem | alright i'll check results after i get back from maya's gymnastics class, which is full of fun and surprises | 23:05 |
| dansmith | ack | 23:06 |
| *** slaweq has joined #openstack-nova | 23:10 | |
| *** hongbin has quit IRC | 23:11 | |
| *** bauzas has joined #openstack-nova | 23:11 | |
| *** slaweq has quit IRC | 23:14 | |
| *** gouthamr has joined #openstack-nova | 23:15 | |
| *** https_GK1wmSU has joined #openstack-nova | 23:16 | |
| *** randomhack has joined #openstack-nova | 23:16 | |
| *** gyee has quit IRC | 23:17 | |
| *** Apoorva has joined #openstack-nova | 23:18 | |
| *** Apoorva_ has quit IRC | 23:18 | |
| *** dfisher has quit IRC | 23:18 | |
| *** https_GK1wmSU has left #openstack-nova | 23:19 | |
| *** randomhack has quit IRC | 23:20 | |
| *** catintheroof has joined #openstack-nova | 23:24 | |
| *** marst has quit IRC | 23:26 | |
| mikal | Does anyone here understand what causes hairpins to fail to enable? | 23:27 |
| mikal | I'm trying to unravel that code to be less ... processy | 23:27 |
| jaypipes | mikal: sorry, no :( | 23:35 |
| jaypipes | dansmith: sorry, was dinnering. what change did you make to make that test stable? | 23:36 |
| dansmith | jaypipes: made sure to boot the instance on a specific node consistently | 23:36 |
| dansmith | jaypipes: since the allocations are screwed up by one running the periodic before the other, | 23:36 |
| dansmith | the order of boot, migration, and which node runs the periodic last affect the outcome | 23:36 |
| dansmith | jaypipes: so now it runs each test twice, starting and finishing on a different node each time | 23:37 |
| dansmith | since it always runs the periodic in the same order, | 23:37 |
| dansmith | that will cover us against ordering issues if you pass all four tests | 23:37 |
| dansmith | and mriedem is going to work on a single-node variant I think | 23:37 |
| jaypipes | dansmith: k | 23:43 |
| jaypipes | dansmith: so I'm good to pull and rebase? | 23:43 |
| *** catintheroof has quit IRC | 23:43 | |
| *** Sukhdev has quit IRC | 23:43 | |
| mikal | jaypipes: its ok, this is all nova-net code and might go to heaven soon anyways | 23:44 |
| jaypipes | mikal: heaven? | 23:44 |
| dansmith | jaypipes: cha | 23:44 |
| mikal | jaypipes: would you prefer "is put out to pasture"? | 23:44 |
| dansmith | jaypipes: remember things are upside down for mikal | 23:44 |
| jaypipes | heh | 23:44 |
| mikal | "kicks the bucket" | 23:44 |
| mikal | "goes for a dirt nap" | 23:44 |
| dansmith | jaypipes: oh looks like there is a pep8 error in that test patch, maybe you can fix when you rebase? | 23:46 |
| jaypipes | dansmith: yuppers. | 23:47 |
| dansmith | jaypipes: and note that two of those tests are self.skipTest()ed so you'll want to unskip them as soon as you can | 23:47 |
| jaypipes | yup, got it. | 23:47 |
| *** smatzek has joined #openstack-nova | 23:51 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!