*** esberglu has quit IRC | 00:04 | |
*** yamamoto has quit IRC | 00:10 | |
*** yamamoto has joined #openstack-nova | 00:11 | |
*** acormier has quit IRC | 00:13 | |
*** gmann has quit IRC | 00:15 | |
*** gmann has joined #openstack-nova | 00:15 | |
*** acormier has joined #openstack-nova | 00:17 | |
*** jackie-truong has quit IRC | 00:17 | |
*** vishwanathj has quit IRC | 00:18 | |
*** Apoorva_ has quit IRC | 00:18 | |
*** vishwanathj has joined #openstack-nova | 00:18 | |
*** Apoorva has joined #openstack-nova | 00:19 | |
*** markvoelker has quit IRC | 00:20 | |
*** edmondsw has joined #openstack-nova | 00:20 | |
*** randomhack has joined #openstack-nova | 00:22 | |
*** Apoorva has quit IRC | 00:23 | |
*** fragatina has quit IRC | 00:23 | |
*** dtp has quit IRC | 00:23 | |
mriedem | jangutter: question in https://review.openstack.org/#/c/483459/15/nova/network/os_vif_util.py@333 | 00:24 |
---|---|---|
*** edmondsw has quit IRC | 00:25 | |
*** randomhack has quit IRC | 00:27 | |
*** psachin has joined #openstack-nova | 00:28 | |
*** thorst has joined #openstack-nova | 00:29 | |
*** jwcroppe has joined #openstack-nova | 00:29 | |
*** claudiub has joined #openstack-nova | 00:31 | |
*** thorst has quit IRC | 00:33 | |
*** jwcroppe has quit IRC | 00:33 | |
*** jwcroppe has joined #openstack-nova | 00:33 | |
*** markvoelker has joined #openstack-nova | 00:35 | |
*** tetsuro has joined #openstack-nova | 00:39 | |
*** kiennt has joined #openstack-nova | 00:40 | |
*** esberglu has joined #openstack-nova | 00:40 | |
*** sdague has quit IRC | 00:41 | |
*** acormier has quit IRC | 00:42 | |
*** hshiina has joined #openstack-nova | 00:43 | |
*** esberglu has quit IRC | 00:45 | |
*** tuanluong has joined #openstack-nova | 00:50 | |
*** claudiub has quit IRC | 00:51 | |
*** baoli has joined #openstack-nova | 00:52 | |
*** thorst has joined #openstack-nova | 00:59 | |
*** phuongnh has joined #openstack-nova | 01:02 | |
*** acormier has joined #openstack-nova | 01:05 | |
alex_xu | oomichi: thanks | 01:06 |
*** thorst has quit IRC | 01:07 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Translate the return value of attachment_create and _update https://review.openstack.org/486194 | 01:16 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Implement new attach Cinder flow https://review.openstack.org/330285 | 01:16 |
*** rajathagasthya has quit IRC | 01:18 | |
*** mdnadeem has joined #openstack-nova | 01:19 | |
*** moshele has joined #openstack-nova | 01:20 | |
*** yamahata has quit IRC | 01:22 | |
*** lucasxu has joined #openstack-nova | 01:22 | |
*** lucasxu has quit IRC | 01:24 | |
*** mtanino has joined #openstack-nova | 01:25 | |
moshele | mriedem, jaypipes: hi can you review https://review.openstack.org/#/c/398265/ ? | 01:26 |
*** yufei has joined #openstack-nova | 01:27 | |
*** harlowja has quit IRC | 01:29 | |
*** mriedem has quit IRC | 01:29 | |
*** mtanino has quit IRC | 01:30 | |
*** Shunli has joined #openstack-nova | 01:32 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Wrong href link returned when providing non-existed version in GET version API https://review.openstack.org/486850 | 01:33 |
*** litao__ has joined #openstack-nova | 01:35 | |
*** Kevin_Zheng has joined #openstack-nova | 01:42 | |
*** gcb has joined #openstack-nova | 01:47 | |
*** edmondsw has joined #openstack-nova | 02:08 | |
openstackgerrit | Merged openstack/nova master: Add VIFHostDevice support to libvirt driver https://review.openstack.org/486426 | 02:08 |
*** acormier has quit IRC | 02:11 | |
openstackgerrit | Moshe Levi proposed openstack/nova master: hardware offload support for openvswitch https://review.openstack.org/398265 | 02:11 |
*** acormier has joined #openstack-nova | 02:11 | |
*** jamesden_ has quit IRC | 02:13 | |
*** edmondsw has quit IRC | 02:13 | |
*** itlinux_ has quit IRC | 02:14 | |
*** yamahata has joined #openstack-nova | 02:15 | |
*** acormier has quit IRC | 02:16 | |
*** tbachman_ has joined #openstack-nova | 02:17 | |
*** patriciadomin has quit IRC | 02:19 | |
*** csuttles has quit IRC | 02:19 | |
*** beagles has quit IRC | 02:19 | |
*** csuttles_ has joined #openstack-nova | 02:19 | |
*** tobasco has quit IRC | 02:19 | |
*** patriciadomin has joined #openstack-nova | 02:19 | |
*** doffm has quit IRC | 02:19 | |
*** tobasco has joined #openstack-nova | 02:20 | |
*** b3nt_pin has joined #openstack-nova | 02:20 | |
*** doffm has joined #openstack-nova | 02:20 | |
*** tbachman has quit IRC | 02:20 | |
*** tbachman_ is now known as tbachman | 02:20 | |
*** gaurangt has quit IRC | 02:22 | |
*** takashin has quit IRC | 02:22 | |
*** takashin has joined #openstack-nova | 02:23 | |
*** jamesdenton has joined #openstack-nova | 02:24 | |
*** jamesdenton has quit IRC | 02:25 | |
*** gaurangt has joined #openstack-nova | 02:25 | |
*** jamesdenton has joined #openstack-nova | 02:26 | |
*** saphi has joined #openstack-nova | 02:30 | |
*** gouthamr has joined #openstack-nova | 02:31 | |
*** baoli has quit IRC | 02:33 | |
saphi | Hi guys. I'm deploying Openstack Pike on Ubuntu 16.04 use ubuntu archive repository. I have two node controller and compute. nova-compute was installed on both of them. So I have two compute nodes. But When I launch an instance. If the instance go to compute-node, it can't download Image from glance-api. If the instance go to controller node, It run successful. | 02:33 |
*** baoli has joined #openstack-nova | 02:34 | |
saphi | On glance-api.log, the error is timed out. | 02:35 |
*** crushil has quit IRC | 02:36 | |
*** crushil has joined #openstack-nova | 02:37 | |
saphi | Oh. the problem is my network configuration | 02:40 |
*** jamesdenton has quit IRC | 02:42 | |
*** baoli has quit IRC | 02:49 | |
tetsuro | reported a bug that you can't use ":" as az name, and proposed 2 solutions. could you advise me which solution is better on https://bugs.launchpad.net/nova/+bug/1695861 ? | 02:57 |
openstack | Launchpad bug 1695861 in OpenStack Compute (nova) "Invalid availability zone name with ':' is accepted" [Undecided,Confirmed] | 02:57 |
*** takashin has left #openstack-nova | 03:02 | |
*** vishwanathj has quit IRC | 03:06 | |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Add 'Forced down' column in serivce-list https://review.openstack.org/487263 | 03:07 |
*** vishwanathj has joined #openstack-nova | 03:07 | |
*** vishwanathj has quit IRC | 03:09 | |
*** vishwanathj has joined #openstack-nova | 03:09 | |
*** zsli_ has joined #openstack-nova | 03:26 | |
*** Shunli has quit IRC | 03:28 | |
*** moshele has quit IRC | 03:28 | |
*** zsli_ has quit IRC | 03:30 | |
*** links has joined #openstack-nova | 03:30 | |
*** links has quit IRC | 03:30 | |
*** mamandle has joined #openstack-nova | 03:45 | |
*** jamesdenton has joined #openstack-nova | 03:49 | |
*** edmondsw has joined #openstack-nova | 03:57 | |
*** mamandle has quit IRC | 03:57 | |
*** fragatina has joined #openstack-nova | 03:57 | |
*** fragatina has quit IRC | 04:00 | |
*** fragatina has joined #openstack-nova | 04:01 | |
*** edmondsw has quit IRC | 04:01 | |
*** chyka has quit IRC | 04:03 | |
*** udesale has joined #openstack-nova | 04:03 | |
*** _pewp_ has quit IRC | 04:04 | |
*** nicolasbock has joined #openstack-nova | 04:04 | |
*** _pewp_ has joined #openstack-nova | 04:06 | |
*** deep-book-gk_ has joined #openstack-nova | 04:19 | |
*** jamesdenton has quit IRC | 04:21 | |
*** deep-book-gk_ has left #openstack-nova | 04:22 | |
*** rajathagasthya has joined #openstack-nova | 04:27 | |
*** oomichi has quit IRC | 04:29 | |
*** oomichi has joined #openstack-nova | 04:30 | |
*** sree_ has joined #openstack-nova | 04:32 | |
*** kornicameister has joined #openstack-nova | 04:32 | |
*** sree_ is now known as Guest68749 | 04:33 | |
*** gongysh has joined #openstack-nova | 04:34 | |
*** cNilesh has joined #openstack-nova | 04:36 | |
*** armax has quit IRC | 04:37 | |
*** armax has joined #openstack-nova | 04:37 | |
*** armax has quit IRC | 04:37 | |
*** Guest68749 has quit IRC | 04:38 | |
*** armax has joined #openstack-nova | 04:38 | |
*** armax has quit IRC | 04:38 | |
*** armax has joined #openstack-nova | 04:39 | |
*** armax has quit IRC | 04:39 | |
*** armax has joined #openstack-nova | 04:40 | |
*** harlowja has joined #openstack-nova | 04:40 | |
*** armax has quit IRC | 04:40 | |
*** gongysh has quit IRC | 04:40 | |
*** armax has joined #openstack-nova | 04:40 | |
*** armax has quit IRC | 04:41 | |
*** armax has joined #openstack-nova | 04:41 | |
*** armax has quit IRC | 04:41 | |
*** armax has joined #openstack-nova | 04:42 | |
*** armax has quit IRC | 04:42 | |
*** armax has joined #openstack-nova | 04:43 | |
*** armax has quit IRC | 04:43 | |
*** armax has joined #openstack-nova | 04:44 | |
*** armax has quit IRC | 04:44 | |
*** armax has joined #openstack-nova | 04:44 | |
*** armax has quit IRC | 04:45 | |
*** armax has joined #openstack-nova | 04:45 | |
*** armax has quit IRC | 04:45 | |
*** armax has joined #openstack-nova | 04:46 | |
*** armax has quit IRC | 04:46 | |
*** armax has joined #openstack-nova | 04:47 | |
*** armax has quit IRC | 04:47 | |
*** armax has joined #openstack-nova | 04:48 | |
*** armax has quit IRC | 04:48 | |
*** jamesdenton has joined #openstack-nova | 04:48 | |
*** priteau has joined #openstack-nova | 04:49 | |
*** esberglu has joined #openstack-nova | 04:53 | |
*** prateek_ has joined #openstack-nova | 04:57 | |
*** esberglu has quit IRC | 04:58 | |
*** jamesdenton has quit IRC | 04:59 | |
*** kazsh has joined #openstack-nova | 04:59 | |
*** gouthamr has quit IRC | 05:00 | |
*** thorst has joined #openstack-nova | 05:04 | |
*** sree_ has joined #openstack-nova | 05:05 | |
*** sree_ is now known as Guest67725 | 05:06 | |
*** rajathagasthya has quit IRC | 05:06 | |
*** vishwana_ has joined #openstack-nova | 05:08 | |
*** vishwana_ has quit IRC | 05:09 | |
*** vishwanathj has quit IRC | 05:09 | |
*** thorst has quit IRC | 05:10 | |
*** vishwanathj has joined #openstack-nova | 05:10 | |
*** markvoelker has quit IRC | 05:13 | |
*** mamandle has joined #openstack-nova | 05:15 | |
*** mamandle has quit IRC | 05:22 | |
*** jjung has joined #openstack-nova | 05:32 | |
*** mamandle has joined #openstack-nova | 05:37 | |
*** ratailor has joined #openstack-nova | 05:38 | |
*** harlowja has quit IRC | 05:39 | |
*** gongysh has joined #openstack-nova | 05:40 | |
*** vikram has joined #openstack-nova | 05:41 | |
vikram | I have a query about keypair | 05:41 |
*** moshele has joined #openstack-nova | 05:41 | |
vikram | Cannot find a 'project_id' field in the keypair table then how GET call with a project-id ensures keypair for the queried project is only returned | 05:42 |
*** trinaths has joined #openstack-nova | 05:42 | |
*** kiennt has quit IRC | 05:42 | |
vikram | I can find the GET call is returning all the keypairs | 05:43 |
vikram | Can someone please help | 05:43 |
*** priteau has quit IRC | 05:44 | |
*** edmondsw has joined #openstack-nova | 05:45 | |
*** edmondsw has quit IRC | 05:49 | |
*** moshele has quit IRC | 05:50 | |
*** Shunli has joined #openstack-nova | 05:59 | |
*** kiennt has joined #openstack-nova | 06:00 | |
*** fragatina has quit IRC | 06:03 | |
*** fragatina has joined #openstack-nova | 06:05 | |
*** rcernin has joined #openstack-nova | 06:06 | |
*** fragatina has quit IRC | 06:08 | |
*** andreas_s has joined #openstack-nova | 06:09 | |
*** chyka has joined #openstack-nova | 06:22 | |
*** randomhack has joined #openstack-nova | 06:23 | |
*** dixiaoli_ has joined #openstack-nova | 06:25 | |
*** chyka has quit IRC | 06:27 | |
*** randomhack has quit IRC | 06:27 | |
*** thorst has joined #openstack-nova | 06:29 | |
*** thorst has quit IRC | 06:33 | |
*** sshwarts has joined #openstack-nova | 06:37 | |
*** litao__ has quit IRC | 06:39 | |
*** bkopilov_ has quit IRC | 06:39 | |
*** esberglu has joined #openstack-nova | 06:41 | |
*** dtantsur|afk is now known as dtantsur | 06:42 | |
*** sridharg has joined #openstack-nova | 06:44 | |
gmann | vikram, it is associated with user_id | 06:45 |
gmann | vikram, and if user id is not passed (it is supported from 2.10) it will be fetched from request context | 06:46 |
*** esberglu has quit IRC | 06:46 | |
*** moshele has joined #openstack-nova | 06:47 | |
*** cfriesen has quit IRC | 06:49 | |
openstackgerrit | Béla Vancsics proposed openstack/nova master: Reduced the complexity of the _init_instance method (1) https://review.openstack.org/374661 | 06:50 |
*** yamamoto has quit IRC | 06:54 | |
gmann | alex_xu, any issue with this(error) https://review.openstack.org/#/c/485061/3 | 06:56 |
*** jamesdenton has joined #openstack-nova | 06:56 | |
openstackgerrit | Merged openstack/nova master: Set IronicNodeState.uuid in _update_from_compute_node https://review.openstack.org/487227 | 07:00 |
*** jamesdenton has quit IRC | 07:00 | |
*** belmoreira has joined #openstack-nova | 07:05 | |
vikram | gmann: ping | 07:07 |
gmann | vikram, pong | 07:11 |
vikram | gmann: Why nova GET call expects a project-id then? | 07:12 |
gmann | vikram, in request body? or url? | 07:13 |
*** ralonsoh has joined #openstack-nova | 07:13 | |
*** markvoelker has joined #openstack-nova | 07:14 | |
*** markus_z has joined #openstack-nova | 07:14 | |
vikram | gmann: any clue? | 07:14 |
alex_xu | gmann: I guess it is just the gate problem, the patch after that one passed all the tests | 07:15 |
gmann | vikram, thats for all APIs and it has been removed from microversion 2.18 - https://docs.openstack.org/nova/latest/reference/api-microversion-history.html#id16 | 07:16 |
vikram | gmann: ok | 07:17 |
gmann | alex_xu, ok, i rechecked that | 07:17 |
gmann | vikram, after 2.18 you can skip the project_id for API request | 07:17 |
vikram | gmann: thanks | 07:17 |
gmann | vikram, np! | 07:18 |
*** ralonsoh has quit IRC | 07:21 | |
*** ralonsoh_ has joined #openstack-nova | 07:21 | |
*** vikram has quit IRC | 07:23 | |
*** ralonsoh_ is now known as ralonsoh | 07:23 | |
*** edmondsw has joined #openstack-nova | 07:33 | |
*** crushil has quit IRC | 07:33 | |
*** crushil has joined #openstack-nova | 07:34 | |
*** edmondsw has quit IRC | 07:37 | |
*** priteau has joined #openstack-nova | 07:38 | |
*** ratailor is now known as ratailor|Lunch | 07:40 | |
*** alexchadin has joined #openstack-nova | 07:43 | |
*** jaosorior has quit IRC | 07:43 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Wrong href link returned when providing non-existed version in GET version API https://review.openstack.org/486850 | 07:44 |
*** crushil has quit IRC | 07:44 | |
*** claudiub has joined #openstack-nova | 07:45 | |
*** dims has quit IRC | 07:45 | |
*** priteau has quit IRC | 07:46 | |
*** markvoelker has quit IRC | 07:48 | |
*** dims has joined #openstack-nova | 07:49 | |
*** damien_r has joined #openstack-nova | 07:50 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Dump versioned notifications when sample test fails https://review.openstack.org/487314 | 07:51 |
*** yamamoto has joined #openstack-nova | 07:55 | |
*** jaosorior has joined #openstack-nova | 07:57 | |
*** jaosorior has quit IRC | 07:58 | |
*** vishwanathj has quit IRC | 07:58 | |
*** vishwanathj has joined #openstack-nova | 07:58 | |
*** jaosorior has joined #openstack-nova | 07:59 | |
*** zsli_ has joined #openstack-nova | 08:00 | |
*** ratailor|Lunch is now known as ratailor | 08:01 | |
*** yamamoto has quit IRC | 08:02 | |
*** jaosorior has quit IRC | 08:02 | |
*** Shunli has quit IRC | 08:03 | |
*** jaosorior has joined #openstack-nova | 08:03 | |
*** jaosorior has quit IRC | 08:03 | |
*** jaosorior has joined #openstack-nova | 08:04 | |
*** zsli__ has joined #openstack-nova | 08:08 | |
*** derekh has joined #openstack-nova | 08:08 | |
*** zsli_ has quit IRC | 08:11 | |
*** mamandle has quit IRC | 08:12 | |
*** gongysh has quit IRC | 08:12 | |
*** jaosorior has quit IRC | 08:13 | |
*** zsli__ has quit IRC | 08:15 | |
*** lucas-afk is now known as lucasagomes | 08:15 | |
openstackgerrit | Béla Vancsics proposed openstack/nova master: Reduced the complexity of the _init_instance method (2) https://review.openstack.org/420619 | 08:16 |
*** Shunli has joined #openstack-nova | 08:18 | |
*** bkopilov_ has joined #openstack-nova | 08:19 | |
*** priteau has joined #openstack-nova | 08:20 | |
*** mamandle has joined #openstack-nova | 08:22 | |
*** efoley has joined #openstack-nova | 08:23 | |
*** zsli_ has joined #openstack-nova | 08:23 | |
openstackgerrit | Gábor Antal proposed openstack/nova master: Add helper method for waiting migrations in functional tests https://review.openstack.org/486537 | 08:23 |
*** efoley_ has joined #openstack-nova | 08:24 | |
*** efoley has quit IRC | 08:24 | |
*** priteau has quit IRC | 08:24 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Improve assertJsonEqual error reporting https://review.openstack.org/428199 | 08:24 |
*** Shunli has quit IRC | 08:26 | |
*** esberglu has joined #openstack-nova | 08:29 | |
*** thorst has joined #openstack-nova | 08:30 | |
openstackgerrit | Gábor Antal proposed openstack/nova master: Transform instance.live_migration_force_complete notification https://review.openstack.org/480561 | 08:30 |
*** esberglu has quit IRC | 08:34 | |
*** thorst has quit IRC | 08:34 | |
*** efoley_ is now known as efoley | 08:35 | |
*** tetsuro has quit IRC | 08:37 | |
*** dtantsur is now known as dtantsur|bbl | 08:38 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 08:44 |
gabor_antal | mriedem bauzas: Would you please take a look at https://review.openstack.org/486537 ? | 08:44 |
*** markvoelker has joined #openstack-nova | 08:45 | |
bauzas | gabor_antal: ack | 08:46 |
*** tbachman has quit IRC | 08:50 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Add method for verify multiple versioned notifications https://review.openstack.org/465526 | 08:51 |
*** jaosorior has joined #openstack-nova | 08:53 | |
*** priteau has joined #openstack-nova | 08:54 | |
*** tbachman has joined #openstack-nova | 08:54 | |
*** priteau has quit IRC | 08:58 | |
*** jamesdenton has joined #openstack-nova | 08:59 | |
*** vishwanathj has quit IRC | 09:01 | |
*** vishwanathj has joined #openstack-nova | 09:01 | |
*** jaosorior has quit IRC | 09:03 | |
*** jamesdenton has quit IRC | 09:04 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Add method for verify multiple versioned notifications https://review.openstack.org/465526 | 09:06 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: do not pass proxy env variables by tox https://review.openstack.org/487327 | 09:07 |
*** damien_r1 has joined #openstack-nova | 09:13 | |
*** dr_gogeta86_ has quit IRC | 09:15 | |
*** damien_r has quit IRC | 09:16 | |
*** markvoelker has quit IRC | 09:19 | |
*** john5223_ has quit IRC | 09:19 | |
*** rhagarty has quit IRC | 09:19 | |
*** dr_gogeta86 has joined #openstack-nova | 09:20 | |
*** jjung has quit IRC | 09:20 | |
*** jaosorior has joined #openstack-nova | 09:21 | |
*** gryf has quit IRC | 09:21 | |
*** dr_gogeta86 has quit IRC | 09:21 | |
*** dr_gogeta86 has joined #openstack-nova | 09:21 | |
*** stephenfin has quit IRC | 09:21 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance-live_migration_abort notification https://review.openstack.org/420453 | 09:21 |
*** gongysh has joined #openstack-nova | 09:21 | |
*** gryf has joined #openstack-nova | 09:22 | |
*** sfinucan has quit IRC | 09:22 | |
*** edmondsw has joined #openstack-nova | 09:22 | |
*** cristicalin has joined #openstack-nova | 09:22 | |
*** rhagarty has joined #openstack-nova | 09:23 | |
*** sfinucan has joined #openstack-nova | 09:23 | |
*** mdrabe has quit IRC | 09:23 | |
*** ekhugen has quit IRC | 09:23 | |
*** stephenfin has joined #openstack-nova | 09:24 | |
*** yamamoto has joined #openstack-nova | 09:24 | |
*** edmondsw has quit IRC | 09:25 | |
*** priteau has joined #openstack-nova | 09:25 | |
*** mdrabe has joined #openstack-nova | 09:26 | |
*** ekhugen has joined #openstack-nova | 09:26 | |
*** zsli_ has quit IRC | 09:28 | |
*** mvk has quit IRC | 09:31 | |
*** egonzalez has joined #openstack-nova | 09:31 | |
*** cristicalin has quit IRC | 09:31 | |
*** iceyao has joined #openstack-nova | 09:32 | |
*** yamamoto has quit IRC | 09:35 | |
*** jjung has joined #openstack-nova | 09:37 | |
*** dixiaoli_ has quit IRC | 09:37 | |
*** dtantsur|bbl is now known as dtantsur | 09:37 | |
*** hshiina has quit IRC | 09:40 | |
*** sambetts|afk is now known as sambetts | 09:40 | |
*** vishwanathj has quit IRC | 09:43 | |
*** vishwanathj has joined #openstack-nova | 09:43 | |
*** yamamoto has joined #openstack-nova | 09:45 | |
*** yankcrime has quit IRC | 09:45 | |
*** _nick has joined #openstack-nova | 09:46 | |
*** alexchadin has quit IRC | 09:46 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance-live_migration_abort notification https://review.openstack.org/420453 | 09:49 |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance-live_migration_post notification https://review.openstack.org/480119 | 09:49 |
*** damien_r has joined #openstack-nova | 09:52 | |
*** dpawlik has joined #openstack-nova | 09:52 | |
*** tuanluong has quit IRC | 09:52 | |
jangutter | sean-k-mooney, mriedem: sorry for taking so long to respond to your comments, had a priority interrupt this morning. | 09:54 |
*** damien_r1 has quit IRC | 09:54 | |
*** danpawlik has quit IRC | 09:54 | |
*** yassine has quit IRC | 09:55 | |
*** cNilesh has quit IRC | 09:57 | |
jangutter | sean-k-mooney, mriedem: it looks like _get_vif_name seldom returns things in the nic<xxxx> format, the mechanism driver passes "devname" and seems to be running the show there. | 09:58 |
*** thorst has joined #openstack-nova | 09:58 | |
*** iceyao has quit IRC | 10:00 | |
*** chyka has joined #openstack-nova | 10:02 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance-live_migration_post notification https://review.openstack.org/480119 | 10:03 |
*** mvk has joined #openstack-nova | 10:04 | |
*** kiennt has quit IRC | 10:05 | |
*** thorst has quit IRC | 10:06 | |
*** chyka has quit IRC | 10:06 | |
*** thorst has joined #openstack-nova | 10:07 | |
openstackgerrit | Jan Gutter proposed openstack/nova master: Netronome SmartNIC Enablement https://review.openstack.org/483459 | 10:09 |
*** Guest67725 has quit IRC | 10:09 | |
*** sree_ has joined #openstack-nova | 10:10 | |
*** sree_ is now known as Guest7927 | 10:10 | |
*** thorst has quit IRC | 10:11 | |
openstackgerrit | Merged openstack/nova master: Do not import nova.conf into nova/exception.py https://review.openstack.org/485907 | 10:12 |
openstackgerrit | yuanyue proposed openstack/nova master: Add a periodic task to destroy ReqSpecs of deleted instances https://review.openstack.org/484694 | 10:14 |
*** Guest7927 has quit IRC | 10:14 | |
*** markvoelker has joined #openstack-nova | 10:16 | |
*** iceyao has joined #openstack-nova | 10:17 | |
*** esberglu has joined #openstack-nova | 10:17 | |
openstackgerrit | Béla Vancsics proposed openstack/nova master: Transform instance-live_migration_pre notification https://review.openstack.org/482070 | 10:20 |
*** phuongnh has quit IRC | 10:20 | |
*** iceyao has quit IRC | 10:21 | |
*** esberglu has quit IRC | 10:22 | |
*** moshele has quit IRC | 10:23 | |
*** cdent has joined #openstack-nova | 10:28 | |
*** iceyao has joined #openstack-nova | 10:28 | |
*** priteau has quit IRC | 10:28 | |
*** Sara_ has joined #openstack-nova | 10:30 | |
*** udesale has quit IRC | 10:30 | |
Sara_ | Hello all.. I have launched a VM on libvirt compute host..Then I have removed and added the compute host to the cluster | 10:31 |
Sara_ | After joining the cluster, the Vm which was launched previously on that moves to error state.. | 10:32 |
Sara_ | with error: No such file or directory: '/var/lib/nova/instances/2f44884d-9877-4da0-abd2-243979b803b7/disk'", "code": 500, "details": " File \"/usr/lib/python2.7/dist-packages/nova/compute/manager.py\", line 375, in decorated_function | | 10:32 |
Sara_ | For your info, resume_guest_state_on_host_boot is set to false | 10:33 |
openstackgerrit | yuanyue proposed openstack/nova master: Add a periodic task to destroy ReqSpecs of deleted instances https://review.openstack.org/484694 | 10:33 |
Sara_ | Could someone help me out? | 10:33 |
Sara_ | Thanks in advance | 10:33 |
*** iceyao has quit IRC | 10:33 | |
mamandle | bauzas: regarding your comment on https://review.openstack.org/#/c/483911/3, I just responded to that, it was done based on a previous comment from efried. Can you please check? | 10:35 |
*** sapcc-bot1 has quit IRC | 10:36 | |
*** sapcc-bot has joined #openstack-nova | 10:36 | |
mamandle | I can push a new patch for review accordingly. | 10:37 |
*** jaosorior has quit IRC | 10:38 | |
*** baoli has joined #openstack-nova | 10:38 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Raise Exception instead of Exception method call https://review.openstack.org/482200 | 10:44 |
*** clarkb has quit IRC | 10:45 | |
*** clarkb has joined #openstack-nova | 10:45 | |
*** hferenc has quit IRC | 10:47 | |
openstackgerrit | Manas Mandlekar proposed openstack/nova master: Instance remains in migrating state forever https://review.openstack.org/483911 | 10:47 |
*** markvoelker has quit IRC | 10:48 | |
*** mtanino has joined #openstack-nova | 10:53 | |
*** mdnadeem has quit IRC | 10:53 | |
openstackgerrit | Artem Tiumentcev proposed openstack/nova master: Add root and ephemeral disk quota https://review.openstack.org/484390 | 10:55 |
*** iceyao has joined #openstack-nova | 10:55 | |
*** roeyc has joined #openstack-nova | 10:57 | |
*** iceyao has quit IRC | 11:00 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 11:07 |
Sara_ | Hello all.. I have launched a VM on libvirt compute host..Then I have removed and added the compute host to the cluster..After joining the cluster, the Vm which was launched previously on that moves to error state..with error: No such file or directory: '/var/lib/nova/instances/2f44884d-9877-4da0-abd2-243979b803b7/disk'", "code": 500, "details": " File \"/usr/lib/python2.7/dist-packages/nova/compute/manager.py\", line 375, in d | 11:08 |
Sara_ | For your info, resume_guest_state_on_host_boot is set to false.Could someone help me out? | 11:08 |
*** edmondsw has joined #openstack-nova | 11:09 | |
*** acormier has joined #openstack-nova | 11:12 | |
*** yassine has joined #openstack-nova | 11:13 | |
*** gszasz has joined #openstack-nova | 11:13 | |
*** edmondsw has quit IRC | 11:13 | |
*** iceyao has joined #openstack-nova | 11:15 | |
*** jamesdenton has joined #openstack-nova | 11:15 | |
openstackgerrit | Artem Tiumentcev proposed openstack/nova master: Add root and ephemeral disk quota https://review.openstack.org/484390 | 11:16 |
*** acormier has quit IRC | 11:16 | |
*** yufei has quit IRC | 11:17 | |
openstackgerrit | Artem Tiumentcev proposed openstack/python-novaclient master: Add 'local_gb' disk quota support https://review.openstack.org/484391 | 11:19 |
*** jjung has quit IRC | 11:22 | |
*** jamesdenton has quit IRC | 11:22 | |
*** jamesden_ has joined #openstack-nova | 11:22 | |
*** sdague has joined #openstack-nova | 11:25 | |
*** priteau has joined #openstack-nova | 11:25 | |
*** sree has joined #openstack-nova | 11:26 | |
*** mamandle has quit IRC | 11:27 | |
*** saphi has quit IRC | 11:28 | |
*** acormier has joined #openstack-nova | 11:28 | |
*** hferenc has joined #openstack-nova | 11:31 | |
*** sree has quit IRC | 11:31 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 11:31 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 11:34 |
*** damien_r has quit IRC | 11:37 | |
*** damien_r has joined #openstack-nova | 11:37 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 11:39 |
kashyap | assert_called_once_with(*args, **kwargs)¶ | 11:44 |
kashyap | Eurgh, wrong window | 11:44 |
openstackgerrit | Merged openstack/nova master: Translate the return value of attachment_create and _update https://review.openstack.org/486194 | 11:44 |
kashyap | Was copy / pasting it in a different buffer | 11:44 |
*** vishwanathj has quit IRC | 11:45 | |
*** moshele has joined #openstack-nova | 11:45 | |
*** markvoelker has joined #openstack-nova | 11:45 | |
*** vishwanathj has joined #openstack-nova | 11:45 | |
*** gongysh has quit IRC | 11:47 | |
*** smatzek has joined #openstack-nova | 11:50 | |
*** psachin has quit IRC | 11:51 | |
*** lucasagomes is now known as lucas-hungry | 11:52 | |
*** jjung has joined #openstack-nova | 11:55 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: fix test_rebuild_server_exc instability https://review.openstack.org/487382 | 11:56 |
*** mamandle has joined #openstack-nova | 11:57 | |
*** yamamoto has quit IRC | 11:57 | |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Post-migration, set cache value for Cinder volume(s) https://review.openstack.org/485752 | 11:59 |
*** sree has joined #openstack-nova | 12:00 | |
openstackgerrit | Alex Szarka proposed openstack/nova master: Transform instance-live_migration_abort notification https://review.openstack.org/420453 | 12:00 |
*** trinaths has left #openstack-nova | 12:01 | |
*** bkopilov_ has quit IRC | 12:02 | |
*** esberglu has joined #openstack-nova | 12:05 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/477091 | 12:08 |
*** Dinesh_Bhor is now known as Dinesh_Bhor|away | 12:08 | |
openstackgerrit | Radoslav Gerganov proposed openstack/nova master: Add connection pool size to vSphere settings https://review.openstack.org/414085 | 12:08 |
*** esberglu_ has joined #openstack-nova | 12:08 | |
*** Dinesh_Bhor|away is now known as Dinesh_Bhor | 12:09 | |
*** klipka has joined #openstack-nova | 12:09 | |
*** esberglu has quit IRC | 12:10 | |
*** yamamoto has joined #openstack-nova | 12:13 | |
*** edmondsw has joined #openstack-nova | 12:13 | |
*** thorst has joined #openstack-nova | 12:16 | |
*** markvoelker has quit IRC | 12:19 | |
*** chyka has joined #openstack-nova | 12:20 | |
*** catintheroof has joined #openstack-nova | 12:21 | |
*** jamesden_ has quit IRC | 12:23 | |
*** jamesdenton has joined #openstack-nova | 12:23 | |
*** chyka has quit IRC | 12:26 | |
*** mgiles has joined #openstack-nova | 12:26 | |
*** markvoelker has joined #openstack-nova | 12:28 | |
*** liverpooler has joined #openstack-nova | 12:29 | |
*** iceyao has quit IRC | 12:32 | |
*** esberglu_ has quit IRC | 12:32 | |
*** acormier has quit IRC | 12:39 | |
*** ioggstream has joined #openstack-nova | 12:39 | |
ioggstream | hi @all | 12:39 |
*** mriedem has joined #openstack-nova | 12:39 | |
mriedem | o/ | 12:40 |
ioggstream | after a stack update I discovered somebody downsized the flavor disk | 12:40 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: query instance after save to avoid partial update https://review.openstack.org/486561 | 12:40 |
ioggstream | u"Flavor's disk is too small for requested image. Flavor disk is 32212254720 bytes, image is 64424509440 bytes." | 12:41 |
ioggstream | I fixed the flavor and re-updated the stack, but it didn't fix | 12:41 |
ioggstream | one host is "Unavailable console type serial." | 12:42 |
ioggstream | What happens when "Flavor disk is to small?" Nova destroys the disk or just stops? | 12:44 |
*** tbachman has quit IRC | 12:44 | |
ioggstream | is there a way to access the root volumes and get the data? | 12:44 |
*** randomhack has joined #openstack-nova | 12:45 | |
alex_xu | nova api meeting is 14 mins at #openstack-meeting-4 | 12:46 |
openstackgerrit | Chris Dent proposed openstack/nova master: style-only: s/context/ctx/ https://review.openstack.org/485791 | 12:47 |
*** efoley has quit IRC | 12:47 | |
openstackgerrit | Chris Dent proposed openstack/nova master: use os_traits.MISC_SHARES_VIA_AGGREGATE https://review.openstack.org/485792 | 12:47 |
*** tbachman has joined #openstack-nova | 12:48 | |
cdent | mriedem: those ^ two needed a rebase to be aligned with master (which had introduced more ‘context’. there were previously both +W so could you do the honors? | 12:49 |
jangutter | Just enough time to watch https://www.youtube.com/watch?v=1g6QJ5TfA7w before the meeting. Voltron! Assemble! | 12:50 |
*** efoley has joined #openstack-nova | 12:50 | |
*** b3nt_pin is now known as beagles | 12:53 | |
*** pchavva has joined #openstack-nova | 12:53 | |
*** yamamoto has quit IRC | 12:54 | |
*** mtanino has quit IRC | 12:55 | |
*** gmann_ has joined #openstack-nova | 12:55 | |
*** esberglu_ has joined #openstack-nova | 12:56 | |
*** ratailor has quit IRC | 12:57 | |
cdent | thank mriedem | 12:58 |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Move the note about '/os-volume_boot' to the correct place https://review.openstack.org/486071 | 12:58 |
*** esberglu_ has quit IRC | 12:58 | |
*** esberglu_ has joined #openstack-nova | 12:59 | |
*** udesale has joined #openstack-nova | 12:59 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: [WIP] Add support for Windows network commands https://review.openstack.org/487405 | 13:00 |
alex_xu | nova api meeting is running at #openstack-meeting-4 | 13:01 |
*** prateek_ has quit IRC | 13:01 | |
*** iceyao has joined #openstack-nova | 13:01 | |
*** eharney has joined #openstack-nova | 13:02 | |
*** moshele has quit IRC | 13:02 | |
*** moshele has joined #openstack-nova | 13:02 | |
*** jaypipes has joined #openstack-nova | 13:03 | |
*** randomhack has quit IRC | 13:04 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Microversion 2.53 - services and hypervisors using UUIDs https://review.openstack.org/485435 | 13:04 |
gibi | mriedem: hi! I added example error messages to the patch https://review.openstack.org/#/c/428199/ ( | 13:05 |
gibi | mriedem: as we agreed | 13:05 |
*** randomhack has joined #openstack-nova | 13:05 | |
*** lucas-hungry is now known as lucasagomes | 13:05 | |
*** iceyao has quit IRC | 13:06 | |
*** mamandle has quit IRC | 13:07 | |
*** hwoarang has quit IRC | 13:07 | |
moshele | jaypipes , mriedem: hi can you review https://review.openstack.org/#/c/398265/ ? | 13:08 |
*** jwcroppe has quit IRC | 13:08 | |
*** hwoarang has joined #openstack-nova | 13:08 | |
*** yamamoto has joined #openstack-nova | 13:09 | |
*** dave-mccowan has joined #openstack-nova | 13:09 | |
*** awaugama has joined #openstack-nova | 13:11 | |
*** hwoarang_ has joined #openstack-nova | 13:12 | |
*** tylerderosagrund has joined #openstack-nova | 13:12 | |
*** felipemonteiro has joined #openstack-nova | 13:14 | |
*** tbachman has quit IRC | 13:14 | |
*** hwoarang has quit IRC | 13:15 | |
*** dave-mcc_ has joined #openstack-nova | 13:16 | |
*** lyan has joined #openstack-nova | 13:17 | |
openstackgerrit | LIU Yulong proposed openstack/nova master: Enable reset keypair while rebuilding instance https://review.openstack.org/379128 | 13:18 |
*** tbachman has joined #openstack-nova | 13:18 | |
*** dave-mccowan has quit IRC | 13:19 | |
*** iceyao has joined #openstack-nova | 13:24 | |
*** jaosorior has joined #openstack-nova | 13:24 | |
mriedem | gmann_: should this be abandoned? https://review.openstack.org/#/c/451331/ | 13:25 |
mriedem | alex_xu: after the meeting, should this be abandoned? https://review.openstack.org/#/c/458004/ | 13:25 |
*** kylek3h has joined #openstack-nova | 13:28 | |
sdague | mriedem: can you set up whatever tests you were running yesterday on this - https://review.openstack.org/#/c/487246/ | 13:28 |
sdague | that should make things wait for compute service to start correctly | 13:28 |
*** saphi has joined #openstack-nova | 13:29 | |
mriedem | sdague: multinode neutron job should be sufficient to test that | 13:29 |
sdague | mriedem: ok, is that just in neutron experimental queue? | 13:30 |
sdague | or you mean the normal multinode job can see the issue? | 13:30 |
dansmith | mriedem: are we reverting multicell yet? | 13:31 |
mriedem | sdague: normal | 13:31 |
*** jistr is now known as jistr|mtg | 13:31 | |
mriedem | dansmith: i haven't heard of anything | 13:31 |
*** felipemonteiro_ has joined #openstack-nova | 13:32 | |
dansmith | amazing | 13:32 |
mriedem | gibi: ok looks good, i wanted to show you something else first | 13:32 |
sdague | mriedem: ok, I'm not sure what behavior you are looking for, but there are result runs here - https://review.openstack.org/#/c/487246 | 13:32 |
*** dillaman has joined #openstack-nova | 13:32 | |
gibi | mriedem: sure | 13:32 |
mriedem | sdague: yeah i'll look after the api meeting | 13:32 |
*** jjung has quit IRC | 13:34 | |
*** felipemonteiro has quit IRC | 13:35 | |
mriedem | gibi: i was reminded of this testtools matcher yesterday https://review.openstack.org/#/c/486850/6/nova/tests/unit/api/openstack/compute/test_versions.py@303 | 13:36 |
mriedem | self.assertThat(jsonutils.loads(res.body), | 13:36 |
mriedem | matchers.DictMatches(expected)) | 13:36 |
mriedem | which is similar to what you're doin | 13:36 |
mriedem | if it fails, it tells you what the diff is | 13:36 |
mriedem | gibi: so i wonder if we could re-use that | 13:36 |
gibi | mriedem: I can check that out | 13:36 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Migration from ``ip`` commands to ``pyroute2`` https://review.openstack.org/484386 | 13:37 |
gibi | mriedem: I will plug that in to the notification sample test to see if it works and then I will check what it prints when something does not match | 13:38 |
*** egonzalez has left #openstack-nova | 13:39 | |
gmann_ | mriedem: hum, i can do abandon. but i wan to give try to merge schema and code split among files. but for next release | 13:40 |
gmann_ | mriedem: we need to abandon or detach from BP to close BP? | 13:40 |
mriedem | gmann_: no, i just wanted to clean up the review queue for that bp | 13:41 |
*** cleong has joined #openstack-nova | 13:42 | |
mriedem | moshele: is that building into an existing bp? | 13:42 |
mriedem | or something else? | 13:42 |
*** ekuris has quit IRC | 13:43 | |
*** chyka has joined #openstack-nova | 13:43 | |
moshele | mriedem: I just opened neutron RFE | 13:43 |
*** acormier has joined #openstack-nova | 13:43 | |
*** hwoarang_ is now known as hwoarang | 13:44 | |
*** catintheroof has quit IRC | 13:44 | |
gmann_ | mriedem: ok, i will detach that from it. | 13:45 |
*** catintheroof has joined #openstack-nova | 13:46 | |
jaypipes | moshele: done. | 13:46 |
*** chyka has quit IRC | 13:47 | |
*** jistr|mtg is now known as jistr | 13:47 | |
*** catintheroof has quit IRC | 13:48 | |
*** catintheroof has joined #openstack-nova | 13:48 | |
*** awaugama has quit IRC | 13:49 | |
*** catintheroof has quit IRC | 13:51 | |
*** claudiub has quit IRC | 13:51 | |
*** awaugama has joined #openstack-nova | 13:51 | |
*** chyka has joined #openstack-nova | 13:52 | |
kashyap | "recheck pep8" is a thing? | 13:52 |
mriedem | no | 13:52 |
*** catintheroof has joined #openstack-nova | 13:52 | |
*** jwcroppe has joined #openstack-nova | 13:52 | |
mriedem | cdent: sdague: wording nit in https://review.openstack.org/#/c/486623/3/releasenotes/notes/deprecate_wsgi_log_format-43a10b7a608ea8f3.yaml | 13:53 |
cdent | yeah, good point, probably “preferred deployment mode" | 13:53 |
openstackgerrit | Sean Dague proposed openstack/nova master: deprecate ``wsgi_log_format`` config variable https://review.openstack.org/486623 | 13:53 |
sdague | mriedem: done | 13:54 |
*** randomhack has quit IRC | 13:54 | |
*** rcernin has quit IRC | 13:54 | |
kashyap | mriedem: Thanks. Sigh, I made a silly tabs / spaces mistake, and paying the penalty of not running `pep8` locally first on last iteration | 13:54 |
bauzas | mriedem: could you please point me out the super etherpad for reviews ? | 13:55 |
bauzas | I mean, the one for the left BPs | 13:55 |
bauzas | mriedem: yeah I'm lazy and I can find it by myself but hopefully your tab is still open | 13:56 |
*** klipka has quit IRC | 13:56 | |
jangutter | https://etherpad.openstack.org/p/nova-pike-feature-freeze-status | 13:57 |
*** cfriesen has joined #openstack-nova | 13:57 | |
*** mamandle has joined #openstack-nova | 13:58 | |
gmann_ | bauzas: this one - https://etherpad.openstack.org/p/nova-pike-feature-freeze-status | 13:58 |
bauzas | thanks | 13:58 |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Post-migration, set cache value for Cinder volume(s) https://review.openstack.org/485752 | 13:59 |
*** crushil has joined #openstack-nova | 13:59 | |
kashyap | And 'recheck pep8' doesn't fix it, as I botched up indentation. The above should fix it. | 13:59 |
*** armax has joined #openstack-nova | 14:00 | |
*** jjung has joined #openstack-nova | 14:00 | |
*** chyka has quit IRC | 14:00 | |
alex_xu | mriedem: I think I will continue https://review.openstack.org/#/c/458004 after freeze as a bug fix. it just adds a test, it isn't realy part of no more ext BP. | 14:02 |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Merge server create schema for availability zone extension https://review.openstack.org/451331 | 14:03 |
jangutter | sean-k-mooney: you perhaps around to do a (hopefully) final eyeball on https://review.openstack.org/#/c/483459/ ? | 14:04 |
*** gmann_ has quit IRC | 14:05 | |
*** dave-mcc_ has quit IRC | 14:05 | |
vdrok | good morning folks | 14:05 |
gibi | mriedem: it seems replacing JsonEqual with DictMatcher passes the sample tests so this direction looks promising | 14:05 |
gibi | mriedem: I will rework my improvement patch | 14:05 |
vdrok | mriedem: seeing http://logs.openstack.org/88/473888/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ipmitool-tinyipa-multinode-ubuntu-xenial/d56cef7/logs/screen-n-cond-cell1.txt.gz#_Jul_26_11_15_52_052437 again in the multinode job :( I thought the option you've added in the last patchset of devstack change was the workaround for the subnode? | 14:06 |
dansmith | vdrok: jlvillal said you guys had fixed that | 14:10 |
dansmith | vdrok: this: https://review.openstack.org/#/c/477313/ | 14:10 |
dansmith | but I guess that was grenade | 14:10 |
vdrok | dansmith: we did add the nomulticell for grenade. but for the multinode job I thought the fix was https://review.openstack.org/#/c/477556/4..5/lib/nova | 14:11 |
dansmith | vdrok: this? http://logs.openstack.org/88/473888/12/check/gate-tempest-dsvm-ironic-ipa-wholedisk-agent_ipmitool-tinyipa-multinode-ubuntu-xenial/d56cef7/logs/screen-n-cond-cell1.txt.gz#_Jul_26_11_15_52_128079 | 14:11 |
dansmith | vdrok: I don't think so | 14:12 |
*** gouthamr has joined #openstack-nova | 14:12 | |
*** xyang1 has joined #openstack-nova | 14:12 | |
*** mtanino has joined #openstack-nova | 14:12 | |
dansmith | vdrok: you won't get any reschedules with the multicell layout, so if you really hit those in regular gate jobs like this then we need to make you non multicell for now I guess | 14:13 |
dansmith | even in the regular ones | 14:13 |
jangutter | moshel: regarding my comments on https://review.openstack.org/#/c/398265 it's basically nova sending extra data to os-vif, so that in future os-vif can handle representors uniformly. | 14:14 |
vdrok | dansmith: hrm, so this means we need to add some stuff to devstack to check that if virt driver = ironic add the nomulticell everywhere? | 14:14 |
jangutter | moshele: ^^ sorry for misspelling your nick. | 14:15 |
dansmith | vdrok: don't you start nova-compute from your devstack plugin such that you can just set it there? | 14:15 |
vdrok | dansmith: we restart it :) but if it was already configured for multicell it fails. at least it failed when I tried this way | 14:16 |
*** pilgrimstack has joined #openstack-nova | 14:16 | |
vdrok | lemme try to find that patch | 14:16 |
*** randomhack has joined #openstack-nova | 14:17 | |
vdrok | dansmith: here https://review.openstack.org/481114. was tested at https://review.openstack.org/481593 | 14:17 |
moshele | jangutter: Ok, I will update the representor_address | 14:18 |
vdrok | n-cond-cell1 log is still there, and is empty http://logs.openstack.org/93/481593/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-pxe_snmp-tinyipa-ubuntu-xenial-nv/5972121/logs/screen-n-cond-cell1.txt.gz | 14:19 |
dansmith | vdrok: yep | 14:20 |
dansmith | vdrok: give me a sec | 14:21 |
vdrok | sure | 14:21 |
*** udesale has quit IRC | 14:23 | |
*** udesale has joined #openstack-nova | 14:23 | |
*** yamamoto has quit IRC | 14:24 | |
*** pchavva has quit IRC | 14:24 | |
bauzas | mriedem: around ? I'm just reading https://review.openstack.org/#/c/485435/6/novaclient/tests/functional/v2/test_os_services.py@74 and I do wonder if we track somewhere the non-possibility to disable/enable a non-compute service | 14:25 |
bauzas | that's something I missed | 14:25 |
sdague | mriedem: can you check out whatever you were verifying yesterday in https://review.openstack.org/#/c/487246/ ( the wait for service patch ), or at least point me to what I'm looking for | 14:26 |
*** marst has quit IRC | 14:26 | |
bauzas | I do remember you modified the REST API to use a PUT /os-services/ instead of an action and you made it cell-aware, but I don't remember we said to not accept enablement/disablement for internal services but computes | 14:26 |
bauzas | mriedem: nevermind, saw the commit msg in https://review.openstack.org/#/c/464280/ | 14:28 |
dansmith | vdrok: so you can set this variable early enough to make it work right? https://review.openstack.org/487443 | 14:30 |
mriedem | bauzas: https://bugs.launchpad.net/python-novaclient/+bug/1700359/comments/2 | 14:30 |
openstack | Launchpad bug 1700359 in OpenStack Compute (nova) "test_os_service_disable_enable fails with "ERROR (NotFound): Could not find binary nova-scheduler on host"" [Medium,Confirmed] | 14:30 |
mriedem | bauzas: trying to perform actions on non-compute services literally won't work, | 14:31 |
mriedem | because we look up the service in the cell via the host mapping, which only exists for compute services | 14:31 |
bauzas | mriedem: yeah it made sense to me | 14:31 |
*** bkopilov_ has joined #openstack-nova | 14:31 | |
mriedem | i just have the todo to put something in the release notes for it | 14:32 |
bauzas | mriedem: and because we only care about the enable/disable flag by the scheduler only for finding a target | 14:32 |
jaypipes | jangutter: where are you getting the vif_plug_ovs package here? https://github.com/Netronome/agilio-ovs-openstack-plugin/blob/d3f53fd3e6eaaa3d4b5f98978b2f3aa504a7a8cd/vif_plug_agilio_ovs/agilio_ovs.py#L29-L31 | 14:32 |
bauzas | mriedem: given other services and not targets for instances | 14:32 |
jaypipes | jangutter: I don't see os-vif in the list of requirements.txt Python packages. | 14:33 |
jangutter | jaypipes: yep, there's a sizeable set of cleanups still on that repo. | 14:33 |
openstackgerrit | Merged openstack/nova master: Using plain routes for the microversions test https://review.openstack.org/485061 | 14:33 |
dansmith | jaypipes: we're claiming in the scheduler now right? | 14:34 |
dansmith | oh no | 14:35 |
dansmith | nm that one hasn't merged yet | 14:35 |
*** marst has joined #openstack-nova | 14:35 | |
dansmith | jaypipes: hopefully after it does, the ironic people won't have reschedules during their test runs :/ | 14:35 |
jaypipes | dansmith: looking at the -1s on that now. | 14:35 |
cdent | gibi: on https://review.openstack.org/#/c/487327/ I assume the virtenv’s still build correctly before runnin the actual tests? That error message is produced by wsgi-intercept, which gets upset about proxy variables when using the urllib3 interceptor | 14:35 |
vdrok | dansmith: yup, seems like it should help, thanks! we'll have to add it to our base builder in project-config | 14:36 |
dansmith | vdrok: okay, you'll work on that/ | 14:37 |
vdrok | yup | 14:37 |
vdrok | will propose a project-config patch now | 14:37 |
dansmith | vdrok: once we merge the scheduler claiming patch, hopefully you won't get any more reschedules during test runs like this, which will probably be faster anyway | 14:38 |
dansmith | should make your runs faster I mean | 14:38 |
dansmith | probably good to do this devstack variable in the meantime anyway | 14:38 |
*** randomhack has quit IRC | 14:38 | |
vdrok | ++ | 14:38 |
*** kristian__ has joined #openstack-nova | 14:39 | |
mriedem | sdague: question in https://review.openstack.org/#/c/486700/2/nova/tests/fixtures.py | 14:41 |
mriedem | oh dan https://review.openstack.org/#/c/487443/ | 14:44 |
*** esberglu_ has quit IRC | 14:44 | |
dansmith | mriedem: I was rushing | 14:44 |
*** esberglu has joined #openstack-nova | 14:44 | |
sdague | mriedem: looking | 14:45 |
mriedem | why do we have: local nomulticellflag="$1" | 14:45 |
mriedem | in start_nova_compute | 14:45 |
mriedem | nothing passes a variable to that function | 14:45 |
dansmith | mriedem: yes, grenade does | 14:46 |
dansmith | mriedem: and ironic's grenade does | 14:46 |
sdague | mriedem: so what is your concern there? | 14:46 |
mriedem | oh grenade | 14:46 |
mriedem | sdague: was trying to sort out if that's coming from something within nova, since we do use pkg_resources.parse_version, but nowhere near that code | 14:46 |
dansmith | mriedem: jlvillal was struggling with that in o.vo recently too | 14:47 |
sdague | mriedem: stevedore probably | 14:47 |
dansmith | something changed in setuptools I think | 14:47 |
sdague | mriedem: actually, I think it's pbr | 14:50 |
*** sridharg has quit IRC | 14:50 | |
*** vishwanathj has quit IRC | 14:51 | |
*** vishwanathj has joined #openstack-nova | 14:52 | |
sdague | let me see if I can trigger a deeper stack warn to figure out exactly where | 14:52 |
*** cdelatte has joined #openstack-nova | 14:52 | |
*** jjung has quit IRC | 14:56 | |
sdague | dansmith: for https://review.openstack.org/#/c/487443/2/lib/nova why isn't the answer to disable multicell? | 14:58 |
dansmith | sdague: not sure what you mean.. default=True=do setup multiple tiering.. set to false will not do that | 14:59 |
dansmith | maybe my logic needs inverting to make more sense? like disable=True? | 15:00 |
*** roeyc has quit IRC | 15:00 | |
mriedem | note we aren't actually multi-cell yet | 15:00 |
mriedem | we're multi-tier | 15:00 |
dansmith | mriedem: well, you could multi-cell with this, we just don't configure it that way | 15:00 |
mriedem | dansmith: so i can post a WIP to set NOVA_NUM_CELLS=2 and it should work? | 15:01 |
dansmith | mriedem: it should configure multiple cells, but not sure it will work :) | 15:01 |
*** blake has joined #openstack-nova | 15:01 | |
dansmith | mriedem: you need NUM_CELLS=2 and the CELL_INDEX=2 for the third node | 15:01 |
mriedem | could tease out some interesting bugs we don't know about yet | 15:01 |
dansmith | well, I didn't know we had three node jobs until you told me yesterday | 15:02 |
mriedem | where is CELL_INDEX? | 15:02 |
dansmith | I rememberd the name wrong, but it's this: https://github.com/openstack-dev/devstack/blob/master/lib/nova#L66-L68 | 15:02 |
mriedem | couldn't that just be: NOVA_CPU_CELL=${NOVA_CPU_CELL:-$NOVA_NUM_CELLS} ? | 15:03 |
dansmith | I just want to say that I wish we had taken my original suggestion to call cellsv2 something other than cells | 15:03 |
mriedem | are they always the same? | 15:03 |
sdague | ok, I'm trying to figure out a way to explain this in stackrc that isn't going to require poking people in irc. | 15:03 |
dansmith | no, | 15:04 |
dansmith | mriedem: you need it to be different on each node you want to be in a different cell | 15:04 |
mriedem | ah ok | 15:05 |
sdague | so, the fleetify patch creates a conductor per compute. | 15:05 |
sdague | plus the api conductor | 15:05 |
mriedem | conductor per node | 15:05 |
dansmith | condutor per cell | 15:05 |
mriedem | well, | 15:05 |
sdague | right, it's good we're all on the same page :) | 15:05 |
mriedem | not really | 15:05 |
mriedem | dansmith: today the multinode job with this change is 1 cell | 15:05 |
openstackgerrit | Eric Fried proposed openstack/nova master: Add requirement for os-service-types https://review.openstack.org/487471 | 15:05 |
mriedem | there is a cell conductor and super conductor | 15:06 |
mriedem | yeah, | 15:06 |
dansmith | mriedem: it's conductor per cell, plus one super conductor | 15:06 |
sdague | mriedem: right, so 1 compute conductor + 1 api conductor, right ? | 15:06 |
mriedem | and the subnodes talk to the cell conductor | 15:06 |
mriedem | api talks to super conductor | 15:06 |
mriedem | fwiw this is why i wrote a todo to doc this in devstack later | 15:06 |
mriedem | because we have 3 nova confs now and multiple conductors so debugging it is a challenge at first | 15:06 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/487473 | 15:06 |
sdague | so, if we introduced this as CELLSV2_SETUP=allinone | 15:06 |
dansmith | mriedem: trying to help by starting that nova doc with diagrams of course | 15:06 |
mriedem | dansmith: yup | 15:07 |
mriedem | that's higher priority IMO anyway | 15:07 |
sdague | CELLSV2_SETUP=condpercell | 15:07 |
sdague | or something, then we could global switch there? | 15:07 |
dansmith | sdague: if it wasn't for ironic (and grenade) I'd say we don't need a flag | 15:07 |
*** pchavva has joined #openstack-nova | 15:07 | |
sdague | dansmith: sure, ironic is always going to be broken this way? | 15:07 |
dansmith | sdague: and we really don't want people doing the allinone if possible | 15:08 |
dansmith | no | 15:08 |
dansmith | ironic will stop being broken when we get the claims patch in, | 15:08 |
sdague | what's the ironic path fix here? | 15:08 |
dansmith | and when we have proper reschedules (which we've punted at this point) then double fixed | 15:08 |
mriedem | 1. ironic sets the tiered=False flag temporarily in devstack-plugin-ironic, | 15:09 |
mriedem | 2. we land https://review.openstack.org/#/c/483566/ | 15:09 |
mriedem | 3. ironic reverts #1 | 15:09 |
mriedem | right? | 15:09 |
dansmith | technically yes | 15:09 |
dansmith | although since we punted on reschedules, | 15:10 |
cdent | If any core types have gaps between wtf-ing at cellsv2 and claims in the scheduler, there’s a stack of api-ref stuff for placement where at least the first few are ready to go: https://review.openstack.org/#/c/474550/ | 15:10 |
dansmith | I think it's probably a good idea to let people setup devstack in this older configuration for the time being, | 15:10 |
dansmith | because otherwise they can't reschedule | 15:10 |
mriedem | are these ironic multi-node jobs? | 15:10 |
mriedem | or just ironic being multi-node by design | 15:10 |
mriedem | because of the 1:M thing | 15:10 |
dansmith | well, ironic multinode jobs, but not sure if it's multi-compute or just multi-ironic-node | 15:10 |
dansmith | either requires a reschedule, which is the problem | 15:11 |
mriedem | that's a good point about reschedules | 15:11 |
dansmith | mriedem: sdague: you want to hangout to hash this over? | 15:12 |
dansmith | sdague hasn't said anything in a few minutes, may be very confused | 15:12 |
mriedem | i just left a comment that it might be good to mention the reschedule thing, | 15:12 |
mriedem | if you're doing tiered and multiple computes | 15:12 |
bauzas | mriedem: 11 comments in https://review.openstack.org/#/c/485435/6 but only 2 I care | 15:14 |
bauzas | mriedem: tl;dr should we mention in the relnote that nova wouldn't support disabling non-compute services, and why should we having two different representative strings for a service object? | 15:14 |
sdague | dansmith: sorry, I was writing a patch | 15:15 |
sdague | I can do a hangout as well | 15:15 |
sdague | dansmith: I was thinking, change the devstack setup to this https://review.openstack.org/487478 | 15:15 |
*** rajathagasthya has joined #openstack-nova | 15:15 | |
sdague | because as much as I don't like this mode switch, I like it even less if there are 2 different ways to do it | 15:16 |
dansmith | sdague: we have to fix grenade for that first | 15:16 |
sdague | dansmith: yep | 15:16 |
sdague | working on that patch right now | 15:16 |
dansmith | sdague: agreed about the two ways, I was just trying to unbreak the ironic people quickly | 15:16 |
dansmith | vdrok: following? | 15:17 |
vdrok | reading | 15:17 |
*** udesale has quit IRC | 15:17 | |
dansmith | vdrok: basically, sdague hates it when I play with his toys | 15:18 |
*** acormier has quit IRC | 15:18 | |
*** acormier has joined #openstack-nova | 15:18 | |
mriedem | here is the 2-cell goody btw https://review.openstack.org/487479 | 15:19 |
*** tbachman has quit IRC | 15:19 | |
dansmith | mriedem: that's just going to put all the nodes into the same cell again right? | 15:19 |
*** tbachman has joined #openstack-nova | 15:19 | |
dansmith | you need to set CPU_CELL=$node_number or something | 15:20 |
dansmith | this will just end up with an empty cell1, which is cool, but not much different from what we're already doing, AFAICT | 15:20 |
*** felipemonteiro_ has quit IRC | 15:20 | |
vdrok | dansmith: so basically CELLSV2_SETUP=singleconductor instead of NOVA_CELLS_TIER=False? | 15:21 |
dansmith | vdrok: yes | 15:21 |
mriedem | vdrok: yes | 15:21 |
mriedem | dansmith: i'd have to set that from like devstack-gate right? | 15:21 |
dansmith | mriedem: something yeah | 15:21 |
mriedem | since devstack doesn't know which subnode it is | 15:21 |
mriedem | ok | 15:21 |
dansmith | right | 15:21 |
*** rcernin has joined #openstack-nova | 15:21 | |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 15:21 |
openstackgerrit | Jay Pipes proposed openstack/nova master: add a retry on DBDeadlock to _set_allocations() https://review.openstack.org/487483 | 15:21 |
jaypipes | alex_xu, cdent, mriedem, dansmith: ok, added protection against DBDeadlock (separate patch) and cleaned up the one conditional with unit tests that alex_xu pointed out. ^^ | 15:21 |
jaypipes | and rebased to master that cdent wanted... | 15:22 |
dansmith | mriedem: I should have kept quiet and had you be amazed and impressed at no more failures with your patch :P | 15:22 |
*** itlinux has joined #openstack-nova | 15:22 | |
vdrok | mriedem: dansmith hrm, so doing it in devstack/settings won't work? OK, will add to devstack-gate | 15:22 |
cdent | jaypipes: cool, will look asap | 15:22 |
vdrok | smth like https://review.openstack.org/#/c/487458/1/devstack/settings | 15:22 |
*** tbachman_ has joined #openstack-nova | 15:23 | |
*** mamandle has quit IRC | 15:24 | |
mriedem | jaypipes: questions in the bottom change | 15:24 |
*** Sukhdev has joined #openstack-nova | 15:24 | |
*** yamamoto has joined #openstack-nova | 15:24 | |
dansmith | vdrok: I think what you have will work right? | 15:24 |
*** sree has quit IRC | 15:25 | |
dansmith | vdrok: as long as it gets loaded before the other stuff runs | 15:25 |
*** crushil has quit IRC | 15:25 | |
vdrok | dansmith: I think so, yes, it should run before nova | 15:25 |
mriedem | what he has should work, unless we don't go with that patch and instead go with seans | 15:25 |
*** sree has joined #openstack-nova | 15:25 | |
jaypipes | mriedem: answered. | 15:26 |
vdrok | ok, then I'm waiting for your decision for now | 15:26 |
*** gszasz has quit IRC | 15:26 | |
*** tbachman has quit IRC | 15:26 | |
*** tbachman_ is now known as tbachman | 15:26 | |
sdague | mriedem: reved - https://review.openstack.org/487478 | 15:28 |
mriedem | vdrok: like this? http://wac.450f.edgecastcdn.net/80450F/k99.com/files/2013/02/Bachelor-630x419.jpg | 15:28 |
vdrok | :) | 15:28 |
*** jaosorior has quit IRC | 15:28 | |
sdague | honestly, this makes the grenade code make more sense as well (assuming it all works) | 15:29 |
mriedem | so many patches to choose from | 15:29 |
sdague | https://review.openstack.org/#/c/487485/1/projects/60_nova/from-ocata/upgrade-nova | 15:29 |
*** belmoreira has quit IRC | 15:29 | |
*** sree has quit IRC | 15:30 | |
mriedem | jaypipes: "Jesus, you're quick." | 15:31 |
mriedem | you did tell us to review immediately you know :) | 15:31 |
*** acormier has quit IRC | 15:31 | |
*** acormier has joined #openstack-nova | 15:31 | |
efried | jaypipes mriedem johnthetubaguy (mordred) https://review.openstack.org/487471 is in support of bp/use-service-catalog-for-endpoints. Should be the last blocker. | 15:32 |
mriedem | efried: why doesn't that ust go into the change that uses it? | 15:32 |
*** rcernin has quit IRC | 15:34 | |
*** andreas_s has quit IRC | 15:35 | |
*** markus_z has quit IRC | 15:35 | |
*** acormier has quit IRC | 15:36 | |
*** yamamoto has quit IRC | 15:36 | |
*** claudiub has joined #openstack-nova | 15:38 | |
dansmith | vdrok: we're doing sdague's I just mean that approach will work | 15:38 |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 15:39 |
openstackgerrit | Jay Pipes proposed openstack/nova master: add a retry on DBDeadlock to _set_allocations() https://review.openstack.org/487483 | 15:39 |
efried | mriedem Daaahhh, I could do that. | 15:39 |
*** iceyao has quit IRC | 15:39 | |
jaypipes | cdent, mriedem: fixed docstring. sorry, was a copy-paste from the _check_capacity_exceeded() function | 15:39 |
openstackgerrit | Moshe Levi proposed openstack/nova master: hardware offload support for openvswitch https://review.openstack.org/398265 | 15:39 |
jaypipes | cdent: I'd prefer to not sprinkle the retryondeadlock decorator around willy-nilly. prefer to apply it only where needed. | 15:40 |
*** crushil has joined #openstack-nova | 15:40 | |
cdent | jaypipes: that’s the root of my question: how do we know, other than when we get a random boom, that a place needs it? | 15:41 |
*** crushil has quit IRC | 15:41 | |
*** acormier has joined #openstack-nova | 15:41 | |
*** crushil has joined #openstack-nova | 15:41 | |
mriedem | cdent: we don't | 15:42 |
cdent | groovy | 15:42 |
mriedem | but we've tried not to use it if possible within nova | 15:42 |
mriedem | as a crux | 15:42 |
*** crushil has quit IRC | 15:42 | |
*** moshele has quit IRC | 15:43 | |
*** crushil has joined #openstack-nova | 15:43 | |
*** tbachman_ has joined #openstack-nova | 15:43 | |
dansmith | jaypipes: mriedem: I don't love the "gardening" in that dbdeadlock patch | 15:44 |
*** crushil has quit IRC | 15:44 | |
*** chyka has joined #openstack-nova | 15:44 | |
*** acormier has quit IRC | 15:44 | |
*** tbachman has quit IRC | 15:44 | |
*** tbachman_ has quit IRC | 15:44 | |
dansmith | the docstring and dead code removal could be separate.. just seems confusing down the road to have something serious like a dbdeadlock mitigation with some random things | 15:44 |
jaypipes | dansmith: you mean me fixing up the docstring and removing the useless line of code? | 15:44 |
*** crushil has joined #openstack-nova | 15:44 | |
*** chyka has quit IRC | 15:44 | |
jaypipes | dansmith: yeah, I was on the fencer. | 15:44 |
*** acormier has joined #openstack-nova | 15:44 | |
*** tbachman has joined #openstack-nova | 15:45 | |
dansmith | jaypipes: yeah, separate those cleanups from the dbdeadlock thing, IMHO | 15:45 |
jaypipes | ok | 15:45 |
mriedem | bauzas: replied to everything in https://review.openstack.org/#/c/485435/ | 15:45 |
dansmith | jaypipes: I'll oil up my +2ing finger to get ready | 15:45 |
*** crushil has quit IRC | 15:45 | |
mriedem | gross | 15:45 |
*** chyka has joined #openstack-nova | 15:46 | |
*** crushil has joined #openstack-nova | 15:46 | |
*** crushil has quit IRC | 15:47 | |
*** owalsh has quit IRC | 15:47 | |
*** crushil has joined #openstack-nova | 15:47 | |
*** crushil has quit IRC | 15:48 | |
vdrok | dansmith: gotcha, updating | 15:48 |
*** efried has quit IRC | 15:49 | |
*** crushil has joined #openstack-nova | 15:49 | |
*** mvk has quit IRC | 15:49 | |
mriedem | wow crux? | 15:50 |
mriedem | crutch | 15:50 |
*** crushil has quit IRC | 15:50 | |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 15:50 |
openstackgerrit | Jay Pipes proposed openstack/nova master: add a retry on DBDeadlock to _set_allocations() https://review.openstack.org/487483 | 15:50 |
cdent | mriedem: I automagically translated that. I have that functionality built in because otherwise I wouldn’t be able to read myself. | 15:50 |
openstackgerrit | Jay Pipes proposed openstack/nova master: docstring and unused code removal https://review.openstack.org/487492 | 15:50 |
jaypipes | mriedem, dansmith: done | 15:50 |
*** crushil has joined #openstack-nova | 15:50 | |
*** crushil has quit IRC | 15:51 | |
*** yassine has quit IRC | 15:52 | |
dansmith | jaypipes: and done | 15:52 |
*** crushil has joined #openstack-nova | 15:52 | |
*** crushil has quit IRC | 15:53 | |
*** owalsh has joined #openstack-nova | 15:53 | |
sdague | mriedem: you probably just typoed horcrux | 15:53 |
*** crushil has joined #openstack-nova | 15:53 | |
jaypipes | dansmith: and now I'm all oily. thanks a lot. | 15:53 |
dansmith | jaypipes: you know you'd prefer that over the alternative | 15:54 |
openstackgerrit | Chris Dent proposed openstack/nova master: remove un-necessary update() in _init_compute_node of rt https://review.openstack.org/483506 | 15:54 |
openstackgerrit | Chris Friesen proposed openstack/python-novaclient master: match exact hypervisor hostnames where applicable https://review.openstack.org/487494 | 15:54 |
*** crushil has quit IRC | 15:54 | |
sdague | ok, I'm about to walk afk for a bit. https://review.openstack.org/#/c/487478/ hasn't blown up yet. I approved the grenade thing it depends on, because that can't hurt anything. But it's going to be another hour + to get results | 15:55 |
*** Drankis has joined #openstack-nova | 15:55 | |
jaypipes | dansmith: eww. | 15:55 |
jaypipes | :) | 15:55 |
*** armax has quit IRC | 15:56 | |
*** armax has joined #openstack-nova | 15:57 | |
*** iceyao has joined #openstack-nova | 15:58 | |
*** imacdonn_ has quit IRC | 15:59 | |
kashyap | If anyone has a few minutes, a self-containted change that fixes a performance issue post-migration: https://review.openstack.org/#/c/485752/ -- "libvirt: Post-migration, set cache value for Cinder volume(s)" | 15:59 |
*** imacdonn_ has joined #openstack-nova | 15:59 | |
openstackgerrit | Matthew Booth proposed openstack/nova master: Fix scope of errors_out_migration in resize_instance https://review.openstack.org/487495 | 15:59 |
kashyap | Unit tests -- fixed; Jenkins -- succeeds. And the reporter has confirmed the fix resolves the I/O latency issue. | 15:59 |
*** cNilesh has joined #openstack-nova | 16:00 | |
*** efried has joined #openstack-nova | 16:02 | |
bauzas | oh man, I totally missed the IronicHostState.uuid thing | 16:02 |
bauzas | jaypipes: mriedem: I really apologize for having missed ^ that | 16:02 |
*** iceyao has quit IRC | 16:02 | |
*** felipemonteiro has joined #openstack-nova | 16:03 | |
bauzas | and yeah, most of the problems we have with ironic scheduling is because of the fact we have a different hoststate model :( | 16:03 |
bauzas | I knew that but I forgot to tell you | 16:03 |
bauzas | graaah | 16:03 |
*** tristanC has quit IRC | 16:03 | |
*** rcernin has joined #openstack-nova | 16:03 | |
*** Apoorva has joined #openstack-nova | 16:06 | |
*** pilgrimstack has quit IRC | 16:06 | |
jaypipes | bauzas: no worries man | 16:07 |
bauzas | I really loved my vacations | 16:07 |
bauzas | but honestly, it threw me out | 16:07 |
*** itlinux has quit IRC | 16:11 | |
*** felipemonteiro_ has joined #openstack-nova | 16:11 | |
*** felipemonteiro has quit IRC | 16:14 | |
*** harlowja has joined #openstack-nova | 16:15 | |
openstackgerrit | Merged openstack/nova master: style-only: s/context/ctx/ https://review.openstack.org/485791 | 16:15 |
*** Sukhdev_ has joined #openstack-nova | 16:15 | |
*** dtp has joined #openstack-nova | 16:15 | |
openstackgerrit | Merged openstack/nova master: use os_traits.MISC_SHARES_VIA_AGGREGATE https://review.openstack.org/485792 | 16:15 |
openstackgerrit | Merged openstack/nova master: Use _error_out_instance_on_exception in finish_resize https://review.openstack.org/485601 | 16:16 |
*** roeyc has joined #openstack-nova | 16:16 | |
*** tbachman has quit IRC | 16:17 | |
*** dtantsur is now known as dtantsur|afk | 16:17 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Change Service repr to use self.id always https://review.openstack.org/487502 | 16:17 |
openstackgerrit | Merged openstack/nova master: Adjust error msg for ImageNUMATopologyAsymmetric https://review.openstack.org/484634 | 16:17 |
mriedem | bauzas: ^ there you go | 16:17 |
bauzas | jaypipes: please, tell me my concern in https://review.openstack.org/#/c/483566/14 is not valid and we self-heal allocations on compute nodes | 16:17 |
bauzas | jaypipes: I know we do this but on a periodic base | 16:18 |
bauzas | jaypipes: but my question is more about a possible race condition between the time we delete the allocations and the source compute runs again the RT that will self-heal the allocations | 16:19 |
*** jwcroppe has quit IRC | 16:20 | |
jaypipes | bauzas: on call | 16:20 |
jaypipes | gimme few | 16:20 |
bauzas | mriedem: +2d | 16:21 |
bauzas | mriedem: just find another peep :p | 16:21 |
bauzas | oh oops | 16:21 |
bauzas | s/peep/peer | 16:21 |
*** lucasagomes is now known as lucas-afk | 16:23 | |
*** felipemonteiro_ has quit IRC | 16:23 | |
*** felipemonteiro_ has joined #openstack-nova | 16:23 | |
*** mvk has joined #openstack-nova | 16:23 | |
*** Sukhdev_ has quit IRC | 16:24 | |
*** cNilesh has quit IRC | 16:24 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 16:24 |
*** lyan has quit IRC | 16:26 | |
*** felipemonteiro_ has quit IRC | 16:28 | |
*** trinaths has joined #openstack-nova | 16:28 | |
*** Sukhdev_ has joined #openstack-nova | 16:28 | |
bauzas | jaypipes: need to go awol for dinner, but you can ping me later or drop a note if you think I scared for nothing | 16:32 |
jaypipes | bauzas: will do! | 16:32 |
*** trinaths has quit IRC | 16:32 | |
*** armax_ has joined #openstack-nova | 16:33 | |
*** roeyc has quit IRC | 16:35 | |
*** roeyc has joined #openstack-nova | 16:35 | |
*** armax has quit IRC | 16:36 | |
*** armax_ is now known as armax | 16:36 | |
openstackgerrit | Chris Dent proposed openstack/nova master: Optional separate database for placement API https://review.openstack.org/362766 | 16:36 |
*** roeyc has quit IRC | 16:37 | |
*** damien_r has quit IRC | 16:42 | |
*** crushil has joined #openstack-nova | 16:43 | |
*** cdent has quit IRC | 16:46 | |
*** tbachman has joined #openstack-nova | 16:46 | |
*** claudiub has quit IRC | 16:46 | |
openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Be clear about hypevisors.search used in a few CLIs https://review.openstack.org/487513 | 16:47 |
mriedem | cfriesen: dansmith: ^ | 16:47 |
mriedem | that's backportable to stable | 16:47 |
mriedem | changing the behavior of those CLIs is not | 16:47 |
*** tristanC has joined #openstack-nova | 16:48 | |
*** Swami has joined #openstack-nova | 16:49 | |
openstackgerrit | Matthew Booth proposed openstack/nova master: Fix scope of errors_out_migration in resize_instance https://review.openstack.org/487495 | 16:49 |
openstackgerrit | Matthew Booth proposed openstack/nova master: Split Compute.errors_out_migration into a separate contextmanager https://review.openstack.org/485734 | 16:49 |
openstackgerrit | Matthew Booth proposed openstack/nova master: Ensure errors_out_migration errors out migration https://review.openstack.org/479802 | 16:49 |
openstackgerrit | Matthew Booth proposed openstack/nova master: Fix scope of errors_out_migration in finish_resize https://review.openstack.org/487515 | 16:49 |
*** roeyc has joined #openstack-nova | 16:49 | |
*** saphi has quit IRC | 16:51 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 16:51 |
mriedem | sdague: grenade exploded http://logs.openstack.org/85/487485/1/check/gate-grenade-dsvm-neutron-ubuntu-xenial/7ab03fb/logs/grenade.sh.txt.gz#_2017-07-26_15_59_28_974 | 16:51 |
mriedem | but, that's appropriate for a project called 'grenade' i guess | 16:52 |
*** blake has quit IRC | 16:52 | |
cfriesen | mriedem: who approved "host-evacuate-live" anyway? :) | 16:53 |
cfriesen | mriedem: the suggestion to use an fqdn assumes that you have fqdns in your cluster | 16:56 |
mdbooth | cfriesen: That tool's old as the hills, isn't it? | 16:56 |
cfriesen | in ours we just have hostnames "compute-1, compute-10, compute-100, etc" so there is no way to run "host-evacuate" on just compute-1 without changing the novaclient code. | 16:58 |
cfriesen | mdbooth: looks like, yes. really "evacuate" should have been "resurrect" :) | 16:58 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 16:59 |
*** derekh has quit IRC | 16:59 | |
mdbooth | cfriesen: I wrote this a while back, btw: https://gist.github.com/mdbooth/163f5fdf47ab45d7addd | 17:00 |
mdbooth | No idea if it's useful to you, or it still works for that matter :) | 17:00 |
mdbooth | Although I'd hope the latter | 17:00 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 17:01 |
*** roeyc has quit IRC | 17:01 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 17:01 |
*** yamahata has quit IRC | 17:01 | |
cfriesen | mdbooth: we've got our own management component that does something similar. | 17:01 |
mriedem | cfriesen: why wouldn't you have fqdns on the compute hosts? | 17:01 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 17:02 |
mdbooth | cfriesen: Not surprised. Seems like a pretty common thing to want. | 17:02 |
cfriesen | mriedem: no need for them...the computes don't talk to anything outside the cluster and they know the hostname of everything in the cluster. | 17:03 |
*** Sukhdev_ has quit IRC | 17:03 | |
*** ralonsoh has quit IRC | 17:04 | |
*** roeyc has joined #openstack-nova | 17:04 | |
*** roeyc has quit IRC | 17:04 | |
*** itlinux_ has joined #openstack-nova | 17:04 | |
dansmith | cfriesen: except you just said the reason to have them :) | 17:05 |
jangutter | mriedem, jaypipes: sean-k-mooney gave his +1 on https://review.openstack.org/#/c/483459 have I addressed your concerns too? | 17:05 |
mriedem | jangutter: i'll look again after lunch | 17:05 |
cfriesen | dansmith: heh...I've proposed https://review.openstack.org/#/c/487494 which is the proper fix. (Once I add in the error for hostname not found.) | 17:05 |
jangutter | mriedem: thanks! | 17:06 |
dansmith | cfriesen: except that breaks the current, legit behavior | 17:06 |
cfriesen | dansmith: we agreed at the last PTG that the current pattern-match behaviour didn't make sense and should be changed. | 17:07 |
dansmith | we did? | 17:07 |
cfriesen | yep | 17:07 |
* dansmith wonders who "we" is | 17:07 | |
dansmith | if I have compute0001.cellN.foo.com in each cell, I can evacuate them in parallel with no shared infrastructure between them and have no problems | 17:08 |
cfriesen | dansmith: the help text for the cases in question are written as affecting a single host, but they use a pattern match which could affect multiple hosts accidentally | 17:08 |
dansmith | I can't imagine why we wouldn't want a --strict flag to enable that new behavior | 17:08 |
dansmith | but the behavior wins over incorrect docs right? | 17:09 |
*** ftersin has quit IRC | 17:09 | |
cburgess | dansmith I'm not following. I actually didn't know it pattern matches and I'm having a hard time figuring out why you would want that. Can you explain the use case more? | 17:09 |
*** itlinux_ has quit IRC | 17:09 | |
cfriesen | dansmith: from my notes it was on the Friday session at the PTG | 17:09 |
dansmith | cburgess: lets say I'm marching through compute nodes to do upgrades, getting all the instances off each one you're going to upgrade first | 17:10 |
cfriesen | and I think it's counterintuitive that a command called "nova host-evacuate" would affect multiple hosts | 17:10 |
dansmith | cburgess: and you want to do batches, either in parallel across cells or just the first N nodes at a time | 17:10 |
dansmith | cfriesen: I'm not saying it wouldn't have made sense to make it behave that way originally, I just don't see why we should change it instead of offering the option for --strict | 17:11 |
cburgess | dansmith And the argument is the client should enable that rather then the admin just issuing N calls? | 17:11 |
*** itlinux has joined #openstack-nova | 17:11 | |
dansmith | cburgess: this is admin only | 17:11 |
cfriesen | dansmith: if you specify "compute-1 it'll affect compute-1, compute-10 to compute-19, compute-100 to compute-199, etc. | 17:11 |
dansmith | cburgess: you meant the CLI I guess. I'm just saying it _does_ | 17:11 |
dansmith | cfriesen: yeah, I understand how pattern matching works.. hence my example above with not insane compute node hostnames :) | 17:12 |
cburgess | dansmith I'm with cfriesen on this in that its its extremely counter-intuitive to me. But I get what you are saying about its been that way for a long time so we probably need to be careful changing it now and possible use a flag to do that. | 17:12 |
dansmith | cburgess: I'm with you too in saying that it probably shouldn't have been done this way in the beginning, | 17:13 |
dansmith | but it clearly intended to pattern match, so I'm guessing the intent was, you know, to be able to do that :) | 17:13 |
cfriesen | I'm not sure it was intentional...I think it was just fallout of the fact that we don't have a way to look up a single hypervisor by name | 17:14 |
dansmith | and as we always say, the api docs don't matter, the actual behavior is what matters and what people will build dependencies on | 17:14 |
cburgess | dansmith Granted... we call the API directly for this rather then use the CLI because there are other issues around limiting the number of in-flight migrations etc. So this is partially just me saying "That don't make no sense". | 17:14 |
cburgess | dansmith I get it... like I said, mostly be saying "That don't make no sense." But hey... its what we ship. | 17:14 |
dansmith | cburgess: not so much across hosts, which is where the matching is here, and we added the live migration throttle, but yeah agreed | 17:14 |
cburgess | dansmith live migration throttle? | 17:15 |
*** owalsh is now known as owalsh_biab | 17:15 | |
dansmith | cfriesen: if it wasn't intentional, it would have failed if the match was zero or >1, or just taken the first match, but it clearly adds all the resulting hosts, so .. clearly intentional, IMHO | 17:15 |
cfriesen | if we're going to change the docs per mriedem's patch...is it worth me updating to include the --strict hostname matching mode or just leave it as is? | 17:15 |
dansmith | cburgess: yeah you can limit how many migrations in parallel a single host will make | 17:15 |
cburgess | dansmith This is a nova.conf option or API thing... or CLI thing? Sorry a bit slow this morning it seems. | 17:16 |
dansmith | cfriesen: I'm happy with your patch if you make it only do that thing on --strict | 17:16 |
dansmith | cfriesen: or if you want to go down the path of requiring either --strict or --loose and do the major version bump dance | 17:16 |
dansmith | cburgess: yeah, nova-compute conf | 17:16 |
dansmith | cburgess: hold on | 17:16 |
dansmith | cburgess: https://github.com/openstack/nova/blob/master/nova/conf/compute.py#L588-L601 | 17:16 |
dansmith | cburgess: you're welcome :) | 17:16 |
*** armax has quit IRC | 17:16 | |
dansmith | cburgess: we have a build limit too, in case you hadn't seen it | 17:17 |
dansmith | cburgess: to avoid building 20 instances in parallel on a single compute node | 17:17 |
dansmith | s/building/failing to build/ :) | 17:17 |
cburgess | dansmith Interesting... thanks. I will have to read up on this. I vaguely recall some conversation about this several summits ago. | 17:18 |
*** trinaths has joined #openstack-nova | 17:20 | |
dansmith | I feel like this is a 3-coffee day | 17:21 |
*** tylerderosagrund has quit IRC | 17:25 | |
cburgess | dansmith So if I'm reading the code right... the max_concurrent_live_migrations option protects the source hypervisor from having more then 1 migrations at a time but the destination isn't protected at all. Does this jive with your understanding? | 17:30 |
dansmith | cburgess: yep, it's outbound | 17:30 |
dansmith | cburgess: could do the same for inbound, or obey the build counter for inbounds | 17:30 |
dansmith | the reason was, | 17:31 |
dansmith | on host-evac-live, you're necessarily hitting one compute node for outbound, but scheduler could spread the targets out | 17:31 |
dansmith | obviously if you're packing and have an empty host, they'll all want to go to the same place | 17:31 |
*** Apoorva_ has joined #openstack-nova | 17:32 | |
cburgess | dansmith inbound seems like it would be harder... you would have to modify the flow so that the source makes a call to the dest to try and acquire a migration slot or something like that and then keep retrying to get it before it does the migration. Seems like it would be tough to do right an not end up with deadlocks. | 17:32 |
*** sree has joined #openstack-nova | 17:32 | |
*** sshwarts has quit IRC | 17:32 | |
*** coreywright has quit IRC | 17:32 | |
openstackgerrit | Merged openstack/python-novaclient master: Microversion 2.53 - services and hypervisors using UUIDs https://review.openstack.org/485435 | 17:33 |
dansmith | cburgess: ah, yeah I guess because we make a blocking call for live migrate but not for build, fair point | 17:33 |
cburgess | dansmith Yeah... it would be very tricky.. which is a bummer since protecting the dest is something we would want to do as well (we actually try very hard to ensure we never have more then 1 in-coming migration at time in liberty due to some pretty nasty os-brick race conditions). | 17:34 |
*** kristian__ has quit IRC | 17:35 | |
*** Apoorva has quit IRC | 17:35 | |
*** kristian__ has joined #openstack-nova | 17:35 | |
cburgess | dansmith But its good to know about these 2 options. I think we will tune the max_concurrent_builds down some to help with performance. | 17:35 |
dansmith | cburgess: donuts appreciated :P | 17:36 |
*** sree has quit IRC | 17:36 | |
cburgess | dansmith hehe... yeah I didn't do donuts in Boston because mriedem said we wouldn't really have the right setup. I'll look into the donuts making a return in Denver. | 17:36 |
dansmith | cburgess: I'm only joking.. you're way over your donuts requirement quota | 17:37 |
vdrok | dansmith: ouch http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-pxe_ipmitool-postgres-ubuntu-xenial-nv/40fb4fb/logs/devstacklog.txt.gz waiting for hypervisors fail | 17:38 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/487473 | 17:39 |
*** trinaths has quit IRC | 17:39 | |
*** kristian__ has quit IRC | 17:39 | |
vdrok | the variable picked up by nova http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-pxe_ipmitool-postgres-ubuntu-xenial-nv/40fb4fb/logs/devstacklog.txt.gz#_2017-07-26_16_06_41_216 | 17:40 |
dansmith | vdrok: gdi, nothing but bad news from you ever | 17:40 |
vdrok | :D | 17:40 |
dansmith | vdrok: you never just stop by to say hi, always to say someting is broken! :) | 17:40 |
vdrok | I promise to start the next day with 'good morning' to nova channel :) | 17:41 |
cburgess | dansmith You have sent me down a rabbit whole here reading all the options with that link to the code. Its nice to have all the options in one place but man its a bit scary reading some of this stuff. | 17:41 |
mriedem | is there anything i need to care about in the scrollback? | 17:42 |
mriedem | besides chet letting us down on donuts in boston? | 17:42 |
cburgess | mriedem donuts | 17:42 |
cburgess | lol | 17:42 |
dansmith | vdrok: http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-pxe_ipmitool-postgres-ubuntu-xenial-nv/40fb4fb/logs/screen-n-cpu.txt.gz#_Jul_26_16_08_05_910044 | 17:42 |
dansmith | vdrok: looks like it created the compute node... | 17:42 |
vdrok | yup, but for some reason it's not picked up by hypervisor-stats | 17:43 |
*** ioggstream has quit IRC | 17:44 | |
dansmith | vdrok: and never by discover either | 17:44 |
*** coreywright has joined #openstack-nova | 17:45 | |
*** lyan has joined #openstack-nova | 17:46 | |
*** acormier_ has joined #openstack-nova | 17:46 | |
*** harlowja has quit IRC | 17:46 | |
*** rajathagasthya has quit IRC | 17:46 | |
*** rajathagasthya has joined #openstack-nova | 17:47 | |
dansmith | vdrok: okay I think this might be because this hack was for grenade and it's not complete enough for a fresh install | 17:47 |
dansmith | vdrok: I think we're pointing at super-conductor (which we want) but it's configured to point at cell0 (which we do not) | 17:48 |
dansmith | vdrok: so give me a few to mull this over | 17:48 |
openstackgerrit | Jackie Truong proposed openstack/nova master: Add trusted certificates to InstanceExtras https://review.openstack.org/457711 | 17:49 |
*** acormier has quit IRC | 17:49 | |
*** kbaegis has joined #openstack-nova | 17:50 | |
*** armax has joined #openstack-nova | 17:52 | |
dansmith | vdrok: updated the devstack change | 17:56 |
*** sambetts is now known as sambetts|afk | 17:57 | |
vdrok | dansmith: thanks! will come back if it fails again :D | 17:57 |
vdrok | good night | 17:57 |
dansmith | vdrok: o/ | 17:58 |
*** prateek_ has joined #openstack-nova | 17:58 | |
*** Apoorva_ has quit IRC | 18:04 | |
*** cdent has joined #openstack-nova | 18:04 | |
*** Apoorva has joined #openstack-nova | 18:04 | |
*** yamamoto has joined #openstack-nova | 18:09 | |
*** yamamoto has quit IRC | 18:13 | |
*** kristian__ has joined #openstack-nova | 18:14 | |
*** sdague has quit IRC | 18:16 | |
*** cdent has quit IRC | 18:16 | |
*** acormier_ has quit IRC | 18:17 | |
*** acormier has joined #openstack-nova | 18:17 | |
*** yamahata has joined #openstack-nova | 18:19 | |
*** kristian__ has quit IRC | 18:19 | |
*** ioggstream has joined #openstack-nova | 18:19 | |
*** eharney has quit IRC | 18:23 | |
*** acormier has quit IRC | 18:25 | |
*** acormier has joined #openstack-nova | 18:25 | |
*** Sukhdev_ has joined #openstack-nova | 18:28 | |
*** acormier has quit IRC | 18:30 | |
*** kristian__ has joined #openstack-nova | 18:30 | |
mriedem | jangutter: really only nits in the release note now https://review.openstack.org/#/c/483459/ | 18:30 |
mriedem | but see what you think | 18:30 |
jangutter | mriedem: I'm working on getting our docs cleared for general release on our support site. Currently customers should have subscriptions, but they should be generally available by the time Pike gets released. | 18:32 |
jangutter | mriedem: should I respin and remove the soon? | 18:33 |
*** eharney has joined #openstack-nova | 18:34 | |
*** sdague has joined #openstack-nova | 18:37 | |
*** yamahata has quit IRC | 18:37 | |
*** baoli has quit IRC | 18:40 | |
*** baoli has joined #openstack-nova | 18:41 | |
*** sgordon has quit IRC | 18:41 | |
sdague | dansmith: your cell1 db change didn't work | 18:47 |
jaypipes | bauzas: answered. sorry, went to lunch | 18:47 |
sdague | https://review.openstack.org/#/c/487478 | 18:48 |
sdague | dansmith: is there a reason you changed that? | 18:49 |
*** yamahata has joined #openstack-nova | 18:53 | |
dansmith | sdague: didn't work how? but yes, we need to make that change | 19:01 |
dansmith | sdague: remember this was just a grenade hack, which meant conductor and other services were still configured to point at the cell db, not cell0 | 19:01 |
dansmith | on fresh with this they're configured wrong now | 19:02 |
bauzas | jaypipes: just reading your comment | 19:02 |
dansmith | sdague: didn't want to ask before pushing over top eh? | 19:02 |
bauzas | jaypipes: I'm a bit in and out till' 9pm my time but will think of your comment | 19:02 |
sdague | dansmith: I did, all the tests failed | 19:02 |
*** dave-mccowan has joined #openstack-nova | 19:02 | |
bauzas | oops 9.30pm | 19:02 |
sdague | cell1 db does not exist | 19:02 |
sdague | dansmith: http://logs.openstack.org/78/487478/4/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/69e2d2e/ | 19:03 |
dansmith | sdague: nova_cell1 should be created on L693 | 19:03 |
sdague | so given that jenkins -1ed that version of the patch I figured it was fine to run it the old way | 19:03 |
sdague | dansmith: well, it failed pretty hard | 19:03 |
openstackgerrit | Jan Gutter proposed openstack/nova master: Netronome SmartNIC Enablement https://review.openstack.org/483459 | 19:03 |
dansmith | it won't actually work without it, and the ironic people found it before jenkins | 19:04 |
sdague | dansmith: ok, but it doesn't pass with it | 19:04 |
*** dave-mccowan has quit IRC | 19:04 | |
dansmith | I get it, but we need to make the change | 19:05 |
sdague | http://logs.openstack.org/78/487478/4/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/69e2d2e/logs/devstacklog.txt.gz#_2017-07-26_18_12_02_728 | 19:05 |
sdague | dansmith: that's fine, you need to help me figure out what other thing is also needed for that change to work | 19:05 |
dansmith | I'm doing it now | 19:05 |
*** nicolasbock has quit IRC | 19:06 | |
dansmith | oh it's failing on the sync before we create it.. I wonder why that's different now | 19:07 |
sdague | because this function is creating the top level nova.conf | 19:09 |
sdague | https://github.com/openstack-dev/devstack/blob/62edb2f0f64bf4ac2c75e9bbfffbad5aac5ad41c/lib/nova#L671-L680 | 19:10 |
sdague | the cell1 db is not created before the sync | 19:10 |
sdague | for the top level | 19:10 |
dansmith | right, because now that points to cell0 always in the toplevel and it's created already | 19:11 |
sdague | yes | 19:11 |
dansmith | so I switched the order of those things which I think will be fine for both cases | 19:12 |
*** jamiec has quit IRC | 19:12 | |
*** vishwanathj has quit IRC | 19:14 | |
sdague | ok, if that works, good enough | 19:14 |
*** vishwanathj has joined #openstack-nova | 19:14 | |
*** owalsh_biab is now known as owalsh | 19:19 | |
*** jamiec has joined #openstack-nova | 19:19 | |
*** acormier has joined #openstack-nova | 19:20 | |
*** harlowja has joined #openstack-nova | 19:21 | |
sdague | dansmith: thanks for the grenade patch fix, I should put a safety wrapper around that for things that only need to set variables | 19:21 |
dansmith | sdague: np | 19:22 |
*** acormier has quit IRC | 19:25 | |
*** harlowja has quit IRC | 19:25 | |
*** rcernin has quit IRC | 19:27 | |
*** ioggstream has quit IRC | 19:29 | |
openstackgerrit | Sean Dague proposed openstack/nova master: Remove the useless fake ExtensionManager from API unittests https://review.openstack.org/486416 | 19:33 |
openstackgerrit | Sean Dague proposed openstack/nova master: Move the note about '/os-volume_boot' to the correct place https://review.openstack.org/486071 | 19:33 |
*** randomhack has joined #openstack-nova | 19:35 | |
*** awaugama has quit IRC | 19:35 | |
mriedem | jangutter: +2, just need jaypipes to +W now | 19:37 |
jangutter | mriedem: I sincerely owe you guys. Thanks! | 19:38 |
*** acormier has joined #openstack-nova | 19:39 | |
*** randomhack has quit IRC | 19:40 | |
*** prateek_ has quit IRC | 19:40 | |
*** dtp has quit IRC | 19:52 | |
*** sgordon has joined #openstack-nova | 19:52 | |
bauzas | jaypipes: so I'm back | 19:52 |
jaypipes | bauzas: from outer space? | 19:52 |
bauzas | jaypipes: heh, just from my backyard :p | 19:53 |
* bauzas was just taking some tomatoes from his garden :p | 19:53 | |
bauzas | anyway | 19:54 |
bauzas | so I saw your comment | 19:54 |
bauzas | jaypipes: (and others) https://review.openstack.org/#/c/483566/14/nova/scheduler/filter_scheduler.py@170 | 19:54 |
bauzas | so, yeah, we have a self-heal by the RT.update_available_resource(), sure, agreed | 19:55 |
bauzas | but the problem I thought was about the fact that it's only running every 60 secs by default | 19:55 |
bauzas | so we could be having a race between the time we deleted the allocations from the source host, and when the source RT is again running update_a_r() | 19:56 |
bauzas | like, we could possibly accept other instances for this host even if it's not possible | 19:57 |
bauzas | or we could possibly accept some nested RPs to be used (like SRVIO VFs) meanwhime | 19:57 |
bauzas | jaypipes: so, I was thinking, should we maybe just get the original allocations from the source host before deleting them, so that if we have problems in the scheduler, we could put them again ? | 19:58 |
bauzas | jaypipes: something like _cleanup_allocations() would return for example | 19:59 |
bauzas | that said, given how we're close to FF, I wonder if it's possible | 19:59 |
bauzas | that's it for me. | 20:00 |
bauzas | :p | 20:00 |
bauzas | roger, roger. | 20:00 |
dansmith | bauzas: see my comment in there just now | 20:00 |
dansmith | mriedem: melwitt: I'm like quad booked for shit all day.. given where we are, do we have things to discuss for cells or should we put the meeting. I think we're down to the devstack stuff and placement related bits at this point | 20:01 |
dansmith | but if we have things, we can still do it | 20:01 |
melwitt | don't think we have to have a meeting but I was just gonna say the console stuff is still up and passing jenkins. I have a devstack change up that Depends-On the stack and runs console proxies per cell and that works too | 20:02 |
bauzas | dansmith: looking | 20:02 |
dansmith | melwitt: orly, okay, I should go look at that | 20:03 |
bauzas | melwitt: dansmith: mriedem: if you need me reviewing things before pike-3 for cells v2, just lemme know | 20:03 |
dansmith | if mriedem agrees, hopefully we just had our meeting | 20:03 |
dansmith | bauzas: console stuff | 20:03 |
bauzas | ok | 20:03 |
*** liverpooler has quit IRC | 20:03 | |
melwitt | CONSOLEZ. I'm about to update it to redact tokens in the debug logs but other than that, it's been ready. mostly unchanged from when PaulMurray was working on it | 20:04 |
mriedem | ok to ditch the meeting | 20:04 |
*** Sukhdev_ has quit IRC | 20:05 | |
mriedem | what do we lose if we don't have the console proxy stuff done? | 20:05 |
mriedem | because < 24 hours is tough for something that hasn't had review yet | 20:05 |
*** acormier has quit IRC | 20:05 | |
*** acormier has joined #openstack-nova | 20:06 | |
melwitt | mriedem: I think just inability to shard console proxies. current state is the token auth cache and proxies are global. the console stuff moves token auth storage to the cell databases and then shards proxies, one per cell | 20:07 |
melwitt | and starts on the deprecation timer on eliminating the consoleauth service | 20:07 |
bauzas | dansmith: looks good for me with the plan | 20:09 |
dansmith | sounds like a good candidate to punt then | 20:09 |
dansmith | bauzas: ack | 20:09 |
*** _pewp_ has quit IRC | 20:09 | |
bauzas | dansmith: I was just thinking of restoring the original allocation but honestly having both allocations for the source and destination hosts make more sense in terms of "resource usage" | 20:09 |
bauzas | because when you wanna move, you need to make sure you have double room | 20:10 |
bauzas | until the move is done | 20:10 |
melwitt | dansmith: yeah. I think the main concern I had was if a change in deployment topology being out-of-sync with the rest of the multicell changes, but I think based on our current state, superconductor isn't going to be a thing yet, right? | 20:10 |
*** Sukhdev has quit IRC | 20:10 | |
*** marst_ has joined #openstack-nova | 20:10 | |
*** acormier has quit IRC | 20:10 | |
*** acormier has joined #openstack-nova | 20:11 | |
*** marst has quit IRC | 20:11 | |
dansmith | melwitt: it is, merged in devstack now.. not sure I get the relation | 20:11 |
dansmith | melwitt: or you mean a change in deployment from pike->queens? | 20:11 |
melwitt | or rather, I don't know what the current state of multicell is in regard to what we will document for users. I think I asked the question on the etherpad, what does multi-tier mean vs multi-cell? | 20:11 |
dansmith | no difference, I just used the term once to mean something specific and someone started saying it I think | 20:12 |
melwitt | like, when we will have the communication of "you'll need to change your deployment of services like this" I was thinking it might be less confusing if the console proxy run location changes coincided with that | 20:12 |
dansmith | the only people affected by such a change would be people that would split out a cell in pike, and then upgrade to queens I think | 20:12 |
melwitt | instead of letting someone get started with multicell and global console proxies and then in another release saying, "oh yeah, go back and change what you already deployed" | 20:13 |
dansmith | and anyone that does that won't have reschedules and affinity checks in pike anyway | 20:13 |
*** cfriesen_ has joined #openstack-nova | 20:13 | |
dansmith | yeah, so that'd be the only concern I think | 20:13 |
melwitt | right | 20:13 |
dansmith | I think that the migration wouldn't be bad though, | 20:13 |
*** pchavva has quit IRC | 20:13 | |
*** _pewp_ has joined #openstack-nova | 20:14 | |
dansmith | because you can just start up console in the cell prior to the upgrade and it won't do anything until after things roll | 20:14 |
dansmith | up to mriedem to decide which he thinks is less problematic/risky | 20:14 |
dansmith | merging early, or documenting that change to the people that actually split a cell in pike | 20:14 |
melwitt | yeah, I guess not. it would be like, stand up console proxies per cell and have to leave the global ones running too until no outstanding tokens are using them anymore | 20:14 |
dansmith | well, as I've said, | 20:14 |
dansmith | I don't think that resetting tokens is a big deal | 20:14 |
dansmith | you just don't want to have a time where you can't get new tokens | 20:15 |
openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_service_url() https://review.openstack.org/458257 | 20:15 |
melwitt | yeah, true | 20:15 |
efried | mriedem jaypipes johnthetubaguy (mordred) ^ | 20:15 |
mordred | efried: woot! | 20:16 |
efried | May need a little help making sure I find all the right places that need to be touched for the followup (other places in nova that talk to endpoints) | 20:16 |
*** cfriesen has quit IRC | 20:17 | |
bauzas | mriedem: jangutter: I have a concern with https://review.openstack.org/#/c/483459/17 | 20:17 |
efried | mordred The difference in ksa usage is dissapointingly tiny in proportion to the amount of ksa work done :) | 20:17 |
*** acormier has quit IRC | 20:17 | |
efried | mordred But os-service-types is gold | 20:17 |
bauzas | mriedem: jangutter: AFAICT, it's depending on an os-vif change, right? | 20:17 |
mordred | efried: you're setting ks_adapter.interface to a list in utils - isn't there some way to set a conf default or something? | 20:17 |
mriedem | bauzas: which is already merged and released | 20:17 |
mordred | efried: woot! | 20:17 |
jangutter | bauzas: correct | 20:18 |
*** acormier has joined #openstack-nova | 20:18 | |
bauzas | mriedem: oh nevermind, just saw it | 20:18 |
efried | mordred The conf options come directly from ksa. | 20:18 |
* mordred doens't know as much about oslo.config so it's also possible that that's not possible | 20:18 | |
bauzas | mriedem: I thought we didn't released it | 20:18 |
*** cfriesen_ has quit IRC | 20:18 | |
mordred | yah- I thought there was maybe some way to set/override the deafult value for one of them or something | 20:18 |
efried | mordred Mm, not sure about that. Doug would probably know. | 20:19 |
jangutter | bauzas: yeah, it snuck in right as the door closed. | 20:19 |
efried | mordred Not completely sure we would want to do that, exactly. | 20:19 |
mordred | efried: nod | 20:19 |
bauzas | jangutter: happy for you | 20:19 |
efried | I guess I can see the advantage for automatic conf generation or something. | 20:19 |
*** cdent has joined #openstack-nova | 20:19 | |
openstackgerrit | melanie witt proposed openstack/nova master: Add periodic task to clean expired console tokens https://review.openstack.org/325381 | 20:20 |
openstackgerrit | melanie witt proposed openstack/nova master: Use ConsoleConnection object to generate authorizations https://review.openstack.org/325414 | 20:20 |
openstackgerrit | melanie witt proposed openstack/nova master: Add console connection object https://review.openstack.org/320063 | 20:20 |
openstackgerrit | melanie witt proposed openstack/nova master: Add access_url_base to console_auth_tokens table https://review.openstack.org/334614 | 20:20 |
openstackgerrit | melanie witt proposed openstack/nova master: Convert websocketproxy to use db for token validation https://review.openstack.org/333990 | 20:20 |
openstackgerrit | melanie witt proposed openstack/nova master: Add console_auth_token_get() method to DB API https://review.openstack.org/481700 | 20:20 |
jangutter | bauzas: thanks, I owe the gang some serious drinks. | 20:20 |
mriedem | melwitt: so i think to summarize the statement for multi-cell in pike, is cern will be ok with it since they don't do build retries anyway, but if you rely on retries then you shouldn't do multi-cell in pike, since we don't have the alternatives stuff done | 20:21 |
mriedem | or if you rely on server group affinity/anti-affinity since the computes and cell conductors can't hit the scheduler or api db | 20:22 |
mriedem | dansmith: ^ keep me honest on that 2nd one | 20:22 |
melwitt | yeah, that makes sense. I just wasn't sure what the difference between multi-tier and multi-cell was but if they're synonyms then I think I understand the state | 20:23 |
openstackgerrit | Merged openstack/python-novaclient master: Change Service repr to use self.id always https://review.openstack.org/487502 | 20:23 |
bauzas | mriedem: dansmith: melwitt: correct me if I'm wrong but you can multi-cell and retry if you are able to upcall ? | 20:23 |
bauzas | the only problem is when you usually isolate your MQs | 20:24 |
*** armax has quit IRC | 20:24 | |
mriedem | melwitt: multi-tier to me is superconductor, and it's not really worth doing multi-cell if you can't do multi-tier with superconductor, because then your cells are all going to be blasting to every other cell conductor - which breaks a bunch of stuff | 20:25 |
mriedem | dan mentioned this on a hangout yesterday with me and jay | 20:25 |
*** gouthamr has quit IRC | 20:26 | |
mriedem | well there is no cell conductor, | 20:26 |
mriedem | there is just conductor | 20:26 |
melwitt | okay. does that mean we're going to document a multi-cell deployment with no superconductor? I was thinking not | 20:26 |
melwitt | i.e. multi-cell also means multi-tier to us | 20:26 |
mriedem | i'm not sure what the advantage of multi-cell w/o superconductor would be if you're sharing MQ everywhere | 20:27 |
*** gouthamr has joined #openstack-nova | 20:27 | |
melwitt | what I'm trying to say is, we're in the position of presenting the deployment options in our docs, so are we going to leave out the "multi-cell w/o superconductor" from that? I was thinking so, else it becomes needlessly confusing | 20:28 |
mriedem | i think we definitely need to document what we're recommending for the deployment, and what the limitations are in pike | 20:28 |
*** gbarros has joined #openstack-nova | 20:28 | |
mriedem | so if you can't live with the limitations in pike, then don't do multi-cell | 20:28 |
melwitt | because AFAICT, multi-cell without superconductor isn't really supposed to be a thing | 20:28 |
*** sree_ has joined #openstack-nova | 20:30 | |
cdent | edleafe: | 20:30 |
mriedem | probably need to hash it out with dan when he's got some time | 20:30 |
mriedem | since this always makes me go in circles | 20:30 |
*** sree_ is now known as Guest74472 | 20:31 | |
cdent | nm | 20:31 |
melwitt | yeah. it just doesn't sound like something we should document and thus recommend | 20:31 |
*** raunak has joined #openstack-nova | 20:31 | |
melwitt | document the recommended deployment alongside its limitations | 20:31 |
melwitt | one for single cell and one for multicell | 20:32 |
sdague | jlvillal / vdrok ironic is still failing after the devstack change, on the hypervisor count never exceeding 0 | 20:34 |
sdague | is that the same issue you were dealing with, or a different one | 20:34 |
sdague | http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/ | 20:34 |
*** Guest74472 has quit IRC | 20:35 | |
jlvillal | sdague: I'll be honest and admit I don't know what exactly is going on. vdrok has been driving this issue. | 20:36 |
jlvillal | sdague: And it is 23:36 at night where he is... | 20:37 |
bauzas | jangutter: question, are we 100% sure the VIF object we're getting is always having a profile information if it's an Agilio VNIC type ? https://review.openstack.org/#/c/483459/17/nova/network/os_vif_util.py@319 | 20:37 |
bauzas | jangutter: I think it's a reasonable assumption but I want to be sure we're not getting a stupid KeyError exception | 20:37 |
jangutter | bauzas: It should, or the claim would fail earlier. The only two VNIC types we use are in the SR-IOV list. | 20:38 |
*** randomhack has joined #openstack-nova | 20:38 | |
*** Drankis has quit IRC | 20:39 | |
*** smatzek has quit IRC | 20:40 | |
sdague | jlvillal: ok, the test results hadn't returned yet, so I just figured I'd give an early heads up | 20:40 |
jlvillal | sdague: Thanks, doesn't look like the test job likes those changes. Based on all the failures | 20:40 |
sdague | we're about 17 minutes away from the devstack patch passing | 20:40 |
*** tojuvone__ has quit IRC | 20:41 | |
jlvillal | Ugh | 20:41 |
sdague | jlvillal: yeh, I don't know what the previous issue was actually | 20:41 |
*** tojuvone__ has joined #openstack-nova | 20:41 | |
*** kristian__ has quit IRC | 20:41 | |
*** kristian__ has joined #openstack-nova | 20:42 | |
jlvillal | sdague: I'm telling people about it over in #openstack-ironic. Reaction not so good ;) | 20:42 |
*** randomhack has quit IRC | 20:44 | |
*** cfriesen_ has joined #openstack-nova | 20:44 | |
dansmith | sdague: jlvillal that's the one yeah | 20:44 |
dansmith | jlvillal: for the record, I did ask a week ago and things were good in ironic land dependent on the change :) | 20:44 |
jlvillal | dansmith: I thought we tested it before and it worked. | 20:45 |
* jlvillal confused | 20:45 | |
sdague | dansmith: http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/logs/devstacklog.txt.gz#_2017-07-26_19_51_43_735 | 20:45 |
dansmith | jlvillal: that's what was reported yeah, but it turns out that was only the grenade one not the multinode regular job | 20:45 |
sdague | any idea why nova might not register resources in the new patch? | 20:45 |
catintheroof | Hi, does anyone has a good guide on how to configure live migration on ocata ? doing the same that worked as of mitaka, doesnt anymore | 20:46 |
dansmith | yes, there's a dependent one that you need | 20:46 |
dansmith | hang on | 20:46 |
jlvillal | sdague: So what patch is about to land? And is that what will cause ironic to break? | 20:46 |
jangutter | bauzas: I got this from the scheduler: Insufficient compute resources: Requested instance NUMA topology together with requested PCI devices cannot fit the given host NUMA topology; Claim pci failed. _phew_ | 20:46 |
*** kristian__ has quit IRC | 20:46 | |
*** slagle has quit IRC | 20:46 | |
dansmith | https://review.openstack.org/#/c/487458/ | 20:46 |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Set Adapter interface defaults in conf https://review.openstack.org/487581 | 20:47 |
dansmith | oh | 20:47 |
dansmith | your run is from that | 20:47 |
jlvillal | yeah] | 20:47 |
*** slagle has joined #openstack-nova | 20:47 | |
dansmith | yeah let me look through a sec hang on | 20:47 |
sdague | http://logs.openstack.org/58/487458/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial/01e5dfe/logs/screen-n-cpu.txt.gz#_Jul_26_19_40_24_440198 that doesn't look good | 20:47 |
jlvillal | +1 on not looking good | 20:48 |
mriedem | that's the flavor migrate stuff i think | 20:49 |
dansmith | nova.conf is still pointing at cell0 | 20:49 |
mriedem | https://review.openstack.org/#/c/484949/ | 20:49 |
mriedem | yup, also shows up in n-cpu logs in the ironic job on that nova change http://logs.openstack.org/49/484949/14/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/69b18d7/logs/screen-n-cpu.txt.gz?level=TRACE | 20:50 |
mriedem | edleafe: ^ | 20:50 |
mriedem | so a different problem | 20:50 |
*** thorst has quit IRC | 20:50 | |
dansmith | oh, | 20:50 |
dansmith | the logic is reversed | 20:50 |
sdague | dansmith: oh, ok, that's hopeful | 20:51 |
sdague | so it just needs to be the other way around? | 20:51 |
dansmith | yeah | 20:52 |
dansmith | pushed a change and rechecked | 20:52 |
dansmith | yeah | 20:52 |
dansmith | because I was still in inverted flag mode in my brain head | 20:52 |
dansmith | jlvillal: ^ | 20:52 |
jlvillal | dansmith: Thanks! | 20:52 |
mriedem | sdague: shouldn't we see https://review.openstack.org/#/c/487458/ pass before approving the devstack change? | 20:53 |
sdague | dansmith: ok, I pre +Aed your new change. I'm going to be dropping off shortly for the day | 20:53 |
dansmith | okay | 20:54 |
sdague | mriedem: maybe, the question is whether anyone will be around to do that. | 20:54 |
mriedem | i guess we can proxy to mtreinish | 20:54 |
sdague | so, I can do this thing, and assuming life is good, it goes in. | 20:54 |
mriedem | yeah otherwise we'll bug mtreinish | 20:54 |
sdague | if things suck, just hit the rebase button | 20:54 |
sdague | to prevent it from landing | 20:54 |
dansmith | sdague: you can throw one of us on devstack core and pinky swear not to do anything else | 20:54 |
sdague | if anyone else wants to be devstack core, I'll sign you right up :) | 20:55 |
dansmith | haha | 20:55 |
mriedem | not it | 20:55 |
sdague | honestly mriedem if you want that bit you can have it | 20:55 |
sdague | you poke enough there | 20:55 |
dansmith | sounds less glamorous when you put it that way | 20:55 |
jlvillal | +1 for more devstack cores :) | 20:55 |
mriedem | here is the bug for the 500 on n-cpu startup with ironic https://bugs.launchpad.net/nova/+bug/1706772 | 20:58 |
openstack | Launchpad bug 1706772 in OpenStack Compute (nova) "InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver" [High,Confirmed] | 20:58 |
*** catintheroof has quit IRC | 21:01 | |
*** gbarros has quit IRC | 21:02 | |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 21:03 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 21:03 |
jaypipes | dansmith, bauzas, mriedem: ^^ | 21:04 |
mriedem | looking | 21:05 |
*** esberglu has quit IRC | 21:05 | |
*** acormier has quit IRC | 21:05 | |
*** acormier has joined #openstack-nova | 21:06 | |
mtreinish | mriedem: you need me to review something? | 21:08 |
melwitt | mriedem: do we not need a spec for adding new policy rules? I would have thought we do https://review.openstack.org/#/c/449288 | 21:08 |
mtreinish | I was just sitting in a corner inhaling lead fumes, but I can take a break from that | 21:09 |
melwitt | lol | 21:09 |
mriedem | mtreinish: not yet | 21:09 |
*** tojuvone__ has quit IRC | 21:09 | |
jaypipes | mtreinish: nice. :) | 21:10 |
mriedem | melwitt: it's not an api change so i don't think a spec is neeed | 21:10 |
mriedem | *needed | 21:10 |
*** tojuvone__ has joined #openstack-nova | 21:10 | |
mriedem | melwitt: plus i think we did one or more of these same granularity policy things in ocata, | 21:10 |
melwitt | mriedem: okay, cool. thanks, I learned a thing | 21:10 |
mriedem | the key is it must be backward compatible with an existing policy json i think | 21:10 |
*** acormier has quit IRC | 21:10 | |
mriedem | so an operator would need to opt into the more granular rules | 21:10 |
melwitt | right. I think they are taking care of that in the patch | 21:11 |
melwitt | cool | 21:11 |
*** priteau has quit IRC | 21:15 | |
openstackgerrit | melanie witt proposed openstack/nova master: deprecate ``wsgi_log_format`` config variable https://review.openstack.org/486623 | 21:15 |
*** yamamoto_ has joined #openstack-nova | 21:19 | |
*** yamamoto_ has quit IRC | 21:21 | |
*** efoley has quit IRC | 21:24 | |
bauzas | jaypipes: just a question about https://review.openstack.org/#/c/487589/1/nova/scheduler/client/report.py | 21:24 |
*** cdent has quit IRC | 21:24 | |
bauzas | jaypipes: when we self-heal by the RT, we remove allocations that are not related to the existing instances, right? | 21:25 |
mriedem | jaypipes: issues in https://review.openstack.org/#/c/487589 | 21:25 |
* mriedem watches jay get blasted | 21:25 | |
dansmith | bauzas: that's what I said in my comment | 21:27 |
jaypipes | bauzas: when the move_claim() completes on the destination host, it will overwrite the allocations to only be the ones on the destination host, yes. I think that's what you're asking? | 21:27 |
jaypipes | mriedem: blasted? | 21:27 |
dansmith | jaypipes: no | 21:28 |
dansmith | jaypipes: he's asking about regular RT healing on the source node while the migration is going on, erasing the double claim | 21:28 |
bauzas | dansmith: my question is about if either the source or the target RT removes the allocations for the moving instance given the instance.host is not related to it | 21:28 |
dansmith | jaypipes: which was in my comment about the plan.. we need to make sure we don't heal over that | 21:29 |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Set Adapter interface defaults in conf https://review.openstack.org/487581 | 21:29 |
*** randomhack has joined #openstack-nova | 21:29 | |
dansmith | bauzas: instance.host will be related to the source until it completes | 21:29 |
dansmith | bauzas: and it would remove the double claim once it runs | 21:29 |
*** esberglu has joined #openstack-nova | 21:29 | |
bauzas | dansmith: that's my question | 21:29 |
dansmith | right | 21:29 |
mriedem | jaypipes: with questions | 21:29 |
bauzas | dansmith: because if instance.host is set to the source host, wouldn't the target RT removing the allocations for the target host ? | 21:30 |
dansmith | again, yes | 21:30 |
edleafe | mriedem: regarding https://bugs.launchpad.net/nova/+bug/1706772 - if we catch that and move on, the flavors will never migrate. What's the alternative? | 21:31 |
openstack | Launchpad bug 1706772 in OpenStack Compute (nova) "InternalServerError: Internal Server Error (HTTP 500) in n-cpu logs on startup with Ironic driver" [High,Confirmed] | 21:31 |
jaypipes | dansmith: do you want me to put something in the RT's update_available_resource() method that basically says "oh, this is migrating? fuck it, don't touch placement"? | 21:31 |
dansmith | jaypipes: we have to do something yeah | 21:31 |
mriedem | i had a comment in the patch related to this: "when the move_claim() completes on the destination host, it will overwrite the allocations to only be the ones on the destination host, yes. " | 21:31 |
bauzas | dansmith: sorry, I misunderstood your comment, I thought you were saying it wasn't a problem | 21:31 |
jaypipes | dansmith: we already jump through a shit-ton of hoops for move operations in the RT... | 21:31 |
jaypipes | what's one more... | 21:31 |
dansmith | jaypipes: well, it's either correct or it's not... | 21:32 |
mriedem | is PUT /allocations/<intsance uuid> completely overwriting the allocations for that instance? | 21:32 |
dansmith | mriedem: yes | 21:32 |
bauzas | mriedem: that is correct AFAIK | 21:32 |
jaypipes | dansmith: no, for move operations the definition of "correct" is fuzzy. | 21:32 |
*** thorst has joined #openstack-nova | 21:32 | |
dansmith | jaypipes: I disagree :) | 21:32 |
mriedem | ah i see | 21:33 |
mriedem | so this works the same if you're doing a resize and revert back to the source host i think | 21:35 |
jaypipes | I'm wondering if instances that are migrating are in RT.tracked_instances... | 21:36 |
*** cleong has quit IRC | 21:36 | |
jaypipes | if they aren't, we're good. | 21:36 |
dansmith | jaypipes: well, the existing RT stuff is not even correct, as you know | 21:36 |
*** randomhack has quit IRC | 21:36 | |
bauzas | jaypipes: well, I don't think so | 21:36 |
*** thorst has quit IRC | 21:37 | |
bauzas | jaypipes: IIRC, tracked_instances is for existing instances | 21:37 |
dansmith | jaypipes: if you have the instance, you should be able to check instance.migration_context to know if it's moving | 21:37 |
bauzas | not for migrating ones | 21:37 |
jaypipes | ok, guys, I think we're good... | 21:37 |
dansmith | bauzas: for migrating ones on the source they should be there right? | 21:37 |
jaypipes | lemme explain. | 21:37 |
jaypipes | pls. | 21:37 |
bauzas | dansmith: for the source RT, yeah they should be there AFAIK | 21:37 |
dansmith | bauzas: right, destination node does not matter | 21:38 |
jaypipes | so, in update_available_resource(), we call _update_usage_from_instance(). this is the "auto-heal" thing. | 21:38 |
bauzas | correct | 21:38 |
jaypipes | within that method, we only delete the allocation if the instance is in DELETED or SHELVE_OFFLOADED state | 21:38 |
bauzas | the problem is how we could possibly have duplicate allocations for both target and source if source just removes the target allocations ? | 21:38 |
jaypipes | otherwise we don't touch the allocations. | 21:38 |
dansmith | jaypipes: eh? | 21:38 |
dansmith | jaypipes: we compare the generated ones to the ones from placement and re-put them if they differ | 21:39 |
dansmith | that's how we get allocations now | 21:39 |
bauzas | jaypipes: PUT /allocations/<instance_uuid> is cleaning up existing allocs, nope ? | 21:39 |
bauzas | FWIW, it's becoming late and I could be wrong | 21:39 |
dansmith | jaypipes: this: https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L890-L904 | 21:40 |
mriedem | edleafe: need to find out when the nova-compute service with the ironic driver is able to talk to ironic | 21:40 |
*** cfriesen_ has quit IRC | 21:40 | |
jaypipes | dansmith: when does update_instance_allocation() get called though? | 21:40 |
dansmith | jaypipes: oh, are you looking at the "is new or is old" bit of RT? | 21:41 |
*** cfriesen_ has joined #openstack-nova | 21:41 | |
jaypipes | dansmith: CORRECT! | 21:41 |
dansmith | jaypipes: okay, so that's a problem for the failure case then, | 21:41 |
jaypipes | dansmith: so we don't actually call that update_instance_allocation() unless it's either a brand new instance or it's DELETED/SHEVE_OFFLOADED | 21:41 |
dansmith | jaypipes: because that means we'll never heal over the double allocation on the source when the migration is canceled | 21:41 |
edleafe | mriedem: sure, but my point was that since the code runs in init_host, it won't get a second chance to run *after* the ironic service starts up | 21:42 |
mriedem | edleafe: at some point on startup the compute manager is calling get_inventory which has to refresh the node list | 21:42 |
mriedem | b/c of the pre_start_hook in the compute manager | 21:43 |
*** acormier has joined #openstack-nova | 21:43 | |
mriedem | so does that just not work today? or are we just not waiting long enough? | 21:43 |
dansmith | mriedem: edleafe: riht, that probably should run when we get a new node | 21:43 |
dansmith | because you can get/lose nodes on ironic at runtime | 21:43 |
dansmith | because we could have started with one node, migrated those, and then gained a couple more nodes later when someone shuts down another ironic compute in the hash ring | 21:44 |
edleafe | dansmith: I thougth a new node would be empty to start | 21:44 |
edleafe | no instance | 21:44 |
dansmith | and if that is done during upgrade, which it is, then you need to migrate it | 21:44 |
dansmith | edleafe: no, because ^ | 21:44 |
dansmith | edleafe: nova-computes shard off the full set of ironic nodes, | 21:45 |
*** tbachman has quit IRC | 21:45 | |
dansmith | and if you were to upgrade one ironic compute, then shut down your old one, | 21:45 |
dansmith | you'd start with some nodes, and then later get a bunch more when the ring rebalances | 21:45 |
dansmith | after init_host(), at runtime, old nodes with instances that you now own and need to migrate | 21:45 |
edleafe | dansmith: so then what IYO would be a better place for this? | 21:46 |
dansmith | edleafe: I'd have to go dig just like you, but there's a place in there where we rebalance the ring (or balance it for the first time) and get a list of the nodes we own | 21:46 |
cfriesen_ | jaypipes: back at the last PTG did you arrive at any conclusions on how to handle the Intel CAT stuff? | 21:46 |
dansmith | edleafe: so .. there. :) | 21:46 |
jaypipes | cfriesen_: bad time to bring that question :) | 21:47 |
* edleafe gets out the shovel | 21:47 | |
jaypipes | cfriesen_: how about discuss tomorrow? | 21:47 |
dansmith | edleafe: _refresh_hash_ring() is a good place to start | 21:48 |
cfriesen_ | jaypipes: sure | 21:48 |
dansmith | after you get the hash ring you could probably spawn your thread to go examine the instances on what the hash ring says are your nodes | 21:49 |
*** vishwana_ has joined #openstack-nova | 21:49 | |
edleafe | dansmith: looking at that now... | 21:49 |
dansmith | edleafe: obviously I wasn't thinking about this possibility either, as I'm used to the world before this was here and there was pretty much only one ironic compute ever | 21:50 |
mriedem | it's curious that this blows up during init_host in the driver, but not when driver.get_available_nodes is called | 21:51 |
mriedem | which is shortly after | 21:51 |
mriedem | like in ocata, this is init_host: http://logs.openstack.org/63/485263/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/de2c924/logs/screen-n-cpu.txt.gz#_2017-07-21_12_07_20_885 | 21:51 |
mriedem | and this is right after http://logs.openstack.org/63/485263/2/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/de2c924/logs/screen-n-cpu.txt.gz#_2017-07-21_12_07_21_167 | 21:51 |
*** vishwanathj has quit IRC | 21:52 | |
*** kylek3h has quit IRC | 21:54 | |
*** kylek3h has joined #openstack-nova | 21:55 | |
bauzas | folks it's late, so I'll disappear in a very short few | 21:55 |
mriedem | o/ | 21:55 |
bauzas | but like any release, just lemme know which changes I should review ASAP tomorrow morning my time | 21:56 |
*** xyang1 has quit IRC | 21:56 | |
bauzas | before we call the axe | 21:56 |
bauzas | and again, sorry for not having been there for half-Pike | 21:56 |
bauzas | \o | 21:56 |
*** Apoorva has quit IRC | 21:57 | |
*** Apoorva has joined #openstack-nova | 21:57 | |
*** edmondsw has quit IRC | 21:58 | |
bauzas | mriedem: before I leave, I'm torn by https://review.openstack.org/#/c/408955/ | 21:58 |
mriedem | edleafe: hold the phone, it was happening before the migrate flavors thing http://logs.openstack.org/80/461480/5/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/834477a/logs/screen-n-cpu.txt.gz?level=TRACE#_Jul_19_03_34_01_687299 | 21:59 |
*** kylek3h has quit IRC | 21:59 | |
*** harlowja has joined #openstack-nova | 22:00 | |
mriedem | blows up in ironic-api http://logs.openstack.org/80/461480/5/check/gate-tempest-dsvm-ironic-ipa-wholedisk-bios-agent_ipmitool-tinyipa-ubuntu-xenial-nv/834477a/logs/screen-ir-api.txt.gz#_Jul_19_03_34_01_680460 | 22:02 |
jgriffith | mriedem ildikov added a note here https://review.openstack.org/#/c/330285/106 regarding the Trace showing up in the logs | 22:03 |
*** kristian__ has joined #openstack-nova | 22:07 | |
openstackgerrit | Merged openstack/nova master: Updated from global requirements https://review.openstack.org/487473 | 22:07 |
mriedem | bauzas: torn how | 22:09 |
mriedem | ? | 22:09 |
mriedem | there are 3 other patches for that: api, docs and novaclient | 22:10 |
mriedem | so it's pretty damn late | 22:10 |
*** kristian__ has quit IRC | 22:11 | |
edleafe | mriedem: ah, so _refresh_cache() is the culprit. The migration change just adds that call a bit earlier | 22:12 |
mriedem | jgriffith: ack | 22:13 |
mriedem | edleafe: right, like <1 sec earlier | 22:13 |
mriedem | but still blowing up | 22:13 |
mriedem | i've adjusted the bug and routed it to ironic | 22:13 |
edleafe | mriedem: yeah, but we should be more graceful about it | 22:13 |
dansmith | mriedem: edleafe well, the bug of not migrating nodes we get via hash rebalance is still a thing | 22:14 |
edleafe | dansmith: agreed | 22:14 |
openstackgerrit | Eric Fried proposed openstack/nova master: Centralize keystoneauth1 Adapter conf option setup https://review.openstack.org/487581 | 22:15 |
*** eharney has quit IRC | 22:18 | |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 22:19 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 22:19 |
jaypipes | mriedem, bauzas, dansmith: ding ding ding. round 2. ^^ | 22:19 |
*** cfriesen_ has quit IRC | 22:19 | |
mriedem | heh, can i be glass joe? | 22:19 |
openstackgerrit | Nicolas Simonds proposed openstack/nova master: libvirt: add support for virtio-net rx/tx queue sizes https://review.openstack.org/484997 | 22:22 |
jaypipes | mriedem: I'll work on my eye tattoo. | 22:23 |
mriedem | heh i guess we forgot about safe_connect on claim_resources | 22:24 |
openstackgerrit | Merged openstack/nova master: Remove the code related to extension loading from APIRouterV21 https://review.openstack.org/486414 | 22:24 |
openstackgerrit | Eric Fried proposed openstack/nova master: nova.utils.get_service_url() https://review.openstack.org/458257 | 22:25 |
*** thorst has joined #openstack-nova | 22:25 | |
*** thorst has quit IRC | 22:26 | |
*** gouthamr has quit IRC | 22:28 | |
*** crushil has quit IRC | 22:28 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix example in _serialize_allocations_for_consumer https://review.openstack.org/487614 | 22:30 |
mriedem | jaypipes: dansmith: so we don't need to handle anything different from the compute RT perspective for a move operation? | 22:30 |
*** marst_ has quit IRC | 22:30 | |
*** Sara_ has quit IRC | 22:33 | |
*** esberglu has quit IRC | 22:34 | |
openstackgerrit | Merged openstack/nova master: Suppress some test warnings https://review.openstack.org/486700 | 22:36 |
openstackgerrit | Merged openstack/nova master: Remove the useless FakeExt https://review.openstack.org/486415 | 22:37 |
*** gouthamr has joined #openstack-nova | 22:42 | |
*** crushil has joined #openstack-nova | 22:48 | |
openstackgerrit | Nicolas Simonds proposed openstack/nova master: libvirt: add support for virtio-net rx/tx queue sizes https://review.openstack.org/484997 | 22:51 |
*** crushil has quit IRC | 22:53 | |
*** lyan has quit IRC | 22:54 | |
*** acormier has quit IRC | 22:57 | |
*** acormier has joined #openstack-nova | 22:57 | |
dansmith | mriedem: seems like not | 22:59 |
*** acormier has quit IRC | 23:02 | |
*** acormier has joined #openstack-nova | 23:03 | |
*** Apoorva_ has joined #openstack-nova | 23:05 | |
*** acormier_ has joined #openstack-nova | 23:05 | |
*** edmondsw has joined #openstack-nova | 23:06 | |
*** acormier has quit IRC | 23:07 | |
*** acormier_ has quit IRC | 23:07 | |
*** Apoorva has quit IRC | 23:08 | |
*** acormier has joined #openstack-nova | 23:08 | |
*** Apoorva_ has quit IRC | 23:09 | |
*** yamamoto has joined #openstack-nova | 23:10 | |
*** edmondsw has quit IRC | 23:11 | |
*** acormier has quit IRC | 23:12 | |
mikal | melwitt: you still around? | 23:14 |
mikal | melwitt: tonyb and I are talking about making a quick list of things we'd like to see cleaned up in nova, because I keep forgetting things because I am an old man. tonyb suggested you had an etherpad like this already somewhere? | 23:15 |
melwitt | I think you probably mean mriedem :) ^ | 23:17 |
mikal | nah | 23:17 |
mikal | Its all about you | 23:17 |
melwitt | haha | 23:17 |
mikal | Well, it depends if tonyb is lying about you already having an etherpad | 23:18 |
melwitt | yeah, if I ever knew of one in the past, I've forgotten about it. I'm not aware of a general nova todos etherpad | 23:18 |
mikal | Ok, I'll just call tonyb a liar in public then | 23:19 |
melwitt | I wouldn't be surprised if we had one at some point though | 23:19 |
mikal | I'm ok with that | 23:19 |
melwitt | haha :) | 23:19 |
mikal | https://etherpad.openstack.org/p/nova-warts is my very long list of things I'd like to potter around fixing now that I am a hobbyist again | 23:19 |
melwitt | coolness | 23:19 |
mikal | melwitt: speaking of which, it would be cool to get https://review.openstack.org/#/c/486831 merged before pike releases too from that series. Its only comments but it gives us a cleanish slate for the cleanup in queens. | 23:22 |
openstackgerrit | Jay Pipes proposed openstack/nova master: claim resources in placement API during schedule() https://review.openstack.org/483566 | 23:22 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: account for move operations in claim https://review.openstack.org/487589 | 23:22 |
mikal | melwitt: i.e. please make with the rubber stamping, kthxbye | 23:22 |
*** sdague has quit IRC | 23:23 | |
*** esberglu has joined #openstack-nova | 23:23 | |
*** raunak_ has joined #openstack-nova | 23:24 | |
melwitt | mikal: k, will look | 23:25 |
*** raunak has quit IRC | 23:25 | |
*** raunak_ is now known as raunak | 23:25 | |
*** thorst has joined #openstack-nova | 23:27 | |
*** esberglu has quit IRC | 23:28 | |
jaypipes | edleafe: consolidated the dict construction to a single line for you. | 23:28 |
mikal | melwitt: ta | 23:29 |
*** chyka has quit IRC | 23:32 | |
*** oomichi has quit IRC | 23:32 | |
*** thorst has quit IRC | 23:32 | |
*** acormier has joined #openstack-nova | 23:32 | |
*** oomichi has joined #openstack-nova | 23:34 | |
openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use service catalog (and discovery) for cinder endpoints https://review.openstack.org/487621 | 23:35 |
*** acormier has quit IRC | 23:35 | |
efried | mordred ^^ *very* WIP, but could you look and see if this is a remotely sane approach to the cinder conversion? | 23:35 |
efried | mordred thanks in advance. | 23:35 |
*** efried is now known as efried_zzz | 23:35 | |
*** acormier has joined #openstack-nova | 23:35 | |
*** yamamoto has quit IRC | 23:37 | |
smcginnis | Ooh, nice. | 23:38 |
openstackgerrit | Merged openstack/nova master: Netronome SmartNIC Enablement https://review.openstack.org/483459 | 23:39 |
openstackgerrit | Merged openstack/nova master: Remove the useless extension block_device_mapping_v1 object https://review.openstack.org/486069 | 23:40 |
openstackgerrit | Merged openstack/nova master: Remove the useless fake ExtensionManager from API unittests https://review.openstack.org/486416 | 23:41 |
*** takashin has joined #openstack-nova | 23:41 | |
openstackgerrit | Merged openstack/nova master: Skip boot from encrypted volume on Xen+libvirt https://review.openstack.org/481627 | 23:42 |
openstackgerrit | Merged openstack/nova master: Add helper method for waiting migrations in functional tests https://review.openstack.org/486537 | 23:43 |
tonyb | melwitt, mikal: let me see if I can find the one I was thinking of. | 23:43 |
openstackgerrit | Merged openstack/nova master: docstring and unused code removal https://review.openstack.org/487492 | 23:44 |
openstackgerrit | Merged openstack/nova master: Move the note about '/os-volume_boot' to the correct place https://review.openstack.org/486071 | 23:44 |
*** Apoorva has joined #openstack-nova | 23:45 | |
*** Apoorva has quit IRC | 23:46 | |
*** Apoorva has joined #openstack-nova | 23:49 | |
*** vladikr has quit IRC | 23:49 | |
melwitt | tonyb: in rootwrap.d, do the comments do anything to scope the commands or are they just for humans to read? | 23:49 |
*** thorst has joined #openstack-nova | 23:50 | |
*** thorst has quit IRC | 23:50 | |
tonyb | melwitt: just for humans | 23:51 |
*** yamamoto has joined #openstack-nova | 23:51 | |
melwitt | tonyb: cool, thanks | 23:51 |
tonyb | melwitt: when doing the privsep stuff in later patches it was annoying to identify things that could be pruned, so I thought I'd mkae it a little easier | 23:52 |
melwitt | tonyb: yeah, I think I understand now | 23:52 |
tonyb | melwitt: I'll address your review feedback after the last_bytes patch lands to make the rebase slightly easier if that's cool with you | 23:53 |
melwitt | tonyb: okay. if the stuff I mentioned is going to be a later cleanup, that's cool. just wanted to make sure I understood | 23:54 |
*** dillaman has quit IRC | 23:54 | |
*** Sukhdev has joined #openstack-nova | 23:54 | |
tonyb | well one of you comments is taken care of in a later patch the other was on my mental todo list I haven't done more that that. | 23:55 |
tonyb | I'll reply and then you can make a call. | 23:55 |
*** yamamoto_ has joined #openstack-nova | 23:55 | |
*** yamamoto has quit IRC | 23:56 | |
melwitt | tonyb: cool thanks | 23:57 |
*** Swami has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!