*** smatzek has quit IRC | 00:01 | |
*** gjayavelu has quit IRC | 00:01 | |
*** markvoelker_ has quit IRC | 00:03 | |
*** yamamoto has joined #openstack-nova | 00:05 | |
*** markvoelker has joined #openstack-nova | 00:09 | |
*** liverpooler has joined #openstack-nova | 00:10 | |
*** crushil has quit IRC | 00:12 | |
*** andreas_s has joined #openstack-nova | 00:13 | |
*** markvoelker has quit IRC | 00:13 | |
*** markvoelker has joined #openstack-nova | 00:18 | |
*** gouthamr has joined #openstack-nova | 00:19 | |
*** andreas_s has quit IRC | 00:21 | |
*** yangyapeng has quit IRC | 00:21 | |
*** andreas_s has joined #openstack-nova | 00:22 | |
*** yangyapeng has joined #openstack-nova | 00:22 | |
*** markvoelker has quit IRC | 00:22 | |
*** ijw has joined #openstack-nova | 00:23 | |
*** andreas_s has quit IRC | 00:26 | |
*** markvoelker has joined #openstack-nova | 00:27 | |
*** yangyapeng has quit IRC | 00:27 | |
*** huanxie has joined #openstack-nova | 00:29 | |
*** ijw has quit IRC | 00:31 | |
*** thorst has joined #openstack-nova | 00:31 | |
*** markvoelker has quit IRC | 00:32 | |
*** andreas_s has joined #openstack-nova | 00:40 | |
*** crushil has joined #openstack-nova | 00:43 | |
*** salv-orlando has joined #openstack-nova | 00:43 | |
*** salv-orlando has quit IRC | 00:47 | |
*** mriedem has quit IRC | 00:48 | |
*** andreas_s has quit IRC | 00:49 | |
*** gjayavelu has joined #openstack-nova | 00:51 | |
*** andreas_s has joined #openstack-nova | 00:54 | |
*** markvoelker has joined #openstack-nova | 00:54 | |
*** thorst has quit IRC | 00:57 | |
*** chyka has joined #openstack-nova | 00:58 | |
*** markvoelker has quit IRC | 00:59 | |
*** mriedem has joined #openstack-nova | 00:59 | |
*** masuberu has joined #openstack-nova | 01:00 | |
*** Tom__ has joined #openstack-nova | 01:00 | |
*** Apoorva_ has joined #openstack-nova | 01:01 | |
*** Shunli has joined #openstack-nova | 01:02 | |
*** chyka has quit IRC | 01:02 | |
*** Apoorva has quit IRC | 01:03 | |
*** masber has quit IRC | 01:04 | |
*** Tom__ has quit IRC | 01:05 | |
*** Apoorva_ has quit IRC | 01:05 | |
*** andreas_s has quit IRC | 01:07 | |
efried | mriedem I wouldn't mind listening in on the port binding debacle^Wpowwow | 01:09 |
---|---|---|
*** gjayavelu has quit IRC | 01:10 | |
mriedem | ok | 01:11 |
*** andreas_s has joined #openstack-nova | 01:12 | |
*** markvoelker has joined #openstack-nova | 01:12 | |
*** phuongnh has joined #openstack-nova | 01:12 | |
*** gjayavelu has joined #openstack-nova | 01:13 | |
openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 01:15 |
*** andreas_s has quit IRC | 01:16 | |
openstackgerrit | Merged openstack/nova-specs master: Enable SR-IOV NIC offload feature discovery https://review.openstack.org/504895 | 01:18 |
*** yangyape_ has joined #openstack-nova | 01:21 | |
*** thorst has joined #openstack-nova | 01:23 | |
*** baoli has joined #openstack-nova | 01:25 | |
*** ijw has joined #openstack-nova | 01:27 | |
*** masayukig has quit IRC | 01:28 | |
*** masayukig has joined #openstack-nova | 01:29 | |
*** suresh12 has quit IRC | 01:30 | |
*** mmehan has quit IRC | 01:30 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/510324 | 01:31 |
*** litao__ has joined #openstack-nova | 01:31 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Spec for service create and destroy notification https://review.openstack.org/444731 | 01:32 |
*** ijw has quit IRC | 01:32 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Spec for service create and destroy notification https://review.openstack.org/444731 | 01:32 |
*** liverpooler has quit IRC | 01:32 | |
*** tojuvone has quit IRC | 01:35 | |
*** thorst has quit IRC | 01:36 | |
*** andreas_s has joined #openstack-nova | 01:39 | |
*** salv-orlando has joined #openstack-nova | 01:44 | |
*** masber has joined #openstack-nova | 01:44 | |
*** Tom has joined #openstack-nova | 01:46 | |
*** masuberu has quit IRC | 01:47 | |
*** markvoelker has quit IRC | 01:47 | |
*** salv-orlando has quit IRC | 01:49 | |
*** vladikr has quit IRC | 01:51 | |
*** vladikr has joined #openstack-nova | 01:51 | |
*** coreywright has quit IRC | 01:53 | |
*** hongbin has joined #openstack-nova | 01:54 | |
*** gjayavelu has quit IRC | 01:55 | |
*** baoli has quit IRC | 01:55 | |
*** ijw has joined #openstack-nova | 01:56 | |
*** josecastroleon has quit IRC | 01:59 | |
openstackgerrit | jichenjc proposed openstack/nova master: Enhance doc for placement allocation list https://review.openstack.org/511715 | 01:59 |
*** markvoelker has joined #openstack-nova | 02:00 | |
openstackgerrit | Huan Xie proposed openstack/nova master: VGPU: Define vgpu resource class https://review.openstack.org/511180 | 02:01 |
*** vladikr has quit IRC | 02:01 | |
*** ijw has quit IRC | 02:01 | |
*** josecastroleon has joined #openstack-nova | 02:01 | |
*** vladikr has joined #openstack-nova | 02:01 | |
*** ijw has joined #openstack-nova | 02:02 | |
*** andreas_s has quit IRC | 02:02 | |
*** yamahata has quit IRC | 02:02 | |
*** baoli has joined #openstack-nova | 02:03 | |
*** markvoelker has quit IRC | 02:05 | |
*** ijw has quit IRC | 02:06 | |
*** bkopilov has quit IRC | 02:07 | |
openstackgerrit | jichenjc proposed openstack/nova master: Add create inventories doc for placement https://review.openstack.org/512215 | 02:08 |
openstackgerrit | jichenjc proposed openstack/nova master: check query param for server groups function https://review.openstack.org/500347 | 02:08 |
*** markvoelker has joined #openstack-nova | 02:10 | |
*** coreywright has joined #openstack-nova | 02:11 | |
*** andreas_s has joined #openstack-nova | 02:11 | |
*** vladikr has quit IRC | 02:13 | |
*** yikun has joined #openstack-nova | 02:13 | |
*** vladikr has joined #openstack-nova | 02:13 | |
*** vks1 has joined #openstack-nova | 02:14 | |
*** markvoelker has quit IRC | 02:14 | |
openstackgerrit | Takashi NATSUME proposed openstack/python-novaclient master: Microversion 2.54 - Enable cold migration with target host https://review.openstack.org/406707 | 02:14 |
*** vks1 has quit IRC | 02:14 | |
BenderRodriguez | anyone here | 02:15 |
BenderRodriguez | I'm getting http 500 errors when attempting to run "openstack hypervisor list" | 02:15 |
BenderRodriguez | http://controller:8774/v2.1/os-hypervisors/detail returned with HTTP 500 | 02:15 |
BenderRodriguez | nova is listed as a compute service in "openstack service list" | 02:15 |
BenderRodriguez | here's a debug output | 02:15 |
BenderRodriguez | https://paste.debian.net/hidden/353b9966/ | 02:15 |
*** andreas_s has quit IRC | 02:16 | |
*** masber has quit IRC | 02:19 | |
*** markvoelker has joined #openstack-nova | 02:19 | |
openstackgerrit | jichenjc proposed openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 02:20 |
*** baoli has quit IRC | 02:20 | |
*** gyee has quit IRC | 02:21 | |
*** Tom has quit IRC | 02:23 | |
*** Tom has joined #openstack-nova | 02:23 | |
*** markvoelker has quit IRC | 02:23 | |
*** andreas_s has joined #openstack-nova | 02:25 | |
*** Swami has quit IRC | 02:25 | |
*** Tom has quit IRC | 02:28 | |
*** markvoelker has joined #openstack-nova | 02:28 | |
*** andreas_s has quit IRC | 02:29 | |
*** josecastroleon has quit IRC | 02:30 | |
*** josecastroleon has joined #openstack-nova | 02:31 | |
*** gjayavelu has joined #openstack-nova | 02:32 | |
*** markvoelker has quit IRC | 02:33 | |
*** ijw has joined #openstack-nova | 02:35 | |
*** takashin has left #openstack-nova | 02:36 | |
*** vladikr has quit IRC | 02:37 | |
*** thorst has joined #openstack-nova | 02:37 | |
mriedem | BenderRodriguez: check the nova-api logs for the 500 | 02:37 |
mriedem | the client trace isn't very helpful | 02:37 |
BenderRodriguez | 2017-10-18 21:18:13.480 27678 ERROR nova.api.openstack EmptyCatalog: The service catalog is empty. | 02:38 |
BenderRodriguez | but how | 02:38 |
BenderRodriguez | openstack service list shows a compute service | 02:38 |
mriedem | would need to see more of the trace from the nova-api log | 02:39 |
mriedem | not sure what's looking up a service catalog entry | 02:39 |
mriedem | compute isn't looking up itself | 02:39 |
*** ijw has quit IRC | 02:39 | |
*** vladikr has joined #openstack-nova | 02:41 | |
BenderRodriguez | mriedem: http://termbin.com/p26m | 02:41 |
BenderRodriguez | 2017-10-18 21:13:33.467 27678 INFO nova.api.openstack [-] http://controller:8774/v2.1/os-hypervisors/detail returned with HTTP 500 | 02:41 |
*** thorst has quit IRC | 02:42 | |
*** andreas_s has joined #openstack-nova | 02:43 | |
*** Tom has joined #openstack-nova | 02:44 | |
*** salv-orlando has joined #openstack-nova | 02:45 | |
*** Tom__ has joined #openstack-nova | 02:45 | |
openstackgerrit | Merged openstack/nova-specs master: Websockify security proxy framework https://review.openstack.org/496160 | 02:45 |
*** markvoelker has joined #openstack-nova | 02:46 | |
*** hshiina has joined #openstack-nova | 02:46 | |
mriedem | BenderRodriguez: looks like nova.conf is misconfigured for talking to keystone, | 02:46 |
mriedem | it's trying to validate the token | 02:46 |
mriedem | so double check your nova.conf for configuring auth stuff | 02:47 |
*** Tom___ has joined #openstack-nova | 02:47 | |
*** karthiks has quit IRC | 02:48 | |
*** Tom has quit IRC | 02:48 | |
*** gmann_afk is now known as gmann | 02:49 | |
*** Tom__ has quit IRC | 02:49 | |
*** salv-orlando has quit IRC | 02:49 | |
*** gongysh has joined #openstack-nova | 02:50 | |
*** vladikr has quit IRC | 02:51 | |
openstackgerrit | jichenjc proposed openstack/nova master: Remove glance usage inside compute https://review.openstack.org/511392 | 02:51 |
openstackgerrit | jichenjc proposed openstack/nova master: Remove usage of glance.generate_image_url https://review.openstack.org/511397 | 02:51 |
*** vladikr has joined #openstack-nova | 02:53 | |
openstackgerrit | Naichuan Sun proposed openstack/nova master: VGPU_support: add enabled white list https://review.openstack.org/512580 | 02:55 |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware https://review.openstack.org/507486 | 02:56 |
BenderRodriguez | mriedem: well looking at the openstack hypervisor --debug list output it seems to be going through authentication fine | 02:56 |
BenderRodriguez | http://termbin.com/tap8c | 02:56 |
*** andreas_s has quit IRC | 02:56 | |
*** gouthamr has quit IRC | 02:57 | |
mriedem | are the auth values in your rc file for the CLI the same as in nova.conf for the [keystone_authtoken] section? | 02:57 |
BenderRodriguez | mriedem: in the rc file the OS_USER/PASS values are for the admin user. In the keystone_authtoken section in the conf, the username/password is for the "nova" user | 02:59 |
openstackgerrit | melanie witt proposed openstack/nova master: DNM: Test websocketproxy with TLS https://review.openstack.org/513160 | 02:59 |
*** TuanLA has joined #openstack-nova | 03:03 | |
mriedem | what does "openstack catalog list" show? | 03:03 |
BenderRodriguez | mriedem: http://termbin.com/nalx | 03:04 |
BenderRodriguez | all three hosts mentioned are pingable/reachable | 03:04 |
mriedem | huh, not sure | 03:05 |
mriedem | i checked the error on ask.o.o and it's come up but no solutions | 03:05 |
mriedem | i haven't seen this before | 03:05 |
BenderRodriguez | oh well | 03:05 |
mriedem | i'd think a config issue but not sure really | 03:05 |
BenderRodriguez | I'll just nuke the set up and try again | 03:05 |
*** andreas_s has joined #openstack-nova | 03:05 | |
BenderRodriguez | at least for the controller | 03:06 |
mriedem | nova user and project are all setup ok? | 03:06 |
BenderRodriguez | hmm | 03:06 |
BenderRodriguez | there is a nova user defined | 03:08 |
*** sapcc-bot1 has joined #openstack-nova | 03:09 | |
*** andreas_s has quit IRC | 03:10 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add attachment_get to refresh_connection_info https://review.openstack.org/512626 | 03:11 |
*** sapcc-bot has quit IRC | 03:12 | |
*** toabctl has quit IRC | 03:14 | |
*** andreas_s has joined #openstack-nova | 03:15 | |
*** nikhil has quit IRC | 03:20 | |
*** markvoelker has quit IRC | 03:20 | |
*** toabctl has joined #openstack-nova | 03:21 | |
* alex_xu back to spec review instead of coding trait patch | 03:21 | |
mriedem | alex_xu: all of your coding dreams, and mine, can come true once the spec freeze is over | 03:21 |
alex_xu | mriedem: hehe, ok :) | 03:21 |
BenderRodriguez | alex_xu: maybe fix this bug | 03:24 |
BenderRodriguez | I found | 03:24 |
BenderRodriguez | if it is a bug | 03:24 |
*** TuanLA has quit IRC | 03:25 | |
*** hieulq has quit IRC | 03:25 | |
*** trungnv has quit IRC | 03:25 | |
*** phuongnh has quit IRC | 03:25 | |
*** markvoelker has joined #openstack-nova | 03:25 | |
alex_xu | BenderRodriguez: today is spec freeze, so the spec review is top priority | 03:26 |
*** trungnv has joined #openstack-nova | 03:26 | |
*** TuanLA has joined #openstack-nova | 03:26 | |
*** phuongnh has joined #openstack-nova | 03:26 | |
*** hieulq has joined #openstack-nova | 03:26 | |
*** mriedem has quit IRC | 03:28 | |
*** bkopilov has joined #openstack-nova | 03:29 | |
*** markvoelker has quit IRC | 03:30 | |
*** josecastroleon has quit IRC | 03:30 | |
*** josecastroleon has joined #openstack-nova | 03:31 | |
*** hshiina has quit IRC | 03:33 | |
*** andreas_s has quit IRC | 03:33 | |
openstackgerrit | jichenjc proposed openstack/nova master: Downgrade log for keystone verify client fail https://review.openstack.org/513243 | 03:34 |
*** markvoelker has joined #openstack-nova | 03:34 | |
*** jgriffith has quit IRC | 03:34 | |
openstackgerrit | Huan Xie proposed openstack/nova master: VGPU: Define vgpu resource class https://review.openstack.org/511180 | 03:36 |
openstackgerrit | Merged openstack/nova master: libvirt: add method to configure migration speed https://review.openstack.org/497456 | 03:36 |
*** peter-hamilton has quit IRC | 03:36 | |
*** jgriffith has joined #openstack-nova | 03:38 | |
*** thorst has joined #openstack-nova | 03:38 | |
*** markvoelker has quit IRC | 03:39 | |
*** josecastroleon has quit IRC | 03:40 | |
*** amodi has joined #openstack-nova | 03:42 | |
*** hongbin has quit IRC | 03:43 | |
*** markvoelker has joined #openstack-nova | 03:43 | |
*** josecastroleon has joined #openstack-nova | 03:44 | |
*** jgriffith_ has joined #openstack-nova | 03:44 | |
*** thorst has quit IRC | 03:46 | |
*** salv-orlando has joined #openstack-nova | 03:46 | |
*** jgriffith has quit IRC | 03:46 | |
openstackgerrit | Yikun Jiang proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762 | 03:47 |
*** jgriffith_ is now known as jgriffith | 03:47 | |
*** markvoelker has quit IRC | 03:48 | |
*** yamahata has joined #openstack-nova | 03:48 | |
*** salv-orlando has quit IRC | 03:50 | |
*** markvoelker has joined #openstack-nova | 03:52 | |
*** Tom___ has quit IRC | 03:53 | |
*** Tom has joined #openstack-nova | 03:54 | |
*** Tom__ has joined #openstack-nova | 03:56 | |
*** markvoelker has quit IRC | 03:57 | |
*** dave-mccowan has quit IRC | 03:57 | |
*** Tahvok has quit IRC | 03:57 | |
*** Tom has quit IRC | 03:58 | |
*** Tom__ has quit IRC | 04:00 | |
*** hshiina has joined #openstack-nova | 04:01 | |
*** markvoelker has joined #openstack-nova | 04:02 | |
*** Tahvok has joined #openstack-nova | 04:02 | |
*** mdnadeem has joined #openstack-nova | 04:03 | |
*** suresh12 has joined #openstack-nova | 04:03 | |
*** markvoelker has quit IRC | 04:06 | |
*** markvoelker has joined #openstack-nova | 04:10 | |
*** gongysh has quit IRC | 04:12 | |
*** markvoelker has quit IRC | 04:15 | |
*** huanxie has quit IRC | 04:19 | |
*** markvoelker has joined #openstack-nova | 04:20 | |
*** TuanLA has quit IRC | 04:21 | |
*** phuongnh has quit IRC | 04:21 | |
*** trungnv has quit IRC | 04:21 | |
*** TuanLA has joined #openstack-nova | 04:21 | |
*** phuongnh has joined #openstack-nova | 04:21 | |
*** trungnv has joined #openstack-nova | 04:21 | |
*** psachin has joined #openstack-nova | 04:22 | |
*** yikun has quit IRC | 04:23 | |
*** ijw has joined #openstack-nova | 04:23 | |
*** ijw has quit IRC | 04:28 | |
*** amodi has quit IRC | 04:29 | |
*** claudiub has joined #openstack-nova | 04:31 | |
*** josecastroleon has quit IRC | 04:35 | |
*** huanxie has joined #openstack-nova | 04:36 | |
*** josecastroleon has joined #openstack-nova | 04:36 | |
*** vladikr has quit IRC | 04:46 | |
*** salv-orlando has joined #openstack-nova | 04:47 | |
*** lajoskatona has joined #openstack-nova | 04:49 | |
*** Tom has joined #openstack-nova | 04:50 | |
*** salv-orlando has quit IRC | 04:51 | |
*** markvoelker has quit IRC | 04:54 | |
*** armax has quit IRC | 04:55 | |
*** armax has joined #openstack-nova | 04:56 | |
*** armax has quit IRC | 04:56 | |
*** armax has joined #openstack-nova | 04:57 | |
*** armax has quit IRC | 04:57 | |
*** armax has joined #openstack-nova | 04:58 | |
*** armax has quit IRC | 04:58 | |
openstackgerrit | Merged openstack/nova master: Keep updating allocations for Ironic https://review.openstack.org/513085 | 04:58 |
openstackgerrit | Merged openstack/nova stable/pike: fix unstable shelve offload functional tests https://review.openstack.org/509818 | 04:58 |
*** armax has joined #openstack-nova | 04:58 | |
*** armax has quit IRC | 04:59 | |
*** armax has joined #openstack-nova | 04:59 | |
*** armax has quit IRC | 04:59 | |
*** sree has joined #openstack-nova | 05:00 | |
*** armax has joined #openstack-nova | 05:00 | |
*** armax has quit IRC | 05:00 | |
*** armax has joined #openstack-nova | 05:01 | |
*** armax has quit IRC | 05:01 | |
*** armax has joined #openstack-nova | 05:02 | |
*** armax has quit IRC | 05:02 | |
*** armax has joined #openstack-nova | 05:02 | |
*** armax has quit IRC | 05:03 | |
*** armax has joined #openstack-nova | 05:03 | |
*** salv-orlando has joined #openstack-nova | 05:03 | |
*** armax has quit IRC | 05:03 | |
*** armax has joined #openstack-nova | 05:04 | |
*** armax has quit IRC | 05:04 | |
*** vvargaszte has joined #openstack-nova | 05:07 | |
*** markvoelker has joined #openstack-nova | 05:08 | |
*** markvoelker has quit IRC | 05:12 | |
*** abhi89 has joined #openstack-nova | 05:13 | |
*** masber has joined #openstack-nova | 05:15 | |
*** markvoelker has joined #openstack-nova | 05:17 | |
*** masuberu has joined #openstack-nova | 05:17 | |
*** masber has quit IRC | 05:19 | |
*** vvargaszte has quit IRC | 05:21 | |
*** Tom has quit IRC | 05:21 | |
*** Tom has joined #openstack-nova | 05:21 | |
*** markvoelker has quit IRC | 05:22 | |
*** jdavis has joined #openstack-nova | 05:22 | |
*** chyka has joined #openstack-nova | 05:22 | |
openstackgerrit | jichenjc proposed openstack/nova master: Add more functional test for placement.usage https://review.openstack.org/513264 | 05:23 |
*** markvoelker has joined #openstack-nova | 05:26 | |
*** chyka has quit IRC | 05:26 | |
*** jdavis has quit IRC | 05:27 | |
*** gongysh has joined #openstack-nova | 05:27 | |
*** markvoelker has quit IRC | 05:29 | |
*** markvoelker has joined #openstack-nova | 05:29 | |
*** gongysh has quit IRC | 05:32 | |
*** suresh12 has quit IRC | 05:34 | |
*** thorst has joined #openstack-nova | 05:42 | |
*** markvoelker has quit IRC | 05:42 | |
*** markvoelker has joined #openstack-nova | 05:42 | |
*** markvoelker has quit IRC | 05:42 | |
*** thorst has quit IRC | 05:47 | |
*** spectr has joined #openstack-nova | 05:48 | |
*** ijw has joined #openstack-nova | 05:50 | |
*** alex_xu has quit IRC | 05:54 | |
*** alex_xu has joined #openstack-nova | 06:00 | |
*** huanxie has quit IRC | 06:01 | |
*** edand has joined #openstack-nova | 06:03 | |
*** josecastroleon has quit IRC | 06:07 | |
*** hoonetorg has quit IRC | 06:09 | |
*** andreas_s has joined #openstack-nova | 06:11 | |
*** Eran_Kuris has joined #openstack-nova | 06:17 | |
*** Oku_OS-away is now known as Oku_OS | 06:18 | |
*** sahid has joined #openstack-nova | 06:20 | |
*** cshen has quit IRC | 06:21 | |
openstackgerrit | Merged openstack/nova stable/newton: Use VIR_DOMAIN_BLOCK_REBASE_COPY_DEV when rebasing https://review.openstack.org/471356 | 06:24 |
*** hoonetorg has joined #openstack-nova | 06:25 | |
*** salv-orlando has quit IRC | 06:26 | |
*** salv-orlando has joined #openstack-nova | 06:26 | |
*** sahid has quit IRC | 06:27 | |
*** sahid has joined #openstack-nova | 06:28 | |
*** salv-orlando has quit IRC | 06:30 | |
*** huanxie has joined #openstack-nova | 06:33 | |
*** sshwarts has joined #openstack-nova | 06:45 | |
*** cshen has joined #openstack-nova | 06:45 | |
*** ijw has quit IRC | 06:48 | |
*** markvoelker has joined #openstack-nova | 06:49 | |
*** vishwana_ has joined #openstack-nova | 06:54 | |
*** vishwanathj has quit IRC | 06:54 | |
*** pcaruana has joined #openstack-nova | 06:55 | |
*** vishwanathj has joined #openstack-nova | 06:58 | |
*** vishwana_ has quit IRC | 06:59 | |
*** hshiina has quit IRC | 07:03 | |
*** crushil has quit IRC | 07:19 | |
*** avolkov`` has joined #openstack-nova | 07:19 | |
*** ttsiouts has joined #openstack-nova | 07:19 | |
*** tesseract has joined #openstack-nova | 07:21 | |
*** avolkov`` has left #openstack-nova | 07:22 | |
*** markus_z has joined #openstack-nova | 07:25 | |
*** salv-orlando has joined #openstack-nova | 07:26 | |
openstackgerrit | Lajos Katona proposed openstack/nova master: Change live_migrate tests to use fakedriver https://review.openstack.org/505202 | 07:27 |
*** salv-orlando has quit IRC | 07:31 | |
*** jpena|off is now known as jpena | 07:31 | |
openstackgerrit | sahid proposed openstack/nova-specs master: update: introducing isolate emulthreads on host https://review.openstack.org/511188 | 07:35 |
*** salv-orlando has joined #openstack-nova | 07:42 | |
*** thorst has joined #openstack-nova | 07:43 | |
*** andreas_s has quit IRC | 07:45 | |
*** thorst has quit IRC | 07:47 | |
*** andreas_s has joined #openstack-nova | 07:54 | |
*** gcb has quit IRC | 07:55 | |
*** markvoelker has quit IRC | 08:01 | |
*** ralonsoh has joined #openstack-nova | 08:03 | |
openstackgerrit | sahid proposed openstack/nova-specs master: virt: allow instances to be booted with trusted VFs https://review.openstack.org/485522 | 08:06 |
*** ragiman has joined #openstack-nova | 08:11 | |
*** lucas-afk is now known as lucasagomes | 08:16 | |
*** stephenfin has left #openstack-nova | 08:17 | |
*** stephenfin has joined #openstack-nova | 08:17 | |
*** AlexeyAbashkin has joined #openstack-nova | 08:28 | |
*** gcb has joined #openstack-nova | 08:28 | |
*** tssurya has quit IRC | 08:29 | |
*** Tom has quit IRC | 08:32 | |
*** yamamoto has quit IRC | 08:32 | |
*** dtantsur|afk is now known as dtantsur | 08:32 | |
*** Tom has joined #openstack-nova | 08:32 | |
*** gjayavelu has quit IRC | 08:35 | |
*** Tom__ has joined #openstack-nova | 08:36 | |
*** Tom has quit IRC | 08:37 | |
*** Tom__ has quit IRC | 08:40 | |
*** Tom has joined #openstack-nova | 08:40 | |
*** tssurya has joined #openstack-nova | 08:41 | |
*** derekh has joined #openstack-nova | 08:46 | |
*** spectr has quit IRC | 08:47 | |
*** Tom has quit IRC | 08:48 | |
*** spectr has joined #openstack-nova | 08:48 | |
*** spectr has quit IRC | 08:48 | |
*** Tom has joined #openstack-nova | 08:48 | |
*** spectr has joined #openstack-nova | 08:50 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Remove 'vendordata_driver' opt https://review.openstack.org/397835 | 08:55 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Validate '[api] vendordata_providers' options https://review.openstack.org/513318 | 08:55 |
*** cdent has joined #openstack-nova | 08:56 | |
bauzas | gibi: you did a bit of review on https://review.openstack.org/#/c/444731/8, fancy to vote it quickly so I could +W ? | 08:56 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Fix indentation of database options https://review.openstack.org/443097 | 08:57 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Resolve TODOs in 'database' https://review.openstack.org/393695 | 08:57 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Remove 'db_driver' config opt https://review.openstack.org/508487 | 08:57 |
*** chyka has joined #openstack-nova | 08:58 | |
openstackgerrit | jichenjc proposed openstack/nova master: remove CONF.vendordata_driver https://review.openstack.org/501510 | 08:59 |
openstackgerrit | jichenjc proposed openstack/nova master: Add description for reousrce class creation https://review.openstack.org/508083 | 08:59 |
*** chyka has quit IRC | 09:03 | |
*** sapd__ has joined #openstack-nova | 09:12 | |
*** sapd_ has quit IRC | 09:12 | |
*** yamamoto has joined #openstack-nova | 09:13 | |
*** Tom has quit IRC | 09:16 | |
*** TuanLA has quit IRC | 09:16 | |
*** hieulq has quit IRC | 09:16 | |
*** trungnv has quit IRC | 09:16 | |
*** phuongnh has quit IRC | 09:16 | |
*** TuanLA has joined #openstack-nova | 09:17 | |
*** phuongnh has joined #openstack-nova | 09:17 | |
*** trungnv has joined #openstack-nova | 09:17 | |
*** hieulq has joined #openstack-nova | 09:17 | |
openstackgerrit | Merged openstack/nova-specs master: Spec for service create and destroy notification https://review.openstack.org/444731 | 09:17 |
*** salv-orlando has quit IRC | 09:21 | |
*** salv-orlando has joined #openstack-nova | 09:22 | |
*** sambetts|afk is now known as sambetts | 09:24 | |
*** salv-orlando has quit IRC | 09:27 | |
*** lpetrut has joined #openstack-nova | 09:29 | |
*** Shunli has quit IRC | 09:30 | |
artom | legacy-grenade-dsvm-neutron-multinode legacy-grenade-dsvm-neutron-multinode : ERROR Project openstack/neutron does not have the default branch master | 09:34 |
artom | o_O | 09:34 |
*** sree_ has joined #openstack-nova | 09:36 | |
*** sree_ is now known as Guest44289 | 09:36 | |
*** sree has quit IRC | 09:37 | |
*** sdague has joined #openstack-nova | 09:38 | |
*** gszasz has joined #openstack-nova | 09:39 | |
*** Tom has joined #openstack-nova | 09:40 | |
*** thorst has joined #openstack-nova | 09:44 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware https://review.openstack.org/507486 | 09:45 |
*** Tom has quit IRC | 09:47 | |
*** thorst has quit IRC | 09:49 | |
*** yamamoto has quit IRC | 09:49 | |
artom | Oh god we broke archive_deleted_rows_again | 09:49 |
*** cdent has quit IRC | 09:53 | |
*** vivsoni has quit IRC | 09:53 | |
*** vivsoni has joined #openstack-nova | 09:53 | |
*** yassine has quit IRC | 09:56 | |
*** andreas_s has quit IRC | 09:57 | |
*** andreas_s has joined #openstack-nova | 09:58 | |
*** TuanLA has quit IRC | 10:02 | |
*** andreas_s has quit IRC | 10:02 | |
*** andreas_s has joined #openstack-nova | 10:08 | |
*** Tom has joined #openstack-nova | 10:11 | |
*** rodolof has joined #openstack-nova | 10:13 | |
*** andreas_s has quit IRC | 10:18 | |
*** mvk has quit IRC | 10:19 | |
*** salv-orlando has joined #openstack-nova | 10:21 | |
*** andreas_s has joined #openstack-nova | 10:23 | |
*** yamahata has quit IRC | 10:28 | |
*** andreas_s has quit IRC | 10:30 | |
*** andreas_s has joined #openstack-nova | 10:30 | |
*** cdent has joined #openstack-nova | 10:31 | |
openstackgerrit | Stephen Finucane proposed openstack/nova-specs master: Add 'move-nova-cmds-to-cliff' spec https://review.openstack.org/433603 | 10:32 |
stephenfin | bauzas: Addressed comments in ^ | 10:32 |
stephenfin | tl;dr: Migration to cliff is only part of that spec. The larger aim is "cleanup nova-* commands". The spec title is misleading but I'm stuck with it now | 10:33 |
*** rodolof has quit IRC | 10:34 | |
*** rodolof has joined #openstack-nova | 10:35 | |
*** Guest44289 has quit IRC | 10:37 | |
*** Tom has quit IRC | 10:37 | |
*** sree has joined #openstack-nova | 10:37 | |
openstackgerrit | Shoham Peller proposed openstack/nova master: Handle spawning error on unshelving https://review.openstack.org/378009 | 10:40 |
*** rgerganov has quit IRC | 10:45 | |
*** bkopilov has quit IRC | 10:47 | |
*** mvk has joined #openstack-nova | 10:48 | |
*** rgerganov has joined #openstack-nova | 10:48 | |
*** huanxie has quit IRC | 10:49 | |
*** yamamoto has joined #openstack-nova | 10:50 | |
*** tbachman has quit IRC | 10:50 | |
*** yamamoto has quit IRC | 10:53 | |
*** yamamoto has joined #openstack-nova | 10:53 | |
*** yamamoto has quit IRC | 10:53 | |
*** jpena is now known as jpena|lunch | 10:59 | |
openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Clean up TODOs in allocations.yaml gabbit https://review.openstack.org/513057 | 10:59 |
*** yangyape_ has quit IRC | 11:01 | |
*** yamamoto has joined #openstack-nova | 11:02 | |
*** phuongnh has quit IRC | 11:02 | |
*** sree has quit IRC | 11:05 | |
*** markus_z has quit IRC | 11:10 | |
*** jdavis has joined #openstack-nova | 11:11 | |
*** smatzek has joined #openstack-nova | 11:12 | |
*** yassine has joined #openstack-nova | 11:17 | |
*** vladikr has joined #openstack-nova | 11:22 | |
*** lucasagomes is now known as lucas-hungry | 11:22 | |
gibi | bauzas: sorry, I was pulled into internal meeting for the whole morning. But I agree with your judgement on https://review.openstack.org/#/c/444731/8 | 11:23 |
*** AlexeyAbashkin has quit IRC | 11:24 | |
*** AlexeyAbashkin has joined #openstack-nova | 11:26 | |
*** markvoelker has joined #openstack-nova | 11:27 | |
sahid | jaypipes: hola, i just updated the vf trusted specs, basically now it's just about to pass a tag in the binding and operator will have to isolate group of hosts | 11:30 |
sahid | they were a part where you asked me to use traits for the binding, can you have a look and perhaps suggest me what you want exactly? | 11:31 |
sahid | jaypipes: here is the link https://review.openstack.org/#/c/485522/ so you don't even have to search for the pointer :) | 11:32 |
*** nicolasbock has joined #openstack-nova | 11:32 | |
*** chyka has joined #openstack-nova | 11:32 | |
*** smatzek has quit IRC | 11:33 | |
*** itlinux has joined #openstack-nova | 11:34 | |
*** chyka has quit IRC | 11:37 | |
*** nicolasbock has quit IRC | 11:38 | |
dtantsur | johnthetubaguy: mind checking https://review.openstack.org/#/c/511844/ please? | 11:41 |
*** nicolasbock has joined #openstack-nova | 11:50 | |
*** AlexeyAbashkin has quit IRC | 11:51 | |
*** edmondsw has joined #openstack-nova | 11:51 | |
*** eharney has joined #openstack-nova | 11:52 | |
*** salv-orlando has quit IRC | 11:54 | |
*** mvk has quit IRC | 11:54 | |
*** AlexeyAbashkin has joined #openstack-nova | 11:55 | |
*** sree has joined #openstack-nova | 11:56 | |
*** rcernin has joined #openstack-nova | 11:58 | |
*** sree has quit IRC | 12:01 | |
*** jpena|lunch is now known as jpena | 12:02 | |
*** mvk has joined #openstack-nova | 12:07 | |
bauzas | who knows IRC nick of https://www.openstack.org/community/members/profile/33046/zhenyu-zheng ? | 12:09 |
*** cdent has quit IRC | 12:10 | |
*** litao__ has quit IRC | 12:10 | |
*** cdent has joined #openstack-nova | 12:10 | |
yikun_jiang | @bauzas Kevin_Zheng | 12:12 |
*** dave-mccowan has joined #openstack-nova | 12:12 | |
bauzas | yikun_jiang: ty | 12:12 |
bauzas | Kevin_Zheng: around ? | 12:12 |
bauzas | Kevin_Zheng: just about https://review.openstack.org/#/c/509326/6 | 12:12 |
cdent | bauzas: yikun_jiang beat me to it, but my usual trick is to search launchpad: https://launchpad.net/+search?field.text=zhenyu-zheng | 12:12 |
*** dillaman has joined #openstack-nova | 12:13 | |
Kevin_Zheng | bauzas what’s up? | 12:13 |
bauzas | Kevin_Zheng: if you could provide a follow-up change for all the nits, would be awesome :) | 12:13 |
*** thorst has joined #openstack-nova | 12:13 | |
*** psachin has quit IRC | 12:13 | |
Kevin_Zheng | bauzas: sure I can do that | 12:13 |
bauzas | that's not urgent, but wanted to make sure you saw the points | 12:13 |
bauzas | Kevin_Zheng: thank you ! | 12:13 |
Kevin_Zheng | bauzas: np | 12:14 |
bauzas | cdent: I usually use https://www.openstack.org/community/members/ for that :) | 12:14 |
bauzas | btw, Kevin_Zheng it would be nice if you could add your nick there ^ | 12:15 |
*** salv-orlando has joined #openstack-nova | 12:15 | |
*** itlinux has quit IRC | 12:15 | |
Kevin_Zheng | I will try tomorrow:) | 12:15 |
cdent | bauzas: sure, but a combo of both sometimes gets us there | 12:16 |
* cdent gets lunch | 12:17 | |
*** cdent has quit IRC | 12:17 | |
*** bkopilov has joined #openstack-nova | 12:18 | |
*** rmart04 has joined #openstack-nova | 12:19 | |
*** peter-hamilton has joined #openstack-nova | 12:25 | |
*** dtantsur is now known as dtantsur|brb | 12:26 | |
*** catintheroof has joined #openstack-nova | 12:27 | |
*** yangyapeng has joined #openstack-nova | 12:29 | |
*** tssurya has quit IRC | 12:30 | |
*** lajoskatona has quit IRC | 12:30 | |
*** lajoskatona has joined #openstack-nova | 12:30 | |
*** jamesdenton has joined #openstack-nova | 12:30 | |
*** tssurya has joined #openstack-nova | 12:30 | |
openstackgerrit | Merged openstack/nova-specs master: Improve the performance of filtering instances by IP. https://review.openstack.org/509326 | 12:36 |
*** catintheroof has quit IRC | 12:42 | |
*** jaosorior has joined #openstack-nova | 12:43 | |
*** lucas-hungry is now known as lucasagomes | 12:43 | |
*** bbbbzhao_ has joined #openstack-nova | 12:44 | |
*** mriedem has joined #openstack-nova | 12:44 | |
*** liverpooler has joined #openstack-nova | 12:47 | |
*** yikun has joined #openstack-nova | 12:48 | |
*** catintheroof has joined #openstack-nova | 12:51 | |
johnthetubaguy | dtantsur|brb: will take a look at that ASAP | 12:52 |
*** catintheroof has quit IRC | 12:53 | |
*** pchavva has joined #openstack-nova | 12:53 | |
*** lyan has joined #openstack-nova | 12:54 | |
*** hemna_ has joined #openstack-nova | 12:55 | |
*** StevenK has quit IRC | 12:59 | |
*** cdent has joined #openstack-nova | 13:02 | |
*** jdavis has quit IRC | 13:06 | |
*** yassine has quit IRC | 13:08 | |
*** yassine has joined #openstack-nova | 13:09 | |
*** tbachman has joined #openstack-nova | 13:09 | |
*** baoli has joined #openstack-nova | 13:11 | |
*** mdnadeem has quit IRC | 13:12 | |
*** baoli has quit IRC | 13:12 | |
*** sbezverk has joined #openstack-nova | 13:13 | |
*** StevenK has joined #openstack-nova | 13:16 | |
*** StevenK is now known as Guest25792 | 13:16 | |
openstackgerrit | sean mooney proposed openstack/nova-specs master: Use neutron's new port binding API https://review.openstack.org/375580 | 13:18 |
*** crushil has joined #openstack-nova | 13:18 | |
*** Guest25792 is now known as StevenK | 13:18 | |
bauzas | mriedem: I think you made valid points on https://review.openstack.org/#/c/334732/65/specs/queens/approved/abort-cold-migration.rst but maybe we shouldn't block on those | 13:19 |
*** baoli has joined #openstack-nova | 13:19 | |
*** rmcall has joined #openstack-nova | 13:20 | |
sean-k-mooney | mriedem: i dont know if you saw http://lists.openstack.org/pipermail/openstack-dev/2017-October/123776.html in your inbox. does that carify the desire workflow? | 13:21 |
*** rcernin has quit IRC | 13:21 | |
bauzas | mriedem: for the virt drivers support, maybe just making sure we update https://docs.openstack.org/nova/latest/user/support-matrix.html and https://docs.openstack.org/nova/latest/user/feature-classification.html could be a starting point, nope ? | 13:21 |
gibi | bauzas, mriedem: I added some comments on the cold migration patch regarding the notification impact but as a second thought we can do the notification impact in a later spec if we don't want to block on core of the feature | 13:23 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/nova-specs master: Network bandwidth resource provider https://review.openstack.org/502306 | 13:25 |
*** itlinux has joined #openstack-nova | 13:27 | |
*** awaugama has joined #openstack-nova | 13:28 | |
*** edand has quit IRC | 13:35 | |
*** rcernin has joined #openstack-nova | 13:35 | |
*** rcernin has quit IRC | 13:40 | |
*** andreas_s has quit IRC | 13:41 | |
*** andreas_s has joined #openstack-nova | 13:42 | |
*** felipemonteiro has joined #openstack-nova | 13:44 | |
*** amodi has joined #openstack-nova | 13:45 | |
*** felipemonteiro__ has joined #openstack-nova | 13:45 | |
*** andreas_s has quit IRC | 13:46 | |
*** mriedem1 has joined #openstack-nova | 13:47 | |
*** andreas_s has joined #openstack-nova | 13:48 | |
*** mriedem has quit IRC | 13:48 | |
cdent | johnthetubaguy: yeah my allocations concern was definitely a long term thing. I don’t think it i something we need to do anything about now, but it feels like something we need in our brains. We get in the habit too often of dimissing the long term picture (because of all the usual constraints). So it was mostly just a reminder. | 13:48 |
mriedem1 | sean-k-mooney: i'm not sure that it does. your email is about the bw aware scheduling stuff. it also says you want nova to make allocations on the bw provider from conductor, but that's not really something we're wanting to do for anything else. we want allocations made in the scheduler if nova is going to make them. but i think neutron should manage the allocations for bw providers since the port is the consumer. | 13:48 |
*** mriedem1 is now known as mriedem | 13:48 | |
mriedem | bauzas: i'll look again | 13:48 |
johnthetubaguy | cdent: yeah, +1 that. I was really just making sure its not a short term blocker. | 13:49 |
*** felipemonteiro has quit IRC | 13:49 | |
cdent | johnthetubaguy: *nod* we do allocate for disk that is shared, by treating it as local… | 13:49 |
*** edand has joined #openstack-nova | 13:51 | |
*** andreas_s has quit IRC | 13:53 | |
*** xyang1 has joined #openstack-nova | 13:54 | |
mriedem | bauzas: i'm interested in knowing what type of storage backend NTT is using and the size of these disks that's causing the cold migration to take so long that a user has to submit a support ticket to an admin to abort the cold migration | 13:55 |
bauzas | that's indeed a good point | 13:55 |
mriedem | like, how long does it take to cold migrate a 100GB disk vm backed by ceph? | 13:55 |
mriedem | cburgess: ^? | 13:56 |
johnthetubaguy | cdent: "nova managed" is how I like to think of that, I wish we could get out of the disk and image business altogether, long term. | 13:56 |
*** lajoskatona has quit IRC | 13:56 | |
*** takashin has joined #openstack-nova | 13:57 | |
cdent | johnthetubaguy: yup, that would be nice. I wonder if that means we’re going to need to break away from the idea that only one thing should be writing all the allocations associated with a build? <- probably best to just store those worms back in the can for sometime later | 13:58 |
johnthetubaguy | cdent: get that lid back on :p | 13:59 |
* johnthetubaguy secretly nods | 13:59 | |
*** andreas_s has joined #openstack-nova | 13:59 | |
*** Tom__ has joined #openstack-nova | 14:00 | |
mriedem | meeting time | 14:00 |
*** hongbin has joined #openstack-nova | 14:03 | |
*** josecastroleon has joined #openstack-nova | 14:04 | |
*** josecastroleon has quit IRC | 14:04 | |
*** Tom__ has quit IRC | 14:04 | |
*** lbragstad has joined #openstack-nova | 14:04 | |
*** josecastroleon has joined #openstack-nova | 14:05 | |
*** esberglu has joined #openstack-nova | 14:07 | |
*** itlinux has quit IRC | 14:07 | |
*** andreas_s has quit IRC | 14:08 | |
*** baoli has quit IRC | 14:09 | |
*** baoli has joined #openstack-nova | 14:09 | |
*** baoli has quit IRC | 14:09 | |
*** baoli has joined #openstack-nova | 14:11 | |
*** andreas_s has joined #openstack-nova | 14:11 | |
jaypipes | sahid: k. reviewing it again. | 14:12 |
jaypipes | sahid: see also: https://twitter.com/jaypipes/status/920739280603009024 | 14:12 |
*** burt has joined #openstack-nova | 14:15 | |
*** suresh12 has joined #openstack-nova | 14:15 | |
*** itlinux has joined #openstack-nova | 14:17 | |
jaypipes | sdague: around? hoping you could help me spot what the issue is with sahid's spec not passing the sphinx-docs job here: https://review.openstack.org/#/c/485522/ | 14:19 |
jaypipes | sdague: can't seem to see anything in the logs.. | 14:19 |
*** Swami has joined #openstack-nova | 14:20 | |
*** gouthamr has joined #openstack-nova | 14:20 | |
efried | jaypipes http://logs.openstack.org/22/485522/3/check/build-openstack-sphinx-docs/3402883/job-output.txt.gz#_2017-10-19_08_16_47_666988 | 14:20 |
efried | wherezat log? | 14:21 |
efried | cause it looks like a sphinx bug masked the real problem. | 14:21 |
jaypipes | efried: well, yeah, I saw THAT. :) I'm just saying that isn't useful | 14:21 |
efried | I'll build it locally and see if I can get at the real problem. | 14:22 |
jaypipes | efried: ok, cool thank you sir. | 14:22 |
efried | jaypipes sahid: Warning, treated as error: /home/efried/Neo/nova-specs/doc/source/specs/queens/approved/sriov-trusted-vfs.rst:166:Footnote [5] is not referenced. | 14:24 |
efried | Couldn't repro that other thing, though. | 14:25 |
jaypipes | efried: hey, thanks for doing that research. appreciated. | 14:25 |
efried | yahyoubetcha. | 14:25 |
*** gmann is now known as gmann_afk | 14:26 | |
sdague | jaypipes: did efried figure the whole thing out? | 14:28 |
jaypipes | sdague: seems he did indeed. | 14:28 |
jaypipes | sdague: sorry for the bother. | 14:28 |
efried | sdague No, I haven't found where sphinx is missing a param to a log message. | 14:28 |
efried | sdague See http://logs.openstack.org/22/485522/3/check/build-openstack-sphinx-docs/3402883/job-output.txt.gz#_2017-10-19_08_16_47_666988 | 14:29 |
efried | That didn't hit when I built locally. | 14:29 |
jaypipes | efried: but you identified the thing that's causing an error in the spec itself. | 14:29 |
efried | Yeah. Though interestingly, when I rebuilt with tox -r, it passed. | 14:29 |
efried | which is... weird. | 14:29 |
sdague | sunspots | 14:29 |
sean-k-mooney | mriedem: hi well we could do the allocation in the scheduler also i just want them to happen before we call to the compute node. | 14:30 |
sean-k-mooney | mriedem: if you want neutorn to do it the i would make that allocations be part of the bind port. | 14:31 |
efried | sean-k-mooney mriedem Have we considered doing the allocation from neutron at port binding time | 14:31 |
efried | yeah, THAT. | 14:31 |
mriedem | yeah that's what i suggested in the spec | 14:32 |
efried | Then we close the window for races between [port binding succeeds] and [allocation fails] | 14:32 |
sean-k-mooney | efried:i was looking a at that code today | 14:32 |
mriedem | the port binding could fail as a result of the allocation failing, but then it's all managed within neutron | 14:32 |
*** tbachman has quit IRC | 14:32 | |
cdent | i also think neutron should do the allocation | 14:32 |
efried | Cool. And the `consumer` of the allocation is who? The port or the instance? (My vote is the port.) | 14:33 |
sean-k-mooney | efried: we can do it as an else to https://github.com/openstack/neutron/blob/1b3f982914d82494c63ac4fee405bf4972d2db32/neutron/plugins/ml2/managers.py#L748 | 14:33 |
cdent | that’s what is currently suggested on the spc, no? | 14:33 |
cdent | (that == port) | 14:33 |
efried | It wasn't clear to me in the spec. | 14:33 |
dansmith | allocation of what class? | 14:33 |
sean-k-mooney | cdent: proably i have been in a meeting for the last little bit and have not looked at the lates version | 14:33 |
cdent | sean-k-mooney: I dumped some thoughts on ps13 and then a new version happened which isn’t hugely different | 14:34 |
efried | dansmith Yeah. At least the "bandwidth" - but that's a future thing. The network interface resource, whatever that is. E.g. a VF or OVS port. | 14:34 |
sean-k-mooney | dansmith: allocation of bandwidth or vifs | 14:34 |
*** itlinux has quit IRC | 14:34 | |
cdent | efried: are we talking about the same spec (I’m talking about the network bandwidth rp one) | 14:34 |
efried | ^ | 14:34 |
dansmith | ah, bandwidth | 14:35 |
efried | cdent We're mostly talking about the 'new neutron port binding api' spec | 14:35 |
dansmith | that means the scheduler can't pick a host with suitable bandwidth for the migration though right? | 14:35 |
efried | cdent but bleeding into the bw rp one. | 14:35 |
sean-k-mooney | cdent: cool ill re read. if the neutron folks are oke with it ill update it shortly | 14:35 |
dansmith | or for a new build for that matter | 14:36 |
cdent | efried: that one is somewhere in the my “next” queue | 14:36 |
sean-k-mooney | efried: yes these two are tightly coupled in some respects | 14:36 |
efried | dansmith Can pick it, but wouldn't allocate it. | 14:36 |
*** READ10 has joined #openstack-nova | 14:36 | |
*** armax has joined #openstack-nova | 14:36 | |
dansmith | efried: == resource race == fail | 14:36 |
sean-k-mooney | dansmith: it can do a first pass without knowing the network backend and then we do the port bind in the conducto before casting to the compute | 14:36 |
mriedem | gibi: this is very simple if you can take a look https://review.openstack.org/#/c/512626/ | 14:36 |
efried | How do we get around a race *somewhere*? | 14:37 |
gibi | mriedem: looking... | 14:37 |
sean-k-mooney | dansmith: we might be able to do it in the schduler but have not look to see where yet | 14:37 |
dansmith | sean-k-mooney: efried: that gets us a two-phase commit of allocations and we have to rollback from those both and then reschedule.. avoiding that is the whole point of doing this in the scheduler | 14:37 |
*** rmcall has quit IRC | 14:37 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Migrate from 'ip' commands to 'pyroute2' https://review.openstack.org/484386 | 14:37 |
efried | Yeah, definitely don't disagree with that. But we're also doing a "bind early, fail early" thing with the port. | 14:38 |
sean-k-mooney | dansmith: well thats one of the reasons i want nova to do the claim instead of neutron | 14:38 |
efried | So either we [bind early, allocate late] and have the race there, or [bind early & allocate network stuff early, allocate non-network stuff late] and have the race there. | 14:38 |
*** spectr has quit IRC | 14:38 | |
efried | I guess the former is cleaner. | 14:39 |
dansmith | um | 14:39 |
mriedem | tbc, the 'use neutron port binding API' spec is really not the same thing here, has nothing to do with allocations - it's about using port binding during live migration | 14:39 |
mriedem | we should have probably renamed that spec title :) | 14:39 |
mriedem | the bw provider one is the thing talking about claims | 14:39 |
mriedem | the call i setup in 20 minutes is about the live migration spec, not the bw provider one | 14:39 |
dansmith | yeah, I'm clearly missing some context from the bw one since I'm thinking about the live migration one | 14:39 |
mriedem | yes people are blurring them | 14:39 |
efried | mriedem Regardless, there needs to be a stake in the ground about who's the consumer of the nw resource, who does the allocation, and when. | 14:40 |
dansmith | effing people | 14:40 |
mriedem | efried: that doesn't have to be decided for https://review.openstack.org/#/c/375580/ | 14:40 |
efried | Unless the vif isn't a resource.... | 14:40 |
mriedem | the call in 20 minutes is for ^ | 14:40 |
mriedem | because i can actually see that getting done in queens | 14:40 |
mriedem | i can't see bw provider getting done in queens | 14:40 |
mriedem | it's dependent on at least 3 other things and we're unclear on the design still | 14:41 |
*** efried is now known as efried|brb | 14:41 | |
*** gyee has joined #openstack-nova | 14:42 | |
sean-k-mooney | mriedem: idealy though we would use the same workflow for spawning a new instance as we do for moving an instance | 14:43 |
sean-k-mooney | mriedem: interms of when and where we claim resouces | 14:43 |
mriedem | i don't disagree, but today we aren't claiming anything in placement for networking | 14:44 |
sean-k-mooney | mriedem: how did you sent that invite by the way? it went straight into my calander and i dont see the email at all | 14:44 |
sean-k-mooney | mriedem: well we are for routed networks correct? | 14:46 |
sean-k-mooney | mriedem: or is that done by neutron? | 14:46 |
mriedem | sean-k-mooney: nova doesn't do anything for routed networks yet | 14:46 |
sean-k-mooney | ok that must be in nova so. | 14:47 |
mriedem | that was related to johnthetubaguy's prep for network-aware scheduling thing | 14:47 |
sean-k-mooney | *neutron | 14:47 |
mriedem | neutron is doing something yes | 14:47 |
johnthetubaguy | the only bit nova does is not error when a port has no ip if its on a routed network | 14:48 |
dansmith | heh | 14:49 |
dansmith | the only thing nova does is not explode | 14:49 |
sean-k-mooney | just pinging mlavlle on the neutron channel to see if he is oke with doing the claim in the port bind. if so ill update the neutron and nova spec to reflect that | 14:49 |
dansmith | sean-k-mooney: hold up dude, | 14:49 |
*** suresh12 has quit IRC | 14:49 | |
dansmith | we should have a discussion, because I think we're missing something important if we do it that way | 14:49 |
*** nikhil has joined #openstack-nova | 14:50 | |
sean-k-mooney | dansmith: im not going to update anything untill after the call | 14:50 |
dansmith | okay | 14:50 |
sean-k-mooney | i just want to get his initall reaction | 14:50 |
sean-k-mooney | if its a non starter from a neutron perspective that is good to know :) | 14:51 |
*** efried|brb is now known as efried | 14:51 | |
*** yamamoto has quit IRC | 14:54 | |
mriedem | again, the primary purpose of the call is about the live migration spec, not the bw provider spec, | 14:56 |
mriedem | if there is time i'm sure we can get into that | 14:56 |
*** rodolof has quit IRC | 14:57 | |
sean-k-mooney | mriedem: right be we still need to decide on where to do the port bind and activate the binding for the live migration too so we can regenerate the xml if needed | 14:57 |
*** rodolof has joined #openstack-nova | 14:57 | |
sean-k-mooney | mriedem: for example vhost-user socket path changes or you migrate form linux bridge to ovs | 14:58 |
*** yikun has quit IRC | 14:58 | |
mriedem | johnthetubaguy: were you going to join? | 15:02 |
*** jaosorior has quit IRC | 15:02 | |
johnthetubaguy | mriedem: ah, I didn't get the invite / behind on mail | 15:02 |
mriedem | https://hangouts.google.com/hangouts/_/calendar/bWF0dHJpZWQyMkBnbWFpbC5jb20.6jrqpj946jj56uo6dsuj4gnmjj | 15:02 |
*** sshwarts has quit IRC | 15:05 | |
*** josecastroleon has quit IRC | 15:06 | |
*** baoli has quit IRC | 15:07 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: cover migration cases with functional tests https://review.openstack.org/493865 | 15:07 |
*** baoli has joined #openstack-nova | 15:08 | |
*** baoli has quit IRC | 15:08 | |
*** dtantsur|brb is now known as dtantsur | 15:08 | |
*** Oku_OS is now known as Oku_OS-away | 15:10 | |
*** baoli has joined #openstack-nova | 15:11 | |
*** markvoelker has quit IRC | 15:12 | |
*** markvoelker has joined #openstack-nova | 15:13 | |
*** acormier has quit IRC | 15:14 | |
*** acormier has joined #openstack-nova | 15:14 | |
*** penick has joined #openstack-nova | 15:15 | |
*** edand has quit IRC | 15:16 | |
*** nicolasbock has quit IRC | 15:17 | |
*** markvoelker has quit IRC | 15:17 | |
*** acormier has quit IRC | 15:18 | |
*** nicolasbock has joined #openstack-nova | 15:18 | |
openstackgerrit | Merged openstack/nova-specs master: Add serial numbers for local disks https://review.openstack.org/511466 | 15:20 |
openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Abort Cold Migration https://review.openstack.org/334732 | 15:21 |
*** MVenesio has joined #openstack-nova | 15:21 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Abort Cold Migration https://review.openstack.org/334732 | 15:21 |
*** nicolasbock has quit IRC | 15:22 | |
*** suresh12 has joined #openstack-nova | 15:23 | |
*** suresh12 has quit IRC | 15:23 | |
*** suresh12 has joined #openstack-nova | 15:23 | |
*** penick has quit IRC | 15:23 | |
stvnoyes | Hi nova cores, There's a stale bugfix review (https://review.openstack.org/#/c/389798) that needs a core review. It's a pretty simple change (in the nova compute api) so it should hopefully be quick(?). Thanks. | 15:24 |
*** penick has joined #openstack-nova | 15:26 | |
*** takashin has left #openstack-nova | 15:27 | |
*** andreas_s has quit IRC | 15:28 | |
*** mvk has quit IRC | 15:30 | |
*** rmart04 has quit IRC | 15:31 | |
*** crushil has quit IRC | 15:32 | |
*** andreas_s has joined #openstack-nova | 15:33 | |
*** andreas_s has quit IRC | 15:37 | |
*** zphir has joined #openstack-nova | 15:39 | |
*** zphir has quit IRC | 15:40 | |
bauzas | graaaah, the Gerrit flickering when you open a comment makes me mad | 15:40 |
*** chyka has joined #openstack-nova | 15:41 | |
efried | bauzas If you can snap a video of that happening, send it to sdague | 15:42 |
*** andreas_s has joined #openstack-nova | 15:42 | |
bauzas | jaypipes: I officially hereby invoke your SQL skills and ask you if you know if SQLA can support an index of a tuple of multiple fields where one of them comes from a inherited mixin | 15:43 |
bauzas | jaypipes: context being https://review.openstack.org/#/c/507762/12 | 15:43 |
bauzas | that's where a POC would help a specs review :) | 15:44 |
dansmith | bauzas: reports are that if you set render=slow it will be better about that | 15:44 |
sdague | I apparently have never seen this thing (or noticed it) | 15:46 |
jaypipes | bauzas: you can include fields from a mixin into an index, sure. | 15:46 |
*** andreas_s has quit IRC | 15:47 | |
jaypipes | bauzas: added a comment (and link to an example) to the spec | 15:48 |
bauzas | jaypipes: oh fsck, deleted of course | 15:49 |
openstackgerrit | Ed Leafe proposed openstack/nova master: Remove the Pike migration code for flavor migration https://review.openstack.org/494206 | 15:49 |
* bauzas facepalms | 15:49 | |
bauzas | but yeah the tuple is wrong then, since we support soft-deletions for instance actions... | 15:50 |
bauzas | not sure you can really *delete* an action tho | 15:50 |
bauzas | dansmith: sorry, WDYM ? | 15:52 |
jaypipes | bauzas: the gerrit flickering annoyance. | 15:52 |
efried | bauzas Go into settings => diff preferences and set Render => Slow | 15:53 |
dansmith | bauzas: https://imgur.com/a/Oq5rw | 15:53 |
dansmith | bauzas: gerrit, diff settings, render -> slow | 15:53 |
bauzas | aaaah cool | 15:53 |
jaypipes | bauzas: go to settings, then diff prefs, then render => slow. | 15:53 |
bauzas | ta ! | 15:53 |
jaypipes | lol, three of us :) | 15:53 |
efried | I win | 15:53 |
dansmith | what? I was totally first | 15:53 |
dansmith | by six seconds | 15:53 |
bauzas | dansmith: +1 marmelade | 15:53 |
dansmith | hehe | 15:53 |
bauzas | dansmith: you should seriously consider then a checked-in luggage :p | 15:54 |
dansmith | willd o | 15:54 |
dansmith | er, will do | 15:54 |
*** yamamoto has joined #openstack-nova | 15:55 | |
openstackgerrit | John Griffith proposed openstack/nova-specs master: Add multiattach support to Nova https://review.openstack.org/499777 | 15:57 |
*** jgriffith is now known as groot | 16:03 | |
*** groot is now known as jgriffith | 16:04 | |
*** jgriffith is now known as groot | 16:05 | |
*** lpetrut has quit IRC | 16:07 | |
*** ttsiouts has quit IRC | 16:08 | |
*** andreas_s has joined #openstack-nova | 16:09 | |
*** lucasagomes is now known as lucas-afk | 16:09 | |
*** yamamoto has quit IRC | 16:11 | |
*** salv-orl_ has joined #openstack-nova | 16:11 | |
*** Swami has quit IRC | 16:12 | |
*** Apoorva has joined #openstack-nova | 16:12 | |
*** abhi89 has quit IRC | 16:14 | |
*** andreas_s has quit IRC | 16:14 | |
*** salv-orlando has quit IRC | 16:14 | |
bauzas | stephenfin: honestly, if all is about code refactoring for Queens, I don't think it needs a spec *unless two points* | 16:16 |
bauzas | #1 we don't use a new framework | 16:16 |
bauzas | #2 we don't change the consumed interface we have for all our customers | 16:16 |
stephenfin | You mean *assuming* those things? | 16:16 |
stephenfin | As opposed to unless | 16:17 |
bauzas | in other words, if we still have a backwards-compatible behaviour | 16:17 |
stephenfin | The CLI won't change from a users perspective | 16:17 |
bauzas | stephenfin: my point is that you said there are multiple issues | 16:17 |
stephenfin | All that will change is return code and docs | 16:17 |
*** penick has quit IRC | 16:17 | |
stephenfin | And the return code one could wait | 16:17 |
bauzas | I'd love to see what could be done without cliff and what other things need it | 16:17 |
stephenfin | We would be changing the framework, though end-users won't see this | 16:17 |
*** pcaruana has quit IRC | 16:18 | |
stephenfin | I'm not dropping the cliff bit - it's still the main reason for this :) | 16:18 |
openstackgerrit | Eric Fried proposed openstack/nova master: Service user token requested with no auth https://review.openstack.org/512329 | 16:18 |
stephenfin | Otherwise is just deleting some dead code but no more. cliff delivers enough tangible benefits to justify its inclusion | 16:18 |
stephenfin | and means nova is using the exact same tooling as everyone else in OpenStack | 16:18 |
stephenfin | *CLI tooling | 16:18 |
bauzas | stephenfin: what I'm saying is that we don't need a spec for something just pure internal refactoring, but I guess pulling a dependency like cliff is more than just internal refactoring | 16:19 |
bauzas | stephenfin: how do you see the implementation path ? | 16:19 |
stephenfin | Yeah, I'm not sure if it is, hence the question :) | 16:19 |
stephenfin | Pretty much what I said in the spec (I think) | 16:19 |
bauzas | stephenfin: fix first some issues, then use cliff for only some subcommands? | 16:19 |
stephenfin | Dump all the deprecated stuff | 16:19 |
bauzas | or do you plan to just change all at once ? | 16:19 |
*** markvoelker has joined #openstack-nova | 16:20 | |
bauzas | stephenfin: the problem is that a cliff move would be like super low priority | 16:20 |
bauzas | so I'm afraid that effort could be multi-cycle | 16:20 |
*** yassine has quit IRC | 16:20 | |
bauzas | hence my question about how you plan to migrate all the existing commands | 16:21 |
stephenfin | I plan to add the cliff stuff one by one with tests, but not register the 'console_scripts' entry points | 16:21 |
stephenfin | then, once it's done, we switch entry points and delete all the existing crud | 16:21 |
openstackgerrit | Eric Fried proposed openstack/nova master: Service user token requested with no auth https://review.openstack.org/512329 | 16:21 |
*** MVenesio has quit IRC | 16:21 | |
*** penick has joined #openstack-nova | 16:21 | |
bauzas | 'one by one', one being a subcommand like Cellv2 ? | 16:21 |
*** Apoorva has quit IRC | 16:21 | |
stephenfin | Yup | 16:21 |
*** Apoorva has joined #openstack-nova | 16:22 | |
stephenfin | You wouldn't be able to run any of them via the command-line but they'd have unit tests | 16:22 |
stephenfin | There's only four or five sub-commands to migrate once the deprecated stuff is removed, in fairness | 16:22 |
bauzas | if I'm using the existing CLI, would I go thru a different codepath ? | 16:23 |
stephenfin | Also, I know it's low priority. This is purely a tech debt reductionexercise | 16:23 |
stephenfin | For the CLI aspects of it, yes | 16:23 |
bauzas | FWIW, I played with cliff but it lasts (4 or 5 years I don't remember exactly) | 16:23 |
stephenfin | For the actual underlying command, shared code path | 16:23 |
bauzas | k | 16:24 |
stephenfin | new UTs would only exercise the arg parsers plus any gaps I will uncover | 16:24 |
bauzas | mriedem: do you think we would really a spec for the above ? | 16:24 |
*** markvoelker has quit IRC | 16:24 | |
bauzas | mriedem: honestly a specless BP seems good if we don't change the CLI | 16:24 |
bauzas | then we could defer the CLI change in a Rocky spec I guess | 16:25 |
*** andreas_s has joined #openstack-nova | 16:28 | |
*** suresh12 has quit IRC | 16:29 | |
*** crushil has joined #openstack-nova | 16:30 | |
*** penick_ has joined #openstack-nova | 16:30 | |
*** andreas_s has quit IRC | 16:32 | |
*** ralonsoh has quit IRC | 16:33 | |
*** penick has quit IRC | 16:33 | |
stephenfin | bauzas: Just to reiterate, the CLI won't change from a usage perspective (minus some help messages, return codes). How it's implemented under the hood would | 16:37 |
*** crushil has quit IRC | 16:38 | |
*** yamamoto has joined #openstack-nova | 16:39 | |
*** lpetrut has joined #openstack-nova | 16:43 | |
*** bnemec has quit IRC | 16:45 | |
*** bnemec has joined #openstack-nova | 16:46 | |
*** AlexeyAbashkin has quit IRC | 16:46 | |
*** Apoorva_ has joined #openstack-nova | 16:46 | |
*** yamahata has joined #openstack-nova | 16:49 | |
openstackgerrit | Eric Fried proposed openstack/nova master: [Trivial] Fix up a docstring https://review.openstack.org/513447 | 16:50 |
efried | sdague ^ that's been on my backlog for a while :) | 16:50 |
*** Apoorva has quit IRC | 16:50 | |
*** jpena is now known as jpena|off | 16:52 | |
*** Apoorva_ has quit IRC | 16:52 | |
sdague | +A | 16:53 |
*** slaweq_ has joined #openstack-nova | 16:53 | |
*** Apoorva has joined #openstack-nova | 16:53 | |
*** yamamoto has quit IRC | 16:53 | |
*** ijw has joined #openstack-nova | 16:54 | |
*** chohoor has quit IRC | 16:55 | |
*** lpetrut has quit IRC | 16:57 | |
*** ijw has quit IRC | 17:00 | |
*** derekh has quit IRC | 17:00 | |
*** ijw has joined #openstack-nova | 17:02 | |
*** slaweq_ has quit IRC | 17:02 | |
*** amodi has quit IRC | 17:02 | |
*** slaweq_ has joined #openstack-nova | 17:03 | |
*** dtantsur is now known as dtantsur|afk | 17:04 | |
*** sambetts is now known as sambetts|afk | 17:04 | |
*** READ10 has quit IRC | 17:04 | |
*** andreas_s has joined #openstack-nova | 17:04 | |
*** tesseract has quit IRC | 17:04 | |
*** felipemonteiro__ has quit IRC | 17:05 | |
*** lpetrut has joined #openstack-nova | 17:10 | |
*** slaweq_ has quit IRC | 17:12 | |
*** bbbbzhao_ has quit IRC | 17:12 | |
*** slaweq_ has joined #openstack-nova | 17:13 | |
dansmith | jaypipes: are you working on a rev to 415921? | 17:17 |
*** slaweq_ has quit IRC | 17:17 | |
*** efried is now known as efried|afk | 17:18 | |
*** smatzek has joined #openstack-nova | 17:19 | |
*** suresh12 has joined #openstack-nova | 17:19 | |
*** suresh12 has quit IRC | 17:20 | |
*** suresh12_ has joined #openstack-nova | 17:20 | |
*** fragatina has quit IRC | 17:23 | |
*** salv-orlando has joined #openstack-nova | 17:25 | |
*** salv-orl_ has quit IRC | 17:29 | |
*** salv-orlando has quit IRC | 17:30 | |
*** andreas_s has quit IRC | 17:31 | |
*** smatzek has quit IRC | 17:32 | |
mriedem | ildikov: ok notes are in https://review.openstack.org/#/c/499777/ | 17:32 |
mriedem | groot: johnthetubaguy: ^ | 17:32 |
*** gjayavelu has joined #openstack-nova | 17:33 | |
*** lbragstad has quit IRC | 17:35 | |
ildikov | mriedem: thanks! | 17:35 |
*** groot is now known as jgriffith | 17:38 | |
*** Swami has joined #openstack-nova | 17:39 | |
*** lbragstad has joined #openstack-nova | 17:39 | |
*** andreas_s has joined #openstack-nova | 17:41 | |
*** mriedem has quit IRC | 17:41 | |
*** mriedem has joined #openstack-nova | 17:43 | |
*** andreas_s has quit IRC | 17:45 | |
ildikov | mriedem: johnthetubaguy: how much time do I have to upload the new version? | 17:47 |
*** amodi has joined #openstack-nova | 17:51 | |
*** MVenesio has joined #openstack-nova | 17:58 | |
*** baoli has quit IRC | 17:58 | |
openstackgerrit | sahid proposed openstack/nova-specs master: virt: allow instances to be booted with trusted VFs https://review.openstack.org/485522 | 17:59 |
openstackgerrit | Ildiko Vancsa proposed openstack/nova-specs master: Add multiattach support to Nova https://review.openstack.org/499777 | 17:59 |
melwitt | mriedem: I was talking to penick_ the other day and they've been testing ocata internally, and noticed delete is really slow (same as you encountered in your devstack fakedriver testing) | 18:00 |
ildikov | mriedem: johnthetubaguy: jgriffith: new old version of the spec ^^ | 18:00 |
melwitt | as in, the REST API call returns fast but it takes like a minute for the instance to disappear | 18:01 |
melwitt | hopefully they can investigate but I've made myself a TODO to look into it when I get a chance | 18:01 |
*** andreas_s has joined #openstack-nova | 18:03 | |
*** tbachman has joined #openstack-nova | 18:04 | |
*** felipemonteiro has joined #openstack-nova | 18:06 | |
*** baoli has joined #openstack-nova | 18:07 | |
*** felipemonteiro__ has joined #openstack-nova | 18:07 | |
jaypipes | dansmith: yes | 18:07 |
dansmith | alright. | 18:09 |
mriedem | ildikov: 4 hours? | 18:11 |
*** felipemonteiro has quit IRC | 18:11 | |
ildikov | mriedem: uploaded a new version plz check :) | 18:11 |
mriedem | melwitt: cool, ok - i think what huawei did internally was run the volume and network cleanup in parallel like when you're creating the instance | 18:11 |
mriedem | melwitt: understanding if there is a regression would be nice too though | 18:12 |
jgriffith | ildikov couple questions/nits in review | 18:12 |
melwitt | mriedem: and that solved it? will they upstream it? | 18:12 |
mriedem | melwitt: not sure, i think they were still saying it's slow, but they are on mitaka | 18:12 |
melwitt | mriedem: yeah, it was a regression for sure compared with juno, so I'll dig into what happened there | 18:13 |
dansmith | mriedem: you didn't have volumes in your test, right? | 18:13 |
mriedem | nope | 18:13 |
mriedem | nor networking | 18:13 |
dansmith | yeah | 18:13 |
dansmith | so the networking parallelism isn't going to buy you as much on delete I think | 18:13 |
melwitt | yahoo/oath doesn't have volumes either | 18:13 |
dansmith | the point there is to overlap some long-running things like image download with network provisioning, | 18:13 |
melwitt | and they're using nova-net via hack | 18:13 |
melwitt | so it's not related to neutron | 18:14 |
dansmith | which wouldn't be as much of a thing on delete | 18:14 |
mriedem | ocata would mean cleaning up allocations in placement | 18:14 |
mriedem | but not sure why that would take much longer | 18:14 |
openstackgerrit | sahid proposed openstack/nova-specs master: update: introducing isolate emulthreads on host https://review.openstack.org/511188 | 18:14 |
melwitt | but huawei said mitaka is slow and that's pre-placement | 18:15 |
jaypipes | dansmith: I don't see how cur_gen can be None in that patch. | 18:15 |
dansmith | jaypipes: you're doing a .get() on it, that's how | 18:15 |
jaypipes | dansmith: the comment I removed is this: | 18:16 |
jaypipes | # Update our generation immediately, if possible. Even if there | 18:16 |
jaypipes | # are no inventories we should always have a generation but let's | 18:16 |
jaypipes | # be careful. | 18:16 |
jaypipes | dansmith: I should have just replaced the get() with a dict access. | 18:16 |
sahid | jaypipes: about your tweet, i understand that it's a bit confusing, i just try to address an use-case | 18:16 |
dansmith | jaypipes: that's what I'm saying | 18:16 |
jaypipes | dansmith: because there simply isn't a way to get a None value there. | 18:16 |
sahid | in any case i update the spec to fix the issue with ci I hope everytinhg is ok now :) | 18:16 |
dansmith | jaypipes: either do that so we break, or check the result of the get() and raise something specific | 18:17 |
dansmith | jaypipes: but don't just ignore it and pass None to placement | 18:17 |
jaypipes | dansmith: will do the former. | 18:17 |
sahid | oh... I just noticed your comments, let see | 18:17 |
dansmith | jaypipes: thanks | 18:17 |
penick_ | melwitt: we "fixed" the delete timing this morning by setting reclaim_instance_interval to a non-zero number. Deletes still take a minute or two on the backend, but at least it'll seem fast for users. | 18:18 |
mriedem | melwitt: the new internal perf thing i got yesterday was they were saying claims were taking too long in the compute because of the lock | 18:18 |
mriedem | they are testing creating 70 instances on the same host at the same time | 18:18 |
*** AlexeyAbashkin has joined #openstack-nova | 18:19 | |
melwitt | penick_: you are now leveraging soft-delete | 18:19 |
penick_ | yep | 18:19 |
melwitt | mriedem: claims in mitaka, right? the old style claim | 18:20 |
mriedem | yes | 18:20 |
*** gszasz has quit IRC | 18:20 | |
mriedem | but, we still have all that code if you're using the ram/core/disk filters | 18:20 |
mriedem | and/or caching scheduler | 18:21 |
melwitt | so the COMPUTE_RESOURCE_SEMAPHORE | 18:21 |
mriedem | anyway, there was no low level profiling done | 18:21 |
mriedem | yeah | 18:21 |
dansmith | and that's all been there for a long time | 18:21 |
mriedem | i was going to see if there are things we hit in the db while we have the lock held that could be moved out | 18:21 |
openstackgerrit | sahid proposed openstack/nova-specs master: virt: allow instances to be booted with trusted VFs https://review.openstack.org/485522 | 18:21 |
*** andreas_s has quit IRC | 18:21 | |
mriedem | like getting instance pci requests | 18:21 |
melwitt | I think that's what caused some stuff in ironic to be slow too right ... the slow initial query for ironic nodes | 18:21 |
dansmith | maybe penick_ wasn't running real conductor before but now is? | 18:22 |
mriedem | i did notice this yesterday https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L1473 | 18:22 |
mriedem | that will call update_usage in the RT which has the lock | 18:22 |
mriedem | and we do that for no apparent reason | 18:22 |
mriedem | the RT doesn't care about an instance setting up networking | 18:22 |
melwitt | hm | 18:23 |
*** AlexeyAbashkin has quit IRC | 18:23 | |
mriedem | i told them to comment that line out and see what happens | 18:23 |
mriedem | and adjust their update_available_resource interval | 18:23 |
*** rodolof has quit IRC | 18:23 | |
*** rodolof has joined #openstack-nova | 18:24 | |
penick_ | dansmith: that's correct.. Our Ocata clusters use conductor, and our SE team is deploying the conductor service to our juno clusters today. | 18:24 |
penick_ | use the conductor service, i mean. | 18:24 |
*** lpetrut has quit IRC | 18:24 | |
openstackgerrit | Merged openstack/nova stable/pike: Fix sending legacy instance.update notification https://review.openstack.org/510957 | 18:25 |
openstackgerrit | Merged openstack/nova stable/pike: Keep updating allocations for Ironic https://review.openstack.org/513198 | 18:25 |
dansmith | penick_: so I'd look to see if maybe you're pegging those whereas before you were doing a bunch of direct access with lower latency? | 18:25 |
dansmith | mriedem's thing was also a single compute, so lots of contention for things in the claim process | 18:26 |
dansmith | whereas I assume penick_ has a plethora of computes | 18:26 |
dansmith | a veritable cornucopia of bountiful resources | 18:26 |
* dansmith gets into the fall spirit | 18:26 | |
mriedem | oh yeah, i guess on _complete_deletion we are updating the rt, | 18:26 |
mriedem | which grabs the lock | 18:26 |
penick_ | The ocata clusters are all dev and qe with only a 1-5 computes each, they're sitting pretty much idle. But i'll doublecheck to make sure we don't have something else cropping up gobbling up the resources on them | 18:26 |
mriedem | and makes all of the deletes on a single node serialized | 18:26 |
*** rodolof has quit IRC | 18:28 | |
ildikov | jgriffith: added some answers | 18:28 |
mriedem | so looking way back https://github.com/openstack/nova/blob/0ca98979da842f9accf0f8d8c4eb7d4f1f9eac7a/nova/compute/manager.py#L612 | 18:29 |
mriedem | before versioned objects | 18:29 |
mriedem | we always updated an instance state using that method, which also updated the RT | 18:29 |
mriedem | which grabs the lock | 18:29 |
mriedem | so we have some vestigial use of that now, updating RT unnecessarily | 18:29 |
mriedem | RT should only care if you're creating, moving or deleting an instance | 18:29 |
mriedem | not that you're setting up networking | 18:30 |
penick_ | The ocata api hosts running the conductor service are all idle | 18:31 |
dansmith | penick_: during a delete storm? | 18:31 |
penick_ | That I don't know yet, i'm going to set one up. I'll let you know what I come up with. | 18:32 |
dansmith | at idle I'd expect them to be idle ;) | 18:32 |
penick_ | But first our -juno- conductors are all exploding as they're being deployed. Gotta help the team tune those first | 18:33 |
penick_ | I set myself up for that :| | 18:34 |
melwitt | exploding meaning they won't run? or they are overloaded and you need to adjust workers? | 18:35 |
*** baoli has quit IRC | 18:37 | |
penick_ | Overloaded, we're only running 26 workers per node, on 3 nodes. Going to try adding more | 18:38 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Don't update RT in _allocate_network https://review.openstack.org/513473 | 18:40 |
*** coreywright has quit IRC | 18:43 | |
*** tbachman has quit IRC | 18:45 | |
*** tbachman has joined #openstack-nova | 18:45 | |
*** slaweq_ has joined #openstack-nova | 18:46 | |
*** baoli has joined #openstack-nova | 18:48 | |
*** suresh12_ has quit IRC | 18:48 | |
*** slaweq_ has quit IRC | 18:49 | |
*** suresh12 has joined #openstack-nova | 18:50 | |
openstackgerrit | sean mooney proposed openstack/nova-specs master: Use neutron's new port binding API for live migration https://review.openstack.org/375580 | 18:51 |
melwitt | penick_: that seems like a lot to me but would have to consult dansmith. I don't remember what the sane starting point for number of workers per node is | 18:53 |
dansmith | workers per node is not a useful metric, it's workers per compute | 18:54 |
dansmith | 26*3 is a fair number of conductor workers, but if you have a thousand computes, then ... probably not insane | 18:54 |
dansmith | it also depends on what is happening | 18:55 |
dansmith | if everything is idle, that's probably more than enough | 18:55 |
melwitt | okay, sorry I think I was thinking of earlier when penick_ said 1-5 computes but if he's talking about juno then that would be 100s of computes | 18:55 |
melwitt | the 1-5 computes is the ocata testing | 18:55 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: integrate ProviderTree to report client https://review.openstack.org/415921 | 18:55 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: add nested resource providers https://review.openstack.org/377138 | 18:55 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: allow filter providers in tree https://review.openstack.org/377215 | 18:55 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: adds REST API for nested providers https://review.openstack.org/384807 | 18:55 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: update client to set parent provider https://review.openstack.org/385693 | 18:55 |
jaypipes | dansmith: ^ | 18:55 |
* jaypipes needs to be afk for around 3 hours. catch y'all later this evening. | 18:56 | |
*** coreywright has joined #openstack-nova | 18:56 | |
*** suresh12 has quit IRC | 18:57 | |
dansmith | melwitt: right | 18:57 |
*** suresh12 has joined #openstack-nova | 18:58 | |
*** salv-orlando has joined #openstack-nova | 19:05 | |
*** jdavis has joined #openstack-nova | 19:05 | |
*** smatzek has joined #openstack-nova | 19:05 | |
*** MVenesio has quit IRC | 19:07 | |
*** smatzek has quit IRC | 19:07 | |
*** smatzek has joined #openstack-nova | 19:08 | |
*** abhi89 has joined #openstack-nova | 19:10 | |
*** slaweq_ has joined #openstack-nova | 19:11 | |
*** smatzek has quit IRC | 19:12 | |
sahid | jaypipes: ci is green https://review.openstack.org/#/c/485522/ | 19:13 |
sahid | btw mriedem, did you take descison for this: https://review.openstack.org/#/c/511188/ ? | 19:14 |
*** suresh12 has quit IRC | 19:15 | |
*** AlexeyAbashkin has joined #openstack-nova | 19:17 | |
*** suresh12 has joined #openstack-nova | 19:18 | |
*** nicolasbock has joined #openstack-nova | 19:18 | |
*** AlexeyAbashkin has quit IRC | 19:21 | |
mriedem | sahid: no | 19:21 |
mriedem | it's not on my list | 19:21 |
*** suresh12 has quit IRC | 19:23 | |
sahid | mriedem: thanks | 19:24 |
*** pchavva has quit IRC | 19:27 | |
*** efried|afk is now known as efried | 19:28 | |
*** suresh12 has joined #openstack-nova | 19:29 | |
*** ijw has quit IRC | 19:29 | |
penick_ | melwitt: this particular cluster is about 1500 nodes. But I think I found the issue. They had the hypervisors set to use the conductor service, but the API was still configured to use local conductor. Which i'm pretty sure will never work. I had them fix it and so far it appears things are working. They'll do some more tests and get back to me | 19:31 |
melwitt | aha, cool | 19:32 |
dansmith | penick_: APIs should use always go straight to the db for object access | 19:32 |
dansmith | and in juno I'm not sure there was anything in conductor that apis needed to access, but local conductor for them should be fine | 19:32 |
dansmith | penick_: what was "fixed" .. the load on the conductors? | 19:33 |
*** awaugama has quit IRC | 19:34 | |
efried | jaypipes This is old news, but I definitely saw a way to get None there. The placement call fails, but report client uses raise_exc=False so the response just comes back, and the caller is doing soft gets everywhere, so populates the inventory with {} and no generation. That percolates down to the code in question. | 19:34 |
melwitt | oh, oops. local conductor on API | 19:34 |
dansmith | yeah: https://github.com/openstack/nova/blob/juno-eol/nova/cmd/compute.py#L65 | 19:39 |
dansmith | no such line there for api, which means it ignores the local conductor flag | 19:39 |
dansmith | also, github groaned at me when I selected the juno-eol tag | 19:39 |
dansmith | so penick_ owes me a beverage | 19:39 |
penick_ | melwitt: this particular cluster is about 1500 nodes. But I think I found the issue. They had the hypervisors set to use the conductor service, but the API was still configured to use local conductor. Which i'm pretty sure will never work. I had them fix it and so far it appears things are working. They'll do some more tests and get back to me | 19:39 |
penick_ | dansmith sorry about that | 19:40 |
* penick_ is good for it | 19:40 | |
dansmith | heh | 19:40 |
melwitt | penick_: yeah, as dansmith said, that shouldn't matter. the nova/cmd/api.py doesn't consider the local conductor conf setting | 19:41 |
dansmith | actually I'm pretty sure penick_ has bought me beverages before | 19:41 |
dansmith | so I'm probably in beverage debt | 19:41 |
melwitt | penick_: and that API is supposed to access the database directly anyhow | 19:41 |
melwitt | (it does so automatically) | 19:41 |
dansmith | yeah, | 19:41 |
penick_ | that makes sense | 19:41 |
dansmith | so maybe after updating the config a bunch of computes were storming the castle and it settled down near the time you flipped that flag, | 19:41 |
dansmith | thinking it was causal? | 19:42 |
efried | What is "cold migration" aka? E.g. in the support matrix https://docs.openstack.org/nova/latest/user/support-matrix.html | 19:42 |
dansmith | efried: resize | 19:43 |
dansmith | efried: or nova migrate | 19:43 |
efried | dansmith thx | 19:43 |
mriedem | ildikov: easy fixes in https://review.openstack.org/#/c/499777/ - you want to update quick? otherwise i can | 19:43 |
*** lpetrut has joined #openstack-nova | 19:44 | |
efried | how do you tell it to resize to another host? | 19:44 |
melwitt | resize automatically goes to another host | 19:44 |
dansmith | well | 19:45 |
mriedem | efried: only way it can go back is the config option | 19:45 |
dansmith | unless configured | 19:45 |
dansmith | yeah | 19:45 |
mriedem | allow_resize_to_same_host | 19:45 |
melwitt | unless you have configured "allow_resize_to_same_host" it won't consider the same host | 19:45 |
efried | whoah, okay. | 19:45 |
melwitt | note that means it CAN go to the same host if you config that, not that it will ONLY go there | 19:45 |
efried | And if you only have one host, presumably, you don't need to switch the setting on? | 19:45 |
melwitt | some ppl get confused by it | 19:45 |
mriedem | efried: remember that cold migrate is called 'resize' in the code, | 19:45 |
mriedem | just like evacuate is called rebuild | 19:45 |
mriedem | totally not confusing | 19:46 |
cdent | efried: force resize to same has been discussed at various times and I’m sure patched in by vairous people | 19:46 |
mriedem | and migrate != live migration | 19:46 |
efried | "remember", sure. | 19:46 |
mriedem | because if it's not live, it's old | 19:46 |
mriedem | *cold | 19:46 |
mriedem | takashi has a spec for specifying a host for cold migratoin | 19:46 |
mriedem | it was only approved after i got him to remove the 'force' flag option | 19:46 |
mriedem | specifying a host is fine as long as the scheduler validates it first, | 19:46 |
*** salv-orl_ has joined #openstack-nova | 19:46 | |
efried | Oh, not the same spec as 'abort cold', the reviewing of which led me to this series of questions? | 19:46 |
mriedem | force flag bypasses the scheduler which gets all sorts of crazy | 19:46 |
mriedem | abort cold is different | 19:47 |
dansmith | efried: you still need the config option even if you only have one host | 19:47 |
mriedem | devstack defaults to set allow_resize_to_same_host=True | 19:47 |
mriedem | b/c it's single node | 19:47 |
efried | dansmith otherwise it'll just fail? | 19:47 |
mriedem | efried: yes | 19:47 |
efried | whee | 19:47 |
mriedem | because cold migrating to yourself doesn't make sense, | 19:48 |
mriedem | unless you're resizing the flavor | 19:48 |
mriedem | and if you're resizing to the same host, we quintuple your cpu allocations during scheduling just to make you pay for it | 19:49 |
*** dave-mccowan has quit IRC | 19:49 | |
*** salv-orlando has quit IRC | 19:49 | |
efried | Well, to me "resize" means "change the size of". Not "move to another host". But what do I know. | 19:49 |
*** nicolasbock has quit IRC | 19:49 | |
mriedem | hence the 'remember cold migrate is called resize internally | 19:49 |
efried | perfect. | 19:50 |
efried | Well, also in the docs. | 19:50 |
mriedem | and evacuate == rebuild | 19:50 |
efried | Which is why /me was confused. | 19:50 |
penick_ | dansmith You're probably right about the thundering herd being the problem. I think the SE team missed that these machines have CPU and memory utilization spiking. The memory spiked enough to hit swap. Also I see at least one panic in the log. | 19:50 |
dansmith | efried: have you read my blog post? | 19:50 |
efried | dansmith Which? | 19:50 |
dansmith | penick_: ack | 19:51 |
dansmith | efried: the secret decoder ring for all these move operations | 19:51 |
*** dave-mccowan has joined #openstack-nova | 19:51 | |
efried | dansmith I hope it's not too long. | 19:51 |
efried | dansmith But send me the link and I'll see if I can plough my way through it. | 19:51 |
efried | (In all seriousness, dansmith, I would love a decoder ring for the move ops) | 19:51 |
dansmith | oh it's long, real long.. | 19:52 |
dansmith | er, the post.. yeah, not too long | 19:52 |
dansmith | efried: http://www.danplanet.com/blog/2016/03/03/evacuate-in-nova-one-command-to-confuse-us-all/ | 19:52 |
efried | IBM forbids me even responding to that. | 19:52 |
*** ijw has joined #openstack-nova | 19:52 | |
dansmith | ack | 19:53 |
dansmith | my corporate compliance training requirement is coming up soon | 19:53 |
dansmith | I better re-read | 19:53 |
openstackgerrit | Merged openstack/nova master: Add 'delete_host' command in 'nova-manage cell_v2' https://review.openstack.org/510324 | 19:54 |
*** nicolasbock has joined #openstack-nova | 19:55 | |
ildikov | mriedem: not at the laptop now | 19:56 |
mriedem | ildikov: i'll update it | 19:56 |
*** ijw has quit IRC | 19:57 | |
ildikov | mriedem: thank you! I owe you, I guess way more than one!!! | 19:57 |
mriedem | get me out of work meetings and customer dinners in sydney and the debt i spaid | 19:58 |
efried | dansmith Super helpful article, thank you. | 19:58 |
* dansmith bows | 19:59 | |
*** nicolasbock has quit IRC | 20:00 | |
penick_ | dansmith and melwitt thanks for the help, btw | 20:01 |
*** liverpooler has quit IRC | 20:01 | |
dansmith | penick_: no problem. Now I have to go shower the juno off me | 20:01 |
penick_ | Sorry about that. On the upside you don't need to bathe in the juno-ness all day every day. | 20:02 |
*** penick_ is now known as penick | 20:02 | |
*** dave-mccowan has quit IRC | 20:02 | |
*** smatzek has joined #openstack-nova | 20:04 | |
dansmith | sdague: we kinda lost momentum on mikal's privsepapalooza: https://review.openstack.org/#/c/494423/30 | 20:04 |
openstackgerrit | Merged openstack/nova master: Pick ironic nodes without VCPU set https://review.openstack.org/511844 | 20:08 |
openstackgerrit | Merged openstack/nova master: Add attachment_get to refresh_connection_info https://review.openstack.org/512626 | 20:08 |
openstackgerrit | Merged openstack/nova master: Update live migration to use v3 cinder api https://review.openstack.org/463987 | 20:08 |
*** nicolasbock has joined #openstack-nova | 20:09 | |
mriedem | stvnoyes: ^ woot | 20:12 |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Add multiattach support to Nova https://review.openstack.org/499777 | 20:14 |
mriedem | johnthetubaguy: ^ updated the multiattach spec - i'll proxy your +2 if you're not around to handle it tonight | 20:14 |
*** nicolasbock has quit IRC | 20:14 | |
*** nicolasbock has joined #openstack-nova | 20:15 | |
mriedem | oh yeah today is the q-1 tag, suppose i should tag that | 20:16 |
*** sahid has quit IRC | 20:16 | |
*** AlexeyAbashkin has joined #openstack-nova | 20:17 | |
cdent | mriedem, dansmith: since it is spec freezey day, and this spec is required by a spec already merged, you wanna drop some eyes on it? It was done as a seperate spec from the POST allocation (which is what requires it) because it’s a different microversion: https://review.openstack.org/#/c/508164/ please and thank you. | 20:20 |
cdent | It’s probably not strictly necessary that it merges as the work is going to be done anyway. It is mostly a bookkeeping thing I guess. | 20:20 |
*** AlexeyAbashkin has quit IRC | 20:21 | |
mriedem | probably just gets a freeze exception given it's a dependency | 20:22 |
*** ijw has joined #openstack-nova | 20:23 | |
cdent | cool, thanks | 20:23 |
*** nicolasbock has quit IRC | 20:23 | |
*** peter-hamilton has quit IRC | 20:26 | |
*** ijw has quit IRC | 20:27 | |
*** andreas_s has joined #openstack-nova | 20:30 | |
*** andreas_s has quit IRC | 20:35 | |
*** tbachman has quit IRC | 20:35 | |
*** nicolasbock has joined #openstack-nova | 20:37 | |
*** AlexeyAbashkin has joined #openstack-nova | 20:38 | |
*** AlexeyAbashkin has quit IRC | 20:42 | |
*** slaweq_ has quit IRC | 20:48 | |
*** slaweq_ has joined #openstack-nova | 20:49 | |
*** slaweq_ has quit IRC | 20:54 | |
*** felipemonteiro__ has quit IRC | 20:54 | |
*** swamireddy has joined #openstack-nova | 20:56 | |
*** ijw has joined #openstack-nova | 20:56 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Add support for certificate validation https://review.openstack.org/488541 | 20:58 |
*** AlexeyAbashkin has joined #openstack-nova | 20:59 | |
*** Apoorva_ has joined #openstack-nova | 21:02 | |
*** AlexeyAbashkin has quit IRC | 21:03 | |
*** felipemonteiro has joined #openstack-nova | 21:04 | |
*** Apoorva has quit IRC | 21:05 | |
*** felipemonteiro has quit IRC | 21:09 | |
*** abhi89 has quit IRC | 21:09 | |
openstackgerrit | Merged openstack/nova-specs master: Add multiattach support to Nova https://review.openstack.org/499777 | 21:10 |
openstackgerrit | Merged openstack/nova-specs master: Add support for certificate validation https://review.openstack.org/488541 | 21:12 |
efried | mriedem I think you added me to https://review.openstack.org/#/c/334732/ to render opinion as a driver owner; did that. | 21:12 |
mriedem | efried: ok, takashi said it was for NFS in his use case too, and it takes "several minutes" for the disk to migrate, | 21:13 |
mriedem | which to me isn't a good use case for needing to add plumbing to abort the thing, | 21:13 |
efried | mriedem wha? How could it take minutes to "migrate" NFS? | 21:13 |
mriedem | if the admin is cold migrating the instance, it's for good reason | 21:13 |
*** markvoelker has joined #openstack-nova | 21:13 | |
mriedem | i think the live migrate cancel stuff was needed because live migrate could stall out and we needed a hook in to abort the job in the hypervisor | 21:14 |
efried | Okay, that's not what the spec says. | 21:15 |
mriedem | this is just like, whiny user says their cold migrating vm is down too long and tells the admin to stop doing that thing | 21:15 |
*** gouthamr has quit IRC | 21:15 | |
mriedem | right, this doesn't say anything about cold migrate stalling out and we need a way to kill it | 21:15 |
efried | The spec implies that we're copying gigabytes of local (*actual* local) disk over the wire. | 21:15 |
efried | ...and want to be able to bail on that. | 21:15 |
mriedem | this is saying, "admin is cold migrating, user doesn't like that it's taking several minutes, and wants the admin to stop' | 21:15 |
mriedem | idk maybe if there were actual numbers in here, | 21:16 |
mriedem | like, i've got a 200GB disk windows vm | 21:16 |
*** thorst has quit IRC | 21:16 | |
mriedem | and it's taking me 3 hours to cold migrate that thing | 21:16 |
mriedem | this is why i asked cburgess this morning b/c i know he uses ceph and i know he loves to migrate stuff | 21:17 |
*** rodolof has joined #openstack-nova | 21:17 | |
cburgess | Oh sorry I missed something... | 21:17 |
cburgess | Do what now? | 21:17 |
stvnoyes | mridem. fantastic! :-) thanks for all the help from both you and johnthetubaguy! | 21:17 |
mriedem | cburgess: do you think https://review.openstack.org/#/c/334732/ is useful? | 21:18 |
mriedem | cburgess: do you have users with 100+ gb disks and if so, do you cold migrate those and if so, how long does that take? | 21:18 |
*** suresh12 has quit IRC | 21:18 | |
cburgess | mriedem Funny you should ask about 100+ GB disk... I'm just now starting at a 15TB one. | 21:18 |
*** thorst has joined #openstack-nova | 21:18 | |
*** suresh12 has joined #openstack-nova | 21:19 | |
cburgess | mriedem Give me a few to read this spec and I'll let you know. | 21:19 |
mriedem | thanks | 21:19 |
*** Apoorva_ has quit IRC | 21:20 | |
*** Apoorva has joined #openstack-nova | 21:20 | |
ildikov | stvnoyes: congrats!!! :) | 21:21 |
*** dave-mccowan has joined #openstack-nova | 21:23 | |
*** thorst has quit IRC | 21:23 | |
*** suresh12 has quit IRC | 21:25 | |
*** suresh12 has joined #openstack-nova | 21:25 | |
*** smatzek has quit IRC | 21:26 | |
*** vladikr has quit IRC | 21:29 | |
*** dave-mccowan has quit IRC | 21:29 | |
*** penick has quit IRC | 21:30 | |
*** dave-mccowan has joined #openstack-nova | 21:37 | |
openstackgerrit | Chris Dent proposed openstack/nova master: WIP: [placement] Enable limiting GET /allocation_candidates https://review.openstack.org/513526 | 21:37 |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762 | 21:37 |
*** hongbin has quit IRC | 21:38 | |
*** lpetrut has quit IRC | 21:39 | |
*** baoli has quit IRC | 21:40 | |
*** penick has joined #openstack-nova | 21:41 | |
mriedem | jaypipes: addressed your comments and sylvain's in https://review.openstack.org/#/c/507762/ - left a todo for alex's thing about sort order which i think we could hash out in review later | 21:41 |
cdent | night all | 21:42 |
*** cdent has quit IRC | 21:42 | |
*** amodi has quit IRC | 21:43 | |
*** dave-mccowan has quit IRC | 21:44 | |
*** thorst has joined #openstack-nova | 21:47 | |
*** xyang1 has quit IRC | 21:47 | |
*** mvk has joined #openstack-nova | 21:48 | |
*** markvoelker has quit IRC | 21:48 | |
openstackgerrit | Merged openstack/nova master: [Trivial] Fix up a docstring https://review.openstack.org/513447 | 21:50 |
*** yamamoto has joined #openstack-nova | 21:50 | |
*** penick has quit IRC | 21:51 | |
*** thorst has quit IRC | 21:51 | |
*** flanders_ has joined #openstack-nova | 21:55 | |
*** jdurgin has quit IRC | 22:01 | |
*** markvoelker has joined #openstack-nova | 22:02 | |
cburgess | mriedem So yeah thats useful. We tend to not recommend cold migrations with large amounts of data. Clients that use a lot of space we push towards a volume solution for the large storage and to either use BFV or to have small roots locally and put the bulk storage in volumes. | 22:03 |
cburgess | But its still a useful feature. | 22:03 |
mikal | Random fact for the day. Name the commit which added metadata to nova. | 22:03 |
*** burt has quit IRC | 22:03 | |
cburgess | mikal: Which part of metadata? The service? | 22:04 |
mikal | There has always been a web service | 22:04 |
mriedem | cburgess: want to comment on the spec? operator input has weight on something like this. | 22:04 |
mikal | So, the commit which added any instance accessible metadata functionality | 22:04 |
cburgess | mriedem Sure | 22:04 |
*** jdavis has quit IRC | 22:04 | |
mriedem | "copy what ec2 / aws does"? | 22:04 |
cfriesen | mriedem: for what it's worth, the largest EC2 instances have 48TB of disk | 22:04 |
cburgess | mikal Um... probably somewhere in in the first few commits if not the initial import. | 22:05 |
cfriesen | mriedem: for the "abort cold migration" thing, what about the case where the dest node crashes mid-transfer? | 22:05 |
mriedem | cfriesen: wouldn't that auto-kill the cold migrate? | 22:05 |
cburgess | cfriesen I think thats covered already isn't it? Don't we detect that? | 22:05 |
cburgess | mriedem cfriesen Oh maybe not now that we can't monitor disk transfer progress. | 22:06 |
cfriesen | I'm thinking the connection could stay open until the TCP connection times out | 22:06 |
cfriesen | in the scp case, at least | 22:06 |
cburgess | Oh right... libvirt will report the error back. | 22:06 |
cburgess | At some point | 22:06 |
cburgess | In theory | 22:06 |
*** markvoelker has quit IRC | 22:06 | |
cburgess | mikal So whats the answer? | 22:06 |
mikal | cburgess: commit bf6e6e718cdc7488e2da87b21e258ccc065fe499 | 22:07 |
mikal | cburgess: which has the commit message "initial import" | 22:07 |
mikal | cburgess: at that point, nova was 5,083 lines of code | 22:07 |
cburgess | mikal Called it! | 22:07 |
mikal | In other words, its always been weird | 22:08 |
cburgess | wow 5K lines of code. I have scripts to fix horked up volumes that are longer then that... | 22:08 |
cburgess | OK thats a lie.. its only 1349 lines of code. | 22:09 |
*** markvoelker has joined #openstack-nova | 22:11 | |
*** lyan has quit IRC | 22:13 | |
*** hemna_ has quit IRC | 22:14 | |
*** markvoelker has quit IRC | 22:16 | |
cburgess | mriedem Is the existing abort admin only? Or is that policy controlable? | 22:19 |
mriedem | cburgess: anytihng related to live migration is admin-only by default | 22:19 |
mriedem | and cold migration | 22:19 |
cburgess | mriedem OK | 22:20 |
*** suresh12 has quit IRC | 22:20 | |
mikal | cburgess: I'm not sure volumes existed in the first commit, I'd have to check... | 22:20 |
*** markvoelker has joined #openstack-nova | 22:20 | |
cburgess | mikal What do volumes have to do with anything? | 22:21 |
mikal | cburgess: well, your volume fix script... | 22:21 |
mikal | cburgess: probably wasn't required back then | 22:21 |
cburgess | mikal My volume fix script wasn't required until the hot mess that is/was os-brick circa liberty. | 22:21 |
*** suresh12 has joined #openstack-nova | 22:22 | |
*** thorst has joined #openstack-nova | 22:23 | |
*** fragatina has joined #openstack-nova | 22:23 | |
*** markvoelker has quit IRC | 22:25 | |
*** jdavis has joined #openstack-nova | 22:25 | |
*** thorst_ has joined #openstack-nova | 22:26 | |
*** thorst has quit IRC | 22:27 | |
*** jdurgin has joined #openstack-nova | 22:28 | |
openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Use neutron's new port binding API for live migration https://review.openstack.org/375580 | 22:28 |
*** markvoelker has joined #openstack-nova | 22:29 | |
*** thorst_ has quit IRC | 22:30 | |
*** sdague has quit IRC | 22:34 | |
*** markvoelker has quit IRC | 22:34 | |
mriedem | dansmith: i updated ^ based on some review i had after sean updated it from the call this morning | 22:34 |
mriedem | dansmith: one sticky thing in there yet which i know you won't like, | 22:35 |
mriedem | but i think we can hammer in code review | 22:35 |
dansmith | yeah I don't really think the argument of "avoid changing the object due to stuff in ml2" is sound | 22:36 |
dansmith | but as long as we can argue in the code I guess it's fine | 22:36 |
*** rodolof has quit IRC | 22:38 | |
*** markvoelker has joined #openstack-nova | 22:39 | |
*** markvoelker has quit IRC | 22:43 | |
openstackgerrit | Merged openstack/nova-specs master: Use neutron's new port binding API for live migration https://review.openstack.org/375580 | 22:45 |
*** andreas_s has joined #openstack-nova | 22:47 | |
*** markvoelker has joined #openstack-nova | 22:47 | |
*** andreas_s has quit IRC | 22:51 | |
*** dave-mccowan has joined #openstack-nova | 22:57 | |
*** ijw has quit IRC | 22:58 | |
*** suresh12 has quit IRC | 23:00 | |
*** suresh12 has joined #openstack-nova | 23:02 | |
*** Apoorva has quit IRC | 23:04 | |
*** Apoorva has joined #openstack-nova | 23:05 | |
*** baoli has joined #openstack-nova | 23:06 | |
*** thorst has joined #openstack-nova | 23:07 | |
*** Apoorva has quit IRC | 23:07 | |
*** Apoorva has joined #openstack-nova | 23:08 | |
*** ijw has joined #openstack-nova | 23:12 | |
*** baoli has quit IRC | 23:12 | |
*** ijw has quit IRC | 23:13 | |
*** ijw has joined #openstack-nova | 23:13 | |
*** andreas_s has joined #openstack-nova | 23:14 | |
*** claudiub has quit IRC | 23:15 | |
*** AlexeyAbashkin has joined #openstack-nova | 23:16 | |
*** andreas_s has quit IRC | 23:18 | |
*** AlexeyAbashkin has quit IRC | 23:21 | |
*** markvoelker has quit IRC | 23:22 | |
openstackgerrit | Merged openstack/nova-specs master: Add pagination and changes since filter support for os-instance-action API https://review.openstack.org/507762 | 23:26 |
*** jdavis has quit IRC | 23:26 | |
*** smatzek has joined #openstack-nova | 23:27 | |
*** chyka has quit IRC | 23:29 | |
*** hemna_ has joined #openstack-nova | 23:31 | |
*** smatzek has quit IRC | 23:31 | |
*** hemna_ has quit IRC | 23:32 | |
*** Swami has quit IRC | 23:34 | |
*** markvoelker has joined #openstack-nova | 23:36 | |
*** suresh12 has quit IRC | 23:36 | |
*** tbachman has joined #openstack-nova | 23:37 | |
*** gmann_afk is now known as gmann | 23:38 | |
*** markvoelker has quit IRC | 23:40 | |
*** dillaman has quit IRC | 23:44 | |
*** markvoelker has joined #openstack-nova | 23:45 | |
*** smatzek has joined #openstack-nova | 23:46 | |
*** suresh12 has joined #openstack-nova | 23:49 | |
*** markvoelker has quit IRC | 23:49 | |
gmann | bauzas: i replied on your comment on this spec - https://review.openstack.org/#/c/508101/7 | 23:51 |
*** andreas_s has joined #openstack-nova | 23:51 | |
gmann | bauzas: let me know if i need to make it clear about those 'Main policy' in spec. i can do that quickly | 23:52 |
*** markvoelker has joined #openstack-nova | 23:54 | |
*** andreas_s has quit IRC | 23:55 | |
*** suresh12 has quit IRC | 23:55 | |
*** Apoorva_ has joined #openstack-nova | 23:58 | |
*** AlexeyAbashkin has joined #openstack-nova | 23:58 | |
*** suresh12 has joined #openstack-nova | 23:58 | |
*** markvoelker has quit IRC | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!