*** dtp has quit IRC | 00:00 | |
*** liangy has quit IRC | 00:01 | |
*** kaisers has quit IRC | 00:02 | |
*** nic has quit IRC | 00:04 | |
*** ZZelle has quit IRC | 00:04 | |
*** browne has quit IRC | 00:05 | |
*** ducttape_ has quit IRC | 00:07 | |
*** krtaylor has quit IRC | 00:08 | |
*** browne has joined #openstack-nova | 00:09 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/439925 | 00:11 |
---|---|---|
*** rfolco has joined #openstack-nova | 00:13 | |
*** claudiub|2 has quit IRC | 00:14 | |
*** rfolco has quit IRC | 00:20 | |
*** mriedem has joined #openstack-nova | 00:27 | |
*** jwcroppe has joined #openstack-nova | 00:28 | |
*** ducttape_ has joined #openstack-nova | 00:29 | |
*** thorst has joined #openstack-nova | 00:31 | |
*** haukebruno has quit IRC | 00:33 | |
*** dimtruck is now known as zz_dimtruck | 00:33 | |
*** rfolco has joined #openstack-nova | 00:35 | |
*** rfolco has quit IRC | 00:35 | |
*** hongbin has quit IRC | 00:35 | |
*** thorst has quit IRC | 00:36 | |
*** tovin07 has joined #openstack-nova | 00:38 | |
*** thorst has joined #openstack-nova | 00:41 | |
*** gongysh has joined #openstack-nova | 00:45 | |
*** gongysh has quit IRC | 00:49 | |
*** iceyao has joined #openstack-nova | 00:50 | |
*** ducttape_ has quit IRC | 00:52 | |
*** owalsh-afk has quit IRC | 00:52 | |
*** owalsh-afk has joined #openstack-nova | 00:52 | |
*** zz_dimtruck is now known as dimtruck | 00:53 | |
*** krtaylor has joined #openstack-nova | 00:53 | |
*** ducttape_ has joined #openstack-nova | 00:53 | |
*** iceyao has quit IRC | 00:54 | |
*** haukebruno has joined #openstack-nova | 00:54 | |
*** Jinxing has joined #openstack-nova | 00:55 | |
*** Jinxing has quit IRC | 00:56 | |
*** owalsh has joined #openstack-nova | 00:57 | |
*** owalsh-afk has quit IRC | 00:57 | |
*** thorst has quit IRC | 01:01 | |
*** crushil has joined #openstack-nova | 01:03 | |
*** phuongnh has joined #openstack-nova | 01:04 | |
*** catintheroof has joined #openstack-nova | 01:04 | |
*** armax has joined #openstack-nova | 01:06 | |
*** Swami has quit IRC | 01:06 | |
*** dimtruck is now known as zz_dimtruck | 01:13 | |
*** ducttape_ has quit IRC | 01:14 | |
*** jamielennox is now known as jamielennox|away | 01:16 | |
*** nebulite has joined #openstack-nova | 01:18 | |
*** tbachman has joined #openstack-nova | 01:21 | |
*** zz_dimtruck is now known as dimtruck | 01:22 | |
*** karimb has quit IRC | 01:30 | |
*** nebulite has left #openstack-nova | 01:32 | |
*** ducttape_ has joined #openstack-nova | 01:34 | |
*** browne has quit IRC | 01:36 | |
*** mtanino has quit IRC | 01:37 | |
*** browne has joined #openstack-nova | 01:40 | |
*** iceyao has joined #openstack-nova | 01:43 | |
*** adrian_otto has quit IRC | 01:44 | |
*** browne has quit IRC | 01:49 | |
*** ducttape_ has quit IRC | 01:51 | |
*** ducttape_ has joined #openstack-nova | 01:52 | |
*** ijw has quit IRC | 01:58 | |
*** ducttape_ has quit IRC | 02:01 | |
*** catintheroof has quit IRC | 02:01 | |
*** ducttape_ has joined #openstack-nova | 02:02 | |
*** dimtruck is now known as zz_dimtruck | 02:06 | |
*** tbachman has quit IRC | 02:07 | |
*** jamesden_ has joined #openstack-nova | 02:08 | |
*** smatzek_ has joined #openstack-nova | 02:09 | |
*** yuntongjin has joined #openstack-nova | 02:09 | |
*** smatzek_ has quit IRC | 02:09 | |
*** smatzek_ has joined #openstack-nova | 02:10 | |
*** tbachman has joined #openstack-nova | 02:11 | |
*** Apoorva_ has quit IRC | 02:15 | |
*** jamesden_ has quit IRC | 02:15 | |
*** raunak has quit IRC | 02:16 | |
*** jamesden_ has joined #openstack-nova | 02:19 | |
*** unicell has quit IRC | 02:20 | |
*** smatzek_ has quit IRC | 02:22 | |
*** kaisers has joined #openstack-nova | 02:24 | |
*** kaisers has quit IRC | 02:29 | |
openstackgerrit | Li Yingjun proposed openstack/nova-specs master: Spec for support set vgamem for video https://review.openstack.org/438787 | 02:29 |
*** nebulite has joined #openstack-nova | 02:33 | |
*** namnh has joined #openstack-nova | 02:34 | |
*** esberglu has joined #openstack-nova | 02:43 | |
*** harry_liu has joined #openstack-nova | 02:43 | |
*** harry_liu has quit IRC | 02:45 | |
*** ducttape_ has quit IRC | 02:46 | |
*** ducttape_ has joined #openstack-nova | 02:47 | |
*** esberglu has quit IRC | 02:48 | |
openstackgerrit | Yoshihiko Atsumi proposed openstack/nova master: Add resize server functional negative tests https://review.openstack.org/420514 | 02:48 |
*** carthaca_ has quit IRC | 02:50 | |
*** sapcc-bot has quit IRC | 02:50 | |
*** artom has quit IRC | 02:50 | |
*** carthaca_ has joined #openstack-nova | 02:50 | |
*** sapcc-bot has joined #openstack-nova | 02:50 | |
*** ducnc has quit IRC | 02:50 | |
*** artom has joined #openstack-nova | 02:50 | |
*** ducttape_ has quit IRC | 02:52 | |
*** gouthamr has quit IRC | 02:53 | |
*** Sukhdev has joined #openstack-nova | 02:54 | |
*** Sukhdev has quit IRC | 02:56 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate https://review.openstack.org/439960 | 02:58 |
*** raunak has joined #openstack-nova | 03:01 | |
*** jamesden_ has quit IRC | 03:03 | |
*** gongysh has joined #openstack-nova | 03:04 | |
*** dave-mccowan has joined #openstack-nova | 03:06 | |
*** hongbin has joined #openstack-nova | 03:08 | |
*** links has joined #openstack-nova | 03:08 | |
*** gongysh has quit IRC | 03:16 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional test for ip filtering with regex https://review.openstack.org/439969 | 03:22 |
*** mriedem is now known as mriedem_afk | 03:26 | |
*** erlon has quit IRC | 03:35 | |
*** unicell has joined #openstack-nova | 03:38 | |
*** unicell has quit IRC | 03:38 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate https://review.openstack.org/438792 | 03:39 |
*** yamahata has quit IRC | 03:45 | |
*** nebulite has quit IRC | 03:50 | |
*** tuanluong has joined #openstack-nova | 03:50 | |
*** thorst has joined #openstack-nova | 03:50 | |
*** thorst has quit IRC | 03:50 | |
*** rcernin has quit IRC | 03:50 | |
*** raunak has quit IRC | 03:54 | |
*** nmathew has joined #openstack-nova | 03:58 | |
*** yuntongjin has quit IRC | 04:03 | |
*** nicolasbock has quit IRC | 04:06 | |
*** udesale has joined #openstack-nova | 04:07 | |
*** sudipto has joined #openstack-nova | 04:10 | |
*** sudipto_ has joined #openstack-nova | 04:10 | |
*** fragatina has quit IRC | 04:13 | |
*** sneti_ has joined #openstack-nova | 04:13 | |
*** dave-mccowan has quit IRC | 04:16 | |
*** mdnadeem has joined #openstack-nova | 04:17 | |
*** dnalezyt has quit IRC | 04:23 | |
*** psachin has joined #openstack-nova | 04:27 | |
*** fragatina has joined #openstack-nova | 04:28 | |
*** sudipto_ has quit IRC | 04:30 | |
*** sudipto has quit IRC | 04:30 | |
*** ratailor has joined #openstack-nova | 04:31 | |
*** thorst has joined #openstack-nova | 04:32 | |
*** thorst has quit IRC | 04:32 | |
*** esberglu has joined #openstack-nova | 04:32 | |
*** Jeffrey4l has joined #openstack-nova | 04:32 | |
*** iceyao has quit IRC | 04:32 | |
*** fragatina has quit IRC | 04:32 | |
*** esberglu has quit IRC | 04:36 | |
*** adrian_otto has joined #openstack-nova | 04:37 | |
*** adisky_ has joined #openstack-nova | 04:38 | |
*** kevinz has joined #openstack-nova | 04:39 | |
*** kaisers has joined #openstack-nova | 04:41 | |
*** sneti_ has quit IRC | 04:43 | |
*** sree has joined #openstack-nova | 04:43 | |
*** diga has joined #openstack-nova | 04:45 | |
*** kaisers has quit IRC | 04:45 | |
*** kaisers has joined #openstack-nova | 04:46 | |
*** kaisers has quit IRC | 04:47 | |
*** kaisers has joined #openstack-nova | 04:47 | |
*** kaisers has quit IRC | 04:52 | |
*** adrian_otto has quit IRC | 04:54 | |
*** crushil has quit IRC | 04:57 | |
*** tbachman has quit IRC | 04:59 | |
*** thorst has joined #openstack-nova | 05:03 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/440076 | 05:03 |
*** Yingxin has joined #openstack-nova | 05:03 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements https://review.openstack.org/395347 | 05:04 |
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-novaclient master: Updated from global requirements https://review.openstack.org/440101 | 05:06 |
ratailor | Hi all, | 05:11 |
ratailor | http://lists.openstack.org/pipermail/openstack-dev/2016-May/095386.html | 05:11 |
ratailor | could anyone please suggest whether its better to handle this ^^ situation in periodic task or on nova-compute service restart / | 05:12 |
ratailor | ? | 05:12 |
*** iceyao has joined #openstack-nova | 05:13 | |
*** thorst has quit IRC | 05:16 | |
*** hongbin has quit IRC | 05:17 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/440076 | 05:18 |
*** iceyao has quit IRC | 05:18 | |
*** iceyao has joined #openstack-nova | 05:18 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements https://review.openstack.org/395347 | 05:20 |
*** fragatina has joined #openstack-nova | 05:22 | |
*** ayogi has joined #openstack-nova | 05:23 | |
*** fragatina has quit IRC | 05:26 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements https://review.openstack.org/440076 | 05:32 |
*** Kevin_Zheng has quit IRC | 05:33 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif master: Updated from global requirements https://review.openstack.org/395347 | 05:34 |
*** prateek has joined #openstack-nova | 05:39 | |
openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Add api-ref for filter/sort whitelist https://review.openstack.org/421760 | 05:41 |
*** unicell has joined #openstack-nova | 05:44 | |
*** kaisers has joined #openstack-nova | 05:44 | |
gmann | alex_xu: mriedem_afk johnthetubaguy : api-ref for filter/sort - https://review.openstack.org/#/c/421760/ | 05:44 |
alex_xu | gmann: appreciate that, will try to reach that asap | 05:45 |
gmann | alex_xu: thanks. mriedem_afk reminded me i was almost forgot those | 05:46 |
alex_xu | gmann: yea, me too | 05:46 |
*** kaisers has quit IRC | 05:48 | |
*** Sukhdev has joined #openstack-nova | 05:51 | |
openstackgerrit | ChangBo Guo(gcb) proposed openstack/nova master: Skip unit tests for SSL + py3 https://review.openstack.org/426505 | 05:56 |
*** dikonoor has joined #openstack-nova | 05:59 | |
*** Sukhdev has quit IRC | 06:05 | |
*** trinaths has joined #openstack-nova | 06:06 | |
*** sridharg has joined #openstack-nova | 06:07 | |
*** claudiub|2 has joined #openstack-nova | 06:08 | |
*** Dinesh_Bhor has quit IRC | 06:09 | |
*** armax has quit IRC | 06:14 | |
*** psachin_ has joined #openstack-nova | 06:18 | |
*** psachin_ has quit IRC | 06:19 | |
*** esberglu has joined #openstack-nova | 06:21 | |
*** esberglu has quit IRC | 06:26 | |
*** markus_z has joined #openstack-nova | 06:28 | |
*** edmondsw has joined #openstack-nova | 06:32 | |
openstackgerrit | ChangBo Guo(gcb) proposed openstack/nova master: Skip unit tests for SSL + py3 https://review.openstack.org/426505 | 06:33 |
*** kaisers has joined #openstack-nova | 06:35 | |
*** edand has joined #openstack-nova | 06:38 | |
*** ekuris has joined #openstack-nova | 06:42 | |
*** mjura has joined #openstack-nova | 06:43 | |
*** salv-orlando has joined #openstack-nova | 06:45 | |
*** Dinesh_Bhor has joined #openstack-nova | 06:46 | |
*** zhurong has joined #openstack-nova | 06:48 | |
*** nkrinner_afk is now known as nkrinner | 06:48 | |
*** unicell has quit IRC | 06:51 | |
*** unicell has joined #openstack-nova | 06:51 | |
*** salv-orl_ has joined #openstack-nova | 06:52 | |
*** zhurong has quit IRC | 06:53 | |
openstackgerrit | Tomi Juvonen proposed openstack/nova-specs master: Planned host maintenance https://review.openstack.org/310510 | 06:53 |
*** salv-orlando has quit IRC | 06:55 | |
openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Don't delete neutron port when attach failed https://review.openstack.org/403568 | 06:56 |
*** edmondsw has quit IRC | 06:56 | |
*** sudipto has joined #openstack-nova | 06:56 | |
*** sudipto_ has joined #openstack-nova | 06:56 | |
*** sudipto_ has quit IRC | 07:00 | |
*** sudipto has quit IRC | 07:00 | |
*** CristinaPauna has quit IRC | 07:00 | |
*** namnh has quit IRC | 07:06 | |
*** yamahata has joined #openstack-nova | 07:07 | |
*** CristinaPauna has joined #openstack-nova | 07:12 | |
*** trinaths has quit IRC | 07:17 | |
*** rcernin has joined #openstack-nova | 07:18 | |
*** tesseract has joined #openstack-nova | 07:18 | |
*** bhagyashris has quit IRC | 07:19 | |
*** lpetrut has joined #openstack-nova | 07:20 | |
*** iceyao has quit IRC | 07:21 | |
*** namnh has joined #openstack-nova | 07:23 | |
*** edmondsw has joined #openstack-nova | 07:24 | |
*** lpetrut has quit IRC | 07:24 | |
*** kevinz has quit IRC | 07:28 | |
*** hwoarang has quit IRC | 07:28 | |
*** kevinz has joined #openstack-nova | 07:28 | |
*** hwoarang has joined #openstack-nova | 07:29 | |
*** edmondsw has quit IRC | 07:29 | |
*** edmondsw has joined #openstack-nova | 07:29 | |
*** vladikr has quit IRC | 07:30 | |
*** raunak has joined #openstack-nova | 07:32 | |
*** edmondsw has quit IRC | 07:34 | |
*** yamamoto has quit IRC | 07:38 | |
*** gongysh has joined #openstack-nova | 07:41 | |
*** iceyao has joined #openstack-nova | 07:45 | |
*** jpena|away is now known as jpena | 07:52 | |
bauzas | good morning Nova | 07:52 |
bauzas | p!spy | 07:52 |
*** unicell has quit IRC | 07:53 | |
*** pkoniszewski has joined #openstack-nova | 07:53 | |
openstackgerrit | Alex Xu proposed openstack/nova-specs master: The ResourceProviderTraits API - Manage traits with ResourceProviders https://review.openstack.org/345138 | 08:00 |
*** andreas_s has joined #openstack-nova | 08:01 | |
*** jpena is now known as jpena|away | 08:05 | |
*** yuntongjin has joined #openstack-nova | 08:07 | |
*** slunkad has quit IRC | 08:07 | |
*** esberglu has joined #openstack-nova | 08:10 | |
*** slunkad has joined #openstack-nova | 08:11 | |
*** jpena|away is now known as jpena | 08:12 | |
*** pcaruana has joined #openstack-nova | 08:13 | |
*** avolkov has joined #openstack-nova | 08:14 | |
*** Kevin_Zheng has joined #openstack-nova | 08:15 | |
*** esberglu has quit IRC | 08:15 | |
*** ltomasbo|away is now known as ltomasbo | 08:16 | |
*** yamamoto has joined #openstack-nova | 08:17 | |
*** yamamoto_ has joined #openstack-nova | 08:17 | |
*** yamamoto_ has quit IRC | 08:20 | |
*** yamamoto has quit IRC | 08:21 | |
*** Fdaisuke has quit IRC | 08:24 | |
*** gibi_ is now known as gibi | 08:25 | |
*** zioproto has joined #openstack-nova | 08:26 | |
zioproto | hello there | 08:26 |
zioproto | still working on the nova migration from mitaka to newton. I found out that after the database migrations all my flavors and aggregates are duplicated in the db. | 08:26 |
*** raunak has quit IRC | 08:26 | |
*** dulek has joined #openstack-nova | 08:27 | |
*** lpetrut has joined #openstack-nova | 08:29 | |
zioproto | I checked in the API db | 08:29 |
zioproto | and in the flavor table there are not duplicates | 08:30 |
zioproto | but openstack flavor list returns duplicate flavors | 08:30 |
*** lpetrut has quit IRC | 08:33 | |
openstackgerrit | Feodor Tersin proposed openstack/nova-specs master: Add ScaleIO ephemeral storage backend https://review.openstack.org/304715 | 08:33 |
*** CristinaPauna has quit IRC | 08:39 | |
*** nmathew has quit IRC | 08:41 | |
*** nmathew- has joined #openstack-nova | 08:41 | |
*** trinaths has joined #openstack-nova | 08:41 | |
*** mlakat has joined #openstack-nova | 08:42 | |
*** gaoyuan has quit IRC | 08:44 | |
*** rmart04 has joined #openstack-nova | 08:44 | |
*** gaoyuan has joined #openstack-nova | 08:45 | |
*** ralonsoh has joined #openstack-nova | 08:46 | |
*** gszasz has joined #openstack-nova | 08:47 | |
*** ducnc has joined #openstack-nova | 08:48 | |
*** rmart04 has quit IRC | 08:48 | |
*** CristinaPauna has joined #openstack-nova | 08:50 | |
*** mlakat has quit IRC | 08:55 | |
*** jaosorior has joined #openstack-nova | 08:56 | |
*** rmart04 has joined #openstack-nova | 08:57 | |
*** zzzeek has quit IRC | 09:00 | |
*** zzzeek has joined #openstack-nova | 09:00 | |
zioproto | anyone ? | 09:01 |
*** fandi has joined #openstack-nova | 09:04 | |
*** fandi has quit IRC | 09:09 | |
*** eglynn has joined #openstack-nova | 09:11 | |
*** amoralej|off is now known as amoralej | 09:13 | |
*** thorst has joined #openstack-nova | 09:13 | |
*** yamamoto has joined #openstack-nova | 09:17 | |
*** thorst has quit IRC | 09:18 | |
*** yamamoto has quit IRC | 09:22 | |
*** Jeffrey4l has quit IRC | 09:25 | |
*** Jeffrey4l has joined #openstack-nova | 09:25 | |
*** udesale__ has joined #openstack-nova | 09:26 | |
*** Guest79770 has quit IRC | 09:27 | |
*** ZZelle has joined #openstack-nova | 09:27 | |
*** ZZelle is now known as Guest20418 | 09:28 | |
*** udesale has quit IRC | 09:28 | |
*** Guest20418 is now known as ZZelle_ | 09:28 | |
*** Oku_OS-away is now known as Oku_OS | 09:30 | |
*** zioproto has quit IRC | 09:30 | |
*** Jeffrey4l has quit IRC | 09:31 | |
openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/nova-specs master: Live Migration of Rescued Instances https://review.openstack.org/347161 | 09:32 |
*** nmathew- has quit IRC | 09:34 | |
*** lucas-afk is now known as lucasagomes | 09:35 | |
*** zioproto has joined #openstack-nova | 09:37 | |
*** yuntongjin has quit IRC | 09:39 | |
*** yingjun has quit IRC | 09:39 | |
*** aarefiev_afk is now known as aarefiev | 09:39 | |
*** bkopilov has joined #openstack-nova | 09:42 | |
*** Jeffrey4l has joined #openstack-nova | 09:43 | |
*** udesale__ has quit IRC | 09:47 | |
*** kaisers_ has joined #openstack-nova | 09:47 | |
*** udesale has joined #openstack-nova | 09:48 | |
*** kaisers_ has quit IRC | 09:52 | |
*** trinaths has quit IRC | 09:54 | |
*** namnh has quit IRC | 09:55 | |
*** esberglu has joined #openstack-nova | 09:59 | |
*** esberglu has quit IRC | 10:03 | |
*** ralonsoh_ has joined #openstack-nova | 10:05 | |
*** ralonsoh has quit IRC | 10:05 | |
*** ralonsoh_ is now known as ralonsoh | 10:06 | |
*** gszasz has quit IRC | 10:06 | |
*** diga has quit IRC | 10:08 | |
*** gszasz has joined #openstack-nova | 10:08 | |
openstackgerrit | John Garbutt proposed openstack/nova-specs master: Add spec to use Cinder's new attachment APIs https://review.openstack.org/373203 | 10:10 |
*** gszasz has quit IRC | 10:10 | |
*** gszasz has joined #openstack-nova | 10:12 | |
*** tovin07 has quit IRC | 10:12 | |
*** nmathew has joined #openstack-nova | 10:16 | |
*** yufei has joined #openstack-nova | 10:17 | |
*** lpetrut has joined #openstack-nova | 10:18 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/439925 | 10:18 |
*** yamamoto has joined #openstack-nova | 10:19 | |
*** bhagyashris has joined #openstack-nova | 10:21 | |
*** yamamoto has quit IRC | 10:22 | |
*** kevinz has quit IRC | 10:23 | |
*** romainh has joined #openstack-nova | 10:25 | |
*** udesale__ has joined #openstack-nova | 10:26 | |
*** gongysh has quit IRC | 10:27 | |
*** udesale has quit IRC | 10:28 | |
zioproto | dansmith: I am still working on those database migrations. Ping me when you come online | 10:29 |
*** udesale__ has quit IRC | 10:30 | |
*** yufei has quit IRC | 10:30 | |
*** links has quit IRC | 10:31 | |
*** cdent has joined #openstack-nova | 10:33 | |
*** sree has quit IRC | 10:35 | |
*** iceyao has quit IRC | 10:39 | |
*** ociuhandu has joined #openstack-nova | 10:41 | |
*** ducnc has quit IRC | 10:47 | |
*** links has joined #openstack-nova | 10:47 | |
*** ociuhandu has quit IRC | 10:47 | |
*** dikonoor has quit IRC | 10:49 | |
*** claudiub|2 is now known as claudiub | 10:49 | |
*** yamamoto has joined #openstack-nova | 10:53 | |
*** yamamoto has quit IRC | 10:53 | |
*** tovin07 has joined #openstack-nova | 10:54 | |
openstackgerrit | Huan Xie proposed openstack/nova master: WIP: Make xenapi driver compatible with assert_can_migrate https://review.openstack.org/439960 | 10:56 |
*** mvk has quit IRC | 10:57 | |
openstackgerrit | Huan Xie proposed openstack/nova master: Make xenapi driver compatible with assert_can_migrate https://review.openstack.org/439960 | 10:57 |
*** gcb has quit IRC | 10:57 | |
*** gcb has joined #openstack-nova | 10:58 | |
*** sambetts|afk is now known as sambetts | 10:59 | |
*** derekh has joined #openstack-nova | 10:59 | |
*** ociuhandu has joined #openstack-nova | 10:59 | |
*** nicolasbock has joined #openstack-nova | 11:01 | |
*** bhagyashris has quit IRC | 11:03 | |
*** gcb has quit IRC | 11:04 | |
*** yamamoto has joined #openstack-nova | 11:04 | |
*** tbachman has joined #openstack-nova | 11:05 | |
*** bhagyashris has joined #openstack-nova | 11:05 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: handle uninited fields in notification payload https://review.openstack.org/415857 | 11:06 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: re-orphan flavor after rpc deserialization https://review.openstack.org/440347 | 11:06 |
*** dikonoor has joined #openstack-nova | 11:07 | |
*** nmathew has quit IRC | 11:08 | |
*** dikonoo has joined #openstack-nova | 11:08 | |
*** dikonoor has quit IRC | 11:11 | |
*** dikonoor has joined #openstack-nova | 11:12 | |
*** phuongnh has quit IRC | 11:13 | |
*** thorst has joined #openstack-nova | 11:14 | |
*** dikonoo has quit IRC | 11:15 | |
*** ociuhandu has quit IRC | 11:18 | |
*** ociuhandu has joined #openstack-nova | 11:19 | |
*** thorst has quit IRC | 11:19 | |
*** edmondsw has joined #openstack-nova | 11:20 | |
*** hshiina has joined #openstack-nova | 11:24 | |
*** edmondsw has quit IRC | 11:25 | |
*** tbachman has quit IRC | 11:26 | |
bhagyashris | johnthetubaguy: Hi, | 11:28 |
*** mvk has joined #openstack-nova | 11:28 | |
bhagyashris | johnthetubaguy: I want to discuss regarding patch https://review.openstack.org/#/c/409644/ | 11:31 |
*** yufei has joined #openstack-nova | 11:31 | |
johnthetubaguy | bhagyashris: yes | 11:32 |
*** tbachman has joined #openstack-nova | 11:32 | |
bhagyashris | johnthetubaguy: currently i am working on it, so my dought is what response code should i written if rotation==0 | 11:32 |
bhagyashris | s/written/return | 11:33 |
*** romainh has quit IRC | 11:34 | |
bhagyashris | s/dought/doubt | 11:36 |
*** ociuhandu has quit IRC | 11:37 | |
*** avolkov has quit IRC | 11:38 | |
*** ociuhandu has joined #openstack-nova | 11:39 | |
*** avolkov has joined #openstack-nova | 11:39 | |
*** tbachman has quit IRC | 11:39 | |
*** ratailor has quit IRC | 11:41 | |
*** dikonoor has quit IRC | 11:42 | |
*** eglynn has quit IRC | 11:43 | |
*** ociuhandu has quit IRC | 11:43 | |
*** sdague has joined #openstack-nova | 11:46 | |
*** yufei has quit IRC | 11:47 | |
*** vanch has joined #openstack-nova | 11:48 | |
*** kaisers_ has joined #openstack-nova | 11:48 | |
vanch | Hi. Is it possible to create server with several volumes attached? block-device-mapping won't help. | 11:49 |
vanch | Seems like i'm affected by this bug https://bugs.launchpad.net/nova/+bug/1560965 and can't attach volumes to instances. | 11:49 |
openstack | Launchpad bug 1560965 in OpenStack Dashboard (Horizon) "libvirt selects wrong root device name" [Undecided,In progress] - Assigned to Matthew Taylor (matthew-taylor-f) | 11:49 |
*** dikonoor has joined #openstack-nova | 11:51 | |
zioproto | johnthetubaguy: after running the database migrations from from mitaka to newton if I make `openstack flavor list` I get the list with all flavors two times. So far I found flavor information only in the api DB in the flavors table. But also in the main nova db in the instance_types table. I have the feeling only 1 should exist. | 11:51 |
*** links has quit IRC | 11:51 | |
*** yassine has quit IRC | 11:52 | |
*** lucasagomes is now known as lucas-brb | 11:52 | |
johnthetubaguy | zioproto: sounds wrong, the online db migration generally deletes the old ones during the move, dansmith might remember more about that flavor migration stuff | 11:53 |
johnthetubaguy | zioproto: for sure the api db is where it should be now | 11:53 |
zioproto | johnthetubaguy: so I confirm that doing in the main nova db ` update instance_types set deleted=1;` it fixes the problem | 11:54 |
zioproto | looks like when the flavor where migrated to the new db, they were not deleted on the main nova db | 11:54 |
*** romainh has joined #openstack-nova | 11:54 | |
zioproto | now I am looking into the host aggregates, I have quite the same problem | 11:54 |
johnthetubaguy | zioproto: sounds like you have a permissions error for the connection strings being used for the online db migrations, did you get any errors? | 11:55 |
zioproto | johnthetubaguy: also `openstack aggregate list` returns everything double | 11:55 |
*** kaisers_ has quit IRC | 11:55 | |
johnthetubaguy | yeah, it deletes stuff in the same way | 11:55 |
zioproto | ok dansmith has a dump of my DB. I guess I have to wait it is morning in UTC-9 | 11:56 |
zioproto | I had tons of errors, because of another bug we fixed | 11:56 |
johnthetubaguy | zioproto: if it helps I think these are the things we will be running with the newton online db migration: https://github.com/openstack/nova/blob/stable/newton/nova/cmd/manage.py#L786 | 11:57 |
johnthetubaguy | zioproto: you can see it trying to delete the old flavors: https://github.com/openstack/nova/blob/stable/newton/nova/objects/flavor.py#L703 | 11:58 |
johnthetubaguy | zioproto: in theory you should have seem some errors logged from this code: https://github.com/openstack/nova/blob/stable/newton/nova/objects/flavor.py#L722 | 11:58 |
johnthetubaguy | zioproto: did you see any of those? | 11:58 |
*** yassine has joined #openstack-nova | 11:58 | |
*** yamamoto has quit IRC | 11:58 | |
*** Kevin_Zheng_Home has joined #openstack-nova | 12:00 | |
*** jpena is now known as jpena|lunch | 12:02 | |
*** links has joined #openstack-nova | 12:04 | |
*** ralonsoh_ has joined #openstack-nova | 12:06 | |
openstackgerrit | Gao Yuan proposed openstack/nova master: Stop using mox stubs in nova.tests.unit.api.openstack.compute.test_serversV21 https://review.openstack.org/438873 | 12:06 |
openstackgerrit | Gao Yuan proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_block_device_mapping https://review.openstack.org/440475 | 12:06 |
*** Kevin_Zheng_Home has quit IRC | 12:08 | |
*** yamahata has quit IRC | 12:08 | |
*** ralonsoh has quit IRC | 12:09 | |
*** bkopilov has quit IRC | 12:10 | |
*** aysyd has joined #openstack-nova | 12:12 | |
*** romainh has quit IRC | 12:14 | |
*** romainh1 has joined #openstack-nova | 12:14 | |
*** annegentle has quit IRC | 12:16 | |
*** JoseMello has joined #openstack-nova | 12:17 | |
*** smatzek_ has joined #openstack-nova | 12:20 | |
*** smatzek_ has quit IRC | 12:21 | |
*** smatzek_ has joined #openstack-nova | 12:21 | |
openstackgerrit | Rico Lin proposed openstack/python-novaclient master: [Fix gate]Update test requirement https://review.openstack.org/440501 | 12:28 |
*** kevinz has joined #openstack-nova | 12:31 | |
*** tovin07 has quit IRC | 12:34 | |
zioproto | johnthetubaguy: no, not any of those | 12:36 |
zioproto | johnthetubaguy: http://paste.openstack.org/show/601128/ | 12:36 |
zioproto | is it correct to run `nova-manage db online_data_migrations` in mitaka before starting and then again in newton when the migration is completed ? | 12:36 |
*** bvanhav has joined #openstack-nova | 12:36 | |
johnthetubaguy | zioproto: only if you run the mitaka version of the code when you have mitaka running, and the newton ones only when you are fully schema and code updated to newton | 12:37 |
johnthetubaguy | zioproto: thats looks like the error you get after it failed differently the first time | 12:38 |
*** kevinz has quit IRC | 12:38 | |
* johnthetubaguy goes back to lunch, back in a bit | 12:38 | |
*** kevinz has joined #openstack-nova | 12:39 | |
*** tuanluong has quit IRC | 12:40 | |
*** gaoyuan has quit IRC | 12:42 | |
*** gszasz has quit IRC | 12:43 | |
*** thorst has joined #openstack-nova | 12:45 | |
*** gszasz has joined #openstack-nova | 12:48 | |
*** gszasz has quit IRC | 12:48 | |
zioproto | johnthetubaguy: I will update another staging cluster we have and I will give feedbacl | 12:50 |
*** gszasz has joined #openstack-nova | 12:51 | |
*** salv-orlando has joined #openstack-nova | 12:52 | |
*** owalsh is now known as owalsh-afk | 12:53 | |
*** ayogi has quit IRC | 12:54 | |
*** salv-orl_ has quit IRC | 12:55 | |
*** catintheroof has joined #openstack-nova | 12:56 | |
*** rfolco has joined #openstack-nova | 12:57 | |
*** yamamoto has joined #openstack-nova | 12:59 | |
*** mriedem_afk is now known as mriedem | 13:02 | |
*** jpena|lunch is now known as jpena | 13:02 | |
openstackgerrit | Matthew Booth proposed openstack/nova master: Improve the readability of check_instance_state https://review.openstack.org/440536 | 13:04 |
*** jwcroppe has quit IRC | 13:08 | |
*** yamamoto has quit IRC | 13:09 | |
*** tbachman has joined #openstack-nova | 13:11 | |
johnthetubaguy | zioproto: it would be great to get those logs for the first run. I am sure dansmith would be able to give you more advice on what is worth collecting once he is online | 13:14 |
*** des_consolado has joined #openstack-nova | 13:14 | |
mriedem | dansmith: +2 on melwitt's counting quotas spec which was amended for pike to note the allocations user/project tracking for quota when a cell is down https://review.openstack.org/#/c/431749/ | 13:16 |
mriedem | dansmith: also noted in there, in ocata we just required that placement existed for comptues to starrt but we didn't require a minimum microversion, | 13:17 |
mriedem | i think in pike we have to require that placement 1.4 (ocata) is available otherwise the scheduler won't work since we don't fallback | 13:17 |
mriedem | so something to remember to put into nova-status | 13:17 |
*** kevinz has quit IRC | 13:19 | |
*** kevinz has joined #openstack-nova | 13:20 | |
*** READ10 has joined #openstack-nova | 13:21 | |
*** jwcroppe has joined #openstack-nova | 13:23 | |
*** esberglu has joined #openstack-nova | 13:24 | |
mriedem | edleafe: cdent: fyi https://bugs.launchpad.net/nova/+bug/1669433 | 13:24 |
openstack | Launchpad bug 1669433 in OpenStack Compute (nova) "nova-status needs to check that placement 1.4 is available for pike" [High,Confirmed] | 13:24 |
cdent | mriedem: noted, thanks | 13:24 |
* cdent is barely surfaced | 13:25 | |
johnthetubaguy | mriedem: I keep meaning to hit that spec | 13:26 |
mriedem | johnthetubaguy: it's just a re-proposal with the added stuff about storing user/project in the allocations table, what we talked about at the PTG | 13:27 |
johnthetubaguy | mriedem: ah, cool | 13:27 |
andymccr | owalsh-afk: following on from yesterday i think if you check the output of api_db version and it's 0 --> then do api_db sync first - this should work, testing it now though. Should avoid the need for an upgrade flag! | 13:28 |
*** markus_z has quit IRC | 13:30 | |
*** cdent has quit IRC | 13:31 | |
*** prateek has quit IRC | 13:36 | |
lyarwood | johnthetubaguy: thanks for the review on the detach patch, I'll try to get another version posted before the meeting at 5 with the cinder team | 13:36 |
mriedem | melwitt: did you see rajesh's email about the ceph monitor ip change bug again? that reminded me of talking about it at the ptg. i was wondering if you were planning on making changes there. | 13:37 |
*** tbachman has quit IRC | 13:39 | |
*** tbachman has joined #openstack-nova | 13:40 | |
*** diana_clarke has joined #openstack-nova | 13:41 | |
*** diana_clarke has left #openstack-nova | 13:41 | |
*** lucas-brb is now known as lucasagomes | 13:44 | |
*** ralonsoh_ has quit IRC | 13:44 | |
*** Jeffrey4l has quit IRC | 13:49 | |
*** kevinz has quit IRC | 13:50 | |
sdague | mriedem: when you get a mental breathing space, I actually need to talk through the options here - https://review.openstack.org/#/c/438049/6/nova/api/openstack/identity.py - because I'm torn in a few directions | 13:50 |
*** kevinz has joined #openstack-nova | 13:51 | |
*** kaisers_ has joined #openstack-nova | 13:51 | |
*** bvanhav_ has joined #openstack-nova | 13:52 | |
*** mdnadeem has quit IRC | 13:52 | |
*** eharney has joined #openstack-nova | 13:52 | |
*** ducttape_ has joined #openstack-nova | 13:52 | |
*** mvk has quit IRC | 13:52 | |
*** bvanhav has quit IRC | 13:53 | |
*** liangy has joined #openstack-nova | 13:53 | |
*** liuyulong has joined #openstack-nova | 13:54 | |
*** rmart04 has quit IRC | 13:54 | |
*** kaisers_ has quit IRC | 13:56 | |
*** eharney has quit IRC | 13:57 | |
*** markus_z has joined #openstack-nova | 14:00 | |
*** tblakes has joined #openstack-nova | 14:00 | |
*** salv-orlando has quit IRC | 14:01 | |
*** cdent has joined #openstack-nova | 14:03 | |
*** vladikr has joined #openstack-nova | 14:05 | |
*** ralonsoh has joined #openstack-nova | 14:06 | |
*** breton has quit IRC | 14:07 | |
*** xyang1 has joined #openstack-nova | 14:07 | |
mdbooth | lyarwood johnthetubaguy: Just had a random thought. I think Nova is still going to have to track connect/disconnect for detach. Say you've got a shared connection containing N connected volumes. The user disconnects all N almost simultaneously. When the last one is disconnected, cinder can tell Nova in that disconnect call that there are none left. However, depending on the order Nova processes them, it might not be the last one. IOW | 14:07 |
mdbooth | it's a race. I think only Nova can reliably know when it's no longer in use on the host. | 14:07 |
*** ducttape_ has quit IRC | 14:08 | |
*** jaypipes has quit IRC | 14:08 | |
mdbooth | And by Nova I mean os-brick obviously. | 14:08 |
mdbooth | But still Nova. | 14:08 |
johnthetubaguy | mdbooth: I thought the locking method, and re-fetching the list with the lock held, and held for the duration of the disconnect, would work around that | 14:09 |
johnthetubaguy | mdbooth: there could be a big hole in that though | 14:09 |
*** eharney has joined #openstack-nova | 14:09 | |
openstackgerrit | Gábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details https://review.openstack.org/440580 | 14:11 |
*** mdrabe has joined #openstack-nova | 14:12 | |
*** links has quit IRC | 14:12 | |
mriedem | sdague: i've got to start getting maya ready to leave in about 5 minutes, which usually takes about 10 minutes because of the constant redirecting, do you want to talk about it later? i see you're in -dev talking quotas. alternatively, dump your brain in the ML and i'll read it when i'm in the office later and have time to weigh the options. | 14:15 |
*** rmart04 has joined #openstack-nova | 14:15 | |
edleafe | mriedem: ack on the nova-status bug | 14:15 |
openstackgerrit | Gábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details https://review.openstack.org/440580 | 14:15 |
mriedem | sdague: plus if it's in the list then others can weigh in | 14:15 |
*** crushil has joined #openstack-nova | 14:17 | |
mriedem | sileht: i feel like manila had the exact same type of issue you're talking about in the ML with the broken telemetry job | 14:17 |
mriedem | and it had something to do with the order of their devstack plugin setup, | 14:17 |
mriedem | such that it was trying to list instances before the instances were in a cell | 14:17 |
mriedem | something like that | 14:17 |
sileht | We don't do anything special | 14:18 |
mriedem | sileht: so need to know when simple_cell_setup is called relative to when the openstack server list returns nothing | 14:18 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: fix missing instance.delete notification https://review.openstack.org/437222 | 14:19 |
*** gouthamr has joined #openstack-nova | 14:19 | |
mdbooth | johnthetubaguy: Nova re-fetching the list with the lock held would work, but only if cinder also didn't update the list until Nova had confirmed the detach. | 14:19 |
sileht | mriedem, we call "openstack server list" after ./stack.sh says everything is ready | 14:19 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform missing delete notifications https://review.openstack.org/410297 | 14:19 |
sileht | mriedem, and then we polls nova every second during 10 minutes | 14:19 |
mdbooth | johnthetubaguy: It's starting to sound to me like a nova-side implementation is going to be simpler. | 14:20 |
mdbooth | After all, it really is an implementation detail of the driver. | 14:21 |
*** owalsh-afk is now known as owalsh | 14:21 | |
johnthetubaguy | mdbooth: right, its assuming the attachments that are shared on the nova host are only modified by Nova (which we can enforce now, using service tokens) | 14:21 |
mriedem | sileht: ok simple_cell_setup is run well before that http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_09_08_19_738 | 14:22 |
johnthetubaguy | mdbooth: generally thats always the case anyways, but it can be enforced too | 14:22 |
sileht | mriedem, yes | 14:22 |
mriedem | sileht: is it listing servers with a filter? | 14:23 |
mriedem | or just listing servers and checking for one result? | 14:23 |
sileht | mriedem, just GET /servers/detail HTTP/1.1 | 14:23 |
mriedem | when did this start failing? | 14:23 |
*** baoli has joined #openstack-nova | 14:24 | |
sileht | I would says some days ago | 14:24 |
*** cleong has joined #openstack-nova | 14:24 | |
*** Kevin_Zheng_ has joined #openstack-nova | 14:25 | |
sileht | We didn't notice the exact time because we fall into an oslo.messaging from time to time and people recheck a lot this job | 14:25 |
mriedem | markus_z: looks like we have a novnc test failure in tempest http://logs.openstack.org/63/435563/3/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/20e15f9/console.html#_2017-03-01_20_30_52_369683 | 14:25 |
mriedem | intermittent i mean | 14:25 |
sileht | since yesterday or the day before, we seen that the error is no more the oslo.messaging bug | 14:25 |
sileht | and it's always failing | 14:25 |
openstackgerrit | Gábor Antal proposed openstack/nova-specs master: Show persisted scheduler hints in server details https://review.openstack.org/440580 | 14:25 |
mriedem | sileht: we should be able to identify when the failure started using logstash | 14:26 |
sileht | mriedem, i'm suspecting a policies bug, because when ceilometer polls nova with ceilometer service account and 'all_tenants=True', it see the instances | 14:26 |
sileht | instances owner are admin/admin | 14:26 |
mriedem | sileht: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22AssertionError%3A%20json%20path%20%24.servers%5B0%5D.status%20cannot%20match%20%7Bu'servers'%3A%20%5B%5D%7D%5C%22&from=7d | 14:26 |
sileht | and we do the 'openstack server list' as admin/admin | 14:26 |
markus_z | mriedem: I haven't seen that test before, I can take a look. | 14:27 |
*** liverpooler has joined #openstack-nova | 14:27 | |
mriedem | markus_z: pretty high failure rate | 14:28 |
mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22in%20_validate_rfb_negotiation%5C%22&from=7d | 14:28 |
mriedem | sdague: ^ | 14:28 |
mriedem | i don't think we're tracking that - mtreinish ^ | 14:28 |
mriedem | sileht: looks like it started on 2/28 | 14:28 |
mriedem | so should dig through related looking changes https://github.com/openstack/nova/commits/master | 14:29 |
mriedem | i have to run for a bit | 14:29 |
*** Jeffrey4l has joined #openstack-nova | 14:29 | |
mtreinish | mriedem: I don't think we're tracking it yet | 14:29 |
*** mriedem has quit IRC | 14:30 | |
*** edmondsw has joined #openstack-nova | 14:32 | |
*** breton has joined #openstack-nova | 14:32 | |
markus_z | the first hits start on 02/21, the tempest test merged 02/03 | 14:34 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: fix missing instance.delete notification https://review.openstack.org/437222 | 14:34 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform missing delete notifications https://review.openstack.org/410297 | 14:34 |
*** Jeffrey4l has quit IRC | 14:35 | |
*** mlavalle has joined #openstack-nova | 14:35 | |
*** JoseMello has quit IRC | 14:35 | |
markus_z | That's the first one: http://logs.openstack.org/38/431038/3/check/gate-tempest-dsvm-neutron-multinode-full-ubuntu-xenial-nv/5e1d485/console.html | 14:36 |
*** yingjun has joined #openstack-nova | 14:37 | |
*** jaypipes has joined #openstack-nova | 14:38 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: Improve assertJsonEqual error reporting https://review.openstack.org/428199 | 14:39 |
*** tblakes has quit IRC | 14:39 | |
*** felipemonteiro has joined #openstack-nova | 14:40 | |
*** felipemonteiro_ has joined #openstack-nova | 14:40 | |
*** esberglu has quit IRC | 14:43 | |
*** kevinz has quit IRC | 14:47 | |
*** kevinz has joined #openstack-nova | 14:47 | |
*** coreywright has quit IRC | 14:48 | |
*** jaypipes has quit IRC | 14:48 | |
*** coreywright has joined #openstack-nova | 14:48 | |
bhagyashris | johnthetubaguy: Hi, i am waiting for your opinion regarding: which response code should i return if rotation==0? | 14:48 |
johnthetubaguy | bhagyashris: on that patch, I basically said there should be no API change, I believe? | 14:49 |
johnthetubaguy | bhagyashris: I suspect that wasn't very clear though, sorry. | 14:49 |
johnthetubaguy | bhagyashris: I would just upload what you have so far, or did you already do that? | 14:50 |
*** gabor_antal_km has joined #openstack-nova | 14:50 | |
bhagyashris | johnthetubaguy: ok. | 14:50 |
johnthetubaguy | bhagyashris: sorry, I seem to have missed that you reply to me earlier, for some reason | 14:50 |
*** ujjain has quit IRC | 14:50 | |
*** gabor_antal_ has quit IRC | 14:51 | |
johnthetubaguy | bhagyashris: basically I think we should allow 0, and make that just delete snapshots, rather than create one it deletes right away after having just created it | 14:51 |
*** hongbin has joined #openstack-nova | 14:51 | |
bhagyashris | johnthetubaguy: ok. | 14:52 |
johnthetubaguy | bhagyashris: that seems to solve the bug, and keep the API behaviour we had before, but I could be missing something | 14:53 |
*** jaypipes has joined #openstack-nova | 14:54 | |
*** mvk has joined #openstack-nova | 14:56 | |
*** tblakes has joined #openstack-nova | 14:57 | |
*** ducttape_ has joined #openstack-nova | 14:57 | |
bhagyashris | johnthetubaguy: in that case image_meta will be empty | 14:57 |
johnthetubaguy | bhagyashris: sorry, I am not sure what you mean? | 14:58 |
*** baoli has quit IRC | 14:59 | |
*** mriedem has joined #openstack-nova | 14:59 | |
*** mriedem has quit IRC | 14:59 | |
bhagyashris | johnthetubaguy: I mean the https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2697 will be empty if rotation==0 | 15:00 |
*** mriedem has joined #openstack-nova | 15:00 | |
johnthetubaguy | bhagyashris: ah, very good point | 15:01 |
mriedem | sileht: i'm back, any news? | 15:01 |
*** romainh1 has quit IRC | 15:01 | |
*** romainh has joined #openstack-nova | 15:01 | |
johnthetubaguy | bhagyashris: which would totally be a change in the API | 15:01 |
*** esberglu has joined #openstack-nova | 15:01 | |
*** zz_dimtruck is now known as dimtruck | 15:03 | |
*** rmart04 has quit IRC | 15:03 | |
johnthetubaguy | bhagyashris: it feels like this needs more discussion / a spec | 15:03 |
*** mtanino has joined #openstack-nova | 15:04 | |
mriedem | oy | 15:05 |
mriedem | how do you keep calm when working with a customer for 2 weeks to apply some patches and they complain the patches don't work and you see they were patching with the --dry-run option the entire time | 15:06 |
*** dikonoor has quit IRC | 15:06 | |
mriedem | i.e. not actually applying any patches | 15:06 |
mriedem | :( | 15:06 |
sileht | mriedem, I'm seen the call returning something here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_25_647 | 15:07 |
sileht | mriedem, and later nothing: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_150 | 15:07 |
*** edand has quit IRC | 15:08 | |
*** trinaths has joined #openstack-nova | 15:08 | |
bauzas | mriedem: fun story | 15:08 |
bhagyashris | johnthetubaguy: i will think on it. | 15:09 |
mriedem | bauzas: not only is the customer not applying them correctly, but there are at least 4 L3 people on the email thread who couldn't figure this out | 15:09 |
*** kevinz has quit IRC | 15:09 | |
bauzas | :) | 15:09 |
* mriedem needs to stop venting in public | 15:09 | |
mriedem | sileht: hmm, and nothing was deleted right? | 15:10 |
*** baoli has joined #openstack-nova | 15:10 | |
sileht | mriedem, yes one of the two instances have been deleted | 15:10 |
mriedem | markus_z: mtreinish: did a bug get created for that novnc issue? | 15:10 |
johnthetubaguy | bhagyashris: on a call, but just digging on the API | 15:10 |
sileht | mriedem, and I see only one instance delete on n-cpu | 15:10 |
kashyap | mriedem: Oh dear, not fun at all. | 15:10 |
markus_z | mriedem: I didn't. Here's the only novnc related patch I found https://github.com/openstack/nova/commit/8bbc1ee but it merged a few hours after the first issue :/ | 15:10 |
johnthetubaguy | bhagyashris: I am not sure the REST API actually changes, so an empty dict might be a fine return value from that function | 15:10 |
kashyap | mriedem: But hey, on the plus side, it is (hopefully) not some gory bug with packet loss :-) | 15:10 |
mriedem | kashyap: yeah if they said they did apply the fixes and the issue was still there, then that would be much worse | 15:11 |
markus_z | mriedem: I'm going to check other places too. | 15:11 |
* kashyap is trying to reproduce something like that involving a RARP requests; splitting hairs apart | 15:11 | |
kashyap | mriedem: Yeah. Glad you noticed it | 15:11 |
mriedem | markus_z: if we can just get a bug reported then we can track it in e-r | 15:12 |
mriedem | that's what i'm looking for now | 15:12 |
bhagyashris | johnthetubaguy: ok. Thank you for information | 15:12 |
markus_z | mriedem: yep, I'm writing it right now | 15:12 |
*** trinaths has quit IRC | 15:12 | |
johnthetubaguy | bhagyashris: it looks like we already don't return the header if rotation == 0: https://github.com/openstack/nova/blob/e75d5f9d531dddd6ce0ada47d64bfcdce14f93cf/nova/api/openstack/compute/create_backup.py#L83 | 15:13 |
johnthetubaguy | bhagyashris: I quite strongly think we should keep allowing 0, but just stop creating the snapshot for that case, and only do the deletes | 15:15 |
markus_z | mriedem: https://bugs.launchpad.net/nova/+bug/1669468 | 15:15 |
openstack | Launchpad bug 1669468 in OpenStack Compute (nova) "tempest.api.compute.servers.test_novnc.NoVNCConsoleTestJSON.test_novnc fails intermittently" [Undecided,New] | 15:15 |
*** crushil has quit IRC | 15:15 | |
*** crushil has joined #openstack-nova | 15:15 | |
mriedem | sileht: looks like at this point we have 1 cell and it's cell0 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_528 | 15:16 |
bhagyashris | johnthetubaguy: ok. | 15:16 |
mriedem | sileht: at this point we have 2 cells http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_642 | 15:16 |
mriedem | cell0 and the main cell | 15:16 |
bhagyashris | johnthetubaguy: Thank you for information | 15:16 |
johnthetubaguy | bhagyashris: no problem | 15:16 |
mriedem | sileht: looks like both of those are before you're listing instances | 15:16 |
mriedem | markus_z: thanks | 15:17 |
mriedem | markus_z: note that logstash only goes back 10 days | 15:18 |
*** sridharg has quit IRC | 15:18 | |
mriedem | so it might have been an issue before 2/21 | 15:18 |
markus_z | mriedem: ohh, ok, I didn't know that this is a hard limit. I'll check earlier changes too. | 15:18 |
*** baoli has quit IRC | 15:18 | |
markus_z | mriedem: I'm writing the e-r entry, takes a minute, haven't done it in a while. | 15:19 |
mriedem | markus_z: actually we probably don't want an e-r query for this, | 15:19 |
mriedem | it's mostly in the neutron multinode nv job | 15:19 |
mriedem | we don't have e-r queries for nv jobs | 15:19 |
mriedem | so it's probably something that just fails in multinode | 15:20 |
markus_z | mriedem: OK, got it. | 15:20 |
*** sree has joined #openstack-nova | 15:21 | |
mriedem | sileht: so something is weird, looking at http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_150 where we don't get anything back | 15:23 |
mriedem | i see "Skipping already-collected cell0" just before that | 15:23 |
mriedem | which is this https://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L2538 | 15:23 |
mriedem | but i don't see this message after it | 15:23 |
mriedem | https://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L2540 | 15:23 |
mriedem | which is where it should be listing instances from the main cell | 15:23 |
mriedem | sileht: do you have a bug tracking the issue? i wanted to push some debug patches | 15:24 |
sileht | mriedem, I open it | 15:24 |
mriedem | so at this point we should have 2 cells | 15:25 |
mriedem | http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_642 | 15:25 |
mriedem | cell0 and cell1 | 15:25 |
*** dave-mccowan has joined #openstack-nova | 15:25 | |
mriedem | but 3 minutes later, we don't process cell1 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_16_43_150 | 15:26 |
mriedem | which is where the instance would be | 15:26 |
*** sree has quit IRC | 15:26 | |
mriedem | dansmith: melwitt: just thought of something, but on the CELLS cache in the api https://github.com/openstack/nova/blob/68e808623e42442482e92f0d61a6667876f29e19/nova/compute/api.py#L2524 | 15:27 |
mriedem | once we set that, we don't refresh it w/o restarting nova-api, | 15:27 |
mriedem | so you could map_cell0, start nova-api, and then create (or add) another cell | 15:27 |
*** cdent has quit IRC | 15:27 | |
mriedem | i think that's a known issue | 15:27 |
dansmith | yeah true | 15:27 |
dansmith | I was literally just thinking about updating those things | 15:28 |
dansmith | however, like the service catalog.. that's once per setup | 15:28 |
mriedem | seems we should re-fetch if len(CELLS) == 1 and CELLS[0].uuid == cell0.uuid | 15:28 |
mriedem | this is really odd actually | 15:29 |
mriedem | at this point we have cell0 http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_528 | 15:29 |
mriedem | at this point we have 2 cells http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_13_54_642 | 15:29 |
mriedem | that could only happen if nova-api was restarted in between | 15:30 |
*** nkrinner is now known as nkrinner_afk | 15:30 | |
mriedem | i don't see that happening though | 15:31 |
sileht | mriedem, https://bugs.launchpad.net/nova/+bug/1669473 | 15:31 |
openstack | Launchpad bug 1669473 in OpenStack Compute (nova) "openstack server list returns an empty list" [Undecided,New] | 15:31 |
*** lucasxu has joined #openstack-nova | 15:32 | |
*** hshiina has quit IRC | 15:33 | |
*** bswartz has quit IRC | 15:34 | |
*** sneti_ has joined #openstack-nova | 15:37 | |
*** tovin07 has joined #openstack-nova | 15:37 | |
*** baoli has joined #openstack-nova | 15:39 | |
*** marst has joined #openstack-nova | 15:40 | |
*** tovin07 has left #openstack-nova | 15:40 | |
mdbooth | BobBall: Are you the citrix xenserver guy? | 15:41 |
mriedem | sileht: ok dumped some debug details in the bug, i'm going to work on adding some debug to nova | 15:41 |
mriedem | mdbooth: he is | 15:41 |
sileht | mriedem, cool thx | 15:41 |
mdbooth | Thanks. | 15:41 |
mdbooth | BobBall: CI looks sad. Are you aware? | 15:41 |
*** bkopilov has joined #openstack-nova | 15:41 | |
mdbooth | mriedem: After reviewing your patch this morning, btw, I decided to 2 a cleanup of check_instance_state and found 2 bugs: https://review.openstack.org/#/c/440536/ | 15:43 |
*** avolkov has quit IRC | 15:43 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Log with cell.uuid if cell.name is not set https://review.openstack.org/440644 | 15:43 |
mriedem | mdbooth: which patch? | 15:43 |
mriedem | dansmith: ^ easy debug fix patch | 15:43 |
mdbooth | Nothing earth shattering, but still bugs caused by readability | 15:43 |
*** baoli has quit IRC | 15:44 | |
*** tbachman has quit IRC | 15:44 | |
*** avolkov has joined #openstack-nova | 15:44 | |
mdbooth | mriedem: https://review.openstack.org/#/c/429476/ | 15:44 |
*** Matias has quit IRC | 15:44 | |
mriedem | ah | 15:47 |
mriedem | yeah check_instance_state is confusing | 15:47 |
mriedem | i always have to look at that 5 times to figure it out | 15:47 |
sileht | mriedem, , hum you are setting the global CELLS without lock that quiet dangerous | 15:47 |
sileht | quiet/quite | 15:47 |
sileht | mriedem, especially if get_all() does IO | 15:48 |
mdbooth | mriedem: I looked at it and assumed you were wrong, btw. Then looked 4 more times and worked out you were right :) | 15:48 |
mriedem | mdbooth: yeah that's par for the course with that one | 15:48 |
mriedem | sileht: yeah i thought the same - i don't think that's the issue here though since i'm seeing the "found 1 cells" and "found 2 cells" at different points | 15:51 |
mriedem | that aren't close together | 15:51 |
mriedem | and i don't see anything that will remove anything from that cache or overwrite it again | 15:52 |
*** kaisers_ has joined #openstack-nova | 15:52 | |
sileht | mriedem, do you have multiple api workers ? | 15:52 |
mriedem | if it went from 'found 2 cells' to 'found 1 cells' that would be a definite issue | 15:52 |
mriedem | yeah | 15:52 |
mriedem | 2 workers | 15:52 |
dansmith | it's not super efficient, but it's fine | 15:52 |
mriedem | oh hmm | 15:52 |
sileht | mriedem, perhaps one worker have 1 cells, the other 2 | 15:52 |
mriedem | yeah... | 15:52 |
mriedem | i bet that's it | 15:52 |
dansmith | only if we're starting api while we're setting up cells | 15:53 |
dansmith | which shouldn't be legit | 15:53 |
mriedem | yeah that's the other thing, cell0 and cell1 should exist before all of this | 15:53 |
mriedem | we start nova-api here http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_08_59_34_428 | 15:54 |
mriedem | 2017-03-02 08:59:34.428 | + functions-common:run_process:1491 : _run_process n-api /usr/local/bin/nova-api '' | 15:54 |
mriedem | we map cell0 here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_08_54_16_288 | 15:54 |
mriedem | 2017-03-02 08:54:16.288 | + lib/nova:init_nova:711 : nova-manage cell_v2 map_cell0 --database_connection 'mysql+pymysql://root:secretmysql@127.0.0.1/nova_cell0?charset=utf8' | 15:54 |
mriedem | hold the phone | 15:54 |
mriedem | http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/devstacklog.txt.gz#_2017-03-02_09_08_19_738 | 15:54 |
mriedem | 2017-03-02 09:08:19.738 | + lib/nova:create_cell:974 : nova-manage cell_v2 simple_cell_setup --transport-url rabbit://stackrabbit:secretrabbit@104.130.199.12:5672/ | 15:54 |
mriedem | n-api is running before cell1 is created | 15:55 |
mriedem | so any request before that is going to only see cell0 and cache it | 15:55 |
mriedem | any request after that doesn't have the cache on that worker is going to get the 2 cells | 15:55 |
dansmith | is that just with their plugin thing or upstream? I don't see how that's possible with base devstack | 15:55 |
BobBall | mdbooth: Thanks - looking. | 15:55 |
sileht | anyways, assuming nobody must call nova-api to not fall into that issue, looks like a serious bug | 15:56 |
*** kaisers_ has quit IRC | 15:56 | |
BobBall | mdbooth: ci-watch.tintri.com shows a small blip earlier today with 7 failures, but it's OK now. Got some specific sadness that you're worried about? | 15:56 |
mdbooth | BobBall: This one looked pretty sad: https://review.openstack.org/#/c/440536/ | 15:57 |
mriedem | dansmith: i assume with their plugin | 15:57 |
mdbooth | If it was just a blip I'll just resubmit. Didn't want to add to a pile if it was an ongoing problem, though. | 15:57 |
*** cdent has joined #openstack-nova | 15:57 | |
sileht | mriedem, it seems ceilometer poll nova just before nova-manage cell_v2 simple_cell_setup | 15:58 |
BobBall | mdbooth: That is quite an unhappy test :( Checking for other issues | 15:58 |
sileht | mriedem, here: http://logs.openstack.org/56/439156/2/check/gate-telemetry-dsvm-integration-gnocchi-ubuntu-xenial/d4a6c69/logs/screen-n-api.txt.gz#_2017-03-02_09_07_05_559 | 15:58 |
BobBall | I mean other chnages with the same issue | 15:58 |
*** rcernin has quit IRC | 15:59 | |
mriedem | sileht: yeah | 15:59 |
mriedem | ok working on something here we can test with | 16:00 |
BobBall | mdbooth: The blip earlier today was ansible related - but that's now resolved. I don't see any other recent failures with your problem | 16:00 |
mdbooth | BobBall: Ok, then. Once more into the breach :) | 16:00 |
mdbooth | BobBall: Thanks for looking. | 16:01 |
*** baoli has joined #openstack-nova | 16:01 | |
*** armax has joined #openstack-nova | 16:02 | |
sileht | mdbooth, in devstack, why create_cell is ran after 'run_phase stack extra' ? | 16:03 |
sileht | mdbooth, sorry | 16:03 |
sileht | mriedem, ^ | 16:03 |
*** owalsh is now known as owalsh-afk | 16:03 | |
*** mlavalle has quit IRC | 16:03 | |
*** yingjun has quit IRC | 16:04 | |
mriedem | sileht: i think that's just legacy from that being where the cells v1 setup happened | 16:04 |
mriedem | which probably no other devstack plugin based job was using cells v1 | 16:04 |
*** baoli has quit IRC | 16:05 | |
sileht | mriedem, I sent a devstack patch as workaround | 16:06 |
sileht | mriedem, but using a global that way looks very dangerous from my point of view | 16:07 |
*** markvoelker has quit IRC | 16:07 | |
*** Oku_OS is now known as Oku_OS-away | 16:07 | |
sileht | mriedem, https://review.openstack.org/440651 | 16:08 |
*** ducttape_ has quit IRC | 16:08 | |
sileht | mriedem, I don't close the bug, since the root cause is more serious | 16:08 |
*** ducttape_ has joined #openstack-nova | 16:09 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Log with cell.uuid if cell.name is not set https://review.openstack.org/440644 | 16:09 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Update CELLS cache if we only have cell0 https://review.openstack.org/440652 | 16:09 |
mriedem | sileht: can you post a gnocchi patch that depends on ^ to see if it helps? | 16:09 |
*** Matias has joined #openstack-nova | 16:11 | |
sileht | mriedem, https://review.openstack.org/440657 | 16:12 |
*** markvoelker has joined #openstack-nova | 16:12 | |
openstackgerrit | Sujitha proposed openstack/nova master: Remove mox from nova.tests.unit.api.openstack.compute.test_create_backup https://review.openstack.org/435610 | 16:12 |
jaypipes | edleafe, alex_xu, bauzas, mriedem, dansmith: https://review.openstack.org/440654, https://review.openstack.org/440655, https://review.openstack.org/440656 | 16:12 |
*** psachin has quit IRC | 16:12 | |
*** sneti_ has quit IRC | 16:13 | |
bauzas | jaypipes: oh cools | 16:13 |
edleafe | jaypipes: will review | 16:13 |
jaypipes | danke | 16:13 |
mriedem | sileht: you know, https://review.openstack.org/#/c/427392/ is probably the thing that triggered this bug | 16:14 |
mriedem | sileht: because before that, cell0 wouldn't be mapped and nova-api wouldn't list any instances | 16:14 |
sileht | mriedem, I think we having another behavior before, and the issue was not so often | 16:16 |
*** BobBall has quit IRC | 16:16 | |
zioproto | dansmith: are you online ? | 16:17 |
sileht | mriedem, thanks for your help | 16:17 |
*** tbachman has joined #openstack-nova | 16:17 | |
*** mjura has quit IRC | 16:17 | |
*** baoli has joined #openstack-nova | 16:18 | |
*** jamesden_ has joined #openstack-nova | 16:18 | |
mriedem | sileht: yeah i mean it's still a bug, but also, if we didn't have cell1 created yet and you tried creating a server, it would fail because we have nowhere to place it | 16:18 |
mriedem | but you could list servers and get nothing back, and that would be fine if you never tried creating any servers | 16:18 |
mriedem | which i think that's what ceilometer was doing | 16:18 |
mriedem | just listing servers | 16:18 |
mriedem | on startup or something, not sure | 16:18 |
mriedem | but that GET call was caching cell0 whereas before https://review.openstack.org/#/c/427392/ we didn't have cell0 mapped so nothing was cached | 16:19 |
bauzas | jaypipes: you're hitting the pbr issue for os-traits lib | 16:23 |
*** raunak has joined #openstack-nova | 16:23 | |
mriedem | jaypipes: yeah you need to update the hacking version here https://github.com/jaypipes/os-traits/blob/master/test-requirements.txt#L5 | 16:23 |
mriedem | http://git.openstack.org/cgit/openstack/requirements/tree/global-requirements.txt#n424 | 16:23 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: handle uninited fields in notification payload https://review.openstack.org/415857 | 16:24 |
openstackgerrit | Arnaud Morin proposed openstack/nova master: Set default value to HTTP_X_FORWARDED_PROTO https://review.openstack.org/423375 | 16:24 |
*** dikonoor has joined #openstack-nova | 16:25 | |
*** karthiks has quit IRC | 16:25 | |
*** baoli has quit IRC | 16:26 | |
*** annegentle has joined #openstack-nova | 16:26 | |
*** baoli has joined #openstack-nova | 16:26 | |
*** baoli has quit IRC | 16:27 | |
jaypipes | mriedem: thx for the heads up, will fix up now. | 16:28 |
*** baoli has joined #openstack-nova | 16:28 | |
*** tjones has quit IRC | 16:28 | |
*** salv-orlando has joined #openstack-nova | 16:29 | |
mriedem | dansmith: before i write tests, how much do you hate this? https://review.openstack.org/#/c/440652/ | 16:29 |
*** eharney has quit IRC | 16:29 | |
mriedem | trying to think of ways to auto-invalidate or update that CELLS cache when a new cell mapping is created | 16:29 |
dansmith | mriedem: one cell is not valid regardless of why so I think you need only check the length | 16:30 |
dansmith | I still assert this is a silly workaround, but if you want it that's fine | 16:30 |
mriedem | i don't know that i want it | 16:31 |
*** mdrabe has quit IRC | 16:31 | |
mriedem | the devstack change would also unblock gnocchi | 16:31 |
mriedem | i think | 16:31 |
*** baoli has quit IRC | 16:33 | |
dansmith | mriedem: what was the change in the last day or so that caused this? | 16:35 |
mriedem | dansmith: https://review.openstack.org/#/c/427392/ | 16:35 |
*** raunak has quit IRC | 16:36 | |
dansmith | ah | 16:36 |
dansmith | that caused me trouble too | 16:36 |
*** mdrabe has joined #openstack-nova | 16:36 | |
jaypipes | edleafe, alex_xu, bauzas, mriedem, dansmith: fixed up pep8/hacking thing. https://review.openstack.org/440678 now new root of series. | 16:38 |
mriedem | it does follow https://docs.openstack.org/developer/nova/cells.html#fresh-install more closely now, but simple_cell_setup and when it's called is kind of our issue now i think | 16:38 |
mriedem | dansmith: if we created cell1 around the same time as cell0, before starting nova-api, then we wouldn't have the cache issue | 16:38 |
mriedem | we'd just have to run discover_hosts after starting n-cpu | 16:39 |
*** ducttape_ has quit IRC | 16:39 | |
dansmith | I still don't understand why we have the problem at all, since devstack is sequential | 16:39 |
bauzas | jaypipes: I thought you were hit by the fact we were pulling pbr-2.0.0 | 16:39 |
*** ducttape_ has joined #openstack-nova | 16:39 | |
mriedem | dansmith: devstack is mapping cell0, starting n-api, then loading extras (ceilometer plugin) which starts querying n-api, then devstack eventually does create_cell which calls simple_cell_setup | 16:40 |
mriedem | which creates the cell1 mapping | 16:40 |
mriedem | for the 'normal' setup there are no extras so we don't see it | 16:40 |
*** andreas_s has quit IRC | 16:41 | |
dansmith | mriedem: ah so we really are starting it in the wrong order we just don't hit the cache? | 16:41 |
*** pcaruana has quit IRC | 16:42 | |
mriedem | dansmith: yeah | 16:42 |
dansmith | mriedem: okay yeah then we should change that | 16:42 |
mriedem | ceilometer hit the cache and stored only cell0 | 16:42 |
dansmith | mriedem: you're going to break my fleetify patch, but.. | 16:42 |
markus_z | mriedem: I don't find a clue to solve the novnc issue. Tomorrow I have no time left, I'll give it another try on Monday. | 16:43 |
mriedem | markus_z: ok thanks for looking | 16:43 |
mriedem | dansmith: sileht has this https://review.openstack.org/#/c/440651/ | 16:43 |
mriedem | but it is a workaround yeah | 16:43 |
mriedem | so the proper fix is probably what i described above, with creating cell1 at the same time as cell0 | 16:43 |
dansmith | mriedem: yeah | 16:44 |
mriedem | and then change simple_cell_setup in the post-setup to just discover_hosts | 16:44 |
mriedem | or map_cell_and_hosts or whatever | 16:44 |
*** jpena is now known as jpena|away | 16:44 | |
*** baoli has joined #openstack-nova | 16:44 | |
dansmith | not map_cell_and_hosts | 16:44 |
mriedem | i don't know if/how that messes up upgrade because we'd already have cell1 | 16:44 |
dansmith | that creates a cell | 16:44 |
dansmith | just discover at the end | 16:44 |
*** markus_z has quit IRC | 16:45 | |
mriedem | we need to not create cell1 if it already exists, which we could maybe figure out with the list_cells command | 16:46 |
mriedem | jaypipes: +2 on https://review.openstack.org/#/c/440678/ | 16:46 |
*** vanch has quit IRC | 16:47 | |
*** baoli has quit IRC | 16:47 | |
dansmith | mriedem: that point where we create cell0 we're on an empty db regardless of upgrade because we're on the old side right? | 16:47 |
*** browne has joined #openstack-nova | 16:48 | |
mdbooth | Is this going to be a problem in general when adding a cell? If you can add a cell and have instances scheduled to it instantly, but those instances won't be visible, isn't this something you're always going to hit when adding a cell? | 16:49 |
jaypipes | mriedem: cheers. the end goal here is to release os-traits lib with a git tag today so we can begin working on tests for that "sync os-traits" thing in placement-manage per bauzas and alex_xu's discussion on the traits spec. | 16:49 |
mdbooth | iow is it worth fixing this with something a bit more general purpose than a workaround for cell1? | 16:50 |
*** xinli has joined #openstack-nova | 16:50 | |
mriedem | dansmith: i think https://github.com/openstack-dev/devstack/blob/master/lib/nova#L700 is the dirty secret | 16:50 |
mriedem | we drop and recreate the nova_api db | 16:50 |
mriedem | dansmith: same for cell0 | 16:50 |
dansmith | mriedem: eh? | 16:50 |
*** cleong has quit IRC | 16:51 | |
mriedem | i think from newton->ocata that wasn't a problem for cell0 because in newton we didn't put anything into cell0 | 16:51 |
mriedem | but ocata cell0 could have stuff in it | 16:51 |
dansmith | init_nova only runs on the old side right? | 16:51 |
mriedem | idk | 16:51 |
mriedem | i thought it ran on both but i don't have grenade memorized | 16:51 |
dansmith | we blow away all the dbs there.. nothing would work if we ran it in both places | 16:52 |
*** cleong has joined #openstack-nova | 16:53 | |
mriedem | ok. i was thinking of this https://review.openstack.org/#/c/393441/2/projects/60_nova/from-newton/upgrade-nova@8 | 16:53 |
mriedem | unrelated and confusing myself i suppose | 16:53 |
mriedem | anyway, i can work a change to do create_cell cell1 after map_cell0 and change simple_cell_setup to be discover_hosts in devstack | 16:54 |
mriedem | and if grenade hates it i guess we'll find out | 16:54 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP compute: Move detach logic from manager into driver BDM https://review.openstack.org/439520 | 16:55 |
openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Only destroy BDMs after successful detach call https://review.openstack.org/440693 | 16:55 |
*** baoli has joined #openstack-nova | 16:58 | |
aunnam | johnthetubaguy, Will you be updating the poc patch https://review.openstack.org/#/c/434842/ by removing scope and access as they are not needed right now? | 16:58 |
johnthetubaguy | aunnam: I was hoping you or sneti might fancy doing that :) | 16:59 |
aunnam | johnthetubaguy, Or you want us to update the patch? | 16:59 |
aunnam | johnthetubaguy, sure will do that, thanks | 16:59 |
mriedem | sileht: looks like my nova workaround patch fixed the gnocchi issue | 17:00 |
*** ayogi has joined #openstack-nova | 17:02 | |
mdbooth | mriedem: re the CELLs cache, would it be feasible to manage that with memcached via oslo_cache? Could a newly created cell poke itself into the cache before allowing anything to be scheduled there? | 17:02 |
mdbooth | Should mean you'd have no weirdness period after creating a new cell. | 17:02 |
mriedem | mdbooth: at a minimum yes on oslo.cache to add a timer to it | 17:03 |
mriedem | mdbooth: feel free to start that | 17:03 |
mriedem | as for how to auto-register a new cell to invalidate the cache or put itself into it, i'm not sure how we do that right now | 17:03 |
mdbooth | mriedem: Well I was explicitly thinking of a distributed cache, like memcached | 17:03 |
mriedem | with oslo.cache the backing cache store is abstracted | 17:04 |
mriedem | i thought anyway | 17:04 |
mdbooth | I think we have the infrastructure in place for that already, but I don't know what the deployment concerns would be | 17:04 |
mdbooth | Yes, looks like it is | 17:04 |
mriedem | we already use oslo.cache in several places so it should be a common pattern | 17:05 |
mriedem | even with a timeout on the cache, we still have a timing issue between when a new cell is added and when the cache invalidates and gets updated | 17:05 |
mriedem | having said that, we don't expect new cells to be added all the time | 17:06 |
mdbooth | Right. Unless you've got a distributed cache, you're always going to have a broken period there. | 17:06 |
mdbooth | Could you put it on the deployer? Before enabling scheduling to a new cell, all n-api need to be restarted? | 17:06 |
*** nic has joined #openstack-nova | 17:06 | |
*** lucasagomes is now known as lucas-afk | 17:07 | |
mdbooth | Ugly, but deterministic. | 17:07 |
mriedem | i believe that's what we've said if you update db or transport url connection info in a cell mapping | 17:08 |
*** crushil has quit IRC | 17:10 | |
mriedem | yeah https://docs.openstack.org/developer/nova/man/nova-manage.html#nova-cells-v2 | 17:10 |
mriedem | "NOTE: Updating the transport_url or database_connection fields on a running system will NOT result in all nodes immediately using the new values. Use caution when changing these values." | 17:10 |
*** lpetrut has quit IRC | 17:12 | |
mdbooth | mriedem: Is it possible to add a cell without allowing instances to be scheduled there, btw? | 17:12 |
*** dave-mcc_ has joined #openstack-nova | 17:12 | |
dansmith | we are really a long way from needing to overthink this cache thing | 17:13 |
mriedem | mdbooth: if the cell doesn't have hostmappings | 17:13 |
* mdbooth recalls this was a use case for cells. | 17:13 | |
mriedem | if it doesn't have host mappings nothing goes into it | 17:13 |
dansmith | you can't even have multiple cells today | 17:13 |
dansmith | so a static list is *fine* | 17:13 |
*** dave-mccowan has quit IRC | 17:13 | |
mdbooth | dansmith: Yeah, with the restarting things I was backing away from distributed caches :) | 17:13 |
*** dave-mccowan has joined #openstack-nova | 17:14 | |
*** dave-mcc_ has quit IRC | 17:17 | |
mriedem | dansmith: so you want me to just change this to check for len 1 and just always re-query until we have more than 1? https://review.openstack.org/#/c/440652/1/nova/compute/api.py | 17:17 |
dansmith | mriedem: it's not what I want, but I will accept it :) | 17:18 |
dansmith | we need to fix devstack anyway right? | 17:18 |
mriedem | i think so | 17:18 |
mriedem | i only worry about fixing devstack and others in the wild falling into the same trap | 17:18 |
*** raunak has joined #openstack-nova | 17:21 | |
*** JoseMello has joined #openstack-nova | 17:21 | |
dansmith | mriedem: this is exactly the same as the service catalog thing to me | 17:21 |
dansmith | mriedem: but, like I say, whatever you want | 17:21 |
*** corey has joined #openstack-nova | 17:21 | |
*** corey is now known as Guest53699 | 17:21 | |
*** bvanhav_ has quit IRC | 17:22 | |
*** cleong has quit IRC | 17:23 | |
*** Apoorva has joined #openstack-nova | 17:23 | |
*** bvanhav_ has joined #openstack-nova | 17:25 | |
mriedem | dansmith: service catalog re: order of steps during deploy? | 17:25 |
*** bvanhav_ is now known as bvanhav | 17:25 | |
dansmith | yeah | 17:26 |
mriedem | ok, so maybe i'll just do the devstack change first, hold off on the nova patch and keep it in the pocket | 17:27 |
mriedem | we could log a warning if there is only 1 cell cached when listing instances, saying hey dummy you started n-api before all of your cells were mapped, you need to create the cells and restart nova-api | 17:28 |
dansmith | yeah, totes | 17:30 |
*** bkopilov has quit IRC | 17:31 | |
*** ralonsoh has quit IRC | 17:34 | |
openstackgerrit | Eric Fried proposed openstack/nova master: PowerVM Driver: spawn/destroy #3: TaskFlow https://review.openstack.org/438729 | 17:34 |
*** leseb_ has joined #openstack-nova | 17:35 | |
sileht | mriedem: thx, should abandon mine ? | 17:36 |
mriedem | sileht: it's probably still a good idea to not load extras/plugins until nova is setup | 17:36 |
*** lucasxu has quit IRC | 17:36 | |
*** rfolco has quit IRC | 17:37 | |
*** lucasxu has joined #openstack-nova | 17:38 | |
*** ayogi has quit IRC | 17:39 | |
mriedem | dansmith: do you remember why for cellsv1 at the end we sync the db? https://github.com/openstack-dev/devstack/blob/master/lib/nova#L978 | 17:40 |
mriedem | after creating cell1 and mapping the hosts to it | 17:40 |
dansmith | that line is for cellsv2 | 17:40 |
*** ltomasbo is now known as ltomasbo|away | 17:41 | |
dansmith | mriedem: I think some of this came from just doing cellsv2 stuff where we had bits for cellsv1 which isn't necessarily sensical | 17:41 |
mriedem | that's cellsv1 | 17:41 |
*** dtp has joined #openstack-nova | 17:41 | |
mriedem | if not n-cell is above | 17:41 |
mriedem | n-cell is v1 | 17:41 |
mriedem | i'm going to remove it and see what happens | 17:41 |
*** Kevin_Zheng_ has quit IRC | 17:43 | |
*** ducttape_ has quit IRC | 17:45 | |
*** krtaylor has quit IRC | 17:46 | |
dansmith | oh sorry I see I read it wrong | 17:46 |
dansmith | so .. no I'm not sure | 17:47 |
*** browne has quit IRC | 17:49 | |
*** fragatina has joined #openstack-nova | 17:49 | |
*** fragatina has quit IRC | 17:50 | |
*** adrian_otto has joined #openstack-nova | 17:51 | |
*** romainh has quit IRC | 17:52 | |
mriedem | dansmith: let's find out https://review.openstack.org/440739 | 17:52 |
*** tesseract has quit IRC | 17:52 | |
mriedem | i'm going to lunch | 17:53 |
*** lucasxu has quit IRC | 17:54 | |
*** fragatina has joined #openstack-nova | 17:55 | |
*** derekh has quit IRC | 17:55 | |
*** mriedem1 has joined #openstack-nova | 17:56 | |
*** mriedem has quit IRC | 17:57 | |
*** fragatina has quit IRC | 17:57 | |
*** fragatina has joined #openstack-nova | 17:58 | |
*** fragatina has quit IRC | 17:58 | |
*** fragatina has joined #openstack-nova | 17:59 | |
*** fragatina has quit IRC | 17:59 | |
*** sambetts is now known as sambetts|afk | 18:02 | |
openstackgerrit | Anusha Unnam proposed openstack/nova master: POC: add descriptions to server tags https://review.openstack.org/434842 | 18:02 |
openstackgerrit | Jay Pipes proposed openstack/nova master: placement: ironic inventory reporting https://review.openstack.org/437602 | 18:04 |
jaypipes | cdent: ^^ fixed your requests | 18:04 |
cdent | rad | 18:04 |
*** liangy has quit IRC | 18:05 | |
*** karimb has joined #openstack-nova | 18:05 | |
*** tbachman has quit IRC | 18:05 | |
*** tbachman has joined #openstack-nova | 18:06 | |
*** erlon has joined #openstack-nova | 18:08 | |
*** liangy has joined #openstack-nova | 18:09 | |
*** jaypipes has quit IRC | 18:12 | |
*** yamahata has joined #openstack-nova | 18:12 | |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db https://review.openstack.org/439754 | 18:15 |
openstackgerrit | Dan Smith proposed openstack/nova master: Target cell in super conductor operations https://review.openstack.org/438022 | 18:15 |
openstackgerrit | Dan Smith proposed openstack/nova master: Change MQ targeting to honor only what is in the context https://review.openstack.org/438023 | 18:15 |
openstackgerrit | Dan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info https://review.openstack.org/439891 | 18:15 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add cell field to Destination object https://review.openstack.org/438024 | 18:15 |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Make conductor ask scheduler to limit migrates to same cell https://review.openstack.org/438025 | 18:15 |
*** unicell has joined #openstack-nova | 18:15 | |
*** edand has joined #openstack-nova | 18:18 | |
openstackgerrit | John Garbutt proposed openstack/nova-specs master: Add spec to use cinder's new attachment API https://review.openstack.org/373203 | 18:18 |
*** jaosorior has quit IRC | 18:19 | |
*** fragatina has joined #openstack-nova | 18:21 | |
*** crushil has joined #openstack-nova | 18:25 | |
*** edmondsw has quit IRC | 18:29 | |
*** slaweq_ has quit IRC | 18:29 | |
*** dikonoor has quit IRC | 18:31 | |
*** slaweq_ has joined #openstack-nova | 18:32 | |
*** edmondsw has joined #openstack-nova | 18:32 | |
*** lucasxu has joined #openstack-nova | 18:32 | |
*** edmondsw has quit IRC | 18:36 | |
*** slaweq_ has quit IRC | 18:38 | |
*** liangy has quit IRC | 18:39 | |
*** slaweq_ has joined #openstack-nova | 18:40 | |
*** amoralej is now known as amoralej|off | 18:44 | |
*** jose-phi_ has joined #openstack-nova | 18:44 | |
*** ducttape_ has joined #openstack-nova | 18:45 | |
*** bvanhav_ has joined #openstack-nova | 18:46 | |
*** rfolco has joined #openstack-nova | 18:46 | |
*** jose-phillips has quit IRC | 18:46 | |
*** bvanhav has quit IRC | 18:46 | |
*** fragatina has quit IRC | 18:48 | |
dansmith | cdent: edleafe since jaypipes isn't around.. do you recall why he wants ironic to be special in the situation where custom resource classes are auto-created? | 18:48 |
dansmith | I'm not sure I ever knew, so maybe recall is the wrong word | 18:49 |
*** fragatina has joined #openstack-nova | 18:49 | |
cdent | dansmith: my recollection is thin but I think it was because we already promised we would, but that we should not extend that promise to anything else. As you've asked, "why not?" is a fair question on that. | 18:50 |
dansmith | hmm, okay | 18:50 |
*** ducttape_ has quit IRC | 18:50 | |
dansmith | if there is a sunset date on that, then maybe I'm on board, like after ironic creates and maintains these themselves or something | 18:51 |
cdent | It seems to me that if we're in the context of the compute-node then we may as well auto create because we're in charge there | 18:51 |
dansmith | right, and virt drivers are in-tree | 18:51 |
cdent | and if we do it for one, may as well for anything | 18:51 |
dansmith | yeah | 18:51 |
dansmith | and you could use the same logic, | 18:51 |
dansmith | in that until operators are familiar with placement, we auto-create things for them from all virt drivers | 18:51 |
cdent | the issue with that, of course, is that whole "precedent" thing. If we start auto creating willy nilly now, then everyone will want it later or never adapt to the time when we don't | 18:52 |
dansmith | also, if your virt driver knows about VFs, PFs, and GPUs, but can't report them until you create a class for them or something.. I dunno, kinda feels too manual to me | 18:52 |
* cdent nods | 18:52 | |
*** salv-orl_ has joined #openstack-nova | 18:52 | |
dansmith | well, I dunno | 18:52 |
dansmith | but I also don't really know why we wouldn't auto-create anyway, so.. | 18:52 |
cdent | Yeah, that's the crux | 18:53 |
dansmith | but, sounds like I'm not missing something major, which is good | 18:53 |
*** crushil has quit IRC | 18:53 | |
*** eharney has joined #openstack-nova | 18:53 | |
cdent | as far as I recall, you're not, but it often feels like there are major things happening while I blink | 18:53 |
*** crushil has joined #openstack-nova | 18:53 | |
dansmith | well, it's enough to justify my -1 until we get jay back to discuss at least :) | 18:54 |
*** bvanhav_ has quit IRC | 18:54 | |
* cdent nods | 18:54 | |
*** bvanhav_ has joined #openstack-nova | 18:54 | |
*** salv-orlando has quit IRC | 18:55 | |
*** kaisers_ has joined #openstack-nova | 18:58 | |
edleafe | dansmith: there was a little bit of provincialism, in that Nova resources have standard names, whereas Ironic resources all have to be "CUSTOM_blah" | 18:59 |
dansmith | edleafe: yeah, but any other driver could expose a custom one | 18:59 |
dansmith | edleafe: if we merged that code, we clearly thought it was legit, so why not auto-create it in the same place? | 18:59 |
edleafe | dansmith: dunno. Maybe Jay remembers why | 19:01 |
*** bvanhav_ is now known as bvanhav | 19:01 | |
*** romainh has joined #openstack-nova | 19:04 | |
*** krtaylor has joined #openstack-nova | 19:05 | |
mriedem1 | blarg! | 19:07 |
*** mriedem1 is now known as mriedem | 19:07 | |
*** adrian_otto has quit IRC | 19:07 | |
mriedem | init_nova_cells is called after init_nova | 19:07 |
*** thorst has quit IRC | 19:09 | |
*** dharinic is now known as dharinic|lunch | 19:09 | |
*** thorst has joined #openstack-nova | 19:10 | |
*** gszasz has quit IRC | 19:10 | |
mriedem | sileht: i've updated the dependency for https://review.openstack.org/#/c/440657/ to be the devstack fix i pushed | 19:11 |
mriedem | it already passed in the non-cells v1 case, and i just fixed it for the cells v1 case | 19:12 |
*** claudiub has quit IRC | 19:12 | |
*** edmondsw has joined #openstack-nova | 19:14 | |
*** thorst has quit IRC | 19:14 | |
*** adrian_otto has joined #openstack-nova | 19:15 | |
*** dtp has quit IRC | 19:17 | |
*** lucasxu has quit IRC | 19:18 | |
*** lucasxu has joined #openstack-nova | 19:19 | |
*** armax has quit IRC | 19:20 | |
melwitt | mriedem: I looked at rajesh's email earlier, he's been working on the problem too and will be proposing some changes, once we figure out which direction to go | 19:22 |
*** adrian_otto has quit IRC | 19:23 | |
*** adrian_otto has joined #openstack-nova | 19:24 | |
cfriesen | Is anyone aware of a Mitaka bug where rows in instance_system_metadata for a given instance don't get deleted when the instance gets deleted? I've got a system with 400K rows in "instance_system_metadata" where deleted_at is null, and only 40 rows in "instances" where deleted_at is null. | 19:29 |
mriedem | yes | 19:30 |
*** xinli has quit IRC | 19:30 | |
*** liangy has joined #openstack-nova | 19:31 | |
*** armax has joined #openstack-nova | 19:31 | |
*** mriedem1 has joined #openstack-nova | 19:31 | |
mriedem1 | cfriesen: you should have this in mitaka https://github.com/openstack/nova/commit/2c48ff44a21083340cec35242a9fc006d3cd828d | 19:34 |
*** ijw has joined #openstack-nova | 19:34 | |
mriedem1 | ^ was fixed in liberty | 19:35 |
mriedem1 | that doesn't mean you don't have a ton of old orphaned stuff before that | 19:35 |
*** mriedem has quit IRC | 19:35 | |
*** irenab_ has quit IRC | 19:35 | |
*** cdent has quit IRC | 19:36 | |
cfriesen | mriedem1: my bad, this DB was actually from Kilo. I made an incorrect assumption. That's almost certainly the issue. Thanks. | 19:36 |
*** sree has joined #openstack-nova | 19:37 | |
*** romainh has quit IRC | 19:42 | |
*** sree has quit IRC | 19:42 | |
*** mriedem1 is now known as mriedem | 19:44 | |
mriedem | cfriesen: you can repay me by sending sdague the nickel i owe him | 19:44 |
*** adrian_otto has quit IRC | 19:45 | |
*** edmondsw has quit IRC | 19:47 | |
cfriesen | that'll be 6 cents Canadian. | 19:47 |
sdague | I'm going to have to play these exchange rate games and work my self up to 2 bits | 19:48 |
*** dharinic|lunch is now known as dharinic | 19:50 | |
*** edmondsw has joined #openstack-nova | 19:50 | |
*** huanxie has quit IRC | 19:51 | |
_gryf | dansmith, I may be wrong, but idea to have ironic custom-class to be auto created is be backward compatible | 19:55 |
_gryf | I mean, there is no discovery mechanism for custom resources | 19:55 |
_gryf | and in past releases we do support ironic resource, right? | 19:56 |
*** armax has quit IRC | 19:58 | |
*** jamielennox|away is now known as jamielennox | 20:02 | |
*** yassine has quit IRC | 20:06 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Log a warning if there is only one cell when listing instances https://review.openstack.org/440652 | 20:06 |
edleafe | _gryf: there weren't resources in past releases | 20:08 |
_gryf | edleafe, but it was tracked by resource tracker | 20:09 |
_gryf | maybe that was the reason | 20:09 |
melwitt | mriedem: I also have reproposed the spec for using the quota-related tables in the api db here https://review.openstack.org/#/c/431748 in case you didn't know | 20:09 |
edleafe | _gryf: yes, but that was VCPU, RAM, disk, etc. | 20:09 |
dansmith | _gryf: yeah, I don't think that's what we're talking about here | 20:09 |
edleafe | _gryf: not ResourceClasses for the Placement service | 20:09 |
dansmith | _gryf: this only existed in ironic in ocata, and not even directly as a placement resource class | 20:09 |
_gryf | dansmith, oh | 20:10 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle conflicts for os-assisted-volume-snapshots https://review.openstack.org/429476 | 20:10 |
melwitt | mriedem: I didn't use the previously-approved tag because I changed it to not talk about populating the quota_usages and reservations tables | 20:10 |
mriedem | oh boy | 20:11 |
mriedem | now i actually have to diff it | 20:11 |
_gryf | so yeah, I'm also uncertain why ironic is treated in special way :( | 20:11 |
melwitt | I can put it back the way it was if you want :P | 20:11 |
*** liuyulong_ has joined #openstack-nova | 20:11 | |
melwitt | it just wasn't accurate anymore | 20:11 |
mriedem | no it's good to be accurate | 20:12 |
edleafe | _gryf: because it's the only non-Nova resource provider we've considered | 20:12 |
melwitt | yeah, was just kidding | 20:13 |
_gryf | but wait. doesn't nova was able to provide bare metal before? I mean, if we track certain amount of resources, spinning out bare metal should take out such resources out of available one, isn't it? | 20:14 |
mriedem | sileht: https://review.openstack.org/#/c/440657/ passed with https://review.openstack.org/#/c/440739/ | 20:15 |
*** liuyulong has quit IRC | 20:15 | |
mriedem | and it looks like https://review.openstack.org/#/c/440739/ passed the cellsv1 and normal jobs | 20:15 |
mriedem | dansmith: sdague: ^ | 20:15 |
mriedem | so we should get that devstack change in | 20:15 |
mriedem | to unblock gnocchi | 20:15 |
*** ducttape_ has joined #openstack-nova | 20:16 | |
*** ducttape_ has quit IRC | 20:21 | |
*** JoseMello has quit IRC | 20:25 | |
*** dtp has joined #openstack-nova | 20:26 | |
mriedem | melwitt: +2 | 20:26 |
melwitt | thanks | 20:27 |
*** claudiub has joined #openstack-nova | 20:33 | |
*** thorst has joined #openstack-nova | 20:35 | |
*** Apoorva has quit IRC | 20:39 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Default firewall_driver to nova.virt.firewall.NoopFirewallDriver https://review.openstack.org/439187 | 20:46 |
*** vanch has joined #openstack-nova | 20:50 | |
mriedem | nova meeting in 10 minutes | 20:50 |
mriedem | was there a cells meeting yesterday? i spaced on that one. | 20:51 |
*** rfolco has quit IRC | 20:51 | |
*** jose-phillips has joined #openstack-nova | 20:52 | |
*** jose-phi_ has quit IRC | 20:53 | |
*** yassine has joined #openstack-nova | 20:54 | |
*** READ10 has quit IRC | 20:54 | |
*** salv-orl_ has quit IRC | 20:54 | |
*** takashin has joined #openstack-nova | 20:54 | |
*** crushil has quit IRC | 20:56 | |
*** jaypipes has joined #openstack-nova | 20:57 | |
*** aysyd has quit IRC | 20:57 | |
*** crushil has joined #openstack-nova | 20:57 | |
*** yassine has quit IRC | 20:58 | |
*** vanch has quit IRC | 20:59 | |
dtp | yes | 20:59 |
*** vanch has joined #openstack-nova | 21:05 | |
*** smatzek_ has quit IRC | 21:10 | |
*** gcb has joined #openstack-nova | 21:11 | |
*** vanch has quit IRC | 21:14 | |
*** tlian has joined #openstack-nova | 21:20 | |
*** adrian_otto has joined #openstack-nova | 21:20 | |
*** yassine has joined #openstack-nova | 21:21 | |
sdague | mriedem: am I the only one that feels like we're doing genetic programming on nova manage commands to move them around until least stuff breaks :) | 21:21 |
*** Apoorva has joined #openstack-nova | 21:23 | |
*** lpetrut has joined #openstack-nova | 21:24 | |
*** bvanhav has quit IRC | 21:25 | |
*** salv-orlando has joined #openstack-nova | 21:28 | |
*** yassine has quit IRC | 21:28 | |
*** tlian has quit IRC | 21:29 | |
*** edmondsw has quit IRC | 21:31 | |
mriedem | sdague: yes you are | 21:31 |
mriedem | everyone else knows what's going on with the nova-manage commands | 21:31 |
mriedem | sdague: musical chairs is the name of the game | 21:32 |
dansmith | seriously | 21:32 |
mriedem | sdague: the commit message explains the thing, it was wrong to begin with how we were doing it, | 21:32 |
mriedem | just didn't realize that until we moved map_cell0 earlier and the telemetry extras injected itself into the middle of the stack | 21:33 |
mriedem | we were basically getting lucky before just because we did some stuff all at the end | 21:33 |
mriedem | which was wrong | 21:33 |
mriedem | sometimes i do feel like a 16th century monk that gets off on watching peas mate with each other | 21:34 |
*** eharney has quit IRC | 21:34 | |
*** irenab_ has joined #openstack-nova | 21:35 | |
takashin | mriedem: Would you remove -2 in https://review.openstack.org/#/c/408955/ ? | 21:35 |
*** edmondsw has joined #openstack-nova | 21:35 | |
* mriedem notes there are no gregor mendel enthusiasts in the crowd | 21:35 | |
* edleafe got the reference but couldn't think of a snappy genetic comeback | 21:35 | |
openstackgerrit | Sarafraj Singh proposed openstack/nova-specs master: Add live-migration-force-after-timeout spec https://review.openstack.org/438467 | 21:36 |
mriedem | takashin: done | 21:36 |
takashin | mriedem: Thank you. | 21:37 |
openstackgerrit | Sarafraj Singh proposed openstack/nova-specs master: WIP: Add live-migration-force-after-timeout spec https://review.openstack.org/438467 | 21:37 |
*** karimb has quit IRC | 21:37 | |
*** takashin has left #openstack-nova | 21:38 | |
*** karimb has joined #openstack-nova | 21:38 | |
mriedem | ildikov: fyi i've started a nova/cinder review priority section here, L62 https://etherpad.openstack.org/p/pike-nova-priorities-tracking | 21:40 |
mriedem | ildikov: let's keep that focused on a small set of patches per week though | 21:40 |
ildikov | mriedem: great, thank you! | 21:41 |
dims | mriedem : looks like stale data - https://governance.openstack.org/tc/goals/pike/python35.html#nova | 21:41 |
mriedem | dims: the # of tests? | 21:41 |
ildikov | mriedem: we can keep the long list on the regular etherpad and move items to the priority one when they are out of WIP for instance | 21:42 |
mriedem | dims: i'm not sure how that number was calculated to begin with | 21:42 |
mriedem | maybe that's total number of py27 tests - total number of py35 tests run | 21:43 |
*** yassine has joined #openstack-nova | 21:43 | |
mriedem | dims: hmm i also see that gate-nova-tox-functional-py35-ubuntu-xenial is non-voting but it's passing | 21:43 |
mriedem | not sure why it's still non-voting | 21:43 |
dims | mriedem : right. http://git.openstack.org/cgit/openstack/nova/tree/tests-py3.txt also shows just a handful of things | 21:44 |
*** dave-mccowan has quit IRC | 21:44 | |
*** yassine has quit IRC | 21:44 | |
dims | +1 to make it voting | 21:44 |
mriedem | dims: want to push that change? | 21:44 |
dims | project-config change, sure | 21:45 |
mriedem | yeah it's actually down to 63 tests now | 21:45 |
mriedem | i'll update the governance repo | 21:45 |
dansmith | mriedem: sdague: for something like /servers/<uuid>/tags/foo, is there some glue somewhere that looks up the instance via uuid before the show/update gets called in the server_tags extension? | 21:47 |
dansmith | something other than servers.py::show I would assume | 21:47 |
*** irenab_ has quit IRC | 21:47 | |
*** ducttape_ has joined #openstack-nova | 21:47 | |
sdague | dansmith: what exactly are you looking for? | 21:48 |
sdague | just how do the routes get populated? | 21:48 |
mriedem | dansmith: this is the extension code for servers https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L182 | 21:48 |
mriedem | https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L64 | 21:49 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/compute/server_tags.py#L183-L190 | 21:49 |
mriedem | show is a 204 | 21:49 |
mriedem | which seems odd | 21:49 |
dansmith | sdague: sdague when I PUT /servers/<uuid>/tags/foo, I never get to server_tags.py::update() before I get NotFound looking up the instance, it seems | 21:49 |
*** irenab_ has joined #openstack-nova | 21:49 | |
dims | mriedem : https://review.openstack.org/440826 | 21:49 |
mriedem | dansmith: that would be this i think https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/server_tags.py#L137 | 21:49 |
dansmith | sdague: do the routes just fetch uuid out of the url for me, but completely rely on me doing the 404 if I don't find the server? | 21:49 |
dansmith | mriedem: yeah I don't seem to get there | 21:50 |
dansmith | maybe I'm doing something else wrong | 21:50 |
mriedem | dansmith: that's what it looks like, the tags extensions can fail with an InstanceNotFound | 21:51 |
sdague | dansmith: I'm going to have to reload this bit back into my head | 21:51 |
mriedem | but it looks like the instance lookup is hidden in the tag object | 21:51 |
dansmith | mriedem: right I just want to make sure that's the only one, because I don't seem to make it into that method *at all* | 21:51 |
mriedem | https://github.com/openstack/nova/blob/master/nova/objects/tag.py#L51 | 21:51 |
mriedem | oh | 21:51 |
dansmith | and I'm wondering if there is some other glue that is missing the cell lookup | 21:51 |
mriedem | dansmith: microversoin? | 21:52 |
*** ducttape_ has quit IRC | 21:52 | |
dansmith | mriedem: it's tempest | 21:52 |
mriedem | still | 21:52 |
mriedem | is it passing 2.1? | 21:52 |
mriedem | i think you need at least 2.26 | 21:52 |
dansmith | I dunno, but the test seems to work without cells. I just tried from nova client and I get the same deal | 21:52 |
mriedem | novaclient CLI will request the latest microversion available that it understands | 21:53 |
mriedem | tempest won't | 21:53 |
*** Guest53699 has quit IRC | 21:53 | |
*** mtanino_ has joined #openstack-nova | 21:53 | |
dansmith | PUT http://192.168.201.194:8774/v2.1/servers/0d97611d-f1d6-4146-858d-9387baf36558/tags/tagme -H "OpenStack-API-Version: compute 2.41" | 21:53 |
mriedem | i don't think anyway | 21:53 |
sdague | mriedem: the tests should be configured correctly | 21:53 |
cfriesen | related to my earlier DB question....is there a reason why "instance_actions" rows don't get deleted when the instance does? | 21:53 |
mriedem | cfriesen: have you bothered to look at the code? | 21:53 |
*** anteaya has quit IRC | 21:54 | |
*** cburgess has quit IRC | 21:54 | |
cfriesen | mriedem: I'm looking at instance_destroy() in the DB API code | 21:54 |
*** mtanino has quit IRC | 21:54 | |
*** lpetrut has quit IRC | 21:55 | |
mriedem | it doesn't appear that they do there | 21:55 |
mriedem | i believe this came up in the ML in newton | 21:55 |
cfriesen | okay, I can check the archives | 21:55 |
sdague | dansmith: I'm pretty sure nothing else is validating the server id until you get into server_tags.py | 21:55 |
cfriesen | I didn't see a bug for it | 21:55 |
dansmith | sdague: okay | 21:55 |
sdague | but, it's end of day, so that's just my recollection | 21:55 |
dansmith | sdague: http://pastebin.com/bicZYZVt | 21:56 |
dansmith | sdague: with that, when I add a tag from the client, I get _none_ of my log lines in the log | 21:56 |
dansmith | well, when I _try_ to add a tag.. it fails with 404 | 21:56 |
dansmith | anyway, just want to make sure I'm not missing something obvious | 21:57 |
mriedem | cfriesen: https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L6468 | 21:57 |
mriedem | they are handled differently for archive at least | 21:58 |
mriedem | because they aren't soft deleted | 21:58 |
mriedem | cfriesen: http://lists.openstack.org/pipermail/openstack-dev/2015-November/079701.html | 21:59 |
*** dimtruck is now known as zz_dimtruck | 21:59 | |
dansmith | mriedem: just checking, but... api_version('2.26') means "2.26 or later" right? just making sure we don't have another single-version thing | 22:00 |
dansmith | that wouldn't explain tempest not working though | 22:00 |
*** cburgess has joined #openstack-nova | 22:00 | |
cfriesen | mriedem: I was just looking at the bug related to that email thread | 22:00 |
mriedem | cfriesen: http://lists.openstack.org/pipermail/openstack-dev/2015-November/079778.html | 22:00 |
mriedem | ^ is the summary | 22:00 |
sdague | dansmith: https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/wsgi.py#L907-L910 | 22:01 |
mriedem | dansmith: depends on where the code is i guess | 22:01 |
dansmith | sdague: okay yeah | 22:01 |
sdague | dansmith: anyway, if this is still a thing tomorrow, I can help debug. But I'm pretty sure we end up just building the routes through route mapper and we get straight to these functions | 22:02 |
mriedem | cfriesen: i also remember this coming out of that discussion https://docs.openstack.org/developer/nova/api_microversion_history.html#id19 | 22:02 |
dansmith | sdague: okay me too, I just don't know how else to explain what I'm seeing | 22:02 |
dansmith | sdague: but yeah thanks | 22:02 |
sdague | the only question is if there is a very early 404 in wsgi | 22:02 |
dansmith | right | 22:03 |
cfriesen | mriedem: right, I saw that part. | 22:03 |
sdague | https://github.com/openstack/nova/blob/37cd9a961b065a07352b49ee72394cb210d8838b/nova/api/openstack/wsgi.py#L601 | 22:03 |
sdague | but that should show up in nova-api logs as a fault | 22:03 |
openstackgerrit | Sujitha proposed openstack/nova master: Add description to policies in admin_actions. https://review.openstack.org/440829 | 22:04 |
dansmith | oooooo | 22:04 |
*** cburgess has quit IRC | 22:04 | |
dansmith | no, no. | 22:05 |
cfriesen | mriedem: that summary is useful, thanks. it might be nice if it was in the code as a comment or something. | 22:05 |
dansmith | dammit | 22:05 |
sdague | ok, you have to share before I run away | 22:05 |
dansmith | there is no instance lookup in the path of the PUT | 22:05 |
sdague | because I want to know :) | 22:05 |
dansmith | I thought there was, but it's for the server get the client does before the put of the tag | 22:06 |
dansmith | after the get returns, | 22:06 |
sdague | ah | 22:06 |
dansmith | no instance get at all | 22:06 |
dansmith | so...... | 22:06 |
sdague | right, so you are way off in 404 land | 22:06 |
dansmith | I don't like 404 land | 22:06 |
*** anteaya has joined #openstack-nova | 22:07 | |
*** thorst has quit IRC | 22:08 | |
openstackgerrit | Sujitha proposed openstack/nova master: Add description to policies in admin_actions. https://review.openstack.org/440829 | 22:08 |
mriedem | dims: v | 22:09 |
mriedem | https://review.openstack.org/440832 | 22:09 |
mriedem | cfriesen: i have to go back and read the summary myself | 22:10 |
*** cburgess has joined #openstack-nova | 22:10 | |
dansmith | sdague: omg I am so awesaome | 22:10 |
dansmith | sdague: RROR stevedore.extension [req-3b12728d-ad52-44bd-b79d-ba66275e1d1d None None] Could not load 'server_tags': cannot import name nova_context | 22:11 |
mriedem | cfriesen: ok so we fixed the 2 things in that thread we said we would, | 22:12 |
mriedem | which is the microversion to list instance actions for deleted instances, | 22:12 |
mriedem | and hard delete instance actions when archiving an instance | 22:12 |
mriedem | cfriesen: if you wanted to push a change to add a comment about why we don't soft delete instance actions when deleting an instance, in the instance_destroy db api method, i'd +2 that | 22:13 |
cfriesen | mriedem: okay | 22:13 |
*** jamesden_ has quit IRC | 22:15 | |
*** cburgess has quit IRC | 22:16 | |
*** crushil has quit IRC | 22:17 | |
*** krtaylor has quit IRC | 22:17 | |
*** slaweq_ has quit IRC | 22:17 | |
*** slaweq_ has joined #openstack-nova | 22:20 | |
openstackgerrit | Anusha Unnam proposed openstack/nova master: Add description to policies to availability_zone https://review.openstack.org/440836 | 22:22 |
*** cburgess has joined #openstack-nova | 22:22 | |
cfriesen | one final DB question (for today, anyway). What's the story around console_auth_tokens added in Newton? Is something going to delete them? | 22:25 |
dansmith | my jar runneth over | 22:25 |
mriedem | cfriesen: talk to melwitt about the spec for that | 22:28 |
cfriesen | mriedem: I'm looking at https://blueprints.launchpad.net/nova/+spec/convert-consoles-to-objects ... looks like it got only partially implemented? | 22:29 |
mriedem | cfriesen: yes | 22:29 |
mriedem | melwitt is going to re-propose the spec for pike | 22:29 |
cfriesen | okay, cool. so in Newton the table is there but unused? | 22:30 |
melwitt | looks like it. you can see the patches that merged vs ones that ended up abandoned here https://review.openstack.org/#/q/topic:bp/convert-consoles-to-objects,n,z | 22:31 |
melwitt | so my plan is to repropose the spec and then resurrect those old patches and fix them up if needed to finish the work | 22:32 |
*** zz_dimtruck is now known as dimtruck | 22:32 | |
cfriesen | melwitt: thanks. I was looking for users of console_auth_token_create() but didn't see any. | 22:33 |
melwitt | yeah | 22:33 |
*** mriedem1 has joined #openstack-nova | 22:33 | |
*** gouthamr has quit IRC | 22:33 | |
*** mriedem has quit IRC | 22:34 | |
cfriesen | melwitt: okay, looks like https://review.openstack.org/#/c/325381/ introduces a periodic task to clean up expired tokens. seems maybe a bit odd to drive it from the compute nodes though. | 22:36 |
*** thorst has joined #openstack-nova | 22:36 | |
*** swann_ has left #openstack-nova | 22:36 | |
*** tblakes has quit IRC | 22:37 | |
*** liuyulong_ has quit IRC | 22:37 | |
melwitt | cfriesen: yeah, although that works out for cells, since the tokens will be kept in cell databases, and only n-cpu and n-cond run in a cell | 22:38 |
*** kaisers has quit IRC | 22:39 | |
*** catintheroof has quit IRC | 22:40 | |
*** thorst has quit IRC | 22:41 | |
jaypipes | dansmith: hey, splitting that big patch is prolly a good idea at this point, yeah. I'll do it when I get to my hotel this evening (currently sitting in SeaTac airport...) | 22:44 |
dansmith | jaypipes: okay I think it'll be easy | 22:44 |
cfriesen | just noticed something odd. at https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L1879 we soft-delete migrations when the instance is deleted, but then at https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L6474 we special-case the migrations table like we do for instance_actions. Is that no longer needed? | 22:45 |
jaypipes | dansmith: ya, shouldn't be a big deal. | 22:47 |
mriedem1 | cfriesen: that's for dealing with migrations that were not soft deleted | 22:47 |
mriedem1 | so you'd have migrations in the db that weren't soft deleted and those would break the archive | 22:47 |
mriedem1 | anything after we started soft deleting migrations when the instance was deleted would be fine | 22:48 |
*** mriedem1 is now known as mriedem | 22:48 | |
mriedem | to drop that special case code in the archive function we'd probably need a schema migration that drops those old records | 22:48 |
mriedem | or an online data migration actually | 22:49 |
mriedem | then you don't have the downtime issue | 22:49 |
*** salv-orlando has quit IRC | 22:51 | |
*** salv-orlando has joined #openstack-nova | 22:51 | |
*** felipemonteiro has quit IRC | 22:52 | |
*** felipemonteiro_ has quit IRC | 22:52 | |
cfriesen | is there anything stopping us from doing something similar to soft-delete instance_actions and instance_actions_events now in instance_destroy()? (Now that we've made the other changes from the mailing list summary, I mean.) Or is it not worth the effort? | 22:54 |
mriedem | we don't want to soft delete those because their useful for operators to find out what actions were performed on an instance, which may be deleted now | 22:55 |
mriedem | that was the reason for the microversion | 22:55 |
mriedem | *they're | 22:55 |
cfriesen | okay, got it | 22:55 |
*** kaisers has joined #openstack-nova | 22:55 | |
mriedem | i'd put that in the comment you add to instance_destroy | 22:55 |
mriedem | wink wink | 22:55 |
* mriedem winks his way out of here | 22:55 | |
*** mriedem has quit IRC | 22:55 | |
cfriesen | that's why I asked. :) | 22:55 |
*** gouthamr has joined #openstack-nova | 22:57 | |
*** breitz has quit IRC | 23:01 | |
*** breitz has joined #openstack-nova | 23:02 | |
*** ducttape_ has joined #openstack-nova | 23:04 | |
*** baoli has quit IRC | 23:04 | |
*** krtaylor has joined #openstack-nova | 23:05 | |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Get instance availability_zone without hitting the api db https://review.openstack.org/439754 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Target cell in super conductor operations https://review.openstack.org/438022 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Change MQ targeting to honor only what is in the context https://review.openstack.org/438023 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info https://review.openstack.org/439891 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Add cell field to Destination object https://review.openstack.org/438024 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Make conductor ask scheduler to limit migrates to same cell https://review.openstack.org/438025 | 23:05 |
openstackgerrit | Dan Smith proposed openstack/nova master: Enlighten server tags API about cells https://review.openstack.org/440856 | 23:05 |
*** mdrabe has quit IRC | 23:06 | |
*** liangy has quit IRC | 23:11 | |
*** adrian_otto has quit IRC | 23:16 | |
*** jaypipes has quit IRC | 23:16 | |
*** thorst has joined #openstack-nova | 23:17 | |
*** oomichi has quit IRC | 23:18 | |
*** thorst has quit IRC | 23:19 | |
*** oomichi has joined #openstack-nova | 23:21 | |
*** lucasxu has quit IRC | 23:22 | |
*** mriedem has joined #openstack-nova | 23:24 | |
*** erlon has quit IRC | 23:25 | |
*** Fdaisuke has joined #openstack-nova | 23:27 | |
*** xyang1 has quit IRC | 23:27 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(1/2) https://review.openstack.org/408955 | 23:27 |
dansmith | dtp: still around? | 23:28 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Enable cold migration with target host(2/2) https://review.openstack.org/408964 | 23:28 |
dtp | yessir | 23:28 |
openstackgerrit | Takashi NATSUME proposed openstack/nova-specs master: Fix formatting errors and warnings https://review.openstack.org/407364 | 23:29 |
dansmith | dtp: there are a few other tests that I think are depending on the hypervisor listing, like the aggregates one that uses hypervisors to get a list of hostnames | 23:29 |
*** vladikr has quit IRC | 23:29 | |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add functional tests for cold migration to same host https://review.openstack.org/414926 | 23:29 |
dansmith | so fixing that might get us a fair swipe of passing tests | 23:29 |
openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Add parameters in cold migrate action https://review.openstack.org/410042 | 23:29 |
dtp | dansmith that's cool. i haven't had a chance to start on that yet | 23:31 |
*** adrian_otto has joined #openstack-nova | 23:31 | |
*** marst has quit IRC | 23:31 | |
dansmith | *gasp* | 23:32 |
openstackgerrit | Sujitha proposed openstack/nova master: Add description to policies in admin_actions. https://review.openstack.org/440829 | 23:32 |
dtp | yeah sorry...misjudged my week | 23:32 |
dansmith | dtp: okay well, let me know if you get overly delayed | 23:32 |
dansmith | s'ok | 23:32 |
dtp | don't let me slow you down - if it's better for you to do that one and me to come back again when i _really_ can focus, that's fine w/ me | 23:33 |
dansmith | okay I'll ping you if I break your lock | 23:33 |
*** baoli has joined #openstack-nova | 23:33 | |
dtp | okey dokey | 23:34 |
*** annegentle has quit IRC | 23:35 | |
*** jamielennox is now known as jamielennox|away | 23:37 | |
*** yassine has joined #openstack-nova | 23:40 | |
*** marst has joined #openstack-nova | 23:42 | |
*** tbachman has quit IRC | 23:44 | |
openstackgerrit | Giridhar Jayavelu proposed openstack/nova-specs master: VMware: add SR-IOV support https://review.openstack.org/317126 | 23:53 |
*** jwcroppe has quit IRC | 23:59 | |
*** jwcroppe has joined #openstack-nova | 23:59 | |
*** karimb has quit IRC | 23:59 | |
*** yassine has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!