Tuesday, 2016-08-30

*** gouthamr_ has joined #openstack-nova00:04
*** gouthamr has quit IRC00:08
*** shaohe_feng has quit IRC00:09
*** woodster_ has quit IRC00:09
openstackgerritMathieu Gagné proposed openstack/nova-specs: Update metadata-service-network-info according to implementation  https://review.openstack.org/33781900:10
*** shaohe_feng has joined #openstack-nova00:10
*** hoangcx has joined #openstack-nova00:13
*** sdake has joined #openstack-nova00:14
*** mtanino has quit IRC00:16
*** lixiaoy1 has joined #openstack-nova00:18
*** trisq has joined #openstack-nova00:18
*** shaohe_feng has quit IRC00:19
*** Swami has quit IRC00:20
*** shaohe_feng has joined #openstack-nova00:20
*** thorst has quit IRC00:23
*** thorst has joined #openstack-nova00:24
*** fragatin_ has quit IRC00:27
*** Apoorva has quit IRC00:27
*** fragatina has joined #openstack-nova00:28
mgagnemarkstur: afaik, capacity is enforced at the scheduler level. nova hypervisor-show won't show you the effective "available" vcpus as hypervisor could be part of an aggregate with different cpu_allocation_ratio. cpu_allocation_ratio config is read from machine running nova-scheduler, it's not read from compute node, even if it defaults to 1:16.00:29
*** shaohe_feng has quit IRC00:29
*** browne has quit IRC00:30
*** shaohe_feng has joined #openstack-nova00:31
mgagnemarkstur: so yea, it causes a lot of headaches if you wish to monitor your effective cloud capacity as you would have to reimplement the same logic nova-scheduler uses. This means find a way to detect default cpu_allocation_ratio (16), check if scheduler itself is configured with a different value in nova.conf or if hypervisor is part of an aggregate with a different cpu_allocation_ratio. Even more fun if it's part of 2 aggregates with 200:32
mgagne different ratios which makes little sense but is "technically possible".00:32
*** thorst has quit IRC00:32
marksturbut the math would not be very smart about it, right?00:33
marksturI think the scheduler doesn't know that some existing vCPUs should have more weight and will allow ligher vCPUs to pile on.00:34
marksturmgagne, ^^00:34
marksturOr perhaps "makes little sense" is enough said.  :)00:35
mgagnemarkstur: that's why while it's technically possible to have multiple ratio, I wouldn't recommend it as there is no known way (to me) to make SOME physical cores 1:1 and others 1:16 on the same machine.00:35
mgagnemarkstur: that's why we (my employer) do not mix them but create different aggregates with specific ratios.00:36
marksturmgagne, Sure at run time they are not relatively throttled.  But I was just looking at the ability to oversubcribe beyond the agreed00:36
mgagnemarkstur: do you want to oversubscribe at schedule time or by some other ways?00:37
marksturmgagne, We just want to have some VMs that use a 1:1 ratio and others to have a 4:1 ratio.  And I was trying to explain how it is not a good idea to let those fellas share one hypervisor.00:37
*** shaohe_feng has quit IRC00:40
marksturTime for me to run.  Thanks for the reply!00:40
*** shaohe_feng has joined #openstack-nova00:40
mgagnemarkstur: cya ;)00:42
*** ijw has joined #openstack-nova00:46
*** ijw has quit IRC00:46
*** ijw has joined #openstack-nova00:46
*** su_zhang has quit IRC00:48
*** su_zhang has joined #openstack-nova00:48
*** su_zhang has quit IRC00:49
*** shaohe_feng has quit IRC00:50
*** shaohe_feng has joined #openstack-nova00:53
*** su_zhang has joined #openstack-nova00:53
*** cheneydc has joined #openstack-nova00:55
*** su_zhang has quit IRC00:57
*** trisq has quit IRC00:58
*** shaohe_feng has quit IRC01:00
mriedem_afkmikal: this looks good - https://review.openstack.org/#/c/353793/ - just a few small things inline01:01
*** vishwanathj has quit IRC01:02
*** shaohe_feng has joined #openstack-nova01:02
*** vishwanathj has joined #openstack-nova01:02
mriedem_afkmikal: and what's up with this? https://review.openstack.org/#/c/348066/01:03
openstackgerritMatt Riedemann proposed openstack/nova: Add more vd2 unit tests  https://review.openstack.org/34929801:09
*** shaohe_feng has quit IRC01:10
*** shaohe_feng has joined #openstack-nova01:11
*** nic has quit IRC01:12
*** maurosr has quit IRC01:12
*** raunak has quit IRC01:13
*** kaisers_ has quit IRC01:14
*** sdake has quit IRC01:14
*** thorst has joined #openstack-nova01:17
*** thorst has quit IRC01:17
*** thorst has joined #openstack-nova01:17
*** shaohe_feng has quit IRC01:21
*** sdake has joined #openstack-nova01:21
*** shaohe_feng has joined #openstack-nova01:22
*** gongysh has joined #openstack-nova01:23
*** trisq has joined #openstack-nova01:24
*** thorst has quit IRC01:26
*** mriedem_afk has quit IRC01:29
*** fragatina has quit IRC01:30
*** shaohe_feng has quit IRC01:31
*** hoangcx has quit IRC01:31
*** shaohe_feng has joined #openstack-nova01:31
*** wangqun has joined #openstack-nova01:32
*** ociuhandu has joined #openstack-nova01:32
*** salv-orlando has joined #openstack-nova01:32
*** cheneydc has quit IRC01:32
*** cheneydc has joined #openstack-nova01:33
*** ljxiash has joined #openstack-nova01:34
*** ociuhandu has quit IRC01:34
*** EinstCrazy has joined #openstack-nova01:38
*** ljxiash has quit IRC01:39
*** code-R has joined #openstack-nova01:40
*** shaohe_feng has quit IRC01:41
*** shaohe_feng has joined #openstack-nova01:41
*** amotoki has joined #openstack-nova01:42
*** salv-orlando has quit IRC01:43
*** stewie925 has quit IRC01:43
*** parora has joined #openstack-nova01:43
*** prateek_ has quit IRC01:45
*** amotoki has quit IRC01:46
*** rfolco has quit IRC01:47
*** Sukhdev has joined #openstack-nova01:48
auggyomfg... finally got a mox test to pass FO REALZIES!!01:50
* auggy wonders how many she broke in the process01:51
*** shaohe_feng has quit IRC01:51
*** ljxiash has joined #openstack-nova01:52
*** ljxiash has quit IRC01:54
*** ljxiash has joined #openstack-nova01:54
*** unicell has quit IRC01:55
*** shaohe_feng has joined #openstack-nova01:56
*** code-R has quit IRC01:57
openstackgerritTuan Luong-Anh proposed openstack/nova: Using assertIsNone() instead of assertEqual(None)  https://review.openstack.org/36184701:58
*** shaohe_feng has quit IRC02:02
*** hoangcx has joined #openstack-nova02:02
*** shaohe_feng has joined #openstack-nova02:02
*** vishwanathj has quit IRC02:03
*** EinstCra_ has joined #openstack-nova02:03
*** vishwanathj has joined #openstack-nova02:03
*** EinstCrazy has quit IRC02:06
openstackgerritmelanie witt proposed openstack/nova: Move cell message queue switching and add caching  https://review.openstack.org/32690602:07
darrencCould I get a few nova cores to review https://review.openstack.org/#/c/352290/1? Thanks!02:09
*** gongysh has quit IRC02:11
*** shaohe_feng has quit IRC02:12
*** shaohe_feng has joined #openstack-nova02:13
*** ijw has quit IRC02:14
*** ijw has joined #openstack-nova02:14
*** ijw has quit IRC02:16
*** ducttape_ has joined #openstack-nova02:18
*** shaohe_feng has quit IRC02:22
*** thorst has joined #openstack-nova02:24
*** shaohe_feng has joined #openstack-nova02:25
*** kevinz has joined #openstack-nova02:27
*** code-R has joined #openstack-nova02:27
*** EinstCrazy has joined #openstack-nova02:28
*** code-R_ has joined #openstack-nova02:30
*** gouthamr_ has quit IRC02:30
*** thorst has quit IRC02:31
*** takashin has joined #openstack-nova02:31
*** amotoki has joined #openstack-nova02:31
*** EinstCra_ has quit IRC02:32
*** magic has joined #openstack-nova02:32
*** Sukhdev has quit IRC02:32
*** magic is now known as Guest3343102:32
*** shaohe_feng has quit IRC02:32
*** ljxiash has quit IRC02:32
*** shaohe_feng has joined #openstack-nova02:33
*** code-R has quit IRC02:33
*** hoangcx has quit IRC02:34
*** xiaoyang has quit IRC02:35
openstackgerritTakashi NATSUME proposed openstack/nova: api-ref: Fix wrong parameters in os-volumes.inc  https://review.openstack.org/34711202:35
*** ljxiash has joined #openstack-nova02:35
openstackgerritTakashi NATSUME proposed openstack/nova: Add a hacking rule for string interpolation at logging  https://review.openstack.org/33484402:35
openstackgerritTakashi NATSUME proposed openstack/nova: api-ref: Fix 'id' (attachment_id) parameters  https://review.openstack.org/34986302:35
openstackgerritTakashi NATSUME proposed openstack/nova: Fix an error in archiving 'migrations' table  https://review.openstack.org/32368402:35
*** ljxiash has quit IRC02:36
*** ljxiash has joined #openstack-nova02:36
*** zerda2 has quit IRC02:36
*** Sukhdev has joined #openstack-nova02:37
*** bdeschenes has quit IRC02:39
*** esmiurium has quit IRC02:41
*** Sukhdev has quit IRC02:42
*** shaohe_feng has quit IRC02:43
*** mlavalle has joined #openstack-nova02:43
*** shaohe_feng has joined #openstack-nova02:43
*** hoangcx has joined #openstack-nova02:44
*** esmiurium has joined #openstack-nova02:45
*** code-R_ has quit IRC02:46
*** armax has quit IRC02:46
*** code-R has joined #openstack-nova02:46
*** shaohe_feng has quit IRC02:53
*** ociuhandu has joined #openstack-nova02:53
*** shaohe_feng has joined #openstack-nova02:54
*** vishwanathj has quit IRC02:55
*** vishwanathj has joined #openstack-nova02:55
*** amotoki has quit IRC02:58
*** amotoki has joined #openstack-nova03:00
*** ducttape_ has quit IRC03:02
*** kaisers_ has joined #openstack-nova03:02
*** Kevin_Zheng has quit IRC03:03
*** shaohe_feng has quit IRC03:03
*** vishwanathj has quit IRC03:04
*** shaohe_feng has joined #openstack-nova03:04
*** vishwanathj has joined #openstack-nova03:04
*** marst has quit IRC03:06
*** ociuhandu has quit IRC03:07
*** daemontool has quit IRC03:07
*** kaisers_ has quit IRC03:08
*** vishwanathj has quit IRC03:08
*** vishwanathj has joined #openstack-nova03:08
*** amotoki has quit IRC03:09
*** daemontool has joined #openstack-nova03:11
*** ijw has joined #openstack-nova03:11
*** yamahata has quit IRC03:13
*** shaohe_feng has quit IRC03:13
*** shaohe_feng has joined #openstack-nova03:14
*** ijw has quit IRC03:15
*** sudipto has joined #openstack-nova03:18
*** sudipto_ has joined #openstack-nova03:18
*** baoli_ has quit IRC03:19
*** vishwanathj is now known as vishwanathj_zzz03:19
*** baoli has joined #openstack-nova03:19
*** marst has joined #openstack-nova03:20
*** tonytan_brb has quit IRC03:21
*** shaohe_feng has quit IRC03:24
*** klkumar has joined #openstack-nova03:24
*** shaohe_feng has joined #openstack-nova03:25
*** vishwanathj_zzz has quit IRC03:29
*** mingyu has joined #openstack-nova03:29
*** vishwanathj_zzz has joined #openstack-nova03:29
*** thorst has joined #openstack-nova03:30
*** TravT has joined #openstack-nova03:30
*** ManishD has joined #openstack-nova03:33
*** shaohe_feng has quit IRC03:34
*** shaohe_feng has joined #openstack-nova03:35
*** thorst has quit IRC03:36
openstackgerritAugustina Ragwitz proposed openstack/nova: WIP: Use admin context to create neutron ports  https://review.openstack.org/35754003:41
*** vishwanathj_zzz has quit IRC03:44
*** code-R has quit IRC03:44
*** code-R_ has joined #openstack-nova03:44
*** shaohe_feng has quit IRC03:44
*** devkulkarni has joined #openstack-nova03:44
*** vishwanathj_zzz has joined #openstack-nova03:44
*** shaohe_feng has joined #openstack-nova03:44
*** salv-orlando has joined #openstack-nova03:45
*** baoli has quit IRC03:48
*** ljxiash has quit IRC03:48
*** links has joined #openstack-nova03:51
*** vishwanathj_zzz has quit IRC03:53
*** zz_dimtruck is now known as dimtruck03:53
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient: Updated from global requirements  https://review.openstack.org/36259503:53
*** vishwanathj_zzz has joined #openstack-nova03:53
*** salv-orlando has quit IRC03:53
*** shaohe_feng has quit IRC03:54
*** vishwanathj_zzz has quit IRC03:55
*** armax has joined #openstack-nova03:55
*** vishwanathj_zzz has joined #openstack-nova03:55
*** shaohe_feng has joined #openstack-nova03:57
*** ljxiash has joined #openstack-nova03:57
*** prateek_ has joined #openstack-nova03:58
*** mingyu has quit IRC03:58
*** parora has quit IRC04:01
*** ljxiash has quit IRC04:02
*** fragatina has joined #openstack-nova04:02
*** ducttape_ has joined #openstack-nova04:02
*** shaohe_feng has quit IRC04:05
*** shaohe_feng has joined #openstack-nova04:05
*** garyk1 has joined #openstack-nova04:05
*** raunak has joined #openstack-nova04:07
*** fragatina has quit IRC04:07
*** stewie925 has joined #openstack-nova04:08
*** ducttape_ has quit IRC04:09
*** lixiaoy1 has quit IRC04:09
*** lixiaoy1 has joined #openstack-nova04:10
*** hoangcx has quit IRC04:10
*** code-R_ has quit IRC04:10
*** amotoki has joined #openstack-nova04:12
*** ducttape_ has joined #openstack-nova04:13
*** shaohe_feng has quit IRC04:15
*** ducttape_ has quit IRC04:15
*** shaohe_feng has joined #openstack-nova04:16
*** devkulkarni has quit IRC04:17
ManishDGood Morning Nova04:22
*** tonytan4ever has joined #openstack-nova04:22
*** mlavalle has quit IRC04:23
*** rama_y has joined #openstack-nova04:25
*** shaohe_feng has quit IRC04:25
*** hoangcx has joined #openstack-nova04:25
*** shaohe_feng has joined #openstack-nova04:26
*** tonytan4ever has quit IRC04:26
*** prateek_ has quit IRC04:26
*** code-R has joined #openstack-nova04:30
*** raunak has quit IRC04:33
*** prateek has joined #openstack-nova04:34
*** sudipto_ has quit IRC04:34
*** thorst has joined #openstack-nova04:35
*** sudipto has quit IRC04:35
*** shaohe_feng has quit IRC04:35
*** shaohe_feng has joined #openstack-nova04:37
*** vishwanathj_zzz has quit IRC04:38
*** code-R_ has joined #openstack-nova04:38
*** vishwanathj_zzz has joined #openstack-nova04:38
*** ratailor has joined #openstack-nova04:40
*** code-R has quit IRC04:41
*** thorst has quit IRC04:41
*** salv-orlando has joined #openstack-nova04:41
*** shaohe_feng has quit IRC04:43
*** shaohe_feng has joined #openstack-nova04:44
*** shaohe_feng has quit IRC04:46
*** vishwanathj_zzz has quit IRC04:47
*** shaohe_feng has joined #openstack-nova04:47
*** vishwanathj_zzz has joined #openstack-nova04:47
*** shaohe_feng has quit IRC04:49
*** shaohe_feng has joined #openstack-nova04:49
*** lixiaoy1 has quit IRC04:50
*** vishwanathj_zzz has quit IRC04:50
*** vishwanathj_zzz has joined #openstack-nova04:50
*** kaisers_ has joined #openstack-nova04:52
*** dimtruck is now known as zz_dimtruck04:53
*** shaohe_feng has quit IRC04:56
*** kaisers_ has quit IRC04:57
*** shaohe_feng has joined #openstack-nova04:57
openstackgerritPrateek Arora proposed openstack/nova: Delete traces of in-progress snapshot on VM being deleted  https://review.openstack.org/29451304:57
*** mingyu has joined #openstack-nova04:58
*** ayoung has quit IRC04:58
*** code-R_ has quit IRC05:03
*** mingyu has quit IRC05:03
*** jdurgin has quit IRC05:03
*** code-R has joined #openstack-nova05:03
*** jdurgin has joined #openstack-nova05:04
*** lixiaoy1 has joined #openstack-nova05:04
*** vishwanathj_zzz has quit IRC05:06
*** Sukhdev has joined #openstack-nova05:06
*** vishwanathj_zzz has joined #openstack-nova05:07
*** sudipto_ has joined #openstack-nova05:07
*** sudipto has joined #openstack-nova05:07
*** jaosorior has joined #openstack-nova05:10
*** vishwanathj_zzz has quit IRC05:11
*** vishwanathj_zzz has joined #openstack-nova05:11
*** Sukhdev has quit IRC05:12
*** ljxiash has joined #openstack-nova05:15
*** vishwanathj_zzz has quit IRC05:15
*** vishwanathj_zzz has joined #openstack-nova05:15
*** lifeless_ is now known as lifeless05:15
*** ducttape_ has joined #openstack-nova05:16
*** vishwanathj_zzz has quit IRC05:17
*** vishwanathj_zzz has joined #openstack-nova05:17
*** unicell has joined #openstack-nova05:18
*** unicell has quit IRC05:19
*** ducttape_ has quit IRC05:21
*** armax has quit IRC05:22
*** unicell has joined #openstack-nova05:24
*** vishwanathj_zzz has quit IRC05:26
*** vishwanathj_zzz has joined #openstack-nova05:26
*** bkopilov has joined #openstack-nova05:27
*** mamandle has joined #openstack-nova05:30
*** sudswas__ has joined #openstack-nova05:33
*** code-R_ has joined #openstack-nova05:34
*** sudipto has quit IRC05:35
*** sudipto has joined #openstack-nova05:35
*** sudipto_ has quit IRC05:35
*** code-R has quit IRC05:38
*** vishwanathj_zzz has quit IRC05:38
*** vishwanathj_zzz has joined #openstack-nova05:38
*** thorst has joined #openstack-nova05:39
*** vishwanathj_zzz has quit IRC05:40
*** sridharg has joined #openstack-nova05:40
*** vishwanathj_zzz has joined #openstack-nova05:40
*** code-R_ has quit IRC05:40
*** kevinz has quit IRC05:41
*** code-R has joined #openstack-nova05:41
*** kevinz has joined #openstack-nova05:41
*** swatson has left #openstack-nova05:42
*** armax has joined #openstack-nova05:46
*** thorst has quit IRC05:46
*** sdake has quit IRC05:47
*** nkrinner_afk is now known as nkrinner05:48
*** sdake has joined #openstack-nova05:50
*** kaisers_ has joined #openstack-nova05:56
*** su_zhang has joined #openstack-nova05:56
*** paul-carlton2 has joined #openstack-nova05:58
*** pbandark has joined #openstack-nova05:59
*** mingyu has joined #openstack-nova06:00
*** mingyu has quit IRC06:04
*** Sukhdev has joined #openstack-nova06:06
*** andreas_s has joined #openstack-nova06:07
*** salv-orl_ has joined #openstack-nova06:08
*** ekuris has joined #openstack-nova06:08
*** kevinz has quit IRC06:09
*** kevinz has joined #openstack-nova06:09
*** salv-orlando has quit IRC06:11
*** salv-orlando has joined #openstack-nova06:12
*** su_zhang has quit IRC06:13
*** su_zhang has joined #openstack-nova06:14
*** salv-orl_ has quit IRC06:17
*** salv-orlando has quit IRC06:17
*** mjura_ has joined #openstack-nova06:17
*** mjura has joined #openstack-nova06:17
*** su_zhang has quit IRC06:18
*** moshele has joined #openstack-nova06:19
*** rcernin has joined #openstack-nova06:19
openstackgerritgengchc2 proposed openstack/nova: Fix a typo in the driver.py file  https://review.openstack.org/36186106:19
*** ijw has joined #openstack-nova06:20
*** mjura has quit IRC06:21
*** amotoki has quit IRC06:22
*** ijw has quit IRC06:25
openstackgerritmelanie witt proposed openstack/nova: Move cell message queue switching and add caching  https://review.openstack.org/32690606:26
*** pcaruana has joined #openstack-nova06:26
*** paul-carlton2 has quit IRC06:28
*** armax has quit IRC06:28
*** paul-carlton2 has joined #openstack-nova06:28
*** praneshp has quit IRC06:32
ManishDHI paul-carlton206:33
*** artom has quit IRC06:34
*** lpetrut has joined #openstack-nova06:36
openstackgerritZhenyu Zheng proposed openstack/nova: Should not be able to sort instances based on joined tables  https://review.openstack.org/35913406:37
openstackgerritBhagyashri Shewale proposed openstack/nova: Return 400 error for non-existing snapshot_id  https://review.openstack.org/36094106:38
*** ManishD has quit IRC06:39
*** Manish has joined #openstack-nova06:39
*** artom has joined #openstack-nova06:44
*** sdake has quit IRC06:44
*** thorst has joined #openstack-nova06:44
*** amotoki has joined #openstack-nova06:46
*** sudipto has quit IRC06:48
*** sudswas__ has quit IRC06:48
*** Sukhdev has quit IRC06:51
*** liverpooler has joined #openstack-nova06:51
*** thorst has quit IRC06:51
*** markus_z has joined #openstack-nova06:52
*** mingyu has joined #openstack-nova06:53
*** amotoki has quit IRC06:56
*** rama_y has quit IRC06:57
*** sudipto has joined #openstack-nova07:00
*** sudswas__ has joined #openstack-nova07:00
openstackgerritChangBo Guo(gcb) proposed openstack/nova: Don't pass argument sqlite_db in method set_defaults  https://review.openstack.org/35094707:01
*** tesseract- has joined #openstack-nova07:07
*** sheel has joined #openstack-nova07:08
*** avolkov` has joined #openstack-nova07:09
*** avolkov has quit IRC07:09
openstackgerritTakashi NATSUME proposed openstack/nova-specs: Abort Cold Migration  https://review.openstack.org/33473207:10
*** jlanoux has joined #openstack-nova07:13
*** paul-carlton2 has quit IRC07:15
*** code-R has quit IRC07:18
*** jlanoux has quit IRC07:18
*** ducttape_ has joined #openstack-nova07:18
openstackgerritChangBo Guo(gcb) proposed openstack/nova: Return instance of Guest from method write_instance_config  https://review.openstack.org/26514607:19
*** jlanoux has joined #openstack-nova07:19
openstackgerritChangBo Guo(gcb) proposed openstack/nova: Don't use 'updated_at' to check service's status  https://review.openstack.org/29708507:19
*** rmart04 has joined #openstack-nova07:20
*** lpetrut has quit IRC07:21
*** rkrum has quit IRC07:21
*** ducttape_ has quit IRC07:23
*** Dinesh_Bhor has quit IRC07:23
*** Dinesh_Bhor has joined #openstack-nova07:24
*** sameo has joined #openstack-nova07:28
*** paul-carlton2 has joined #openstack-nova07:28
*** matrohon has joined #openstack-nova07:33
openstackgerritPrateek Arora proposed openstack/nova: Delete traces of in-progress snapshot on VM being deleted  https://review.openstack.org/29451307:37
*** bhagyashri has joined #openstack-nova07:46
*** bhagyashri has quit IRC07:47
*** bhagyashri has joined #openstack-nova07:47
*** thorst has joined #openstack-nova07:49
*** Oku_OS-away is now known as Oku_OS07:49
*** kaisers1 has quit IRC07:50
*** pilgrimstack has joined #openstack-nova07:51
*** kaisers has quit IRC07:52
*** tanee_away is now known as tanee07:52
*** kaisers has joined #openstack-nova07:53
*** kaisers1 has joined #openstack-nova07:53
*** maurosr has joined #openstack-nova07:53
*** cdent has joined #openstack-nova07:55
*** code-R has joined #openstack-nova07:55
openstackgerritmelanie witt proposed openstack/nova: Move cell message queue switching and add caching  https://review.openstack.org/32690607:55
*** paul-carlton2 has quit IRC07:56
*** thorst has quit IRC07:57
*** zzzeek has quit IRC08:00
*** lhinds_ has joined #openstack-nova08:02
*** zzzeek has joined #openstack-nova08:02
*** lhinds_ has left #openstack-nova08:04
*** yassine has joined #openstack-nova08:05
*** yassine is now known as Guest1760908:06
*** Guest17609 is now known as yassou08:06
*** derekh has joined #openstack-nova08:07
*** kaisers_ has quit IRC08:07
*** kaisers_ has joined #openstack-nova08:08
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Testing latest u-c  https://review.openstack.org/30334508:10
*** magic has joined #openstack-nova08:18
*** ducttape_ has joined #openstack-nova08:19
*** magic is now known as Guest9997308:19
*** willise has joined #openstack-nova08:19
*** phuongnh has joined #openstack-nova08:19
*** Guest33431 has quit IRC08:22
*** tonytan4ever has joined #openstack-nova08:23
*** ducttape_ has quit IRC08:23
*** paul-carlton2 has joined #openstack-nova08:26
*** tonytan4ever has quit IRC08:28
*** roeyc has joined #openstack-nova08:28
openstackgerritAndrey Volkov proposed openstack/nova: Add test fixture for cell0  https://review.openstack.org/30186408:32
openstackgerritZhenyu Zheng proposed openstack/nova-specs: Support volume_type as a BDM parameter when boot instances  https://review.openstack.org/36269808:34
*** zenoway has joined #openstack-nova08:34
openstackgerritZhenyu Zheng proposed openstack/nova-specs: Support volume_type as a BDM parameter when boot instances  https://review.openstack.org/36269808:35
*** RuiChen has joined #openstack-nova08:38
*** tojuvone has left #openstack-nova08:40
*** markd_ has joined #openstack-nova08:40
*** tojuvone_ has joined #openstack-nova08:40
*** moshele has quit IRC08:41
*** moshele has joined #openstack-nova08:42
*** lennyb has quit IRC08:42
bauzascdent: hello08:43
*** tojuvone_ is now known as tojuvone08:43
johnthetubaguybauzas: have you looked at cells and the new context managers, I have a question here I am not sure about: https://review.openstack.org/#/c/328491/708:44
bauzasjohnthetubaguy: just saw yesterday alaski's patch08:45
bauzasjohnthetubaguy: but sure, how can I help ?08:45
johnthetubaguybauzas: I am curious if my worries are valid or not, basically08:45
bauzas(note: 2 PTO weeks + 1 off-site conference week means that I'm a bit out :p )08:46
johnthetubaguyIts more a documentation concern really08:46
bauzasjohnthetubaguy: okay, lemme review it08:46
*** daemontool has quit IRC08:46
johnthetubaguybauzas: thanks08:46
bauzascdent: in case you also want me to help you for the patch, lemme know08:46
bauzasjohnthetubaguy: I actually wonder if we could find some other way to automatically add hosts within a cell08:49
*** daemontool has joined #openstack-nova08:49
*** antonyfm has joined #openstack-nova08:49
johnthetubaguybauzas: long term, maybe, but as an operator I actually quite like being explicit about adding hosts, so we need both options I feel08:50
openstackgerritjichenjc proposed openstack/nova: Add usage of the allow_resize_same_host  https://review.openstack.org/36270808:50
johnthetubaguybauzas: its optional to do the conversion at this point, I think?08:50
bauzasjohnthetubaguy: well, the problem is that if we don't have a HostMapping, no instances can be booted for some host08:53
bauzasjohnthetubaguy: so, say I'm adding host A to cell108:53
bauzasjohnthetubaguy: then the service will automatically be created08:53
bauzasjohnthetubaguy: but there will be no HostMapping item being created, so no way to boot an instance for it08:54
johnthetubaguybauzas: agreed, thats the problem08:54
bauzasso, here the proposal is to run a discover command, and I think we could merge it for Newton08:55
bauzasbut I'd rather prefer to discuss on how to automatically add computes to cells08:55
johnthetubaguyyes, scheduler picks it, possibly, but we fail to know where the host lives, so the boot fails08:55
bauzasthat means the compute would need to find out which cell it belongs to08:56
bauzasjohnthetubaguy: zactly08:56
*** thorst has joined #openstack-nova08:56
johnthetubaguyso I am OK with the cmd as a workaround for newton08:56
bauzasyup, given we only support one cell atm08:57
johnthetubaguymy problem with the patch, is we need to describe where the user needs to run that cmd, I belive08:57
johnthetubaguyI think it will break if you run it on the child cell08:57
johnthetubaguybut not 100% sure08:57
bauzassec, verifying it08:58
*** zenoway has quit IRC08:58
bauzastbh, I don't remember the internals of the MQ switching08:58
johnthetubaguyHostMapping add is what I am thinking about08:58
*** cdent has quit IRC08:58
johnthetubaguymaybe that always defaults to the API db, which all nodes should have, so it works? I am not sure08:59
*** zenoway has joined #openstack-nova08:59
bauzasjohnthetubaguy: so , HostMapping.get_by_host reads the API DB08:59
*** lixiaoy1 has quit IRC09:00
*** code-R_ has joined #openstack-nova09:00
*** links has quit IRC09:00
*** thorst has quit IRC09:02
johnthetubaguyand we need that on all nodes anyways? I guess we do09:02
johnthetubaguybauzas: ^09:02
*** code-R has quit IRC09:03
bauzasjohnthetubaguy: HostMapping is listing all hosts indeed09:04
bauzasthat's the routing table09:04
*** jlanoux has quit IRC09:05
bauzasjohnthetubaguy: tbc, my wonders are, given we're within a cell, is it possible to call out the API DB session ?09:05
*** tuanla_ has joined #openstack-nova09:05
bauzasjohnthetubaguy: that's the whole purpose of the MQ/DB context switch09:05
johnthetubaguyI think it is in theory possible, if configured correctly09:05
johnthetubaguyI think we are trying to avoid such things though09:05
*** lpetrut has joined #openstack-nova09:06
*** jaosorior is now known as jaosorior_lunch09:08
prateekjohnthetubaguy, can you please review  https://review.openstack.org/294513 , whenever you have some free time09:08
johnthetubaguyprateek: fixated on all the priority features right now, hopefully get more time other end of this week09:09
prateekjohnthetubaguy, thanks! i would get in touch EOW09:10
bauzasjohnthetubaguy: agreed, we really try to refrain our cells world to call northbound09:11
*** hamzy has quit IRC09:11
bauzasjohnthetubaguy: honestly, I'm torn09:11
*** hamzy has joined #openstack-nova09:11
johnthetubaguybauzas: anyways, can catch up with the others when they are awake, was just curious09:12
bauzasjohnthetubaguy: you have a valid point, but we should for Newton just mention where to run, not really implement09:12
openstackgerritClaudiu Belu proposed openstack/nova: WIP: api: discoverable policy  https://review.openstack.org/28053909:13
bauzasjohnthetubaguy: well it's more or less us agreeing about if we should be defensive with our patches or just explaining to operators where they need to run commands09:13
*** bdeschenes has joined #openstack-nova09:14
bauzasAFAICR, we have a couple of cell mng commands that are not preventing operators to trample their deployments if they run it intra-cell09:14
*** links has joined #openstack-nova09:15
johnthetubaguybauzas: I think this is safe, if it fails how I think it does, just a likely a strange error message09:17
*** ducttape_ has joined #openstack-nova09:19
*** jlanoux has joined #openstack-nova09:20
bauzasjohnthetubaguy: I just commented out09:20
bauzasjohnthetubaguy: for Newton, given the very experimental level, I'd say docs is fine09:20
bauzaswe don't yet support multi-cells09:20
bauzasbut in Ocata, once multi-cells will become a reality, then indeed we should somehow fail gently and warn09:21
bauzasjohnthetubaguy: anyway, given we have a lot of Cellv2Commands that are based on that assumption, it's more or less finding some way to wrap something around that would say "meh, your fault, run it elsewhere"09:22
*** tbachman_ has joined #openstack-nova09:22
*** tbachman has quit IRC09:22
*** tbachman_ is now known as tbachman09:22
*** ducttape_ has quit IRC09:24
*** cdent has joined #openstack-nova09:27
*** jlanoux_ has joined #openstack-nova09:28
*** nkrinner has quit IRC09:29
*** jlanoux has quit IRC09:31
*** lpetrut1 has joined #openstack-nova09:34
*** lpetrut has quit IRC09:34
*** lpetrut1 is now known as lpetrut09:34
*** nkrinner has joined #openstack-nova09:35
*** ljxiash has quit IRC09:36
*** ljxiash has joined #openstack-nova09:37
*** madhaviy has joined #openstack-nova09:38
madhaviyhi there, I want to create a server using admin token by passing key_name( nova keypair) of a some other user (Imported by some other user)09:40
*** sahid has joined #openstack-nova09:40
madhaviyis this possible?09:40
*** ljxiash has quit IRC09:41
*** jaosorior_lunch is now known as jaosorior09:42
*** lennyb has joined #openstack-nova09:43
*** rwmjones_hols is now known as rwmjones09:43
*** oanson has joined #openstack-nova09:46
*** kaisers_ has quit IRC09:48
*** RuiChen has quit IRC09:49
bhagyashrirpodolyaka: Hi, could you please review https://review.openstack.org/#/c/345191/ ?09:51
*** roeyc has quit IRC09:55
*** thorst has joined #openstack-nova09:58
*** ihrachys has joined #openstack-nova10:00
*** liuyulong is now known as yulong|away10:00
*** jlanoux has joined #openstack-nova10:00
*** jlanoux_ has quit IRC10:03
*** GB21 has joined #openstack-nova10:03
*** amotoki_ has joined #openstack-nova10:03
*** thorst has quit IRC10:05
*** mnestratov has joined #openstack-nova10:08
*** wangqun has quit IRC10:08
*** daemontool has quit IRC10:09
*** daemontool has joined #openstack-nova10:09
openstackgerritDavanum Srinivas (dims) proposed openstack/nova: [WIP] Testing latest u-c  https://review.openstack.org/30334510:10
*** hoangcx has quit IRC10:19
*** ducttape_ has joined #openstack-nova10:20
*** sridharg has quit IRC10:22
*** amotoki has joined #openstack-nova10:23
*** gszasz has joined #openstack-nova10:24
*** tonytan4ever has joined #openstack-nova10:24
*** amotoki_ has quit IRC10:25
*** ducttape_ has quit IRC10:25
*** salv-orlando has joined #openstack-nova10:27
*** tonytan4ever has quit IRC10:28
*** EinstCrazy has quit IRC10:31
*** EinstCrazy has joined #openstack-nova10:31
openstackgerritBhagyashri Shewale proposed openstack/python-novaclient: Fix 'UnicodeEncodeError' for unicode values  https://review.openstack.org/34602610:32
openstackgerritChris Dent proposed openstack/nova: Optional separate database for placement API  https://review.openstack.org/36276610:33
cdentjohnthetubaguy: ^10:33
cdentthat's the first section of https://etherpad.openstack.org/p/placement-db10:33
*** amotoki_ has joined #openstack-nova10:33
johnthetubaguycdent: ah, good stuff, I will try get to that straight after lunch10:34
cdentcool, thanks10:34
*** roeyc has joined #openstack-nova10:35
*** amotoki has quit IRC10:36
*** EinstCrazy has quit IRC10:36
*** phuongnh has quit IRC10:39
*** bdeschenes has quit IRC10:39
prateekcdent, if you have some free time, can you please let me know what you mean what you meant by the comment on "This test doesn't test anything other than itself." https://review.openstack.org/#/c/327706/8/nova/tests/unit/api/openstack/test_wsgi.py10:42
*** lixiaoy1 has joined #openstack-nova10:42
cdentprateek: yeah, let me look at it again to remind myself10:42
prateekcdent, ok10:43
cdentprateek: what I mean is that no code outside of that test is actually called by the test. All it is testing is that your Controller raises an exception, which, to me at least, is useless. Or am I missing something?10:44
cdentbrb10:45
prateekcdent, no you didn't , the controller was supposed to raise an exception and then a 504 was meant to be returned10:46
prateekand i messed up royally !10:46
prateekcdent, i am wondering how test_resource_not_authorized which is on top of test i wrote got passed, it does the exactly same mistake i have done10:47
cdenthmmm, yeah. :(10:48
*** sridharg has joined #openstack-nova10:48
*** GB21 has quit IRC10:49
cdentI think there are probably a lot of tests like that10:49
*** GB21 has joined #openstack-nova10:50
prateekcdent, yeah would need a debugger to find out what actually is happening behind the scenes, would get back to you with how it works, thanks for your help10:51
*** salv-orl_ has joined #openstack-nova10:52
*** sdague has joined #openstack-nova10:53
bauzascdent: as I said earlier, in case you need help for the etherpad implementation, lemme know10:54
*** salv-orl_ has quit IRC10:54
cdentbauzas: the first section is ready for review, after I get another coffee I'm going to settle in to do the additional database table, so I think it is under control but review on the first section would be very welcome: https://review.openstack.org/36276610:55
*** salv-orlando has quit IRC10:56
*** sridharg has quit IRC10:56
*** sridharg has joined #openstack-nova10:57
johnthetubaguycdent: given bad code is the only reason for that test to fail, it feels OK-ish to me. We have seen things were the raise or log hides the real exception, and it does help avoid that. I am curious if there is a better way for that though, they do feel lame.11:00
cdentjohnthetubaguy: you mean it is testing the exception itself?11:01
johnthetubaguycdent: testing that the code correctly raises the correct exception11:02
cdentit's not doing that11:02
johnthetubaguyoh...11:02
cdentit's testing _no_ code outside the test, except for anything that is called within the exception itself11:02
johnthetubaguyI see what you mean, its mocking a think and testing it raises11:03
cdentyes11:03
johnthetubaguyhmm, that does see wrong11:03
cdentwe know from that test that raising a NeutronConnectionFailed() is possible, but in a complicated and not very robust way. That's all.11:03
*** tbachman_ has joined #openstack-nova11:03
*** thorst has joined #openstack-nova11:03
johnthetubaguycdent: yeah11:04
johnthetubaguycdent: I was looking at the wrong code, my bad11:05
* cdent coffees up11:05
johnthetubaguycdent: justifies your comments about the framework being so opaque really11:05
*** tbachman has quit IRC11:05
*** tbachman_ is now known as tbachman11:05
*** wznoinsk has quit IRC11:10
*** adisky has joined #openstack-nova11:10
*** cdent has quit IRC11:10
*** thorst has quit IRC11:11
*** hoangcx has joined #openstack-nova11:11
*** rtheis has joined #openstack-nova11:12
*** trisq has quit IRC11:12
*** cdent has joined #openstack-nova11:13
openstackgerritTakashi NATSUME proposed openstack/nova: WIP: Enable cold migration with target host  https://review.openstack.org/35710511:13
*** hoangcx2 has joined #openstack-nova11:15
cdentsdague: in case you haven't seen it yet, I've updated the placement devstack stuff: https://review.openstack.org/#/c/342362/11:16
sdagueyep, I just pulled it down and am building the test env here11:16
cdent\o/11:17
*** hoangcx has quit IRC11:17
sdagueso far so good. It's odd to look at a service log without all the oslo.service dump in it though :)11:18
*** ducttape_ has joined #openstack-nova11:21
*** ducttape_ has quit IRC11:26
*** bvanhav has joined #openstack-nova11:27
ratailorcan anyone please review it, https://review.openstack.org/#/c/312887/11:28
*** wznoinsk has joined #openstack-nova11:28
*** sudipto has quit IRC11:32
*** sudswas__ has quit IRC11:32
sdaguecdent: ok, so your devstack patch creates the endpoints11:32
* cdent nods11:32
sdaguebut it doesn't create the placement accounts, or put that info in the nova.conf11:32
sdagueunless I'm missing something11:33
cdent"the placement accounts"?11:33
cdentcreate_service_user "placement" is in there11:33
sdaguewhere are you adding the credentials to the nova.conf ?11:33
cdentI'm not, I don't even know what that means11:33
*** amotoki_ has quit IRC11:33
sdaguehttps://review.openstack.org/#/c/358797/5/nova/conf/placement.py@3711:34
sdagueif we're going to talk to another service over rest11:34
sdaguewe need service user credentials11:34
cdentyeah, I've questioned multiple times why that stuff is even necessary, but nobody has taken the time to explain it to me11:34
cdentI was under the impression that a compute node knows its region so why do we need to have it in config11:35
cdentwhy can't we just ask keystone, and be done with it?11:35
openstackgerritJohn Garbutt proposed openstack/nova: Api-ref: Improve os-migrateLive input parameters  https://review.openstack.org/34565211:35
cdentthere are _so_many_ assumptions made by this crowd11:35
sdaguehttp://logs.openstack.org/61/360761/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/25c13b2/logs/etc/nova/nova.conf.txt.gz11:35
sdaguea compute node doesn't know it's region11:36
cdentweird11:36
cdentokay11:36
sdaguebut, regardless of that, it needs auth11:36
*** amotoki has joined #openstack-nova11:36
*** Manish has quit IRC11:36
sdaguesee that neutron section in the conf file11:36
cdentokay, but either: explain it to me like I'm five, or perhaps just fix it and then I'll know?11:37
*** kaisers_ has joined #openstack-nova11:37
cdentwhat I think you're going to tell me or show me is just going to make me cry11:37
sdagueok... where do you expect nova to get credentials to talk to another service?11:38
*** thorst has joined #openstack-nova11:38
sdagueto generate a valid keystone token11:38
cdentI have no expectations about that, that's what I'm trying to tell you.11:38
cdentIt is not something I've had to deal with, yet.11:38
*** thorst_ has joined #openstack-nova11:39
sdagueok, well when services are talking to each other over REST, we have 2 options11:39
cdent(as you're well aware the volume of tasks are such that most stuff just has to get dropped on the floor until it is critical)11:40
sdagueif the call chain was user initiated, we can use the user's keystone token that started the process. This is how we talk to cinder, or glance, for instance11:40
sdagueif it is not11:40
sdaguethen we need auth credentials for a service user in our config11:40
sdagueso that we can make calls, not on behalf of a user, at any time11:40
sdaguewhich we need to do with neutron, and hence the auth block there11:41
sdaguehttps://review.openstack.org/#/c/358797/5/nova/conf/placement.py@37 - is jay enabling that for communication to the placement api11:41
*** kaisers_ has quit IRC11:41
sdaguebut it means we need the values in the config file, otherwise we're making calls with no auth, and they all explode11:41
*** thorst has quit IRC11:42
cdentI guess the surprise/crying comes in because of the need for this to be explicit rather than there being reasonable generic defaults which each service could override if it wanted to, because for the most part that looks like boilerplate11:43
cdent(the neutron chunk is what I mean by boilerplate)11:43
openstackgerritRajesh Tailor proposed openstack/nova: Fix notify instance usage on evacuate  https://review.openstack.org/36279411:43
cdentsdague: in the context of this stuff, what difference does it make that currently the placement API's only auth handling is that the user has the admin role: https://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handler.py#L140 ?11:46
sdaguecdent: most of those things need to be pretty explicit during a real deploy, so if we aren't explicit about them, you end up encoding devstack defaults in nova code11:46
sdaguecdent: that's the server11:47
sdagueit still needs a valid keystone token to even get there11:47
sdaguewere would that come from?11:47
cdentsdague: yes, I know that. I'm just saying: is a 'create[d]_server_user' going to have that role?11:47
*** lucasagomes is now known as lucas-hungry11:47
cdents/server/service/11:48
sdaguecdent: https://github.com/openstack-dev/devstack/blob/ecfc8a77c203c7832b8b7542342cbb8e258a7765/lib/keystone#L455-L46711:49
*** takashin has left #openstack-nova11:49
cdentyes, I know how to read the code. What I'm asking is "hey, is this  thing about the way the placement handles auth (either in devstack or on the server side) going to be an issue, do we need to worry about that?"11:50
sdaguecdent: for right now, I think you just need to change it to create_service_user "placement" "admin"11:50
sdagueat some point we're going to get all the service cross calls to work on the "service" role instead of the "admin" role, but that work has not yet started11:51
sdagueothers, I think checking role the way you did it should be fine11:51
*** tblakes has joined #openstack-nova11:51
cdentokay, I've made a note. Can you point me at a good example for correctly setting the conf for auth (in the [placement] section, right?)?11:53
jrollis there a reason not to build in using the service role and policy.json from the start, or is it just time constraints?11:53
cdentjroll: it was mostly lack of time and lack of clear specification. There was talk of it happening, but it was struck off as a not immediate requirement. If you've got cycles though, please have at :)11:55
cdent(seriously, not being snarky, your help would be very welcome)11:55
sdaguecdent: https://github.com/openstack-dev/devstack/blob/ecfc8a77c203c7832b8b7542342cbb8e258a7765/lib/neutron#L292-L31211:55
jrollcdent: okay cool, just curious11:55
sdaguethat's where neutron configures nova11:55
cdentthanks sdague11:55
sdaguejroll: we also kind of need to synchronize the role downgrade to service at least across base iaas11:56
sdagueotherwise it's going to be kick you in the knees confusing to ops11:56
cdentI've added notes to the review and -W'd myself, will get to that in a few minutes, currently adding the database tables. thanks sdague11:57
*** rfolco has joined #openstack-nova11:57
jrollsdague: fair enough, we did the move when we changed our policy to be more than admin or nothing11:58
*** efried has joined #openstack-nova11:58
sdaguecdent: yep, no prob. I think I can sketch using the keystone auth correctly in parallel, and then hope it all comes together11:58
*** mingyu has quit IRC12:00
*** pradk has joined #openstack-nova12:02
*** jaosorior has quit IRC12:04
*** mamandle has quit IRC12:04
*** jaosorior has joined #openstack-nova12:04
*** ducttape_ has joined #openstack-nova12:06
*** vladikr has joined #openstack-nova12:06
tdurakovhi folks12:11
*** ttrumm has joined #openstack-nova12:11
*** jaosorior has quit IRC12:11
*** jaosorior has joined #openstack-nova12:12
tdurakovwho could check one thing: on master/devstack with nova-network will try to boot instance without passing net-id12:12
*** tonytan4ever has joined #openstack-nova12:13
*** clenimar has quit IRC12:15
*** gouthamr has joined #openstack-nova12:17
sdaguecdent - just so this is somewhere else than in my head - http://paste.openstack.org/show/564819/ is the minimal way to use keystoneauth as a rest client, which does all the token bits behind the scenes. That's on my devstack using the random admin user we setup by default.12:23
*** kswiatek has joined #openstack-nova12:23
openstackgerritliuxiuli proposed openstack/nova: Modify workflow of rebuild_instance when schedule fails  https://review.openstack.org/34811112:24
cdentsdague: thanks was looking at when starting the python-placementclient code (which is far from done at this point)12:24
cdentI struggled to figure out "what's the bare minimum", so this is great12:25
sdaguethe keystone session interface is basically a wrapper on requests, with a couple of extra parameters to do selection of endpoint12:25
cdentyeah, this was another one of those situations where I was expecting some kind of reasonable defaulting (to environment variables in this case)12:29
cdent(and maybe it does, but the docs were not at all clear)12:29
sdagueok, going to get another cup of coffee, how is the devstack how is the devstack patch coming? I think I have a *should barely work* version of this locally now. But need some coffee / breakfast anyway.12:31
*** mdrabe has joined #openstack-nova12:31
*** su_zhang has joined #openstack-nova12:31
*** ducttape_ has quit IRC12:32
cdentsdague: I'm just testing it is okay, then ready to push12:32
openstackgerritChangBo Guo(gcb) proposed openstack/nova: Add volume status check when deleting instances  https://review.openstack.org/26033912:33
*** tuanla_ has quit IRC12:34
cdentwhere do tests for api migrations live?12:35
cdents/api/api db/12:36
cdentah found em, in functional12:39
*** lucas-hungry is now known as lucasagomes12:41
*** sudipto has joined #openstack-nova12:42
*** sudswas__ has joined #openstack-nova12:42
*** baoli has joined #openstack-nova12:44
*** EinstCrazy has joined #openstack-nova12:44
kswiateksdague, pkoniszewski, melwitt, mdbooth, could you review: https://review.openstack.org/#/c/314928/12:45
alaskijohnthetubaguy: bauzas responded on https://review.openstack.org/#/c/32849112:47
*** annegentle has joined #openstack-nova12:48
*** cdelatte has joined #openstack-nova12:49
*** gouthamr_ has joined #openstack-nova12:49
*** gouthamr has quit IRC12:51
cdentsdague: just pushed new version of the devstack stuff12:52
*** markvoelker has joined #openstack-nova12:52
bauzasalaski: cool, will look into it asap12:53
*** tbachman has quit IRC12:53
*** claudiub has joined #openstack-nova12:54
bauzasalaski: okay, so basically, we have the same opinion12:54
*** roeyc has quit IRC12:54
bauzasalaski: I'm okay with merging this one for Newton, and then discussing for Ocata about providing better ways12:54
*** roeyc has joined #openstack-nova12:55
bauzasI mean, providing a better warning in case the operator runs it in the child cell, and also discuss about how it could be possible to leave a northbound call for computes adding automatically to the cell12:55
bauzasjohnthetubaguy: you okay with that?12:55
* johnthetubaguy is looking12:56
bauzasjohnthetubaguy: tbc, like I said, all our nova-manage cmds for cells v2 have the same issue if the operator runs them in a child cell host12:56
openstackgerritLudovic Beliveau proposed openstack/nova: Don't parse PCI whitelist eveytime neutron ports are created  https://review.openstack.org/33723612:56
*** xinliang has quit IRC12:57
*** trisq has joined #openstack-nova12:57
johnthetubaguyalaski: thanks for the response, I am +1 your comments on that patch12:58
johnthetubaguyalaski: just a slight docs tweak is good with me12:58
*** madhaviy has quit IRC12:59
*** edand has joined #openstack-nova12:59
*** clenimar has joined #openstack-nova13:00
bauzasjohnthetubaguy: we can possibly add a follow-up reno change for adding like a comment saying 'please run all the nova-manage commands for cellsv2 at the API level"13:01
bauzasjohnthetubaguy: but tbc, it's the same problem for all our already existing calls13:01
johnthetubaguyI guess most of them do the same, thats true13:01
bauzasso, maybe adding a prelude section is okay by me13:02
*** sbezverk_ has quit IRC13:02
bauzaslike we did for Mitaka13:02
johnthetubaguyalaski: bauzas: how about we put all the tweaks in a follow up patch, to make them all consistent (somehow)?13:02
bauzasjohnthetubaguy: you mean a doc thing ?13:02
*** xyang1 has joined #openstack-nova13:02
bauzasjohnthetubaguy: or more something like an helper decorator (or something else) for all the commands, verifying whether we can access the API DB, and if not, fail gracefully?13:04
*** gcb has quit IRC13:04
*** ttrumm has quit IRC13:04
*** GB21 has quit IRC13:04
johnthetubaguybauzas: I am fine with just a doc thing for this cycle13:04
*** ttrumm has joined #openstack-nova13:04
*** mamandle has joined #openstack-nova13:05
*** abalutoiu has joined #openstack-nova13:06
*** su_zhang has quit IRC13:07
*** su_zhang has joined #openstack-nova13:07
sdaguecdent: ok, cool, just working out some of the expected exceptions from the keystone auth side, let me see if the happy path works now13:08
sdaguecdent: resource reporting is every 60 seconds?13:09
*** ttrumm has quit IRC13:09
cdentsdague, that's the default yeah13:09
*** rodrigods has quit IRC13:09
*** rodrigods has joined #openstack-nova13:09
*** david-lyle has quit IRC13:10
bauzassdague: cdent: well that depends13:10
bauzassdague: cdent: resource reporting can be more often, tbc it's every time we claim for an instance13:10
sdaguebauzas: ok, so if I trigger a server build, it will happen immediately?13:11
bauzasby default, we periodically make a whole new global update every 60 secs, that's true but we also amend the host every time an instance is claimed13:11
bauzassdague: yup, if the claim is successful in the compute manager13:11
*** adisky has quit IRC13:11
sdaguegreat13:11
*** su_zhang has quit IRC13:11
*** antonyfm has quit IRC13:11
sdaguegives me enough to tickle this13:11
*** ducttape_ has joined #openstack-nova13:12
sdaguecdent: fyi, keystone auth gives us some reasonable exceptions to distinguish the failure cases we cared about - http://paste.openstack.org/show/564830/13:12
cdentexcellent smithers13:13
*** rlrossit has joined #openstack-nova13:13
sdagueas I was trying to handle the non happy path, which I did with glance instead, because with placement api in keystone, dropping it for 30 seconds isn't as simple in spot testing :)13:13
*** sheel has quit IRC13:16
*** markvoelker has quit IRC13:17
alex_xujohnthetubaguy: we didn't create migration obj for rebuild action, if we fail at that check, the rebuild action will be broken https://review.openstack.org/#/c/348111/9/nova/conductor/manager.py@64813:17
*** ducttape_ has quit IRC13:17
*** dinobot_ is now known as dakhmetov13:17
*** david-lyle has joined #openstack-nova13:18
*** mlavalle has joined #openstack-nova13:18
alex_xujohnthetubaguy: from the comment at here https://review.openstack.org/#/c/200485/28/nova/conductor/manager.py@898, looks like Nikola's plan is passing migration from compute api. Maybe that was forgetten to change in the end.13:19
*** jamesdenton has joined #openstack-nova13:20
openstackgerritChris Dent proposed openstack/nova: [placement] add a placement_aggregates table to api_db  https://review.openstack.org/36286313:20
openstackgerritClaudiu Belu proposed openstack/nova: Adds Hyper-V OVS ViF driver  https://review.openstack.org/14004513:21
johnthetubaguyalex_xu: I just think the log message is bad, and we should add a comment why we don't error out there13:22
johnthetubaguyalex_xu: passing down the migrate object would be a much better idea log term, maybe we could add that as a TODO?13:22
johnthetubaguyalex_xu: my worry was really the save_and_reraise_exception decorator13:23
*** bdeschenes has joined #openstack-nova13:23
*** GB21 has joined #openstack-nova13:23
*** daemontool has quit IRC13:25
openstackgerritAline Bousquet proposed openstack/nova-specs: Spec for supporting authentication methods based on image metadata  https://review.openstack.org/32607313:26
*** daemontool has joined #openstack-nova13:27
*** mriedem has joined #openstack-nova13:30
*** mmedvede_ has joined #openstack-nova13:30
*** dakhmetov has quit IRC13:30
*** dinobot_ has joined #openstack-nova13:30
*** mmedvede has quit IRC13:30
*** mmedvede_ has quit IRC13:30
*** dinobot_ is now known as dakhmetov13:30
mriedemis danpb out?13:30
*** luis5tb has joined #openstack-nova13:31
*** EinstCrazy has quit IRC13:31
*** dakhmetov is now known as dinobot_13:31
*** dinobot_ is now known as dakhmetov13:31
*** su_zhang has joined #openstack-nova13:31
mriedemmoshele: are you aware of any changes in os-vif that need to be released for newton?13:31
mriedemanything needed for a pending feature?13:32
mriedemsahid: russellb: ^13:32
*** pwnall has joined #openstack-nova13:32
mriedemhttps://review.openstack.org/#/q/project:openstack/os-vif+status:open13:32
*** sbezverk has joined #openstack-nova13:33
mriedemlike maybe https://review.openstack.org/#/c/344433/13:33
*** abhishekk has joined #openstack-nova13:33
mriedemi'm asking b/c the final release for os-vif in newton was supposed to be last week and the release team wants to cut the stable/newton branch13:34
*** lixiaoy1 has quit IRC13:34
alex_xujohnthetubaguy: yea, agree with a TODO13:34
*** tbachman has joined #openstack-nova13:36
cdentsdague: could you help me with something? This failure should only happen if placement_database.connection is not None. Is something strange about CONF in that environment: http://logs.openstack.org/66/362766/1/check/gate-nova-python27-db-ubuntu-xenial/e4aa915/console.html#_2016-08-30_10_44_42_866978 on https://review.openstack.org/#/c/362766/13:38
*** markvoelker has joined #openstack-nova13:40
*** pwnall has quit IRC13:40
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526313:40
*** pwnall has joined #openstack-nova13:40
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799313:41
*** tbachman has quit IRC13:41
*** mmedvede has joined #openstack-nova13:41
*** ManishD has joined #openstack-nova13:42
mriedemcdent: my guess would be the issue is in https://review.openstack.org/#/c/362766/1/nova/db/sqlalchemy/migration.py@17713:42
mriedemthe api migrations are being run twice13:42
mriedemonce for the api db and once for the placement db13:42
openstackgerritClaudiu Belu proposed openstack/os-vif: Adds NoopPlugin  https://review.openstack.org/36287613:43
openstackgerritBalazs Gibizer proposed openstack/nova: Removed enum duplication from nova.compute  https://review.openstack.org/33506613:43
cdentmriedem: yeah, but why would the test fail on that job but not locally?13:43
cdent(with just tox -epy27 <the test> ?)13:44
cdentmriedem: and whatever is happening how to fix it? :)13:45
*** mgoddard_ has joined #openstack-nova13:45
*** markvoelker has quit IRC13:45
mriedemgood question13:46
* cdent does a full run13:46
*** annegentle has quit IRC13:46
*** hoangcx2 has quit IRC13:47
*** burt has joined #openstack-nova13:48
*** zz_dimtruck is now known as dimtruck13:48
*** mgoddard has quit IRC13:48
*** thorst_ is now known as thorst13:48
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/35879713:49
openstackgerritSean Dague proposed openstack/nova: WIP: Totally hacky happy path for placement API working.  https://review.openstack.org/36288313:49
sdaguemriedem: ok, so I basically didn't change jay's patch, though there is a rebase in there I guess13:49
moshelemriedem: I am not aware, but I wasn't much involved in the os-vif, so it better to ask danpb13:49
tdurakovcdent: I'd try to clear .tox/py27 for example13:49
*** daemontool has quit IRC13:49
sdagueI was working on top of his patch to get some things working, and the happy path looks ok13:49
mriedemmoshele: danpb appears to be out13:49
mriedemmoshele: hence me pinging the entire os-vif core team13:50
sdagueI actually got REST talking to placement API without horrible errors13:50
*** daemontool has joined #openstack-nova13:50
tdurakovpaul-carlton2 eliqiao shaohe_feng pkoniszewski jlanoux yuntongjin mdbooth kashyap kmartin claudiub tobasco tdurakov andreas_s abhishekk mrhillsman raj_singh live-migration subteam meeting in 10 inutes on #openstack-meeting-313:51
sdaguemriedem/cdent: I'm going to step away from computer for a bit and go for a bike ride while the weather is nice, and will dig back into this once I get back13:51
kashyaptdurakov: Back from long travel, and not feeling quite productive yet, I'll just lurk :-)13:51
tdurakovkashyap: sure no worries13:51
cdentsdague: that's cool, my battery is dead so I need to go home, and will try to get the loose ends together from there13:52
*** takedakn has joined #openstack-nova13:52
* cdent waves13:52
*** cdent has quit IRC13:52
sdaguecdent: cool. The placement api doesn't seem to be logging much13:52
sdagueI wonder if the wrong log file is being followed in devstack13:52
*** ayoung has joined #openstack-nova13:52
sdagueor if there is something else that needs configuration13:52
openstackgerritAndrey Volkov proposed openstack/nova: WIP Map instances to cell0 on failed schedule  https://review.openstack.org/26782713:52
sdaguebut I can look later13:52
*** ducttape_ has joined #openstack-nova13:52
*** gouthamr_ is now known as gouthamr13:53
*** liverpooler has quit IRC13:53
johnthetubaguycdent: when you get back on, this might be an issue, but I am not totally sure: https://review.openstack.org/#/c/362766/1/nova/db/sqlalchemy/api.py@13313:54
openstackgerritviswesuwara nathan proposed openstack/python-novaclient: Fix incorrect output of "nova show" for long user data  https://review.openstack.org/36230313:54
*** anush__ has joined #openstack-nova13:56
*** yamahata has joined #openstack-nova13:57
*** takedakn has quit IRC13:57
openstackgerritAndrey Volkov proposed openstack/nova: WIP Map instances to cell0 on failed schedule  https://review.openstack.org/26782713:59
*** ratailor has quit IRC13:59
*** zzzeek has quit IRC14:00
*** sbezverk has quit IRC14:01
*** rmcall_ has joined #openstack-nova14:01
*** jdillaman has joined #openstack-nova14:02
*** eharney has joined #openstack-nova14:02
*** annegentle has joined #openstack-nova14:03
*** su_zhang has quit IRC14:03
*** rmcall has quit IRC14:03
*** rmcall_ is now known as rmcall14:03
*** zzzeek has joined #openstack-nova14:03
*** su_zhang has joined #openstack-nova14:04
*** dimtruck is now known as zz_dimtruck14:04
*** zzzeek has quit IRC14:04
*** zzzeek has joined #openstack-nova14:05
*** lixiaoy1 has joined #openstack-nova14:06
*** browne has joined #openstack-nova14:07
cmartinmarkus_z: Hey I was told to talk to you about an issue with a nova bug14:07
*** rama_y has joined #openstack-nova14:08
*** sdake has joined #openstack-nova14:08
markus_zcmartin: sure, which one?14:08
*** su_zhang has quit IRC14:08
cmartinmarkus_z: It's this one https://bugs.launchpad.net/nova/+bug/1587108 I had a few questions because I am trying to figure out how to proceed14:09
openstackLaunchpad bug 1587108 in OpenStack Compute (nova) "Booting an instance from snapshot (which is an instance booted from Cinder volume) fails with: "Volume is smaller than the minimum size specified in image metadata."" [Medium,In progress] - Assigned to Chris Martin (cm876n)14:09
*** cleong has joined #openstack-nova14:09
* markus_z is reading the bug14:10
*** sbezverk has joined #openstack-nova14:10
johnthetubaguycmartin: that looks like the correct behaviour14:11
johnthetubaguybut that means I must be missing something14:11
johnthetubaguyif the disk is bigger than the volume, you can't boot it14:11
*** garyk1 has quit IRC14:11
*** ljxiash has joined #openstack-nova14:11
*** sdake_ has joined #openstack-nova14:12
*** bdeschenes has quit IRC14:12
*** sdake has quit IRC14:13
cmartinjohnthetubaguy: Well here is what happens, the flavor size is 3, the volume size is 1, it lets you boot the intial instance but not the snapshot, because the exception that catches if the Volume is Larger than the disk passes when creating the initial instance because the size is 1, min_disk is 0 UNTIL the root_gb from the flavor is used to set the min_disk which is after the exception, which is why when you take a snapshot and reboot now the14:13
cmartinexception catches it14:13
cmartinjohnthetubaguy: In this case I was using a volume of size 1 and flavor of disk size 314:14
markus_zYeah, I would honestly expect that both cases fail or succeed14:14
cmartinYeah exactly14:14
johnthetubaguycmartin: so the initial is allowed14:14
johnthetubaguythis boils down to when we take the snapshot, we set the wrong min_disk value14:14
cmartinNo the min_disk is set in the initial instance14:14
cmartinit is just set after the exception check14:15
johnthetubaguywe take it from the flavor, but in the BFV case, it needs to come from the volume14:15
cmartinAnd yes the min_disk is taken from the flavor14:15
*** roeyc has quit IRC14:15
johnthetubaguyright, thats the bug here, when BFV, the min_disk should be set from the size of the boot disk, not the flavor14:15
cmartinYea that's right14:15
johnthetubaguymelwitt has a similar patch up to look at things around the resource tracker and BFV14:17
cmartincan you link it to me and i'll take a look14:17
johnthetubaguyI don't have a link to that handy though14:17
*** pwnall has quit IRC14:17
cmartinoh I'll look it up then14:17
*** prateek has quit IRC14:17
johnthetubaguycmartin: I think this is it: https://review.openstack.org/35509114:21
cmartinjohnthetubaguy: yea I am looking at it right now14:21
johnthetubaguycool14:21
cmartinIt does seem to be trying to fix the overall larger problem14:21
*** roeyc has joined #openstack-nova14:22
cmartinBut I'm not completely sure since most of my bug tracking has been done in nova/nova/compute/api.py and her patch doesn't touch those files14:22
*** rlrossit has quit IRC14:23
*** zz_dimtruck is now known as dimtruck14:23
johnthetubaguycmartin: it will not fix your bug, AFAIK, but yeah, it fixes related issues14:25
johnthetubaguycmartin: I just think the fix should follow in those footsteps14:25
*** raunak has joined #openstack-nova14:26
cmartinjohnthetubaguy: alright thanks I'm still a pretty new contributor so I was just trying to figure out how to move forward and this helps14:26
*** rlrossit has joined #openstack-nova14:26
johnthetubaguycmartin: no problem, happy to try and help14:27
*** mriedem has quit IRC14:27
*** mriedem has joined #openstack-nova14:28
*** daemontool has quit IRC14:28
*** daemontool has joined #openstack-nova14:28
*** marst has quit IRC14:29
*** mamandle has quit IRC14:29
*** pbandark has quit IRC14:31
*** mgoddard_ has quit IRC14:32
*** mgoddard has joined #openstack-nova14:32
kashyapjohnthetubaguy: cmartin: What is "BFV" here?  -- https://bugs.launchpad.net/nova/+bug/1587108/comments/514:33
openstackLaunchpad bug 1587108 in OpenStack Compute (nova) "Booting an instance from snapshot (which is an instance booted from Cinder volume) fails with: "Volume is smaller than the minimum size specified in image metadata."" [Medium,In progress] - Assigned to Chris Martin (cm876n)14:33
bhagyashrivek: Hi, could you please review https://review.openstack.org/#/c/346026/ ?14:33
johnthetubaguykashyap: boot from volume14:33
*** ociuhandu has joined #openstack-nova14:33
johnthetubaguykashyap: at least thats what I meant14:33
kashyapjohnthetubaguy: Err, okay, my brain is in hibernate mode14:33
johnthetubaguykashyap: no worries14:34
*** su_zhang has joined #openstack-nova14:34
*** dikonoor has joined #openstack-nova14:34
*** woodster_ has joined #openstack-nova14:34
*** pwnall has joined #openstack-nova14:35
*** sudswas__ has quit IRC14:35
*** sudipto has quit IRC14:35
*** oanson has quit IRC14:36
mriedemso to run the placement db migrations we do it via the nova-manage api_db sync command? https://review.openstack.org/#/c/342362/10/lib/placement@15614:36
mriedemthat seems weird14:36
*** su_zhang has quit IRC14:36
dansmithmriedem: there are no placement db migrations14:36
*** nkrinner has quit IRC14:36
bauzasmriedem: yup, that's what we agreed14:36
dansmithmriedem: there are only api migrations, and we shouldn't have to run the db sync twice14:37
bauzasmriedem: no clear outstanding placement db14:37
*** su_zhang has joined #openstack-nova14:37
*** kaisers_ has joined #openstack-nova14:37
bauzasdansmith: mriedem: I was reviewing cdent's patch https://review.openstack.org/#/c/362766/14:37
*** tonytan_brb has joined #openstack-nova14:37
bauzasdansmith: mriedem: I actually wonder if we should provide a separate contextmanager for the placement DB14:38
dansmithyou mean for in the db_api?14:38
dansmithplacement.writer?14:38
*** nkrinner has joined #openstack-nova14:39
bauzasdansmith: I mean https://review.openstack.org/#/c/362766/1/nova/objects/resource_provider.py14:39
bauzasI was thinking we were not yet using a separate engine facade, just using the same as for the API DB14:40
*** marst has joined #openstack-nova14:40
bauzasand just help operators to sync a new DB if really needed14:40
*** tonytan4ever has quit IRC14:40
bauzasbut I could be wrong14:40
dansmithbauzas: we have to have a new context manger to honor the alternate connection url for people that want to pre-split, right?14:40
*** su_zhang has quit IRC14:41
*** ekuris has quit IRC14:41
*** prateek has joined #openstack-nova14:42
*** tonytan_brb has quit IRC14:42
*** daemontool has quit IRC14:42
kashyapDoes anyone know top off their heads: if it's possible to change an existing flavour's public / private visibility setting to 'projects' (tenants)?14:42
*** tonytan4ever has joined #openstack-nova14:42
mriedemdansmith: bauzas: see the devstack change from cdent above14:43
*** david-lyle has quit IRC14:43
kashyap(I realize I could create a new flavour and decide about its visibility)14:43
openstackgerritTimofey Durakov proposed openstack/nova: do not merge  https://review.openstack.org/36292214:43
mriedemhe has an optional flag to create the placement db and run schema migrations on it14:43
bauzasdansmith: well, indeed, we could need a separate connection string14:44
bauzasokay14:44
dansmithmriedem: right, so if we want a split one, then you run api sync against a new database and point to that with the placement connection url14:44
*** jaosorior is now known as jaosorior_away14:45
*** diogogmt has joined #openstack-nova14:45
*** raunak has quit IRC14:45
*** nkrinner has quit IRC14:46
*** sdake_ has quit IRC14:47
*** lixiaoy1 has quit IRC14:48
*** david-lyle has joined #openstack-nova14:48
johnthetubaguywith the current patch you only need to run the api sync once, buts thats OK for now maybe14:48
*** lixiaoy1 has joined #openstack-nova14:48
mriedemrunning nova-manage api_db sync twice shouldn't hurt, if you ran it the first time it will have the api db migrations at the latest version and is a noop14:49
mriedemand will then pick up the placement db migrations14:49
johnthetubaguyyup yup14:49
openstackgerritLucian Petrut proposed openstack/nova: Hyper-V: fix image handling when shared storage is being used  https://review.openstack.org/34743714:49
dansmithsure, I meant that you don't have to run it twice against two databases14:50
melwittdansmith: I just commented on the mq switching patch. it's failing on the new side of grenade because the transport url for the cell mapping is missing the rabbit userid. I'm not yet sure how that is happening from the simple cell setup for grenade14:51
*** lixiaoy1 has quit IRC14:52
dansmithmelwitt: okay I saw your comment.. do you need help or were you just explaining why the debug is still there?14:52
openstackgerritMaciej Szankin proposed openstack/nova: WIP conf opt: added check for help msg line lenght  https://review.openstack.org/36245414:52
*** roeyc has quit IRC14:52
*** jlanoux has quit IRC14:53
openstackgerritOpenStack Proposal Bot proposed openstack/python-novaclient: Updated from global requirements  https://review.openstack.org/36259514:53
melwittdansmith: might need help. I'm going to start trying to find why the rabbit userid isn't being set in grenade14:54
*** ManishD has quit IRC14:54
*** tbachman has joined #openstack-nova14:54
kashyapOkay, disregard me above -- for my question, `nova flavour-access-add` should help14:54
*** ManishD has joined #openstack-nova14:54
melwittdansmith: or the rabbit userid variable. I'm not sure how this is happening yet14:54
dansmithmelwitt: so this would be that we're doing the cell setup in grenade but passing an empty user, and you're fetching that broken thing out of the db...14:55
dansmithI'm just using the get_transport_url thing from devstack14:55
dansmithmaybe I need to source something else to make that whole14:55
dansmithsdague: ^14:55
openstackgerritMaciej Szankin proposed openstack/nova: WIP conf opt: added check for help msg line lenght  https://review.openstack.org/36245414:55
melwittdansmith: oh, passing empty user deliberately? because the rest of the data is there in the transport_url correctly. it pulls them from devstack variables14:56
dansmithmelwitt: no not intentionally,14:56
*** jlanoux has joined #openstack-nova14:56
melwittit should have Just Worked(tm) I thought. because it's just stuff that ends up being written to nova.conf anyhow14:56
dansmithbut if I haven't sourced something that actually defaults the rabbit userid or something, then this would happen I think14:56
*** cdent has joined #openstack-nova14:56
melwittoh, gotcha14:56
dansmithyeah, it's defaulted in stack.sh,14:57
dansmithwhich we don't run14:57
dansmithin grenade14:57
melwitta-ha14:57
dansmithlet me hack something up to test14:57
melwittI also noticed grenade is using the old school deprecated rpc backend variables. not critical but something we'll need to change later14:57
melwitt(in nova.conf)14:58
dansmithmelwitt: depends-on this and try again: https://review.openstack.org/36293614:59
melwittdansmith: k, thanks14:59
*** nkrinner has joined #openstack-nova14:59
*** amotoki has quit IRC15:01
*** mingyu has joined #openstack-nova15:01
*** david-lyle has quit IRC15:02
openstackgerritmelanie witt proposed openstack/nova: Move cell message queue switching and add caching  https://review.openstack.org/32690615:02
cdentsdague: on [t 38wp]. Yeah, I was never too clear on what the requirements were there so have been assuming since it has never come up in review that the web log was sufficient. Certainly possible to add more. In a not-quite-related thing there's a pending WIP for starting notifications from resource provider objects.15:02
purplerbot<sdague> cdent: cool. The placement api doesn't seem to be logging much [2016-08-30 13:52:22] [n 38wp]15:02
*** moshele has quit IRC15:03
dansmithmelwitt: I think this is the actual proper fix: https://review.openstack.org/36294115:05
dansmithunless sdague knows a better way15:05
*** diogogmt has quit IRC15:06
*** mingyu has quit IRC15:06
bauzasmelwitt: FWIW, I'm currently rebasing https://review.openstack.org/35509115:06
*** tbachman has quit IRC15:06
melwittdansmith: okay, cool15:06
bauzasmelwitt: I had a question tho, about why we shouldn't update the original instance15:06
bauzasany reason I missed ?15:06
melwittbauzas: I was just about to reply on that one. I think there's still one last problem with it in that resize is still saving instances with root_gb = 0 in the db15:06
*** coolsvap is now known as coolsvap_15:07
*** mjura_ has quit IRC15:07
bauzasmelwitt: but if an instance is BFV, then it would still be root_gb=0 even when moving ?15:07
melwittbauzas: oh, and make a copy? to avoid the possibility of the instance getting saved to the db with a modified flavor15:07
*** tonytan_brb has joined #openstack-nova15:07
*** diogogmt has joined #openstack-nova15:08
ducttape_question about default policy in nova - novaclient(request).quotas.get(tenant_id, detail=True) causes failures for _member_ type users (detail=False works).   this seems like a strange default, since I can find all the details via making the 35 other api calls to get this info.  is there a reason for this ?15:09
*** sdake has joined #openstack-nova15:09
*** armax has joined #openstack-nova15:09
melwittbauzas: yeah we want it to be considered as root_gb=0 for calculations for moving it, but we were trying to make sure it doesn't get persisted that way. and currently it is being persisted with root_gb=0 in the resize case, abhishekk noticed15:10
*** rmart04 has quit IRC15:10
melwittI had been meaning to figure out how to avoid that but hadn't gotten to it yet15:10
dansmithOR, we don't try to hack this up in the face of the real solution.. :)15:11
*** tbachman has joined #openstack-nova15:11
*** tonytan4ever has quit IRC15:11
*** nkrinner is now known as nkrinner_afk15:11
*** xwizard has quit IRC15:13
*** tbachman_ has joined #openstack-nova15:15
*** praneshp has joined #openstack-nova15:15
bauzasmelwitt: sorry, otp15:16
*** tbachman has quit IRC15:17
*** tbachman_ is now known as tbachman15:17
bauzasmelwitt: so, just to make it sure, take one BFV instance, and then moving it15:18
*** sudswas__ has joined #openstack-nova15:18
*** sudipto has joined #openstack-nova15:18
*** zzzeek has quit IRC15:19
*** kaisers_ has quit IRC15:19
mriedemsdague: looks like the re-enabled auto-allocate tempest tests are still ok http://status.openstack.org//elastic-recheck/index.html#161649815:20
mriedemthe blip there is a single change failing in the check queue15:21
mriedemso probably a broken change15:21
*** abalutoiu has quit IRC15:21
mriedemsdague: so can we get https://review.openstack.org/#/c/353018/ approved so i can release 6.0.0 today or tomorrow15:21
sdaguemriedem: yes15:22
*** david-lyle has joined #openstack-nova15:22
*** pwnall has quit IRC15:22
melwittbauzas: yeah, resize/move one BFV instance. when considering the root_gb want to consider it as 015:23
openstackgerritAnusha Unnam proposed openstack/nova: Add a new release note  https://review.openstack.org/36244815:23
*** mdrabe has quit IRC15:23
openstackgerritChris Dent proposed openstack/nova: Optional separate database for placement API  https://review.openstack.org/36276615:23
sdaguedansmith: that d-g change is probably fine15:23
*** mdrabe has joined #openstack-nova15:24
dansmithsdague: cool, thanks15:24
*** sridharg has quit IRC15:24
sdaguemriedem: +A15:24
dansmithsdague: the grenade canary will let melwitt prove that it fixes the problem and then if we can land the d-g fix, we can drop the grenade one15:25
sdagueok, is there any sign of the follow on jaypipes patches for other things the placement api should do?15:25
*** mingyu has joined #openstack-nova15:26
dansmithhe's not around I guess?15:26
*** artom has quit IRC15:27
mriedemi didn't get a reply to my email15:27
dansmithno reply from him overnight, which isn't a good sign15:27
*** links has quit IRC15:28
*** kaisers_ has joined #openstack-nova15:29
openstackgerritChris Dent proposed openstack/nova: [placement] add a placement_aggregates table to api_db  https://review.openstack.org/36286315:30
openstackgerritChris Dent proposed openstack/nova: Add {get_,set_}aggregates to objects.ResourceProvider  https://review.openstack.org/35526315:30
*** sdake has quit IRC15:31
openstackgerritChris Dent proposed openstack/nova: Implement get and set aggregates in the placement API  https://review.openstack.org/35799315:31
*** Jeffrey4l_ has quit IRC15:32
*** andreas_s has quit IRC15:33
*** TravT has quit IRC15:34
sdaguecdent: do you know what the follow on reporting patches would look like?15:37
dansmithcdent: we had a discussion yesterday about the missing reporting functionality that we expect jay has in a queue15:37
dansmithcdent: do you know that those are done and just not submitted or do you think they still need writing?15:37
dansmithsdague: heh, jinx15:38
*** rama_y has quit IRC15:38
*** TravT has joined #openstack-nova15:38
dansmithcdent: i.e. reporting allocations and inventory from the RT through the reporting client... because the patch up that we all thought did that only creates resource providers15:39
*** zzzeek has joined #openstack-nova15:40
cdentdansmith, sdague: I'm sorry to say that I don't know. Jay's currently as unavailable to me as he is to you15:40
*** salv-orlando has joined #openstack-nova15:40
dansmithyeah, but I was hoping you'd have more context about the big picture here15:40
*** david-lyle has quit IRC15:40
*** pwnall has joined #openstack-nova15:41
*** ManishD has quit IRC15:41
*** zzzeek has quit IRC15:41
sdagueright, I can get the current patch he has into merge state, however, it seems we need some other stuff to hit the finish line, and I definitely don't have context on what additional reporting should be in there15:42
dansmithwe need to be reporting compute node inventories15:42
cdentdansmith: I bet I was hoping for that more...15:42
dansmithand instance allocations15:42
*** unicell has quit IRC15:42
cdentin broad strokes what I understood was that instead of using the get_inventory stuff that he added in one of his branches he was going to do things raw in one of the existing methods and then change it over later. I don't know if some/none/all of that is done.15:43
*** zzzeek has joined #openstack-nova15:43
cdentWriting allocations to the api is currently not possible because although the api code is written, the object code is not, Jay said he was working on that but I've seen no concrete evidence15:43
*** paul-carlton2 has quit IRC15:44
cdentI have a pretty good picture of how that object code is supposed to work though if a) someone wants to do or b) I should go ahead and do it15:44
dansmithum, what?15:44
dansmiththere's not full API support for allocations?15:44
dansmiththat's pretty much going to kill our ocata plans15:44
*** klkumar has quit IRC15:44
cdentthere's been pending api code for allocations for plural weeks but jay's been saying he's going to write the object code to wire it up15:45
cdentAllocationList.{create,delete}_all()15:45
cdentwas the plan, as I recall15:45
*** cfriesen has quit IRC15:45
* dansmith headdesks15:46
sdaguecould we do a hangout in 15 minutes to figure out where we stand, and what's reasonable for this week. Because I'm happy to have this be my week, if it means we get to a useful place. But if we can't get there, there are other things to go poke at.15:46
* tbachman hands dansmith a headdesk cushion15:46
dansmithsdague: yeah15:46
*** derekh has quit IRC15:46
cdentdansmith: a) there's not _that_ much to do on the api side for allocations b) I feel like I've been meekly waving my hands about this for a long time so please let me know what I need to do be less meek next time15:46
cdentc) happy to do a hangout whenever15:47
dansmithcdent: there's also not that much time left to get this done...15:47
cdentdansmith: yes, I know15:48
*** lpetrut has quit IRC15:48
*** unicell has joined #openstack-nova15:50
*** david-lyle has joined #openstack-nova15:50
cdentsdague, dansmith say top of the hour for the hangout?15:50
dansmithwfm15:51
*** markus_z has quit IRC15:51
*** jlanoux has quit IRC15:52
*** ihrachys has quit IRC15:54
*** ducttape_ has quit IRC15:55
*** ducttape_ has joined #openstack-nova15:56
*** vishwanathj_zzz is now known as vishwanathj15:56
*** artom has joined #openstack-nova15:56
*** Sukhdev has joined #openstack-nova15:58
cdentsdague, dansmith, edleafe give this a try: https://hangouts.google.com/call/ikfdxn75dfbf7masd3rknl5ndye15:59
*** Hieu has joined #openstack-nova16:00
*** abalutoiu has joined #openstack-nova16:01
*** tbachman has quit IRC16:01
auggygood morning nova!16:02
*** devananda is now known as devananda|MOVING16:04
*** nic has joined #openstack-nova16:04
*** mriedem1 has joined #openstack-nova16:04
bauzascdent: dansmith: edleafe: sdague: I need to bail out :/16:05
*** moshele has joined #openstack-nova16:05
*** mriedem has quit IRC16:06
sfinucanmoshele: Sorry for missing the sriov meeting again today16:06
sfinucanI've been using Fedora since my move to Red Hat, and I only just figured out how to enable Outlook-like notifications in Evolution. Shan't happen again16:06
mriedem1cdent: we end here? https://review.openstack.org/#/c/339874/16:06
*** mriedem1 is now known as mriedem16:07
sfinucanI'll review the logs now16:07
moshelesfinucan: np :)16:07
sdaguemriedem: https://etherpad.openstack.org/p/placement-next16:08
*** klkumar has joined #openstack-nova16:10
*** ljxiash has quit IRC16:13
*** raunak has joined #openstack-nova16:15
*** ociuhandu has quit IRC16:15
*** armax has quit IRC16:16
*** sudswas__ has quit IRC16:16
*** sudipto has quit IRC16:16
*** tonytan_brb has quit IRC16:17
*** matrohon has quit IRC16:19
mriedemthe good news is devstack is at least standing up with the latest devstack placement service change16:19
mriedemhttp://logs.openstack.org/41/362441/1/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/669af17/logs/apache/placement-api.txt.gz16:20
*** lpetrut has joined #openstack-nova16:20
*** david-lyle has quit IRC16:21
mriedemjust updated the d-g change to point at sean's hack on top of jay's change16:22
*** david-lyle has joined #openstack-nova16:23
cdentedleafe: are you savvy to this logging change that sdague says needs to happen?16:23
edleafecdent: no, not really16:24
cdentdo you want to become so? :)16:24
sdagueit's this, about wsgi requests - https://specs.openstack.org/openstack/openstack-specs/specs/log-guidelines.html#specific-event-types16:26
mriedemcdent: edleafe: https://github.com/openstack/keystone/blob/master/httpd/wsgi-keystone.conf16:26
mriedemCustomLog /var/log/apache2/keystone_access.log combined16:26
cdentmriedem: so yeah, placement is already logging via apache, and sdague says that does't have enough info16:26
cdent(and maybe is not going somewhere good enough_16:26
mriedemwell, we don't have anything hitting that api yet, at least not in those d-g results i have up16:27
cdentdansmith: I'm going to send some "oh hey, jay, we made this etherpad, just so you know" email. Unless you want that gig.16:27
dansmithcdent: all yours16:27
cdentdansmith: ✔16:27
*** kaisers_ has quit IRC16:28
dansmithcdent: so placement has no api samples which makes it kinda hard to know exactly what to look for16:28
dansmithcdent: and there is no api-ref stuff for placement right?16:28
dansmithit something else being generated I can look at?16:28
cdentdansmith: what do you mean by "look for"? What do you want to see?16:28
*** moshele has quit IRC16:29
mriedemsample api requests16:29
*** Swami has joined #openstack-nova16:29
mriedemlike the api samples in nova's functional test tree and docs16:29
mriedemdoes gabbi provide that?16:29
dansmithcdent: s/know what to look for/know what to PUT/16:29
dansmithright, what mriedem said16:29
edleafesdague: so is something like this what's needed to set up oslo logging? https://github.com/openstack/nova/blob/master/nova/wsgi/nova-api.py#L3316:29
sdagueedleafe: well, at the end of the day we want lines like this in the keystone log - http://logs.openstack.org/61/360761/1/check/gate-grenade-dsvm-neutron-ubuntu-trusty/08cb274/logs/apache/keystone.txt.gz#_2016-08-25_20_28_31_19616:30
cdentah, okay: either here https://github.com/openstack/nova/tree/master/nova/tests/functional/api/openstack/placement/gabbits or http://specs.openstack.org/openstack/nova-specs/specs/newton/approved/generic-resource-pools.html#rest-api-impact16:30
sdagueespecially because they contain request-id and context info16:30
*** tbachman has joined #openstack-nova16:30
dansmithyeah, I guess the gabbits are readable if you eye-parse out the data bits16:31
cdentdansmith: the gabbits show it in yaml, the spec shows it in json strings16:31
*** unicell has quit IRC16:31
cdentdansmith: there's a yaml file that I used to exercise the devstack set up here, which is very plain: https://gist.github.com/cdent/a9590764fbc7402d450fa36df14f35e016:32
*** nic has quit IRC16:33
openstackgerritSean Dague proposed openstack/nova: Make api-ref bug link point to nova  https://review.openstack.org/36217016:33
*** code-R_ has quit IRC16:34
*** david-lyle_ has joined #openstack-nova16:36
*** trisq has quit IRC16:37
sdagueedleafe: are you looking into logging?16:38
*** mamandle has joined #openstack-nova16:38
*** Sukhdev has quit IRC16:39
edleafesdague: yes, but I'm not sure how to enable it. You mentioned middleware, but I don't see any16:39
*** yamahata has quit IRC16:39
sdagueno, I don't think there is any middleware16:39
*** david-lyle has quit IRC16:39
sdagueI think it's just about putting the request logging in there16:39
edleafesdague: maybe that's why I didn't find it :)16:39
edleafesdague: so just import logging from oslo?16:39
*** zenoway has quit IRC16:40
sdaguewell, to start, but I assume that's already there. The important thing is to actually log requests. Also, errors. My current stack has 500 errors, and I have no idea why (probably auth issue)16:40
sdaguethere are zero things in the placement-api.log16:40
*** zenoway has joined #openstack-nova16:41
cdentsdague: one sec16:41
sdaguewell, not quite zero things - http://paste.openstack.org/show/564859/ :)16:41
edleafesdague: ok, digging16:41
dansmithcdent: hmm, we can't post multiple inventories in one go?16:41
cdentdansmith: you can16:42
cdentthat was added later16:42
lbeliveauI raised a new jira on bugs.launchpad.net, proposed a fix with "Closes-bug:", but the review is not getting logged in the bug, anybody knows how to fix this ?16:42
cdentPUT /resource_providers/{uuid}/inventories16:42
dansmithcdent: https://github.com/openstack/nova/blob/master/nova/tests/functional/api/openstack/placement/gabbits/inventory.yaml#L254 ?16:42
dansmithokay good16:42
dansmith(whew)16:42
cdentyeah that one16:42
cdentsdague: have you looked to be sure that apache isn't putting it somewhere else? I ask because the site-templates are weird and the weirdness has been telephone gamed from project to project as they have mod-wsgi'd themselves16:44
*** zenoway has quit IRC16:45
melwittlbeliveau: it will only update the bug on PS1 so if you added Closes-Bug later than that, you have to go comment and add a link manually for the review in progress. upon merge, the bug will be updated automatically to close it16:45
cdentit could be that 500s in the auth middleware are not being properly trapped16:45
cdentsdague: ^ . In fact that is fairly likely.16:45
sdagueright16:45
sdagueso, my guess, we should have a LOG.info here - https://github.com/openstack/nova/blob/bc344458e7603886509a5a80ca7dca628b203c93/nova/api/openstack/placement/handler.py#L145 for success, and log the failures as well in a blanket except handler16:46
lbeliveaumelwitt: thanks, usually it was just working for me (meaning didn't needed to manual link the review)16:46
edleafesdague: yeah, that's where I was looking16:46
cdentsdague: so one option would be a derivation of the faultwrap middleware as the outer most piece of middleware that traps all thigns16:46
edleafesdague: also the webob exceptions16:47
cdentsdague, edleafe that wouldn't be the best place for it, as that's inside the stack of the middleware16:47
melwittlbeliveau: it should work automatic if you had the Closes-Bug in the commit message on the first revision of the patch16:47
cdentyou want something that is outermost16:47
cdentso something that is added in deploy.py16:47
*** Oku_OS is now known as Oku_OS-away16:47
cdentdoing it at the linked line will only catch errors in the placment handlers, and nothing to do with any of the middlewares16:48
edleafecdent: don't those middlewares already log their errors?16:48
sdagueso FaultWrapper is fine for the 500 case16:48
cdentedleafe: I'm guess not if sdague is having untrapped 500s16:48
*** devkulkarni has joined #openstack-nova16:49
sdagueedleafe: no, a lot of stuff rolls into FaultWrapper iirc.16:49
*** mamandle has quit IRC16:49
sdaguebecause that's the thing that catches random exceptions16:49
*** liverpooler has joined #openstack-nova16:50
*** fragatina has joined #openstack-nova16:50
sdagueedleafe: so I think there are 2 things. Integrate FaultWrapper (I think as is), then handle the non fault cases as well16:50
dansmithcdent: I see no gabbits that validate/expose the resource provider's generation field, only ones that pass it during inventory CRUD16:51
*** fragatin_ has joined #openstack-nova16:51
*** mingyu has quit IRC16:51
*** jaosorior_away has quit IRC16:51
cdentdansmith: what do you mean by validate?16:51
cdentthis one tries with a bad one and fails: https://github.com/openstack/nova/blob/master/nova/tests/functional/api/openstack/placement/gabbits/inventory.yaml#L28316:52
*** rlrossit has quit IRC16:52
dansmithcdent: check that it's returned? I just want to know what key from the result to use, and I don't see any gabbits that use it16:52
dansmithcdent: that's putting it during inventory create16:52
*** diogogmt has quit IRC16:52
dansmithcdent: the client has to know what the current generation is though16:52
dansmithcdent: surely it's something inside of the actual GET /resource_providers/uuid or something right?16:52
*** pradk has quit IRC16:53
*** pradk- has joined #openstack-nova16:53
cdentdansmith: when you get a resource provider it comes with a 'generation' field: https://github.com/openstack/nova/blob/master/nova/tests/functional/api/openstack/placement/gabbits/resource-provider.yaml#L6916:53
dansmithcdent: that's what I was looking for, yeah, thanks16:54
*** fragatina has quit IRC16:55
cdentsdague: so to restate what your'e after, just to be clear: 1) trap and log (at the outermost middleware layer) uncaught exceptions that are of the 500 variety, which can be done like FaultWrapper 2) at the PlacementHandler layer log, but reraise, exceptions which are <500 status. Is that in the realm of correct?16:56
dansmithsdague: that caching of the rp in the base patch you're working on will not work for us, unless the scheduler client is recreated each time16:56
dansmithcaching the generation will not work16:56
sdaguedansmith: ok, explain16:56
dansmithsdague: I guess we just go forward with what is there for the moment, but it'll break16:56
dansmithsdague: we pull the generation once at create and if we're ever out of sync, we'll die16:57
sdaguewhat is the issue with a long standing keystone token?16:57
*** erlon has quit IRC16:57
*** unicell has joined #openstack-nova16:57
*** lucasagomes is now known as lucas-dinner16:58
sdaguedansmith: can you point me at the bit of code that does that?16:58
dansmithsdague: https://review.openstack.org/#/c/362883/1/nova/scheduler/client/report.py@16916:59
dansmithsdague: I guess we can just invalidate the cache if and when we get a failed update so I'll just handle it downstream of you16:59
*** devkulkarni has quit IRC17:00
*** sdague has quit IRC17:00
*** Hieu has quit IRC17:01
openstackgerritChris Dent proposed openstack/nova: [placement] remove a comment that is no longer a todo  https://review.openstack.org/36303917:01
*** rama_y has joined #openstack-nova17:01
cdentbiab17:01
*** cdent has quit IRC17:01
*** sdague has joined #openstack-nova17:01
*** raj_singh_ has joined #openstack-nova17:01
*** su_zhang has joined #openstack-nova17:01
*** mingyu has joined #openstack-nova17:02
*** hieulq_ has joined #openstack-nova17:02
*** marst has quit IRC17:03
*** pradk- is now known as pradk17:03
*** praneshp has quit IRC17:03
*** su_zhang has quit IRC17:03
*** Apoorva has joined #openstack-nova17:03
*** su_zhang has joined #openstack-nova17:04
*** su_zhang has quit IRC17:04
*** su_zhang has joined #openstack-nova17:05
*** cdent has joined #openstack-nova17:06
*** unicell has quit IRC17:06
*** mgoddard_ has joined #openstack-nova17:06
*** diogogmt has joined #openstack-nova17:07
mriedemhmm, someone must have changed an api error response message17:07
*** devkulkarni has joined #openstack-nova17:07
sdaguedansmith: oh, that bit, yeh that's part of jay's patch that I didn't touch17:08
dansmithsdague: I know17:08
sdagueso, sure, we can tweak there17:08
sdaguehmmm.... ok, placement-api isn't being installed with pbr?17:08
cdentsdague: i just copied what nova was doing17:09
*** mgoddard has quit IRC17:09
cdentwas hoping it would come out clean in the review process...17:10
cdentwhich I guess is what is happening now17:10
mriedemnova does this https://github.com/openstack/nova/blob/master/setup.cfg#L4917:10
openstackgerritGábor Antal proposed openstack/nova: Use more specific asserts in tests  https://review.openstack.org/36304317:10
cdentmriedem: I thought sdague meant in devstack17:10
mriedemkeystone does this https://github.com/openstack/keystone/blob/master/setup.cfg#L8117:10
mriedemi'm assuming sdague meant an entry point is missing from setup.cfg so that pbr would install it17:10
sdagueright17:10
cdentmriedem: yeah, I realize that now17:10
cdentbut yes, it does not exist yet17:10
*** su_zhang has quit IRC17:11
*** ijw has joined #openstack-nova17:11
*** su_zhang has joined #openstack-nova17:11
edleafecdent: we're not using paste for the placement API, right?17:11
cdentbut same comment about coming out clean still applies17:11
cdentedleafe: correct, it does its own thing in nova/api/openstack/placement/deploy.py17:12
*** rcernin has quit IRC17:12
*** klkumar has quit IRC17:12
cdentbecause we didn't want paste to be config17:12
edleafecdent: ok, that's what I thought17:12
edleafecdent: so I'll add FaultWrapper there17:12
cdentedleafe: to preserve the separate you might want to copy and trim it to its bare essentials (that's what was done with the other middlewares)17:13
edleafecdent: ah, I see. OK, I'll take a whack at that17:13
*** tesseract- has quit IRC17:14
mriedemshit well novaclient is busted in the gate, that's blocking 2.37 from landing in there, so i'll be working on that now17:15
*** su_zhang has quit IRC17:16
cdentsdague, mriedem I've add the wsgi bit for setup.cfg to the etherpad, perhaps we can dump things which are not immediate there as we find them?17:16
mriedemcdent: a TODO section sounds good17:16
cdentdone17:17
*** tonytan4ever has joined #openstack-nova17:18
sdagueyeh, so logging never is setup anywhere in this stack I don't think17:18
sdagueok, I need to grab some food, I'm going to need to unwind this part a bit before I can figure out why the devstack patch doesn't work17:19
*** hieulq_ has quit IRC17:19
cdentsdague: ping me later if you want a pseudo pair17:20
*** sahid has quit IRC17:21
*** marst has joined #openstack-nova17:21
dansmithsounds like he wants a pseudo sandwich as much as anything17:21
mriedemhttps://www.youtube.com/watch?v=YLpUatutZDw17:23
*** tonytan4ever has quit IRC17:23
*** ijw has quit IRC17:24
*** tesseract- has joined #openstack-nova17:24
*** pcaruana has quit IRC17:25
*** ijw has joined #openstack-nova17:25
mriedemoh yes http://instantrimshot.com/index.php?sound=rimshot&play=true17:26
*** sdake has joined #openstack-nova17:27
*** tesseract- has quit IRC17:28
*** praneshp has joined #openstack-nova17:28
*** tonytan4ever has joined #openstack-nova17:29
*** su_zhang has joined #openstack-nova17:32
openstackgerritDan Smith proposed openstack/nova: Report compute node inventories through placement  https://review.openstack.org/36306117:33
dansmithcdent: sdague mriedem ^ untested unworking stub of the inventory stuff I think17:34
dansmithwhen sdague updates the base and devstack patches, I'll fix it up and actually try it17:34
openstackgerritMatt Riedemann proposed openstack/python-novaclient: Fix test_trigger_crash_dump_in_locked_state_nonadmin test  https://review.openstack.org/36306217:34
mriedem^ unblocks novaclient17:34
dansmithmelwitt: ^ ready for +W17:35
melwitton it17:35
*** su_zhang has quit IRC17:35
cdentdansmith: at a glance that looks reasonable, but haven't looked very closely17:36
*** su_zhang has joined #openstack-nova17:36
dansmithcdent: yep, not much point until I can see if it even works :)17:36
dansmithjust FYI17:36
mriedemdansmith: melwitt: thanks17:37
cdentdansmith: if you're feeling like you want to be implicit you can leave out reserved, {min,max}_unit and step_size, they will be default to what you've got there17:39
cdentactually, that's not true17:40
cdentthe defaults are different from what you've got, never mind17:40
dansmithokay17:40
* cdent tries to stay focused on what's he actually doing17:41
dansmithI think being explicit there is useful anyway, both for future proofness and also just for being an easy place to see what exactly is being reported17:41
dansmithit's not that verbose17:41
* cdent nods17:41
dansmithcdent: one thing.. am I supposed to report those strings as the resource classes? or do I need to resolve them to indexes?17:42
dansmithDISK_GB etc17:42
cdentthe api expects strings17:42
dansmithhaven't followed where the dynamic stuff is going17:42
dansmithokay cool17:42
*** unicell has joined #openstack-nova17:42
*** prateek_ has joined #openstack-nova17:42
*** devkulkarni has quit IRC17:44
*** cfriesen has joined #openstack-nova17:45
*** prateek has quit IRC17:46
*** lpetrut has quit IRC17:46
*** raj_singh_ has quit IRC17:47
*** rlrossit has joined #openstack-nova17:48
cdentdansmith: since the placement api doesn't do rpc (and ought to scale in the future via horizontally having more api servers without needing a conductor) is there a distance future where the methods on the resource provider objects won't need to be remotable?17:49
dansmithcdent: they probably don't need to be remotable now technically, right?17:50
dansmithaside from the fact that we have had code in the past that has used them as remotable17:50
cdentdansmith: correct, but it seemed odd to break the pattern now17:50
cdentand correct on that too17:50
dansmithyeah, can't undo it now but eventually we probably can yeah17:50
cdentcool, just checking my understanding, thanks17:50
*** mlavalle has quit IRC17:53
*** gouthamr has quit IRC17:54
*** markvoelker has joined #openstack-nova17:54
*** gouthamr has joined #openstack-nova17:54
*** devkulkarni has joined #openstack-nova17:55
*** baoli has quit IRC17:59
*** baoli has joined #openstack-nova18:00
*** su_zhang has quit IRC18:00
*** Sukhdev has joined #openstack-nova18:01
*** rmcall has quit IRC18:03
*** rmcall has joined #openstack-nova18:03
*** Sukhdev has quit IRC18:04
*** tesseract- has joined #openstack-nova18:05
*** tesseract- has quit IRC18:05
*** tesseract- has joined #openstack-nova18:06
*** salv-orl_ has joined #openstack-nova18:08
*** tesseract- has quit IRC18:08
*** mnestratov has quit IRC18:08
*** Apoorva has quit IRC18:10
openstackgerritArun yerra proposed openstack/nova-specs: Proposal for standardizing hardware NIC capabilities.  https://review.openstack.org/34134118:10
*** yamahata has joined #openstack-nova18:10
*** hemanthm is now known as hemanthm|lunch18:10
*** Apoorva has joined #openstack-nova18:10
*** tesseract- has joined #openstack-nova18:10
*** salv-orlando has quit IRC18:11
*** tonytan4ever has quit IRC18:13
*** parora has joined #openstack-nova18:14
*** tonytan4ever has joined #openstack-nova18:14
*** dikonoor has quit IRC18:15
*** dikonoor has joined #openstack-nova18:16
openstackgerritAndrew Laski proposed openstack/nova: Add a TODO and add info to a releasenote  https://review.openstack.org/36291918:16
*** prateek_ has quit IRC18:17
sdaguedansmith: humph, I'm getting a method not allowed here which is my crazy 500 error18:17
dansmithsdague: from the placement api you mean?18:17
sdagueyeh18:17
dansmithPOST or PUT?18:18
sdaguePOST18:18
openstackgerritMatt Riedemann proposed openstack/nova: Add more vd2 unit tests  https://review.openstack.org/34929818:18
*** ducttape_ has quit IRC18:18
sdague'REQUEST_METHOD': 'POST', 'PATH_INFO': '/resource_providers/5c42a360-cd71-4586-a65e-471933757434'18:18
openstackgerritVu Tran proposed openstack/nova: libvirt: Enable instance resizing for LVM backed instances  https://review.openstack.org/36076418:18
sdagueis that supposed to be a PUT?18:18
dansmithsdague: the code says you can't POST to /uuid18:18
sdagueit was a post in jay's patch18:19
dansmithsdague: but jay's code seems to be doing that18:19
dansmithso it has to be POST /resource_providers or PUT /resource_providers/uuid18:19
dansmithI think right?18:19
sdagueyeh, seems right.18:19
dansmithsorry, jay's code seems to be doing ti wrong I mean18:20
dansmithyou need to snip the /uuid part on create18:20
sdagueyeh, let me try that bit18:21
sdaguethat will at least maybe, let me know if the devstack patch is ok18:21
*** markvoelker has quit IRC18:22
*** gszasz has quit IRC18:23
sdaguehmmm... GET is no good either?18:25
sdague'REQUEST_METHOD': 'GET', 'PATH_INFO': '/resource_providers/5c42a360-cd71-4586-a65e-471933757434'18:25
*** su_zhang has joined #openstack-nova18:25
dansmithuh18:25
*** su_zhang has quit IRC18:26
dansmith404 or no method?18:26
*** rrecio has joined #openstack-nova18:26
sdagueno, 40518:27
dansmithare you sure you're hitting the right API?18:28
*** tesseract- has quit IRC18:30
sdagueyes, let me get this logging tweaked, then I'll have a better thing to say here18:30
*** tongli has joined #openstack-nova18:30
*** tesseract- has joined #openstack-nova18:30
*** tesseract- has quit IRC18:30
*** tesseract- has joined #openstack-nova18:31
*** mgoddard_ has quit IRC18:31
sdagueit might have been me overrunning the logs on the GET request, and it turning into something stupid18:32
sdaguethe GETs are working for me now, the POST is failing on media type enforcement18:32
sdague2016-08-30 14:34:34.686 ERROR nova.scheduler.client.report [req-4b6fcb8a-6437-4050-a96c-763422f8abed None None] Failed to create resource provider record in placement API for UUID 5c42a360-cd71-4586-a65e-471933757434. Got 201: .18:34
sdague well progress18:34
cdentsdague: I think jay's code is pretty much completely untested so I wouldn't take what it is doing as canonical in any way18:36
openstackgerritDoug Hellmann proposed openstack/os-vif: Update reno for stable/newton  https://review.openstack.org/36311518:36
*** yamahata has quit IRC18:37
*** tesseract- has quit IRC18:37
*** fragatin_ has quit IRC18:38
*** nic has joined #openstack-nova18:39
*** mtanino has joined #openstack-nova18:41
*** zengine has joined #openstack-nova18:41
*** ducttape_ has joined #openstack-nova18:41
*** tonytan_brb has joined #openstack-nova18:42
*** Apoorva has quit IRC18:43
*** GB21 has quit IRC18:43
*** su_zhang has joined #openstack-nova18:43
sdaguecdent: yes, definitely not tested :)18:44
*** lpetrut has joined #openstack-nova18:45
*** su_zhang has quit IRC18:45
*** tonytan4ever has quit IRC18:45
*** Apoorva has joined #openstack-nova18:45
*** tonytan4ever has joined #openstack-nova18:47
sdagueok, so the devstack patch is validated now, let me get someone else to +2 that https://review.openstack.org/#/c/34236218:47
sdaguemtreinish: how about you?18:47
*** yamahata has joined #openstack-nova18:48
sdagueand I have another round of fixes here I need to bring back into the fold18:48
*** delattec has joined #openstack-nova18:48
*** mdrabe_ has joined #openstack-nova18:49
*** salv-orl_ has quit IRC18:49
*** hemanthm|lunch is now known as hemanthm18:50
*** liangy_ has joined #openstack-nova18:50
*** tonytan_brb has quit IRC18:50
*** aignatov has quit IRC18:50
*** dstepanenko_ has joined #openstack-nova18:51
* dansmith netboots18:51
*** cdelatte has quit IRC18:51
*** lxsli has quit IRC18:51
*** dstepanenko has quit IRC18:51
*** ianw has quit IRC18:51
*** mdrabe has quit IRC18:52
*** lennyb has quit IRC18:52
*** liangy has quit IRC18:52
*** NobodyCam has quit IRC18:52
*** sayalilunkad has quit IRC18:52
*** scsnow has quit IRC18:52
*** scsnow has joined #openstack-nova18:53
openstackgerritEd Leafe proposed openstack/nova: WIP - Added FaultWrapper to the placement API  https://review.openstack.org/36312518:53
edleafecdent: sdague: ^^ am I on the right track?18:53
*** dimtruck is now known as zz_dimtruck18:54
*** NobodyCam has joined #openstack-nova18:54
* cdent looks18:54
*** cn28h has quit IRC18:54
edleafecrap -never mind18:55
edleafemissed a git add18:55
edleafeone minute18:55
cdentyeah, was just gonna say, the bit in deploy.py seems fine though :)18:55
sdagueedleafe: yeh, though honestly I don't know why we'd dup the fault wrapper, just use it in place18:55
*** prateek_ has joined #openstack-nova18:56
cdentdansmith: if you're around, I could do with a small borrow of your brain: When writing allocations, do we need to process generations18:56
sdaguewe can dup it out when we split18:56
cdentsdague: everything else has already been duped, and when it was duped it was made much smaller18:56
edleafesdague: that was cdent's suggestion to make it similar to the rest18:56
dansmithcdent: okay18:56
cdentbut yeah, it's not strictly necessary18:56
*** aignatov has joined #openstack-nova18:56
*** edand has quit IRC18:57
cdentdansmith: the api doesn't have the generation in the input when we write allocations, so I'm not quite sure...18:57
*** annegentle has quit IRC18:57
sdaguecdent: at this point in the cycle, I don't want to manage any new differences18:57
cdentdansmith: http://specs.openstack.org/openstack/nova-specs/specs/newton/approved/generic-resource-pools.html#put-allocations-consumer-uuid and http://specs.openstack.org/openstack/nova-specs/specs/newton/approved/resource-providers-allocations.html18:57
cdentsdague: makes sense18:58
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/35879718:58
openstackgerritSean Dague proposed openstack/nova: WIP: bang in some logging  https://review.openstack.org/36313018:58
sdagueedleafe: also, yes, that should work. Though, it turns out that wasn't really the issue18:58
*** intr1nsic has quit IRC18:58
sdagueI put something similar in my loggint patch to figure out what is going on18:58
*** annegentle has joined #openstack-nova18:58
cdentsdague other reason it happened is that  the calling strategy for the middlewares is a bit different from how nova likes things18:58
*** cn28h has joined #openstack-nova18:58
edleafesdague: the extra logging will come next18:58
openstackgerritEd Leafe proposed openstack/nova: WIP - Added FaultWrapper to the placement API  https://review.openstack.org/36312518:59
*** parora has quit IRC18:59
edleafe^^ should be better now18:59
*** salv-orlando has joined #openstack-nova18:59
*** erlon has joined #openstack-nova18:59
dansmithcdent: I think we had a convo about this at some point, but are you sure you need a generation when updating an allocation?19:00
*** devkulkarni has quit IRC19:00
dansmithcdent: you're refreshing all the allocations for a given consumer every time you update, right?19:00
openstackgerritAndrew Laski proposed openstack/nova: Pull from cell0 and build_requests for instance list  https://review.openstack.org/35613819:00
openstackgerritAndrew Laski proposed openstack/nova: WIP Move instance creation to conductor  https://review.openstack.org/31937919:00
cdentdansmith: not refreshing, setting. if there's an allocation for that consumer already it is considered an error19:00
sdaguedansmith: do we have an existing decorator for a method example somewhere that traps exceptions and sets attributes on self?19:01
*** intr1nsic has joined #openstack-nova19:01
dansmithcdent: really? how are we going to do the heal then?19:01
sdaguejust to speed up me writing this error handler19:01
cdentdansmith: your statement "but are you sure you need a generation when updating an allocation?" is my question19:01
dansmithsdague: we probably have decorators for those two things, but not sure all in one19:01
dansmithsdague: which part do you need to copy?19:01
cdentdansmith: that's a great question, but currently the spec is: "409 Conflict if there is already an allocation record for the specified consumer against a specified resource provider. "19:02
sdaguedansmith: I just need refreshers, I do decorators so infrequently19:02
edleafesdague: your WIP logging patch looks similar to what I was adding. Can I just add the faultwrapper copy to it and abandon mine?19:02
cdent(so one option would be a delete/put pair)19:02
dansmithcdent: not sure how resizes are going to work then19:02
sdagueedleafe: sure19:02
dansmithsdague: just a sec19:02
cdentdansmith: alaski had that same comment at some point and I'm not sure how it was resolved :(19:02
sdagueedleafe: actually, please don't dup faultwrapper19:02
sdagueI don't want to manage extra dups right now, we'll use the existing one19:03
openstackgerritMatt Riedemann proposed openstack/nova: Documentation for the vendordata reboot.  https://review.openstack.org/35379319:03
dansmithsdague: http://pastebin.com/wCQtnqKc19:03
dansmithis that what you want?19:03
*** lxsli has joined #openstack-nova19:04
sdaguedansmith: yep, perfect19:04
sdaguethank you19:04
*** sayalilunkad has joined #openstack-nova19:04
dansmithheh, np19:04
*** lennyb has joined #openstack-nova19:04
*** david-lyle_ is now known as david-lyle19:05
*** raunak has quit IRC19:05
cdentdansmith: I don't think there's anything about the data model that makes doing the heal impossible, so maybe it's just okay and the spec is "wrong"19:05
*** zz_dimtruck is now known as dimtruck19:06
dansmithcdent: well, it means a lot of polling to check that the current allocation matches what it should be, and if we need to correct it, a delete/post with a race window of not consuming resources19:06
* cdent nods19:06
dansmithcdent: not sure why we wouldn't be able to PUT a specific allocation to change it19:07
dansmitha same-host resize is going to have to either have two allocations for the same host or change one19:07
dansmithin fact, two allocations is the more correct case, IMHO19:07
dansmithbecause during resize_confirm you're using two of several things19:07
cdenti'm entirely willing to accept that19:07
cdentand can code it that way; but I'm still unsure about generation19:08
dansmithyeah, well, not sure why generation would be needed during the allocation bit19:08
cdentat some point during the allocation we need to check if there's capacity for it19:09
cdentwhich means its view is dependent on a particular view of a resource provider (at a generation when inventory was set). Is that right?19:10
* cdent ow19:10
dansmithum19:10
*** baoli has quit IRC19:10
*** lpetrut has quit IRC19:10
dansmithwe don't check for capacity, we POST what we need and it either succeeds or doesn't right?19:10
cmartinHey I am working on a bugfix and before I do something very tedious I was wondering if I could get a quick answer here19:10
cdentdansmith: that's what I mean the: server checks for capacity19:11
*** coolsvap_ has quit IRC19:12
dansmiththe server can't check against anything other than the current inventory so I'm not sure why generation gives you anything,19:12
dansmithunless you want to fail if the generation has changed since you submitted the request,19:12
dansmithbut the client requesting the allocation doesn't really care, right?19:12
mriedemsdague: cdent: dansmith: got a clean run with the devstack change and sean's fix on top of jay's change http://logs.openstack.org/41/362441/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4b43ad8/console.html19:13
dansmithit doesn't need to examine the capacity before it decides to submit a request, right?19:13
cdentdansmith: correct19:13
alaskicdent: dansmith just catching up. but I think I convinced jaypipes that it should be possible to update allocations19:13
mriedemthere is sadness here, but it sounds like that's a known issue http://logs.openstack.org/41/362441/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/4b43ad8/logs/screen-n-cpu.txt.gz?level=TRACE#_2016-08-30_17_38_00_79719:13
dansmithalaski: I think we have to be able to do that19:13
cdentalaski: ah, good, I guess the spec never made it up to date19:13
alaskidansmith: right, I had the same concerns as you on that19:14
dansmith\o/19:14
cdentalaski: do you remember about generations and allocations. the reason I'm fussing over this is because I seem to remember a discussion about it in sunnyvale but not enough details19:14
alaskicdent: seems like it. I discussed it in person with him and then I guess it never made it to writing19:14
*** armax has joined #openstack-nova19:15
openstackgerritSean Dague proposed openstack/nova: WIP: bang in some logging  https://review.openstack.org/36313019:15
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/36314819:15
alaskicdent: I need to keep reading to get full context as that's not ringing a bell19:15
*** sbezverk has quit IRC19:16
* cdent is here all night, tip your server19:16
sdaguemriedem: right, https://review.openstack.org/363148 should be a thing now19:16
*** ijw has quit IRC19:16
mriedemyeah you squashed the changes, lost the old change id19:16
mriedemwas that intentional?19:16
sdaguenope19:17
sdaguefixing19:17
openstackgerritSean Dague proposed openstack/nova: WIP: bang in some logging  https://review.openstack.org/36313019:17
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/35879719:17
sdaguetoo fast on the last squash19:17
mriedemcan we abandon https://review.openstack.org/#/c/362883/ ?19:17
mriedemto keep things straight19:17
sdagueyep19:17
mriedemok, and https://review.openstack.org/#/c/363061/ will have to be rebased19:18
sdagueyep19:18
alaskicdent: I see what you mean. I don't recall anything about having generations with allocations. But you'd want to check allocations against the current inventory right? passing a generation would potentially check against a previous inventory which would be odd19:18
cdentalaski: it's not about passing the generation, it's making sure that the generation hasn't changed out from under you while making changes19:18
sdagueok, I think that take on 358797 should be basically sound19:18
sdaguebut, all unit tests are pointless, let me go and work on those now19:19
dansmithI'm rebasing on that and stacking19:19
alaskicdent: a generation for the allocation? I'm not sure I can see a situation where you're reporting an allocation with potentially outdated data19:19
dansmithalaski: he means RP generation with the allocation19:19
tdurakovalaski: ping19:19
mriedemok, i'll update the d-g change to pick up the latest and pull in dan's change and the log jammin' change19:19
dansmithwhich I don't think makes sense19:19
cdentwriting an allocation against a changed inventory19:19
alaskicdent: dansmith19:20
alaskigotcha19:20
sdaguemriedem: so the log jammin' change is all kinds of gross19:20
dansmithcdent: you don't write allocations against an inventory though, from the client perspective19:20
tdurakovalaski: question on rpodolyaka's patch that you've reviewed19:20
* mriedem hopes sdague gets the big lebowski reference19:20
cdentdansmith: but if there's no room in the inventory the write of the allocation must fail19:20
alaskicdent: dansmith yeah, I'm not seeing the usefulness. if sum(allocation) < inventory then proceed. the inventory changing shouldn't matter as long as there's capacity19:20
*** armax has quit IRC19:20
tdurakovalaski: why we use admin_context for host_manager, and shouldn't for ironic_host_manager https://review.openstack.org/#/c/347948/3/nova/scheduler/host_manager.py19:20
dansmithcdent: right, but that's the point19:20
sdaguewe really need to retool how the placement api gets setup as a wsgi script, including log initialization. That's going to be on my stack after I make the unit tests sound on 35879719:21
dansmithcdent: you fail the SQL update in that case, but nothing about the generation means anything to that19:21
alaskitdurakov: looking19:21
sdaguemriedem: apparently not entirely :)19:21
cdentokay, that all sounds sane to me, I wish I could shake the niggle that says jay's going to come along and disagree, but I guess if he wants to do that he needs to be here19:22
dansmithsdague: https://www.youtube.com/watch?v=FiG7z1lrs7019:22
mriedemhttps://s-media-cache-ak0.pinimg.com/736x/86/f9/59/86f959ffac58dc752f9359111dd1fb35.jpg19:22
alaskitdurakov: usually get_admin_context is used because it's the only utility method there so people favor it over just doing RequestContext(). If there was a get_context method it would probably be used19:22
mriedemhe's here to fix your cable19:22
sdaguedansmith: ah, man ... I had forgotten that19:23
tdurakovalaski: should I change context to non-admin one for host_manager?19:23
alaskitdurakov: yes. A few cycles ago it may have been necessary because there were checks for admin in the db layer. But those were all moved to policy a while back19:23
tdurakovacked, also point about objects is valid to both manager, I assume19:24
tdurakovalaski: ^19:24
*** annegentle has quit IRC19:24
alaskitdurakov: it may not be. HostManager does len(compute_nodes) which may not work without accessing the .objects19:25
alaskior the slice operation19:26
sdaguehmmm... our version detection for qemu version is totally bonkers19:26
tdurakovalaski: ok, working on that one right now19:26
alaskitdurakov: leaving the .objects is fine for consistency. I didn't realize it was being copied from hostmanager19:26
sdaguehttp://logs.openstack.org/61/360761/1/check/gate-tempest-dsvm-full-ubuntu-xenial/d847714/logs/screen-n-cpu.txt.gz#_2016-08-25_20_15_57_16319:27
sdaguexenial has 2.5.019:27
tdurakovalaski: tbh both works for me, well, will leave object for consistency:)19:27
alaskitdurakov: cool. either works for me19:28
*** ianw_ has joined #openstack-nova19:28
*** rama_y has quit IRC19:28
*** Sukhdev has joined #openstack-nova19:28
*** baoli has joined #openstack-nova19:28
cdentcan I rely on methods with database context manager decorators to nest properly and rollback as expected when things go wrong?19:29
*** parora has joined #openstack-nova19:30
alaskicdent: I think that's a rpodolyaka question, who unfortunately is not here19:31
cdenti'll try to test it19:31
cdentthanks19:32
*** prateek_ has quit IRC19:33
*** rtheis_ has joined #openstack-nova19:33
*** armax has joined #openstack-nova19:35
*** rtheis has quit IRC19:35
*** rcernin has joined #openstack-nova19:39
openstackgerritSean Dague proposed openstack/nova: Fix qemu version check.  https://review.openstack.org/36316019:39
sdaguemriedem et al ^^^ quick thing that I noticed when looking at logs19:40
*** bvanhav has quit IRC19:41
*** fragatina has joined #openstack-nova19:43
*** su_zhang has joined #openstack-nova19:43
mriedemlooking19:45
mriedemheh, "Running Nova with a QEMU version less than 1.5.3 is deprecated. The required minimum version of QEMU will be raised to 1.5.3 in the next release."19:45
mriedemand we have:19:46
mriedemii  qemu-kvm                              1:2.5+dfsg-5ubuntu10.4              amd64        QEMU Full virtualization19:46
sdaguemriedem: yep19:46
sdaguealso, yay for error messages that don't tell you what it thinks we have19:47
sdaguebecause, it would have been easy to see it was wrong19:47
mriedemopen a low-hanging-fruit bug to clean that up and someone will pick it up fast19:48
*** su_zhang has quit IRC19:48
*** jamesdenton has quit IRC19:48
dansmithsdague: I get a nasty trace with your patch on top of a so-enabled devstack19:51
dansmithsdague: 2016-08-30 12:51:21.869 TRACE nova.compute.manager MissingAuthPlugin: An auth plugin is required to determine endpoint URL19:51
melwittmriedem: what's the difference between terminating a volume connection and detaching it? I was checking out the recent code you added that checks the stashed connector to determine whether to terminate,19:52
mriedemif you'll excuse me, i have to head to church and start praying19:52
mriedemhttp://www.cbssports.com/nfl/news/vikings-stop-practice-after-teddy-bridgewater-suffers-apparent-knee-injury/19:52
sdaguedansmith: hmmmmm19:52
sdaguedansmith: you have the devstack patch?19:52
melwittmriedem: and I'm seeing it not seem to matter whether terminate connection is called or not. (if I have instance in error state with no host set) the detach call seems to free the volume and it's then available for attaching again19:53
dansmithaye19:53
cmartinmriedem: Dang that's unfortunate, if it makes you feel any better my favorite team is starting a 2nd year 7th round pick QB19:53
dansmithsdague: I'm on 4d6017566a2fd550b418609c8452e6cf35dd29a719:53
mriedemmelwitt: that's probably a better question for the cinder channel people19:53
sdaguedansmith: what does your placement section look like?19:53
*** akshai has joined #openstack-nova19:53
dansmithsdague: placement section of ...19:54
dansmith?19:54
sdaguein /etc/nova/nova.conf19:54
melwittmriedem: okay, thanks19:54
dansmithsdague: grep placement -i /etc/nova/nova.conf19:54
dansmithsdague: nothing19:54
cdentdansmith: did you enable_service placement-api in your local.conf?19:54
* dansmith looks sheepish19:55
mriedemmelwitt: i imagine it means different things to different volume backends19:55
sdagueheh19:55
dansmithcdent: sdague: just enable_service placement-api ?19:55
mriedemyeah, latest version of the devstack change doesn't enable the placement-api by default19:55
sdaguedansmith: yes19:55
dansmithsdague: regardless, we need to handle that gracefully as everyone will be in that boat on day zero of newton19:55
cdentdansmith: before today it was automatic, but sdague made me change it :)19:55
sdaguedansmith: you have the full stack trace?19:56
sdaguedansmith: I agree19:56
dansmithsdague: lemme try to get it before devstack kills it19:56
openstackgerritPushkar Umaranikar proposed openstack/nova: Expand feature matrix with server admin actions  https://review.openstack.org/36240819:56
dansmithsdague: http://pastebin.com/raw/azJusvqw19:57
sdaguedansmith: ok, I can put that into the wrapper19:57
*** harlowja has quit IRC19:58
dansmithokay19:58
*** rama_y has joined #openstack-nova19:58
*** su_zhang has joined #openstack-nova19:58
*** Apoorva has quit IRC20:00
*** Sukhdev has quit IRC20:00
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/35879720:00
sdaguedansmith: I think that will fix it20:00
dansmithokay well, I am hoping just enabling the thing will let me test my part and then I will rebase20:01
sdaguesure20:01
dansmithI have a question20:01
sdagueshoot20:01
dansmithwhen you people are watching devstack run,20:02
dansmithyou're shouting vile obscenities at the screen too, right?20:02
*** su_zhang has quit IRC20:02
sdaguenot usually, why?20:02
dansmithoh, hmm20:02
dansmithI thought that was a thing20:02
sdaguebecause of the copious output?20:02
dansmithno20:02
sdagueis that how you summon the gods of testing?20:02
dansmithhaha20:03
sdagueusually goat sacrifice works better20:03
* dansmith looks around for a goat, finds only a cat20:03
cdentdansmith: yes20:04
mriedemi usually look elsewhere whilst stacking20:04
dansmithI just expand the window to a full 27" and mirror the window on all screens20:04
dansmithin hopes someone who has ever seen a movie will come visit and be impressed20:05
mriedemand start swearing?20:05
dansmithhah20:05
mriedemoh i see, like a 90s hacker movie?20:05
dansmiths/a 90s/every/20:05
mriedemwhere people are flying through some cyber space thing while coding20:05
sdaguewe should totally add some extra matrix bits into it20:05
dansmithand furious typing as if I'm causing all the output20:05
mriedemhttps://www.youtube.com/watch?v=u1Ds9CeG-VY20:05
mriedem^ is dan at home20:06
dansmithYes, I "assemble port scan objects" regularly20:06
melwittlol ... I feel embarrassed watching that20:09
*** dikonoor has quit IRC20:10
*** su_zhang has joined #openstack-nova20:10
cdenthugh jackman and dansmith do look a bit alike20:10
* dansmith feels sorry for hugh jackman20:11
*** sdake has quit IRC20:11
*** pradk has quit IRC20:11
*** sdake has joined #openstack-nova20:12
*** mdrabe_ is now known as mdrabe20:13
*** raunak has joined #openstack-nova20:14
tdurakovfolks, do we have any issues with py27 unit-tests right now?20:16
dansmithsdague: now I get this: 2016-08-30 13:15:40.043 ERROR nova.scheduler.client.report [req-990b33be-ecc5-4ea6-bcef-7d1cc5859876 None None] Failed to create resource provider record in placement API for UUID 5cdba15c-1409-422c-8274-746795e6c595. Got 400: 400 Bad Request20:16
*** sbezverk has joined #openstack-nova20:16
*** pradk has joined #openstack-nova20:16
dansmithsdague: because: JSON does not validate20:16
dansmithsdague: http://pastebin.com/Wpugnpdh20:17
sdaguejson inbound or outbound20:17
dansmithpresumably means you don't match the schema that the server side requires20:17
mriedemit's not nested in some object20:17
mriedemdoes it need to be in a 'resource' dict or something?20:17
sdagueok, I was pretty sure I saw that working here, but I can do a full clean / start again20:18
dansmithokay20:18
sdaguethat's definitely server side json enforcement20:19
*** ducttape_ has quit IRC20:19
dansmithI'm going to run off for a bit but will circle back after you've had a chance to look20:19
mriedemhttps://github.com/openstack/nova/blob/master/nova/api/openstack/placement/handlers/resource_provider.py#L2720:19
mriedemseems right20:19
sdagueyeh, I'm really confused honestly, this is exactly an object20:20
mriedemhere is the related gabbit https://github.com/openstack/nova/blob/master/nova/tests/functional/api/openstack/placement/gabbits/resource-provider.yaml#L3420:20
cdentis the content-type header being sent?20:21
sdagueif not, it would be a 41520:21
cdentyeah20:21
* cdent hmmms20:21
cdentoh, hang on20:21
*** ducttape_ has joined #openstack-nova20:22
openstackgerritTimofey Durakov proposed openstack/nova: ironic_host_manager: fix population of instances info on start  https://review.openstack.org/34794820:22
cdentnevermind, I thought perhaps this has already merged and was causing confusion: https://review.openstack.org/#/c/361422/20:22
cdentdansmith: is there any chance you have an older jsonschema?20:23
cdent(python module)20:23
sdaguecdent: in devstack we should be using whatever is in upper constraints20:24
cdentbut unless pip is being told to force update and he's got old cruft laying around? (speculating)20:24
sdagueno, devstack is pretty explicit20:25
sdagueso 2.5.1 should be what we are on20:25
*** gyee has joined #openstack-nova20:25
*** rtheis_ is now known as rtheis20:26
*** kevinz has quit IRC20:27
*** sbezverk_ has joined #openstack-nova20:29
*** sbezverk has quit IRC20:29
*** FL1SK has quit IRC20:30
*** hemanthm is now known as hemanthm|bbl20:32
*** rcernin has quit IRC20:33
openstackgerritEd Leafe proposed openstack/nova: WIP - Added FaultWrapper to the placement API  https://review.openstack.org/36312520:33
*** rcernin has joined #openstack-nova20:33
*** Apoorva has joined #openstack-nova20:34
*** rstarmer has joined #openstack-nova20:34
*** ianw_ is now known as ianw20:39
*** ijw has joined #openstack-nova20:40
mriedemsdague: dansmith: cdent: we now have a job in the experimental queue for running the placement-api20:42
mriedemgate-tempest-dsvm-neutron-placement-full-ubuntu-xenial-nv20:42
cdentmriedem++20:42
openstackgerritTimofey Durakov proposed openstack/nova: do not merge  https://review.openstack.org/36292220:42
sdaguemriedem: awesome20:44
bauzasmriedem: just catching up, bravo20:46
mriedemoh but it takes awhile to be deployed i think20:46
mriedemlike job changes happen every 30 minutes or something?20:47
openstackgerritAndrew Laski proposed openstack/nova: WIP Move instance creation to conductor  https://review.openstack.org/31937920:49
bauzasdansmith: sdague: cdent: I briefly followed your hangout and the etherpad as I was/am mostly off for tonight, but I can help continuing work on https://review.openstack.org/#/c/363061/ and https://review.openstack.org/#/c/358797 on my EU morning20:52
bauzasdansmith: just make sure to upload your latest branch before leaving today so I can take your work and continue20:53
sdaguemriedem: something like that20:53
tdurakovg20:53
tdurakovops20:53
tdurakovsdague: hi, do we have a plan to move ceph ci jobs to xenial?20:54
*** lpetrut has joined #openstack-nova20:54
tdurakovsdague: if we do who is working on that?20:54
sdaguetdurakov: probably just needs to be worked with infra20:54
sdaguetdurakov: probably no one20:54
tdurakovsdague: at least we need a patch to devstack20:54
sdaguedo we?20:55
mriedemtdurakov: any changes would be in the devstack ceph plugin repo20:55
mriedemto probably make it straddle both xenial and trusty20:55
mriedembut i'm not sure what changes would be needed20:55
tdurakovsdague: at least change this one https://github.com/openstack-dev/devstack/blob/master/lib/ceph#L35620:56
tdurakovsdague: systemd instead of upstart20:56
mriedemtdurakov: i think https://github.com/openstack-dev/devstack/blob/master/lib/ceph needs to just be dropped20:57
mriedemfor one20:57
mriedemi don't think any jobs are using it20:57
mriedemtdurakov: we use this https://github.com/openstack/devstack-plugin-ceph20:57
sdaguetdurakov: if you have patches to review, let me know20:57
tdurakovmriedem: ha, just wanted to ask about that20:57
mriedemhttps://github.com/openstack/devstack-plugin-ceph/blob/master/devstack/lib/ceph#L33520:57
sdagueotherwise, I'm not thinking about it until post freeze20:58
mriedemlooks like it already handles this20:58
mriedemhttps://github.com/openstack/devstack-plugin-ceph/commit/19051aa4cd779d9f6265a1a0a9fd00617ac72dab20:58
tdurakovmriedem: right, thank you for pointing to the right source20:59
mriedemtdurakov: it's been awhile since i've done an audit in project-config of the ceph jobs out there, but i think ceilometer was the last using a ceph job with the devstack stuff, and that was moving to use the plugin repo21:00
*** baoli has quit IRC21:00
mriedemi'd have to double check21:00
mriedemsorry i mean gnocchi21:00
tdurakovmriedem: hm, when I worked on ceph part for live-migration jobs there we several differences, that forces me to duplicate some of that ceph functions, I'll do some checks, and then try to reuse that plugin instead21:01
mriedemhttps://review.openstack.org/#/c/315994/21:03
mriedemtdurakov: there is an experimental queue job for running devstack-plugin-ceph with xenial21:05
mriedembut that's on the devstack-plugin-ceph repo21:06
*** jamielennox is now known as jamielennox|away21:06
tdurakovmriedem: it looks like I could clone that in post_hook, we don't need ceph to be initially installed, I'd just reuse plugin lib functions21:08
mriedemyeah i think that's what gnocchi does21:09
scottdamriedem: You had comments on this patch and I think I've addressed them. Please review when you have time: https://review.openstack.org/#/c/326681/21:12
scottdaTempest Migrate volume while attached to an instance to test Nova swap_volume, etc.21:12
*** thorst has quit IRC21:13
mikal.21:14
*** raunak has quit IRC21:14
mriedemhmm, i'm not sure if we can remove this https://github.com/openstack-dev/devstack/blob/master/files/debs/ceph21:16
mriedemsince https://github.com/openstack/devstack-plugin-ceph/blob/master/devstack/lib/ceph doesn't install xfsprogs21:17
*** harlowja has joined #openstack-nova21:17
mriedembut it's used here https://github.com/openstack-dev/devstack/blob/master/functions#L63021:17
mriedemmikal: what's going on with this? https://review.openstack.org/#/c/348066/21:18
mriedemit's the last unmerged patch for the vd2 stuff21:18
*** rstarmer has quit IRC21:18
mikalmriedem: please hold21:19
mikalOh that one21:19
mikalSo I think we've had a brain fart there21:19
mikalThere was an openstack-dev thread about it21:19
*** raunak has joined #openstack-nova21:19
*** ayoung has quit IRC21:19
*** gouthamr has quit IRC21:19
openstackgerritSylvain Bauza proposed openstack/nova: Make req spec and RT aware of volume-backed instances  https://review.openstack.org/35509121:20
mikalOh, maybe not21:20
openstackgerritChris Dent proposed openstack/nova: WIP Add create_all and delete_all to AllocationList  https://review.openstack.org/36320921:20
mikalmriedem: its a little complicated. Do you have a moment to work through the thought process?21:20
*** rtheis has quit IRC21:20
cdentdansmith, mriedem, sdague 363209 there ^^ is a start, but a lame one. I'll continue on it tomorrow, but need to stop now, getting stupid and sore.21:21
sdaguecdent: no worries21:21
mikalIt goes a bit like this...21:21
cdentsdague: any review commentary prior to tomorrow is most welcome, in case I've gone off in the weeds21:21
* cdent waves goodnight21:22
*** cdent has quit IRC21:22
mikalThere are two cases for a vendordata request. The request is caused by a nova operation like boot, where we know the authentication details of the user doing the operation and we can pass those through to the external rest api21:22
openstackgerritSean Dague proposed openstack/nova: rt: ensure resource provider records exist from RT  https://review.openstack.org/35879721:22
mikalThe second case is the instance requesting metadata, where we don't know the auth details of the user that created the instance, and so we can't pass those through21:22
mikalSo that patch passed through the auth details for the nova rest api iniated case21:23
mikalBut leaves no auth for the instance initiated case21:23
mikalThe suggestion on openstack-dev was to use a keystone account instead of the user creds21:23
mikalAnd I had presumed we'd do that for all the calls to the vendordata rest server things21:23
mikalBut maybe I'm wrong? Should we just use a service account for those where we don't know the user details?21:24
sdaguemriedem: I unfuxored a thing on https://review.openstack.org/358797 which unblocked dan21:25
sdaguebut it still needs unit tests, if anyone wants to pile in there, cool. Otherwise I'll probably get the placement-api doing logging tomorrow to make debugging the partial patches easier21:25
mriedemsdague: ah ok i see how that would mess up the validation21:25
sdaguemriedem: yep21:25
*** sdake has quit IRC21:26
sdaguewe got on a hangout and I said "well the only reason this might not work is if we didn't need this encoding" and dan looked and said "oh, have you never used requests before" :P so, sorted21:26
mriedemmikal: hmm, if we have a service account, it seems we'd want to just use that always21:26
*** salv-orlando has quit IRC21:26
mikalmriedem: that's kind of where I was going, hence not wanting to land all that driver change for the other thing21:27
sdaguesigning off now for dinner21:27
mikalmriedem: then again, the user details when available tell you a lot more than a service account does21:27
*** zengine has quit IRC21:27
mikalmriedem: which is why I am conflicted21:27
mikalmriedem: also, I don't have the service account thing written because I've been pulled into something internal at work for the last couple of weeks21:27
mriedemmikal: yeah, so i was going to say, does not having the creds for when the instance is requesting vendordata a blocker to using it?21:28
mriedemor does that just depend on the impl of the actual vd provider?21:28
mikalSo, I don't think its a blocker21:28
mriedemi mean, you don't have this with config drive either21:28
mriedemsince it doesn't change21:28
mikalI am unsure21:29
mikalI think you need the user creds for things like AD to know which user to add the instance to21:29
mriedemwell, i mean, with config drive you're just going to get the initial vendor data21:29
*** mingyu has quit IRC21:29
*** rfolco has quit IRC21:29
mikalAnd you'd have those after the first call if creating an instance caused a call to metadata21:29
mikalBut I think it only does that for config drive21:29
mikalThe external thing could cache it after that first call21:30
mriedemso if the vd provider blocks requests that don't provide auth, that's going to basically make this unusable for any non-libvirt driver out of the gate right?21:30
mikalWithout that patch, yes21:30
mriedemso, it seems we want to get that patch in21:30
mikalAnd then add a service account on top later if we need to?21:31
mriedemand work a service account thing in as a later future enhancement21:31
mriedemyeah21:31
mikalI'd be ok with that21:31
mriedemok21:31
mikalOk, I can remove my -W then21:31
mriedemcool, was just going to ask you to :)21:31
mikalWe should reply to the dev thread as well though21:31
mriedemwas this a nova thread?21:31
mikalLet me find it21:31
openstackgerritAndrew Laski proposed openstack/nova: DNM logs for debugging  https://review.openstack.org/36244221:31
*** sdake has joined #openstack-nova21:32
*** armax has quit IRC21:32
mikalmriedem: Subject line is "[openstack-dev] [nova][keystone] auth for new metadata plugins"21:32
mikalOh, there's a middleware problem I hadn't twigged to21:33
openstackgerritMatt Riedemann proposed openstack/nova: DNM: test rm -f devstack/lib/ceph  https://review.openstack.org/36321621:34
*** claudiub has quit IRC21:35
*** cleong has quit IRC21:35
mikalmriedem: I replied to the thread, which should make it easier to find21:36
mriedemyup reading it21:36
*** rfolco has joined #openstack-nova21:37
openstackgerritVladik Romanovsky proposed openstack/nova: tests: verify pci passthrough with numa  https://review.openstack.org/35607721:37
openstackgerritmelanie witt proposed openstack/nova: Detach volume after deleting instance with no host  https://review.openstack.org/34061421:38
*** rfolco has quit IRC21:39
mriedemmelwitt: whomg21:39
mriedemyou're still trying to make that work huh21:39
mriedemi love the list of reverts in that commit message21:40
melwittmriedem: yeah :( I had to spend some time figuring out what else was needed since the code evolved quite a bit since I last had it working21:40
melwittand yeah, the commit message is ... a saga haha21:42
*** abalutoiu has quit IRC21:42
openstackgerritTakashi NATSUME proposed openstack/nova: Add a hacking rule for string interpolation at logging  https://review.openstack.org/33484421:42
*** Swami has quit IRC21:44
*** _alastor__ has joined #openstack-nova21:45
_alastor__Hey folks, quick question.  Say I have a flat external network netA1.  On this network I have a bunch of subnets, eg netA1-sub1, netA1-sub2 etc.  I want to boot a VM that uses a specific subnet, but nova boot's `nic` argument only allows me to specify a net-id, not a subnet-id  How do I accomplish this?21:45
*** tblakes has quit IRC21:47
*** eharney has quit IRC21:48
*** mingyu has joined #openstack-nova21:49
*** chrichip has joined #openstack-nova21:49
*** salv-orlando has joined #openstack-nova21:49
*** marst has quit IRC21:50
mriedemmikal: replied21:54
*** tonytan4ever has quit IRC21:54
mriedemjust for the record21:54
*** mlavalle has joined #openstack-nova21:55
mikalOk21:57
mriedembig ol +W on that, i'll mark the bp complete tomorrow21:57
mriedemthanks for getting those follow up changes done21:57
mikalIts ok, sorry for being pulled away for a couple of weeks recently21:57
mikalIts a thing I don't enjoy, but don't have a lot of control over21:58
mriedemnp. just go merge all of the cells v2 stuff today :)21:58
mikalThe service user thing doesn't look too bad to do. I might try and whip up a patch to do that thing to see how bad it is...21:58
mikalmriedem: are they on the priority etherpad? If they are I'll take a look today.21:58
mriedemi don't think alaski was updating that anymore21:58
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova: Remove context object in oslo.log method  https://review.openstack.org/31710921:59
mikalmriedem: ok, so how do I determine what his review priorities are?22:00
dansmithsdague: I have it working now22:00
mriedemmight have to ask him, or dansmith, or melwitt22:00
mriedemtime for me to run22:01
openstackgerritDan Smith proposed openstack/nova: Report compute node inventories through placement  https://review.openstack.org/36306122:01
*** marst has joined #openstack-nova22:01
mriedemdansmith: run check experimental on that too22:01
dansmithmriedem: okay22:01
*** mriedem has quit IRC22:01
*** burt has quit IRC22:02
openstackgerritAugustina Ragwitz proposed openstack/nova: WIP: Use admin context to create neutron ports  https://review.openstack.org/35754022:05
*** chrichip has quit IRC22:06
*** rstarmer has joined #openstack-nova22:07
auggyi've been having a couple folks repeatedly running intel-nfv-ci recheck on my WIP patches22:07
auggyis someone trying to fix an issue that anyone knows of? i'm more worried about gate load22:08
*** rlrossit has quit IRC22:09
*** mdrabe has quit IRC22:11
*** mingyu has quit IRC22:11
*** lpetrut has quit IRC22:12
openstackgerritTimofey Durakov proposed openstack/nova: ironic_host_manager: fix population of instances info on start  https://review.openstack.org/34794822:13
openstackgerritAugustina Ragwitz proposed openstack/nova: WIP: Assume neutron port_binding extensions enabled  https://review.openstack.org/35772622:17
*** diogogmt has quit IRC22:20
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova: Using get() method to prevent KeyError  https://review.openstack.org/35942422:22
*** su_zhang has quit IRC22:22
*** cn28h has quit IRC22:23
*** cn28h has joined #openstack-nova22:26
*** ianw has quit IRC22:26
openstackgerritAugustina Ragwitz proposed openstack/nova: WIP: Assume neutron port_binding extensions enabled  https://review.openstack.org/35772622:31
*** diogogmt has joined #openstack-nova22:32
*** ducttape_ has quit IRC22:34
*** su_zhang has joined #openstack-nova22:34
*** jamesdenton has joined #openstack-nova22:36
*** sdake has quit IRC22:36
*** nic has quit IRC22:38
*** hemna is now known as hemnafk22:39
*** FL1SK has joined #openstack-nova22:39
openstackgerritAugustina Ragwitz proposed openstack/nova: WIP: Use admin context to create neutron ports  https://review.openstack.org/35754022:41
*** tomhambleton has joined #openstack-nova22:44
*** Swami has joined #openstack-nova22:47
*** Swami_ has joined #openstack-nova22:47
*** jamesdenton has quit IRC22:48
*** erhudy has quit IRC22:52
dansmithbauzas: if you want to write unit tests on my patch for inventory, and maybe see if any more need writing for the base patch tomorrow before I get up that would rock22:56
dansmithbauzas: it works for me as it is now, so I think the functional code is good22:56
*** ianw has joined #openstack-nova22:57
*** ayoung has joined #openstack-nova22:59
*** armax has joined #openstack-nova23:00
*** pradk has quit IRC23:00
melwittdansmith: I put up this patch for the devstack rabbit userid, we'll see if that's good enough https://review.openstack.org/#/c/363295/23:00
dansmithmelwitt: cool23:00
*** mingyu has joined #openstack-nova23:01
*** ducttape_ has joined #openstack-nova23:03
*** zengine has joined #openstack-nova23:06
*** mingyu has quit IRC23:08
*** praneshp has quit IRC23:08
*** ducttape_ has quit IRC23:09
*** Apoorva has quit IRC23:09
*** takashin has joined #openstack-nova23:11
*** rkrum has joined #openstack-nova23:12
*** praneshp has joined #openstack-nova23:13
*** Apoorva has joined #openstack-nova23:14
*** jamesdenton has joined #openstack-nova23:16
openstackgerritTakashi NATSUME proposed openstack/nova: WIP: Enable cold migration with target host  https://review.openstack.org/35710523:19
*** praneshp has quit IRC23:19
*** mingyu has joined #openstack-nova23:20
*** salv-orlando has quit IRC23:21
cfriesendansmith: when you were switching from InstanceV1 to InstanceV2, how did you handle newer code receiving the InstanceV1 object since the major version is different?23:22
*** su_zhang has quit IRC23:23
alaskimikal: the priorities etherpad is actually up to date on cells stuff, outside of devstack/grenade patches23:31
*** sdague has quit IRC23:31
mikalalaski: oh cool. Thanks.23:33
*** jamesdenton has quit IRC23:34
alaskimikal: not at all. thank you23:35
*** rcernin has quit IRC23:35
cfriesendansmith: never mind, procedural error in my testing23:36
*** mingyu has quit IRC23:39
*** praneshp has joined #openstack-nova23:42
*** rama_y has quit IRC23:46
*** mingyu has joined #openstack-nova23:51
*** sameo has quit IRC23:52
*** mriedem has joined #openstack-nova23:57
*** tonytan4ever has joined #openstack-nova23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!