Thursday, 2017-05-25

gmannmriedem: yea. nice. we will  use resp.obj['server']['id'] to fetch instance right ?00:00
*** claudiub has quit IRC00:00
*** pchavva has quit IRC00:00
gmannmriedem: also we would not need instance there once we deprecate and remove the CONF.api.hide_server_address_states00:01
gmannbut thats long term things may be next release as it need spec00:01
*** ijw has joined #openstack-nova00:01
mriedemgmann: yes that's the fix00:01
*** ijw has quit IRC00:01
mriedemso the plan is to just remove the config option and always hide 'addresses' when the vm_state is 'building'?00:02
*** ijw has joined #openstack-nova00:02
gmannmriedem: yea, but on spec we can discuss more VM states if addresses is not ready during those00:03
melwittapologies in advance00:07
openstackgerritmelanie witt proposed openstack/nova master: Add FixedIP.get_count_by_project()  https://review.openstack.org/44624600:07
openstackgerritmelanie witt proposed openstack/nova master: Add FloatingIP.get_count_by_project()  https://review.openstack.org/44624700:07
openstackgerritmelanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object  https://review.openstack.org/44624400:07
openstackgerritmelanie witt proposed openstack/nova master: Add SecurityGroup.get_counts()  https://review.openstack.org/44624500:07
openstackgerritmelanie witt proposed openstack/nova master: Remove 'reserved' count from used limits  https://review.openstack.org/44624200:08
openstackgerritmelanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage  https://review.openstack.org/44624300:08
openstackgerritmelanie witt proposed openstack/nova master: Count server groups to check quota  https://review.openstack.org/44624000:08
openstackgerritmelanie witt proposed openstack/nova master: Count networks to check quota  https://review.openstack.org/44624100:08
openstackgerritmelanie witt proposed openstack/nova master: Count instances to check quota  https://review.openstack.org/41652100:08
openstackgerritmelanie witt proposed openstack/nova master: Add InstanceGroup.get_counts()  https://review.openstack.org/45785700:08
openstackgerritmelanie witt proposed openstack/nova master: Add check_deltas() and limit_check_project_and_user() to Quotas  https://review.openstack.org/44623900:08
openstackgerritmelanie witt proposed openstack/nova master: Add InstanceGroup._remove_members_in_db  https://review.openstack.org/45785800:08
openstackgerritmelanie witt proposed openstack/nova master: Count server group members to check quota  https://review.openstack.org/45785900:08
openstackgerritmelanie witt proposed openstack/nova master: Count security groups to check quota  https://review.openstack.org/45786000:08
openstackgerritmelanie witt proposed openstack/nova master: Make Quotas object favor the API database  https://review.openstack.org/41094500:08
openstackgerritmelanie witt proposed openstack/nova master: Count fixed ips to check quota  https://review.openstack.org/45786100:08
openstackgerritmelanie witt proposed openstack/nova master: Add online migration to move quotas to API database  https://review.openstack.org/41094600:08
openstackgerritmelanie witt proposed openstack/nova master: Count floating ips to check quota  https://review.openstack.org/45786200:08
dtpgoodness gracious00:08
*** hongbin has quit IRC00:10
*** yamahata has quit IRC00:11
*** mingyu has quit IRC00:11
*** nic has quit IRC00:11
*** Sukhdev_ has quit IRC00:16
*** r-daneel has quit IRC00:20
openstackgerritDan Peschman proposed openstack/nova master: WIP: Use uuid for id in Services API  https://review.openstack.org/46428000:29
*** shaner has quit IRC00:31
*** litao__ has joined #openstack-nova00:31
*** dtp has quit IRC00:32
litao__alex_xu: pls review my patch https://review.openstack.org/#/c/414463/ if you have free time, thanks.00:33
*** shaner has joined #openstack-nova00:34
*** tuanluong has joined #openstack-nova00:36
*** dimtruck is now known as zz_dimtruck00:37
*** gianpiet_ has quit IRC00:38
*** gianpietro has joined #openstack-nova00:38
*** shaner has quit IRC00:39
*** gomarivera has joined #openstack-nova00:39
*** ijw has quit IRC00:39
*** shaner has joined #openstack-nova00:40
*** gomarivera has quit IRC00:45
*** gomarivera has joined #openstack-nova00:45
mriedemzzzeek: well good news, i sorted out how to get the main and api db's setup, so i've made quite a bit of progress00:46
mriedemit's all hackaroo, but it's a start00:46
mriedemoh nice, just recreated the 500 error00:47
*** yamahata has joined #openstack-nova00:47
*** gomarivera has quit IRC00:50
*** fragatina has joined #openstack-nova00:54
*** gomarivera has joined #openstack-nova00:55
*** yamahata has quit IRC00:55
*** gomarivera has quit IRC00:59
*** phuongnh has joined #openstack-nova01:02
*** kaisers__ has joined #openstack-nova01:02
*** zz_dimtruck is now known as dimtruck01:03
*** kaisers_ has quit IRC01:06
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Fix instance lookup in hide_server_addresses extension  https://review.openstack.org/46777201:07
*** gianpietro has quit IRC01:08
*** gianpietro has joined #openstack-nova01:09
*** smatzek has joined #openstack-nova01:10
*** gianpietro has quit IRC01:13
*** Yangyapeng has joined #openstack-nova01:13
*** shaner has quit IRC01:19
*** owalsh_ has joined #openstack-nova01:19
*** shaner has joined #openstack-nova01:19
*** edmondsw has joined #openstack-nova01:20
*** yolkfull has joined #openstack-nova01:21
*** owalsh has quit IRC01:22
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Log traceback when bdm validation fails for unknown reason  https://review.openstack.org/46780901:23
*** owalsh_ is now known as owalsh01:23
*** s1061123 has quit IRC01:24
*** fragatina has quit IRC01:24
*** crushil has quit IRC01:24
*** edmondsw has quit IRC01:25
*** crushil has joined #openstack-nova01:27
*** links has joined #openstack-nova01:30
*** s1061123 has joined #openstack-nova01:34
*** sree has joined #openstack-nova01:36
*** sree has quit IRC01:41
*** sofie_ has joined #openstack-nova01:41
openstackgerritJohn Griffith proposed openstack/nova master: WIP/POC Implement new attach Cinder flow  https://review.openstack.org/33028501:43
*** mtanino__ has joined #openstack-nova01:44
*** thorst has joined #openstack-nova01:46
*** ihrachys has quit IRC01:48
*** acormier has quit IRC01:49
*** annp has joined #openstack-nova01:49
*** acormier has joined #openstack-nova01:49
*** tovin07_ has joined #openstack-nova01:51
*** Shunli has joined #openstack-nova01:52
*** acormier has quit IRC01:54
*** cNilesh has joined #openstack-nova01:56
*** gianpietro has joined #openstack-nova01:57
*** mtanino__ has quit IRC01:59
*** gianpietro has quit IRC02:01
*** thorst has quit IRC02:02
*** zhurong has joined #openstack-nova02:05
*** hongbin has joined #openstack-nova02:09
*** gjayavelu has joined #openstack-nova02:10
*** coreywright has quit IRC02:10
*** smatzek has quit IRC02:11
*** thorst has joined #openstack-nova02:14
*** ijw has joined #openstack-nova02:15
*** masayukig has joined #openstack-nova02:18
*** ijw has quit IRC02:18
*** ijw_ has joined #openstack-nova02:19
*** ijw__ has joined #openstack-nova02:20
*** ijw_ has quit IRC02:24
*** coreywright has joined #openstack-nova02:29
*** lucasxu has joined #openstack-nova02:33
*** xinliang has quit IRC02:34
*** thorst has quit IRC02:37
*** mtanino_ has joined #openstack-nova02:37
*** itlinux has joined #openstack-nova02:37
*** dikonoor has joined #openstack-nova02:45
*** xinliang has joined #openstack-nova02:47
*** dikonoo has quit IRC02:49
*** ihrachys has joined #openstack-nova02:49
*** ihrachys has quit IRC02:50
*** tuanluong has quit IRC02:50
*** rfolco has quit IRC02:52
*** mtanino_ has quit IRC02:56
*** gianpietro has joined #openstack-nova02:59
*** itlinux has quit IRC03:03
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992303:03
*** gianpietro has quit IRC03:03
*** armax has quit IRC03:06
*** lucasxu has quit IRC03:06
*** lucasxu has joined #openstack-nova03:08
*** edmondsw has joined #openstack-nova03:08
*** dikonoor has quit IRC03:13
*** edmondsw has quit IRC03:13
mriedemKevin_Zheng: looking better but no release note yet :)03:15
Kevin_Zheng...ah...god, what was I thinking03:15
*** lucasxu has quit IRC03:18
gmannmriedem: re-thinking on quota class fix, as we are going to move quota/limit thing to keystone (as discussed in PTG) , is it worth to fix this API in microversion when there is a work around of getting default quotas from os-quota-set03:20
gmannmriedem: but yes that's per projects not global default03:20
*** sree has joined #openstack-nova03:22
mriedemgmann: it seems trivial to fix,03:26
mriedemand i'd rather not assume we're going to have nova using limits from keystone in queens03:26
*** jichen has joined #openstack-nova03:26
mriedemanyway, i have to call it a day03:27
mriedemttyl03:27
*** mriedem has quit IRC03:27
gmannmriedem: ok, yea trivial but it increase microversion numbers :) anyways yea keystone limits might be far.03:27
*** hamzy has joined #openstack-nova03:31
*** Sukhdev has joined #openstack-nova03:32
*** hongbin has quit IRC03:32
openstackgerritfalseuser proposed openstack/nova master: Fix the problems that occur during rebuild operations  https://review.openstack.org/46758803:34
*** crushil has quit IRC03:36
*** gjayavelu has quit IRC03:44
*** tuanluong has joined #openstack-nova03:47
*** dikonoor has joined #openstack-nova03:48
openstackgerritHuan Xie proposed openstack/nova master: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349303:48
*** vks1 has joined #openstack-nova03:51
*** crushil has joined #openstack-nova03:54
*** gouthamr has quit IRC03:57
*** sayantan_ has joined #openstack-nova03:58
*** tuanluong has quit IRC03:59
sayantan_Hi. I am a little stuck. While creating an instance, I get the following error "no valid hosts found. There are no enough hosts available"04:00
sayantan_When I check the nova-compute.log I see the error "nova.virt.libvirt.driver [-] Error defining a domain with XML: <domain type="kvm">"04:00
sayantan_Any idea what is going wrong here?04:00
*** sofie_ has quit IRC04:01
*** psachin has joined #openstack-nova04:05
*** tbachman has quit IRC04:07
*** zhurong has quit IRC04:08
*** Sukhdev has quit IRC04:11
*** markvoelker has joined #openstack-nova04:13
*** yamamoto has quit IRC04:13
*** yamamoto has joined #openstack-nova04:13
*** thorst has joined #openstack-nova04:16
*** zhurong has joined #openstack-nova04:16
*** yamamoto has quit IRC04:17
*** thorst has quit IRC04:18
*** dikonoor has quit IRC04:19
*** vks1 has quit IRC04:22
*** thorst has joined #openstack-nova04:26
*** yingjun has joined #openstack-nova04:30
*** diga has joined #openstack-nova04:31
*** thorst has quit IRC04:38
*** crushil has quit IRC04:38
*** vks1 has joined #openstack-nova04:38
*** xyang1 has quit IRC04:45
*** crushil has joined #openstack-nova04:50
*** ayogi has joined #openstack-nova04:52
*** edmondsw has joined #openstack-nova04:56
*** ltomasbo|away is now known as ltomasbo04:57
*** karthiks has joined #openstack-nova05:00
*** yamamoto has joined #openstack-nova05:01
*** edmondsw has quit IRC05:01
*** gyee has quit IRC05:03
*** mikal_ is now known as mikal05:06
*** markvoelker_ has joined #openstack-nova05:11
*** trinaths has joined #openstack-nova05:11
*** crushil has quit IRC05:13
*** markvoelker has quit IRC05:14
*** claudiub has joined #openstack-nova05:17
*** markvoelker has joined #openstack-nova05:17
*** dikonoor has joined #openstack-nova05:17
*** udesale has joined #openstack-nova05:17
*** markvoel_ has joined #openstack-nova05:19
*** markvoelker has quit IRC05:19
*** markvoelker_ has quit IRC05:21
*** slaweq has joined #openstack-nova05:23
*** ratailor has joined #openstack-nova05:24
*** sree has quit IRC05:28
*** lyan has quit IRC05:29
*** slaweq has quit IRC05:29
*** dikonoor has quit IRC05:29
*** kaisers__ has quit IRC05:30
*** thorst has joined #openstack-nova05:38
*** prateek has joined #openstack-nova05:40
*** thorst has quit IRC05:42
*** sree has joined #openstack-nova05:45
*** arunman has joined #openstack-nova05:49
*** diga has quit IRC05:51
*** markvoel_ has quit IRC05:53
*** markvoelker has joined #openstack-nova05:53
*** avolkov has joined #openstack-nova05:53
*** markvoelker has quit IRC05:54
*** kaisers_ has joined #openstack-nova06:00
*** sayantan_ has quit IRC06:02
*** vks1 has quit IRC06:06
*** Dinesh_Bhor has quit IRC06:06
*** thorst has joined #openstack-nova06:09
*** Dinesh_Bhor has joined #openstack-nova06:11
*** yolkfull_ has joined #openstack-nova06:15
openstackgerritsuzhengwei proposed openstack/nova master: compute_model problem  https://review.openstack.org/46289706:17
*** yolkfull has quit IRC06:17
*** Oku_OS-away is now known as Oku_OS06:18
*** rcernin has joined #openstack-nova06:18
*** kaisers_ has quit IRC06:19
*** sridharg has joined #openstack-nova06:19
*** kaisers_ has joined #openstack-nova06:19
*** sridharg has quit IRC06:19
*** sridharg has joined #openstack-nova06:20
*** sridharg has quit IRC06:20
*** sree has quit IRC06:20
*** sridharg has joined #openstack-nova06:20
*** pcaruana has joined #openstack-nova06:20
*** sree has joined #openstack-nova06:22
*** sree has quit IRC06:23
*** markvoelker has joined #openstack-nova06:27
*** mdnadeem has joined #openstack-nova06:27
*** thorst has quit IRC06:27
*** vks1 has joined #openstack-nova06:27
*** sree has joined #openstack-nova06:28
*** markvoelker has quit IRC06:32
*** avolkov has quit IRC06:32
*** diga has joined #openstack-nova06:35
*** yolkfull_ has quit IRC06:42
*** mnestratov has joined #openstack-nova06:42
*** edmondsw has joined #openstack-nova06:45
*** edmondsw has quit IRC06:49
*** adisky_ has joined #openstack-nova06:50
*** sree_ has joined #openstack-nova06:51
*** kaisers_ has quit IRC06:52
*** sree_ is now known as Guest5221706:52
*** sree has quit IRC06:52
*** ralonsoh has joined #openstack-nova06:55
*** markvoelker has joined #openstack-nova06:59
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992307:02
*** markvoelker has quit IRC07:03
openstackgerritNgo Quoc Cuong proposed openstack/nova master: Remove translation of log messages  https://review.openstack.org/46699507:06
*** markvoelker has joined #openstack-nova07:09
*** gcb has quit IRC07:10
*** dixiaoli has joined #openstack-nova07:13
*** gcb has joined #openstack-nova07:14
*** markvoelker has quit IRC07:14
*** Guest52217 has quit IRC07:21
*** sree has joined #openstack-nova07:21
*** kaisers_ has joined #openstack-nova07:22
*** sree has quit IRC07:22
*** thorst has joined #openstack-nova07:24
*** sree has joined #openstack-nova07:24
*** markvoelker has joined #openstack-nova07:29
*** thorst has quit IRC07:29
*** zhurong has quit IRC07:30
*** dikonoor has joined #openstack-nova07:31
*** markvoelker has quit IRC07:37
*** fragatina has joined #openstack-nova07:38
*** karimb has joined #openstack-nova07:41
*** markvoelker has joined #openstack-nova07:42
*** fragatina has quit IRC07:44
*** zhurong has joined #openstack-nova07:45
*** markvoelker has quit IRC07:49
*** kaisers_ has quit IRC07:51
*** kaisers_ has joined #openstack-nova07:51
*** moshele has joined #openstack-nova07:52
*** jpena|off is now known as jpena07:58
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-nova08:02
*** fragatina has joined #openstack-nova08:05
*** lucas-pto is now known as lucasagomes08:08
openstackgerritZhenyu Zheng proposed openstack/nova master: Exclude deleted service records when calling hyperrvisor statistics  https://review.openstack.org/46722008:12
*** kaisers_ has quit IRC08:13
*** sheel has joined #openstack-nova08:13
*** yolkfull_ has joined #openstack-nova08:14
*** yolkfull_ has quit IRC08:16
*** yolkfull_ has joined #openstack-nova08:17
openstackgerritZhenyu Zheng proposed openstack/nova master: Support tag instances when boot(2/4)  https://review.openstack.org/45956908:22
*** markvoelker has joined #openstack-nova08:24
*** thorst has joined #openstack-nova08:25
*** efoley__ has joined #openstack-nova08:26
*** efoley_ has joined #openstack-nova08:28
*** avolkov has joined #openstack-nova08:28
*** thorst has quit IRC08:29
*** markvoelker has quit IRC08:30
openstackgerritHuan Xie proposed openstack/nova master: XenAPI: Fix vif plug problem  https://review.openstack.org/46792608:30
*** trinaths has left #openstack-nova08:31
*** efoley__ has quit IRC08:31
*** markvoelker has joined #openstack-nova08:32
openstackgerritHuan Xie proposed openstack/nova master: XenAPI: nova-compute cannot restart after manually delete VM  https://review.openstack.org/46792608:36
*** lpetrut has joined #openstack-nova08:37
*** phuongnh has quit IRC08:38
*** phuongnh has joined #openstack-nova08:39
*** markvoelker has quit IRC08:40
*** sree has quit IRC08:42
*** sree has joined #openstack-nova08:42
*** kaisers_ has joined #openstack-nova08:43
*** gszasz has joined #openstack-nova08:44
*** sree has quit IRC08:44
*** sree has joined #openstack-nova08:45
openstackgerritHuan Xie proposed openstack/nova master: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349308:48
*** zhurong has quit IRC08:54
*** baoli has joined #openstack-nova09:02
*** vks1 has quit IRC09:02
*** sree_ has joined #openstack-nova09:02
*** sree_ is now known as Guest8880709:03
*** zhurong has joined #openstack-nova09:04
*** sree has quit IRC09:04
*** baoli has quit IRC09:06
*** Guest88807 has quit IRC09:07
*** derekh has joined #openstack-nova09:09
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992309:11
openstackgerritGhanshyam Mann proposed openstack/nova master: Add api-ref for os-quota-class-set APIs  https://review.openstack.org/46793809:16
*** markvoelker has joined #openstack-nova09:16
*** diga has quit IRC09:17
*** priteau has joined #openstack-nova09:17
*** markvoelker has quit IRC09:21
*** phuongnh has quit IRC09:25
*** Shunli has quit IRC09:26
*** phuongnh has joined #openstack-nova09:26
*** thorst has joined #openstack-nova09:26
openstackgerritNgo Quoc Cuong proposed openstack/nova master: Remove translation of log messages  https://review.openstack.org/46699509:26
openstackgerritjichenjc proposed openstack/nova master: Use plain routes list for os-services endpoint instead of stevedore  https://review.openstack.org/46081809:28
*** thorst has quit IRC09:30
openstackgerritNgo Quoc Cuong proposed openstack/nova master: Remove translation of log messages  https://review.openstack.org/46699509:32
alex_xusfinucan: appreciate if you can approve this one https://review.openstack.org/#/c/461628/09:32
alex_xulitao__: yea, it is on my review list09:32
openstackgerritNgo Quoc Cuong proposed openstack/nova master: Remove translation of log messages  https://review.openstack.org/46794809:33
litao__alex_xu: thanks09:33
openstackgerritBin Zhou proposed openstack/nova master: Insert the description of the change.  https://review.openstack.org/46795209:34
*** udesale has quit IRC09:34
*** zhurong has quit IRC09:35
*** yingjun has quit IRC09:37
*** udesale has joined #openstack-nova09:39
alex_xulitao__: np09:40
*** mvk_ has quit IRC09:41
*** takashin has left #openstack-nova09:44
*** cdent has joined #openstack-nova09:46
*** sambetts|afk is now known as sambetts09:46
*** sdague has joined #openstack-nova09:46
*** gomarivera has joined #openstack-nova09:47
*** jichen has quit IRC09:47
*** udesale has quit IRC09:48
*** gomarivera has quit IRC09:51
*** udesale has joined #openstack-nova09:53
*** markvoelker has joined #openstack-nova09:54
*** rmart04 has joined #openstack-nova09:58
*** markvoelker has quit IRC09:58
*** tovin07_ has quit IRC10:00
*** cNilesh has quit IRC10:02
*** cNilesh has joined #openstack-nova10:03
*** tbachman has joined #openstack-nova10:04
*** mvk has joined #openstack-nova10:09
*** yamamoto has quit IRC10:11
*** cNilesh has quit IRC10:12
*** sfinucan has quit IRC10:19
*** sfinucan has joined #openstack-nova10:19
*** edmondsw has joined #openstack-nova10:21
*** sheel has quit IRC10:22
*** vks1 has joined #openstack-nova10:23
*** kaisers_ has quit IRC10:23
*** udesale has quit IRC10:23
*** udesale has joined #openstack-nova10:23
*** edmondsw has quit IRC10:25
openstackgerritLucian Petrut proposed openstack/nova master: [Trivial] Hyper-V: accept Glance vhdx images  https://review.openstack.org/46736910:27
*** thorst has joined #openstack-nova10:27
*** annp has quit IRC10:27
*** Yangyapeng has quit IRC10:30
*** tbachman has quit IRC10:31
*** thorst has quit IRC10:31
*** dixiaoli has quit IRC10:39
*** dikonoor has quit IRC10:43
*** tbachman has joined #openstack-nova10:47
*** markvoelker has joined #openstack-nova10:47
*** lucasagomes is now known as lucas-hungry10:48
*** mingyu has joined #openstack-nova10:48
*** tbachman has quit IRC10:52
*** markvoelker has quit IRC10:52
*** mingyu has quit IRC10:53
*** markvoelker has joined #openstack-nova10:55
openstackgerritSean Dague proposed openstack/nova master: remove oslo.context exact key tests  https://review.openstack.org/46799510:58
*** yamamoto has joined #openstack-nova10:58
*** dikonoor has joined #openstack-nova10:59
*** markvoelker has quit IRC10:59
sdaguesfinucan / bauzas ^^^11:00
sdaguewe have unit tests that break on the new oslo.context because legacy11:00
sdaguewe should just delete them11:00
*** Yangyapeng has joined #openstack-nova11:02
*** Yangyapeng has quit IRC11:02
*** mtanino_ has joined #openstack-nova11:07
*** acormier has joined #openstack-nova11:09
openstackgerritSean Dague proposed openstack/nova master: Migrate to oslo request_id middleware  https://review.openstack.org/46799811:10
*** markvoelker has joined #openstack-nova11:14
*** smatzek has joined #openstack-nova11:15
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992311:17
*** markvoelker has quit IRC11:19
*** phuongnh has quit IRC11:20
*** yolkfull_ has quit IRC11:21
*** dimtruck is now known as zz_dimtruck11:24
*** jpena is now known as jpena|lunch11:26
*** yingjun has joined #openstack-nova11:27
*** prateek has quit IRC11:28
openstackgerritGhanshyam Mann proposed openstack/nova master: Fix to return server groups quota in quota class set  https://review.openstack.org/46799911:28
*** acormier has quit IRC11:29
*** acormier has joined #openstack-nova11:29
*** markvoelker has joined #openstack-nova11:29
gmannalex_xu: ^^ fix for quota class set bug, i put this as WIP till you push the spec for this11:30
*** acormier has quit IRC11:34
*** markvoelker has quit IRC11:34
*** gianpietro has joined #openstack-nova11:35
*** gianpietro has quit IRC11:40
sdaguealex_xu: oh, if you are still up https://review.openstack.org/46799511:43
*** arunman has quit IRC11:43
openstackgerritGhanshyam Mann proposed openstack/nova master: Add api-ref for os-quota-class-set APIs  https://review.openstack.org/46793811:44
*** dikonoor has quit IRC11:45
*** amrith has left #openstack-nova11:48
openstackgerritZhenyu Zheng proposed openstack/nova master: Exclude deleted service records when calling hyperrvisor statistics  https://review.openstack.org/46722011:48
*** rfolco has joined #openstack-nova11:50
*** gianpietro has joined #openstack-nova11:52
openstackgerritChris Dent proposed openstack/nova master: Handle new hosts for updating instance info in scheduler  https://review.openstack.org/45442611:52
*** gianpietro has quit IRC11:53
*** lucas-hungry is now known as lucasagomes11:55
*** thorst has joined #openstack-nova11:58
*** edmondsw has joined #openstack-nova11:58
*** ekuris has quit IRC11:58
*** udesale has quit IRC11:59
*** udesale has joined #openstack-nova11:59
*** udesale has quit IRC11:59
gmannsdague: alex_xu:  added api-ref for quota class set and documented the bug there. check if it looks fine. https://review.openstack.org/46793811:59
*** markvoelker has joined #openstack-nova12:00
*** kylek3h has quit IRC12:00
gmannadding this API mystery&magic as warning :)12:00
*** ratailor has quit IRC12:04
*** markvoelker has quit IRC12:04
sdaguecool, I'll take a look in a bit12:04
*** dikonoor has joined #openstack-nova12:08
*** lyan has joined #openstack-nova12:09
*** vks1 has quit IRC12:10
*** markvoelker has joined #openstack-nova12:11
*** acormier has joined #openstack-nova12:11
*** zz_dimtruck is now known as dimtruck12:11
*** acormier has joined #openstack-nova12:12
*** ekuris has joined #openstack-nova12:14
*** tbachman has joined #openstack-nova12:14
*** mtanino_ has quit IRC12:14
*** kylek3h has joined #openstack-nova12:15
*** markvoelker has quit IRC12:15
*** bhagyashris has quit IRC12:16
*** markvoelker has joined #openstack-nova12:17
mdboothAfter tearing my hair out for most of the morning it transpires that os-client-config, rather than just reading environment variables, actually pops them. I mean, why would anybody want to look an an environment variable again?12:19
*** ayogi has quit IRC12:19
*** pchavva has joined #openstack-nova12:19
mdboothOf course, this breaks anything which gets a config more than once12:19
mdboothLike OVB deploy, for eg12:20
*** prateek has joined #openstack-nova12:21
*** markvoelker has quit IRC12:22
*** gianpietro has joined #openstack-nova12:24
*** karthiks has quit IRC12:24
*** roeyc has joined #openstack-nova12:25
*** roeyc has quit IRC12:25
*** acormier has quit IRC12:25
*** roeyc has joined #openstack-nova12:25
*** acormier has joined #openstack-nova12:25
*** gomarivera has joined #openstack-nova12:26
*** gianpietro has quit IRC12:26
*** tbachman has quit IRC12:28
*** tbachman has joined #openstack-nova12:28
openstackgerritLars Kellogg-Stedman proposed openstack/nova master: provide interface-scoped nameserver information  https://review.openstack.org/46769912:30
*** acormier has quit IRC12:30
*** bhagyashris has joined #openstack-nova12:31
*** gianpietro has joined #openstack-nova12:32
*** gianpietro has quit IRC12:32
*** gomarivera has quit IRC12:35
*** efoley__ has joined #openstack-nova12:35
*** gomarivera has joined #openstack-nova12:35
*** yingjun has quit IRC12:37
*** efoley_ has quit IRC12:39
*** pewp has quit IRC12:39
*** pewp has joined #openstack-nova12:40
*** gomarivera has quit IRC12:40
*** kylek3h has quit IRC12:41
*** efried has joined #openstack-nova12:46
*** lyan has quit IRC12:49
*** arunman has joined #openstack-nova12:49
cdentmdbooth: the universe does not want you to have hair12:49
*** jpena|lunch is now known as jpena12:51
*** acormier has joined #openstack-nova12:52
*** acormier has quit IRC12:52
*** acormier has joined #openstack-nova12:53
*** links has quit IRC12:54
*** markvoelker has joined #openstack-nova12:56
*** yamamoto has quit IRC12:56
*** liverpooler has joined #openstack-nova12:56
*** moshele has quit IRC12:57
*** acormier has quit IRC12:58
*** acormier has joined #openstack-nova12:59
*** Yangyapeng has joined #openstack-nova12:59
*** gouthamr has joined #openstack-nova13:01
*** yamamoto has joined #openstack-nova13:02
*** acormier has quit IRC13:04
*** baoli has joined #openstack-nova13:05
openstackgerritSean Dague proposed openstack/nova master: Migrate to oslo request_id middleware  https://review.openstack.org/46799813:09
*** gianpietro has joined #openstack-nova13:11
*** psachin has quit IRC13:13
*** baoli has quit IRC13:13
*** baoli has joined #openstack-nova13:13
*** ctrath has joined #openstack-nova13:15
*** mdrabe has joined #openstack-nova13:16
*** lucasxu has joined #openstack-nova13:16
*** efoley_ has joined #openstack-nova13:19
*** lyan has joined #openstack-nova13:21
savvassmcginnis: good morning! Were you by any chance able to reproduce that issue I reported yesterday regarding the Any Availability zone selection when creating an instance? Which resulted in cinder failing to create a volume13:22
*** efoley__ has quit IRC13:23
*** mriedem has joined #openstack-nova13:23
mriedemo/13:23
*** sridharg has quit IRC13:23
smcginnissavvas: Unfortunately no, having some issues getting it set up at the moment.13:24
smcginnissavvas: I was wondering if you could open a bug to make sure we track this?13:24
mriedemdansmith: i've got super special early morning news, the stable/newton backport of the db creds special characters fix and all changes below it are passing https://review.openstack.org/#/c/466808/ https://review.openstack.org/#/c/420750/ https://review.openstack.org/#/c/420876/13:24
mriedemincluding the change for the cell0 db name13:24
smcginnissavvas: I looked through the code quick and it does look like we should be handling None correctly.13:24
savvasI'd be happy to. Where should I report this?13:25
*** fragatina has quit IRC13:25
*** dixiaoli has joined #openstack-nova13:26
sdaguemriedem: did you get my email on the db test case debug?13:26
mriedemsdague: reading now13:26
smcginnissavvas: In the top right corner here: https://bugs.launchpad.net/cinder/+bugs13:26
sdaguecell1 is still sqlite13:26
sdagueis the tldr13:26
*** lucasxu has quit IRC13:27
*** roeyc has quit IRC13:27
*** lucasxu has joined #openstack-nova13:27
mriedemhmm13:27
mriedemthat's got to all be done in a fixture,13:28
*** roeyc has joined #openstack-nova13:28
mriedemand i'd think we could sub the db engine13:28
*** dixiaoli has quit IRC13:28
sdagueyeh, the cell magic switchero fixture is pretty complicated, but it's in there13:29
sdaguethe real challenge is that because we're running this all in a single process, there was something about the context manager that was "interesting" that melwitt and dansmith worked through13:29
mriedemfwiw i didn't think i was using the main cell database fixture13:30
mriedemthat did all the switching stuff13:30
mriedemi was using the SimpleCellFixture, which i'm not sure is right to use, but i thought would be simpler to start13:31
sdaguemriedem: no this - https://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/tests/fixtures.py#L363-L53213:31
mriedemright i didn't tihnk i was using that13:31
sdagueright, you aren't13:31
sdagueand because of that, it doesn't work13:31
sdaguebecause engine facade is global13:32
mriedemhuh, i thought SimpleCellFixture would take care of things13:32
danpawlikMorning13:32
mriedemthis one https://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/tests/fixtures.py#L25713:32
sdagueI'm pretty sure that stopped working once there was the context manager calls13:32
*** esberglu has joined #openstack-nova13:32
*** markvoelker has quit IRC13:33
*** pwiltsey has joined #openstack-nova13:33
mriedemhttps://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/tests/fixtures.py#L328 ?13:33
sdaguehttps://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/compute/api.py#L2401 is basically where it goes off the rails13:33
*** prateek has quit IRC13:33
*** lucasxu has quit IRC13:33
*** sree has joined #openstack-nova13:33
mriedemthat shouldn't actually do anything https://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/tests/fixtures.py#L29613:33
sdaguethe inst_map.cell_mapping is13:34
sdagueCellMapping(created_at=None,database_connection='sqlite:///',id=1,name='onlycell',transport_url='fake://nowhere/',updated_at=None,uuid=1d5950cd-863a-4eb6-a3ec-3583fc93fbfc)13:34
mriedemsdague: yeah i think because of this https://github.com/openstack/nova/blob/76c2453682a7afa26ff2a7eb825e900af53a61d6/nova/tests/fixtures.py#L32813:34
mriedemi think SingleCellSimple is too simple here13:34
mriedemand why i wasn't sure it would work13:34
mriedemso that confirms it13:34
sdagueyeh13:34
*** lucasxu has joined #openstack-nova13:34
mriedemwell, i think i can add the cell1 mapping manually13:35
mriedemwe have the api db setup13:35
sdagueso, I guess the question is if you can pull that from your config13:35
sdagueyeh13:35
danpawlikmriedem: Please check my PS https://review.openstack.org/#/c/459753/ . Thanks!13:35
mriedemi think i just create the main cell db, and use that url for the cell1 mapping db connection13:35
sdaguemriedem: ok, but before you dive in there13:35
sdaguewe need to delete some overly agressive context unit tests - https://review.openstack.org/#/c/467995/13:36
sdagueto get a version of oslo.context out there that lets us do global request id13:36
mriedemdanpawlik: if that doesn't work for windows guests then you should probably point that out as a limitation in the release note13:37
*** jwcroppe has quit IRC13:38
*** yamahata has joined #openstack-nova13:39
danpawlikmriedem: it works on Windows13:39
danpawlikI checked it on my infra and it works without any problem13:40
*** baoli_ has joined #openstack-nova13:40
danpawlikmriedem: this functionality with vendor_id and fake hyperv id is additional. It normally works on new nvidia drivers13:41
*** sree has quit IRC13:42
*** sree has joined #openstack-nova13:43
*** baoli has quit IRC13:43
*** lucasxu has quit IRC13:43
*** lucasxu has joined #openstack-nova13:43
*** gomarivera has joined #openstack-nova13:44
*** eharney has joined #openstack-nova13:46
*** mtanino_ has joined #openstack-nova13:48
mriedemsdague: questions inline13:48
sdaguemriedem: looking13:48
*** sree has quit IRC13:49
*** Yangyapeng has quit IRC13:50
sdaguemriedem: I can add a really small test that just looks for our key adds13:50
mriedemwe should have something13:50
mriedemi'm also having a hard time seeing what's different in here http://logs.openstack.org/12/467812/1/check/gate-cross-nova-python27-ubuntu-xenial/1aa9e05/console.html#_2017-05-25_03_56_24_61742213:50
*** gianpietro has quit IRC13:51
mriedemglobal_request_id ?13:51
sdagueyes13:52
*** Yangyapeng has joined #openstack-nova13:53
*** jwcroppe has joined #openstack-nova13:53
mriedemsdague: is there a reason we don't call super from_dict? like is_admin_project is in the parent class from_dict but not the nova one13:55
mriedemwas just looking at https://github.com/openstack/nova/commit/80738df83f4cdd7a3143b157b73d1a9e6b3b2c4013:55
sdaguemriedem: only because legacy, which is totally going to screw us other places13:55
mriedemwas just looking at this https://github.com/openstack/nova/blob/master/nova/context.py#L19613:55
sdagueyeh13:55
*** crushil has joined #openstack-nova13:57
*** tbachman has quit IRC13:57
*** pchavva has quit IRC13:57
*** tidwellr has joined #openstack-nova13:58
*** pchavva has joined #openstack-nova13:58
sdagueour context on the other side of the RPC bus actually diverges a lot13:59
sdagueok, let me see about an additional fix here13:59
*** dhiaeddine has joined #openstack-nova14:01
*** dimtruck is now known as zz_dimtruck14:02
*** yamahata has quit IRC14:02
openstackgerritZhenyu Zheng proposed openstack/nova master: Send out notifications when instance tags changed  https://review.openstack.org/45992314:07
*** moshele has joined #openstack-nova14:08
*** jaypipes has joined #openstack-nova14:09
*** awaugama has joined #openstack-nova14:09
efriedjaypipes (hopefully) quick question...14:11
efriedjaypipes https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L443-L446  <== does this have a sync issue?14:12
*** coreywright has quit IRC14:12
efriedjaypipes If multiple clients are doing this at the same time for the same resource provider, that is?14:12
efriedjaypipes I guess in this context, since it's in the scheduler, and there's only one of those (right?) that's not possible...?14:13
jaypipesefried: that isn't the scheduler :)14:13
jaypipesefried: common mistake...14:13
efriedbah, ignorance14:13
jaypipesefried: that's in the compute resource tracker.14:13
jaypipesefried: which holds the COMPUTE_NODE_SEMAPHORE when that is called.14:13
*** pwiltsey has quit IRC14:13
efriedjaypipes Ah, the COMPUTE_NODE_SEMAPHORE.14:14
*** moshele has quit IRC14:14
*** pwiltsey has joined #openstack-nova14:14
jaypipesefried: we might consider adding some thread-level locking, though, if that routine would get hit outside of the compute node resource tracker (if, for example, _ensure_resource_provider() were called by some of the new claims routines, but I don't think that's going to be the case)14:14
efriedjaypipes Uhm, not finding that.  Am I spelling it right?14:14
*** markvoelker has joined #openstack-nova14:15
openstackgerritSean Dague proposed openstack/nova master: Have nova.context use super from_context  https://review.openstack.org/46799514:15
efriedjaypipes Well, next question would be whether it's kosher for me to take that (big-sounding) semaphore from my compute driver at init.14:15
sdaguemriedem: ok, hopefully that's better there14:15
jaypipesefried: https://github.com/openstack/nova/blob/master/nova/compute/resource_tracker.py#L64514:15
*** ijw__ has quit IRC14:15
jaypipesefried: COMPUTE_RESOURCE_SEMAPHORE, sorry14:15
*** kaisers_ has joined #openstack-nova14:15
efriedjaypipes I guess what I was hoping was that the placement API itself would have internal sync, and some kind of deterministic response if I POST a resource that's already there...14:16
efriedLike a 412 response, mebbe14:16
jaypipesefried: it does.14:17
mriedemsdague: ok going to also want dansmith to review this14:17
sdaguemriedem: sure14:17
jaypipesefried: there is a unique constraint on resource provider name which will throw a 409.14:17
*** sree has joined #openstack-nova14:17
efriedjaypipes Ah, good deal.  So I don't have to use that semaphore; I can just catch-and-ignore the 409.14:17
jaypipesefried: and then there is a generation field on the resource provider that is used to catch concurrent updates.14:17
jaypipesefried: look for ConcurrentUpdateDetected in the placement code.14:18
*** pwiltsey has quit IRC14:18
efriedjaypipes But of course I don't have to read the placement code to find this out, cause it's documented in the placement API ref, right?14:18
jaypipesefried: you mean like this does already? :) https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L388-L40014:18
openstackgerritDan Smith proposed openstack/nova master: re-Allow adding computes with no ComputeNodes to aggregates  https://review.openstack.org/46061614:18
jaypipesefried: placement api-ref is ongoing. avolkov is working on that.14:19
efriedjaypipes Perfect, thanks.  Missed that on my first couple read-throughs ;-)14:19
jaypipesavolkov: can you link efried your api-ref patch series so he can review please?14:19
efried(course I didn't know I was looking for 409, so I forgive myself)14:19
jaypipesefried: I live to serve.14:19
efried(though the comment is eminently helpful)14:19
dansmithmriedem: had to rebase again ^14:20
efriedjaypipes I'm still gonna have to come back atcha when it comes to identifying the shared-ness of my resource; but baby steps.14:20
avolkovefried: jaypipes: https://review.openstack.org/#/c/449765/14:20
*** vks1 has joined #openstack-nova14:20
*** kaisers_ has quit IRC14:20
mriedemdansmith: i bet you can do some horse trading with sdague on his context patch14:21
jaypipesefried: resources aren't shared :) resource providers are decorated with the MISC_SHARES_VIA_AGGREGATE trait.14:21
avolkovefried: jaypipes: and built version http://docs-draft.openstack.org/96/467596/2/check/gate-placement-api-ref-nv/7cd3495//placement-api-ref/build/html/14:21
*** acormier has joined #openstack-nova14:21
jaypipesefried: https://review.openstack.org/#/q/topic:cd/placement-api-ref+status:open14:22
mriedemdansmith: the rebase is gone14:22
mriedem*wrong14:22
*** sree has quit IRC14:22
jaypipesefried: you'll notice we use a similar strategy for most resource creation in the placement client: https://github.com/openstack/nova/blob/master/nova/scheduler/client/report.py#L784-L78914:22
mriedembut thanks for the stat padding14:22
mriedemoh wait14:22
*** READ10 has joined #openstack-nova14:23
mriedemyeah,14:23
mriedemwrong again14:23
*** markvoelker has quit IRC14:23
*** udesale has joined #openstack-nova14:23
efriedavolkov jaypipes Thanks y'all.14:23
*** udesale has quit IRC14:23
dansmithmriedem: okay, I'm doing like six things at once, so I'll look again in a sec14:24
*** yamamoto has quit IRC14:24
*** udesale has joined #openstack-nova14:24
*** ekuris has quit IRC14:25
*** r-daneel has joined #openstack-nova14:25
danpawlikmriedem: http://imgur.com/g5Mo9KT14:25
*** coreywright has joined #openstack-nova14:26
jaypipesdansmith: only six?14:26
*** jamesdenton has joined #openstack-nova14:27
dansmithjaypipes: I can only count that high14:27
*** armax has joined #openstack-nova14:27
danpawlikmriedem: I don't have ant problems to install new nvidia drivers if vendor is not set14:28
danpawlikmriedem: I try to install the newest drivers14:28
dansmithmriedem: oh, I don't get why git keeps dropping that removal14:29
mriedemdanpawlik: ok14:29
*** zz_dimtruck is now known as dimtruck14:29
mriedemdansmith: you can blame it on the rain, but you can't blame it on git14:29
mriedemsdague: question/comment in https://review.openstack.org/#/c/467995/14:29
*** felipemonteiro has joined #openstack-nova14:30
openstackgerritSean Dague proposed openstack/nova master: Migrate to oslo request_id middleware  https://review.openstack.org/46799814:30
sdaguemriedem: looking14:30
*** Swami has joined #openstack-nova14:30
*** Dave has quit IRC14:30
*** Swami has quit IRC14:31
dansmithmriedem: well, it just drops that hunk without calling it a conflict, so I'll blame it anyway14:32
*** ctrath1 has joined #openstack-nova14:32
*** kfarr has quit IRC14:32
openstackgerritDan Smith proposed openstack/nova master: re-Allow adding computes with no ComputeNodes to aggregates  https://review.openstack.org/46061614:32
dansmithmaybe we could merge this and avoid me chasing rebases14:32
sdaguemriedem: answered14:32
sdaguethe constructor for oslo.context in the from_ methods use the original class14:33
mriedemhttps://s-media-cache-ak0.pinimg.com/236x/75/c1/dc/75c1dcb4c3ab545deeb1f192eef3c0af.jpg?noindex=114:33
mriedemjust a bunch of hunks14:33
*** claudiub has quit IRC14:33
sdagueso that's how we still end up with nova context14:33
sdagueafter the super call14:33
sdaguelinks in review14:33
mriedem# TODO(sdague): also context has show_deleted, we should14:34
mriedemalso or oslo?14:34
*** ctrath has quit IRC14:35
mriedemdansmith: i've been your huckleberry for weeks on this one14:35
*** dimtruck is now known as zz_dimtruck14:35
sdaguemriedem: heh, yeh14:36
sdagueI can fix the typo14:36
openstackgerritSean Dague proposed openstack/nova master: Have nova.context use super from_context  https://review.openstack.org/46799514:37
mriedemalex_xu: jaypipes: re-confirming, but when deleting a service we don't actually delete the compute_nodes record,14:37
mriedemnothing actually deletes the compute_nodes record14:37
mriedemhttps://review.openstack.org/#/c/467220/4//COMMIT_MSG14:37
*** zz_dimtruck is now known as dimtruck14:37
*** lucasxu has quit IRC14:39
*** yamamoto has joined #openstack-nova14:39
openstackgerritMatt Rabe proposed openstack/nova master: Query deleted instance records during _destroy_evacuated_instances  https://review.openstack.org/46777414:40
danpawlikmriedem: new drivers install correctly. I will add mention about windows and vendor_id14:41
danpawlikin release notes soon14:41
*** sree has joined #openstack-nova14:41
edleafejaypipes: got a minute (or 10) to talk about https://review.openstack.org/#/c/465171/ ?14:43
jaypipesedleafe: on call for 15, then free.14:43
edleafejaypipes: okee dokee14:44
*** yamamoto has quit IRC14:44
*** vks1 has quit IRC14:45
*** hongbin has joined #openstack-nova14:45
*** ctrath1 has quit IRC14:45
*** sree has quit IRC14:46
cdentedleafe: ping me when you start, I'd like to ride along please14:46
edleafecdent: roger that14:46
sdaguemriedem: the context bits look good to you now?14:47
sdaguegiven that we're blocking a constraint update on that14:47
*** udesale has quit IRC14:48
mriedemsdague: +1 until dansmith can take a look14:48
sdagueok, cool14:48
dansmithmriedem: sdague: I got a call starting in a few and then I'll look14:48
sdaguedansmith: sounds good14:48
sdaguethank you14:48
sdaguemriedem: I have an orthoginal (but related question)14:49
sdaguefor nova to be a good player in global request id, and accept them, we need https://review.openstack.org/#/c/467998/14:49
*** thorst_ has joined #openstack-nova14:49
alex_xumriedem: yea, i think so. and interesting bug, add it into review list14:49
sdaguewhich is going to cause an extra http header to emit14:49
*** karthiks has joined #openstack-nova14:49
sdaguemicroversion?14:49
mriedemalex_xu: i'm fixing the test in that one14:49
sdaguealex_xu might also want to weigh in there14:50
*** gyee has joined #openstack-nova14:50
mriedemsdague: i tend to say yes, otherwise how do you know if the cloud has the header or not?14:50
mriedemhowever,14:50
*** Dave has joined #openstack-nova14:50
mriedemdo we hook in something that removes the header for requests < new microversion?14:51
sdaguenope14:51
mriedemotherwise the new microversion is only signaling14:51
sdaguecorrect14:51
sdaguealso, it depends on code version on the server and if they follow our upper constraints14:51
*** thorst has quit IRC14:51
sdagueit's definitely a little messy, and mostly annoying we didn't do this a long time ago14:52
mriedemsdague: we can't require a new minimum version of oslo.middleware?14:52
sdaguemaybe, I can look at the force on the requirements side14:52
sdaguewe could land it with the requirements force14:52
*** mdrabe has quit IRC14:54
mriedemyou want oslo.middleware>=3.27.0 it looks like14:55
mriedemfor https://github.com/openstack/oslo.middleware/commit/0e3dbba0d9d373fbfa9e28897cd33377e2491d3214:55
*** lucasxu has joined #openstack-nova14:56
sdagueyep14:56
alex_xuemm...any special reason for not having a microversion?14:56
*** ctrath has joined #openstack-nova14:56
sdaguehttps://review.openstack.org/#/c/468057/14:56
sdaguemriedem: ok, I'll build on top of that in my spider of crazy depends on14:57
*** ijw has joined #openstack-nova15:00
*** dave-mccowan has joined #openstack-nova15:00
*** claudiub has joined #openstack-nova15:01
*** markvoelker has joined #openstack-nova15:01
*** mdrabe has joined #openstack-nova15:01
*** ctrath has quit IRC15:01
edleafejaypipes: free?15:01
jaypipesedleafe: sorry, still on call.15:01
jaypipesedleafe: will ping you asap.15:01
edleafejaypipes: kewl15:02
*** ctrath has joined #openstack-nova15:02
*** ltomasbo is now known as ltomasbo|away15:04
*** pabelanger has left #openstack-nova15:04
openstackgerritSean Dague proposed openstack/nova master: Migrate to oslo request_id middleware - mv 2.46  https://review.openstack.org/46799815:05
*** marst_ has joined #openstack-nova15:05
*** ijw has quit IRC15:05
*** fragatina has joined #openstack-nova15:06
mriedemsdague: you'll throw a shoe, but we should have a bp and spec for that microversion15:06
mriedemi imagine it will be small15:06
* cdent throws shoe for sdague 15:07
*** gianpietro has joined #openstack-nova15:07
* mriedem catches shoe, tries it on15:07
* mriedem hobbles in circle15:07
sdaguemriedem: specless blueprint?15:07
cdentI should warn you, I do no the other one, so if you like that one, you're gonna hobble for a long time15:07
*** jamiec_ has quit IRC15:07
mriedemsdague: all api changes need a spec15:07
mriedemthems the rules15:07
*** jamiec has joined #openstack-nova15:08
mriedemsmcginnis: so what kind of fun dual maintenance path is it going to be for os-brick in both python and go?15:09
sdaguemriedem: ok, let me throw together something quick15:09
*** derekh has quit IRC15:10
mriedemjaypipes: isn't this vestigial now? https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L80015:10
mriedemadded in https://github.com/openstack/nova/commit/8941b45bc58a833261bb09fc7eb8fb5c765e154a15:11
mriedemwondering b/c of https://github.com/openstack/nova/commit/ea4754ba21ea08eb367d62bc46b5eba3777c119c15:12
jaypipesmriedem: yeah. the comment can be removed.15:12
*** felipemonteiro has quit IRC15:14
*** penick has joined #openstack-nova15:18
*** roeyc has joined #openstack-nova15:19
smcginnismriedem: Eh, it's inevitable.15:20
*** yamamoto has joined #openstack-nova15:20
*** yamamoto has quit IRC15:20
*** yingjun has joined #openstack-nova15:22
mriedemhmm, i've got questions about compute nodes and services records15:24
mriedemb/c something isn't adding up15:24
*** sree has joined #openstack-nova15:25
mriedemdeleting a nova-compute service record doesn't delete the compute_nodes record,15:25
mriedembut if you restart the nova-compute process, it's going to create a new services table record for the same host/binary/topic15:26
mriedemthe compute_nodes table entry has a service_id record in it15:26
mriedemthe resource tracker isn't going to create a new compute_nodes record because one already exists for the given host and nodename15:26
mriedembut, do we ever update the compute_nodes.service_id record anywhere?15:26
*** sree has quit IRC15:27
openstackgerritSean Dague proposed openstack/nova-specs master: oslo.middleware request_id spec  https://review.openstack.org/46806615:27
sdaguemriedem: ok, spec ^^^15:27
*** sree has joined #openstack-nova15:28
mriedemok15:28
*** yingjun has quit IRC15:29
*** Oku_OS is now known as Oku_OS-away15:29
mriedemjaypipes: do we actually not tie the compute nodes record to the nova-compute service anywhere?15:30
mriedemah looks like it's not, by design15:31
mriedemsince it's all deprecated15:31
*** sree has quit IRC15:32
*** ctrath has quit IRC15:35
mriedemoh snap15:35
*** ctrath has joined #openstack-nova15:35
mriedemalex_xu: we do soft delete the compute node record when the service is deleted,15:36
mriedemif they are tied together,15:36
mriedemwhich happens for very old compute nodes records15:36
mriedemhttps://github.com/openstack/nova/blob/65402e1aeb770d077620f2935a0cb305474aa7a1/nova/db/sqlalchemy/api.py#L46115:36
jaypipesmriedem: we removed the direct linkage between the two on purpose15:37
mriedemhttps://github.com/openstack/nova/blob/65402e1aeb770d077620f2935a0cb305474aa7a1/nova/db/sqlalchemy/api.py#L46115:37
mriedemyeah15:37
mriedemthe db api tests are still doing the very old style linkage15:37
mriedemso testing using those for a modern setup is really confusing15:37
*** pcaruana has quit IRC15:38
*** awaugama has quit IRC15:38
*** yingjun has joined #openstack-nova15:38
*** pcaruana has joined #openstack-nova15:39
*** ltomasbo|away is now known as ltomasbo15:39
*** thorst_ has quit IRC15:39
*** jmlowe has quit IRC15:42
*** Yangyapeng has quit IRC15:43
*** yingjun has quit IRC15:43
jaypipesedleafe: k, sorry about that. ready now.15:46
jaypipeshangout?15:46
*** gianpietro has quit IRC15:46
*** lucasagomes is now known as lucas-afk15:47
*** danpawlik is now known as _danpawlik15:48
*** hshiina has joined #openstack-nova15:48
*** tbachman has joined #openstack-nova15:48
*** crushil has quit IRC15:50
mriedemsdague: -1 is specifically for expanding on this https://review.openstack.org/#/c/468066/1/specs/pike/approved/oslo-middleware-request-id.rst@4815:51
mriedemotherwise +215:51
sdaguemriedem: so, it's not sufficient that the patch already has that in it?15:52
mriedemthe spec is a doc15:52
sdaguesure15:52
mriedempublished as a doc, people reading those later shouldn't have to dig through lp to find the patch15:52
*** efoley_ has quit IRC15:52
edleafejaypipes: cdent: so you suggested passing the instance UUIDs in the reqspec15:52
edleafeThat was my original approach, but dansmith preferred the RPC parameter approach, so I changed it15:53
edleafejaypipes: see https://review.openstack.org/#/c/463623/15:53
jaypipesedleafe: right.15:53
jaypipesedleafe: lemme walk through in my head whether the recent "continuing the automatic reschedule behaviour" thing affects my decision on that...15:54
cdentedleafe: I don't really have a strong opinion. my natural inclination is parameters, but that's not been seasoned by years of nova-based RPC15:54
*** shaner has quit IRC15:55
edleafejaypipes: cdent: my preference was reqspec (which is why I did it that way first), since it already had the pretty much useless 'instance_uuid' attribute15:55
openstackgerritSean Dague proposed openstack/nova-specs master: oslo.middleware request_id spec  https://review.openstack.org/46806615:55
jaypipesdansmith: can you, in one sentence, explain your preference to change the RPC interface vs. add a field to the reqspec object?15:55
sdaguemriedem: done15:55
jaypipesdansmith: I want to make sure I understand you completely.15:55
dansmithjaypipes: we don't need to store the uuids in the database, right?15:56
*** phuongnh has joined #openstack-nova15:56
*** shaner has joined #openstack-nova15:56
dansmithwe've had this conversation a couple times15:56
edleafedansmith: but there is already the 'instance_uuid', which we don't store either15:56
dansmithedleafe: um, what?15:57
dansmithalready instance_uuid in the reqspec?15:57
edleafeyup15:58
edleafedansmith: https://review.openstack.org/#/c/463623/5/nova/objects/request_spec.py@7715:58
dansmithwhat do you mean we don't store it15:58
dansmith?15:58
dansmith...right, I know it's in there15:58
edleafewell, we don't *need* to store it15:58
edleafeit's useless if num_instances > 115:59
dansmithokay not sure what that has to do with not adding another thing we don't need to store, which could be a hundred uuids :)15:59
*** penick has quit IRC15:59
mriedemfuel on the fire makes it better right?15:59
*** mdnadeem has quit IRC15:59
mriedemat what point do we add kitchen_sink to request spec?15:59
*** penick has joined #openstack-nova15:59
*** thorst has joined #openstack-nova16:00
edleafeI understand the reqspec to be the vehicle for passing the requested info to the scheduler16:00
edleafethe scheduler needs this info16:00
jaypipesdansmith: so the reason I was advocating passing in all the instance uuids in the reqspec was because I wanted to get rid of the retry stuff and do all of that in the scheduler (and thus we'd need all those UUIDs). But now that that is off the table, I'm not sure it makes sense any more.16:01
dansmithaye16:01
edleafejaypipes: it definitely does16:01
*** thorst has quit IRC16:02
edleafeif num_instances > 1, how will the scheduler claim the resources if it doesn't know the consumer_id?16:02
dansmiththe uuid list is only something that makes sense for a single call to the scheduler, AFAIK, so it shouldn't be stuffed into the database, just something we pass like anything else, IMHO16:02
*** lucasxu has quit IRC16:03
jaypipesedleafe: a fair point.16:03
*** lucasxu has joined #openstack-nova16:03
jaypipesedleafe: if we moved the handling of num_instances > 1 to the conductor, though...16:03
*** thorst has joined #openstack-nova16:04
jaypipesedleafe: we'd need more robust concurrent update handling in the conductor, then.16:04
edleafejaypipes: sp the conductor would make num_instances calls to the scheduler, instead of 1?16:04
jaypipesedleafe: I'm spitballing.16:04
*** penick has quit IRC16:04
edleafeWe'd also have to run the host queries num_instances times instead of once16:04
jaypipesedleafe: right.16:05
openstackgerritMatt Riedemann proposed openstack/nova master: Exclude deleted service records when calling hypervisor statistics  https://review.openstack.org/46722016:05
*** Yangyapeng has joined #openstack-nova16:05
edleafeyou're spitballing; I'm poking holes16:05
edleafe:)16:05
mriedemKevin_Zheng: ^ i updated the commit message and re-wrote the test a bit16:05
jaypipesedleafe: I'm thinking out loud.16:05
mriedemwith a bunch of comments to explain it16:05
edleafeme too16:05
edleafeI've thought about these a lot already, though :)16:05
sdaguemriedem: I'm confused about your comment on https://review.openstack.org/#/c/467995/ about implications for versioned objects16:06
sdaguemaybe that's where we need dansmith poking16:06
openstackgerritEd Leafe proposed openstack/nova master: Pass the number of hosts to return explicitly  https://review.openstack.org/46576716:07
openstackgerritEd Leafe proposed openstack/nova master: Remove selecting host based on host_subset_size  https://review.openstack.org/46517416:07
openstackgerritEd Leafe proposed openstack/nova master: Return multiple hosts from select_destinations  https://review.openstack.org/46576816:07
*** Apoorva has joined #openstack-nova16:07
edleafejaypipes: ^^ The series is ready for review. I can switch the passing of UUIDs if needed16:08
jaypipesedleafe, dansmith: for retries, do we ever retry the entire list of instances (in a num_instances > 1 case) or do we just retry the launch of one of them?16:08
edleafejaypipes: if we retry the whole list, that would be very dumb16:08
edleafesince some could have already been successful16:08
jaypipesedleafe: well, it all depends on how "atomic" we view the num_instances > 1 case, right?16:09
*** roeyc has quit IRC16:09
dansmithjaypipes: we've lost scope of the others by the time we're retrying any of them16:10
dansmithjaypipes: and they might've scattered across cells16:10
dansmithjaypipes: as you've pointed out, the api implies atomicity, and we guarantee almost none16:10
mriedemsdague: yes, that's my call for dan16:10
*** roeyc has joined #openstack-nova16:10
*** nic has joined #openstack-nova16:10
edleafethe min_count and max_count were supposed to provide a go/no-go atomicity16:11
*** roeyc has quit IRC16:11
*** Apoorva_ has joined #openstack-nova16:11
sdaguemriedem: ok, cool. Jenkins is currently a happy camper, so there is at least that16:12
jaypipesdansmith, edleafe: ok, random idea here... what if we triggered claims in the scheduler only if num_instances == 1? at least for right now... and let the num_instances > 1 case be handled in the same wonky claim-on-compute way it is now?16:13
dansmithoh please god no16:13
cdentwhat would that gain?16:14
dansmithjaypipes: nobody wants to claim on compute right?16:14
jaypipesit would mean we would solve the 80% case now. and come up with a solution for the 20% case later.16:14
edleafejaypipes: yeah, that sounds terrible16:14
*** Apoorva has quit IRC16:15
edleafethe only thing missing to solve 100% of the claims is the instance UUIDs.16:15
edleafeAs long as we pass those in some form to the scheduler, we are good16:15
* cdent agrees with edleafe 16:15
edleafethe only question is what is the best way to pass them16:15
jaypipesedleafe: right, but what I'm saying is we solve that later and for the first patch(es), we bite off what we can chew for right now.16:15
jaypipesinstead of trying to solve everything at once.16:16
edleafeIMO the patches are bite-sized16:16
jaypipesedleafe: the patches might be. the debate isn't. :)16:16
mriedempass them over rpc16:16
mriedemdon't store them in the db16:16
mriedemi thought that was clear?16:16
dansmithmriedem: me too16:17
jaypipesmriedem: nobody has suggested storing them in the DB.16:17
*** Apoorva_ has quit IRC16:17
edleafemriedem: well, if that's the decision, then everything is ready for review16:17
dansmithjaypipes: perhaps we can nail this down quicker in a hangout?16:17
dansmithjaypipes: edleafe did :)16:17
jaypipeshe did?16:17
mriedemif you put them in the reqspec they go in the db unless you monkey the object to not persist16:17
mriedembut that seems wrong16:17
edleafeI suggested putting them in the reqspec16:17
*** Apoorva has joined #openstack-nova16:17
jaypipesok.16:17
edleafeso I guess DB storage is inevitable :)16:17
mriedemi mean sure you can throw any attribute on an object and it won't persist16:17
mriedemif it's not in the model16:18
jaypipesright16:18
edleafejaypipes: to be fair, you suggested the same thing :)16:18
jaypipesthat's what I thought we were going to do..16:18
edleafeme too16:18
jaypipesedleafe: not store in the DB. I suggested just tacking instance_uuids as a field on the object, since that would avoid an RPC API change.16:18
mriedemit seems very not intuitive16:18
dansmithjaypipes: it doesn't avoid an rpc change16:18
mriedem2 years from now someone is going to ask, wtf, why are these on this object but not in the db?16:18
dansmithyeah16:18
dansmithit's silly to do that16:19
*** savvas has quit IRC16:19
cdentthere's nothing wrong with an rpc api change, and it is semantically clean. let's just do that.16:19
jaypipesfine. call me silly. I don't care.16:19
edleafeI've done it both ways, so I don't care either :)16:19
cdent"that" == add a param16:19
dansmithjaypipes: you know you're just generally silly anyway :)16:19
jaypipesindeed.16:19
jaypipesok, follow on question...16:19
*** awaugama has joined #openstack-nova16:20
jaypipeslet's say we pass an instance_uuids param to the scheduler. cool, fine by me. But what about the whole "alternate destinations" thing that is designed to solve the no-cell-upcall issue?16:20
jaypipesare we still going for that?16:20
dansmith...16:21
dansmithhave there been other suggestions on how to resolve that other than doing the alternates thing?16:21
*** yamamoto has joined #openstack-nova16:21
*** Apoorva has quit IRC16:22
edleafejaypipes: have you seen https://review.openstack.org/#/c/465767/ ?16:22
cdentI gotta run, if there's a summary of this, can someone let me know somehow later this evening?16:22
edleafecdent: will do16:22
cdentthanks16:22
*** cdent has quit IRC16:22
jaypipesdansmith: not that I'm aware of. was just trying to catch up my thoughts on this series.16:23
dansmithokay16:23
edleafeAdding alternates changes the result of select_destinations() from a list of hosts to a list of a list of hosts16:23
jaypipesedleafe: and you/we are OK with that, yes?>16:24
*** Apoorva has joined #openstack-nova16:24
*** pchavva has quit IRC16:24
edleafeIt wasn't my preference, no16:24
edleafeBut it was a big request from operators, so...16:24
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/46808916:25
mriedemalex_xu: oomichi: we're kind of at an impass with some of the new cinder attachment reviews - john and i are the only reviewers on these but i'm also working on the patches too, so we need a 3rd core to help move some stuff along, can you help review the 3 bottom changes in this series which already have a +2 from john? https://review.openstack.org/#/c/456896/16:25
mriedem*impasse16:25
*** crushil has joined #openstack-nova16:25
jaypipesedleafe: is there a reason you undid Sylvain's changes from patch 10 on https://review.openstack.org/#/c/460177/10..11/nova/compute/resource_tracker.py?16:29
jaypipesedleafe: I'd asked him to change the dict comprehension into a simple tracked_keys = set(self.tracked_instances.keys())16:29
jaypipesedleafe: and you undid that.16:30
jaypipesedleafe: and changed instance_uuid -> allocation_uuid.16:30
edleafejaypipes: probably a rebase screw-up16:30
*** pcaruana has quit IRC16:30
jaypipesedleafe: just a case of rebase screw up?16:30
jaypipesedleafe: jinx :)16:30
edleafeI rebased my series on master, and his is in the series16:30
jaypipesedleafe: could you please push quick update on that?16:30
*** pcaruana has joined #openstack-nova16:30
jaypipesedleafe: and I will quick approve.16:30
edleafeI'll fix that in a bit16:30
jaypipessince dansmith is already +2 on that16:31
edleafegimme a few16:31
*** yamamoto has quit IRC16:32
dansmithmriedem: what ovo impact do you think that context change has?16:33
mriedemdansmith: don't know, but i've thought in the past when we talk about changes to context it can have implications for rpc16:34
mriedemso i was waiting for you16:34
dansmithmriedem: you might also want to get a read from tonyb or jamie on it.. there was some upgrade issue when we bumped oslo.context the last time16:34
dansmithmriedem: yeah, rpc, but not ovo specifically that I know of16:34
mriedemwaiting for tony isn't going to be an option16:34
dansmithtonyb was the one handling the upgrade issue last time16:34
openstackgerritSean Dague proposed openstack/nova-specs master: oslo.middleware request_id spec  https://review.openstack.org/46806616:35
openstackgerritSean Dague proposed openstack/nova master: Migrate to oslo request_id middleware - mv 2.46  https://review.openstack.org/46799816:36
sdaguemriedem ok all the cross links and blueprint bits filed16:36
sdaguedansmith: how do you imagine it would have an impact?16:37
openstackgerritEd Leafe proposed openstack/nova master: Have scheduler claim resources  https://review.openstack.org/46399316:38
openstackgerritEd Leafe proposed openstack/nova master: Pass the number of hosts to return explicitly  https://review.openstack.org/46576716:38
openstackgerritEd Leafe proposed openstack/nova master: Remove selecting host based on host_subset_size  https://review.openstack.org/46517416:38
openstackgerritEd Leafe proposed openstack/nova master: Make the method to put allocations public  https://review.openstack.org/46408616:38
openstackgerritEd Leafe proposed openstack/nova master: Pass a list of instance UUIDs to scheduler  https://review.openstack.org/46517116:38
openstackgerritEd Leafe proposed openstack/nova master: Return multiple hosts from select_destinations  https://review.openstack.org/46576816:38
dansmithsdague: i don't recall the details, which is why I said, but I think that during one of the bumps, we could end up with say a new compute sending a context to an old compute that it couldn't parse or something.. like maybe it wasn't defensive enough in the original version maybe?16:38
edleafejaypipes: ^^ should be fixed16:38
sdaguedansmith: maybe, the from_dict is pretty defensive16:39
dansmithsdague: if the super'd method is defensive with gets like ours is there, then I guess we're okay for this change, I just don't know16:39
sdagueit's all .get() calls16:39
*** udesale has joined #openstack-nova16:39
mriedemhmm,16:39
dansmithsdague: yeah, either it wasn't before or there was some really subtle detail16:39
mriedemwe do have tests for this16:39
sdaguehttps://github.com/openstack/oslo.context/blob/cce83ad5e12baf2edc0e12c2944c587224e71148/oslo_context/context.py#L358-L38216:39
mriedemin the grenade live migration job we have the back and forth live migration thing16:39
sdaguemriedem: right16:39
mriedemlet me see if that's happening16:39
mriedemit was dependent on a devstack backport to ocata16:39
sdaguedansmith: it may not have been a long time ago16:40
sdaguejamielennox definitely did a bunch of work on this16:40
dansmithsdague: yeah, that came out of tonyb highlighting the issue I think16:40
dansmithI recall,16:40
jaypipesedleafe: you didn't push the right patch.16:40
dansmithI just don't know the deets16:40
mriedemit was blown up the last midcycle at intel16:40
mriedemwhich was newton16:40
dansmithright16:40
jaypipesedleafe: https://review.openstack.org/#/c/460177/ was the patch in question.16:40
sdaguethe worst thing I think that could happen is if we API (new) create context -> cpu (old)16:40
*** rcernin has quit IRC16:40
jaypipesedleafe: you pushed all the ones above that.16:40
sdaguethen pass it back to something new16:40
dansmithyeah16:41
sdaguewhich means some bits would be lost and fall back to defaults16:41
sdaguelike global_request_id will end up zeroed out16:41
mriedemsdague: ah you merged it https://review.openstack.org/#/c/466033/16:41
mriedemso yeah it should be running16:41
dansmithanyway, if we can't want, then I guess we just do it assuming the tests pass, I'm just saying.. there were dragons here last time and I don't know what they all were16:41
dansmith*wait16:41
edleafeHmmm... I thought when I changed it back it would push that16:41
openstackgerritEd Leafe proposed openstack/nova master: Have scheduler claim resources  https://review.openstack.org/46399316:43
openstackgerritEd Leafe proposed openstack/nova master: Pass the number of hosts to return explicitly  https://review.openstack.org/46576716:43
openstackgerritEd Leafe proposed openstack/nova master: Remove selecting host based on host_subset_size  https://review.openstack.org/46517416:43
openstackgerritEd Leafe proposed openstack/nova master: Make the method to put allocations public  https://review.openstack.org/46408616:43
openstackgerritEd Leafe proposed openstack/nova master: Don't delete allocation if instance being scheduled  https://review.openstack.org/46017716:43
openstackgerritEd Leafe proposed openstack/nova master: Pass a list of instance UUIDs to scheduler  https://review.openstack.org/46517116:43
openstackgerritEd Leafe proposed openstack/nova master: Return multiple hosts from select_destinations  https://review.openstack.org/46576816:43
sdaguemriedem: yeh, that passed, was there something you were looking for specifically?16:43
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: SSP emphemeral disk support  https://review.openstack.org/44318916:43
edleafejaypipes: ^^ ok, I made a small whitespace change to make sure it got pushed16:43
*** jheroux has joined #openstack-nova16:44
sdaguemriedem / dansmith if there is an old bug here I could figure out if that could happen again16:44
mriedemlooking16:45
jaypipesedleafe: approved.16:46
jaypipesdansmith: https://review.openstack.org/#/c/464086 is ready for your blessing.16:46
sdaguemriedem: I think this was the relevant fix https://review.openstack.org/#/c/341895/16:46
*** ltomasbo is now known as ltomasbo|away16:48
*** prateek has joined #openstack-nova16:49
sdaguehttps://bugs.launchpad.net/nova/+bug/1603979 is this the bug?16:50
openstackLaunchpad bug 1603979 in OpenStack Compute (nova) "gate: context tests failed because missing parameter "is_admin_project" (oslo.context 2.6.0)" [Critical,Fix released] - Assigned to Tang Chen (tangchen)16:50
sdagueso tonyb's fix is just unit test fixes16:51
sdagueit's nothing actually functional16:51
sdaguehttps://review.openstack.org/#/c/342604/16:51
dansmiththe thing I'm talking about was identified before we bumped the version in u-c16:51
dansmithso probably not that bug16:51
mriedemhttp://logs.openstack.org/95/467995/3/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/46deb21/logs/new/tempest_conf.txt.gz16:52
mriedemlive_migrate_back_and_forth = True16:52
dansmithanyway, if you guys are confident and see tests, then just do it16:52
sdaguedansmith: ok, I'm having a hard time finding any reference to what that was16:52
dansmithsdague: my major involvement was a hallway conversation and shared laptop screen with tonyb16:52
*** dtp has joined #openstack-nova16:52
sdaguethis would have been midcycle? http://lists.openstack.org/pipermail/openstack-dev/2016-July/099467.html16:53
mriedemit might have also been some capped requirement crap16:54
mriedemin stable16:54
sdaguebecause the dates for the unit test break are all around this16:54
mriedemyes newton midcycle16:54
sdagueright, so that was entirely about unit tests16:54
mriedemconfirmed that we're doing the back and forth live migration in that grenade job http://logs.openstack.org/95/467995/3/check/gate-grenade-dsvm-neutron-multinode-live-migration-nv/46deb21/logs/tempest.txt.gz#_2017-05-25_15_16_25_89516:54
mriedemso we should be happy16:54
sdagueactually these same unit tests blocking the the current oslo.context uc bump16:54
edleafejaypipes: running out for a bit. I'll answer any other questions when I get back.16:55
sdaguemriedem: cool16:55
mriedem+216:55
*** vks1 has joined #openstack-nova16:56
*** mvk has quit IRC16:57
sdaguemriedem: great16:57
*** felipemonteiro has joined #openstack-nova16:58
sdagueok, need another +2 to unblock uc16:58
*** Swami has joined #openstack-nova16:58
*** baoli_ has quit IRC16:59
mriedemi need a plate of food to unblock my hunger17:00
*** ralonsoh has quit IRC17:01
*** ijw has joined #openstack-nova17:01
*** cuhler has joined #openstack-nova17:01
mriedem+2 on the spec also17:01
*** baoli has joined #openstack-nova17:04
*** dikonoor has quit IRC17:04
*** yamamoto has joined #openstack-nova17:06
cfriesenfor upgrading from newton (without any cells) to ocata, what nova-manage commands are needed prior to the migration?  I think it's "nova-manage cell_v2 simple_cell_setup", "nova-manage db sync", "nova-manage api-db sync", and "nova-manage db online_data_migrations".  Am I missing anything?   (And when would you use "nova-manage cell_v2 map_cell0" instead?)17:06
cfriesenI'm looking at the upgrade notes and some of the cellsv2 stuff is a bit ambiguous17:07
*** dhiaeddine has quit IRC17:09
cuhlerHi mriedem, os-brick version has been bumped (incl global-requirements here: https://review.openstack.org/#/c/467757/). Can you please remove the workflow -1 and review Veritas nova volume driver at https://review.openstack.org/#/c/443951/? Thx.17:09
*** yamamoto has quit IRC17:10
*** gianpietro has joined #openstack-nova17:11
mriedemcfriesen: https://docs.openstack.org/developer/nova/cells.html#upgrade-minimal17:11
mriedemhttps://docs.openstack.org/developer/nova/man/nova-manage.html#nova-cells-v217:11
mriedemhttps://docs.openstack.org/developer/nova/cells.html#faqs17:11
mriedemcuhler: sure17:12
cfriesenmriedem: thanks17:12
sdaguemriedem: great17:12
openstackgerritMatt Riedemann proposed openstack/nova master: Libvirt volume driver for Veritas HyperScale  https://review.openstack.org/44395117:15
mriedemcuhler: +217:15
mriedemnow you must fish for another core17:15
*** jmlowe has joined #openstack-nova17:16
*** jmlowe has quit IRC17:16
*** rmart04 has quit IRC17:16
cfriesenmriedem: re the point about newton expecting a different name for the cell0 database...does that cause problems when later upgrading to ocata?17:16
mriedemcfriesen: have you created a cell0 db yet?17:17
mriedemand if so, what did you name it?17:17
*** jmlowe has joined #openstack-nova17:17
cfriesennope...planning on holding off till the ocata upgrade if I can17:17
cfriesenI'm just trying to figure out what I should do after upgrading to newton17:17
mriedemok, if you're running the nova-manage commands from ocata code you'll be fine17:17
cfriesencool, will hold off then17:18
mriedemneed to get https://review.openstack.org/#/c/420461/ into newton, along with it's dependencies17:18
mriedemsdague: ^ could you poke through those?17:18
mriedemthere is a dependent grenade and devstack backport in there17:18
*** sambetts is now known as sambetts|afk17:18
*** udesale has quit IRC17:20
*** lucasxu has quit IRC17:20
sdaguelooking17:20
*** penick has joined #openstack-nova17:21
*** phuongnh has quit IRC17:21
cuhlermriedem: thanks17:23
sdaguemriedem: lgtm17:24
*** gianpietro has quit IRC17:24
*** gianpietro has joined #openstack-nova17:25
*** jpena is now known as jpena|off17:26
mriedemthanks17:28
mriedemdansmith: this is going to need your loving care https://review.openstack.org/#/c/420461/ - that's the newton backport to fix the default cell0 db name connection string we talked about yesterday17:28
*** gianpietro has quit IRC17:29
mriedemmelwitt: do you want me to hold off on https://review.openstack.org/#/c/446239/ for now?17:30
*** arunman has quit IRC17:30
*** acormier has quit IRC17:31
*** cuhler has quit IRC17:31
mriedemmelwitt: we could probably do facade thing for count() in the object code in a separate cleanup if we want to move forward17:31
*** acormier has joined #openstack-nova17:31
melwittmriedem: I was gonna wait until you were done with the tests to update anything to get them all at once. but, if I remove count() from nova/quota then I need to add a test for the facade thing in nova/objects/quotas. so it's up to you, want me to update it first and then you look again?17:32
mriedemlet me skim the tests first17:32
*** gszasz has quit IRC17:32
melwittk. I'm just running through the facade change locally to make sure things don't break17:33
*** acormier has quit IRC17:35
mriedemmelwitt: why is test_reservation_expire removed?17:39
melwittmriedem: gah, I meant to put that back. accidental removal17:40
mriedemok, i'll leave a reminder17:40
melwittthanks17:40
*** acormier has joined #openstack-nova17:42
*** savvas has joined #openstack-nova17:42
*** acormier has quit IRC17:43
*** acormier has joined #openstack-nova17:44
*** crushil has quit IRC17:45
*** fragatina has quit IRC17:47
savvasmriedem: I noticed your fingerprints on https://blueprints.launchpad.net/nova/+spec/flavor-root-disk-none . Is there a best practice suggestion to secure this? For example I am bypassing the quota limitation on my local disks by removing the DiskFilter filter from nova (which is far from ideal..) but I have no way to enforce instances being created with use of cinder volumes instead of local block devices.17:47
*** acormier has quit IRC17:48
*** acormier has joined #openstack-nova17:49
savvasI found this in nova.conf: max_local_block_devices but again this would not be ideal as reading the comments suggests that it won't pick alternative storage instead.17:51
mriedemsavvas: max_local_block_devices isn't what you think it is17:53
mriedemsavvas: otherwise i don't think there is a way to force users to boot from volume17:53
mriedemlet me find something for you to read17:53
mriedemsavvas: http://lists.openstack.org/pipermail/openstack-dev/2017-May/117012.html17:54
*** rmart04 has joined #openstack-nova17:54
*** lpetrut has quit IRC17:54
*** claudiub has quit IRC17:56
openstackgerritDan Smith proposed openstack/nova master: re-Allow adding computes with no ComputeNodes to aggregates  https://review.openstack.org/46061617:56
*** eharney has quit IRC17:57
mriedemmelwitt: ok comments posted17:59
*** ctrath has quit IRC18:00
melwittmriedem: thanks, looking18:00
*** vks1 has quit IRC18:00
*** ctrath has joined #openstack-nova18:00
*** crushil has joined #openstack-nova18:03
savvasmriedem: interesting. So at this time there is no way to bypass/secure this limitation in the software?18:03
mriedemsavvas: i'm not aware of one outside of patches people have put into their systems18:05
mriedemsavvas: the outcome of that session was to write a spec for the short-term solution to auto-create block device mappings based on the flavor (which the operator controls) if bdms aren't requested by the user18:06
mriedemnot using extra specs18:06
savvasye the short term solution sounds acceptable though18:06
mriedemsays the guy that wants *anything*18:06
mriedem:)18:07
mriedemthat's all queens release at this point18:07
jaypipesmriedem, dansmith: if you have time. https://review.openstack.org/#/c/461574/18:07
savvashehe, ye ;>18:07
*** baoli has quit IRC18:08
mriedemjaypipes: didn't you need an os-traits release and g-r bump for something in this series?18:08
savvasbasically it menas if we end up selling a project based solution, at this point having api or heat available to the tenant could lead to resource exhaustion18:08
*** prometheanfire has joined #openstack-nova18:09
mriedemsavvas: there is the reserved_host_disk_mb config option18:09
prometheanfiremriedem: hi18:09
prometheanfirehttp://logs.openstack.org/76/466476/9/check/gate-cross-nova-python27-ubuntu-xenial/89a6a52/testr_results.html.gz18:09
*** gjayavelu has joined #openstack-nova18:09
mriedemprometheanfire: was this the same thing as last week?18:10
prometheanfirethink the new dogpile.cache makes nova sad18:10
prometheanfireprobably18:10
mriedemor 2 weeks ago18:10
mriedemdid you open a bug for that?18:10
jaypipesmriedem: no, that was this series: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/resource-provider-traits18:10
mriedemjaypipes: ah ok18:10
mriedemprometheanfire: please report a bug18:10
mriedemi'm doing 4 things at once atm18:10
prometheanfireya18:11
prometheanfirethough I don't see a commit that'd do that18:11
jaypipesmriedem: also, global requiremnts is already at os-traits >= 0.3, so we're cool.18:11
jaypipesmriedem: just need to rebase that fix conflicts18:11
dansmithjaypipes: so you still feel it's important/useful to have that giant sql query in comments inline there?18:11
*** david-lyle has joined #openstack-nova18:12
dansmithI commented on that, but don't think I saw a reply18:12
jaypipesdansmith: you asked me to remove it from the commit message, which I did.18:12
jaypipesdansmith: some (cdent, edleafe I think) have said the SQL in the code comment is useful.18:12
mriedemdansmith: the example or the whole thing?18:13
melwittare they dreaming in SQL now too?18:13
mriedemwe do need a book describing what the massive sql build up is doing18:13
mriedemthe example starting at L829 could get outdated over time18:13
dansmithjaypipes: you're right, I never committed that comment18:13
openstackgerritJay Pipes proposed openstack/nova master: integrate trait cache with TraitList and Trait  https://review.openstack.org/46277018:14
openstackgerritJay Pipes proposed openstack/nova master: add cache which keeps DB and os_traits in sync  https://review.openstack.org/46276918:14
dansmithanyway, 200 lines of sql comment before any code is really distracting for me and I'd rather that be in devref if it's really useful to keep,18:14
dansmithbut I'm clearly in the minority18:14
jaypipesdansmith: the comment is explaining how the SQLAlchemy joins are being built up.18:14
*** baoli has joined #openstack-nova18:14
jaypipesbut again, whatevs, I'm happy to move it. just let me know.18:15
dansmithI know18:15
*** baoli has quit IRC18:15
dansmithanyway, I don't think I can really review the sqla and find anything wrong with it, but I'm okay with just going based on the tests if that doesn't scare anyone else18:15
mriedemwe should have med_ look at it to spot the bug in the query like during the talk at the summit :)18:15
med_heh18:15
jaypipesheh, reminds me I need to fix those slides...18:16
med_only if you are giving away t-shirts for my son.18:16
*** eharney has joined #openstack-nova18:16
melwittI had assumed those were copied from the code, so it made me wonder if the code had the bugs too18:17
*** david-lyle has quit IRC18:19
mriedemdansmith: i'm in the same boat, i'm going to have to review mostly based on tests18:19
*** hshiina has quit IRC18:19
dansmithmriedem: okay18:19
*** lyan has quit IRC18:19
*** slaweq has joined #openstack-nova18:19
mriedemalso, with shit like this, we're going to have to jump in at some point and work out the bugs afterward18:20
mriedemwhile jay is still working with us :)18:20
jaypipesthanks for all your votes of confidence guys.18:20
mriedemha18:20
melwittmriedem: thanks for catching the gaps in the tests. I've changed things so many times I've lost track of some of them18:21
mriedemjaypipes: you realize i'm not commenting on your technical ability but the fact this is a complicated new system being built, and therefore has to have bugs creep out over time18:21
*** dgonzalez has quit IRC18:22
*** dgonzalez has joined #openstack-nova18:22
openstackgerritEric Fried proposed openstack/nova master: Nix redundant dict in set_inventory_for_provider  https://review.openstack.org/46812318:24
*** lucasxu has joined #openstack-nova18:25
*** slaweq has quit IRC18:26
*** baoli has joined #openstack-nova18:27
*** fragatina has joined #openstack-nova18:28
*** jmlowe has quit IRC18:28
*** fragatina has quit IRC18:30
*** fragatina has joined #openstack-nova18:30
*** baoli has quit IRC18:30
*** kaisers_ has joined #openstack-nova18:31
*** baoli has joined #openstack-nova18:32
openstackgerritSean Dague proposed openstack/python-novaclient master: Have python-novaclient support global_request_id  https://review.openstack.org/46812618:32
sdaguemriedem: someone broke stable/newton and turned on a trusty upgrade job - https://review.openstack.org/#/c/420750/18:34
sdaguelast time that happened it was related to a bad exclude rule by cinder18:34
mriedemi'm having a hard time parsing that18:35
mriedemfailing in the gate?18:35
mriedemand exclude rule on a job in project-config?18:35
smcginnissdague: I had made changes there, but that was a few weeks back now.18:35
*** jmlowe has joined #openstack-nova18:35
smcginnissdague: AFAIK, all grenade jobs should have been blocked on stable/newton.18:35
*** fragatina has quit IRC18:36
sdaguesmcginnis: I have no idea the last time someone tried to get grenade changes on stable/newton through, it's not very often18:36
sdaguemriedem: yes, it's running a job it definitely should not be18:36
*** kaisers_ has quit IRC18:36
smcginnissdague: Now that mitaka is EOL, it shouldn't ever be done.18:36
sdaguesmcginnis: agreed18:37
sdaguemriedem: anyway, the backport fixes for the cell naming change jobs aren't going to work until the jobs are cleaned up on the gate18:37
*** danpawlik has joined #openstack-nova18:38
mriedemsigh, ok18:38
mriedemlet me coffee up first18:38
sdaguemriedem: https://www.youtube.com/watch?v=yysnM407rjE - power up18:39
*** gomarivera has quit IRC18:39
savvasmriedem: your suggested host space reservation doesn't do much for me. If I enable that, instance creation fails if I select boot from image in new volume. If I set my root disk size to 0 to bypass that, the whole point is gone as heat for example deploys a simple instance with block device again and ignores the reserved host space18:39
savvasany other thoughts?18:39
*** gjayavelu has quit IRC18:41
*** rwmjones has left #openstack-nova18:41
*** rmart04 has quit IRC18:42
*** Sukhdev has joined #openstack-nova18:42
mriedemsavvas: no immediate thoughts, you could try the #openstack-operators channel to see if others are dealing with this,18:44
mriedemor ask med_, cburgess or mgagne, our resident nova channel friendly ops, about their opinions18:44
cburgessDo what now?18:44
mriedemhelp someone18:44
mriedemc'mon chet18:44
cburgessOh OK.. I gues I can try...18:45
savvas:--)18:45
cburgessWhats the question/issue/suggestion?18:45
savvasRight18:45
savvaswell I am trying to avoid instances being created on local storage18:45
cburgessOh that one...18:46
savvasour nodes have a 20G root partition and that should be utilized for system processes only. So apart from the fact that nova doesn't seem to recognize cinder storage as usable space18:46
savvasit also simply refuses not to try and make local block devices18:46
cburgessDefine refuse? If you launch an instance with boot from volume you shouldn't see a local device.18:46
*** jmlowe has quit IRC18:48
mriedemcburgess: the problem is the same as usual, in that you can't force the user to do boot from volume18:49
mriedemunless you automagic something in the api code to do that, as some have done18:49
cburgessCorrect18:50
cburgessHence the point of that whole sessions in bonston. I still need to write that spec...18:50
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/46808918:50
cburgessYou simply can't block an local instance launch in nova unless you write a custom patch.18:50
savvascburgess: for creating a new instance it works just fine via horizon but for example if I launch a simple stack it doesn't force me to select a boot volume or anything18:51
savvasand it creates a local block device18:51
*** jmlowe has joined #openstack-nova18:51
cburgesssavvas Yup.. its a limitation in openstack. Its something thats been of ongoing discussion for the past few cycles and we are working on a spec for.. queens (mriedem??) to try and address this limitation.18:52
mriedemqueens yes18:52
savvasye I read about that18:52
savvaswas hoping people may have found a workaround to deal with this problem though18:53
savvasbut seems like there aren't any (yet)18:53
mriedemnot outside of patching the api18:53
mriedemwhich i'd advise against18:54
cburgessEven I advise against patching the API now, even though I've been known to do it.18:54
cburgessBut yes... its a known issue and hopefully we can have a good discussion about it at the upcoming PTG and agree on a spec for the queens cycle to address this issue.18:54
*** READ10 has quit IRC18:55
mriedemchet is in nova-patchers-anonymous18:55
cburgessmriedem Meh.. I got tired of dansmith accusing me of doing awful things with his code. :P18:56
mriedemi know i don't get tired of that18:56
dansmithmriedem kinda likes the pain you know18:56
mriedemi meant you hurting chet18:56
mriedemnot me18:56
dansmithheh18:56
*** jobewan has joined #openstack-nova18:58
*** claudiub has joined #openstack-nova18:59
*** tbachman has quit IRC19:01
cfriesenwould there be value in having "nova-manage db online_data_migrations" return a value indicating whether or not it needs to be called again?  (when specifying --max-count)19:02
*** gomarivera has joined #openstack-nova19:02
cfriesenseems like currently a calling script needs to parse the output19:02
melwittI thought it already returns 1 if there's more to do and 0 when there's no more to do. or are you saying it returns 0 when you use --max-count and there is still more to do?19:03
*** kaisers_ has joined #openstack-nova19:04
cfriesenmelwitt: it currently has "return ran and 1 or 0"  and I think an exception in one of the migration routines will give a 019:05
cfriesenI want success/partial-success/error return codes19:05
openstackgerritMatt Riedemann proposed openstack/nova master: Handle conflict from neutron when addFloatingIP fails  https://review.openstack.org/46813619:05
mriedemcfriesen: sounds like a bug19:05
*** penick has quit IRC19:06
*** gomarivera has quit IRC19:06
cfriesenmriedem: what should it return in the error case?  127 like we have if you specify a nonpositive integer for max-count?  or something else19:06
mriedemidk, sometimes we return 2 for things19:06
mriedemit's not really defined19:07
*** gomarivera has joined #openstack-nova19:07
sdaguecfriesen: so the problem with that is it means you have to turn off set -e in scripts19:07
mriedemsdague: that's what we do in grenade for the nova-status upgrade check19:07
sdaguemriedem: yeh, which is a little suck19:08
*** yamamoto has joined #openstack-nova19:08
mriedemwell maybe we don't https://github.com/openstack-dev/grenade/blob/master/projects/60_nova/upgrade.sh#L9719:08
mriedemi must be thinking of something in d-g19:08
*** kaisers_ has quit IRC19:08
mriedemah we use ||19:08
sdagueyeh19:08
sdaguewhich is just mask the world19:09
*** pcaruana has quit IRC19:09
cfriesensdague: you mean distinguishing between success-and-done vs success-and-need-to-call-again?19:09
sdagueyeh, but more importantly best practice for shell scripts is set -e, and things are only supposed to be non zero on failure19:10
cfriesensdague: so you're saying the caller must always parse the output to determine if it's actually done?19:11
*** gomarivera has quit IRC19:11
openstackgerritMatt Riedemann proposed openstack/nova master: Handle conflict from neutron when addFloatingIP fails  https://review.openstack.org/46813619:11
cfriesenbecause that seems kind of lame19:11
*** mvk has joined #openstack-nova19:11
sdaguecfriesen: you're just calling this in a loop from another program right?19:11
cfriesensdague: no guarantee it'll be in a loop...what if someone wanted to process X migrations each maintenance window19:12
sdagueok19:12
*** yamamoto has quit IRC19:13
mriedemsdague: i think that grenade-dsvm-neutron-multinode-ubuntu-trusty failure in stable/newton wasn't what you thought it was19:13
mriedemstable/mitaka isn't deleted yet19:13
mriedemplus this job passed yesterday19:13
mriedemit's an ssh issue with ansible19:13
mriedemhttp://logs.openstack.org/50/420750/2/gate/gate-grenade-dsvm-neutron-multinode-ubuntu-trusty/7fd8a27/logs/devstack-gate-setup-host.txt19:13
sdaguemriedem: how is stable/mitaka still a thing?19:14
mriedemsdague: rax laid off tonyb19:14
mriedemif i had twitter, i'd tweet it, that if you want LTS in openstack, don't hire tonyb19:14
sdagueheh19:14
mriedemhuh, this is weird http://logs.openstack.org/74/467674/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/414bb96/logs/screen-n-api.txt.gz?level=TRACE#_May_25_02_46_02_13972819:19
mriedemif you run tempest with cinder.cross_az_attach=False,19:20
mriedem2 bfv tests fail,19:20
mriedembut they are failing on some weird instance.host lazy load issue in the api19:20
mriedemwhich i wouldn't expect19:20
mriedemhost wouldn't be set at this point19:20
mriedembut i'd think it's None19:20
mriedemhmm, or is it the BuildRequest object?19:22
mriedemdansmith: ^ methinks that's what is blowing up19:23
mriedemwe create an Instance object w/o a host field set, and serialize that into the BuildRequest19:23
*** baoli has quit IRC19:23
dansmithwell, no host at that point19:23
mriedemright,19:23
mriedembut this az check is looking for the host on the instance, which isn't set19:24
mriedemand kablamo19:24
dansmiththey're doing a .get o it which doesn't really make sense19:24
mriedemthat code is super old,19:24
mriedemprobably when it was a dict19:24
dansmithfrom dict era?19:24
dansmithokay19:24
dansmithso maybe just needs updating for using 'in' ?19:24
mriedemsavvas: i'm surprised you didn't hit this when you set cross_az_attach=False ^19:24
mriedemdansmith: yeah19:24
*** baoli has joined #openstack-nova19:25
mriedemdansmith: and/or set instance.host = None for the temp instance that goes into the BuildRequest19:25
*** xyang1 has joined #openstack-nova19:25
*** tbachman has joined #openstack-nova19:26
dansmithwell, we wouldn't want to write it into the database that way unintentionally.. I dunno, .get() was clearly looking for "if set or not"19:26
mriedemi just worry about other places that could hit this,19:26
dansmithand today that's done with in19:26
mriedembut i'd think those would have been found by now19:26
dansmithI'd just hate to have a situation where we've scheduled but something pulled the instance out of buildrequest and does a save() which overwrites the real host19:27
mriedemsure i can be a cautious cat for now19:28
dansmithcall me nervous nellie19:28
savvasmriedem: well most of the testing I've done was by creating an instance via horizon. Horizon asks you to create a volume when spawning an instance19:28
savvasso I didn't realize that was happening until I started messing with the system, trying to break it basically19:29
melwittmriedem: tonyb got hired, so stable/mitaka's days are probably numbered19:29
mriedemmelwitt: i heard19:29
mriedemi'll let stable/mitaka know19:29
melwittcool, thanks19:29
dansmithwell, just go announcing his news for him why don'tcha?19:29
melwitthe announced it on twitter, get with the program!19:29
dansmithoh, yeah I see, okay :)19:30
*** tbachman has quit IRC19:30
dansmithguns lowered19:30
melwittlol19:30
melwittcan't believe you're not up-to-speed with the twittersphere, SIGH19:30
mriedemwell someone better make an LTS reference in there19:30
mriedemfor me19:31
mriedemby proxy19:31
melwitt@mriedem_proxy19:31
dansmithI don't follow him so I didn't notice19:31
*** cdent has joined #openstack-nova19:32
*** tbachman has joined #openstack-nova19:36
*** avolkov has quit IRC19:41
cfriesenmriedem: in commit ab05b902 you introduced an online migration to fix an issue....shouldn't that have been ported back to stable/mitaka to fix the issue before the Newton code would ever see it?19:46
*** gomarivera has joined #openstack-nova19:47
cfriesenor are we really saying that online data migrations should be run ASAP after an upgrade is done rather than at the operator's leisure?19:47
cdentedleafe: is a list of list of hosts being returned the only option? Would a single dimension longer list work?19:50
cdentthat is: can the grouping happen on the conductor side?19:50
openstackgerritMatt Riedemann proposed openstack/nova master: Avoid lazy-load error when getting instance AZ  https://review.openstack.org/46814719:51
mriedemdansmith: easy stat pad ^19:51
*** annegentle has joined #openstack-nova19:53
*** kaisers_ has joined #openstack-nova19:53
mriedemcfriesen: that one was really odd19:54
cfriesenmriedem: never mind, I see we introduced the change in Newton so no way to backport the migration19:54
mriedemcorrect19:54
cfriesenmriedem: I'm assuming it'd be okay if we deleted those entries separately prior to the upgrade19:55
*** priteau has quit IRC19:55
mriedemthe old busted build requests?19:55
cfriesenthe failed BuildRequest I mean19:55
mriedemi think so19:55
*** jamielennox is now known as jamielennox|away19:56
*** Sukhdev has quit IRC19:57
cfriesenmriedem: what would have happened to successful old build requests?19:57
*** kaisers_ has quit IRC19:57
*** amotoki is now known as amotoki_away19:58
*** amotoki_away is now known as amotoki19:59
*** amotoki is now known as amotoki_away19:59
mriedemhappened where? when?20:00
mriedemsuccessful build requests are cleaned up when the instance is created20:01
mriedemfailed ones weren't getting cleaned up at some point, which i think was part of the issue20:01
cfriesenah, okay.  so at steady-state there would only be failed ones left in the DB20:01
mriedemso you'd have these old busted build requests with the old data format,20:01
mriedemand they'd revive somehow and blow up20:01
*** acormier_ has joined #openstack-nova20:01
*** acormier has quit IRC20:01
mriedemi believe they'd be pulled back when listing instances20:01
*** Apoorva has quit IRC20:01
mriedembecause they weren't deleted20:01
*** cdent has quit IRC20:02
mriedemand the from_db_object or whatever assumed the new data model format20:02
mriedemas i said, it was a weird one20:02
*** Apoorva has joined #openstack-nova20:02
mriedemdansmith: +2 on https://review.openstack.org/#/c/460616/ - time to get someone to pay you back20:02
*** Apoorva has quit IRC20:06
edleafecd20:08
edleafeugh20:08
*** felipemonteiro has quit IRC20:10
*** yamahata has joined #openstack-nova20:10
mriedemdansmith: on this cells rpcapi thing https://review.openstack.org/#/c/461532/6/nova/cells/rpcapi.py - i'm not sure what type of exception should be raised here20:11
mriedemjust anything?20:11
dansmithmriedem: yeah, we've done it a couple other places20:11
mriedemServiceTooOld ?20:11
dansmithmriedem: since that would be an upgrade concern, and it's cellsv1, I'd just raise anything to call attention20:11
dansmithsure, sounds fine tome20:11
*** david-lyle has joined #openstack-nova20:12
*** eharney has quit IRC20:12
*** smatzek has quit IRC20:12
*** jamesdenton has quit IRC20:13
gyeemriedem, jaypipes, can you guys please take a look? https://review.hpcloud.net/13589520:13
gyeeI am trying to get a resolution on this one20:13
mriedemgyee: i don't have access to your internal gerrit :)20:13
mriedemi can request access of course20:14
gyeeoh shit, wrong link20:14
gyeemy bad20:14
gyeehttps://review.openstack.org/#/c/466143/20:15
gyeemy brain is fried trying to context switch upstream/downstream20:16
openstackgerritSteve Noyes proposed openstack/nova master: WIP: update live migration to use v3 cinder api  https://review.openstack.org/46398720:17
*** david-lyle has quit IRC20:17
*** Apoorva has joined #openstack-nova20:17
*** jmlowe has quit IRC20:18
openstackgerritSteve Noyes proposed openstack/nova master: WIP: update live migration to use v3 cinder api  https://review.openstack.org/46398720:19
*** lucasxu has quit IRC20:21
*** lucasxu has joined #openstack-nova20:22
mriedemgyee: looking20:22
*** moshele has joined #openstack-nova20:23
*** gjayavelu has joined #openstack-nova20:27
*** karimb has quit IRC20:32
*** lyan has joined #openstack-nova20:33
*** edmondsw has quit IRC20:37
*** Yangyapeng has quit IRC20:38
*** danpawlik has quit IRC20:38
*** crushil has quit IRC20:39
*** markvoelker has quit IRC20:42
*** slaweq has joined #openstack-nova20:44
*** edmondsw has joined #openstack-nova20:44
mriedemgyee: comments inline20:45
*** yamahata has quit IRC20:45
*** READ10 has joined #openstack-nova20:45
gyeemriedem: thanks!20:46
mriedemnova meeting in #openstack-meeting in 10 minutes20:50
*** dillaman has quit IRC20:50
*** yamahata has joined #openstack-nova20:50
*** gomarivera has quit IRC20:52
*** gomarivera has joined #openstack-nova20:53
openstackgerritMatt Riedemann proposed openstack/nova master: Handle uuid in HostAPI.compute_node_get  https://review.openstack.org/46153220:53
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Use uuid for id in Services API  https://review.openstack.org/46428020:53
*** gomarivera has quit IRC20:53
*** gomarivera has joined #openstack-nova20:53
*** takashin has joined #openstack-nova20:55
*** dillaman has joined #openstack-nova20:55
*** gjayavelu has quit IRC20:56
*** markvoelker has joined #openstack-nova20:56
*** gianpietro has joined #openstack-nova20:57
*** fragatina has joined #openstack-nova21:00
*** markvoelker has quit IRC21:00
*** smatzek has joined #openstack-nova21:00
*** rfolco has quit IRC21:01
openstackgerritMatt Rabe proposed openstack/nova master: Query deleted instance records during _destroy_evacuated_instances  https://review.openstack.org/46777421:02
*** ctrath has quit IRC21:04
openstackgerritMatt Rabe proposed openstack/nova master: Query deleted instance records during _destroy_evacuated_instances  https://review.openstack.org/46777421:04
*** prateek has quit IRC21:05
*** itlinux has joined #openstack-nova21:05
*** jwcroppe has quit IRC21:07
*** jwcroppe has joined #openstack-nova21:08
*** smatzek has quit IRC21:11
*** tidwellr has quit IRC21:11
*** tidwellr has joined #openstack-nova21:12
*** moshele has quit IRC21:12
*** jwcroppe has quit IRC21:12
*** ayogi has joined #openstack-nova21:14
*** gianpietro has quit IRC21:14
*** takashin has quit IRC21:15
*** dimtruck is now known as zz_dimtruck21:16
*** takashin has joined #openstack-nova21:16
*** tidwellr has quit IRC21:16
*** yamahata has quit IRC21:18
*** jwcroppe has joined #openstack-nova21:20
oomichimriedem: thanks, lgtm on https://review.openstack.org/#/c/45689621:20
openstackgerritEric Fried proposed openstack/nova master: PowerVM Driver: SSP emphemeral disk support  https://review.openstack.org/44318921:21
*** thorst has quit IRC21:22
*** lyan has quit IRC21:22
*** lyan has joined #openstack-nova21:24
*** sdague has quit IRC21:24
*** jheroux has quit IRC21:25
*** jwcroppe has quit IRC21:25
*** awaugama has quit IRC21:26
mriedemoomichi: thanks. there are 2 more on top of that one with +2s if you can take a look at those also.21:27
*** marst_ has quit IRC21:30
*** crushil has joined #openstack-nova21:30
*** dave-mccowan has quit IRC21:33
*** crushil has quit IRC21:37
*** imacdonn has quit IRC21:39
*** lucasxu has quit IRC21:39
*** imacdonn has joined #openstack-nova21:40
*** itlinux has quit IRC21:42
mriedemmelwitt: jaypipes: dansmith: we talked about spot instances in one of the forum sessions, do you remember which one by chance?21:42
*** jwcroppe has joined #openstack-nova21:43
dansmithreservations or something I think21:43
mriedemah yes21:43
mriedemhttps://etherpad.openstack.org/p/BOS-forum-advanced-instance-scheduling21:43
*** burt has quit IRC21:46
*** fragatina has quit IRC21:48
*** zz_dimtruck is now known as dimtruck21:54
*** gianpietro has joined #openstack-nova21:54
openstackgerritEric Fried proposed openstack/nova master: Nix redundant dict in set_inventory_for_provider  https://review.openstack.org/46812321:56
*** gianpietro has quit IRC21:59
*** jwcroppe has quit IRC21:59
*** jwcroppe has joined #openstack-nova21:59
*** tbachman has quit IRC22:02
*** mdrabe has quit IRC22:03
*** wolsen has joined #openstack-nova22:03
*** Apoorva_ has joined #openstack-nova22:04
*** slaweq has quit IRC22:05
*** markvoelker has joined #openstack-nova22:05
*** annegentle has quit IRC22:06
*** gjayavelu has joined #openstack-nova22:06
*** slaweq has joined #openstack-nova22:07
*** Apoorva has quit IRC22:08
*** slaweq has quit IRC22:08
mriedemis it just me,22:08
mriedemor are the examples in here missing some things https://docs.openstack.org/ocata/config-reference/compute/schedulers.html#aggregateimagepropertiesisolation22:08
*** slaweq has joined #openstack-nova22:08
*** slaweq has quit IRC22:13
*** markvoelker has quit IRC22:15
*** markvoelker has joined #openstack-nova22:16
*** kaisers_ has joined #openstack-nova22:19
*** thorst has joined #openstack-nova22:20
*** gianpietro has joined #openstack-nova22:21
*** itlinux has joined #openstack-nova22:22
*** esberglu has quit IRC22:22
*** thorst has quit IRC22:23
*** esberglu has joined #openstack-nova22:23
*** kaisers_ has quit IRC22:24
*** tbachman has joined #openstack-nova22:26
*** esberglu has quit IRC22:28
*** baoli has quit IRC22:29
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/46808922:29
*** gouthamr has quit IRC22:29
*** gianpietro has quit IRC22:30
*** edmondsw has quit IRC22:34
*** edmondsw has joined #openstack-nova22:34
*** Apoorva_ has quit IRC22:35
*** Apoorva has joined #openstack-nova22:35
*** tbachman has quit IRC22:36
*** jamielennox|away is now known as jamielennox22:36
*** gianpietro has joined #openstack-nova22:39
*** edmondsw has quit IRC22:39
*** gianpietro has quit IRC22:40
*** tbachman has joined #openstack-nova22:41
*** gianpietro has joined #openstack-nova22:42
*** gomarivera has quit IRC22:42
*** gianpietro has quit IRC22:44
*** lyan has quit IRC22:44
*** claudiub has quit IRC22:49
*** jamespd has left #openstack-nova22:52
*** thorst has joined #openstack-nova22:53
*** jobewan has quit IRC22:55
*** takashin has quit IRC23:02
*** takashin has joined #openstack-nova23:03
jaypipesmriedem: "Deleting instance files /var/lib/nova/instances/c929d839-a55d-4834-b044-cd70e9f6d79a_del"23:03
jaypipesmriedem: seeing the above in a customer log file. Does the _del at the end of the file mean the instance was soft-deleted?23:03
mriedemnope23:03
jaypipesah, ok23:03
mriedemthe libvirt driver renames the file i think23:04
mriedemso it can delete it23:04
jaypipesoh... before shutting down the instance?23:04
mriedemin here https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L783923:04
jaypipesmriedem: trying to figure out why this sequence of events is occurring in the order it is... http://paste.openstack.org/show/610689/23:05
jaypipesmriedem: this is a Liberty installation.23:05
*** gouthamr has joined #openstack-nova23:05
mriedemthat's called from cleanup() which is called from destroy() which is called during shutdown_instance in the compute manager23:05
jaypipesmriedem: from that paste, it almost looks like we're deleting the instance before successfully detaching the vNIC.23:06
mriedem"Neutron deleted interface" is via an event from neutron23:06
mriedemfor network-vif-deleted23:06
mriedemconcurrent23:06
mriedemwe deallocate the network, which deletes the port,23:06
mriedemneutron sends an event saying the port was deleted,23:06
mriedemwe log that and refresh the cache23:06
mriedemnw info cache that is23:06
mriedemassuming this was a port that nova created when the server was created23:06
*** takashin_ has joined #openstack-nova23:07
mriedemnote req-cbfbe2ef-3403-42a9-aef2-9a0e9babe9ed is a separate request23:07
mriedemthat's the instance request23:07
mriedemthat InstanceNotFound is ignorable23:07
mriedemb/c we already refreshed the nw info cache when we deleted the port23:07
mriedemduring deallocate_for_instance23:07
*** itlinux has quit IRC23:07
mriedemhttps://github.com/openstack/nova/blob/liberty-eol/nova/compute/manager.py#L650023:08
mriedem^ is what you hit23:08
jaypipesmriedem: well, it's leaving qvo devices on the host...23:08
*** takashin has quit IRC23:08
*** thorst has quit IRC23:08
*** takashin_ has left #openstack-nova23:09
openstackgerritguang-yee proposed openstack/nova master: make sure to rebuild claim on recreate  https://review.openstack.org/46614323:09
mriedemhttps://github.com/openstack/nova/blob/liberty-eol/nova/compute/manager.py#L226523:10
mriedemshould unplug the vif23:10
mriedemwe deallocate the port here https://github.com/openstack/nova/blob/liberty-eol/nova/compute/manager.py#L228023:10
mriedemvif unplug should clean things up on the host shoudln't it?23:10
mriedemdriver.destroy calls cleanup which calls unplug_vifs23:11
*** markvoelker has quit IRC23:11
mriedemgyee: i was just updating that :)23:12
jaypipesmriedem: I've asked eugene to get more log information. he says there's lots of stale qvo devices from deleted instances on the customer's hosts...23:13
openstackgerritMatt Riedemann proposed openstack/nova master: make sure to rebuild claim on recreate  https://review.openstack.org/46614323:15
*** lyan has joined #openstack-nova23:16
*** jmlowe has joined #openstack-nova23:16
mriedemjaypipes: i think dansmith fixed a bug in the libvirt driver where failed spawns weren't cleaning up properly23:18
mriedemleaving a bunch of garbage around23:18
openstackgerritChris Friesen proposed openstack/nova master: Add validation for cpu_realtime_mask  https://review.openstack.org/46820323:19
*** dimtruck is now known as zz_dimtruck23:19
cfriesensahid: ^23:20
*** gjayavelu has quit IRC23:20
gyeemriedem: all good :-)23:21
mriedemjaypipes: https://review.openstack.org/#/c/409706/ and https://review.openstack.org/#/c/428671/23:22
*** takashin has joined #openstack-nova23:26
jaypipesmriedem: thx23:27
gyeejaypipes: nice comment :-)23:28
jaypipesgyee: you disagree?23:28
gyeeI'll take the 5th23:28
jaypipesomfg the gate is killing me today.23:30
*** jamesdenton has joined #openstack-nova23:32
*** edmondsw has joined #openstack-nova23:35
*** jamesdenton has quit IRC23:36
*** Apoorva_ has joined #openstack-nova23:36
*** vladikr has quit IRC23:38
cfriesenis it possible to run a subset of tox functional tests?23:39
mriedemcfriesen: yes23:39
*** vladikr has joined #openstack-nova23:39
mriedemtox -e functional -- nova.tests.functional.test_servers23:40
*** edmondsw has quit IRC23:40
mriedemor whateever23:40
mriedemsame as unit tests23:40
*** Apoorva has quit IRC23:40
cfriesenah, okay.  with unit tests it seems to accept wildcards anywhere in the test path and it doesn't need the "--"23:41
*** Apoorva_ has quit IRC23:41
* cfriesen needs to not be lazy23:42
melwittI thought it worked the same. I don't use "--" but I also might not be wildcarding the way you are23:42
cfriesenhmm...it doesn't even like the format you suggested.  but it works if I just run "tox -e functional"23:43
cfriesenah well23:43
melwitttox -efunctional test_blah23:44
*** markvoelker has joined #openstack-nova23:44
*** markvoelker has quit IRC23:45
cfriesenhmm....probably helps if I point to actual tests and not template directories.23:46
*** lyan has quit IRC23:46
openstackgerritJohn Griffith proposed openstack/nova master: WIP/POC Implement new attach Cinder flow  https://review.openstack.org/33028523:49
*** Swami has quit IRC23:49
*** yingjun has joined #openstack-nova23:49
*** acormier_ has quit IRC23:51
*** lyan has joined #openstack-nova23:52
*** zz_dimtruck is now known as dimtruck23:58
*** hongbin has quit IRC23:58
*** lyan has quit IRC23:59
*** READ10 has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!