Friday, 2015-03-13

*** yamamoto has quit IRC00:00
openstackgerritxu-haiwei proposed openstack/tempest: Add 'servers_links' attribute in server list schema  https://review.openstack.org/15903700:02
openstackgerritxu-haiwei proposed openstack/tempest: Add 'fault' attributes in server schema  https://review.openstack.org/15936000:02
openstackgerritxu-haiwei proposed openstack/tempest: Rename compute response schema dir to v2_1  https://review.openstack.org/16251100:02
openstackgerritxu-haiwei proposed openstack/tempest: Block additionalProperties on Nova API tests  https://review.openstack.org/15613000:02
openstackgerritxu-haiwei proposed openstack/tempest: Adding common header attributes in image header schema  https://review.openstack.org/15900800:02
openstackgerritxu-haiwei proposed openstack/tempest: Merge availability_zone response schema into one file  https://review.openstack.org/16281600:02
openstackgerritxu-haiwei proposed openstack/tempest: Add 'images_links' attribute in image list schema  https://review.openstack.org/15904400:02
*** achanda has quit IRC00:03
openstackgerritxu-haiwei proposed openstack/tempest: Merge hosts response schema into one file  https://review.openstack.org/16282100:04
*** dimtruck is now known as zz_dimtruck00:09
*** Noice has quit IRC00:10
*** dmorita has joined #openstack-qa00:15
*** Longgeek has joined #openstack-qa00:18
*** woodster_ has quit IRC00:20
*** woodster_ has joined #openstack-qa00:30
*** sputnik13 has quit IRC00:31
*** dims has joined #openstack-qa00:32
*** Longgeek has quit IRC00:32
*** yamamoto has joined #openstack-qa00:41
*** pal has joined #openstack-qa00:42
*** marun has quit IRC00:42
*** jaypipes has quit IRC00:45
openstackgerritIan Wienand proposed openstack-dev/devstack: Add defaults for yum proxy variables  https://review.openstack.org/16404000:51
*** topshare has joined #openstack-qa00:52
*** mwagner_lap has quit IRC00:53
*** liusheng has quit IRC00:56
openstackgerritMorgan Fainberg proposed openstack-dev/devstack: Add response time to keystone access log  https://review.openstack.org/16404200:56
*** cody-somerville has quit IRC00:56
morganfainbergjogo, ^ the other items i'm poking at will come down the line00:57
*** kevinbenton has quit IRC00:59
*** zz_dimtruck is now known as dimtruck01:09
*** rwsu is now known as rwsu-afk01:13
*** annashen has quit IRC01:19
*** ibiris is now known as ibiris_away01:20
*** dkranz has joined #openstack-qa01:24
*** enikanorov__ has joined #openstack-qa01:24
*** enikanorov_ has quit IRC01:26
openstackgerritMerged openstack-dev/devstack: Shut down ironic services in the modern way  https://review.openstack.org/16381301:32
openstackgerritMerged openstack/tempest: Add scenario 'test_preserve_preexisting_port'  https://review.openstack.org/16092401:33
*** yamahata has quit IRC01:33
openstackrecheckopenstack/nova change: https://review.openstack.org/137817 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/137267001:34
openstackLaunchpad bug 1372670 in OpenStack Compute (nova) "libvirtError: operation failed: cannot read cputime for domain" [High,In progress] - Assigned to Eduardo Costa (ecosta)01:34
openstackrecheckopenstack/nova change: https://review.openstack.org/145619 failed gate-nova-python27 in the gate queue with an unrecognized error01:34
*** annashen has joined #openstack-qa01:39
*** amotoki has joined #openstack-qa01:39
*** ChuckC has joined #openstack-qa01:42
*** amotoki has quit IRC01:44
openstackrecheckopenstack/heat change: https://review.openstack.org/163717 failed gate-heat-python27 in the gate queue with an unrecognized error01:46
*** ChuckC has quit IRC01:46
*** ChuckC has joined #openstack-qa01:47
*** tsekiyama has joined #openstack-qa01:52
*** luqas has quit IRC01:55
*** kevinbenton has joined #openstack-qa01:57
openstackgerritMerged openstack-dev/devstack: install missing elasticsearch client  https://review.openstack.org/16369302:00
*** patrickeast has quit IRC02:02
openstackgerrityuntongjin proposed openstack-dev/devstack: Copy etc/nova/policy.d to $NOVA_CONF_DIR  https://review.openstack.org/16006802:06
*** dpaterson has quit IRC02:07
*** harlowja is now known as harlowja_away02:07
*** asselin has quit IRC02:09
*** asselin has joined #openstack-qa02:10
*** dustins has quit IRC02:11
*** dustins has joined #openstack-qa02:12
*** dims has quit IRC02:14
*** marun has joined #openstack-qa02:16
*** mlavalle has quit IRC02:17
*** Longgeek has joined #openstack-qa02:18
openstackrecheckopenstack/tempest change: https://review.openstack.org/162850 failed gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error02:18
*** marun has quit IRC02:22
openstackgerritMasayuki Igawa proposed openstack/tempest: Remove python-ironicclient from requirements  https://review.openstack.org/16405702:23
*** tsekiyama has quit IRC02:26
*** tsekiyama has joined #openstack-qa02:27
*** dims has joined #openstack-qa02:34
*** Poornima has joined #openstack-qa02:34
*** Longgeek has quit IRC02:35
*** tsekiyama has quit IRC02:36
*** apevec has quit IRC02:38
*** pal has quit IRC02:39
*** dims has quit IRC02:39
*** mlavalle has joined #openstack-qa02:41
openstackgerritGhanshyam Mann proposed openstack/tempest: Merge agent response schema into one file  https://review.openstack.org/16251602:41
openstackgerritGhanshyam Mann proposed openstack/tempest: Rearrange certificates response schema into one file  https://review.openstack.org/16251902:41
openstackgerritGhanshyam Mann proposed openstack/tempest: Rearrange hypervisors response schemas into one file  https://review.openstack.org/16252302:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Fix interfaces response schema  https://review.openstack.org/16253002:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Rearrange keypairs response schema into one file  https://review.openstack.org/16255102:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Arrange quotas response schema into one file  https://review.openstack.org/16284102:42
openstackgerritGhanshyam Mann proposed openstack/tempest: Merge server response schema into one file  https://review.openstack.org/16287502:42
*** mpopow_ has quit IRC02:43
*** achanda has joined #openstack-qa02:44
openstackgerritMerged openstack/tempest: Skip boto tests when auth_version is v3  https://review.openstack.org/16379202:53
*** amotoki has joined #openstack-qa02:55
openstackgerritArmando Migliaccio proposed openstack/tempest: Add API tests for Neutron DVR extension  https://review.openstack.org/9823502:59
*** amotoki has quit IRC03:00
openstackgerritMerged openstack-infra/devstack-gate: add oslo.versionedobjects  https://review.openstack.org/16221803:02
openstackrecheckopenstack/nova change: https://review.openstack.org/164045 failed gate-tempest-dsvm-neutron in the gate queue with an unrecognized error03:02
*** blogan has quit IRC03:05
*** annashen has quit IRC03:05
*** annashen has joined #openstack-qa03:07
*** blogan has joined #openstack-qa03:12
openstackgerritIan Wienand proposed openstack-dev/devstack: Remove packaged rpm python libraries  https://review.openstack.org/16145503:15
*** annashen has quit IRC03:18
*** jaypipes has joined #openstack-qa03:18
*** ChanServ sets mode: +o jaypipes03:18
*** annashen has joined #openstack-qa03:19
*** blogan has quit IRC03:20
*** blogan has joined #openstack-qa03:24
*** dimtruck is now known as zz_dimtruck03:24
*** blogan has quit IRC03:27
*** annashen has quit IRC03:30
*** Longgeek has joined #openstack-qa03:31
*** Poornima has quit IRC03:34
*** blogan has joined #openstack-qa03:36
*** cody-somerville has joined #openstack-qa03:36
*** cody-somerville has quit IRC03:36
*** cody-somerville has joined #openstack-qa03:36
*** diegows has quit IRC03:38
*** annashen has joined #openstack-qa03:40
*** Longgeek has quit IRC03:41
*** annashen has quit IRC03:43
*** annashen has joined #openstack-qa03:44
*** annashen has quit IRC03:47
*** tsekiyama has joined #openstack-qa03:49
*** annashen has joined #openstack-qa03:49
*** Longgeek has joined #openstack-qa03:52
*** tsekiyama has quit IRC03:53
*** annashen has quit IRC03:59
*** rushiagr_away is now known as rushiagr03:59
*** mpopow_ has joined #openstack-qa04:02
*** mpopow__ has joined #openstack-qa04:03
*** annashen has joined #openstack-qa04:04
*** annashen has quit IRC04:06
*** liusheng has joined #openstack-qa04:06
*** mpopow_ has quit IRC04:07
*** amotoki has joined #openstack-qa04:11
*** annashen has joined #openstack-qa04:11
*** BharatK has joined #openstack-qa04:12
*** mpopow has joined #openstack-qa04:13
*** mpopow_ has joined #openstack-qa04:13
*** mpopow__ has quit IRC04:15
*** cody-somerville has quit IRC04:15
*** amotoki has quit IRC04:15
*** pal has joined #openstack-qa04:16
*** mpopow has quit IRC04:17
openstackrecheckopenstack/glance change: https://review.openstack.org/132717 failed gate-glance-python27, gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-full, gate-grenade-dsvm, gate-tempest-dsvm-large-ops, gate-tempest-dsvm-neutron-large-ops, gate-devstack-dsvm-cells in the gate queue with an unrecognized error04:21
*** annashen has quit IRC04:23
*** dboik_ has quit IRC04:34
openstackgerritYuriy Taraday proposed openstack-dev/devstack: Add rootwrap daemon mode support for Neutron  https://review.openstack.org/10738604:35
*** zz_dimtruck is now known as dimtruck04:36
*** chandankumar has joined #openstack-qa04:39
*** annashen has joined #openstack-qa04:39
*** woodster_ has quit IRC04:40
*** sputnik13 has joined #openstack-qa04:43
*** mtanino has quit IRC04:46
*** Longgeek has quit IRC04:47
openstackgerritAl Miller proposed openstack-dev/devstack: Remove LBaaS support from devstack  https://review.openstack.org/16143604:48
*** annashen has quit IRC04:54
*** annashen has joined #openstack-qa04:56
*** mpopow_ has quit IRC05:00
*** sputnik13 has quit IRC05:11
*** coolsvap|afk is now known as coolsvap05:14
*** swamireddy is now known as swamireddy_sick_05:16
openstackgerritAdam Gandelman proposed openstack/tempest: Skip network scenario tests for baremetal  https://review.openstack.org/16393405:20
adam_gmtreinish, gahh that needed to be updated with another that landed today ^05:21
*** Poornima has joined #openstack-qa05:24
*** Poornima has quit IRC05:24
*** vigneshvar has joined #openstack-qa05:24
*** Poornima has joined #openstack-qa05:25
*** dimtruck is now known as zz_dimtruck05:28
*** chandankumar has quit IRC05:36
*** annashen has quit IRC05:37
*** chandankumar has joined #openstack-qa05:40
*** anshul has joined #openstack-qa05:40
*** annashen has joined #openstack-qa05:40
*** annashen has quit IRC05:44
*** Longgeek has joined #openstack-qa05:48
*** chandankumar has quit IRC05:52
*** annashen has joined #openstack-qa05:53
*** ajo has joined #openstack-qa05:53
*** mlavalle has quit IRC06:00
*** yfried|afk is now known as yfried06:02
openstackgerritAbhishek G M proposed openstack/tempest: Test creation of server attached to created port  https://review.openstack.org/16288606:02
*** mlavalle has joined #openstack-qa06:07
*** achanda has quit IRC06:10
*** annashen has quit IRC06:11
*** achanda has joined #openstack-qa06:13
*** Sukhdev has joined #openstack-qa06:18
*** vigneshvar has quit IRC06:19
*** Longgeek has quit IRC06:21
*** amotoki has joined #openstack-qa06:23
*** achanda has quit IRC06:28
*** ajo has quit IRC06:31
*** ajo has joined #openstack-qa06:32
*** achanda has joined #openstack-qa06:34
*** yfried is now known as yfried|afk06:35
*** SridharG1 has joined #openstack-qa06:35
*** achanda has quit IRC06:38
*** Sukhdev has quit IRC06:43
*** rushiagr is now known as rushiagr_away06:45
*** pal has quit IRC06:49
*** k4n0 has joined #openstack-qa06:50
*** chandankumar has joined #openstack-qa06:52
*** pal has joined #openstack-qa06:53
*** coolsvap is now known as coolsvap|afk06:54
*** yfried|afk is now known as yfried06:55
*** thingee has joined #openstack-qa07:02
*** ibiris_away is now known as ibiris07:04
*** afazekas has joined #openstack-qa07:04
*** yfried is now known as yfried|afk07:05
*** pkoniszewski has joined #openstack-qa07:07
*** bkopilov has quit IRC07:08
*** coolsvap has joined #openstack-qa07:09
*** Longgeek has joined #openstack-qa07:18
*** dims has joined #openstack-qa07:23
*** dims has quit IRC07:27
*** bkopilov has joined #openstack-qa07:28
openstackgerritafazekas proposed openstack-dev/devstack: f22 default to dnf instead of yum  https://review.openstack.org/16374107:29
*** jamielennox has quit IRC07:31
*** bkopilov has quit IRC07:32
*** jamielennox has joined #openstack-qa07:34
*** yfried|afk is now known as yfried07:39
*** jamielennox has quit IRC07:39
*** Longgeek has quit IRC07:41
*** Longgeek has joined #openstack-qa07:41
*** topshare has quit IRC07:45
*** topshare has joined #openstack-qa07:46
*** ajo has quit IRC07:47
*** yfried is now known as yfried|afk07:49
*** thingee has quit IRC07:51
*** pal has quit IRC07:52
*** jamielennox|away has joined #openstack-qa07:55
*** pal has joined #openstack-qa07:55
*** jamielennox|away is now known as jamielennox07:55
openstackgerritMerged openstack/tempest-lib: Updated from global requirements  https://review.openstack.org/15780307:57
*** coolsvap has quit IRC07:59
openstackgerritAndrea Frittoli  proposed openstack/tempest: Copy the default params dict to avoid race  https://review.openstack.org/16389507:59
openstackgerritAndrea Frittoli  proposed openstack/tempest: Use the configured version of identity in stress  https://review.openstack.org/16125908:00
*** markus_z has joined #openstack-qa08:00
*** topshare has quit IRC08:04
*** topshare has joined #openstack-qa08:06
*** safchain has joined #openstack-qa08:19
*** openstackgerrit has quit IRC08:21
*** openstackgerrit has joined #openstack-qa08:21
*** gfidente has joined #openstack-qa08:23
*** gfidente has quit IRC08:23
*** gfidente has joined #openstack-qa08:23
*** topshare has quit IRC08:25
openstackgerritAdam Gandelman proposed openstack-infra/elastic-recheck: Add query for 1431724  https://review.openstack.org/16410608:26
*** topshare has joined #openstack-qa08:26
*** pal has quit IRC08:28
*** ihrachyshka has joined #openstack-qa08:30
openstackgerritAdam Gandelman proposed openstack/tempest: Skip network scenario tests for bug 1431724 + baremetal  https://review.openstack.org/16393408:33
openstackbug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [Undecided,New] https://launchpad.net/bugs/143172408:33
adam_gmriedem_away, mtreinish ^08:33
*** pal has joined #openstack-qa08:36
*** jlanoux has joined #openstack-qa08:38
*** yfried|afk is now known as yfried08:46
*** ajo has joined #openstack-qa08:47
*** ihrachyshka has quit IRC08:48
*** andreykurilin_ has joined #openstack-qa08:53
*** amotoki has quit IRC08:57
*** dkusidlo has joined #openstack-qa08:59
*** luqas has joined #openstack-qa09:03
*** yfried is now known as yfried|afk09:05
*** SridharG1 has left #openstack-qa09:09
*** e0ne has joined #openstack-qa09:11
*** e0ne has quit IRC09:16
*** jordanP has joined #openstack-qa09:16
*** Longgeek has quit IRC09:16
*** yfried|afk is now known as yfried09:18
openstackgerritAndrea Frittoli  proposed openstack-infra/elastic-recheck: Add query for bug 1431724  https://review.openstack.org/16412009:19
openstackbug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [Undecided,New] https://launchpad.net/bugs/143172409:19
*** mhorban has quit IRC09:20
*** amotoki has joined #openstack-qa09:20
*** e0ne has joined #openstack-qa09:20
andreaf43 hits in the last ~7h ^^^^09:20
*** bnemec has quit IRC09:24
*** bnemec has joined #openstack-qa09:25
openstackgerritAndrea Frittoli  proposed openstack/tempest: Revert "Add scenario 'test_preserve_preexisting_port'"  https://review.openstack.org/16412109:26
andreafand the proposed fix ^^^09:27
*** yfried is now known as yfried|afk09:28
*** zz_johnthetubagu is now known as johnthetubaguy09:29
*** SridharG1 has joined #openstack-qa09:29
*** andreykurilin_ has quit IRC09:31
*** andreykurilin_ has joined #openstack-qa09:32
*** e0ne has quit IRC09:37
*** dims has joined #openstack-qa09:42
*** yfried|afk is now known as yfried09:46
*** dims has quit IRC09:47
*** vigneshvar has joined #openstack-qa09:47
*** bkopilov has joined #openstack-qa09:49
*** dims has joined #openstack-qa09:54
*** bkopilov has quit IRC09:55
*** SridharG has quit IRC09:58
*** SridharG has joined #openstack-qa10:00
*** luqas has quit IRC10:04
*** yfried is now known as yfried|afk10:06
*** ihrachyshka has joined #openstack-qa10:08
*** yamamoto has quit IRC10:11
*** eugene_bag has quit IRC10:14
*** tkammer has joined #openstack-qa10:17
*** Longgeek has joined #openstack-qa10:17
*** e0ne has joined #openstack-qa10:17
*** e0ne is now known as e0ne_10:17
*** vigneshvar has quit IRC10:19
openstackgerritAndrea Frittoli  proposed openstack/tempest: Support v3 in credential providers and subclasses  https://review.openstack.org/13302910:20
openstackgerritAndrea Frittoli  proposed openstack/tempest: Use the configured version of identity in stress  https://review.openstack.org/16125910:20
openstackgerritAndrea Frittoli  proposed openstack/tempest: Copy the default params dict to avoid race  https://review.openstack.org/16389510:20
*** e0ne_ is now known as e0ne10:22
andreafmtreinish: it turns out that the faiures in https://review.openstack.org/133029 on the auth_v3 job are related to https://review.openstack.org/163895 - DEFAULT_PARAMS contained an unrelated tenant_name which clashed with the provided project_name10:24
*** dkusidlo_ has joined #openstack-qa10:24
*** dkusidlo has quit IRC10:28
*** dkusidlo_ is now known as dkusidlo10:28
*** e0ne_ has joined #openstack-qa10:28
*** e0ne has quit IRC10:29
*** yfried|afk is now known as yfried10:29
*** pc_m has joined #openstack-qa10:29
*** Longgeek has quit IRC10:32
*** luqas has joined #openstack-qa10:35
*** yamamoto has joined #openstack-qa10:37
*** andreykurilin_ has quit IRC10:39
*** luqas has quit IRC10:40
*** vigneshvar has joined #openstack-qa10:40
*** aix has joined #openstack-qa10:44
*** dkusidlo_ has joined #openstack-qa10:45
*** dkusidlo has quit IRC10:48
*** dkusidlo_ is now known as dkusidlo10:48
*** apevec has joined #openstack-qa10:49
*** apevec has quit IRC10:49
*** apevec has joined #openstack-qa10:49
*** topshare_ has joined #openstack-qa10:53
*** jamielennox has quit IRC10:55
*** topshare has quit IRC10:55
*** dmorita has quit IRC10:55
*** yfried is now known as yfried|afk10:58
*** tosky has joined #openstack-qa10:58
*** harlowja_away has quit IRC10:59
*** erlon has joined #openstack-qa11:01
*** jamielennox|away has joined #openstack-qa11:02
*** jamielennox|away is now known as jamielennox11:02
*** mpaolino has joined #openstack-qa11:06
*** aysyd has joined #openstack-qa11:13
*** jamielennox has quit IRC11:14
*** yfried|afk is now known as yfried11:18
*** aysyd has quit IRC11:20
*** jamielennox|away has joined #openstack-qa11:24
*** jamielennox|away is now known as jamielennox11:24
openstackgerritJoe Hakim Rahme proposed openstack/tempest: Deprecates 'format' in Javelin image description  https://review.openstack.org/16296311:24
*** pal has quit IRC11:35
openstackgerritMarian Horban proposed openstack/tempest: API test for instance's migration added  https://review.openstack.org/15300511:35
openstackgerritMerged openstack/tempest: Revert "Add scenario 'test_preserve_preexisting_port'"  https://review.openstack.org/16412111:39
*** Poornima has quit IRC11:40
*** cdent has joined #openstack-qa11:44
*** topshare_ has quit IRC11:47
*** vigneshvar has quit IRC11:51
*** bkopilov has joined #openstack-qa11:53
*** eugene_bag has joined #openstack-qa11:56
*** diegows has joined #openstack-qa11:57
*** mwagner_lap has joined #openstack-qa11:57
*** mpaolino has quit IRC12:00
*** nicodemos has quit IRC12:01
kashyapI notice -- $ openstack ec2 credentials list --user 33c44ff28ba847b683913758ac1bba27  with a minimal Nova config, is there a way I can avoid having  EC2 configured?12:01
kashyapProbably explicitly disabling them would do I guess.12:02
kashyapafazekas, Probably you know something above the above? ^12:02
*** yfried is now known as yfried|afk12:02
afazekaskashyap, NOVA_ENABLED_APIS=osapi_compute,metadata  # just remove the ec212:04
*** eugene_bag has quit IRC12:04
*** aysyd has joined #openstack-qa12:04
kashyapafazekas, Ah, right, thank you.12:04
andreafjamielennox: hi - are you around?12:08
openstackgerritAndrea Frittoli  proposed openstack-dev/devstack: Adding tempest_roles when auth_version is v3  https://review.openstack.org/16415512:11
*** apevec has quit IRC12:11
openstackgerritAndrea Frittoli  proposed openstack/tempest: Support v3 in credential providers and subclasses  https://review.openstack.org/13302912:12
*** dkusidlo has quit IRC12:13
kashyapafazekas, My IRC proxy died, not sure if you saw my previous message, let me repost:12:14
kashyap(died briefly, i.e.)12:14
kashyap<kashyap> Also, if you've seen this w/ current DevStack git?12:14
kashyap<kashyap> "2015-03-13 12:00:49.730 | Authorization Failed: type object 'HTTPHeaderDict' has no attribute 'from_httplib'"12:14
kashyap<kashyap> Keystone fails to get token.12:14
*** Longgeek has joined #openstack-qa12:15
openstackgerritAndrea Frittoli  proposed openstack/tempest: Use the configured version of identity in stress  https://review.openstack.org/16125912:16
*** bkopilov has quit IRC12:20
*** bknudson has joined #openstack-qa12:21
openstackgerritAndrea Frittoli  proposed openstack/tempest: Support v3 in credential providers and subclasses  https://review.openstack.org/13302912:21
*** jhenner has quit IRC12:25
openstackgerritFilip Hubík proposed openstack/tempest: Add keystone v2.0 and v3 api discovery checks  https://review.openstack.org/16271012:27
*** tochi has quit IRC12:27
pc_mHi all!  Seeing function test breakage and need some advice. Anyone able to advise?12:29
*** Longgeek has quit IRC12:31
*** yamamoto has quit IRC12:37
*** chandankumar has quit IRC12:40
*** yamamoto has joined #openstack-qa12:41
*** k4n0 has quit IRC12:46
afazekaskashyap: no12:50
*** weshay has joined #openstack-qa12:52
kashyapafazekas, Np, I'll re-provision my env12:53
mriedem_awayadam_g: ihrachyshka: ah, that sucks12:55
mriedem_awayfunny we don't run an icehouse job against tempest changes on master https://review.openstack.org/#/c/160924/12:55
mriedem_awaylooks like we do, so why didn't this fail? http://logs.openstack.org/24/160924/8/check/check-tempest-dsvm-full-icehouse/d33a0aa/12:56
mriedem_awayactually http://logs.openstack.org/24/160924/8/check/check-tempest-dsvm-neutron-icehouse/3d4b6d0/12:56
mriedem_awayah, the test class was skipped on icehouse in the original change: http://logs.openstack.org/24/160924/8/check/check-tempest-dsvm-neutron-icehouse/3d4b6d0/console.html#_2015-03-11_22_13_06_08812:57
mriedem_awayso why would it fails stable/icehouse? this doesn't make sense.12:57
ihrachyshkamriedem_away, maybe gate job for tempest is not configured to support l3 extension12:58
ihrachyshkawhich is concerning...12:58
*** mriedem_away is now known as mriedem12:58
ihrachyshkasince l3 is pretty base12:59
mriedemso there was one hit in the gate on stable/icehouse13:00
mriedemhttp://goo.gl/WiB32O13:00
mriedemthe tests aren't skipped on icehouse: http://logs.openstack.org/45/164045/1/gate/gate-tempest-dsvm-neutron/0fccaed/console.html#_2015-03-13_02_43_19_46413:01
mriedemso gate-tempest-dsvm-neutron isn't configured the same way that check-tempest-dsvm-neutron-icehouse is13:02
mriedemcheck-tempest-dsvm-neutron-icehouse doesn't have the router extension enabled, gate-tempest-dsvm-neutron does13:03
*** mlavalle has quit IRC13:03
mriedemwhy didn't this fail for juno i wonder?13:03
mriedemon master the tests are skipped on juno b/c the router extension isn't enabled http://logs.openstack.org/24/160924/8/check/check-tempest-dsvm-neutron-full-juno/3f2ecf0/console.html#_2015-03-11_23_23_53_31213:04
mriedemso i guess i don't know how to handle this besides a config option in tempest, which would be useless after kilo. we could disable the router extension in the icehouse job so it actually acts like the job on master and stable/juno and skips those tests.13:05
*** dpaterson has joined #openstack-qa13:06
*** mlavalle has joined #openstack-qa13:07
openstackgerritZu Qiang proposed openstack-dev/devstack: Reset no_proxy when the node is installed behind a proxy  https://review.openstack.org/9498813:07
*** eugene_bag has joined #openstack-qa13:10
ihrachyshkamriedem, I would prefer actually testing router "extension" instead of disabling all tests for it13:14
mriedemihrachyshka: yeah, me too, but i'd also prefer that we don't skip tests on master changes which is basically lying about what's going to be tested with master tempest on stable/icehouse13:14
mriedemwe don't run those tests on stable/juno changes either13:15
*** vigneshvar has joined #openstack-qa13:15
mriedemhttp://logs.openstack.org/56/163456/2/check/check-tempest-dsvm-neutron-full/a41f094/console.html#_2015-03-11_20_25_11_85613:15
mriedemthat's a stable/juno nova patch13:15
*** rfolco has joined #openstack-qa13:15
mriedemthat or we need these compat jobs that run against tempest changes to actually run the tests that we have on stable today13:16
*** dpaterson has quit IRC13:18
*** dpaterson has joined #openstack-qa13:18
*** dboik has joined #openstack-qa13:21
mriedemmtreinish: when you're around, i'd like to know why check-tempest-dsvm-neutron-full on stable/icehouse runs tests that aren't run in check-tempest-dsvm-neutron-full-icehouse on master13:23
*** mpaolino has joined #openstack-qa13:24
mriedemi might need a config option for this preexisting ports test13:24
*** yfried|afk has quit IRC13:24
ihrachyshkamriedem, keep me informed. but overall, I'm against reducing test coverage for stable branches.13:27
*** yamamoto has quit IRC13:27
openstackgerritZu Qiang proposed openstack-dev/devstack: Reset no_proxy when the node is installed behind a proxy  https://review.openstack.org/9498813:28
*** mpaolino has quit IRC13:31
openstackgerritAndrea Frittoli  proposed openstack-infra/elastic-recheck: Add query for bug 1431724  https://review.openstack.org/16412013:32
openstackbug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [High,Fix released] https://launchpad.net/bugs/1431724 - Assigned to Andrea Frittoli (andrea-frittoli)13:32
andreafmriedem: I fixed the query ^^^13:32
mriedemandreaf: +W13:33
*** BharatK has quit IRC13:39
*** dboik has quit IRC13:50
*** dboik has joined #openstack-qa13:50
*** obutenko_ has joined #openstack-qa13:54
*** rbak has joined #openstack-qa13:59
*** dansmith is now known as superdan13:59
*** jecarey has joined #openstack-qa14:03
*** dims has quit IRC14:06
*** jaypipes is now known as leakypipes14:07
*** dims has joined #openstack-qa14:07
mtreinishmriedem: they shouldn't be different, icehouse neutron wasn't capable of doing a full tempest run in parallel14:10
mtreinishso the set of tests should be very limited14:10
mtreinishjust smoke and scenario (which should cover your new test)14:10
mriedemmtreinish: i looked for about a half hour to try and figure out where the api_extensions are filtered in the icehouse jobs but couldn't figure that out14:11
*** yamamoto has joined #openstack-qa14:11
mtreinishmriedem: oh is it that, the api extensions are hardcoded on icehouse and juno14:11
mtreinishin lib/tempest14:11
mtreinishthere's a bug with a fix pending14:12
*** pkoniszewski has quit IRC14:12
mtreinishone sec I'll dig it up14:12
mriedemhttp://logs.openstack.org/24/160924/8/check/check-tempest-dsvm-neutron-icehouse/3d4b6d0/logs/tempest_conf.txt.gz14:12
mriedem[network-feature-enabled] api_extensions = agent,14:12
mriedemso that job only runs with the neutron agent extension, whatever that is14:12
mtreinishmriedem: https://review.openstack.org/#/c/160572/14:12
mriedemhttp://logs.openstack.org/45/164045/1/gate/gate-tempest-dsvm-neutron/0fccaed/logs/tempest_conf.txt.gz14:12
mriedemhas them all: api_extensions = agent, allowed-address-pairs, binding, dhcp_agent_scheduler, ext-gw-mode, external-net, extra_dhcp_opt, extraroute, fwaas, l3_agent_scheduler, lbaas, lbaas_agent_scheduler, metering, multi-provider, provider, quotas, router, security-group, service-type, vpnaas14:13
mtreinishmriedem: it was a time based thing14:13
mtreinishmriedem: the fix landed between your patch going through check and being approved14:13
mriedemyeah, so now that https://review.openstack.org/#/c/160572/ is in,14:13
mriedemi should be good to restore my new test?14:13
mtreinishmriedem: yes14:13
mtreinishand it'll should fail on icehouse14:14
mriedemi verified that stable/juno neutron jobs are skipping test_network_basic_ops.py also14:14
mtreinishmriedem: https://review.openstack.org/#/c/160576/14:14
*** dboik has quit IRC14:15
*** Longgeek has joined #openstack-qa14:15
*** Ananci has joined #openstack-qa14:16
*** amotoki has quit IRC14:16
*** dboik has joined #openstack-qa14:16
*** ChuckC_ has joined #openstack-qa14:16
*** ChuckC has quit IRC14:17
*** afazekas has quit IRC14:18
openstackgerritMatt Riedemann proposed openstack/tempest: Restore "Add scenario 'test_preserve_preexisting_port'"  https://review.openstack.org/16419014:18
mriedemthere we go14:18
*** vigneshvar has quit IRC14:18
openstackrecheckopenstack/horizon change: https://review.openstack.org/159541 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/128681814:18
openstackLaunchpad bug 1286818 in OpenStack-Gate "Ubuntu package archive periodically inconsistent causing gate build failures" [Low,In progress] - Assigned to Jeremy Stanley (fungi)14:18
*** SridharG has quit IRC14:20
*** dboik has quit IRC14:21
*** bkopilov has joined #openstack-qa14:21
*** dboik has joined #openstack-qa14:21
openstackrecheckopenstack/glance change: https://review.openstack.org/164048 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/128681814:21
openstackLaunchpad bug 1286818 in OpenStack-Gate "Ubuntu package archive periodically inconsistent causing gate build failures" [Low,In progress] - Assigned to Jeremy Stanley (fungi)14:21
*** dims is now known as dimsum__14:21
*** ChuckC_ has quit IRC14:23
mtreinishEmilienM: I was looking at https://review.openstack.org/#/c/163622/ again and I was wondering is there always going to be a floating ip on each network label?14:24
EmilienMmtreinish: oh... very good question14:24
EmilienMmtreinish: let me check in Nova14:25
mtreinishbecause if there is a network without a floating ip the check loop will fail14:25
EmilienMyeah14:25
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - Add create_test_server function  https://review.openstack.org/15160114:26
openstackgerritJoseph Lanoux proposed openstack/tempest: Define validation_resources function for ssh validation  https://review.openstack.org/14922914:26
openstackgerritJoseph Lanoux proposed openstack/tempest: WIP - Add new multi ssh configuration options  https://review.openstack.org/14653514:26
*** eugene_bag has quit IRC14:27
openstackgerritZengfa Gao proposed openstack/tempest: :Add API tests for Neutron subnetpool  https://review.openstack.org/15964414:28
EmilienMmtreinish: looking at http://developer.openstack.org/api-ref-compute-v2.html14:29
EmilienMmtreinish: it seems you're right.14:29
EmilienMmtreinish: I'm checking now in my platform14:30
*** aysyd has quit IRC14:32
*** aysyd has joined #openstack-qa14:36
openstackgerritMerged openstack-infra/elastic-recheck: Add query for bug 1431724  https://review.openstack.org/16412014:37
openstackbug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [High,Fix released] https://launchpad.net/bugs/1431724 - Assigned to Andrea Frittoli (andrea-frittoli)14:37
*** sabeen has joined #openstack-qa14:37
*** cbader has joined #openstack-qa14:40
openstackgerritMatthew Treinish proposed openstack/tempest: Skip test_connectivity_between_vms_on_different_networks for baremetal  https://review.openstack.org/16393414:41
mtreinishadam_g: ^^^ I just went back to rev 2 since the existing port test was reverted14:41
EmilienMmtreinish: I confirm I don't see floating when no floating is associated. I'm updating my patch.14:41
*** pal has joined #openstack-qa14:45
*** amotoki has joined #openstack-qa14:46
EmilienMmtreinish: so in fact I think we consider if use_floatingip_for_ssh is at True, the servers have floating IP. Since we try to create one in Javelin/Create14:47
EmilienMmtreinish: am I missing something?14:47
openstackrecheckopenstack/nova change: https://review.openstack.org/164045 failed because of: gate-tempest-dsvm-neutron: https://bugs.launchpad.net/bugs/128681814:47
openstackLaunchpad bug 1286818 in OpenStack-Gate "Ubuntu package archive periodically inconsistent causing gate build failures" [Low,In progress] - Assigned to Jeremy Stanley (fungi)14:47
*** Longgeek has quit IRC14:49
mtreinishdkranz: if you've got a sec a couple of quick doc patches: https://review.openstack.org/#/c/163578/ , https://review.openstack.org/163587 , and https://review.openstack.org/15801714:54
*** SridharG1 has quit IRC14:54
dkranzmtreinish: sure, I was just starting to do some reviews14:55
dkranzmtreinish: BTW, the issue I fixed with not filling creds when called from is_admin_available was the actual source of the TypeError issues I was seeing14:55
dkranzmtreinish: So I don't think we need to add a catch for that14:56
mtreinishdkranz: cool, yeah I saw that patch go through14:56
*** SridharG has joined #openstack-qa14:56
mtreinishdkranz: it might still be worth adding unit tests for the is_admin_available() function though14:56
dkranzmtreinish: I started to do that but ran into some nasty problems14:56
*** pal_ has joined #openstack-qa14:57
dkranzmtreinish: I need some help from a mock expert14:57
*** pal has quit IRC14:57
dkranzmtreinish: I actually have a complete test that I thought should work but it fails in strange ways14:57
mtreinishdkranz: well I'm no expert w/ mock but I can take a look at it. Can you upload it as a wip14:58
dkranzmtreinish: That is what I was thinking14:58
dkranzmtreinish: One thing was that the behavior of the unit tests seemed to change depending on if there was an actual tempest.conf or not. Is that expected? I was not expecting it.14:59
dkranzmtreinish: I used the same mock for PrivateConfig as the other tests use.14:59
mtreinishdkranz: hmm, if you mock out config then it shouldn't ever use the tempest.conf15:00
dkranzmtreinish: that's what I thought. The other strange thing was that I got different behavior depending on whether I ran all the test cases or just one. Strange. ANyway I will pu;sh it up today15:01
*** openstackrecheck has quit IRC15:04
*** mriedem has quit IRC15:04
*** openstackrecheck has joined #openstack-qa15:04
*** ChuckC_ has joined #openstack-qa15:07
*** erlon has quit IRC15:11
*** mtanino has joined #openstack-qa15:13
*** bknudson has quit IRC15:13
*** jgrimm has quit IRC15:13
*** jgrimm has joined #openstack-qa15:14
*** yfried|afk has joined #openstack-qa15:21
*** tsekiyama has joined #openstack-qa15:28
*** erlon has joined #openstack-qa15:29
*** sputnik13 has joined #openstack-qa15:30
*** zz_dimtruck is now known as dimtruck15:31
*** david-lyle_afk is now known as david-lyle15:33
*** mriedem has joined #openstack-qa15:34
*** ibiris is now known as ibiris_away15:35
*** DaSchab has joined #openstack-qa15:35
*** yfried|afk has quit IRC15:36
*** cody-somerville has joined #openstack-qa15:37
*** sputnik13 has quit IRC15:38
openstackgerritgordon chung proposed openstack-dev/devstack: switch to use ceilometermiddleware  https://review.openstack.org/15547315:41
*** dboik_ has joined #openstack-qa15:43
*** dboik has quit IRC15:43
*** ibiris_away is now known as ibiris15:43
openstackgerritDavid Kranz proposed openstack/tempest: Add test for the various config cases of is_admin_available()  https://review.openstack.org/16422515:44
*** mpopow has joined #openstack-qa15:44
*** bknudson has joined #openstack-qa15:45
*** ajo has quit IRC15:48
*** ChuckC_ has quit IRC15:49
*** DaSchab has quit IRC15:51
*** ChuckC has joined #openstack-qa15:53
*** marun has joined #openstack-qa15:54
*** ajo has joined #openstack-qa15:55
openstackgerritMerged openstack/tempest: Create test nodes for test_baremetal_nodes  https://review.openstack.org/16277315:55
*** amotoki has quit IRC15:56
*** yamamoto has quit IRC15:57
sdaguemtreinish: what keeps merge conflicting this - https://review.openstack.org/#/c/158852/15:57
mtreinishsdague: that was what we were just talking about in infra15:58
mtreinishthere was a corrupt ceilo clone which confused zuul15:58
sdagueah15:58
sdagueok, thanks for looking into it15:59
*** Sukhdev has joined #openstack-qa15:59
openstackgerritMerged openstack/tempest: Cleanup the tempest readme  https://review.openstack.org/16358715:59
*** e0ne_ has quit IRC15:59
*** amotoki has joined #openstack-qa16:00
mtreinishsdague: sure, np. I actually only noticed because the zuul graph looked cool with like 7 merge conflicts on all different projects in the gate16:03
*** mlavalle has quit IRC16:03
sdagueheh16:04
*** apevec has joined #openstack-qa16:04
openstackgerritEmilien Macchi proposed openstack/tempest: javelin: implement floating-ip support  https://review.openstack.org/16362216:06
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for detach_volume NoneType bug 1327218  https://review.openstack.org/16423516:08
openstackbug 1327218 in OpenStack Compute (nova) "Volume detach failure because of invalid bdm.connection_info" [High,Confirmed] https://launchpad.net/bugs/132721816:08
*** amotoki has quit IRC16:10
*** mpopow has quit IRC16:10
mtreinishsdague: so for the subunit2sql thing, you were saying I should change that migration to just make the time columns ints and be done with it16:11
*** Noice has joined #openstack-qa16:11
sdaguethat's my feeling16:12
sdagueI think a lot of things get simpler then16:12
sdagueand with mysql you can get pretty formatted times back with the functions I pointed you at16:13
mriedemmtreinish: so we're reusing volumes in tempest runs right?16:13
mtreinishsdague: ok cool, that's what I'll do then16:13
mtreinishmriedem: hmm, maybe for some tests, but I thought most tests just create and delete16:14
*** SridharG has left #openstack-qa16:14
mriedemi was tracing a volume id through the n-cpu logs and seeing the same volume showing up in multiple tests16:14
mriedemand one of them blew up b/c on detach the bdm.connection_info was gone16:14
mriedemi'm guessing b/c another test did something to wipe it out (update the db)16:15
mriedemnot sure though, it's been a long-standing bug16:15
*** rwsu-afk is now known as rwsu16:15
mtreinishmriedem: was they all tests in one test class?16:16
mtreinishman I can't speak today...16:16
*** woodster_ has joined #openstack-qa16:16
mriedemmaybe they was...16:16
mriedem:)16:16
mtreinishok, because I can see that being a reuse case, especially because volumes are kinda expensive to create for every test16:17
mtreinishbut between test classes if you saw that, something is really going wrong16:17
openstackgerritMerged openstack/tempest-lib: Add api docs to the rest client  https://review.openstack.org/15801716:20
*** amotoki has joined #openstack-qa16:22
*** jogo is now known as flashgordon16:22
*** mpopow has joined #openstack-qa16:22
*** tkammer has quit IRC16:26
*** amotoki has quit IRC16:27
*** Longgeek has joined #openstack-qa16:34
*** dboik_ has quit IRC16:36
*** dboik has joined #openstack-qa16:37
*** mlavalle has joined #openstack-qa16:37
openstackgerritFilip Hubík proposed openstack/tempest: Add keystone v2.0 and v3 api discovery checks  https://review.openstack.org/16271016:38
*** mlavalle has quit IRC16:38
*** pkoniszewski has joined #openstack-qa16:39
mtreinishsdague: I was looking more at the unix_timestamp stuff, and it looks like it's still only second resolution as an int. How were you able to deal with the microseconds?16:39
mriedemmtreinish: well, this at least is really confusing when you're stepping through the n-cpu logs:16:40
mriedemhttp://git.openstack.org/cgit/openstack/tempest/tree/tempest/scenario/test_encrypted_cinder_volumes.py#n3816:40
mriedemfor the cryptsetup test we still name the volume_type with 'luks'16:40
mriedemso i was thinking the luks test failed while digging through the compute logs, but it was the cryptsetup test that failed16:40
mtreinishmriedem: oh, that's a clear bug16:41
mriedemi'll push a change for that16:41
mtreinishresources should never be created with a static name16:41
*** melwitt has joined #openstack-qa16:41
mtreinishI think that's even written down somewhere :)16:41
mriedemmtreinish: well the utility creates a random name: randomized_name = data_utils.rand_name('scenario-type-' + name + '-')16:41
mriedembut name is always 'luks'16:41
mriedemeven when not using luks16:41
mtreinishhttp://docs.openstack.org/developer/tempest/HACKING.html#parallel-test-execution16:42
mtreinishmriedem: it should just call tempest_lib.common.utils.data_utils.rand_name('luks') on L3916:43
mtreinishinstead of just 'luks'16:43
mtreinishmriedem: oh, heh I didn't even notice that one wasn't luks16:43
mriedem"volume_type": "scenario-type-luks--1230229905"16:43
mriedemit still gets a random name16:44
mriedembut it's not only the luks test16:44
mriedemanyway, easy change16:44
mriedemi'll push a thing16:44
*** mpopow has quit IRC16:44
mtreinishoh, ok. I guess the create_volume_type() call is calling that inside16:44
mriedemthe other interesting thing is that detach_volume explodes in nova but apparently doesn't return a failure code16:44
mriedemyeah16:45
mtreinishoh, that's fun16:45
*** pkoniszewski has quit IRC16:46
mriedemyeah, we're just stuck in 'detaching' state until that times out16:47
mtreinishmriedem: do you have a link with the explosion?16:47
mriedemyou know it16:47
mriedemhttp://logs.openstack.org/93/156693/7/check/check-tempest-dsvm-postgres-full/d3b26e8/logs/screen-n-cpu.txt.gz#_2015-03-12_16_38_17_56716:48
mriedemhttps://bugs.launchpad.net/nova/+bug/132721816:48
openstackLaunchpad bug 1327218 in OpenStack Compute (nova) "Volume detach failure because of invalid bdm.connection_info" [High,Confirmed]16:48
NoiceHello, to finalize the installatin of swift, what node is the swift.conf downloaded to? Controller?16:49
notmynameNoice: swift.conf should be on every swift node16:49
*** mestery has quit IRC16:50
*** mpaolino has joined #openstack-qa16:50
openstackgerritMatt Riedemann proposed openstack/tempest: Distinguish between luks and cryptsetup volume types  https://review.openstack.org/16425916:51
mriedemmtreinish: ^16:51
*** mestery has joined #openstack-qa16:51
*** safchain has quit IRC16:51
openstackgerritFilip Hubík proposed openstack/tempest: Add keystone v2.0 and v3 api discovery checks  https://review.openstack.org/16271016:51
mriedemalso https://review.openstack.org/#/c/164235/16:52
mriedemthat's the e-r query for this failure ^16:52
mtreinishmriedem: yeah that's weird, I would have expected the traceback to result in setting something as an error state or an error resp16:56
*** Longgeek has quit IRC16:56
mtreinishbut, thinking about it more, it's async so the resposne cant be sent back to the user, and nova doesn't own the volume state so it probably can't set it as error16:56
mtreinishmriedem: nova doesn't have a mechanism to tell cinder things went bad does it?16:56
*** harlowja has joined #openstack-qa16:57
mriedemit's a cast, yeah16:58
mriedemdamn16:58
mriedemwell nova calls cinderclient.begin_detaching and i'm not sure what that does16:59
mriedemassuming it sets some state, like don't use it16:59
*** apevec has quit IRC16:59
*** dustins_ has joined #openstack-qa16:59
mriedemoh yeah, sets volume status to 'detaching'16:59
mriedemi saw that in the tempest console logs16:59
*** anshul has quit IRC16:59
mriedemit's 'detaching' until tempest times out and deletes the volume17:00
sdaguemtreinish: honestly, do the 2 columns17:01
mtreinishmriedem: yeah I just found that in the cinder code: http://git.openstack.org/cgit/openstack/cinder/tree/cinder/volume/api.py#n50817:02
mriedemmtreinish: ok, so at a minimum, we need to call roll_detaching when detach_volume explodes in the compute manager17:03
mriedemto put the volume status back in 'in-use'17:03
*** dustins has quit IRC17:03
mriedemroll_detaching would be better named 'rollback_detaching', but whatevs17:03
*** sputnik13 has joined #openstack-qa17:03
*** jlanoux has quit IRC17:03
mtreinishsdague: oh ok, well then I'm not sure that changes things for the migration I have. I would probably just add a follow-on one to convert the datetime column to an int17:04
sdaguemtreinish: sure17:04
sdaguemriedem: you saw folks had to revert your revert right? it cratered icehouse jobs17:04
mtreinishmriedem: are you sure that's what you want to do that. Is the volume still usable after the failed detach?17:04
mriedemsdague: ?17:05
mtreinishsdague: yeah, we got the bottom of how it slipped in too17:05
mriedemhttps://review.openstack.org/#/c/164190/17:05
mriedemmtreinish: good question, i'm not sure if it's usable17:05
mriedemnova doesn't have the connection_info anymore...17:05
mriedemi'm wondering if nova can somehow refresh the connection info17:05
mriedemmtreinish: actually, heh, we already try to rollback the detach in the nova compute manager, but where we're failing is outside that try/except block17:07
mtreinishmriedem: haha, nice17:07
sdaguemriedem: that patch still fails icehouse, fwiw17:07
mriedemsdague: hmm, i'm confused then17:08
mriedemsdague: we shouldn't merge it if it's going to break stable/icehouse jobs again17:08
mtreinishsdague: it should the issue was we fixed the tempest extension list on icehouse devstack17:08
mriedemmtreinish: the icehouse compat job is failing on the restore https://review.openstack.org/#/c/164190/17:08
mtreinishmriedem: yeah, that was expected. Because we have the right extension list on icehouse now17:09
mriedemoh17:09
mriedemwell we shouldn't merge this test if it's going to break icehouse then...17:09
mtreinishit only skipped before because the extension list was wrong17:09
mriedemit's skipped in juno fwiw17:09
mtreinishmriedem: juno devstack still has the broken extension list (there is a patch in progress to fix it, it's blocked by another broken job)17:10
mtreinishmriedem: we just need to fix your patch to have the proper skip conditions so it doesn't run where it can't run17:10
mriedemmtreinish: yeah, that's going to require a compute-feature-enabled flag then17:10
*** cody-somerville has quit IRC17:11
*** mpaolino has quit IRC17:11
mriedemjust marked the restore patch WIP17:11
*** cody-somerville has joined #openstack-qa17:11
mtreinishsigh, well if that's what it takes. It's something beyond the scope of backport I'm guessing?17:11
*** Nic has joined #openstack-qa17:13
*** annashen has joined #openstack-qa17:15
*** patrickeast has joined #openstack-qa17:16
*** ajo has quit IRC17:16
*** mpaolino has joined #openstack-qa17:16
*** jordanP has quit IRC17:18
*** markus_z has quit IRC17:20
openstackgerritMerged openstack-dev/devstack: Fail if run in POSIX compatability mode  https://review.openstack.org/16321417:27
adam_gdkranz, hey sorry to bother you again, https://review.openstack.org/#/c/163934/ got jammed up in the gate yesterday and needs a reapproval, if you have a sec17:27
openstackrecheckopenstack/cinder change: https://review.openstack.org/158829 failed gate-cinder-pep8, gate-cinder-python27 in the gate queue with an unrecognized error17:29
openstackgerritMerged openstack/tempest: Remove neutron CLI tests  https://review.openstack.org/16285017:30
*** erlon has quit IRC17:31
dkranzadam_g: looks like some one beat me to it17:32
*** achanda has joined #openstack-qa17:33
*** dustins_ has quit IRC17:33
adam_gdkranz, ah! :)17:34
*** bkopilov has quit IRC17:34
*** bkopilov has joined #openstack-qa17:35
NoiceThis is a noob question, but the swift hash path suffix and prefix can be anything right? There is no defined standard beyond the organization running the cloud?17:36
openstackgerritMerged openstack/tempest: Replace hardcoded volume size by created volume size  https://review.openstack.org/16303817:40
openstackgerritMerged openstack/tempest: Copy the default params dict to avoid race  https://review.openstack.org/16389517:41
*** johnthetubaguy is now known as zz_johnthetubagu17:42
marunmtreinish: do you have time today to revisit the issue of freezing neutron api test development?17:42
*** jhenner has joined #openstack-qa17:43
notmynameNoice: correct. the biggest "rules" are that it cannot be changed and that they must be secret17:43
*** bkopilov has quit IRC17:43
*** dustins has joined #openstack-qa17:44
*** bkopilov has joined #openstack-qa17:44
notmynamehmm...I used scare quotes and shouldn't have. those are the rules17:44
*** ChuckC has quit IRC17:45
openstackgerritZengfa Gao proposed openstack/tempest: Add API tests for Neutron subnetpool  https://review.openstack.org/15964417:46
*** bkopilov has quit IRC17:50
*** bkopilov has joined #openstack-qa17:51
*** annashen has quit IRC17:51
*** rushiagr_away is now known as rushiagr17:51
openstackgerritZengfa Gao proposed openstack/tempest: Add API tests for Neutron subnetpool  https://review.openstack.org/15964417:51
*** Sukhdev has quit IRC17:52
*** Longgeek has joined #openstack-qa17:53
*** omnibus7 is now known as davidlenwell17:57
*** bkopilov has quit IRC17:58
*** bkopilov has joined #openstack-qa17:59
*** ajmiller has joined #openstack-qa18:06
*** idokungfu has joined #openstack-qa18:07
dkranzmtreinish: This test fails test5 only if you have a chance to take a look https://review.openstack.org/#/c/164225/1/tempest/tests/common/test_admin_available.py,unified18:08
*** mpaolino has quit IRC18:12
mriedemmtreinish: so now i'm all paranoid about this change https://review.openstack.org/#/c/157054/18:13
mriedemlive migrating a paused instance doesn't work in juno or icehouse18:13
mriedemthere are 2 config flags already to not run that test...but you could support both pause and live_migrate, and fail with that in juno...18:13
mriedemwe won't hit any failures in the gate since multi-node is required and that's only on experimental atm18:14
openstackgerritMerged openstack-infra/elastic-recheck: Add query for detach_volume NoneType bug 1327218  https://review.openstack.org/16423518:19
openstackbug 1327218 in OpenStack Compute (nova) "Volume detach failure because of invalid bdm.connection_info" [High,Confirmed] https://launchpad.net/bugs/132721818:19
openstackgerritMorgan Fainberg proposed openstack-dev/devstack: Add response time to keystone access log  https://review.openstack.org/16404218:20
*** woodster_ has quit IRC18:20
*** fandi has joined #openstack-qa18:20
*** fandi has quit IRC18:21
flashgordonmtreinish: https://review.openstack.org/#/c/151056/ should I just abandon that patch?18:22
*** Longgeek has quit IRC18:22
*** nikil has joined #openstack-qa18:23
*** shardy has quit IRC18:24
*** bkopilov has quit IRC18:25
*** bkopilov has joined #openstack-qa18:25
*** nikil has quit IRC18:28
*** nikil has joined #openstack-qa18:28
*** pal_ has quit IRC18:29
*** openstackrecheck has quit IRC18:31
*** openstackrecheck has joined #openstack-qa18:31
*** bkopilov has quit IRC18:32
*** bkopilov has joined #openstack-qa18:32
*** mlavalle has joined #openstack-qa18:33
*** e0ne has joined #openstack-qa18:34
*** Sukhdev has joined #openstack-qa18:35
dkranzmriedem: about https://review.openstack.org/#/c/161768/18:43
mriedemdkranz: yeah18:43
dkranzmriedem: Is this an atttempt to generate failures so logstash can be used to track them down?18:43
mriedemdkranz: well it was, but i haven't seen those tests fail after like 9 rechecks18:44
mriedemdkranz: so i basically changed it to just 'unskip'18:44
mriedemhowever, i'm all paranoid about stable branches now18:44
dkranzmriedem: that was not clear from the commit message18:44
mriedemyeah...18:45
mriedemit was originally dependent on a logging patch in nova which has since merged18:45
dkranzmriedem: I still think there should be a way to skip tests on stable branches18:45
mriedemi could update the commit message to just say 'we aren't seeing this anymore on master, unskip'18:45
mriedemyeah that would be nice18:46
dkranzmriedem: sure but I am also going to +A18:46
dkranzmriedem: and I am also pushing a patch that will run that test under stress as WIP18:46
flashgordondevstack is back down to about 15 minutes again18:46
mriedemdkranz: i checked the juno and icehouse neutron compat jobs and they are running the tests, so that makes me feel better18:47
flashgordondtroyer: we make about 170 or so calls to OSC in devstack18:47
flashgordonand a lot of those take at least two seconds18:48
openstackgerritDavid Kranz proposed openstack/tempest: DO NOT MERGE - Run network connectivity start/stop test as stress  https://review.openstack.org/16430018:48
*** andreykurilin_ has joined #openstack-qa18:49
flashgordonmtreinish: and tempest is 20 minutes or so18:50
dtroyerflashgordon: a lot of those calls are unnecessary…18:51
openstackgerritDean Troyer proposed openstack-dev/devstack: Batch up calls to OSC  https://review.openstack.org/16430218:51
dtroyerflashgordon:  ^^^ is a simplistic way to reduce the number.   it cut about 30 seconds off my slow VM tests18:52
*** annashen has joined #openstack-qa18:52
flashgordondtroyer: nice18:53
*** idokungfu has quit IRC18:53
flashgordonvery slick way to get around the load times18:54
dtroyerI'm playing with running osc as a long-running process instead and talking to it over pipes.  the issue is where we need to create or find an ID, the simple batch mode doesn't do that nicely18:54
flashgordondtroyer: what about the service create stuff18:54
dtroyerthat's only one call and it is inside an if block18:55
flashgordonalso are we re-using the same token for all of that ?18:55
mtreinishflashgordon: no, we can figure that patch out, we still want to do it18:55
mtreinishflashgordon: 20 min isn't too bad considering we're running ~1500 tests18:55
flashgordonmtreinish: no its not, are we ready to stop running say keystone API tests on nova changes?18:56
dtroyerflashgordon: yes, it's all the service token at this point, no auth available to set up keystone18:56
flashgordondtroyer: ohh right doh18:56
mtreinishmriedem: hmm so for the live migrate thing, do you want to add another flag, pause_live_migrate?18:56
*** liusheng has quit IRC18:56
*** annashen has quit IRC18:56
*** liusheng has joined #openstack-qa18:57
* morganfainberg perks up.18:57
mtreinishflashgordon: keystone's api tests would be easy to segregate, but what are you trying to save? if it's runtime that won't do much18:57
dtroyerIIRC we stick with the service token for all of the account creation so auth isn't part of the times there18:58
flashgordondtroyer: not too bad get_or_create_service takes 4 second start to end18:58
mriedemmtreinish: is that the only option? i kind of hate having to create a new flag for every new test we want just because we dont have the code back on stable18:58
flashgordonmtreinish: run time, I know its not a lot. but its an easy start18:58
flashgordonand the inverse.18:58
flashgordondon't run nova API tests on keystone patches18:58
mtreinishflashgordon: I'm sure morganfainberg doesn't care :)18:58
mtreinishmriedem: well it's that or backport18:58
dtroyerflashgordon: look at the time for the whole create_keystone_accounts().  in the logs, create_nova_accounts() immediately follows it so subtracting those two times is simple to compare the whole thing18:59
morganfainbergwait, i don't care about what? :P18:59
mriedemyeah, the backport isn't going to happen18:59
mriedemcurse you, branchless tempest18:59
morganfainbergbrrrraaaaaaaaaaaaanncchhhheessssss /zombie18:59
morganfainberg:P18:59
mtreinishmriedem: it's your own damn fault for breaking api consistency by fixing bugs :)18:59
mriedemfair point19:00
mriedemwell let me wip that one too now19:00
mriedemremember that scene from wayne's world where wayne exclaims that he's being shit on? that's what i feel like today :)19:00
openstackgerritJoe Gordon proposed openstack/tempest-lib: Deprecate the nova_manage client  https://review.openstack.org/15105619:01
mtreinishmriedem: heh, I could see that19:02
mtreinishflashgordon: fwiw, ironic already in the process of splitting there gating jobs off19:02
mriedemmy green dashboard is all turning red now19:02
flashgordonmtreinish:oh nice what is the process?19:03
mtreinishflashgordon: they're just changing there gating regex, instead of running full19:03
flashgordonmtreinish: it may be easier to start running less of tempest on say keystone before nova actually19:03
flashgordonmtreinish: link19:03
*** jordanP has joined #openstack-qa19:03
flashgordonmorganfainberg: would you mind if I make keystone gate faster?19:03
*** jordanP has quit IRC19:03
morganfainbergflashgordon, uhm... how would you do that?19:03
*** cody-somerville has quit IRC19:03
mtreinishyeah, but I would be -1 on doing that for nova19:04
mtreinishironic and keystone are diff19:04
morganfainbergflashgordon, i wont say no. but i want to know what you're proposing.19:04
flashgordonmorganfainberg: stop running compute tempest tests on keystone changes19:04
*** cody-somerville has joined #openstack-qa19:04
flashgordonmtreinish: what about nova?19:04
mtreinishflashgordon: https://review.openstack.org/#/c/161420/19:04
mtreinishflashgordon: nova is the glue, I'm much more hesitant to change that regex19:05
morganfainbergflashgordon, i don't think this is a bad idea. though, do you see any risk in a keystone change breaking nova [in most cases]? we've been good, but just want to see what you think.19:05
mtreinishmorganfainberg: well you've introduced a noticeable race at least once this cycle... :)19:06
flashgordonmtreinish: so your saying don't change the set of tests that are run against nova? or don't remove nova from say keystone?19:06
morganfainbergmtreinish, right.19:06
mtreinishflashgordon: don't change the set that runs against nova19:06
*** mpopow has joined #openstack-qa19:06
flashgordonmtreinish: ack, most of tempest is nova right now anyway19:06
morganfainbergmtreinish, but would that have been missed w/o nova cross-gating on the keystone changes19:06
mtreinishmorganfainberg: actually I think it would, just because the keystone tests in tempest are limited19:07
*** gfidente has quit IRC19:07
mtreinishbecause it was a race on initial creation, but I'm not sure the keystone tempest tests would tickle that19:07
morganfainbergmtreinish, this is why i am asking before19:07
flashgordonbut when did we catch the race?19:08
dkranzThe tempest scenario tests that use nova would still be running19:08
*** tosky has quit IRC19:08
mtreinishflashgordon: like a month or 2 ago19:08
dkranzEven if we stopped running tempest api nova tests on keystone19:08
morganfainbergmtreinish, flashgordon, maybe we want to wait until keystone spins up our functional testing suite?19:08
mtreinishdkranz: no the proposal would be to set the regex on keystone jobs to be 'identity'19:08
mtreinishso unless the scenario tests set that service tag they wouldn't be run either19:09
morganfainbergmtreinish, flashgordon, but i'm not opoosed to this change now. i just want to make sure we're not opening ourselves up for scary scary stuff too quickly19:09
morganfainbergmtreinish, flashgordon, i'll defer to your judgement on the risk - we (keystone) will continue to try and avoid causing issues regardless.19:09
dkranzmtreinish: why not identity + scenario?19:09
morganfainbergand keep working towards functional testing19:10
flashgordonmtreinish: as in how did we catch the race19:10
flashgordonmtreinish: did it land or did we catch it before it landed?19:10
*** dustins has quit IRC19:10
mtreinishflashgordon: by running 2 compute tests with tenant isolation at the same time19:10
flashgordonmtreinish: not how to reproduce the bug, but at what point did we realize we had the bug?19:11
mtreinishflashgordon: I don't remember, it was pretty obvious when looking at the code. I pushed the fix as soon as we noticed it19:12
openstackgerritMerged openstack/tempest: Skip test_connectivity_between_vms_on_different_networks for baremetal  https://review.openstack.org/16393419:12
mtreinishthere should have been an e-r query if you wanted to dig it up19:12
flashgordonmtreinish: right, my point is it got into the code even with our tests19:12
*** dustins has joined #openstack-qa19:12
mtreinishdkranz: that would probably be fine too19:12
dkranzmtreinish: that is just "virtualizing" what will happen when api tests are moved to projects19:13
mtreinishflashgordon: sure, but I just blame morganfainberg for the recheck grind to land it (even though it's not his fault) :)19:13
flashgordonmtreinish: can I set the regex to" tempest.api.identity|tempest.scenario19:14
flashgordonto run both?19:14
mtreinishflashgordon: yes that'll will do what you intend, but I would honestly do 'identity|scenario'19:15
flashgordonmtreinish: that works for me19:15
mtreinishin case something else is tagged as saying it needs keystone19:15
flashgordonahh so tags match too nice19:15
morganfainbergflashgordon, mtreinish so just ping me if you're going to change how we gate and point me at the patch.19:16
mtreinishflashgordon: but I feel before we start doing this, I think we need to have some people sit down and improve the test tagging. Which I view as a prereq before we can do any of this19:16
mtreinishalthough everything would be tagged as using keystone, because every test does19:17
flashgordonmtreinish: how about this, I'll post a patch up for morganfainberg to see19:18
flashgordonmark it as WIP19:18
flashgordonfor the idea19:18
flashgordonand go from there19:18
morganfainbergflashgordon, ++ let me know if you need anything else19:18
flashgordonand then we talk tagging details19:18
mtreinishflashgordon: sure19:19
mtreinishdkranz: yeah it does, but honestly I'm much more comfortable with this approach vs the complete split out19:20
dkranzmtreinish: I would like it better too, if we could solve the problem of a horizontal tempest core team19:21
*** annashen has joined #openstack-qa19:21
dkranzmtreinish: with big tent, I don't see how saying all the project api tests (and more deep functional) are in tempest19:22
mtreinishdkranz: I'm not sure I see that as a problem, if we just limit the scope of tempest to something like what I had in that WIP (which I need to revisit)19:22
flashgordonFYI running  just keystone tests takes about a minute19:23
mtreinishflashgordon: yeah with ~20 min of setup time19:23
flashgordonmtreinish: lol yeah ...19:23
dkranzmtreinish: I guess I don't see the value of having blackbox api/functional tests divided between tempest and project repos, but there are many different views about that19:23
flashgordon15 minutes now !19:23
mtreinishflashgordon: oh, you know trove is already doing this. I just remembered19:24
dkranzmtreinish: we should make sure it is resolved for real in Vancouver19:24
mtreinishflashgordon: because trove has 6 tests which are even quicker19:26
mtreinishdkranz: I've always viewed it as just a matter of tiering, that there are classes of things which belong in projects (like negative testing) and others that I view as belonging in tempest19:26
mtreinishso it becomes hard to make blanket statements about dirs of tests which I don't think are as clear cut19:27
mtreinishdkranz: but at the same time that also makes it difficult to make rules that are handled other than at the individual patch level about things we agree should be tested by tempest proper19:30
flashgordonmtreinish: yeah I thought I saw trove do this19:32
flashgordonhttps://review.openstack.org/#/c/164314/119:32
flashgordonmorganfainberg mtreinish: that is the idea ^19:32
flashgordonnow lets talk about tagging19:33
flashgordonmtreinish morganfainberg: what are your thoughts?19:33
mtreinishflashgordon: have you done a run with that regex before?19:34
flashgordonrunning it now19:34
mtreinishI'm curious how much time it actually saves19:35
flashgordonme too19:35
flashgordonwell ident only is about a minute or 219:35
mtreinishflashgordon: but scenario are normally the slowest tests19:36
flashgordonmtreinish: right ... I ma seeing that now19:36
flashgordonmaybe worth dropping them and just tagging a few with identity ?19:36
flashgordontest_encrypted_cinder_volumes etc19:36
flashgordonthat doesn't need to run against keystone I hope19:37
mtreinishflashgordon: but encryption that sounds like something keystoney :)19:37
flashgordonlol19:37
mtreinishmorganfainberg: ^^^ you're with me right19:37
flashgordonthere is another project that does that19:37
flashgordonin keystone org19:38
morganfainbergmtreinish, encryption is uhhh19:38
morganfainbergi mean somewhat19:38
morganfainbergkeystone, but i mean we don't "own" encryption stuff :P19:38
morganfainbergwe have encryption things.19:39
*** dustins has quit IRC19:39
mtreinishheh, I was giving you an opportunity to rule it all, and you turned it down :)19:39
morganfainbergmtreinish, i am scared to rule it all19:39
morganfainbergmtreinish, honestly, i don't want to own all encryption :P19:39
flashgordonmtreinish: my scenario times will be off, this is a fakevirt driver env19:40
flashgordonbut its still going19:40
mtreinishflashgordon: it will timeout for everything then19:40
mtreinishbecause scenario tests normally login to the guest19:40
flashgordonahh 1101.327519:40
flashgordon - Worker 0 (48 tests) => 0:06:23.703093s19:41
flashgordonso 6 minutes totatl19:41
flashgordonnot bad actually19:41
mtreinishflashgordon: you really have to use a real backend to get a feel for it. The cheap way to do it is just push a tempest patch which changes the regex in tox.ini for -efull19:42
mtreinishthat will give you real run times, like 20 of them19:42
openstackgerritJoe Gordon proposed openstack/tempest: DO NOT MERGE: testing regex  https://review.openstack.org/16432219:44
flashgordonlike that ^ ?19:44
mtreinishflashgordon: yep that should do it19:45
flashgordoncool19:45
flashgordonso what about tags?19:45
*** bkopilov has quit IRC19:45
flashgordonyou said that was something to be done before this?19:45
*** ajo has joined #openstack-qa19:46
mtreinishflashgordon: so it's probably not an issue with keystone, but we're pretty poor about applying service tags everywhere19:46
flashgordonso when should they be applied?19:47
mtreinishso I just  think we need some people to go through everything to make sure things are sane19:47
flashgordonon say a nova test that uses volumes?19:47
dkranzmtreinish: your last comment is what pushed me over the line towards thinking that moving them out of tempest was the way to go.19:47
flashgordonshould get a cinder tag19:47
mtreinishflashgordon: yeah exactly (although the tag is volume)19:48
flashgordonerr right19:48
flashgordonso for the special case of keystone what needs to be done19:48
flashgordonand for the rest of the tags, sounds like a great sprint session19:48
*** bkopilov has joined #openstack-qa19:48
mtreinishflashgordon: well keystone should be good, unless we get pedantic and start tagging everything19:49
mtreinishflashgordon: unless there is a test which explicity calls keystone's api somewhere (which ther emight be)19:50
*** Longgeek has joined #openstack-qa19:50
flashgordonany easy way (grep) way to find those19:50
mtreinishflashgordon: err, I'm not sure, it all eventually goes to tempest.services.identity, but things normally go through an object initialized in tempest.clients and are aliased in local test classes19:51
mtreinishdkranz: which statement?19:52
mtreinishI had a network blip and my client dropped the history19:52
flashgordonmtreinish: http://paste.openstack.org/show/19217819:52
flashgordongit grep identity_client tempest/api | grep -v 'api/identity/'19:53
*** sabeen has quit IRC19:53
dkranzmtreinish: back at 15:3019:53
flashgordonquotas tests sound reasonable to tag19:54
dkranzmtreinish: IMO it is arbitrary and the current set of tempest api tests are all over the map19:54
flashgordonanyway lunch time bbiab19:54
mtreinishdkranz: ok, yeah but that's because we've mostly just allowed everything. I think if we came up with stricter guidelines and then applied them to all new patches and used them as an additional criteria for removal that's a much better approach19:56
*** ajmiller_ has joined #openstack-qa19:56
*** rushiagr is now known as rushiagr_away19:57
dkranzmtreinish: I would be fine with that and we have discussed it in the abstract last three summits19:57
mtreinishdkranz: well the real problem before was there wasn't anywhere else for anything to live. That's not true today (at least for some projects)19:58
mtreinishdkranz: and we've also started this process, like for cli testing19:58
dkranzmtreinish: yes. Maybe there can be some discussion about this during the NY thing (which I will not be there physically but will be around Wed/Thur)19:58
*** ajmiller has quit IRC20:00
mtreinishdkranz: well, to be honest I was trying to avoid discussions like that in NY,  because it's the appearance of being behind closed. (also because of limited space)  I was mostly trying to save that time to be high bandwidth get some bps and other todos done20:01
mtreinishbut I'm sure the topic will at least come up20:01
dkranzmtreinish: your call :)20:02
*** bkopilov has quit IRC20:02
dkranzmtreinish: I am actually not a subscriber to the theory that "closed-door" discussions are bad as long as any theory is then published20:02
dkranzmtreinish: not everyone can travel to the summits either20:03
mtreinishdkranz: neither am I, I'm just cognizant of that opinion. Also the sprint has much more limited attendance20:04
*** bkopilov has joined #openstack-qa20:04
*** achanda has quit IRC20:06
openstackgerritZengfa Gao proposed openstack/tempest: Add API tests for Neutron subnetpool  https://review.openstack.org/15964420:08
*** yamahata has joined #openstack-qa20:09
mriedemmtreinish: this is the culmination of my day with that detach_volume thing https://review.openstack.org/#/c/164330/20:09
*** mpopow has quit IRC20:09
*** achanda has joined #openstack-qa20:11
mtreinishmriedem: cool, I'll tkae a look20:13
mriedemit's really addressing the symptom, which sucks20:13
*** Longgeek has quit IRC20:18
mtreinishmriedem: I wonder if we should look at doing a callback mechanism with cinder, it might help with things like this20:18
mriedemcallback how?20:18
marunmtreinish: do you have time to revisit the issue of neutron api tests?20:19
mtreinishmriedem: similar to the nova api that neutron uses to inform about state of things20:19
mtreinishmriedem: so we can better track the state of volumes between the services20:20
mriedemmtreinish: you mean the events stuff?20:20
mtreinishyeah20:21
mriedemndipanov was working on that at one point i thought20:21
mtreinishI'm just thinking out loud20:21
mriedembasically, attach a volume and wait for cinder to send an event back20:21
marunmriedem: oh, nova doesn't wait for that to complete?20:21
mtreinishmriedem: yeah something like that20:21
* marun wonders why people keep forgetting this is supposed to be a distributed system20:22
mtreinishmarun: heh, it's surprising isn't it20:22
mtreinishmarun: yeah we can probably talk about it now20:22
openstackgerritMerged openstack/tempest: remove redundant negative flavor admin tests  https://review.openstack.org/15885220:23
openstackgerritMerged openstack/tempest: remove redundant negative flavor admin tests  https://review.openstack.org/15885220:23
mriedemmarun: well, i don't think cinder does it20:23
mriedemhttp://git.openstack.org/cgit/openstack/nova/tree/nova/virt/libvirt/volume.py#n39420:23
marunmtreinish: As I said yesterday, I'm hoping we can devise a strategy for freezing.20:23
mriedemnova does everything locally, plugs vifs, attaches volumes, etc etc20:24
marunmriedem: ouch.  good luck testing something like that comprehensively.20:24
mriedemit's like nova-volume and the network stuff never moved out of nova :)20:24
*** achanda has quit IRC20:25
marunmriedem: ah, so when the responsibility was removed, no rearchitecture was done.20:25
mriedemand now we have multiple services keeping track asynchronously20:25
marunmriedem: :/20:25
mriedemi guess?20:25
openstackrecheckopenstack/keystone change: https://review.openstack.org/162266 failed because of: gate-keystone-pep8: unrecognized error, gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/131106620:25
openstackLaunchpad bug 1311066 in OpenStack-Gate "Some nodes allocated in node pool are very very slow" [High,Confirmed]20:25
mriedemnova-volume was before my time20:25
marunmriedem: that certainly was the case with neutron20:25
*** e0ne has quit IRC20:25
mtreinishmriedem: was it? I remember having to work with it. Although that probably was from before you started on openstack stuff20:25
marunmriedem: it took me looking through the source to figure out that nova was racing vm boot against neutron port wiring20:25
mriedemso now it makes sense to me why every time there is a new cinder driver or neutron plugin we have new volume and vif types to handle in the libvirt code in nova20:26
mtreinishmriedem: to be fair though it was basically identical to cinder at that point20:26
mriedemwhy can't nova just talk to black box volume / network service and that can hide all of the backend driver details from nova?20:27
marunmriedem: people like making work for themselves?20:27
mriedemnetwork_service.attach_port(instance, port)20:27
mriedemgo!20:27
marunmriedem: if things were architected as distributed from the get-go, that's where we'd be20:28
marunmriedem: but since it's not, we're stuck with a crap-tonne of code that assumes synchronous20:28
marunit would take a major rewrite to remove those assumptions, not just the calling points20:28
mriedemwell, i'm not dumping on it too much, things move forward and it's hard to forklift20:28
mriedembut it certainly makes things more complex20:29
marunmriedem: still, it's kind of sad that a distributed system, going on 5 years old by now, isn't architected to be properly distributed in all kinds of ways.20:29
marunthe joys of legacy20:29
marunmtreinish: neutron api tests?20:30
mtreinishmarun: so do you have the numbers on in flight api.neutron tests?20:31
marunmtreinish: building a gerrit query for that as we speak20:31
marunmtreinish: I always struggle with the file searches20:31
* marun goes to look at gerrit query docs20:31
marunmtreinish: https://review.openstack.org/#/q/project:openstack/tempest+file:%255Etempest/api/network/.*+status:open,n,z20:32
marunmtreinish: doesn't look too bad, honestly20:33
mtreinishmarun: tbh, I'm also still kinda hesitant to freeze dev here, because this really feels like a neutron decision. Especially when we don't have a clear direction yet on the scope of tempest with functional testing20:33
mtreinishmarun: yeah that's not too many, although a bunch have been around for awhile20:33
mtreinishlike I know armax's dvr thing is at least from the fall20:33
mtreinishmarun: by neutron decision I meant a neutron policy decision to say all new api tests belong in neutron20:34
marunmtreinish: I can make that happen.20:34
*** Sukhdev has quit IRC20:35
marunmtreinish: I'll work with Kyle to make it official, and once we have it committed to our repo, you'll be willing to freeze?20:35
marunmestery: ^^20:35
*** BharatK has joined #openstack-qa20:35
mesterymarun: Yay!20:36
mtreinishmarun: no that's what I'm saying you guys say that's your policy and watch the tempest queue to tell people20:36
mtreinishthen your frozen without input from me :)20:36
mesterymtreinish: I see what you did there ;)20:36
marunmtreinish: ah, so we'll be responsible for policing it, at least in the near term?20:36
mtreinishbecause that's really what it comes down to20:36
marunmtreinish: and once the tests are removed, the policing becomes unnecessary since there won't be a place for them to go?20:37
mtreinishmarun: yeah, I think that's probably best way to handle that, you guys self police :) (how could that go wrong)20:38
marunlonger term, obviously, we still have to solidify how the in-tree tests are to be consumable and can run against stable20:38
marunmtreinish: ok, fair enough.20:38
mtreinishmarun: yeah, I think the deletion is a a different discussion, but in the short term if you want to move dev that's how I think we should go about it20:38
marunmtreinish: sounds good20:38
marunmestery: thoughts?20:38
mesterymarun: This all seems reasonable and puts us in control of our own destiny. +2 from me20:39
marungreat!20:39
* mtreinish hopes no one notices he indemnified himself from tests slipping freeze :)20:40
flashgordonmtreinish: another possibly easy test thing to sort out20:41
flashgordonhorizon20:41
flashgordonhow many tests does tempest even have for horizon?20:41
mtreinishflashgordon: heh, 120:41
flashgordonwe run 3 full tempest and a grenade job on it20:41
flashgordondoes grenade even test horizon?20:41
flashgordon(I hope so)20:41
mtreinishflashgordon: heh, shh...20:41
mtreinishflashgordon: all it does is login with raw http calls20:42
*** annashen has quit IRC20:42
mtreinishflashgordon: we could easily move it to somewhere else20:42
mtreinishdavid-lyle: ^^^20:42
flashgordonmtreinish: well for starters we don't need to run it 3x20:42
mtreinishflashgordon: sure we do, postgres breaks the horizon all the time :)20:43
david-lylemove it where?20:43
flashgordonmtreinish: I can't tell if your joking or not sadly20:43
mtreinishflashgordon: haha, I am joking20:43
mtreinishdavid-lyle: somewhere you think it makes sense20:43
flashgordondavid-lyle: tempest/scenario/test_dashboard_basic_ops.py20:43
david-lylewe have no db so upgrade is of no concern20:44
flashgordondavid-lyle: do you have a test like that one elsewhere?20:44
mtreinishdavid-lyle: what about the consistent config during an upgrade?20:44
david-lylemtreinish: we don't test that20:44
david-lylebuyer beware20:44
mtreinishdavid-lyle: that's part of what grenade gives you, the config doesn't change between releases20:45
mtreinishunless you explicitly add it20:45
mtreinishdavid-lyle: but regardless the upgrade question is different from the question of having that test in tempest20:45
david-lyleour config is different than most of openstack and uses some django settings files20:45
david-lyleonly a very small set a required to run20:45
david-lyleand the only time that base few change is when django changes how it works20:46
mtreinishdavid-lyle: sure, I was just saying that's part of what grenade is doing20:46
david-lylewe have an integration test suite in horizon that runs approximately the same test as is in tempest20:46
mtreinishdavid-lyle: link?20:47
david-lylemtreinish: sure, just saying I believe were not testing anything like that20:47
david-lylemtreinish: looking20:47
mtreinishdavid-lyle: then do you want to go through: https://wiki.openstack.org/wiki/QA/Tempest-test-removal and propose removing the test during the next removal meeting?20:47
mtreinishthen you can safetly kill all your tempest jobs20:48
flashgordonmtreinish: oh that is even better20:48
flashgordonmtreinish: for now I have https://review.openstack.org/16434420:48
flashgordondavid-lyle: ^20:48
mtreinishflashgordon: honestly I'd rather just wait until the 5th and kill all the jobs20:48
flashgordonmtreinish: I am fine with that too20:48
flashgordonthe 5th? why so long?20:48
david-lylemtreinish: so your option would pull us out of the integrated gate/20:49
mtreinishdavid-lyle: yep20:49
*** annashen has joined #openstack-qa20:49
mtreinishdavid-lyle: to be fair I think the only reason horizon was part of the integrated gate was because of project policy for being integrated20:50
david-lylemtreinish: the only thing being in the integrated gate really validates is that keystone didn't break, but our tests should cover that20:50
flashgordonmtreinish: if this was wait until next week  then why not20:50
david-lylewe usually have to fix the issue locally anyway20:50
david-lyleI'd be ok with removing20:50
mtreinishflashgordon: we do the removal meetings once a month20:50
flashgordonmtreinish: ahh, so this is a quick win for now20:51
david-lylewe don't need to fail jobs on neutron/nova/cinder tests20:51
flashgordonand frees up a ton of test nodes20:51
flashgordonmtreinish: and what about the grenade testing?20:51
flashgordonmtreinish: we do basic grenade testing of horizon (not even sure what that means here though)20:51
david-lyleso this will run more like the client project tests?20:51
clarkbmtreinish: I think it was in there for two reasons. First its installed by devstack defaults and second there were plans to add tests it just never happened20:52
mtreinishdavid-lyle: sure, and if you do hit an issue with keystone we should be adding keystone tests to prevent that breakage in the future20:52
david-lyleyup20:52
david-lyleclarkb: my take is our tests are no longer wanted20:53
clarkbya things may have changed, but there were reasons for it being there20:54
clarkband hey we caught at least one largish bug that I can think of20:54
clarkbthe template compile thing20:54
mtreinishdavid-lyle: heh s/tests/test :)20:54
flashgordondavid-lyle: how would upgrade testing work20:54
david-lyleI meant the integration tests we've been creating20:54
mtreinishclarkb: sure, but if horizon had it's own equiv test now we would catch that20:54
david-lyleI think they are effective in our tree as well20:55
mtreinishdavid-lyle: oh, ok20:55
clarkbmtreinish: yup, we just never had that in the past20:55
clarkbmtreinish: but thats changing which is good20:55
mtreinishfwiw, I've always been a fan of that horizon tempest test. I thought it was cleverly done20:57
flashgordonmtreinish: hehe20:57
david-lylelog in is all you ever need20:57
*** achanda has joined #openstack-qa20:57
mtreinishdavid-lyle: heh, exactly :)20:58
flashgordondavid-lyle: how would upgrade testing work if we pull the test out of tempest. What does horizon need for upgrade testing in genera;?20:58
*** melwitt has quit IRC20:58
*** rfolco has quit IRC20:59
mtreinishflashgordon: well right now all we do is: http://git.openstack.org/cgit/openstack-dev/grenade/tree/upgrade-horizon and verify you can login before and after20:59
mtreinishif that's still important we can move the login part to javelin pretty easily20:59
*** melwitt has joined #openstack-qa21:00
*** harlowja has quit IRC21:00
flashgordonmtreinish: that is true21:00
*** melwitt has quit IRC21:00
david-lylenot familiar with javelin21:01
flashgordonmtreinish: I still think we should drop the duplicate tempest-full jobs from horizon before the 5th21:01
flashgordonmtreinish: it will free up a non-trivial amount of nodes during crunch time21:01
david-lyleflashgordon: I fully agree with that21:01
flashgordondavid-lyle: then take a look at https://review.openstack.org/#/c/164344/121:02
mtreinishflashgordon: is that what your patch did? I didn't actually read it. i'm fine with that, I just don't want to delete them until the test is out of tempest21:02
mtreinishflashgordon: ok, yeah I'm fine with dropping the job count21:02
flashgordonmtreinish: ohh yeah not delete no21:03
*** dpaterson has quit IRC21:03
flashgordonjust prune21:03
mtreinishdavid-lyle: javelin is the tool we use for creating resources before an upgrade to verify they survive the upgrade process21:04
mtreinishdavid-lyle: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/cmd/javelin.py21:04
*** harlowja has joined #openstack-qa21:06
*** melwitt has joined #openstack-qa21:07
*** ajo has quit IRC21:09
dkranzmtreinish: I found why my unit test is failing and have two questions21:13
*** marun has quit IRC21:14
mtreinishdkranz: oh, sorry I forgot to look at it before. Sure shoot21:14
*** diegows has quit IRC21:14
dkranzmtreinish: the reason is because in ConfigFIxture.setUp we set all the identity confs to 'fake_...'21:14
dkranzmtreinish: My code was assuming these values had their defaults from config if I did not set them21:15
dkranzmtreinish: I can fix that but do we want that in the generic fixture class all the tests are using?21:15
mtreinishdkranz: nah, I'd say just override them locally in your tests21:15
*** pc_m has quit IRC21:16
dkranzmtreinish: The second pain was some random behavior that is different when tempest.conf is there. That seems like a bug.21:16
mtreinishbecause I think a bunch of the other tests are expecting those in there21:16
morganfainbergmtreinish, so..21:16
dkranzmtreinish: ok, no big deal just painful to find21:16
dkranzmtreinish: the different behavior with tempest.conf there or not is really strange21:16
mtreinishmorganfainberg: uh oh what'd I do?21:16
dkranzmtreinish: I looked at the code but did not find anything strange. I guess I will keep looking. With the file there I would get different behavior depending on how many tests I was running!21:17
mtreinishdkranz: yeah that sounds weird, after I migrate home, I'll try dig into that21:17
mtreinishdkranz: do you ahve stack traces or something as an example?21:17
dkranzmtreinish: not stacktraces, but the manifestation was that certain conf values that were set in the test came out different when read by the code21:18
morganfainbergmtreinish, is there a desire to cut back on the number of ddevstacks we use for keystone runs as well?21:18
morganfainbergmtreinish, not just eliminating the compute stuff flashgordon proposed21:19
mtreinishmorganfainberg: well they're actually are used by keystone, especially since the postgres one overloads eventlet21:19
morganfainbergmtreinish, we can make any other one do eventlet, that is trivial21:19
morganfainbergmtreinish, it was just stuck there out of convienence21:20
mtreinishmorganfainberg: for keystone I just see it as less clear cut, because the different configs are testing different things21:20
mtreinishin the horizon case there was no reason to be doing that21:20
morganfainbergmtreinish, well the only *really* difference is postgres = eventlet, otherwise it's the same config for us.21:20
morganfainbergfor the rest.21:20
mtreinishmorganfainberg: well except it uses postgres instead of mysql :)21:21
mtreinishwhich raises the larger question about the value of that21:21
morganfainbergmtreinish, so? :P21:21
mtreinishmorganfainberg: heh, I tend to agree, but the last few times we tried to kill that people got there torches and pitchforks21:21
*** annashen has quit IRC21:22
*** annashen has joined #openstack-qa21:22
flashgordonmtreinish: yeah postgres is a third rail these days21:23
*** andreykurilin_ has quit IRC21:23
*** andreykurilin_ has joined #openstack-qa21:23
*** ajo has joined #openstack-qa21:23
dkranzmtreinish: I pushed a working version.  I don't see the randomness with tempest.conf present for the code that passes all the tests. I don't think it is worth you looking at this more unless something else goes wrong.21:25
dkranzmtreinish: I may poke some more before quitting today.21:25
mtreinishdkranz: ok21:26
*** achanda has quit IRC21:27
flashgordonerr morganfainberg ^^21:27
openstackgerritDavid Kranz proposed openstack/tempest: Add test for the various config cases of is_admin_available()  https://review.openstack.org/16422521:27
david-lylewe in horizon don't do anything, so you don't have to watch over us very closely ;)21:27
david-lyleit's all just an illusion21:28
david-lyleI'm head mirror guy, someone else is in charge of smoke21:28
mtreinishdavid-lyle: heh, I might hold you to that :)21:30
openstackgerritMerged openstack/tempest: javelin: implement floating-ip support  https://review.openstack.org/16362221:30
mtreinishEmilienM: ^^^21:30
EmilienMmtreinish: \o/ we can now use javelin in multi node21:31
EmilienMmtreinish: cool thx!21:31
*** cbader has quit IRC21:31
morganfainbergflashgordon, hehehe21:32
dkranzmtreinish: I have a reprodicible example and am going to file a bug.21:32
mtreinishdkranz: ok cool, if you've got a reproduce that should make it easy to track down21:33
*** achanda has joined #openstack-qa21:33
dkranzmtreinish: when I change the value in tempest.conf to  match what the test is setting in the fake config, the test passes.21:33
dkranzmtreinish: but you should look at https://review.openstack.org/#/c/164225/2 when you get a chance to make sure it is not due to me doing something stupid21:34
*** jgrimm_ has joined #openstack-qa21:34
*** timello_ has joined #openstack-qa21:35
*** maurosr has quit IRC21:35
*** bknudson has quit IRC21:35
*** timello has quit IRC21:36
*** ekhugen has quit IRC21:36
nikilhi does any one have idea on parameter in "tenant_networks_reachable=true" tempest.conf. Does true means it do ssh/ping test ? Is it ok to enable this parameter if i run from other network21:36
*** ekhugen has joined #openstack-qa21:36
*** jgrimm- has joined #openstack-qa21:36
*** jgrimm has quit IRC21:36
*** maurosr has joined #openstack-qa21:36
*** timello has joined #openstack-qa21:37
*** annashen has quit IRC21:39
mtreinishnikil: it's how you tell tempest that the default network used fby tenants is not reachable by tempest. It means that certain tests which rely on that either create floating ips or are skipped21:39
*** jgrimm_ has quit IRC21:39
*** timello_ has quit IRC21:39
mtreinishnikil: but that entire section of config is confusing and is about to be refactored to be clearer and more explicit21:40
nikilmtreinish: thanks, basically i run the tempest from other machine and have some floating IP issue. So thanks i will skip this21:40
*** bknudson has joined #openstack-qa21:41
*** annashen has joined #openstack-qa21:41
*** andreykurilin_ has quit IRC21:41
*** andreykurilin_ has joined #openstack-qa21:42
*** rushiagr_away is now known as rushiagr21:44
*** marun has joined #openstack-qa21:44
*** dboik has quit IRC21:46
*** annashen has quit IRC21:56
nikilmtreinish: I try to run tempest like this "bash tools/pretty_tox_serial.sh (?!.*\[.*\bslow\b.*\])((smoke)|(^tempest\.scenario))" as they do in CI system. But it through me error "-bash: !.*\[.*\bslow\b.*\]: event not found" . Any idea on this .21:56
*** mpopow has joined #openstack-qa21:58
*** annashen has joined #openstack-qa22:00
mtreinishnikil: you need quotes around the regex otherwise your shell will try to interpret it22:00
*** rwsu has quit IRC22:00
*** Longgeek has joined #openstack-qa22:03
nikilmtreinish: Yes i tried even like this  /bin/bash tools/pretty_tox_serial.sh "(?!.*\[.*\bslow\b.*\])((smoke)|(^tempest\.scenario))"   -> this has quotes . Still it doesn't work. Also please let me knwo the blue print of the project because i have diged much of configuration so i can contribute few22:03
*** harlowja has quit IRC22:04
*** jecarey has quit IRC22:04
mtreinishnikil: with quotes you still get the error about event not found?22:05
mtreinishoh, you need to add -- between the script and the regex22:05
nikilmtreinish: I just took from community test log "http://logs.openstack.org/84/163784/4/check/check-tempest-dsvm-neutron/9fe5176/console.html" and this is how they run. I also tried with quots but it doesn't help22:05
mtreinishI think it looks for that (to be fair I don't often call pretty_tox directly, normally through tox22:06
*** harlowja has joined #openstack-qa22:06
mtreinishnikil: like do tox -esmoke-serial22:06
*** harlowja has quit IRC22:06
*** harlowja has joined #openstack-qa22:06
mtreinishnikil: do you mean to contribute to the config docs? I started an etherpad here: https://etherpad.openstack.org/p/tempest-configuration-doc just add a section with your name to that list if you want to add something22:07
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:07
nikilmtreinish: yes i will put what i can contribute22:08
openstackrecheckopenstack/keystone change: https://review.openstack.org/155974 failed gate-tempest-dsvm-neutron-full in the gate queue with an unrecognized error22:09
mriedemmarun: mestery: do you know if this is a known issue? http://logs.openstack.org/78/163978/1/check/check-tempest-dsvm-neutron-full/792a4e4/logs/screen-q-svc.txt.gz?level=TRACE#_2015-03-13_16_07_36_40622:09
mtreinishmriedem: ooh, that looks ugly22:09
mriedemfo sho22:10
mriedemmtreinish: of course, it's not 100% fail22:10
nikilmtreinish : so what is the difference between "tox -esmoke-serial" and  /bin/bash tools/pretty_tox_serial.sh "(?!.*\[.*\bslow\b.*\])((smoke)|(^tempest\.scenario))"   .  Because now when i use tox -e is started to install dependencies etc.. I guess the test will run22:10
mtreinishmriedem: heh, of course because db explosions are par for the course22:10
mriedemhttp://goo.gl/WPuxqU22:11
mriedembasically22:11
mriedemhttps://bugs.launchpad.net/neutron/+bug/143206522:11
openstackLaunchpad bug 1432065 in neutron "test_ports fails with "StaleDataError: UPDATE statement on table 'ports' expected to update 1 row(s); 0 were matched."" [Undecided,New]22:11
mtreinishnikil: tox is a command for setting up isolated venvs and running test commands: https://tox.readthedocs.org/en/latest/22:11
mriedemmtreinish: hm, oslo.db 1.7.0 released yesterday22:12
mriedemthis db explosion is new in the last 24 hours22:12
mtreinishnikil: we maintain the job definitions for the gate in the tox.ini in the root of the tempest repo, it automates setting up the env and running the tests22:12
mtreinishnikil: its normally what I use for running tempest22:12
mtreinishmriedem: oh, that's probably it22:12
mriedemmtreinish: or https://github.com/openstack/neutron/commit/5dbb34b56fc42d9c68bf6647910a437a2ad6b29e22:12
mtreinishmriedem: although looking at dhellmann's release notes I doubt it, the release looks pretty simple22:13
mriedemhttps://review.openstack.org/#/c/149261/22:13
*** cdent has quit IRC22:13
mtreinishmriedem: yeah that looks more likely22:13
mriedemeverytime i try reverting a thing in neutron they tell me it's not whatever i thought it was22:15
mriedemso i've given up22:15
*** melwitt has quit IRC22:15
*** melwitt has joined #openstack-qa22:16
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:17
mriedemand there is this http://logs.openstack.org/78/163978/1/check/check-tempest-dsvm-neutron-full/792a4e4/logs/screen-q-svc.txt.gz?level=TRACE#_2015-03-13_16_14_02_59522:17
mriedemand this http://logs.openstack.org/78/163978/1/check/check-tempest-dsvm-neutron-full/792a4e4/logs/screen-q-svc.txt.gz?level=TRACE#_2015-03-13_16_15_21_78622:17
mriedemman22:17
mtreinishmestery: ^^^ why so many stack traces :(22:18
mriedemthe last one is the killer22:18
mriedemtempest is cleaning up resources and hits the db deadlock22:19
*** ihrachyshka has quit IRC22:19
*** melwitt has quit IRC22:19
*** melwitt has joined #openstack-qa22:19
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:21
mtreinishmriedem: yeah that would probably cause an issue, but honestly all 3 look like they should be fatal to me22:22
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron db deadlock bug 1432065  https://review.openstack.org/16435822:22
openstackbug 1432065 in neutron "DBDeadlock: (OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') 'DELETE FROM ipallocationpools WHERE ipallocationpools.id" [Critical,Confirmed] https://launchpad.net/bugs/143206522:22
mriedem^22:22
mriedeme-r query22:22
mriedemyeah they all look terrible22:22
mriedemthe 2nd one was related to that change i pointed out in neutron yesterday22:22
mriedemi think that was the retry thing they added22:22
mriedemso they trace but continue going22:22
mtreinishmriedem: yeah that's just ugly if it's expected and retries why trace...22:24
*** Longgeek has quit IRC22:25
*** mtanino has quit IRC22:27
*** melwitt has quit IRC22:28
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:30
*** dimtruck is now known as zz_dimtruck22:30
*** rwsu has joined #openstack-qa22:33
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:34
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852522:35
*** rbak has quit IRC22:35
*** ajo has quit IRC22:44
*** beisner has quit IRC22:49
*** apevec has joined #openstack-qa22:50
*** beisner has joined #openstack-qa22:52
*** tsekiyam_ has joined #openstack-qa22:52
*** mpopow has quit IRC22:52
*** mpopow has joined #openstack-qa22:53
*** tsekiyama has quit IRC22:56
*** tsekiyam_ has quit IRC22:56
*** mpopow has quit IRC22:57
openstackgerritMerged openstack-infra/elastic-recheck: Add query for neutron db deadlock bug 1432065  https://review.openstack.org/16435823:05
openstackbug 1432065 in neutron "DBDeadlock: (OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') 'DELETE FROM ipallocationpools WHERE ipallocationpools.id" [Critical,Confirmed] https://launchpad.net/bugs/143206523:05
*** mpopow has joined #openstack-qa23:06
*** openstackrecheck has quit IRC23:13
*** openstackrecheck has joined #openstack-qa23:13
*** aysyd has quit IRC23:13
*** annashen has quit IRC23:18
*** annashen has joined #openstack-qa23:20
*** david-lyle is now known as david-lyle_afk23:29
*** annashen has quit IRC23:29
*** patrickeast has quit IRC23:32
*** zz_dimtruck is now known as dimtruck23:32
*** rwsu has quit IRC23:35
openstackrecheckopenstack/trove change: https://review.openstack.org/162354 failed gate-trove-python27 in the gate queue with an unrecognized error23:37
*** ajmiller_ has quit IRC23:37
*** rwsu has joined #openstack-qa23:37
*** ChuckC has joined #openstack-qa23:41
*** dimtruck is now known as zz_dimtruck23:42
*** melwitt has joined #openstack-qa23:49
*** dimsum__ has quit IRC23:52
*** dims_ has joined #openstack-qa23:55
*** dims_ has quit IRC23:57
*** dims_ has joined #openstack-qa23:57
*** apevec has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!