Monday, 2015-02-09

*** achanda has quit IRC00:00
*** achanda has joined #openstack-qa00:02
*** yamahata has joined #openstack-qa00:09
*** weshay has quit IRC00:19
*** gfidente^2nd has joined #openstack-qa00:20
*** gfidente has quit IRC00:22
*** mriedem1 has joined #openstack-qa00:23
*** mriedem has quit IRC00:24
*** gfidente^2nd has quit IRC00:25
*** gfidente has joined #openstack-qa00:25
*** dimsum__ has joined #openstack-qa00:35
*** dims_ has joined #openstack-qa00:36
*** dimsum__ has quit IRC00:39
*** oomichi has joined #openstack-qa00:41
*** bkopilov has quit IRC00:48
*** bkopilov has joined #openstack-qa00:51
*** achanda has quit IRC00:52
*** woodster_ has quit IRC01:10
openstackrecheckopenstack/nova change: https://review.openstack.org/148137 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/134451301:14
openstackLaunchpad bug 1344513 in Cinder "test_cinder_encryption_type_list fails" [Undecided,New]01:14
*** bkopilov has quit IRC01:23
*** bkopilov has joined #openstack-qa01:24
openstackgerritJamie Lennox proposed openstack-dev/devstack: Isolate creating service users  https://review.openstack.org/15067201:25
*** zhiyan has quit IRC01:40
*** jecarey has joined #openstack-qa01:45
*** zhiyan has joined #openstack-qa01:47
*** woodster_ has joined #openstack-qa01:49
*** wuhg has joined #openstack-qa01:49
*** annashen has joined #openstack-qa01:50
*** achanda has joined #openstack-qa01:52
*** Yogi1 has joined #openstack-qa01:53
*** Yogi11 has joined #openstack-qa01:55
*** Yogi1 has quit IRC01:57
*** achanda has quit IRC01:57
openstackgerritMasayuki Igawa proposed openstack/tempest: Change tempest Conflict exc to tempest-lib exc  https://review.openstack.org/14844002:09
openstackgerritMasayuki Igawa proposed openstack/tempest: Change tempest OverLimit exc to tempest-lib exc  https://review.openstack.org/14843902:09
openstackgerritMasayuki Igawa proposed openstack/tempest: Change tempest Unauthorized exc to tempest-lib exc  https://review.openstack.org/14841702:09
openstackgerritMasayuki Igawa proposed openstack/tempest: Change tempest NotFound exc to tempest-lib exc  https://review.openstack.org/14848102:09
*** yamamot__ has joined #openstack-qa02:11
*** annashen has quit IRC02:27
*** mwagner_lap has joined #openstack-qa02:28
*** gfidente has quit IRC02:40
*** kan_ has joined #openstack-qa03:08
*** Longgeek has joined #openstack-qa03:11
*** Longgeek has quit IRC03:14
*** Longgeek has joined #openstack-qa03:20
*** shashankhegde has joined #openstack-qa03:22
*** shashankhegde has quit IRC03:23
*** pcrews has quit IRC03:30
openstackgerritJamie Lennox proposed openstack-dev/devstack: Isolate creating service users  https://review.openstack.org/15067203:36
*** mriedem1 has quit IRC03:40
*** dimtruck is now known as zz_dimtruck03:40
*** pal has joined #openstack-qa03:41
openstackgerritYAMAMOTO Takashi proposed openstack-dev/devstack: plugins.rst: Fix a typo  https://review.openstack.org/15391503:43
*** Madan has joined #openstack-qa03:50
*** annashen has joined #openstack-qa03:51
*** rushiagr_away is now known as rushiagr03:53
*** dttocs has quit IRC04:00
*** coolsvap_ is now known as coolsvap04:02
*** Yogi11 has quit IRC04:03
*** sabeen has quit IRC04:03
openstackgerritGhanshyam Mann proposed openstack/tempest: Separate token client from identity client  https://review.openstack.org/15153004:11
*** amotoki has joined #openstack-qa04:13
*** jhenner has quit IRC04:22
*** dims_ has quit IRC04:23
*** rushiagr is now known as rushiagr_away04:24
*** annashen has quit IRC04:31
*** rushiagr_away is now known as rushiagr04:31
*** zz_dimtruck is now known as dimtruck04:31
*** achanda has joined #openstack-qa04:39
*** dimtruck is now known as zz_dimtruck04:43
*** zz_dimtruck is now known as dimtruck04:43
*** nikil89_ has joined #openstack-qa04:46
*** nikil89_ is now known as naggappan04:46
*** yfried|afk is now known as yfried04:49
*** coolsvap is now known as coolsvap_04:55
*** coolsvap_ is now known as coolsvap04:56
*** SridharG has joined #openstack-qa04:57
*** k4n0 has joined #openstack-qa04:59
*** raghav_mulugu has joined #openstack-qa05:12
*** annashen has joined #openstack-qa05:13
*** k4n0 has quit IRC05:23
*** dimsum__ has joined #openstack-qa05:24
*** k4n0 has joined #openstack-qa05:24
*** dimsum__ has quit IRC05:29
naggappanHi is there any existing scripts to convert the nosetests output into html fromate. If we use tox it can be done. But is there any way in nosetes?05:34
*** k4n0 has quit IRC05:36
*** yfried has quit IRC05:38
*** achanda has quit IRC05:38
*** Murad_ has quit IRC05:48
openstackgerritGhanshyam Mann proposed openstack/tempest: Remove CONF values from identity clients  https://review.openstack.org/15154005:49
*** k4n0 has joined #openstack-qa05:50
*** BharatK has joined #openstack-qa05:50
openstackgerritMerged openstack/tempest: Add os-tenant-networks test  https://review.openstack.org/14676105:51
openstackgerritMerged openstack/tempest: Add os-tenant-networks test  https://review.openstack.org/14676105:51
*** boris-42 has quit IRC05:52
*** SridharG has left #openstack-qa05:55
*** achanda has joined #openstack-qa05:57
*** annashen has quit IRC06:06
*** shashankhegde has joined #openstack-qa06:07
*** shashankhegde has quit IRC06:11
*** k4n0 has quit IRC06:13
*** chandankumar has joined #openstack-qa06:13
*** k4n0 has joined #openstack-qa06:14
*** gamado has joined #openstack-qa06:16
*** anshul has joined #openstack-qa06:18
*** anshul has joined #openstack-qa06:19
*** achanda has quit IRC06:22
*** boris-42 has joined #openstack-qa06:26
*** pcaruana has quit IRC06:28
*** k4n0 has quit IRC06:31
*** k4n0 has joined #openstack-qa06:34
*** SridharG has joined #openstack-qa06:46
*** yfried has joined #openstack-qa06:49
*** itzikb has joined #openstack-qa06:50
*** yfried_ has joined #openstack-qa06:53
*** yfried has quit IRC06:53
*** vigneshvar has joined #openstack-qa07:02
*** gszasz has joined #openstack-qa07:10
*** neeti has joined #openstack-qa07:12
*** achanda has joined #openstack-qa07:15
*** afazekas has joined #openstack-qa07:20
*** nmagnezi has joined #openstack-qa07:46
*** achanda has quit IRC07:47
*** achanda has joined #openstack-qa07:51
*** SridharG1 has joined #openstack-qa07:53
*** SridharG has quit IRC07:54
*** e0ne has joined #openstack-qa07:55
*** k4n0 has quit IRC07:57
*** gszasz has quit IRC07:58
*** k4n0 has joined #openstack-qa08:00
*** gszasz has joined #openstack-qa08:00
*** e0ne has quit IRC08:03
*** gamado has quit IRC08:07
*** ajo has quit IRC08:10
*** woodster_ has quit IRC08:10
*** ajo has joined #openstack-qa08:10
*** pal has quit IRC08:11
*** gamado has joined #openstack-qa08:11
*** luqas has joined #openstack-qa08:11
*** neeti has quit IRC08:13
*** naggappan has quit IRC08:16
*** shardy has joined #openstack-qa08:17
*** jlibosva has joined #openstack-qa08:18
*** neeti has joined #openstack-qa08:25
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for network tests  https://review.openstack.org/15031208:25
*** jhenner has joined #openstack-qa08:32
*** safchain has joined #openstack-qa08:37
*** aix has joined #openstack-qa08:40
*** andreykurilin_ has joined #openstack-qa08:40
*** jlibosva has quit IRC08:41
*** oomichi has quit IRC08:42
*** jlibosva has joined #openstack-qa08:43
gmannk4n0: ping08:43
k4n0gmann, pong08:43
gmannk4n0: regarding resource cleanup patches08:43
k4n0gmann, Yes, go on08:44
gmannk4n0: actually there are some issue for credential and net resource creation - https://review.openstack.org/#/c/141424/08:44
gmannk4n0: i discussed that with andreaf_ and he is working on base patch to make those cleanly.08:45
*** xavileon has joined #openstack-qa08:45
k4n0gmann, Yes, i have seen that patch, I am only fixing minor issues in my patches, will rebase all of them once andreaf_ gets his patch in08:45
gmannk4n0: may be you need to wait for those base patch08:46
*** jlanoux has joined #openstack-qa08:46
k4n0gmann, ok, I will only fix some review comments related to the split and then wait08:46
gmannk4n0: cool. thx :)08:46
k4n0gmann, thanks :)08:46
openstackgerritYuiko Takada proposed openstack/tempest: Add os-baremetal-nodes tests  https://review.openstack.org/14912508:47
*** markus_z has joined #openstack-qa08:47
*** afazekas has quit IRC08:49
*** achanda has quit IRC08:52
*** mpaolino has joined #openstack-qa08:53
*** jordanP has joined #openstack-qa08:54
*** achanda has joined #openstack-qa08:56
openstackgerritMerged openstack-dev/devstack: plugins.rst: Fix a typo  https://review.openstack.org/15391508:56
*** nikil89_ has joined #openstack-qa08:58
*** nikil89_ is now known as naggappan08:59
openstackgerritYuiko Takada proposed openstack/tempest: Add os-baremetal-nodes tests  https://review.openstack.org/14912508:59
*** jpich has joined #openstack-qa09:02
*** vigneshvar has quit IRC09:05
openstackgerritThomas Bechtold proposed openstack/tempest: Test for id_username instead of "Log In"  https://review.openstack.org/15395409:05
*** ylobankov has quit IRC09:07
*** achanda has quit IRC09:08
*** jlibosva has quit IRC09:09
*** jlibosva has joined #openstack-qa09:10
*** ylobankov has joined #openstack-qa09:13
*** vigneshvar has joined #openstack-qa09:17
*** SridharG has joined #openstack-qa09:17
openstackgerritMichele Paolino proposed openstack-dev/devstack: Support for libvirt/QEMU tar releases  https://review.openstack.org/10871409:18
jordanPianw, hey. About https://review.openstack.org/#/c/152082/ (Create a `policy.d` dir in $PROJECT_CONF_DIR) I am not sure to undertand your suggestion09:18
*** achanda has joined #openstack-qa09:18
jordanPthe single function thing09:18
ianwjordanP: just have a "create_policy_dir" or something, so that someone reads the comment on that function and realises calls to it can disappear at some point in the future09:19
ianwjordanP:  i guess it doesn't matter that much, it's not a lot of code.  just it gets checked in and never ever leaves09:20
*** SridharG1 has quit IRC09:20
jordanPianw, okay, so I put a function "create_policy_dir" in lib/nova, lib/cinder, etc... ?09:21
*** k4n0 has quit IRC09:21
ianwjordanP: no just one in functions-common and call it.09:22
jordanPianw, yeah, that make more sense09:22
*** k4n0 has joined #openstack-qa09:23
*** aix has quit IRC09:23
*** vponomaryov has joined #openstack-qa09:24
*** yamahata has quit IRC09:31
*** yamamot__ has quit IRC09:32
*** andreykurilin_ has quit IRC09:41
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for volume tests  https://review.openstack.org/15161009:41
*** gfidente has joined #openstack-qa09:42
*** achanda has quit IRC09:46
*** jhenner has quit IRC09:49
*** zz_johnthetubagu is now known as johnthetubaguy10:00
*** e0ne has joined #openstack-qa10:00
openstackrecheckopenstack/requirements change: https://review.openstack.org/151770 failed gate-grenade-dsvm, gate-requirements-integration-dsvm in the gate queue with an unrecognized error10:03
*** jhenner has joined #openstack-qa10:08
*** e0ne has quit IRC10:09
*** e0ne has joined #openstack-qa10:09
*** e0ne is now known as e0ne_10:19
*** andreaf_ is now known as andreaf10:21
*** e0ne_ has quit IRC10:24
*** e0ne has joined #openstack-qa10:24
*** tochi has quit IRC10:28
*** yfried_ is now known as yfried|afk10:32
*** yfried|afk is now known as yfried_10:35
*** k4n0 has quit IRC10:35
*** k4n0 has joined #openstack-qa10:36
*** vigneshvar has quit IRC10:37
*** vigneshvar has joined #openstack-qa10:40
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for object_storage tests  https://review.openstack.org/15210510:46
*** eezhova has joined #openstack-qa10:47
*** k4n0 has quit IRC10:47
*** yfried_ is now known as yfried|afk10:48
*** erlon has joined #openstack-qa10:53
*** yfried|afk is now known as yfried_11:08
*** e0ne is now known as e0ne_11:08
*** e0ne_ has quit IRC11:14
*** adalbas has joined #openstack-qa11:24
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for data_processing tests  https://review.openstack.org/15241211:27
*** aysyd has joined #openstack-qa11:30
*** afazekas has joined #openstack-qa11:34
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for baremetal tests  https://review.openstack.org/15241711:38
*** afazekas has quit IRC11:39
*** chandankumar has quit IRC11:42
*** e0ne has joined #openstack-qa11:52
*** cdent has joined #openstack-qa11:54
*** andreaf_ has joined #openstack-qa11:54
*** jamielennox is now known as jamielennox|away11:56
*** e0ne is now known as e0ne_11:58
*** andreaf_ has quit IRC11:58
*** andreaf_ has joined #openstack-qa11:59
*** e0ne_ is now known as e0ne11:59
openstackgerritBob Ball proposed openstack-dev/devstack: XenAPI: Use round-robin mirror for Ubuntu  https://review.openstack.org/15379212:04
*** gszasz has quit IRC12:05
*** gszasz has joined #openstack-qa12:08
*** Longgeek has quit IRC12:12
openstackrecheckopenstack/sahara change: https://review.openstack.org/151621 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/137351312:16
openstackLaunchpad bug 1373513 in Cinder "Lvm hang during tempest tests" [Critical,In progress] - Assigned to John Griffith (john-griffith)12:16
*** gszasz has quit IRC12:17
*** gszasz has joined #openstack-qa12:19
*** afazekas has joined #openstack-qa12:19
openstackgerritErlon R. Cruz proposed openstack-dev/devstack: Set pip_install default behavior to 'upgrade'  https://review.openstack.org/15400812:24
*** aix has joined #openstack-qa12:29
*** rfolco has joined #openstack-qa12:32
*** rushiagr is now known as rushiagr_away12:35
*** rfolco has quit IRC12:36
*** Madan has quit IRC12:44
*** dimsum__ has joined #openstack-qa12:44
*** dims_ has joined #openstack-qa12:45
openstackgerritErlon R. Cruz proposed openstack-dev/devstack: Set pip_install default behavior to 'upgrade'  https://review.openstack.org/15400812:46
openstackgerritnithya-ganesan proposed openstack/tempest: WIP - Create shared ssh verification by extending RemoteClient  https://review.openstack.org/15389912:48
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for image tests  https://review.openstack.org/15321512:48
*** dimsum__ has quit IRC12:49
*** rfolco has joined #openstack-qa12:49
openstackgerritSean Dague proposed openstack-dev/devstack: remove tuskar  https://review.openstack.org/15401512:51
*** rfolco has quit IRC12:51
openstackgerritSean Dague proposed openstack-dev/devstack: gantt is a dead project, remove it  https://review.openstack.org/15401712:53
openstackgerritErlon R. Cruz proposed openstack-dev/devstack: Set pip_install default behavior to 'upgrade'  https://review.openstack.org/15400812:54
openstackgerritErlon R. Cruz proposed openstack-dev/devstack: Set pip_install default behavior to 'upgrade'  https://review.openstack.org/15400812:55
*** e0ne is now known as e0ne_12:59
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for identity tests  https://review.openstack.org/15320513:01
*** nmagnezi has quit IRC13:04
*** neeti has quit IRC13:05
*** weshay has joined #openstack-qa13:06
*** e0ne_ is now known as e0ne13:06
*** eezhova has quit IRC13:14
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for messaging tests  https://review.openstack.org/15376413:16
*** rushiagr_away is now known as rushiagr13:16
*** BharatK has quit IRC13:16
*** nmagnezi has joined #openstack-qa13:19
*** yfried_ is now known as yfried|afk13:23
*** yfried|afk is now known as yfried_13:24
*** toure_ has joined #openstack-qa13:25
*** toure_ has quit IRC13:25
*** e0ne is now known as e0ne_13:30
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for orchestration tests  https://review.openstack.org/15376513:31
openstackrecheckopenstack/nova change: https://review.openstack.org/153041 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/1353939 https://bugs.launchpad.net/bugs/134238013:32
openstackLaunchpad bug 1353939 in OpenStack Compute (nova) "Rescue fails with 'Failed to terminate process: Device or resource busy' in the n-cpu log" [High,Confirmed]13:32
openstackLaunchpad bug 1353939 in OpenStack Compute (nova) "duplicate for #1342380 Rescue fails with 'Failed to terminate process: Device or resource busy' in the n-cpu log" [High,Confirmed]13:32
*** woodster_ has joined #openstack-qa13:34
openstackgerritRohan Kanade proposed openstack/tempest: Split resource_setup for telemetry tests  https://review.openstack.org/15376613:35
*** bknudson has quit IRC13:36
*** rfolco has joined #openstack-qa13:37
*** e0ne_ is now known as e0ne13:38
*** jecarey has quit IRC13:38
*** rfolco has quit IRC13:40
*** rushiagr is now known as rushiagr_away13:41
*** Longgeek has joined #openstack-qa13:44
*** weshay has quit IRC13:47
*** afazekas has quit IRC13:47
*** aix has quit IRC13:47
*** weshay has joined #openstack-qa13:54
*** vigneshvar has quit IRC13:55
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368113:57
openstackgerritAndrea Frittoli  proposed openstack/tempest: Drop the legacy and un-used _interface  https://review.openstack.org/15362113:57
*** Longgeek has quit IRC13:57
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389613:57
*** bknudson has joined #openstack-qa13:59
*** Longgeek has joined #openstack-qa14:00
*** SridharG has left #openstack-qa14:00
*** david-lyle_afk is now known as david-lyle14:01
openstackgerritJoseph Lanoux proposed openstack/tempest: Update test_live_migration for return-one-value  https://review.openstack.org/15404714:01
*** Yogi1 has joined #openstack-qa14:02
*** krtaylor has quit IRC14:03
*** anshul has quit IRC14:04
*** e0ne has quit IRC14:05
*** e0ne has joined #openstack-qa14:05
*** amotoki has quit IRC14:09
openstackgerritNikolay Fedotov proposed openstack/tempest: Scenario test for vpnaas: ipsec-site-connection  https://review.openstack.org/14007214:13
sdaguedtroyer: let me know once you get around today14:13
sdagueI want to figure out the elasticsearch pkg thing14:13
*** jaypipes has joined #openstack-qa14:15
*** ChanServ sets mode: +o jaypipes14:15
*** dustins has joined #openstack-qa14:16
*** krtaylor has joined #openstack-qa14:16
*** jecarey has joined #openstack-qa14:19
*** cbader has joined #openstack-qa14:19
openstackgerritnithya-ganesan proposed openstack/tempest: WIP - Create shared ssh verification by extending RemoteClient  https://review.openstack.org/15389914:22
*** e0ne is now known as e0ne_14:23
*** Longgeek has quit IRC14:23
openstackgerritDavid Kranz proposed openstack/tempest: Change security-group clients to return one value and update tests  https://review.openstack.org/15368514:23
openstackgerritDavid Kranz proposed openstack/tempest: Change keypair client to return one value and update tests  https://review.openstack.org/15365214:24
openstackgerritSean Dague proposed openstack-dev/devstack: add gating up/down script for devstack  https://review.openstack.org/15299414:24
*** wuhg has quit IRC14:29
*** rushiagr_away is now known as rushiagr14:29
*** abhirc has joined #openstack-qa14:38
*** xavileon has quit IRC14:42
dkranzandreaf: ping14:48
dkranzandreaf: Are overrrides of the new methods like skip_checks supposed to call super? I would expect so but see some code that does not.14:48
*** e0ne_ is now known as e0ne14:49
*** sabeen has joined #openstack-qa14:54
*** afazekas has joined #openstack-qa14:54
*** aix has joined #openstack-qa14:56
*** bkopilov has quit IRC14:58
*** dimtruck is now known as zz_dimtruck15:00
*** mriedem has joined #openstack-qa15:01
*** Ananci has joined #openstack-qa15:04
*** ChuckC has joined #openstack-qa15:06
*** ChuckC has quit IRC15:06
*** ChuckC has joined #openstack-qa15:07
dtroyersdague: g'morning.  I should be sufficiently caffeinated by now to do actual thinking… ;)15:10
*** amotoki has joined #openstack-qa15:10
sdaguedtroyer: ok, cool15:10
sdagueso, the thinking question is what to do about - https://review.openstack.org/#/c/153048/15:10
*** superdan is now known as dansmith15:10
sdagueI'd like to get some solution in place15:10
sdagueso that the glance folks can move forward15:11
*** Obulpathi has joined #openstack-qa15:11
dtroyerfor the most part I think that one is OK15:11
sdaguealso, I've started to get agressive with folks and -2ing stuff that should be out of tree plugins, given that we've got a working example of testing with the ec2api up15:11
dtroyeryeah, that's a good direction15:12
sdagueand my culling branch - https://review.openstack.org/#/q/status:open+project:openstack-dev/devstack+branch:master+topic:culling,n,z15:13
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368115:13
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389615:13
*** rbak has joined #openstack-qa15:13
dtroyerI think my concern in https://etherpad.openstack.org/p/devstack-package-install-interface is how the packages are called.  There's a comment in about making the calling of the package functions a bit more atomic and sharable15:14
sdaguedtroyer: oh, that's fine, I can work up function calls today if you like15:15
dtroyerthe interface functions are fine, its just how we get there.  it feels to me it should be more like distro services than integrated sub-services15:16
sdagueyeh, that might be. I'll ponder while I go deal with snow removal. Another Monday, another storm.15:16
dtroyeryuck…I'll not brag about 60+ this weekend then15:17
andreafdkranz: yes overrides should always call super15:18
andreafdkranz: I haven't reviewed all those patches yet so it might be there are a few missing around15:18
*** Longgeek has joined #openstack-qa15:24
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368115:25
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389615:25
dkranzandreaf: thanks, I already gave -1 since I decided this expectation was generic15:28
*** nmagnezi has quit IRC15:31
openstackgerritMerged openstack-infra/devstack-gate: Refactor processing of testr artifacts for reuse  https://review.openstack.org/15367715:32
*** zz_dimtruck is now known as dimtruck15:32
openstackgerritMerged openstack-infra/devstack-gate: Enable preseeding testrepository with a number of streams  https://review.openstack.org/15303615:32
openstackgerritMerged openstack-infra/devstack-gate: Remove unused variables(PIP_USE_MIRRORS, USE_GET_PIP)  https://review.openstack.org/14943915:32
openstackgerritMerged openstack-infra/devstack-gate: Add partial-ironic support  https://review.openstack.org/14876015:32
*** afazekas has quit IRC15:32
andreafdkranz: great, thanks15:33
openstackgerritnithya-ganesan proposed openstack/tempest: WIP - Create shared ssh verification by extending RemoteClient  https://review.openstack.org/15389915:33
openstackrecheckopenstack/sahara change: https://review.openstack.org/151621 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/141292315:34
openstackLaunchpad bug 1412923 in devstack "heat api takes too long to come up, tempest tests fail" [Undecided,In progress] - Assigned to Davanum Srinivas (DIMS) (dims-v)15:34
*** enikanorov has joined #openstack-qa15:35
*** achanda has joined #openstack-qa15:35
*** enikanorov has quit IRC15:36
openstackrecheckopenstack/nova change: https://review.openstack.org/152866 failed gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error15:36
*** yfried_ is now known as yfried|afk15:40
*** achanda has quit IRC15:42
*** malini has joined #openstack-qa15:42
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368115:44
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389615:44
*** Obulpathi has quit IRC15:45
*** afazekas has joined #openstack-qa15:46
*** hemnafk is now known as hemna15:46
*** Longgeek has quit IRC15:50
*** Obulpathi has joined #openstack-qa15:51
*** yfried|afk is now known as yfried_15:51
*** zz_jgrimm is now known as jgrimm15:51
*** ChuckC has quit IRC15:51
*** ChuckC has joined #openstack-qa15:52
hogepodgesdague can you give me a sense of how hacking rules work within tempest? Just a high level overview of when and how they're applied.15:54
hogepodgeor mtreinish ^^, or anyone else15:54
*** Obulpathi has left #openstack-qa15:55
*** rfolco has joined #openstack-qa15:55
mtreinishhogepodge: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/hacking/checks.py is where the custom tempest rules exist15:55
mtreinishthey get run per file using flake815:55
*** dims_ has quit IRC15:56
mtreinishhogepodge: flake8 does all the parsing of the file and passes lines of strings to each check method in that file15:56
mtreinishthe test file explains it a bit more: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/tests/test_hacking.py15:57
hogepodgeI see.15:57
hogepodgeI have a first pass at a hacking rule for checking uuid metadata. I'm running tox right now to make sure it passes style, but I'll send it up for review.15:59
*** pcrews has joined #openstack-qa15:59
*** beekneemech is now known as bnemec15:59
hogepodgeMy concern with my implementation is that previous_logical won't catch it on tests where there is other metadata.15:59
*** aix has quit IRC16:00
mtreinishhogepodge: why not? logical lines treat a multiline statement as one line16:00
mtreinishor do you mean other decorators, because that might be an issue if there is a services decorator or a skip16:00
hogepodgeThat's exactly what I'm worried about. I based my work off of the services decorator check.16:01
*** dimsum__ has joined #openstack-qa16:01
openstackgerritJohn Villalovos proposed openstack-dev/devstack: Use 'https' protocol by default as easier for proxies  https://review.openstack.org/15339716:04
mtreinishhogepodge: yeah's a tricky one, I'm not exactly sure how to proceed there. Maybe we should just enforce a decorator order. Since every test requires a uuid decorator we say that goes on the bottom16:05
*** itzikb has quit IRC16:05
*** shashankhegde has joined #openstack-qa16:05
mtreinishand if it also requires a service decorator use the uuid decorator as the line to check for instead of test_*16:05
hogepodgemtreinish I think that's a good idea.16:05
mtreinishthen any other decorators get stacked on top of that. I think that should work16:06
*** dimsum__ has quit IRC16:08
*** dimsum__ has joined #openstack-qa16:10
*** dimsum__ has quit IRC16:11
openstackgerritMerged openstack/tempest: Remove CONF values from volume clients  https://review.openstack.org/14991016:11
openstackgerritMerged openstack/tempest: Separate token client from identity client  https://review.openstack.org/15153016:12
*** dimsum__ has joined #openstack-qa16:12
openstackgerritMerged openstack-dev/devstack: guides: Notes to setup DevStack with Nested KVM Virtualization  https://review.openstack.org/14863016:12
*** dimsum__ has quit IRC16:13
openstackgerritMerged openstack-dev/devstack: lib/neutron: Update comments about entry points  https://review.openstack.org/15064816:13
*** dimsum__ has joined #openstack-qa16:13
*** dimsum__ has quit IRC16:14
andreafmtreinish: no test run (because of a bug in the code), but still getting a list of slowest tests (https://jenkins03.openstack.org/job/check-tempest-dsvm-full-icehouse/2807/console) - is this from pre-seeding of avg test run times?16:15
*** coolsvap is now known as coolsvap_16:15
mtreinishandreaf: ooh, nice catch. Yeah the test times there are probably from the pre-seed16:16
mtreinishandreaf: we probably can fix pretty_tox to catch that case and not run slowest16:16
mtreinishoh wait, maybe because we still want it to run if the test run actually ran tests but failed16:16
*** dimsum__ has joined #openstack-qa16:17
mtreinishit might require changing subunit-trace to return a specific code if there are no tests run16:17
andreafmtreinish: yes that might be a tricky case to catch :)16:17
mtreinishI think we just use 1 now in subunit-trace, which is too generic probably16:17
*** raghav_mulugu has quit IRC16:21
openstackgerritMatthew Treinish proposed openstack/tempest-lib: Migrate skip_tracker.py from tempest  https://review.openstack.org/15233816:22
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389616:22
*** sergsh has joined #openstack-qa16:26
sergshdkranz, ping16:26
dkranzsergsh: pong16:26
sergshdkranz, abput https://review.openstack.org/#/c/143806/4/tempest/api/network/test_dhcp_ipv6.py16:27
sergshdkranz, what do you mean "call super first"?16:27
dkranzsergsh: skip_checks is overriding the method in the superclass16:27
dkranzsergsh: it needs to call super the same way resource_setup does16:28
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368116:28
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389616:28
dkranzsergsh: super(NetworksTestDHCPv6, cls).skip_checks()16:28
sergshdkranz, ok, got it16:28
*** aix has joined #openstack-qa16:29
*** afazekas has quit IRC16:33
*** naggappan has quit IRC16:34
flashgordondhellmann: https://review.openstack.org/#/c/153708/ your part of reqs core right?16:35
*** flashgordon is now known as jogo16:35
*** gszasz has quit IRC16:35
openstackgerritMerged openstack-dev/devstack: Keystone set debug in config file  https://review.openstack.org/15387616:35
*** gszasz has joined #openstack-qa16:35
openstackgerritMerged openstack-dev/devstack: Removed confusing duplication of ca config for keystone  https://review.openstack.org/15374216:36
*** shashankhegde has quit IRC16:38
openstackrecheckopenstack/requirements change: https://review.openstack.org/151037 failed gate-grenade-dsvm, gate-requirements-integration-dsvm in the gate queue with an unrecognized error16:39
openstackgerritDavid Kranz proposed openstack/tempest: Change flavors client to return one value and update tests  https://review.openstack.org/15411416:41
openstackgerritSergey Shnaidman proposed openstack/tempest: Test attaching router to IPv6 subnets  https://review.openstack.org/14380616:42
*** rwsu has joined #openstack-qa16:44
openstackgerritJordan Pittier proposed openstack/tempest: Volumes: strict type and value check of the 'bootable' flag  https://review.openstack.org/15214816:45
openstackgerritJordan Pittier proposed openstack/tempest: Volumes: strict type and value check of the 'bootable' flag  https://review.openstack.org/15214816:46
*** yfried_ has quit IRC16:46
sergshdkranz, fixed it, could you please check it in your time?16:46
openstackgerritTerry Wilson proposed openstack-dev/devstack: Install python-openvswitch with openvswitch  https://review.openstack.org/15411816:47
*** Longgeek has joined #openstack-qa16:47
*** nicodemos has joined #openstack-qa16:47
dkranzsergsh: sure16:48
*** bkopilov has joined #openstack-qa16:48
*** afazekas has joined #openstack-qa16:50
openstackgerritSergey Shnaidman proposed openstack/tempest: Support for IPv6 for API (part 2)  https://review.openstack.org/13723916:53
*** vigneshvar has joined #openstack-qa16:55
*** Yogi1 has quit IRC16:59
*** marun has joined #openstack-qa17:00
*** coolsvap_ is now known as coolsvap17:02
*** amotoki has quit IRC17:03
*** jlanoux has quit IRC17:03
openstackgerritChris Hoge proposed openstack/tempest: Add new hacking rule for UUID metatdata  https://review.openstack.org/15412717:04
*** Yogi1 has joined #openstack-qa17:04
*** enikanorov has joined #openstack-qa17:05
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: DO NOT MERGE COPY ALL OF .TESTREPOSITORY to log server  https://review.openstack.org/14971917:07
openstackgerritSergey Shnaidman proposed openstack/tempest: Support for IPv6 for API (part 2)  https://review.openstack.org/13723917:09
*** Longgeek has quit IRC17:10
*** rwsu has quit IRC17:10
*** rwsu has joined #openstack-qa17:11
dhellmannjogo: I was just on my way here to ask you about what's up with tempest-lib17:12
dhellmannthe requirements for oslo.config in stable/juno seem to be in conflict with the other apps? is there anything I can do to help resolve that17:13
dhellmannjogo: +2a17:13
dhellmannjogo: I guess maybe that's what https://review.openstack.org/#/c/153702/ is for?17:14
*** mlavalle has joined #openstack-qa17:15
*** EmilienM is now known as EmilienM|afk17:15
*** toure_ has joined #openstack-qa17:15
*** toure_ has quit IRC17:15
*** jpich has quit IRC17:19
openstackgerritMerged openstack/tempest: Change tempest UnprocessableEntity exc to tempest-lib exc  https://review.openstack.org/14843617:25
*** btran has joined #openstack-qa17:25
openstackgerritMerged openstack/tempest: Change tempest InvalidContentType exc to tempest-lib exc  https://review.openstack.org/14843717:25
*** mpaolino has quit IRC17:28
*** zigo has quit IRC17:29
*** otherwiseguy has joined #openstack-qa17:30
mriedemmtreinish: i have to say, i had a hell of a time trying to find a 100% fail in the gate on that keystone race bug you fixed on friday17:30
mriedemwith the duplicate role create17:30
mriedemi think that's what is killing the categorization rates17:30
mtreinishmriedem: heh, really I only saw it once on a change sdague pointed out17:31
mtreinishI didn't think it was that common17:31
otherwiseguysdague: I'm hoping that this change (https://review.openstack.org/#/c/154118/) isn't too controversial. Just adding the installation of python-openvswitch when installing openvswitch to support my native ovsdb backend for ovs_lib patch. python-openvswitch doesn't rely on any other python packages.17:31
mriedemi had it on a nova change of mine17:31
mriedemotherwiseguy: is neutron finally using python-openvswitch rather than command line?17:32
mriedemb/c that would be nice17:32
otherwiseguymriedem: I have a patch that basically adds an abstract API with a backend for using ovs-vsctl and one for python-openvswitch.17:33
otherwiseguyThat way we can transition.17:33
mtreinishmriedem: the bigger issue with that failure is we don't index the keystone logs so we can't write a good e-r query17:33
*** gszasz has quit IRC17:33
clarkbmtreinish: we should now17:34
clarkbsdague fixed it17:34
otherwiseguySo I'm wanting to test both backends with the same functional test, just configuring which backend is used. But python-openvswitch isn't available in PyPI and it's a bit of a pain to get it ready to put in PyPI.17:34
mriedemmtreinish: ? i was getting hits with tags:"screen-key.txt" and tags:"keystone.txt"17:34
sdaguemriedem: that's the minority case17:34
sdaguemost of the runs don't use that log file17:35
mtreinishclarkb: ah, ok cool17:35
sdaguebecause they are under apache17:35
mtreinishsdague: that's just picking up the eventlet case?17:35
sdagueso I actually don't know about the keystone.txt one doing the right thing or not17:35
openstackgerritDavid Kranz proposed openstack/tempest: Change limits/quota clients to return one value and update tests  https://review.openstack.org/15413717:36
sdaguebut we definitely weren't indexing that file until late last week17:36
*** Nic has joined #openstack-qa17:37
mriedemmtreinish: seen this? http://logs.openstack.org/37/151037/1/gate/gate-grenade-dsvm/a767b9a/logs/grenade.sh.txt.gz#_2015-02-09_16_04_55_45917:37
mriedempkg_resources.ContextualVersionConflict: (oslo.config 1.4.0 (/usr/local/lib/python2.7/dist-packages), Requirement.parse('oslo.config>=1.6.0'), set(['tempest-lib']))17:37
mtreinishmriedem: yeah that's breaking the juno gate17:38
mriedembug reported?17:38
mtreinishjogo: is working on it17:38
mriedemassuming capping tempest-lib on stable/juno?17:38
mtreinishmriedem: it's not as simple because tempest is run from master17:39
mtreinishwe already run tempest in a tox venv, the fix is to also do that with javelin17:39
mriedemok17:39
otherwiseguymriedem: replied to your question re: PyPI on the review.17:41
mtreinishoh, cool it looks like the fixed preseeding is already working17:41
mriedemmtreinish: jogo: reported a bug in case there isn't one https://bugs.launchpad.net/grenade/+bug/141991317:41
openstackLaunchpad bug 1419913 in grenade "Grenade fails with ContextualVersionConflict between oslo.config and tempest-lib on juno side" [Undecided,New]17:41
mtreinishthat took effect faster then I was expecting17:41
*** krtaylor has quit IRC17:41
*** jlibosva has quit IRC17:43
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for grenade bug 1419913  https://review.openstack.org/15414717:47
openstackbug 1419913 in grenade "Grenade fails with ContextualVersionConflict between oslo.config and tempest-lib on juno side" [Undecided,New] https://launchpad.net/bugs/141991317:47
mriedemmtreinish: ^17:47
mriedemalso seeing this http://logs.openstack.org/37/151037/1/gate/gate-requirements-integration-dsvm/7a9f85f/console.html#_2015-02-09_16_13_26_26817:50
mtreinishmriedem: looks like the stable release tag broke ceilo17:52
mriedemand keystone17:53
mtreinishthey probably just forgot to bump the version string in setup.cfg (although they really don't need one IIRC)17:53
mriedemyup https://github.com/openstack/ceilometer/blob/stable/juno/setup.cfg#L317:53
mriedemhttps://github.com/openstack/keystone/blob/stable/juno/setup.cfg#L317:53
mriedemi can push patches for those17:54
*** krtaylor has joined #openstack-qa17:54
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for busted requirements on juno bug 1419919  https://review.openstack.org/15415817:57
openstackbug 1419919 in Keystone "gate-requirements-integration-dsvm fails on stable/juno with ValueError for missing 2014.2.3" [Undecided,New] https://launchpad.net/bugs/141991917:57
mriedemmtreinish: ^17:57
mriedemmtreinish: i amazingly have no meetings today so i can actually do things17:57
morganfainbergmriedem, is that allowed?17:58
mriedemmorganfainberg: someone f'ed up17:58
morganfainbergmriedem, a day with no meetings that is17:58
morganfainberghehe17:58
openstackgerritMerged openstack-dev/devstack: implement elasticsearch pkg for devstack  https://review.openstack.org/15304817:58
mriedemmtreinish: hmm, cinder and nova also have hard-coded versions in their setup.cfg on stable/juno17:58
openstackgerritMerged openstack-dev/devstack: Isolate creating service users  https://review.openstack.org/15067217:59
*** dmorita has joined #openstack-qa17:59
*** gfidente has quit IRC18:01
*** yamahata has joined #openstack-qa18:03
*** harlowja has joined #openstack-qa18:04
*** annashen has joined #openstack-qa18:05
*** safchain has quit IRC18:06
*** afazekas has quit IRC18:07
openstackgerritMerged openstack-infra/elastic-recheck: Add query for grenade bug 1419913  https://review.openstack.org/15414718:08
openstackbug 1419913 in grenade "Grenade fails with ContextualVersionConflict between oslo.config and tempest-lib on juno side" [Undecided,Confirmed] https://launchpad.net/bugs/141991318:08
*** e0ne has quit IRC18:09
mtreinishmriedem: ^^^ man you didn't even give me a chance to +A it...18:11
mriedemmtreinish: too slow18:11
mriedemi'm bumping the versions on the stable/juno branches for each project18:11
mriedemlooks like apavec did that for 2014.2.2 after 2014.2.1 was released but it hasn't been done for 2014.2.2/3 yet18:12
*** melwitt has joined #openstack-qa18:14
*** aix has quit IRC18:15
openstackgerritMerged openstack-infra/elastic-recheck: Add query for busted requirements on juno bug 1419919  https://review.openstack.org/15415818:15
openstackbug 1419919 in Keystone "gate-requirements-integration-dsvm fails on stable/juno with ValueError for missing 2014.2.3" [Undecided,New] https://launchpad.net/bugs/141991918:15
*** yjiang5_ has joined #openstack-qa18:16
openstackgerritSean Dague proposed openstack-dev/devstack: add gating up/down script for devstack  https://review.openstack.org/15299418:16
yjiang5_Hi, all, my multi-host devstack environment failed because  https://review.openstack.org/#/c/149288/ will die devstack if I have my controller node in another host. I remember devstack should support multiple host enviornment, right?18:16
*** openstackrecheck has quit IRC18:17
*** openstackrecheck has joined #openstack-qa18:17
yjiang5_dtroyer: do you have any idea on it?18:17
*** rushiagr is now known as rushiagr_away18:18
*** luqas has quit IRC18:22
clarkbyjiang5_: yes, in fact that change has been reverted18:23
clarkbyjiang5_: bceause we need to not die on multinode installs18:23
*** mfalatic has joined #openstack-qa18:25
clarkbyjiang5_: make sure your checkout of devstack is up to date18:25
yjiang5_clarkb: aha, thanks. So possibly I forgot to update my devstack env.Thanks.18:25
yjiang5_clarkb: possibly that patch is still  helpful. We only need something to do more accurate check and dies if it's really a mis-configuration. I will try to see if I can cook a patch for it.18:26
mriedemmtreinish: not sure if this is the answer, but https://review.openstack.org/#/q/Ib8a29258d99de75b49a9b19aef36bb99bc5fcac0,n,z18:26
mriedemgoing to lunch18:26
*** krtaylor has quit IRC18:27
*** shashankhegde has joined #openstack-qa18:27
*** yamahata has quit IRC18:29
*** patrickeast has joined #openstack-qa18:30
*** yamahata has joined #openstack-qa18:30
openstackgerritMORITA Kazutaka proposed openstack-dev/devstack: Add support Sheepdog cinder backend  https://review.openstack.org/15418418:30
openstackgerritOpenStack Proposal Bot proposed openstack/tempest: Updated from global requirements  https://review.openstack.org/15418718:31
sdaguejogo: didn't realize this had wedged juno - https://review.openstack.org/#/c/153080/718:31
sdague+2 now18:31
openstackgerritSean Dague proposed openstack-dev/devstack: remove tuskar  https://review.openstack.org/15401518:32
openstackgerritSean Dague proposed openstack-dev/devstack: gantt is a dead project, remove it  https://review.openstack.org/15401718:32
*** markus_z has quit IRC18:33
sdaguemriedem: once you get back, is this a rush fix - https://review.openstack.org/#/c/153080/ ?18:34
openstackgerritDavid Kranz proposed openstack/tempest: Change flavors client to return one value and update tests  https://review.openstack.org/15411418:37
*** patrickeast has quit IRC18:39
*** johnthetubaguy is now known as zz_johnthetubagu18:39
*** patrickeast has joined #openstack-qa18:42
*** achanda has joined #openstack-qa18:43
openstackgerritSean Dague proposed openstack-dev/devstack: add gating up/down script for devstack  https://review.openstack.org/15299418:44
*** coolsvap is now known as coolsvap_18:45
mriedemsdague: rush fix?18:45
*** yfried_ has joined #openstack-qa18:45
sdaguemriedem: that should unwedge juno18:46
sdagueI think18:46
mriedemsdague: there are 2 bugs that i know of18:46
mriedemstarted the ML thread18:46
sdagueok, well I'm asking you, as the started of said thread, you want me to fast approve https://review.openstack.org/#/c/153080/  ?18:46
*** coolsvap_ is now known as coolsvap18:46
*** vigneshvar has quit IRC18:47
mriedemsdague: well it looks like grenade is passing, so i suppose18:47
*** coolsvap is now known as coolsvap_18:47
*** achanda has quit IRC18:47
mriedemlooks like there is more work to do there but if it's busting grenade i say go for it18:47
sdaguealthough, grenade on master seems fine...18:48
sdagueand that's a master patch18:48
mriedemhttp://status.openstack.org/elastic-recheck/gate.html18:48
mriedemso is the problem in juno/icehouse?18:48
sdagueyeh, I don't know18:49
mriedemlogstash shows those only fail on stable/juno18:49
mriedemnot master18:49
sdagueI just figured if someone told me which fixes needed potential fast approve, then I'd look at them18:49
mriedemsdague: i think master is fine18:49
sdagueok18:49
mriedemhttp://status.openstack.org/elastic-recheck/data/uncategorized.html in the last 24 hours is pretty clean anyway18:50
*** patrickeast has quit IRC18:50
jogosdague: well that needs to be backported to stable first anyway18:50
jogosdague: but the grenade patch needs to land first I think, so not sure18:51
*** ChuckC has quit IRC18:53
mriedemadam_g: since apevec isn't around, can you tell if this is right? https://review.openstack.org/#/q/Ib8a29258d99de75b49a9b19aef36bb99bc5fcac0,n,z18:53
*** achanda has joined #openstack-qa18:53
mriedemi assume apevec usually runs a script to do those18:53
*** ChuckC has joined #openstack-qa18:54
jogomriedem: so those can't land due to grenade bug18:54
*** Longgeek has joined #openstack-qa18:55
jogomriedem: and I take it those are blocking the juno gate as well?18:55
mriedemjogo: yeah18:55
mriedemat least ceilometer and keystone18:55
mriedemhence the fubar email :)18:55
jogomriedem: why do you care about stable/juno btw? your internal IBM branches?18:56
mriedemjogo: that's offensive sir18:56
mriedemjogo: i started looking into it b/c of the bad categorization %s on the e-r page18:56
mriedemthat showed me the grenade failure and then later the other thingy18:56
sdaguejogo: if you queue up the list of patches I should review in order, I will in about 20 minutes18:56
jogomriedem: ahhh18:57
mriedemjogo: i care because i care about the health and well being of openstack our shining savior hallelujah18:57
jogosdague: not actually sure what patches just yet because there are multiple steps and not sure if we can turn them into one to unwedge the gate18:57
jogomriedem: good, ok so you saw my two patches18:57
mriedemjogo: yup18:57
* cdent sings hosanna18:58
jogomriedem: so not installing tempest should fix the issue. But doing so is a a two patch solution18:58
jogomriedem: https://review.openstack.org/#/c/153702/ won't land due to tempest-lib issue18:58
jogoand we can'18:58
jogowe can't land https://review.openstack.org/#/c/153080/7 on stable/juno without the grenade change18:58
jogoso I am looking for ideas18:58
mriedemoh so we can't merge https://review.openstack.org/#/c/153080/ and then backport to stable/juno?18:59
mriedemjogo: can we cap versions in icehouse/juno for oslo.config or anything?19:00
mriedemor they are already capped and that's the problem19:00
mriedemb/c tempest-lib requires newer oslo.config19:00
jogomriedem: no because grenade assumes javelin is installed19:00
jogomriedem: yeah we can put a cap in that should fix it19:00
jogowell hmm not sure due to python dependencies being odd19:01
*** cbader has quit IRC19:01
mriedemin icehouse, oslo.config is capped: https://github.com/openstack/requirements/blob/stable/icehouse/global-requirements.txt#L4819:01
mriedembut tempest-lib isn't19:01
mriedemhttps://github.com/openstack/requirements/blob/stable/icehouse/global-requirements.txt#L12319:01
mriedemcan we cap tempest-lib in icehouse19:01
mriedem?19:01
jogomtreinish: ^19:02
mriedemoslo.config is uncapped in stable/juno https://github.com/openstack/requirements/blob/stable/juno/global-requirements.txt#L5519:02
jogoI don't think so because branchless tempest19:02
mriedembranchless tempest can't work with older tempest-lib?19:02
*** toure_ has joined #openstack-qa19:03
jogomriedem: AFAIK no because trunk tempest needs the latest tempest-lib19:03
mriedemgdi19:03
*** zigo has joined #openstack-qa19:03
jogoright19:03
mriedemwho came up with this crazy branchless tempest idea in the first place?! :P19:03
jogonot installing tempest would fix it but we may need to ninja a patch or two in19:04
mriedemcan we temporarily install tempest from a tag?19:04
jogohmmm there is another solution  Ithink19:04
mriedemon stable?19:05
mriedemthat's what we do internally, we checkout a given corresponding tempest tag for the release and run from there19:05
mriedemwe might miss some fixes but we either skip those or cherry pick them back19:05
jogoa patch to stable/icehouse devstack to stop doing reqs sync for tempest19:05
jogobecause we are syncing stable/icehouse reqs to tempest master19:06
jogowhich is batshit19:06
mriedemjogo: another possible way out,19:07
mriedemtempest requires tempest-lib>=0.1.019:07
*** vigneshvar has joined #openstack-qa19:07
mriedemtempest-lib requires oslo.config>=1.4.019:07
mriedemwhich would work under the cap of oslo.config in stable/icehouse: oslo.config>=1.2.0,<1.519:08
mriedemso if we could pin tempest-lib to 0.1.0 on stable/icehouse that might workaround it19:08
mriedemlet me try that19:08
jogomriedem: AFAIK we cannot because we use things from tempest-lib 0.2.0 already19:08
mriedemhmm, then the version req in tempest master is busted19:09
*** dimtruck is now known as zz_dimtruck19:09
jogomriedem: see Idff90dde0607ad58d6959a8afa32f8bb4f74c6dc19:09
mriedemha, shit19:09
mtreinishjogo: you can use tempest-lib 0.1.0 on the stable branches19:09
mtreinishthere is an edge case with an unhandled exception which will mask real failures19:10
jogomtreinish: excellent haha19:10
mriedemmtreinish: but once tempest on master picks up https://review.openstack.org/#/c/153708/ and bumps the req won't that break if we pin tempest-lib on stable?19:10
mriedemso this would be a temporary pin right19:10
mtreinishmriedem: well it'll change the min in the reqs file, but besides that exception the first real usage is: https://review.openstack.org/15346119:11
openstackgerritDavid Kranz proposed openstack/tempest: Change data_processing client to return one value and update tests  https://review.openstack.org/15420219:11
*** Longgeek has quit IRC19:11
*** EmilienM|afk is now known as EmilienM19:12
*** melwitt has quit IRC19:13
mtreinishmriedem: if it's still syncing the reqs file like it was before it'll overwrite that (which is really bad)19:13
*** melwitt has joined #openstack-qa19:13
mriedemmtreinish: ok sec19:13
dhellmannsdague, mtreinish : since we're capping oslo requirements in the stable branches, would it make sense to remove the stable-compat jobs from those projects?19:14
dhellmannjogo: let me know if I can help with reviews or implementation on this stable/juno stuff -- several oslo libs are blocked until we have that resolved19:14
*** melwitt has quit IRC19:15
mtreinishjogo: the issue there is it's still syncing the reqs file. You need to stop devstack from syncing the reqs on tempest if we're only going to do it through a venv19:15
*** melwitt has joined #openstack-qa19:15
jogomtreinish: right, so I actually think the best way forward is to ninja a few patches in19:15
mriedemjogo: mtreinish: sdague: https://review.openstack.org/#/c/154203/19:15
jogobut lets see if mriedem's thing works first19:16
mriedemso we also need a change to devstack to stop syncing reqs on which branch?19:16
mriedemicehouse?19:16
jogodhellmann: please don't cut any new oslo libs until you are shure they are capped on stable/* branches19:16
jogomriedem: doing that but still installing tempest will lead to other issues19:17
mriedemjogo: ok i'm watching 154203 in zuul now then19:17
*** zz_dimtruck is now known as dimtruck19:17
yjiang5_clarkb: according to https://github.com/openstack-dev/devstack/blob/master/stack.sh#L588 ,seems the   https://review.openstack.org/#/c/149288/ is not reverted?19:17
*** BharatK has joined #openstack-qa19:18
jogomriedem: want to start an etherpad for this?19:18
sdaguedhellmann: once it's all working, the answer is yes19:18
mriedemjogo: i don't know where to start19:18
jogomriedem: pick an etherpad name and I will start filling it in19:18
mtreinishjogo: that's what I was saying before, unless there's an unhandled exception raised by an http call 0.1.0 will work even with installing tempest (at least for now)19:18
clarkbyjiang5_: oh wait, where there multiple die patches19:18
mriedemjogo: https://etherpad.openstack.org/p/wedged-stable-gate-feb-2015 ?19:19
jogosure19:19
dhellmannjogo: yeah, we're holding off19:19
clarkbyjiang5_: fwiw we do have multi host devstack working right now with latest devstack as of frida19:19
clarkbyjiang5_: there was a similar change that was reverted and I didn't look at the diff just the commit message.19:20
jogodhellmann: thanks19:20
dhellmannsdague: once it's all working? I'm not sure why we care about master working with old stuff now if we're going to impose lower level caps anyway19:20
dhellmannsdague: removing those jobs would at least unblock current dev work on those libraries19:20
dhellmannand if we don't release them until the caps are in place, it shouldn't introduce any other risk elsewhere19:21
yjiang5_clarkb: hmm, so possibly something else wrong on my environment? Not sure and will check again.19:21
sdaguedhellmann: oh, for stuff that has caps?19:21
dhellmannsdague: yeah, all oslo libs will be capped, so I'm suggesting we just stop testing all oslo libs against stable branches for now19:21
dhellmanns/for now/now/19:21
dhellmannbecause I have several where I can't land patches because of the tempest-lib thing jogo is working through19:21
dhellmannand then our next priority will be imposing the caps, and I will have some time to help jogo with that now19:22
sdaguedhellmann: sure, sounds fine19:22
openstackrecheckConsole logs not available after 13:29s for gate-keystone-python27 151962,7,4c5bdc019:22
clarkbyjiang5_: I am looking at what we have now19:22
dhellmannsdague: ok, I'll go set that up19:22
yjiang5_clarkb: thanks.19:23
jogodhellmann: I am just worried about breaking stable/juno further right now19:23
mtreinishjogo: another not so crazy option is to remove the syncing and reqs job on tempest-lib master and change the oslo.config option to be >=1.4.0 and push a point release19:24
clarkbyjiang5_: http://logs.openstack.org/79/136179/5/experimental/check-tempest-dsvm-aiopcpu/6f5193e/logs/10.209.161.148-subnode/ you can see the logs and configuration for the compute node there19:24
clarkbyjiang5_: DATABASE_TYPE is still set19:24
clarkbyjiang5_: but mysql is not in the list of enabled services. So that is probably why it is working19:24
dkranzcdent: I noticed that the tempest telemetry client create_sample method is never called. Do you know what's up with that?19:24
dhellmannjogo: yeah, this would only let us make changes to master in the libs themselves, and the oslo team has agreed to not release anything until stable/juno is fixed and we have those caps in place19:25
jogomtreinish: ++  honestly the syncing bumping min versions when not actually needed is hurting us19:25
clarkbyjiang5_: if you look in the localrc file19:25
mtreinishjogo: wait, tempest-lib shouldn't be using oslo.config for anything directly so it shouldn't be in the reqs file for tempest-lib...19:25
* mtreinish checks19:25
*** achanda has quit IRC19:25
jogodhellmann: cool works for me then, thanks19:25
openstackgerritMerged openstack-dev/devstack: Add postgresql dev package as testonly neutron dep  https://review.openstack.org/15309119:26
yjiang5_clarkb: aha, thanks. So I need set the database_type in localrc. Not sure if it19:26
openstackgerritMatthew Treinish proposed openstack/tempest-lib: Remove oslo.config from requirements.txt  https://review.openstack.org/15421019:26
mtreinishjogo: ^^^ I think that should fix things...19:26
yjiang5_clarkb: pressed 'enter' too quickly. I will take this way, thanks.19:26
clarkbyjiang5_: and let me know if that isn't it we can keep digging19:27
mtreinishoh wait, nope it'll fail because of oslo.logging nm19:27
*** achanda has joined #openstack-qa19:27
yjiang5_clarkb: sure.19:27
jogomtreinish: sigh19:27
*** ChuckC_ has joined #openstack-qa19:28
*** ChuckC has quit IRC19:29
jogoso lets hope the pin tempest-lib on stable works19:30
jogobecause otherwise unwinding this will take time19:30
*** e0ne has joined #openstack-qa19:30
* mtreinish hides19:30
jogomtreinish: want  to help? https://review.openstack.org/#/c/153702/ needs backporting to icehouse19:31
*** jordanP has quit IRC19:32
mtreinishjogo: we don't run grenade on icehouse anymore19:32
mtreinishso we shouldn't need to backport that any further19:33
mriedemright19:33
jogomtreinish: good, well done then that was easy19:33
*** sileht has quit IRC19:33
openstackgerritWayne Okuma proposed openstack-dev/devstack: Adds elasticsearch support as a pre-req for the glance-index.  https://review.openstack.org/14944219:35
jogosdague: https://review.openstack.org/#/c/151812/ and related can sue some reviews19:35
sdaguejogo ... looking19:35
jogoto help us get out of this issue in general19:35
openstackgerritJoe Gordon proposed openstack-dev/devstack: Stop installing tempest  https://review.openstack.org/15308019:37
jogomriedem: so if your patch works, we can land my patches to stop installing tempest and that should future proof us19:37
sdagueoh, man, I didn't realize in new gerrit ui if you highlight text before you write a comment, it leaves that annotation in there - https://review.openstack.org/#/c/151812/1/inc/python,cm19:37
*** andreykurilin_ has joined #openstack-qa19:38
*** afazekas has joined #openstack-qa19:41
*** openstackgerrit has quit IRC19:41
*** sileht has joined #openstack-qa19:41
*** openstackgerrit has joined #openstack-qa19:41
jaypipesmtreinish: on that wedge etherpad, you wrote: "It won't work because oslo.logging (which is still incubator synced in tempest-lib) requires oslo.logging". Is that what you meant to write? :)19:43
dhellmannjaypipes: I think mtreinish meant the incubated logging code in tempest needs oslo.config19:44
mtreinishjaypipes: s/oslo.logging/oslo.config19:44
jaypipes:)19:44
jaypipesgotcha.19:44
mtreinishsigh, fixed it19:44
jogomriedem sdague: https://review.openstack.org/#/c/153080/7 should be ready for review19:47
jogothe backport of that should prevent this in the future19:47
sdaguejogo: +219:48
* jogo looks up and notices his train is pulling into the station and goes AFK for a bit19:48
sdaguejogo: I think the venv general patch is far enough off, to just move forward on this19:48
*** bkopilov has quit IRC19:49
openstackrecheckConsole logs not available after 13:25s for check-tempest-dsvm-full 154140,2,0052e3619:50
*** abhirc has quit IRC19:52
*** itzikb has joined #openstack-qa19:53
*** Rockyg has joined #openstack-qa19:53
openstackgerritMatthew Treinish proposed openstack/tempest-lib: Switch to using oslo.log from library  https://review.openstack.org/15421019:54
mtreinishjogo: ^^^ this probably will just make things more complicated. But if we want to remove oslo.config from the reqs file this is the best way todo it19:55
mtreinisheventually we'll want to land that but I'm sure it'll make the stable branch story just more difficult19:55
*** melwitt has quit IRC19:55
*** melwitt has joined #openstack-qa19:56
openstackgerritDavid Kranz proposed openstack/tempest: Change telemetry client to return one value and update tests  https://review.openstack.org/15421819:56
*** afazekas has quit IRC19:56
itzikbmtreinish: hi,Can you please review https://review.openstack.org/#/c/139979/?19:57
jogomtreinish: well if mriedem's patch works we can unwedge stable and begin landing patches to not install tempest19:58
jogowhich should prevent your patch from breaking things19:58
*** afazekas has joined #openstack-qa19:58
*** krtaylor has joined #openstack-qa19:59
*** andreykurilin_ has quit IRC20:00
jogomriedem mtreinish: https://jenkins07.openstack.org/job/check-tempest-dsvm-full/25612/console20:00
jogofrom mriedem's attempted fix https://review.openstack.org/#/c/154203/20:00
jogoso that is fun20:01
mtreinishjogo: yeah there wasn't anything changed in that code path between 0.1.0 and 0.2.020:02
cdentdkranz: sorry i was getting some dinner, done now, what's up with which test? (trans. huh?)20:02
mtreinishI wonder how that got through...20:02
jogomtreinish: hmm maybe stable/icehouse is broken20:03
dkranzcdent: It wasn't a test. Just that some methods are defined in the client but not used in any test.20:03
* cdent looks20:03
*** Nic has quit IRC20:03
*** Nic has joined #openstack-qa20:04
jogomtreinish: https://review.openstack.org/#/c/154052/ stable/icehouse is working20:04
mtreinishjogo: oh the first failure is why we pushed out 0.2.0:20:04
mtreinishhttp://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-full/2339922//console.html#_2015-02-09_19_45_24_98420:04
mtreinishthe status code differs thing I've not seen before20:04
*** abhirc has joined #openstack-qa20:05
jogomtreinish: hmm ok, so how do we want to proceed?20:05
mtreinishoh really weird it's returning a 400 and the traceback says 200 != 20220:05
cdentdkranz: looking at the log from the commit that added that line I'd say someone decided they were going to add a full featured telemetry client in preparation for some grand future when ceilometer would be covered by tempest20:06
cdentbut then plans changed, but the code did not20:06
dkranzcdent: ok, so what is the grand plan now?20:06
*** afazekas has quit IRC20:07
mtreinishjogo: sigh we can't use 0.1.0 anymore it looks like tempest has landed changes recently that require 0.2.020:07
*** abhirc has quit IRC20:07
*** afazekas has joined #openstack-qa20:07
mriedemjogo: mtreinish: e-r said it was bug 135249820:07
openstackbug 1352498 in Cinder "Tempest fails spectacularly with "VolumeType c39f18bf-2408-4377-98f6-ef2839d6f70e deletion failed, VolumeType in use."" [Undecided,New] https://launchpad.net/bugs/135249820:07
mriedemon stable/icehouse20:07
*** catohornet1 has joined #openstack-qa20:07
jogomtreinish: can we temporarily pin tempest on stable/icehouse?20:08
cdentWell in the 8 months or so since I've known anything about the existence of tempest the plan on whether or not _any_ ceilometer was going to be run in tempest tests has changed at least twice and I'm not currently certain what the state is because I recently saw a patchset which suggested perhaps some tests were going to be allowed in.20:08
mtreinishmriedem: oh, I was going just by the commit messages, let me check the code of the commits I was looking at20:08
mtreinishjogo: it might not be needed20:08
cdentIn other words I don't know. Are you trying to accomplish something dkranz, or just looking to clean things up?20:08
dkranzcdent: I was changing the telemetry client to return one value in prep for moving to tempest-lib20:09
jogomtreinish: hmm did all the jobs fail the same?20:09
dkranzcdent: https://review.openstack.org/#/c/154218/20:09
mriedemjogo: yeah20:09
dkranzcdent: I was also adding the response code checking in the client which had not been done20:09
*** aysyd has quit IRC20:10
mriedemDetails: Unexpected http success status code 200, The expected status code is 20220:10
mtreinishjogo: yeah the commits I thought required 0.2.0 should still work on 0.1.020:10
mriedemjogo: mtreinish: did cinder change the response code at some point?20:10
jogohmm therea re a lot of volume failures20:10
mtreinishmriedem: they shouldn't be able to20:10
mtreinishbecause of branchless tempest...20:10
jogohere are the three outputs:20:11
jogohttp://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-full/2339922/logs/testr_results.html.gz20:11
jogohttp://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-postgres-full/dc9f6b6/logs/testr_results.html.gz20:11
jogohttp://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-neutron/8b79a28/logs/testr_results.html.gz20:11
jogobut that isn't full so ignoringit20:11
*** catohornet1 has left #openstack-qa20:11
cdentah, okay, dkranz I now remember this coming up back when I made some adjustments and at that time there was discussion about the single/double response code that I guess got dropped for "later": https://review.openstack.org/#/c/115971/20:11
cdentIf, in fact, we want templest-lib to have a working telemetry client then yeah, create_sample needs to be in it.20:12
mriedemmtreinish: jogo: https://github.com/openstack/tempest/commit/d9df38c867d6447dc41ad3fa7bc8b3d732e751b020:12
dkranzcdent: That's fine. My patch just changes it with the others.20:13
mriedemmtreinish: jogo: https://review.openstack.org/#/c/114783/ didn't run against icehouse from what i can see20:13
dkranzcdent: thanks for the info20:13
mriedemi guess that would have been juno so old grenade would be icehouse20:13
jogomriedem: but icehouse jobs aren't failing everywhere20:13
cdentYou're welcome. Took me a while to decompress the index for that stuff out the back of my brain.20:13
mtreinishmriedem: it ran icehouse on check20:15
*** scottda has joined #openstack-qa20:15
mtreinishand that just moves the check out of the test code and into the clients20:15
jdgjogo: what's the scoop?20:16
jogojdg: ^20:16
*** mtanino has joined #openstack-qa20:17
jogojdg: trying to figure out why this patch failed https://review.openstack.org/#/c/154203/20:17
jdglooking...20:17
openstackgerritDavid Kranz proposed openstack/tempest: Change flavors client to return one value and update tests  https://review.openstack.org/15411420:18
jdgjogo: weird, the VG was never created20:18
openstackgerritSean Dague proposed openstack-dev/devstack: update plugin doc  https://review.openstack.org/15422420:18
mriedemjdg: well, the bug is old https://bugs.launchpad.net/bugs/135249820:18
openstackLaunchpad bug 1352498 in Cinder "Tempest fails spectacularly with "VolumeType c39f18bf-2408-4377-98f6-ef2839d6f70e deletion failed, VolumeType in use."" [Undecided,New]20:18
mriedemjdg: the weird thing is it failed the same in 3 different icehouse jobs20:18
jdgmriedem: no... I mean the Volume Group doesn't exist20:19
mriedemare we missing devstack changes on stable/icehouse?20:19
jogojdg: ohhh so devstack is not setting something up correctly?20:19
jdgmriedem: lemme look again, I could be wrong20:19
jogojdg: http://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-postgres-full/dc9f6b6/logs/devstacklog.txt.gz#_2015-02-09_19_43_34_97420:20
jdgmriedem: jogo ok I was wrong20:20
mriedemwell, e-r said all 3 jobs failed with the same bug20:20
jogojdg: is http://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-postgres-full/dc9f6b6/logs/devstacklog.txt.gz#_2015-02-09_19_43_35_098 bad?20:20
jogomriedem: lets recheck another stable/icehouse patch20:21
jogoto sort out of this is your patch or unrelated20:21
jdgjogo: mriedem can you trap one of those on failure?20:22
jdgjogo: mriedem I'd be curious to see what's deployed on the VG20:22
mriedemjogo: yeah looking that up now20:22
jogomriedem: https://review.openstack.org/#/c/143110/3 here is a nice unrelated patch20:22
jdgjogo: mriedem ie like "lvs before and after the run"20:22
jogomriedem: just ran recheck20:22
jogojdg: fungi or clarkb can do that if you think that is the issue.20:22
jogojdg: but we try not to as do that as much as possible20:23
mriedemjogo: you rechecked what?20:23
jogomriedem: some random stable/icehouse patch20:23
mriedemjogo: ah ok20:23
mriedemi was going to check logstash20:23
jogomaking sure the failure is related to your patch20:23
jogooh good idea20:23
jdgmriedem: jogo I'm not sure why but the VG size appears to be just slightly off20:23
jdgI don't know what's going on with the taskflow calls :(20:24
*** shashankhegde has quit IRC20:24
clarkbjogo: iirc devstack-gate names an lv properly so that cinder just uses it20:24
mriedemjogo: so far just my icehouse change http://goo.gl/2m5yOD20:25
fungijdg: in many cases you can so some inspection just by proposing throwaway tweaks to tempest, devstack or devstack-gate to spit extra details into the logs20:25
clarkbjdg: previously we set up a volume then dumped a file that was then mounted back in somewhere that cinder used and that was causing more problems that just using a 24GB lv directly20:25
mriedemjogo: the bug in tempest-lib is masking the failure20:25
*** smcginnis has joined #openstack-qa20:25
mtreinishjogo, mriedem: looking through the logs at the first failure on the pin patch full job (which is not cinder related) I see: http://logs.openstack.org/03/154203/2/check/check-tempest-dsvm-full/2339922/logs/screen-n-api.txt.gz?level=TRACE20:25
jdgfungi: good idea.. I'll do try that if I don't find what I'm looking for in a minute here20:25
mriedemmtreinish: fun20:26
jdgclarkb: so I remember some of that, but I don't remember where things left off20:26
jdgclarkb: I *thought* we were back to just creating a loop device?20:26
jogomtreinish: eww20:26
clarkbjdg: pretty sure thats what we did in the past20:26
clarkbjdg: I will dig up where the magic happens20:27
fungi_soon_ (*cough* cross repo dependencies in zuul *cough*) you can even propose a throwaway change to devstack and then set your patch to some other project to depends-on that and see the results too20:27
mriedemjogo: mtreinish: http://goo.gl/7WHbJQ20:27
jdgclarkb: yeah, sorry I lost track of that a while back20:27
mriedemjogo: mtreinish: message:"ResourceClosedError: This result object does not return rows. It has been closed automatically." AND tags:"screen-n-api.txt"20:27
mriedemhas 21 hits in 7 days, stable/icehouse and master20:27
clarkbjdg: https://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/functions.sh#n24120:27
jogojdg: mriedem looks like a oslo.db bug?20:27
clarkbjdg: line 263 is he important one aiui20:28
mtreinishmriedem: heh, just what we needed20:28
mriedemmtreinish: jogo: yeah, not sure, checking to see if we cap oslo.db in icehouse20:28
mtreinishanother bug trying to unwind all of this...20:28
mtreinishmriedem: we probably do20:28
mriedemmtreinish: jogo: oslo.db isn't in icehouse20:28
mriedemhttps://github.com/openstack/requirements/blob/stable/icehouse/global-requirements.txt20:29
mriedemso that would be oslo-incubator/nova/sqlalchemy20:29
dhellmannyeah, oslo.db started in juno20:29
mtreinishmriedem: oh, yeah I don't think it was ready 1 yr ago20:29
mriedemmessage:"ResourceClosedError: This result object does not return rows. It has been closed automatically." AND tags:"screen-n-api.txt" AND build_branch:"master"20:30
mriedemonly hits on check queue20:30
mriedemso probably code bugs20:30
clarkbjeblair: these are some large zuul changes :)20:30
mriedemjogo: mtreinish: i'm rechecking https://review.openstack.org/#/c/154203/ on the cinder bug20:30
jogomriedem mtreinish: so even if we resolve the volume failures we still have   AttributeError: 'module' object has no attribute 'Forbidden'20:31
jogoso I don't think we have a plan yet20:31
mriedemjogo: if i remember correctly though, that's just a thing in tempest-lib that surfaces when a test fails20:31
clarkbjeblair: will get back to review after lunch. Any chance I can interest you in the stack that starts at https://review.openstack.org/#/c/153093/ ?20:31
mriedemif the tests pass then we shouldn't see that20:31
mriedemjogo: ^20:31
mriedemmtreinish would have to confirm20:31
clarkbgah wrong window20:31
jdgmriedem: jogo so there are a number of failures cascading there before the cinder volume create failure20:31
jogomriedem: odds of 3 jobs failing for the same thing being random20:32
jogois doubtful20:32
jdgeven setUpClass fails which I haven't seen before20:32
mriedemjogo: yeah20:32
jogomriedem: so if https://jenkins03.openstack.org/job/check-tempest-dsvm-full/25883/console fails (random icehouse patch)20:33
jogothen it means we have yet another blocker20:33
mriedemjogo: yeah, was wondering when the last icehouse change was checked20:33
jogomriedem: 12 hours ago or so20:33
*** tsekiyama has joined #openstack-qa20:33
jogobut that is enough time for new $version of $thing to break us20:33
mriedemyeah20:34
jdgwow.. quota errors too20:34
jogolast success 2015-02-09T10:27:52.264+00:0020:34
jogojdg: those are normal, cinder logging makes me want to poke my eyes out with a rusty nail20:35
jdgjogo: fair enough, point taken20:35
mriedemjdg: yeah those quota warnings have been around forever20:35
mriedemthe deprecation warnings20:35
mriedemat least horizon20:35
jogojdg: you should fix 'em!20:35
jdgmriedem: jogo well, they should be unhandled traces20:35
jdg:(20:35
mriedem*at least havana i meant20:36
cdentdkranz: do you have a pointer to some history on why the tempest clients are better when they only return one response? I ask because it is often the headers I want to inspect when making tests.20:36
jdgmriedem: jogo so last commit from Ciner was Jan 14 FWIW20:36
*** toure_ has quit IRC20:36
*** smcginnis has left #openstack-qa20:36
jdgjogo: yes, I just added it to my list20:37
jogojdg: dependencies change all the time and break stuff20:37
jdgjogo: I've picked through some of them already20:37
*** Guest46399 has joined #openstack-qa20:37
jdgjogo: right, I was just looking to see if we broke something on the Cinder side explicitly20:37
jogomriedem: so https://jenkins03.openstack.org/job/check-tempest-dsvm-full/25883/console is running20:37
jogowe will know whats up soon20:37
mriedemjogo: yeah i'm watching it on 2 screens20:38
mriedemconsole and zuul20:38
jogomriedem: if icehouse is not broken on its own, we need a new plan of attack.20:38
cdentoh, I see dkranz, it's a magic class. Ugh.20:38
mriedemjogo: can we somehow trick icehouse with a trojan horse and once night falls we pounce?!20:39
mriedemyou win icehouse, please accept this gift20:39
jdgLOL20:39
jogomriedem: if only20:39
*** Rockyg has quit IRC20:40
*** afazekas has quit IRC20:44
*** salv-orlando has joined #openstack-qa20:44
dkranzcdent: The history is that almost all tempest code ignores the response except for checking the response code which is handled in the client20:47
*** shashankhegde has joined #openstack-qa20:47
* cdent is glad he wrote gabbi20:47
dkranzcdent: right, that is a different use case20:48
cdentit's exposing all kinds of ways in which headers are being misused and abused20:48
cdentI dunno: You can't test an HTTP API without testing the headers.20:48
dkranzcdent: a fair number of tempest tests could be replaced by something like gabbi20:48
dkranzcdent: but many of them are more functional in nature20:48
cdentpretty much all the gabbi tests I've written so far would be described as functional because they use a database fixture20:49
cdents/database/storage/20:49
dkranzcdent: where you have to make additional api calls to validate the result20:49
cdentSounds like a bad HTTP API then ;)20:49
cdentone you can't trust20:50
* cdent is mostly kidding20:50
*** afazekas has joined #openstack-qa20:50
dkranzcdent: I know. We need both tests that validate the api and that validate deeper issues.20:50
*** andreaf_ has quit IRC20:51
cdentIf there's interest + some guidance I can make a stab at starting the process of translating some of the more boring API tests to somewhere else. Is the hope that they would become in-tree?20:51
dkranzcdent: Yes, exactly20:51
dkranzcdent: those tests are more akin to unit tests for the api IMO20:52
* cdent nods20:52
dkranzcdent: and I would include negative tests in that bucket20:52
jogomriedem: hmm didn't see any package (pip or dpkg) changes between good and bad changes20:53
jogomriedem: it may be your patch somewhow20:53
mriedemjogo: if it is, it's something that's changed between tempest-lib 0.1.0 and 0.2.0, or tempest's usage of tempest-lib20:54
cdentdkranz, Is there a heuristic for deciding if a test should or should not be in tree? I've heard different perspectives on the "if it needs another project" aspect.20:54
dkranzcdent: one minute, let me find the etherpad about this20:55
jogomriedem: not sure, can we confirm by pinning master tempest to tempest-lib 0.1.0?20:55
*** BharatK has quit IRC20:55
jogoand even if it did change how do we move forward etc.20:55
cdent(my negative testing of ceilometer last week revealed a _huge_ problem in wsme ....)20:55
cdentcool thanks dkranz20:55
mtreinishmriedem: the key change between 0.1.0 and 0.2.0 was adding a missing exception20:55
mtreinishwhich tempest was using20:55
mriedemjogo: not sure, have to figure out what's breaking first20:55
jogodamn https://jenkins03.openstack.org/job/check-tempest-dsvm-full/25883/console passed with flying colors20:56
*** malini has quit IRC20:56
mtreinishmriedem: it's the Forbidden UnAuthorized thing we were looking at before20:56
mriedemjogo: there are still 2 other jobs running on it20:56
mriedemmtreinish: yeah20:56
*** Longgeek has joined #openstack-qa20:56
mtreinishmriedem: there were other changes but I don't think any of them should be used anywhere yet20:57
jogoI don't think pinning tempest-lib on stable is a good way forward at this point20:57
jogothe other candidates that I can think of are:20:57
mriedemmtreinish: http://paste.openstack.org/show/170190/20:57
jogo* Ninja in some of my patches (this would worry me a bit)20:58
jogo* temp pin tempest on stable branches20:58
jogo* EOL icehouse20:58
cdent+1 to ending life. all of it.20:59
mtreinishjogo: I sent the email about the EOL: http://lists.openstack.org/pipermail/openstack-dev/2015-February/056366.html20:59
jdgjogo: cdent wow... that's bold20:59
jdg:)21:00
mriedemi was trying to think of a witty comeback21:00
jogomtreinish: I actually think that may be the best step forward at this time21:00
jogoalthough realistically we cannot EOL it *today*. maybe tomorrow (Tuesday)21:01
jogowhich means want to just revisit the breakage tomorrow?21:01
mriedemidk, i still feel like killing stable/icehouse gets branchless tempest off too easy21:01
dkranzcdent: I led this cross-project session in Paris https://etherpad.openstack.org/p/kilo-crossproject-move-func-tests-to-projects and there is also related https://etherpad.openstack.org/p/kilo-summit-tempest-scope-in-the-brave-new-world21:01
mtreinishjogo: we probably should put it on the cross-project meeting agenda for tomorrow21:02
mriedem+1 to that21:02
jogomtreinish: ohh good idea21:02
mriedemsince ttx will be there21:02
jogomriedem: well we have the path forward, its just blocked by all of this21:02
dkranzcdent: No firm conclusions on many issues. The stuff that Sean pushed is also related21:02
mriedemjogo: oh you mean the changes on stable/juno21:02
mriedemforgot about those...21:02
jogomriedem: my patches  https://review.openstack.org/#/q/I78d51f04ed01da4ce8aa0e127be028f969d3b4f8,n,z21:03
mriedemyeah21:03
dkranzcdent: but the bottom line is that it is still unclear exactly what tests should be in tempest in the long run21:03
jdgjogo: mriedem so seriously, just 'drop' support21:03
mriedembknudson: ^ maybe you want to read that ML thread :)21:03
jogobut they are circular ... :/21:03
jdgjogo: mriedem that seems highly lame and exactly the kind of thing to make people HATE us21:03
jdgjogo: mriedem as much as pinning sucks, that seems like a much more reasonable/sane approach21:03
jogohmm maybe not all of 'em https://review.openstack.org/#/c/154217/21:04
mriedemjdg: what's lame?21:04
jogodifferent failure21:04
cdentthank dkranz21:04
cdents21:04
jdgmriedem: your post regarding just EOL Icehouse now?21:04
jdgmriedem: I'm wondering if I'm missing something?21:04
mriedemjdg: that's mtreinish21:04
mriedemjogo: that looks like the ec2 bug21:04
jdgmriedem: yes, but21:04
*** weshay has quit IRC21:04
mriedemis ec2 capped on stable/icehouse21:04
jdgmriedem: DOHHH21:04
jdgmriedem: sorry... not the first time I've done that21:04
mtreinishheh, it happens again :)21:05
jdgsone of a!!21:05
jdgmtreinish: mriedem one of you change your nic quick!!21:05
jogobut we didn't see that moments ago21:05
mriedemjogo: boto is capped on stable/icehouse... https://github.com/openstack/requirements/blob/stable/icehouse/global-requirements.txt#L621:05
jogoWTF21:05
jogomriedem: what does that mean in this context?21:05
mriedemjogo: your stable/icehouse change is failing on boto failures21:06
mtreinishjdg: for a casual nick friday a while back we switches nicks...21:06
mriedemjogo: when we hit that on master we capped boto21:06
jdgLOL21:06
mriedemjogo: then fixed and uncapped,21:06
jdgmtreinish: so what you're saying is I'm not the only one that does it21:06
mriedemso i'm not sure why this is failing on stable/icehouse21:06
jogomriedem: ohh I know21:06
jogotempest/stable prob doesn't have the pin in it21:06
jogoand my patch stops global sync21:07
mtreinishjogo: it would if the sync is run...21:07
jogoerr damn21:07
jogotempest master (branchless)21:07
mriedemjogo: ah yup21:07
jogougggg21:07
mriedembranchless tempest again ftw :)21:07
jogoso yeah, fuck21:08
jogoso we go to a venv we break EC2, if we don't venv javelin on icehouse breaks21:09
mtreinishjogo: wait I missed something. What!?21:09
*** Longgeek has quit IRC21:10
* dhellmann tries to catch up with the latest21:10
dhellmannjogo: virtualenvs break ec2?21:10
mtreinishdhellmann: my guess is using latest boto with stable code (which installing master tempest from a venv would do) breaks the tests21:11
mtreinishbut I missed it too21:11
mriedemhttps://review.openstack.org/#/c/154217/121:11
mriedemthat stops the reqs sync if i understand it,21:11
mriedembut tempest on master has uncapped boto21:11
mriedembut the code in nova can't handle uncapped boto21:11
mriedemthat's why boto is capped in global-reqs on icehouse21:11
jogomriedem: correct21:11
mtreinishffs21:12
mriedemheh21:12
*** andreaf_ has joined #openstack-qa21:12
dhellmanndoes master tempest work with the capped boto against icehouse?21:12
*** andreaf has quit IRC21:12
dhellmanncould we have the tempest job get the boto requirement from the nova requirements list?21:12
*** andreaf_ is now known as andreaf21:12
mriedemdhellmann: master tempest works with capped boto on icehouse yes b/c boto is capped21:13
*** andreaf_ has joined #openstack-qa21:13
mriedemidk about the latter question21:13
dhellmannok, I wasn't sure if the internal apis of boto had changed, or just the way it interacts with the rest api21:13
mriedemlatest boto started doing new auth signature stuff that ec2 in nova wasn't handling21:13
dhellmannright21:13
jogodhellmann: yes master tempest works with capped boto21:13
dhellmannok21:13
dhellmannok, so how hard would it be to make the tempest job pull the boto requirement from whatever nova is using?21:14
mriedemit does on master, but we capped boto on icehouse/juno21:14
mriedemwhich then dovetails into the topic of removing ec2 from nova :)21:14
jogoas for the second idea, getting boto version from nova-reqs21:14
dhellmannI assume nova has a boto dependency, but maybe not21:14
jogothat is pretty ugly21:14
*** afazekas has quit IRC21:14
mriedemdhellmann: it does, it's capped from stable global-reqs21:14
dhellmannwell, it is, but we're trying to build a job that tests the icehouse api and if we know the boto version needs to be different for those tests, then...21:14
dhellmannso we need to stop thinking about this as installing a thing and its dependencies and start thinking about installing a set of packages to run the test job we're designing, right?21:15
mriedemdhellmann: https://github.com/openstack/nova/blob/stable/icehouse/requirements.txt#L621:15
dhellmanncool21:15
dhellmannso theoretically at least we could look there to figure out which boto to use for tempest21:15
dhellmannand if tempest's boto requirement was unbounded, or we update the requirement before installing tempest, there would be no runtime requirement check failure21:16
*** dmellado has quit IRC21:16
dhellmannno pkg_resources error, that is21:16
*** dmellado has joined #openstack-qa21:16
jogoso this is a big issue with branchless tempest21:16
dhellmannindeed21:16
jogocan we just cap boto on master for now and revisit later (I.E. never)21:16
mriedemha21:17
jogobecause saying tempest needs different versions of libs for different branches is fugly21:17
mtreinishjogo: I'm fine with that21:17
dhellmannthat seems like another option -- didn't we do that for a while? I see some reqs changes to undo the cap21:17
mriedembut it's boto today and something else tempest requires tomorrow21:17
mriedemwe uncapped boto on master b/c the nova code was fixed21:17
mriedemwe could backport the nova changes down to stable/icehouse...21:17
mriedembut that's dumb b/c boto is capped in nova on icehouse21:17
dhellmannyeah21:18
mriedemwouldn't be a real world issue21:18
dhellmannsure it is, but the way we're telling people to solve it is by using an older version of boto21:18
dhellmannso if that's what we're saying, we should do that ourselves here, too21:18
jogodon't know of any  good answer to this21:18
dhellmannI see 3 options: we could turn off those tests, fix nova to work with newer boto, or make the tests run with older boto21:19
mriedemhmm21:20
dhellmannas mriedem points out, this is just today and there may be something other than boto in the future (although it's less likely than if we were installing everything together in one site-packages)21:20
mriedemcan we skip the boto tests in tepmest if boto is < 2.35?21:20
mriedembut that doesn't fix jogo's patch21:20
dhellmannno, that wouldn't help21:20
*** achanda has quit IRC21:20
dhellmannyou need to skip if the version of nova you're talking to is whatever version doesn't include the fix for the new boto21:20
mtreinishmriedem: we could, but wouldn't help because the tests aren't broken with boto <2.3521:20
*** ChuckC_ has quit IRC21:20
mriedemmtreinish: right21:21
jogowhat about just skip EC2 tests on stable/icehouse21:21
mriedemdhellmann: yeah, +1 to that21:21
mtreinishdhellmann: +1, but we can't do that in tempest because that's not exposed info from nova21:21
*** ChuckC_ has joined #openstack-qa21:21
dhellmanncan you tell whether the tests will passed based on the nova api version? or did the fix not cause a version bump?21:21
*** ChuckC_ is now known as ChuckC21:21
dhellmannthe api version isn't exposed?21:21
mriedemmtreinish: we can't get that info from the cli?21:21
mriedemnova-manage --version or whatever21:21
mriedemthat should return 2015.1 for kilo21:21
dhellmannmriedem: not all tempest runs will have access to nova-manage21:21
mriedemle sigh21:22
dhellmannbut I thought the rest api had an endpoint to get the API version21:22
jogodhellmann: this isn't the openstack API21:22
mtreinishdhellmann: i don't think nova's boto does21:22
jogoits EC221:22
jogoso that is a different version thing21:22
dhellmannjogo: sure, but you could *ask* the openstack api first21:22
dhellmannis the version different between the ec2 that works with old and new botos?21:23
jogothat just sounds wrong, and we don't have microversions yet anyway etc.21:23
dhellmannhow is it wrong?21:23
jogowe can always backport the fix to icehouse21:23
jogodhellmann: if using the EC2 API you shouldn't have to ever look at the OpenStack API21:23
dhellmannjogo: it's a damned test, don't be puritanical21:24
mtreinishmriedem: it wouldn't be hard to change the icehouse job to just exclude the tempest boto tests21:24
jogodhellmann: oh good word ;)21:24
dhellmann:-)21:24
mtreinishwhich would be how to skip it21:24
dhellmannmtreinish: that sounds like an easy solution21:24
jogomtreinish: +++ do it21:24
jogomriedem: where is the nova patch for boto?21:25
mtreinishugh, now I have to look where to do that...21:25
mriedemjogo: for the fix?21:25
mriedemmtreinish: i think it's d-g21:25
mtreinishyeah it is21:25
*** dmellado has quit IRC21:25
jogomriedem: yeah, maybe its a easy backport?21:25
mriedemjogo: it's 2 fixes, you'd have to squash them21:25
mriedemfirst: https://github.com/openstack/nova/commit/f7b1af9e13df728d086047f6763bd98cb2cad1b221:25
mriedemsecond: https://github.com/openstack/nova/commit/fb588f87db65f28823f9e07a9900c34c7b3576a221:25
jogowhich is required for keystone to calculate21:27
jogothe correct v4 signature when validating the request.21:27
jogowhen did keystone add that?21:27
* jogo votes drop EC2 tests on icehouse21:27
morganfainbergkeystone add what?21:27
*** nicodemos has quit IRC21:27
jogohttps://github.com/openstack/nova/commit/f7b1af9e13df728d086047f6763bd98cb2cad1b221:27
morganfainbergoh this the ec2 signature versions are wrong issue?21:28
mriedemyeah21:28
mriedemdoes keystone support ec2 v4 in icehouse?21:28
morganfainbergyay for incompatible changes :(21:28
morganfainbergmriedem, uh, might need a fix to do so21:28
jogomorganfainberg: TL;DR EC2 tests in icehouse are blocking us from moving away from installing tempest21:28
morganfainbergthere is some weirdness in the signature validator that something boto changed somewhere21:28
jogomorganfainberg: not asking keystone to backport21:28
morganfainbergcaused a mismatch21:28
jogomorganfainberg: I think we are moving to dropping the EC2 tests on icehouse21:29
morganfainbergjogo, ok then i support removing tests >.>21:29
jogomtreinish: is working on a patch I think21:29
morganfainbergjogo, i mean, if it warrants a backport i'm happy to consider21:29
morganfainbergjogo, just saying i know there was some issue around this at oine point21:29
* jogo hopes mtreinish's skip EC2 on icehouse patch works21:30
mtreinishjogo: it'll be a project config patch probably looking at the d-g code21:31
mriedemthe actual ec2 sig stuff happens in keystonemiddleware21:32
mtreinishso we won't test it upfront21:32
mriedemor keystoneclinet rather21:32
morganfainbergthat makes fixing in icehouse painful21:32
morganfainbergreally painful21:32
dhellmannmtreinish: if you do it in project-config, won't you have to touch a bunch of jobs separately?21:32
morganfainbergit could be/is new requirements21:32
mriedemwell, python-keystoneclient>=0.7.0,<0.1221:32
* dhellmann is still sorting out how these tempest jobs work21:33
cdentgood luck everyone21:33
* cdent waves21:33
*** cdent has quit IRC21:33
mtreinishdhellmann: the job definitions just need a env variable to set a custom testr regex when running with icehouse21:33
mriedemmorganfainberg: keystone on icehouse requires keystoneclient < 0.12 which has the v4 auth support https://github.com/openstack/python-keystoneclient/blob/0.11.2/keystoneclient/contrib/ec2/utils.py#L4021:34
mriedemso i don't think keystone would be an issue21:34
mriedemwe'd just have to backport the nova changes21:34
mtreinishdhellmann: the other way to do it is add a condition in d-g if the branch is icehouse and set that regex21:34
mriedemboto is also capped on stable/juno so we'd have to backport the nova ec2 changes to juno and then icehouse21:34
dhellmannmtreinish: yeah, my point was that doing it in d-g would be one localized change, but I guess doing it in p-c means it's tied to the job definition more closely, even if we have to change more than one job definition21:35
mtreinishdhellmann: the 2nd way is probably less LOC but seemed weird because we already have the mechanism to set custom regexes in place21:35
dhellmannyeah21:35
mriedemhow is it already almost 421:37
*** ChuckC has quit IRC21:38
dhellmannmtreinish: so something like DEVSTACK_GATE_TEMPEST_REGEX='(?!ec2)' maybe?21:38
*** ChuckC has joined #openstack-qa21:39
mtreinishdhellmann: well I was going to use: '(?!.*\[.*\bslow\b.*\])(^tempest\.(api|scenario|cli))'21:40
mtreinishwhich is the full job's regex without the thirdparty tests21:40
dhellmannwhere is that?21:40
mtreinishdhellmann: it's in tempest's tox.ini file21:40
*** afazekas has joined #openstack-qa21:41
dhellmannah21:41
dhellmannand thirdparty is ec2 in this case?21:41
mriedemyeah21:41
mriedemit's the only thing under thirdparty in tempest21:41
mriedemboto21:41
mriedemhttp://git.openstack.org/cgit/openstack/tempest/tree/tempest/thirdparty21:42
dhellmannk21:42
*** ChuckC_ has joined #openstack-qa21:42
dhellmannlooking at how devstack-vm-gate.sh calls tox with the regex, I'm not sure I see how that works. It looks like it passes 2 args, but pretty_tox.sh only consumes the first one21:44
mtreinishdhellmann: the all job on tempest's tox.ini doesn't have a regex set21:45
mtreinishso when d-g passes it to tox, tox will pass it to pretty_tox which will pass it to testr21:45
*** ChuckC has quit IRC21:46
dhellmannmtreinish: devstack-vm-gate.sh passes 2 arguments to tox, though21:46
dhellmannat least on line 57321:46
dhellmannhttp://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n57321:46
mtreinishyeah the concurency option21:46
mtreinishto set it only use as many testr worker procs as d-g specified21:47
dhellmannah, tox.ini has it quoted, I missed that21:47
dhellmannhttp://git.openstack.org/cgit/openstack/tempest/tree/tox.ini#n4021:47
dhellmannok, sorry for the noise :-)21:47
mtreinishdhellmann: no worries, you might have found a bug. It's been a while since I've touched this code path21:48
mtreinishjogo: do you have a sample icehouse review link? I'm trying to figure out which jobs to modify?21:48
jogomtreinish: https://review.openstack.org/#/c/154217/121:50
mriedemlooks like just -full jobs21:51
mtreinishyeah just postgres-full and full21:52
mtreinishneutron back then was just smoke21:52
mtreinishwhich doesn't include the thirdparty tests21:52
mtreinishjogo, mriedem, dhellmann: https://review.openstack.org/#/c/154251/121:53
*** afazekas has quit IRC21:53
mriedemmtreinish: throw bug 1419913 in the commit message for tracking21:54
openstackbug 1419913 in grenade "Grenade fails with ContextualVersionConflict between oslo.config and tempest-lib on juno side" [Undecided,Confirmed] https://launchpad.net/bugs/141991321:54
*** sergsh has quit IRC21:54
*** achanda has joined #openstack-qa21:54
mtreinishmriedem: done21:55
sdaguemtreinish: https://review.openstack.org/#/c/154251/1 why not just do the venv installation in devstack stable/icehouse?21:57
mtreinishsdague: you can look at the backtrace21:57
mtreinishbut that's actually what that patch fixes21:57
mtreinishbecause if we do that tempest get's latest boto21:57
*** itzikb has quit IRC21:58
mtreinishwhich will fail against stable icehouse's version of boto21:58
sdagueah, right21:58
mriedemmtreinish: questions in there on the jobs you picked to change21:58
dhellmannthis was less ugly than having tempest look at nova's version to figure out which version of boto to install for itself and quicker than backporting the fixes to nova21:58
jogodhellmann: ++21:59
sdagueor to disable it in devstack?21:59
sdaguelike completely drop the ec2 api in icehouse because it's actually not testable any more22:00
sdaguein the devstack config22:00
*** dmellado has joined #openstack-qa22:00
dhellmannthat's another option. would tempest figure out not to run the tests automatically if we did that?22:00
sdaguethat's a question I don't quite know22:00
mriedemlooking22:00
mtreinishdhellmann: that's what I was just checking22:01
mtreinishI think the answer is no, but that's fixable22:01
sdaguemtreinish: we could just delete the boto config section, right?22:01
mtreinishsdague: I just looked at the code I think it raises an exception if we do that22:02
mtreinishhttp://git.openstack.org/cgit/openstack/tempest/tree/tempest/thirdparty/boto/test.py#n7022:02
* mtreinish facepalms22:03
mriedemshould have a feature enabled thing in tempest for not running boto tests22:03
mriedembut i guess you just wouldn't run thirdparty22:03
mtreinishyeah or a service_available flag22:03
mriedemthat's what we do internally22:03
mriedemright, something like that22:03
dhellmannyeah, and if these tests are moving out to the stand-alone ec2 repo I wouldn't spend time adding a special flag22:03
*** afazekas has joined #openstack-qa22:04
sdaguehttps://review.openstack.org/15425222:05
sdaguehow about that?22:05
mtreinishactually relooking at that code it'll do the right thing, it's just a rats nest of nested try excepts22:05
mtreinishsdague: that should work, let's see if can get through check22:06
sdaguemtreinish: yep22:06
*** oomichi has joined #openstack-qa22:06
*** afazekas has quit IRC22:09
openstackgerritMatt Riedemann proposed openstack/tempest: Fix typos in boto decision_maker()  https://review.openstack.org/15425322:09
mriedemsdague: btw, https://etherpad.openstack.org/p/wedged-stable-gate-feb-201522:10
mriedemit's a mess, as most good etherpads are22:10
*** abhirc has joined #openstack-qa22:15
*** afazekas has joined #openstack-qa22:15
*** Yogi1 has quit IRC22:15
*** dmellado has quit IRC22:20
jogomriedem: looks like we have baby steps forward so that is good22:22
*** afazekas has quit IRC22:23
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368122:23
*** dustins has quit IRC22:23
dhellmannjogo, mriedem, mtreinish: so are we waiting for sdague's patch to merge before we take the next step?22:25
jogodhellmann: yeah22:25
jogodhellmann: but there are patches that can still be reviewed22:25
*** vigneshvar has quit IRC22:25
jogolet me cleanup the etherpad to say  that22:26
dhellmannjogo: yeah, do -- I'm going to sign off soon but i can look at a patch or two first22:26
sdaguejogo: same, it's about to be family time here22:26
*** Ananci has quit IRC22:29
*** scottda has left #openstack-qa22:29
sdaguejogo: I rebased https://review.openstack.org/#/c/154217/ on my devstack patch, so it should be able to get good test results (hopefully)22:32
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for ironic bug 1418833  https://review.openstack.org/15427222:33
openstackbug 1418833 in Ironic "check-tempest-dsvm-ironic-agent_ssh fails due to ConfigDriveWriteError" [Critical,Fix committed] https://launchpad.net/bugs/1418833 - Assigned to Jay Faulkner (jason-oldos)22:33
jogosdague https://review.openstack.org/#/c/154216/22:34
jogosdague: that is failing in boto as well22:34
jogoohh because its icehouse devstack on old22:35
sdaguewell... full fails as well22:35
sdaguebecause no one merged this fast enough - https://review.openstack.org/#/c/151037/22:35
jogosdague: ugg22:36
sdagueapparently you can't turn of ec2 tests - https://jenkins04.openstack.org/job/check-tempest-dsvm-full/28091/console22:40
mriedemyeah https://review.openstack.org/#/c/154252/122:40
sdagueok, well that's my night folks22:41
mtreinishsdague: I'll push a flag to make that will just bypass that crazy decision_maker() function22:42
mriedemit looks like if you goofed with the auth values in tempest.conf for boto it will set these values and skip the tests22:42
mriedemhttp://git.openstack.org/cgit/openstack/tempest/tree/tempest/thirdparty/boto/test.py#n6922:42
mtreinishand update your patch to use that instead22:42
mriedemwe could also backport the nova changes...22:42
mriedembut that's whack a mole22:43
dhellmannI'm comfortable with us saying we're not testing the ec2 API in icehouse any more22:43
mriedem...22:43
dhellmannif someone wants to do the work to backport the fix and support it, I would be OK with that happening later, after we're up and running elsewhere again22:44
mriedemwhat if we backport a security fix to icehouse in the ec2 code?22:44
mriedemyeah, we could disable, backport actual fixes, then enable again22:44
dhellmannmriedem: we need to differentiate between what we're going to do today to unblock everyone and what we want the long-term thing to be22:44
dhellmannright22:44
mriedemso mtreinish will push a tempest patch to add a boto entry to service_available in tempest.conf, then skip the boto tests if that's True,22:45
mriedemthen we set devstack on stable/icehouse to set that to True22:45
*** dmorita has quit IRC22:45
dhellmannthat sounds about right22:46
dhellmannjogo is writing other things in the etherpad22:46
mriedemi also have to head out for $family22:46
*** dmorita has joined #openstack-qa22:46
mriedemwill eavesdrop later22:46
jogostill working out the order of things to not break it further22:47
dhellmannI wonder why no tests were run for https://review.openstack.org/#/c/154251/222:48
*** toure_ has joined #openstack-qa22:49
dhellmannI need to drop off, too. I'll check the etherpad for reviews to do in the morning22:49
*** mriedem has quit IRC22:51
*** rfolco has quit IRC22:51
openstackgerritMatthew Treinish proposed openstack/tempest: Add compute feature enabled flag for the ec2 api  https://review.openstack.org/15427922:52
jogook I think the order should work22:52
mtreinishmriedem, jogo, sdague: ^^^22:52
*** dmellado has joined #openstack-qa22:52
jogomtreinish: can you review the steps I wrote down22:53
jogomtreinish: as I want to make sure I didn't miss anything22:53
*** e0ne has quit IRC22:53
sdaguemtreinish: +A, though... is that mergable in current state of world?22:53
jogoif I did, its very possible I break trunk22:53
jogosdague: ^22:53
jogoone step is to break stable/juno grenade further22:54
mtreinishsdague: it should be, the thing which is broken is running javelin on juno grenade22:54
sdagueok22:54
mtreinisheverything else is protected because of the tox venv22:54
sdagueanyway, I really really need to leave computer now, if there is stuff for me to approve in the morning, let me know22:55
*** Longgeek has joined #openstack-qa22:55
jogosdague: see the etherpad, it should have all the patches and order needed22:55
mtreinishjogo: sure I'll take a look now22:55
openstackgerritAndrea Frittoli  proposed openstack/tempest: Split creds and resources in tenant isolation  https://review.openstack.org/15389622:55
*** dmellado has quit IRC22:56
*** dmellado_ has joined #openstack-qa22:56
*** dmellado_ is now known as dmellado22:57
jogoall together it should be only 5 or 6 patches lol22:57
jogobut hopefully no ninja patches and it shouldn't break master at all22:59
mtreinishjogo: can you hit the rebase button on your don't install tempest in stable/juno23:01
mtreinishI'll +A it after23:01
*** toure_ has quit IRC23:01
jogomtreinish: which one?23:02
jogolink23:02
mtreinishjogo: https://review.openstack.org/#/c/154217/23:02
*** andreykurilin_ has joined #openstack-qa23:03
jogoit needs another reabse? Sean rebased it already23:03
jogoahh I see23:03
mtreinishjogo: I just pushed a rev for Sean's patch to use the flag I added23:03
mtreinishjogo: that order on the etherpad looks right to me23:05
*** jamielennox|away is now known as jamielennox23:05
jogomtreinish: thanks for sanity checking, here is the rebase https://review.openstack.org/#/c/154217/23:08
* jogo goes AFK to find food23:09
*** enikanorov_ has quit IRC23:09
*** diegows has joined #openstack-qa23:10
*** toure_ has joined #openstack-qa23:10
openstackgerritJohn Villalovos proposed openstack-dev/devstack: Use 'https' protocol by default as easier for proxies  https://review.openstack.org/15339723:10
*** Longgeek has quit IRC23:12
openstackgerritMerged openstack-dev/devstack: Stop installing tempest  https://review.openstack.org/15308023:15
*** jlibosva has joined #openstack-qa23:15
*** jlibosva has quit IRC23:20
*** EmilienM is now known as EmilienM|afk23:28
*** bknudson has quit IRC23:31
*** jgrimm is now known as zz_jgrimm23:35
*** dmellado has quit IRC23:36
*** toure_ has quit IRC23:37
andreafmtreinish: is there a way to mark a compute extension in tempest as disabled without having to provide a list of all the enabled ones?23:38
*** dmellado has joined #openstack-qa23:38
mtreinishandreaf: there's just the list opt23:38
mtreinishthere are reasons it's that way23:40
andreafmtreinish: I guess something related to stable branches23:40
andreafmtreinish: so it means that implementing and exclusion list on top is not an option?23:41
mtreinishactually no, it's more with what happens if you add an extension on master23:41
mtreinishI'd have to dig up all the old discussions to outline all of the edge cases23:42
mtreinishandreaf: devstack actually supports that, but we will not use that on the gate23:42
*** mriedem has joined #openstack-qa23:43
mtreinishbecause it relies on the api to get the list of all the extensions23:43
*** tochi has joined #openstack-qa23:43
*** mriedem has quit IRC23:44
andreafmtreinish: if we had an excluded extensions in tempest that would not require using the API23:44
mtreinishandreaf: it's really only either or, the overlap between an include and exclusion list is why we don't do that23:45
*** mriedem has joined #openstack-qa23:46
mtreinishandreaf: https://review.openstack.org/#/c/116121/23:47
andreafmtreinish: uhm, right... ok I'll have to stop being lazy and produce my list of extensions :P23:47
mtreinishandreaf: heh, you can use verify_tempest_config for that if the list is constant23:48
*** andreykurilin_ has quit IRC23:51
mriedemmtreinish: so once https://review.openstack.org/#/c/154279/ is merged you're going to update https://review.openstack.org/#/c/154251 right?23:51
*** dimtruck is now known as zz_dimtruck23:53
*** dimsum__ has quit IRC23:54
*** dimsum__ has joined #openstack-qa23:55
openstackgerritMaru Newby proposed openstack-infra/devstack-gate: Use sudo to move hook script logs  https://review.openstack.org/15429223:55
marunmtreinish: I'm seeing an issue wiht the refactored testr artifact processing...  subunit and testr are not installed by the neutron functional job.23:57
marunmtreinish: any thoughts as to how I should best rectify?23:57
marunmtreinish: Should I manually install it in the environment in our hook script?23:57
*** dimsum__ is now known as dims23:57
marunmtreinish: That's the easy way out, but I'm wondering if a generally usable solution wouldn't be preferable.23:58
*** dims is now known as Guest7024723:58
*** Guest70247 has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!