Monday, 2014-11-17

lifelesssdague: you have seen that testtools 1.3.0 has fixed it all, right ?00:01
lifelesssdague: (wondering why you're rechecking etc etc)00:01
*** yamamoto has quit IRC00:01
*** yamamoto has joined #openstack-qa00:02
lifelesssdague: [there is still an issue for trove specifically, because 2.6 is now running setUpClass and their code upcalls, which I'll have fixed shortly)00:02
lifelesssdague: see https://review.openstack.org/#/c/134730/00:03
*** yamamoto has quit IRC00:04
openstackgerritIan Wienand proposed openstack-dev/devstack: Remove nose things  https://review.openstack.org/13473300:13
*** dmorita has joined #openstack-qa00:29
*** yamamoto has joined #openstack-qa00:31
*** dims has quit IRC00:32
*** dims has joined #openstack-qa00:32
*** dgonzalez has joined #openstack-qa00:33
openstackrecheckopenstack/heat change: https://review.openstack.org/129391 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/139286000:37
*** dgonzalez has quit IRC00:41
*** markmcclain has quit IRC00:42
*** markmcclain has joined #openstack-qa00:43
*** mkollaro has quit IRC00:45
*** topshare has joined #openstack-qa00:54
*** nosnos has joined #openstack-qa01:01
*** weshay has quit IRC01:03
*** Yogi has joined #openstack-qa01:07
*** X019 has joined #openstack-qa01:19
*** achanda has quit IRC01:39
*** wuhg has joined #openstack-qa01:40
*** achanda has joined #openstack-qa01:43
*** yamahata has joined #openstack-qa01:46
*** yamahata has quit IRC01:52
*** yamahata has joined #openstack-qa01:53
*** achanda has quit IRC02:13
openstackgerritMasayuki Igawa proposed openstack-dev/grenade: Remove commented out codes and files related to upgrade-packages  https://review.openstack.org/12829902:16
*** adalbas has quit IRC02:17
*** dims has quit IRC02:18
*** dims has joined #openstack-qa02:19
*** dims has quit IRC02:25
*** dims has joined #openstack-qa02:25
*** oomichi has joined #openstack-qa02:28
*** pcrews has quit IRC02:31
*** X019 has quit IRC02:32
*** X019 has joined #openstack-qa02:44
*** zz_dimtruck is now known as dimtruck02:46
openstackgerritMerged openstack/tempest: Decouple resources and preconditions in secgroup scenario  https://review.openstack.org/12954202:46
*** jyuso has joined #openstack-qa02:52
*** salv-orlando has quit IRC03:00
*** Yogi has quit IRC03:09
*** achanda has joined #openstack-qa03:14
*** amotoki has joined #openstack-qa03:18
*** achanda has quit IRC03:19
*** dims_ has joined #openstack-qa03:20
*** dims has quit IRC03:23
*** Longgeek has joined #openstack-qa03:28
*** dims_ has quit IRC03:29
*** dims has joined #openstack-qa03:29
*** Longgeek has quit IRC03:33
*** yamamoto has quit IRC03:37
*** markmcclain has quit IRC03:43
*** markmcclain has joined #openstack-qa03:44
*** nosnos has quit IRC03:49
*** ramishra has joined #openstack-qa03:51
openstackgerritKen'ichi Ohmichi proposed openstack-dev/devstack: Add TEMPEST_ENABLE_NOVA_XML_API option  https://review.openstack.org/13485104:06
openstackgerritKen'ichi Ohmichi proposed openstack-dev/devstack: Add TEMPEST_ENABLE_NOVA_XML_API option  https://review.openstack.org/13485104:07
*** cmyster has quit IRC04:19
openstackgerritKen'ichi Ohmichi proposed openstack-infra/devstack-gate: WIP: Specify Nova XML API tests clearly for juno/icehouse  https://review.openstack.org/13485204:22
*** rushiagr_away is now known as rushiagr04:22
*** cmyster has joined #openstack-qa04:23
*** wuhg has quit IRC04:23
*** vigneshvar has joined #openstack-qa04:25
*** wuhg has joined #openstack-qa04:26
openstackgerritKen'ichi Ohmichi proposed openstack/tempest: Disable Nova API XML tests as the default  https://review.openstack.org/12681504:28
*** vigneshvar has quit IRC04:31
*** yamahata_ has quit IRC04:38
*** yamahata_ has joined #openstack-qa04:39
*** yamahata_ has quit IRC04:40
*** isq has joined #openstack-qa04:40
*** Longgeek has joined #openstack-qa04:44
*** nosnos has joined #openstack-qa04:46
*** vigneshvar has joined #openstack-qa04:46
*** mmedvede has quit IRC04:48
*** Longgeek has quit IRC04:48
*** mmedvede has joined #openstack-qa04:49
*** vponomaryov has quit IRC04:50
*** vponomaryov has joined #openstack-qa04:51
*** achanda has joined #openstack-qa04:53
*** oomichi has quit IRC05:11
*** pcrews has joined #openstack-qa05:17
*** chandankumar has joined #openstack-qa05:20
*** dimtruck is now known as zz_dimtruck05:21
openstackrecheckConsole logs not available after 13:29s for gate-nova-python27 123309,6,f5738bf05:22
openstackrecheckopenstack/nova change: https://review.openstack.org/133165 failed gate-grenade-dsvm in the gate queue with an unrecognized error05:22
*** bkopilov has quit IRC05:27
*** jamielennox is now known as jamielennox|away05:34
*** neeti has joined #openstack-qa05:35
*** Longgeek has joined #openstack-qa05:37
*** jamielennox|away is now known as jamielennox05:41
*** ashishg has joined #openstack-qa05:41
*** zz_dimtruck is now known as dimtruck05:42
ashishgPlease review https://review.openstack.org/#/c/109529/05:42
*** bkopilov has joined #openstack-qa05:50
*** nosnos_ has joined #openstack-qa05:50
*** nosnos has quit IRC05:51
*** dimtruck is now known as zz_dimtruck05:54
*** yfried has quit IRC05:54
*** pcrews has quit IRC05:54
*** nosnos_ has quit IRC05:57
*** abehl has joined #openstack-qa05:58
*** nosnos has joined #openstack-qa05:59
*** mdbooth has quit IRC05:59
openstackgerritEli Qiao proposed openstack/tempest: Add Conflict exception in test_floating_ips_actions case  https://review.openstack.org/13136406:00
*** hogepodge has quit IRC06:01
openstackgerritchandan kumar proposed openstack/tempest: enable cinder v2 api for volumetype test  https://review.openstack.org/12621306:03
*** mdbooth has joined #openstack-qa06:04
*** Longgeek has quit IRC06:17
*** Longgeek has joined #openstack-qa06:18
*** Longgeek_ has joined #openstack-qa06:18
*** Longgeek has quit IRC06:22
*** nosnos_ has joined #openstack-qa06:23
*** nosnos has quit IRC06:23
*** hogepodge has joined #openstack-qa06:24
openstackgerritlokesh s proposed openstack-dev/devstack: fixes cleaning up of ironic directory from /etc  https://review.openstack.org/13341306:26
openstackgerritchandan kumar proposed openstack/tempest: Enable cinder v2 api for volume hosts  https://review.openstack.org/13394706:28
*** ajo has joined #openstack-qa06:35
*** ajo has quit IRC06:36
*** ajo has joined #openstack-qa06:36
*** nmagnezi has joined #openstack-qa06:40
*** markmcclain has quit IRC06:45
*** markmcclain has joined #openstack-qa06:46
*** Longgeek_ has quit IRC06:56
*** Longgeek has joined #openstack-qa06:57
*** markmcclain has quit IRC07:01
*** achanda has quit IRC07:02
*** markmcclain has joined #openstack-qa07:08
*** yfried has joined #openstack-qa07:21
*** Longgeek has quit IRC07:27
*** Longgeek has joined #openstack-qa07:28
*** yfried is now known as yfried|afk07:35
*** yfried|afk is now known as yfried07:40
*** Longgeek_ has joined #openstack-qa07:41
*** tkammer has joined #openstack-qa07:42
*** safchain has joined #openstack-qa07:44
*** Longgeek has quit IRC07:45
*** ramishra has quit IRC07:46
*** e0ne has joined #openstack-qa07:47
*** e0ne has quit IRC07:50
*** dgonzalez has joined #openstack-qa07:50
yfriedmasayukig: that's a doc change that could use a +A https://review.openstack.org/#/c/133471/07:51
openstackgerritCyril Roelandt proposed openstack/tempest: Respect auth.allow_tenant_isolation  https://review.openstack.org/13425907:54
*** cmyster has left #openstack-qa07:55
*** sridhar has joined #openstack-qa08:02
*** ajo has quit IRC08:03
*** avico has joined #openstack-qa08:05
*** tkammer has quit IRC08:05
*** SridharG has joined #openstack-qa08:11
*** dgonzalez has quit IRC08:14
*** yamahata has quit IRC08:20
*** markus_z has joined #openstack-qa08:21
*** ajo has joined #openstack-qa08:23
openstackgerritSergey Shnaidman proposed openstack/tempest: Add .idea to .gitignore  https://review.openstack.org/13487408:26
*** dgonzalez has joined #openstack-qa08:26
*** salv-orlando has joined #openstack-qa08:29
openstackgerritSergey Shnaidman proposed openstack/tempest-lib: Add .idea to .gitignore  https://review.openstack.org/13487508:29
*** dgonzalez has quit IRC08:32
*** jordanP has joined #openstack-qa08:33
*** jordanP has quit IRC08:33
*** jordanP has joined #openstack-qa08:33
*** luqas has joined #openstack-qa08:34
*** tkammer has joined #openstack-qa08:37
*** jlanoux has joined #openstack-qa08:46
openstackgerritJordan Pittier proposed openstack/tempest: Make every swift clients use expected_success  https://review.openstack.org/13455508:48
*** jpich has joined #openstack-qa08:52
kashyapianw, Hi, when you get a moment, this is with current DevStack git: http://paste.openstack.org/show/134035/08:54
kashyapIt's a kind of yum failure, as PIPESTATUS returned 1, instead of 0.08:55
kashyapLooking at devstack/functions-common, not sure what exactly is yum missing there - from the stack trace. I wonder if you have any clues.08:56
*** tkammer has quit IRC09:06
jpichkashyap: Hey! I had a similar issue with the python-ecdsa package recently, I *think* it's because devstack went from installing it from pip to installing it as a package, so when recycling a devstack VM it causes trouble09:07
kashyapjpich, Morning,09:08
jpichremoving the version that's already installed then installing the package should resolve it, and after that devstack should run ok09:08
kashyapjpich, I see, good to know. Thanks for the info, I'm checking what's installed on it from a different guest console.09:09
kashyapjpich, I don't have an installed version of python-ecdsa. I just did something crude: remove all the pip directories from /usr/lib/python2.7/site-packages and re-issued a new DevStack run on my F21.09:11
jpichkashyap: Ok! For a quicker check you can also try installing the package manually rather than re-run devstack09:12
*** DaSchab has joined #openstack-qa09:14
kashyapjpich, Yup, noted. I need this install anyhow :-)09:14
jpichkashyap: Good luck! :-)09:14
*** tkammer has joined #openstack-qa09:21
kashyapjpich, Yes, successful DevStack on my re-run. And, you're right - seems like no python-ecdsa RPM package, and no trace of it in my devstack log either.09:23
kashyapianw, Please disregard me.09:23
*** DaSchab has quit IRC09:23
jpichkashyap: Glad it worked :)09:24
*** ashishg has quit IRC09:25
*** mpaolino has joined #openstack-qa09:26
*** e0ne has joined #openstack-qa09:31
*** ramishra_ has joined #openstack-qa09:31
*** zz_johnthetubagu is now known as johnthetubaguy09:40
*** ramishra_ has joined #openstack-qa09:41
openstackgerrityolanda.robla proposed openstack-infra/devstack-gate: Add option for is_debian to support it  https://review.openstack.org/13076809:41
*** flaper87 has quit IRC09:43
*** flaper87 has joined #openstack-qa09:43
*** markmcclain has quit IRC09:46
*** markmcclain has joined #openstack-qa09:47
*** dkusidlo has joined #openstack-qa09:48
*** DaSchab has joined #openstack-qa09:49
*** yfried is now known as yfried|afk09:52
*** DaSchab has quit IRC09:58
*** DaSchab has joined #openstack-qa09:58
*** DaSchab has quit IRC10:00
openstackgerritchandan kumar proposed openstack/tempest: Enable cinder v2 api tests in volume quotas  https://review.openstack.org/13488910:00
*** yfried|afk is now known as yfried10:01
*** yamahata has joined #openstack-qa10:02
*** achanda has joined #openstack-qa10:06
*** achanda has quit IRC10:10
*** dkusidlo has quit IRC10:11
*** tkammer has quit IRC10:11
*** yfried is now known as yfried|afk10:12
*** dkusidlo has joined #openstack-qa10:15
*** dkusidlo has quit IRC10:15
*** DaSchab has joined #openstack-qa10:16
*** yfried|afk is now known as yfried10:18
*** tkammer has joined #openstack-qa10:25
*** yfried is now known as yfried|afk10:28
openstackgerritNikolay Fedotov proposed openstack/tempest: Scenario tests for FWaaS  https://review.openstack.org/13489610:28
*** yfried|afk is now known as yfried10:30
*** gfidente has joined #openstack-qa10:33
openstackgerritNikolay Fedotov proposed openstack/tempest: Scenario tests for FWaaS  https://review.openstack.org/13489610:34
*** topshare has quit IRC10:34
*** yfried has quit IRC10:39
*** tkammer has quit IRC10:39
*** yfried has joined #openstack-qa10:39
*** abehl has quit IRC10:42
sdaguelifeless: so the fact that 1.3.0 fixes things is good. It still doesn't make 1.2 a working version. So this will just block out that one version.10:44
*** aysyd has joined #openstack-qa10:49
*** yfried is now known as yfried|afk10:50
*** yfried|afk is now known as yfried10:51
*** tkammer has joined #openstack-qa10:54
*** dgonzalez has joined #openstack-qa10:54
*** abehl has joined #openstack-qa10:56
*** chandankumar has quit IRC10:56
*** mkollaro has joined #openstack-qa10:57
*** abehl has quit IRC10:58
*** abehl has joined #openstack-qa10:58
*** adalbas has joined #openstack-qa11:01
jordanPyfried, hi. About https://review.openstack.org/#/c/134615/1/tempest/scenario/test_shelve_instance.py to you suggest to change the definition of get_remote_client in manager.py ?11:03
yfriedjordanP: I'll talk to you in a few minutes ok?11:05
jordanPyfried, sure11:06
*** DaSchab has quit IRC11:06
*** chandankumar has joined #openstack-qa11:08
*** DaSchab has joined #openstack-qa11:12
openstackrecheckopenstack/heat change: https://review.openstack.org/129391 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756011:15
*** amotoki has quit IRC11:19
*** cdent has joined #openstack-qa11:19
*** dgonzalez has quit IRC11:22
*** dgonzalez has joined #openstack-qa11:23
*** rfolco has joined #openstack-qa11:23
*** dgonzale_ has joined #openstack-qa11:27
*** dgonzalez has quit IRC11:28
*** yamahata has quit IRC11:30
openstackgerritJoseph Lanoux proposed openstack/tempest: Add MultiNic test  https://review.openstack.org/13490811:30
*** vigneshvar has quit IRC11:30
*** yamahata has joined #openstack-qa11:31
*** dgonzale_ has quit IRC11:34
*** dgonzalez has joined #openstack-qa11:35
*** rfolco has quit IRC11:36
*** tkammer has quit IRC11:38
*** yamahata has quit IRC11:39
*** dgonzalez has quit IRC11:39
*** yfried_ has joined #openstack-qa11:44
yfried_jordanP: I'm back11:44
*** yfried has quit IRC11:44
yfried_jordanP: I'm backjordanP: re get_remote_client - your code seems reasonable enough to be used every time the method is called11:44
yfried_jordanP: so either this is already the case by some hidden stuff, or this should be implemented in the manager for all to use11:44
jordanPyfried_, i borrowed this code from tempest/scenario/test_snapshot_pattern.py11:45
jordanPi remember there was a lot of failure with test_snapshot_pattern.py and that the try/catch were added to adresse these failures11:46
jordanPnot address but help debug11:46
yfried_jordanP: so move it from there to manager. Unless you can think of a reason not to test that?11:46
jordanPI can think of no reason... so I will do it in a dedicated patch11:47
*** openstackgerrit has quit IRC11:48
*** openstackgerrit has joined #openstack-qa11:49
*** dims has quit IRC11:50
*** tkammer has joined #openstack-qa11:50
*** dims has joined #openstack-qa11:50
jordanPyfried_, I don't agree with your comment "Please consider adding this as another test case in test_network_advanced_server_ops" so I am pushing a new patchset as is, I am waiting for other review11:51
*** DaSchab has quit IRC11:52
yfried_jordanP: could you please explain why you don't agree?11:53
*** DaSchab has joined #openstack-qa11:53
*** dgonzalez has joined #openstack-qa11:53
*** dgonzalez has quit IRC11:53
jordanPyfried_,  well the shelve/unshelve feature is not related to network11:53
*** dgonzalez has joined #openstack-qa11:53
yfried_jordanP: yes, but your test seems to do the same thing - modify machine and check connectivity, adding only the timestamp test11:54
*** dgonzalez has quit IRC11:54
*** DaSchab has quit IRC11:55
*** dgonzalez has joined #openstack-qa11:55
jordanPyfried_, I know but same as ./test_stamp_pattern.py and ./test_volume_boot_pattern.py11:56
yfried_jordanP: we need to refactor the scenario tree to solve this kind of issue11:57
yfried_jordanP: you should be able to share this code even though these tests are unrelated11:57
jordanPI will support you on that :) but it will take time and in the mean time i'd like to move forward with this...11:58
yfried_jordanP: I agree. just venting...11:58
*** dgonzalez has quit IRC11:59
*** yamahata has joined #openstack-qa12:02
*** markus_z has quit IRC12:04
openstackgerritJordan Pittier proposed openstack/tempest: Scenario manager: catch Exception in get_remote_client  https://review.openstack.org/13491412:09
*** rfolco has joined #openstack-qa12:10
openstackgerritSean Dague proposed openstack-dev/devstack: add LIBS_FROM_GIT to docs  https://review.openstack.org/13491512:11
*** mpaolino has quit IRC12:17
openstackgerritJordan Pittier proposed openstack/tempest: Add a shelve/unshelve scenario  https://review.openstack.org/13461512:17
*** jaypipes has joined #openstack-qa12:18
*** ChanServ sets mode: +o jaypipes12:18
*** dgonzalez has joined #openstack-qa12:19
*** markus_z has joined #openstack-qa12:19
*** dgonzalez has quit IRC12:23
*** rfolco has quit IRC12:23
*** jyuso has quit IRC12:28
*** Yogi has joined #openstack-qa12:28
*** dmorita has quit IRC12:29
yfried_jordanP: I'm still concerned about the network issue12:34
yfried_jordanP: seems like you are using the default network_resources provided by isolated_creds. are you intending to do so?12:34
*** nosnos_ has quit IRC12:39
*** markmcclain has quit IRC12:47
*** DaSchab has joined #openstack-qa12:48
*** markmcclain has joined #openstack-qa12:48
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492412:50
jordanPyfried_, i don't understand, "I'm still concerned about the network issue" ?12:59
jordanPthe code is similar to test_stamp_pattern.py13:00
*** yfried_ is now known as yfried|afk13:03
*** yfried|afk is now known as yfried_13:04
yfried_jordanP: I'm unfamiliar with that test13:04
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: Switch to enable/disable Nova V2 XML Support  https://review.openstack.org/13471413:05
jordanPyfried_, me too :)13:05
yfried_jordanP: did you test it on neutron or nova-network?13:05
jordanPneutron13:05
*** DaSchab has quit IRC13:05
yfried_jordanP: and it used the tenant network created by isolated_creds?13:05
yfried_mtreinish: ping13:06
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: Switch off Nova V2 XML Support  https://review.openstack.org/13468513:06
*** DaSchab has joined #openstack-qa13:07
jordanPyfried_, I dont know..13:08
*** Yogi has quit IRC13:08
openstackrecheckopenstack/nova change: https://review.openstack.org/134751 failed because of: gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/139286013:10
*** dgonzalez has joined #openstack-qa13:11
*** mpaolino has joined #openstack-qa13:12
*** rushiagr is now known as rushiagr_away13:12
*** dgonzalez has quit IRC13:12
sdaguedtroyer: once you get up, some template hacking in shocco I think is required13:14
openstackgerritSean Dague proposed openstack-dev/devstack: add LIBS_FROM_GIT to docs  https://review.openstack.org/13491513:15
*** yfried_ is now known as yfried|afk13:16
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: Switch off Nova V2 XML Support  https://review.openstack.org/13468513:16
*** dkranz has joined #openstack-qa13:26
*** markus_z has quit IRC13:26
*** tristanC_ is now known as tristanC13:27
openstackgerritJohn Davidge proposed openstack-dev/devstack: Add IPv6 support for tenant data network  https://review.openstack.org/8798713:35
openstackgerritJoseph Lanoux proposed openstack/tempest: Add MultiNic test  https://review.openstack.org/13490813:35
*** yfried|afk is now known as yfried_13:37
*** Yogi has joined #openstack-qa13:38
*** markus_z has joined #openstack-qa13:39
*** k4n0_ has quit IRC13:39
*** Yogi has quit IRC13:44
*** DaSchab has quit IRC13:44
mtreinishyfried_: pong13:48
*** yfried_ is now known as yfried|afk13:48
*** dims has quit IRC13:52
*** dims has joined #openstack-qa13:53
*** dkranz has quit IRC13:55
*** abehl has quit IRC13:56
*** dkranz has joined #openstack-qa14:00
*** neeti has quit IRC14:02
openstackrecheckopenstack/sahara change: https://review.openstack.org/134336 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756014:02
sdagueso heat jobs are failing a lot again14:05
*** dgonzalez has joined #openstack-qa14:06
*** dustins has joined #openstack-qa14:07
*** cdent has quit IRC14:08
*** dgonzalez has quit IRC14:09
*** yfried|afk is now known as yfried_14:10
yfried_sdague: https://review.openstack.org/#/c/130411/ is still pending since your -114:10
*** krtaylor has joined #openstack-qa14:11
*** jgriffit1 is now known as jgriffith14:16
sdagueyfried_: ok, well I'm still -1, but for different reasons14:16
sdagueI did really want that squashed into the last commit as well, but it's too later for that14:17
*** jgriffith is now known as Guest1011714:17
*** Guest10117 is now known as jdg14:18
*** Yogi has joined #openstack-qa14:20
*** zz_dimtruck is now known as dimtruck14:20
*** jdg is now known as jgriffith14:20
*** Yogi has quit IRC14:21
*** Yogi has joined #openstack-qa14:21
yfried_sdague: tnx14:22
*** vigneshvar has joined #openstack-qa14:23
*** toure has joined #openstack-qa14:26
yfried_does anyone know why we have both "image_ssh_user" and "ssh_user" in tempest.conf?14:26
*** toure_ has joined #openstack-qa14:32
*** mriedem has joined #openstack-qa14:34
*** toure has quit IRC14:35
openstackrecheckopenstack/horizon change: https://review.openstack.org/134561 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error14:36
*** DaSchab has joined #openstack-qa14:36
yfried_dkranz: ^14:38
*** toure has joined #openstack-qa14:38
dkranzyfried_: I am about to submit a fix to not use the compute one in the scenario manager.14:38
dkranzyfried_: I don't know why we have both14:39
openstackgerritDavid Kranz proposed openstack/tempest: Do not force use of [compute] image_ssh_user in scenario tests  https://review.openstack.org/13495214:39
yfried_dkranz: so wouldn't a better fix would be to remove one of them?14:39
dkranzyfried_: It is not clear that it is wrong to have both14:40
openstackgerritAshish Kumar Gupta proposed openstack/tempest: Floating IP Negative Tests  https://review.openstack.org/10952914:40
dkranzyfried_: but having the scenario manager use the one in compute is clearly wrong which is what I just proposed a fix for14:40
yfried_dkranz: so either we make it clear and update the docs, or we find out which is redundant and we remove it?14:41
*** toure_ has quit IRC14:41
dkranzyfried_: The problem is that they are clearly redundant in the gate because they are set to the same value. But that doesn't mean they are redundant more generally.14:42
*** cdent has joined #openstack-qa14:42
yfried_dkranz: I know. which is why I'm trying to figure this out14:42
dkranzyfried_: You are free to come up with a theory :)14:42
yfried_dkranz: who would know? mtreinish?14:42
dkranzyfried_: My guess is that this is very old.14:42
yfried_dkranz: obviously :)14:43
mtreinishdkranz: if you want to converge options you can deprecate one14:43
dkranzyfried_: however I could image wanting to run scenario tests with a real image and the compute tests with cirros14:43
*** dimtruck is now known as zz_dimtruck14:43
mtreinishlook at the auth section and how we handled tenant isolation14:43
*** rushiagr_away is now known as rushiagr14:44
yfried_dkranz: by default, scenarios boot the image from CONF.compute.image_ref, so it makes sense to use its ssh_user as well14:45
yfried_dkranz: what's up with CONF.input_scenario.ssh_user_regex?14:45
*** bknudson has joined #openstack-qa14:46
*** chandankumar has quit IRC14:47
dkranzyfried_: ok, so I abandoned the change14:47
sdaguemtreinish: so... heat is off the rails on tests again?14:47
yfried_dkranz: please don't. let's figure this out14:48
mtreinishsdague: I really dunno, I've been online for ~1hr14:50
mtreinishI wouldn't be surprised though14:50
sdagueso, top 3 recheck bugs14:50
sdague2 & 3 are heat14:50
dkranzyfried_: I just want to make sure this is correct. When we figure out I can resubmit.14:50
sdague1 is a console generated negative test14:50
sdaguewhich I thought mriedem was going to propose a skip for14:50
dkranzyfried_: It is clearly wrong that [scenario] specifies an ssh user but not an image14:51
mriedemsdague: except it's a generated test, so wasn't sure how to skip, w/o skipping the entire class14:51
mtreinishdkranz: IIRC the scenario section is mostly used for the scenario test which uses testscenarios14:52
dkranzmtreinish: That is certainly not "obvious" :)14:52
sdaguedkranz: can you weigh in a bit on GetConsoleOutputNegativeTestJSON and whether what it's doing here is valid14:52
*** weshay has joined #openstack-qa14:53
dkranzsdague: ok, I need to read back14:53
sdaguehttp://logs.openstack.org/96/134596/1/check/check-tempest-dsvm-neutron-full/01fbe23/console.html.gz14:53
sdaguethat's happening a bunch14:53
* dkranz looking14:53
sdaguebut it's auto generated negative testing14:53
sdaguewhich makes figuring out what it's doing, and if it's correctly failing, hard14:53
dkranzsdague: Did this start recently?14:53
sdagueyes14:53
dkranzsdague: ok, let me investigate14:54
sdaguehttp://status.openstack.org/elastic-recheck/#139286014:54
yfried_dkranz: Change-Id: Ia86f48772ac02d67faa1c7d764cb9dc0938f6452 by andreaf did something with regexes and scenario.utils but I'm not sure what's being done there14:54
mtreinishsdague: it sends a get console request with a body of {"os-getConsoleOutput": {"length": null}} and gets a response body of {"output": ""}14:55
mtreinishthat behavior seems off somehow14:55
mtreinishmriedem, dims: ^^^ weren't you playing with this stuff at some point?14:55
mriedemmtreinish: we added that when we hit timeouts or something14:56
dimsmriedem: mtreinish: vaguely recall :)14:56
dkranzsdague: looks real to me14:58
dkranzsdague: like the server is treating the 'null' length as if it were zero14:58
sdagueok, but is that actually considered wrong?14:58
dkranzsdague: according to the schema it is wrong14:59
sdaguewhose schema14:59
dkranzsdague: but that could be a bug in the schema14:59
*** Longgeek_ has quit IRC14:59
dkranz'json-schema': {'additionalProperties': False, 'type': 'object', 'properties': {'os-getConsoleOutput': {'type': 'object', 'properties': {'length': {'minimum': 0, 'type': ['integer', 'string']}}}}}, 'resources': [{'expected_result': 404, 'name': 'server'}], 'http-method': 'POST'}15:00
dkranzsdague: ^^^15:00
sdagueright, whose schema is that15:00
dkranzsdague: that is in tempest15:01
dkranzsdague: whether it is right or not, it changed in the past few days15:01
sdaguebecause in nova, this is totally allowed15:01
dkranzsdague: I believe it could be, but this test was presumably returning 404 until very recently15:01
sdagueso there aren't any recent changes in nova that I can see here15:02
sdaguethis code path goes back to 201215:02
mtreinishwell, shouldn't it be failing on every run if the tempest test is incorrect?15:03
mtreinishwhy does it only happen sometimes?15:03
sdagueit's auto generated, so that's the question15:03
yfried_dkranz: so server_basic_ops seems to be loading (image, flavor, user) dynamically from [input_scenario] section and use CONF.compute.(image_ref, flavor_ref, ssh_user) as defaults15:03
dkranzsdague: the autogen is deterministic though15:03
yfried_dkranz: seems like it would be reasonable to use the same in all scenarios?15:04
yfried_mkoderer: ping15:05
sdagueyeh, well is someone looking into the failure, or are we going to delete the tests. Because the test seems provably wrong based on my reading of the nova code.15:06
dkranzsdague: I'm going to look at the logs a bit more now15:08
sdaguedkranz: ok15:08
yfried_mtreinish: https://blueprints.launchpad.net/tempest/+spec/input-scenarios-for-scenario this did a POC with server_basic_ops. was this ever continued?15:09
*** marun has joined #openstack-qa15:09
*** zz_dimtruck is now known as dimtruck15:09
*** enikanorov_ has joined #openstack-qa15:10
yfried_mtreinish: will we be able to discuss large_ops test at this week's mtg, or was it discussed in summit?15:12
mtreinishyfried_: IIRC it's just the one test which uses it. No one has seen sufficient reason to expand it since the one test landed15:13
*** rbak has joined #openstack-qa15:13
mtreinishyfried_: you can put it on the agenda, but really you should just talk to flashgordon about it.15:14
mtreinishin there current form the large ops tests will eventually just be converted to a nova functional test, because that's what they are15:14
yfried_mtreinish: about large_ops - will do both15:15
yfried_flashgordon: ping15:15
sdague44dce62e23a56a0302efc16ecdfeac700bfefa84 merged about the time the failing started... for what it's worth15:15
yfried_mtreinish: about the BP - well, it was requested in icehouse summit and added new modules and conf values. I wonder if it's being used anywhere.15:15
yfried_mtreinish: I'm trying to understand why we have so many ssh_user values15:15
yfried_mtreinish: so if it's not being used - can we remove/revert it until someone actually requests it? or maybe somehow extract it into tempest-lib?15:16
*** Yogi has quit IRC15:17
yfried_mtreinish: on the other hand, is there a documentation of this dynamic scenario thing? maybe it's a good thing we can start using, but it's just not public knowledge?15:20
mtreinishyfried_: it is being used, by that one test. If you specify multiple images to run that test with you may need to provide multiple ssh users which is why the option is there15:21
mtreinishit's just not used in the gate because we just run it with the cirros image15:21
mtreinishyfried_: there probably aren't any external docs for it in the tempest tree, just inline comments15:22
*** jecarey_ has joined #openstack-qa15:22
yfried_mtreinish: so it's for operator who want to run server_basic_ops multiple times against different images?15:23
mtreinishyfried_: yes, IIRC that is how it works15:23
*** dgonzalez has joined #openstack-qa15:24
*** jlibosva has joined #openstack-qa15:24
yfried_mtreinish: so now I wonder if we could make all the scenarios use it, so you have a single place in conf where you define your scenario image(s?)15:24
*** weshay has quit IRC15:24
*** sabeen1 has joined #openstack-qa15:24
mtreinishsdague: hmm weird, maybe the test was just broken before and that's why it was passing. (I could see recreating creds unecessarily causing the expected error condition)15:24
yfried_mtreinish: as dkranz said, it makes sense to have a different image for scenario15:25
dkranzmtreinish: But that still does not explain why it is flaky now15:26
*** jlibosva has quit IRC15:26
*** jlibosva has joined #openstack-qa15:27
jlibosvasdague: hi15:27
*** superdan is now known as dansmith15:28
*** dgonzalez has quit IRC15:29
*** dgonzalez has joined #openstack-qa15:29
*** topshare has joined #openstack-qa15:30
*** atiwari has joined #openstack-qa15:30
*** pcrews has joined #openstack-qa15:33
sdaguedkranz: because it's creating a test server and not waiting for it15:34
dkranzsdague: ok, so that is the bug15:34
sdagueit's at least one of them15:34
*** jecarey__ has joined #openstack-qa15:35
sdagueanyway, I think we need to delete the auto generated tempest tests anyway, if you can't read the test and figure out what it's going to do, it makes this sort of thing a mess to go debug. Ask mtreinish is not scalable.15:35
*** ramishra_ has joined #openstack-qa15:36
*** ramishra_ has quit IRC15:36
mtreinishsdague: heh, I'm probably the wrong person to ask about it anyway? :)15:37
dkranzsdague: I don't see how that is the issue here. The bug is right in the test code15:37
dkranzsdague: to me the bug is more that waiting for a server to come up in not the default15:38
dkranzsdague: for create_test_server15:38
dkranzsdague: I presume you are not advocating that we create a set of manual negative tests15:39
dkranzsdague: we discussed moving the negative test stuff to tempest-lib15:39
*** markmcclain has quit IRC15:40
dkranzmtreinish: Do you want to remove these tests, or should I push a fix for this bug?15:40
*** markmcclain has joined #openstack-qa15:40
sdaguedkranz: my issue is that bug has been in there for a while, it was blocking other people's stuff, and until I spent a second day chasing people on it it didn't get looked at.15:41
sdaguedkranz: so that change should actually just mean the test fails 100% of the time, because the tempest schema is wrong15:42
sdagueit only happened to pass because server boots were slow enough that the server didn't get created most of the time15:42
dkranzsdague: what is the right schema? This is why we said we should move neg testing to projects15:43
sdaguedkranz: don't know, my interest in this test's usefulness ran out an hour ago. Which is why I said we should delete it :)15:45
dkranzsdague: I'm not objecting to that15:45
openstackgerritSean Dague proposed openstack/tempest: delete console negative tests  https://review.openstack.org/13497615:47
sdagueok, that's my proposed solution :)15:48
*** achanda has joined #openstack-qa15:49
yfried_mtreinish: dkranz: how come "tox" isn't part of tempest requirments.txt?15:49
jlibosvasdague: hi, I made a patch for neutron grenade to become voting https://review.openstack.org/#/c/134532/ as you asked. Can you please have a look?15:49
sdaguejlibosva: is it passing on stable/juno?15:50
jlibosvasdague: I think not15:50
sdagueok, so you need to change the exclude for that15:51
mtreinishyfried_: because it's not required15:51
sdaguejlibosva: left a comment where it should go15:51
jlibosvasdague: thanks15:52
*** dgonzale_ has joined #openstack-qa15:52
mtreinishyfried_: you can run tempest directly with a test runner, there's also run_tempest.sh. Tox is just what we use for the gate and has some convenient shortcuts for different job types15:53
dkranzmtreinish: you ok with just deleting the negative console test?15:54
jlibosvasdague: updated, I hope that's what is needed15:54
mtreinishdkranz: yes, I think that's fine, we can always add it back if it makes sense15:55
mtreinishdkranz: I already left a comment on sdague's review15:55
*** dgonzalez has quit IRC15:56
*** rwsu has joined #openstack-qa15:56
dkranzmtreinish: ok.15:56
yfried_mtreinish: tnx15:56
*** beekneemech is now known as bnemec15:56
*** dgonzale_ has quit IRC15:57
*** zz_jgrimm is now known as jgrimm15:59
openstackgerritYair Fried proposed openstack/tempest: Makes all scenarios use image details from [input-scenario]  https://review.openstack.org/13498015:59
yfried_dkranz: mtreinish: please take a look  https://review.openstack.org/13498016:00
*** edwa6643 has joined #openstack-qa16:00
sdaguemtreinish: testresources getting used anywhere yet in tempest?16:00
*** toure has quit IRC16:01
mtreinishsdague: no, not yet16:01
*** mestery is now known as mestery_afk16:01
sdagueok, bummer, I was looking for examples to make it make sense in my brain16:01
mtreinishsdague: heh, I think that's part of the reason it hasn't been used anywhere in tempest yet :)16:02
*** marun has quit IRC16:02
*** toure has joined #openstack-qa16:03
*** dkusidlo has joined #openstack-qa16:03
sdagueyeh... bummer16:04
*** yfried_ has quit IRC16:04
*** dkranz has quit IRC16:05
*** jecarey_ has quit IRC16:07
*** jecarey__ is now known as jecarey16:07
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498516:08
*** achanda has quit IRC16:09
*** david-lyle_afk is now known as david-lyle16:11
*** jlibosva has quit IRC16:12
cdentsdague: I was trying to use testresources in my http test experiment and eventually stalled out in part because it was melting my brain and also because I ran out of time for that task16:13
cdentI was trying to create aribtrary dependencies (ordering of tests while preserving isolation)16:14
openstackgerritJoseph Lanoux proposed openstack/tempest: Add BlockDeviceMappingV2Boot test  https://review.openstack.org/13499616:17
*** SridharG has left #openstack-qa16:18
mtreinishjlanoux: ^^^ pdb? :)16:18
jlanouxmtreinish: sorry - I'm currently correcting it :(16:19
mtreinishjlanoux: heh, no worries16:19
*** marun has joined #openstack-qa16:19
*** dgonzalez has joined #openstack-qa16:20
*** dkranz has joined #openstack-qa16:20
*** mpaolino has quit IRC16:20
openstackgerritJoseph Lanoux proposed openstack/tempest: Add BlockDeviceMappingV2Boot test  https://review.openstack.org/13499616:21
dimsmtreinish: logged a bug for the extra tests that fail even with the nova v2 xml flag switched off - https://bugs.launchpad.net/tempest/+bug/139347516:22
openstackrecheckopenstack/nova change: https://review.openstack.org/131132 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756016:23
mtreinishdims: ok thanks, you're patch to fix it was the right approach we just have to be more selective in the skips16:23
*** hemna has joined #openstack-qa16:25
*** DaSchab has quit IRC16:27
*** DaSchab has joined #openstack-qa16:27
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498516:28
*** hemna has quit IRC16:28
*** DaSchab has quit IRC16:28
mtreinishdims: ^^^ heh, I meant just rebase it on top of that commit :)16:29
dimsmtreinish: :)16:30
*** rfolco has joined #openstack-qa16:32
*** mpaolino has joined #openstack-qa16:34
*** chandankumar has joined #openstack-qa16:34
*** rfolco has quit IRC16:36
*** sridhar has quit IRC16:37
*** Yogi has joined #openstack-qa16:37
*** dkusidlo has quit IRC16:38
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498516:38
openstackgerritMatthew Treinish proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492416:39
mtreinishdims: ^^^ that should do it per test16:40
mtreinishif you wanted to test it to make sure16:40
*** dkusidlo has joined #openstack-qa16:40
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492416:40
mtreinishdims: ^^^ :(16:41
dimsmtreinish: just fixing commit messages and rebasing them correctly16:42
dimsmtreinish: y, will add setup methods with skips, is that ok?16:42
dimsmtreinish: for those specific ones i listed in the bug report16:42
mtreinishdims: look at rev 2 on 13492416:42
dimssorry, stepped on your commit16:44
mtreinishno worries :) I think that approach should only skip where needed16:44
mtreinishI think you could do it with a skipIf decorator too, but it gets kind of interesting to pull the interface class variable in the decorator16:46
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492416:46
*** hemna has joined #openstack-qa16:47
*** mlavalle has joined #openstack-qa16:48
*** hemna has quit IRC16:49
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492416:49
openstackrecheckopenstack/sahara change: https://review.openstack.org/134336 failed because of: gate-sahara-pep8: unrecognized error, gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756016:50
dimsmtreinish: i added a skipUnless in Nova, to avoid adding setUp methods in multiple classes16:50
dimsmtreinish- https://review.openstack.org/#/c/134332/12/nova/test.py,unified16:50
mtreinishdims: there is a skip unless decorator in testtools already16:51
mtreinishhttps://github.com/testing-cabal/testtools/blob/master/testtools/testcase.py#L89716:52
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Enable nova multi host on aiopcpu tests  https://review.openstack.org/13160416:53
*** hemna has joined #openstack-qa16:54
*** dkranz has quit IRC16:54
*** beagles is now known as beagles_brb16:58
*** toure has quit IRC17:02
*** toure has joined #openstack-qa17:03
*** chandankumar has quit IRC17:03
*** jlanoux has quit IRC17:03
*** rwsu has quit IRC17:03
*** dkranz has joined #openstack-qa17:06
*** tkammer has quit IRC17:13
*** rwsu has joined #openstack-qa17:16
*** rwsu has quit IRC17:18
*** rwsu has joined #openstack-qa17:19
*** dgonzalez has quit IRC17:20
*** dgonzalez has joined #openstack-qa17:20
*** flashgordon is now known as jogo17:22
*** atiwari has quit IRC17:23
jogomtreinish: I saw something in backscroll about large-ops17:23
*** atiwari has joined #openstack-qa17:23
*** dgonzalez has quit IRC17:24
*** dkusidlo has quit IRC17:24
*** jpich has quit IRC17:24
dimsmtreinish: that does not work when specified at the class level17:26
*** DaSchab has joined #openstack-qa17:29
*** avico has quit IRC17:31
*** atiwari has quit IRC17:31
*** atiwari has joined #openstack-qa17:32
openstackrecheckopenstack/nova change: https://review.openstack.org/132950 failed gate-nova-python27 in the gate queue with an unrecognized error17:33
*** wuhg has quit IRC17:33
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498517:34
*** DaSchab has quit IRC17:34
*** weshay has joined #openstack-qa17:34
*** chandankumar has joined #openstack-qa17:38
mtreinishjogo: yeah, yfried was asking about it he wanted to make changes17:41
*** harlowja_away is now known as harlowja17:41
mtreinishI think he had an etherpad, let me try to dig it up17:41
*** kmartin has joined #openstack-qa17:42
mtreinishjogo: https://etherpad.openstack.org/p/tempest_large_ops_with_network17:42
*** yamahata has quit IRC17:53
openstackgerritAshish Kumar Gupta proposed openstack/tempest: Floating IP Negative Tests  https://review.openstack.org/10952917:54
*** jordanP has quit IRC17:54
*** asselin has joined #openstack-qa17:55
*** Yogi has quit IRC17:56
*** suneelb has joined #openstack-qa17:57
*** beagles_brb is now known as beagles17:58
jogomtreinish: thanks, commenting on the etherpad17:58
dimsjogo: update on the xml stuff - http://markmail.org/message/txgsqmx6kpjiltyx17:59
*** yamahata has joined #openstack-qa18:00
openstackgerritAdam Gandelman proposed openstack-dev/devstack: Do not hard-code ironic svc port, protocol  https://review.openstack.org/13504118:01
jogodims: thanks, will look at it later today18:04
dimsjogo: no hurries, just reporting progress :)18:04
jogodims: thanks for spearheading this!18:05
*** markus_z has quit IRC18:10
*** topshare has quit IRC18:10
openstackrecheckopenstack/nova change: https://review.openstack.org/128191 failed because of: gate-nova-python27: unrecognized error, gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756018:12
*** bkopilov has quit IRC18:13
*** topshare has joined #openstack-qa18:17
*** mpaolino has quit IRC18:18
*** yfried_ has joined #openstack-qa18:19
yfried_dkranz: ping18:20
jogoyfried_: I commented on the etherpad about large ops18:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467018:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463918:22
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Turn off nova_allow_move_to_same_host if in aiopcpu  https://review.openstack.org/13504418:22
*** achanda has joined #openstack-qa18:25
*** chandankumar has quit IRC18:25
*** sabeen1 has quit IRC18:26
*** topshare has quit IRC18:27
dkranzyfried_: pong18:28
*** patrickeast has joined #openstack-qa18:28
*** achanda has quit IRC18:30
yfried_dkranz: https://review.openstack.org/134980 were you able to take a look?18:32
dkranzyfried_: not yet18:33
*** e0ne has quit IRC18:33
*** achanda has joined #openstack-qa18:35
*** johnthetubaguy is now known as zz_johnthetubagu18:38
yfried_jogo: tnx. posted some questions on your comments18:38
yfried_jogo: https://etherpad.openstack.org/p/tempest_large_ops_with_network18:39
*** rushiagr is now known as rushiagr_away18:40
*** yamahata has quit IRC18:41
yfried_dkranz: mtreinish: mkoderer: cyeoh: can I get some cores' eyes on these 2 patches please? https://review.openstack.org/#/c/124722/ https://review.openstack.org/#/c/124625/18:41
openstackgerritDean Troyer proposed openstack-dev/devstack: Simplify docs build  https://review.openstack.org/13504818:47
openstackrecheckopenstack/trove change: https://review.openstack.org/112035 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756018:48
*** mestery_afk is now known as mestery18:48
*** yjiang5_away is now known as yjiang518:50
dkranzyfried_: See my comment in https://review.openstack.org/#/c/124722/. Do I misunderstand the meaning of __class__?18:51
jogoyfried_: responded18:54
*** weshay has quit IRC18:55
*** luqas has quit IRC19:03
openstackgerritSean Dague proposed openstack/tempest: Delete console negative tests  https://review.openstack.org/13497619:03
*** vigneshvar_ has joined #openstack-qa19:06
*** ajo has quit IRC19:07
mtreinishsdague, dkranz: can you guys take a look at: https://review.openstack.org/121910 it should block regressions on not being able to do a list-tests w/o a config file19:10
*** vigneshvar has quit IRC19:10
*** Rockyg has joined #openstack-qa19:13
*** bknudson has quit IRC19:15
*** bknudson has joined #openstack-qa19:15
*** wojtczak has joined #openstack-qa19:16
*** DaSchab has joined #openstack-qa19:18
*** weshay has joined #openstack-qa19:18
mtreinishdims: the xenserver failure on that patch was real: http://dd6b71949550285df7dc-dda4e480e005aaa13ec303551d2d8155.r49.cf1.rackcdn.com/24/134924/5/31874/run_tests.log19:22
*** wojtczak has left #openstack-qa19:22
mtreinishCONF isn't definied in one of the files19:22
*** DaSchab has quit IRC19:22
openstackrecheckopenstack/trove change: https://review.openstack.org/134802 failed because of: gate-tempest-dsvm-neutron-heat-slow: https://bugs.launchpad.net/bugs/1374175 https://bugs.launchpad.net/bugs/129756019:23
openstackgerritAdolfo Duarte proposed openstack/tempest: Added 'distributed' attribute to router update  https://review.openstack.org/13292219:28
dimsmtreinish: ack, fixing19:28
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492419:33
sdaguedtroyer: hmmmm.... we lost the ability to run devstack unit tests after the bashate conversion?19:33
openstackgerritMatthew Treinish proposed openstack/tempest: Sync latest log module from oslo-incubator  https://review.openstack.org/13160119:36
*** yfried_ has quit IRC19:39
*** dustins_ has joined #openstack-qa19:41
*** sabeen has joined #openstack-qa19:42
sdaguemtreinish: why syncing versus switching to oslo.log?19:43
mtreinishsdague: I didn't think oslo.log was ready yet19:44
sdagueok19:44
*** dustins has quit IRC19:44
mtreinishsdague: also dims was helping me with that patch, because there was an issue with oslo.i8ln being an implicit requirement19:44
sdagueok19:45
*** atiwari has quit IRC19:49
*** e0ne has joined #openstack-qa19:55
*** weshay has quit IRC19:55
openstackgerritAdolfo Duarte proposed openstack/tempest: Added 'distributed' attribute to router update  https://review.openstack.org/13292220:01
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498520:03
*** sabeen2 has joined #openstack-qa20:03
*** sabeen has quit IRC20:04
*** omnibus7 is now known as davidlenwell20:06
*** sabeen1 has joined #openstack-qa20:06
*** ajo has joined #openstack-qa20:08
*** sabeen2 has quit IRC20:08
*** Sukhdev has joined #openstack-qa20:12
*** yjiang5 is now known as yjiang5_away20:12
dtroyersdague: the tests/* scripts?20:12
sdagueyeh, except, we don't seem to be running them20:12
*** e0ne has quit IRC20:13
*** mpaolino has joined #openstack-qa20:13
*** sabeen1 has quit IRC20:13
*** sabeen1 has joined #openstack-qa20:14
dtroyerI don't recall them being in run_stest.sh before20:15
sdagueso, you are probably right20:15
dtroyerthey should be though, maybe tme to add them20:16
sdaguehowever, the subtlety, and the screw ups I made with the LIBS_FROM_GIT means that I really want an infrastructure for running unit tests here20:16
openstackgerritSean Dague proposed openstack-dev/devstack: make run_tests.sh do something again  https://review.openstack.org/13506520:16
sdagueso.... ^^^20:16
dtroyeryeah, that's the ticket20:17
sdagueso I'm ok adhocing more testing here, though this looked kind of interesting as well - https://github.com/sstephenson/bats20:19
sdaguejust to make it a bit more structured20:20
openstackrecheckopenstack/horizon change: https://review.openstack.org/96800 failed gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm in the gate queue with an unrecognized error20:25
openstackgerritAdam Gandelman proposed openstack-dev/devstack: Log early boot of Ironic VMs to serial with sgabios  https://review.openstack.org/13506820:30
openstackgerritAdam Gandelman proposed openstack-dev/devstack: Log early boot of Ironic VMs to serial with sgabios  https://review.openstack.org/13506820:32
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463920:36
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Set HOST_IP to the private interface  https://review.openstack.org/13507020:36
*** atiwari has joined #openstack-qa20:40
openstackgerritRob Crittenden proposed openstack-dev/devstack: Remove hardcoded protocol from backup_swift_url  https://review.openstack.org/13507320:41
openstackgerritAdam Gandelman proposed openstack-dev/devstack: Do not hard-code ironic svc port, protocol  https://review.openstack.org/13504120:44
*** mriedem has quit IRC20:47
*** openstackgerrit has quit IRC20:49
*** openstackgerrit has joined #openstack-qa20:49
*** mlavalle has quit IRC20:49
*** mlavalle has joined #openstack-qa20:51
openstackrecheckopenstack/nova change: https://review.openstack.org/109131 failed gate-nova-python27, gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error20:52
*** mkollaro has quit IRC20:52
*** mlavalle has quit IRC20:53
*** achanda has quit IRC20:54
*** sabeen1 has quit IRC20:56
*** sabeen2 has joined #openstack-qa20:56
openstackgerritRob Crittenden proposed openstack/tempest: Fix invalid URL in AccountClientCustomizedHeader  https://review.openstack.org/13507820:57
openstackgerritSean Dague proposed openstack/tempest: skip test_server_cfn_init as the failure rate is too high  https://review.openstack.org/13507920:58
sdaguemtreinish: ^^20:58
sdaguethat's just thrashing the gate right now20:58
mtreinishsdague: sure, makes sense21:00
mtreinishalthough that was the only running test in the slow job21:00
mtreinishso now it's an empty job definition21:00
sdaguehmmm.21:00
sdaguealso.... it seems that such a thing already went in?21:00
sdaguehttps://jenkins05.openstack.org/job/gate-tempest-dsvm-neutron-heat-slow/6750/console21:01
mtreinishsdague: hmm, i think that's just an import failure because the patch there doesn't touch the heat tests21:01
sdaguemtreinish: what triggered the import failure?21:02
*** mkollaro has joined #openstack-qa21:03
*** vigneshvar_ has quit IRC21:03
mtreinishdunno, but if the list tests explodes with subunit-trace I think that is the output, but I'm not 100% (it's been a couple of weeks)21:03
mtreinishit could be in any file, because it does a full list first21:04
sdaguewe don't display anything else ?21:05
mtreinishI'm not sure, I though it should print the list, I'll dig into it in a sec21:05
mtreinishI'm going to transition home first21:06
sdaguemtreinish: one sec, why is test_server_cfn_init running in the main tests?21:07
*** DaSchab has joined #openstack-qa21:07
*** DaSchab has quit IRC21:11
openstackrecheckopenstack/swift change: https://review.openstack.org/135008 failed because of: gate-grenade-dsvm: unrecognized error, gate-tempest-dsvm-full: unrecognized error, gate-tempest-dsvm-neutron-heat-slow: unrecognized error, gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/129756021:24
openstackrecheckopenstack/nova change: https://review.openstack.org/113811 failed gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error21:24
anteayaand thoughts on where I would look in the logs to find out more details about the heat slow failures: http://logs.openstack.org/08/135008/2/gate/gate-tempest-dsvm-neutron-heat-slow/8b9eb1e/logs/21:25
anteayathey aren't in tempest, testr, any of the devstack files or anywhere else I have looked21:25
*** achanda has joined #openstack-qa21:28
lifelessanteaya: it failed without capturing any tests21:28
lifelesspossibly dying hard on the first test or test setup, which subunit v1 can't show because it can't multiplex21:29
stevebakeranteaya: could it be that no tests are running in the heat-slow job, and they are all running in the main tests job?21:32
*** ajo has quit IRC21:34
*** ajo has joined #openstack-qa21:34
stevebakeranteaya: ignore me21:35
openstackgerritAdolfo Duarte proposed openstack/tempest: Adding api tests for dvr routers  https://review.openstack.org/13331721:35
*** Rockyg has quit IRC21:36
*** eezhova has quit IRC21:37
*** eezhova has joined #openstack-qa21:37
*** aysyd has quit IRC21:43
*** cdent has quit IRC21:44
sdaguelifeless: ... is it possible in the testtools releases that how regexes worked with testr changed?21:48
sdaguestevebaker: yeh, it looks like tempest tests aren't running in the jobs I'd expect them to21:50
mtreinishsdague: do you have a link?21:50
sdaguehttp://logs.openstack.org/65/135065/1/check/check-tempest-dsvm-full/0f5df25/console.html21:51
sdaguetest_server_cfn_init should be a slow test21:51
sdagueso not run there21:51
sdagueand equivalently, the heat jobs are failing because they are empty21:51
*** safchain has quit IRC21:52
*** salv-orlando has quit IRC21:52
stevebakersdague: ah, there it is http://logs.openstack.org/65/135065/1/check/check-tempest-dsvm-full/0f5df25/console.html#_2014-11-17_21_18_30_12421:53
openstackgerritRob Crittenden proposed openstack-dev/devstack: Configure boto.cfg in tempest to point to SSL bundle  https://review.openstack.org/13509121:53
mtreinishsdague: yeah, the other tests tagged as slow are getting run there too21:54
sdaguemtreinish: right, so there is a system level failure here21:54
mtreinishsdague: yeah, it's the new testtools, I just did a local test21:54
sdaguemtreinish: ok, 1.4.0 breaks the regex?21:54
mtreinishhttp://paste.openstack.org/show/134187/21:54
sdaguedoes 1.3.0 as well?21:55
mtreinishdunno, I'll check21:55
sdaguelifeless: ^^^21:55
lifelesssdague: no21:55
lifelesssdague: it shouldn't be possible21:55
lifelesssdague: but I guess perhaps it is. I need to take cynthia swimming now, will dive in as soon as I return21:56
mtreinishnope: http://paste.openstack.org/show/134188/21:56
mtreinishsdague: so it's just 1.4.021:56
sdaguemtreinish: ok, want to propose the requirements exclusion?21:56
mtreinishsdague: sure21:57
mtreinishheh, but won't that break trove again?21:57
*** ajo has quit IRC21:57
anteayalifeless: ah thanks21:57
lifelesssdague: mtreinish: please try to reproduce more narrowly, I've just tested regexes with 1.4.0 here and its fine.21:58
lifelesssdague: mtreinish: last time it was knee-jerk and premature, I'd had to see that happen again. I'll be back in ~90m21:58
sdaguelifeless: it wasn't premature, 1.2.0 required things it didn't specify21:58
sdagueblocking the problematic version lets people get back to work, and lets you have family time to figure it out when is convenient21:59
*** toure has quit IRC22:00
sdaguelifeless: attr regex ?22:00
mtreinishsdague: https://review.openstack.org/#/c/135092/22:01
*** salv-orlando has joined #openstack-qa22:02
sdaguemtreinish: if you testr list-tests22:02
sdagueare the tags still there?22:02
openstackgerritSean M. Collins proposed openstack-dev/devstack: Documentation: Using Neutron with DevStack  https://review.openstack.org/13120122:02
mtreinishsdague: yes, I think so, let me double check those paste links22:02
mtreinishsdague: yeah on 1.1.0, and 1.3.0 the attrs were still listed in the regexed list22:03
mtreinishoh let met try it with 1.4.0 without a regex filter and see if the attrs are there22:03
sdagueright, but in 1.4.0 there are no attrs, right?22:03
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/devstack-gate: Add oslo.context to devstack-vm-gate-wrap.sh  https://review.openstack.org/13509322:04
mtreinishsdague: yep, that looks to be the issue22:04
mtreinishthe attrs aren't being appended to the test_id. So the regex is working correctly because there is nothing matching22:04
*** safchain has joined #openstack-qa22:04
sdaguemtreinish: can you propose all the backports as well?22:04
sdaguemtreinish: yep22:05
mtreinishsdague: sure I'll push the backports one sec22:05
openstackrecheckConsole logs not available after 13:27s for gate-tempest-dsvm-postgres-full 134555,4,a009eac22:07
*** DaSchab has joined #openstack-qa22:07
*** ianw has quit IRC22:08
*** nmagnezi has quit IRC22:08
*** ianw has joined #openstack-qa22:08
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467022:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Turn off nova_allow_move_to_same_host if in aiopcpu  https://review.openstack.org/13504422:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463922:09
openstackgerritJoe Gordon proposed openstack-infra/devstack-gate: Set HOST_IP to the private interface  https://review.openstack.org/13507022:09
mtreinishsdague: https://review.openstack.org/#/c/135096/ and https://review.openstack.org/#/c/135097/22:09
mtreinishit looks like juno was missing the 1.2.0 exclude22:09
*** Sukhdev has quit IRC22:12
*** DaSchab has quit IRC22:12
*** ajo has joined #openstack-qa22:15
*** ajo has quit IRC22:15
openstackgerritJamie Lennox proposed openstack-dev/devstack: Use certmonger for certs  https://review.openstack.org/13510122:16
sdaguemtreinish: yeh, it never managed to merge22:17
sdaguebecause ... it takes too long to fix req issues22:18
mtreinishlifeless: it's probably around the fact that tempest tries to inline the decorators: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/test.py#n4722:18
*** sabeen2 has quit IRC22:18
mtreinishalthough looking at the testcase.py code I'm not sure why replacing unittest with unittest2 would break that22:19
mtreinishbut something looks weird to me in the tempest code, is that really the right way to inline a decorator?22:21
*** edwa6643 has quit IRC22:22
openstackrecheckConsole logs not available after 14:37s for check-tempest-dsvm-neutron-heat-slow 135067,1,3403eee22:22
*** mpaolino has quit IRC22:30
*** dkranz has quit IRC22:31
openstackrecheckopenstack/tempest change: https://review.openstack.org/128578 failed gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error22:36
*** dustins_ has quit IRC22:36
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: Add oslo.context  https://review.openstack.org/13510522:37
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467022:47
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463922:47
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507022:47
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/134972 failed gate-tempest-dsvm-neutron-heat-slow in the gate queue with an unrecognized error22:49
*** salv-orlando has quit IRC22:58
*** mlavalle has joined #openstack-qa22:58
*** salv-orlando has joined #openstack-qa23:00
openstackrecheckConsole logs not available after 13:44s for check-tempest-dsvm-full 135059,1,49cd82923:03
*** marun has quit IRC23:04
mtreinishsdague: I think I just found a fix for the testtools 1.4.0 thing in tempest23:04
mtreinishdid we already merge the exclude?23:05
mtreinishclarkb: ^^^ ?23:05
mtreinishit looks like tempest has the mixin order backwards on the base test classes, I think23:05
sdaguemtreinish: so what changed in testtools that made it care?23:06
mtreinishsdague: the only difference between 1.3.0 and 1.4.0 is that the testtools TestCase class inherits from unittest2 instead of unittest:23:07
mtreinishhttps://github.com/testing-cabal/testtools/commit/d30ee53f2eeb9ce4c4a04b7f6e94063edab72611#diff-1be3d2372bad38ec96fe0bf7b4e66485R2823:07
mtreinishI'm not sure why that would make a difference though23:08
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:08
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:08
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Skip additional tests when xml_api_v2 is set to False  https://review.openstack.org/13492423:08
mtreinishbecause I thought unittest2 just did a pass through if python was newer than 2.623:08
clarkbyes I merged already23:08
openstackgerritDavanum Srinivas (dims) proposed openstack/tempest: Switch off Nova XML v2 Tests  https://review.openstack.org/13498523:08
clarkbbut you can unwind at a leisurely pace now23:08
openstackgerritMatthew Treinish proposed openstack/tempest-lib: Add a test mixin for users of the cli tests  https://review.openstack.org/13510823:10
mtreinishclarkb: ok, because it'll probably be a 2 stage thing to get the order switched over in tempest, which will require a tempest-lib release23:10
*** dimtruck is now known as zz_dimtruck23:16
openstackrecheckConsole logs not available after 14:31s for check-tempest-dsvm-full 135074,2,de23c2023:17
mtreinishsdague: oh, I'm think afazekas may have hit this before when he added the py2.6 hack in to add unittest2 to the BaseTestCase there.23:17
mtreinishalthough maybe not because the order was wrong even if the unittest2 usage was conditional23:18
openstackrecheckopenstack/nova change: https://review.openstack.org/131132 failed gate-nova-python27, gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error23:19
openstackgerritMatthew Treinish proposed openstack/tempest: Fix inheritance for BaseTestCase  https://review.openstack.org/13511523:21
mtreinishsdague: ^^^23:21
mtreinishlifeless: ^^^ I think that fixes the issue with testtools 1.4.023:21
*** markmcclain has quit IRC23:22
openstackgerritMatthew Treinish proposed openstack/tempest-lib: Add a test mixin for users of the cli tests  https://review.openstack.org/13510823:25
mtreinishdims: sorry I suck on 134924, so many little copy and paste bugs...23:27
*** dims_ has joined #openstack-qa23:28
*** rbak_ has joined #openstack-qa23:30
*** rbak_ has quit IRC23:32
dims_mtreinish: i do it *all* the time :) no sweat23:32
*** dims has quit IRC23:32
*** rbak has quit IRC23:33
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:36
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:36
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507023:36
sdaguemtreinish: once you figure this out, would be good to figure out what the testtools test case or tempest unit test case would be to prevent future breakage23:36
*** yjiang5_away is now known as yjiang523:36
openstackrecheckopenstack-dev/devstack change: https://review.openstack.org/134975 failed gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-heat-slow in the gate queue with an unrecognized error23:37
lifelessright, back23:37
mtreinishsdague: hmm, I can add an attr check to the list-tests unit test I've got a patch up to fix23:40
mtreinishI'm not sure it's something we can internally check in testtools, if the usage in tempest was wrong and just happened to work before23:41
mtreinishalthough it might be a unittest2 thing, I'm not sure I still need to dig further I guess23:41
lifelessmtreinish: that decorator glue seems to be dynamically generating attrs, which is fine if a little awkward23:43
mtreinishlifeless: yeah, I'm pretty sure it's because the mixin order was backwards in tempest23:43
mtreinishit works when I locally tested https://review.openstack.org/#/c/135115/23:44
mtreinishbut I'm not sure why it would have worked in testtools<1.4.0 if that was the cause23:44
lifelesssdague: when I say premature w.r.t. 1.2.0. I mean that there was no analysis of whether it was an upstream issue or not. It was just (AFAICT) fire and forget.23:44
lifelessmtreinish: possibly there is a bug in the unittest2 id() method.23:45
lifelessmtreinish: I will look into that.23:45
lifelessmtreinish: I know there are things in there I need to improve.23:45
mtreinishlifeless: oh ok, yeah it could be, I guess I should probably pull the unittest2 tree. I don't know why I thought if python>=2.7 unittest2 just imported unittest.23:49
sdaguelifeless: I spent 2 hrs of my saturday getting to the understanding level I had to send that email23:49
sdaguewhile you can say I didn't understand everything23:50
sdagueI am quite annoyed by saying there was no analysis23:50
sdaguefor you, as the testtools author, to create the minimal test case is a few minutes of work, but that's not true for everyone else23:51
lifelesssdague: I didn't know that. All I knew was what you wrote23:51
sdaguemy email was a summary, to give people enough info to move forward23:51
lifelesssdague: I'm sorry that a chunk of your time was consumed.23:51
sdaguelifeless: yeh, no worries. I just felt like your retort devalued the effort that went into having any path forward. I agree the dependency fix was the right eventual fix, but these things emerge in parts, and we have to accept that23:52
sdaguewhich is why the blocks I think are a good tool here, like I said, it lets us split the problem and get people running again that are working on completely unrelated stuff23:54
lifelesssure23:54
lifelessI'm totally fine with blocks; what got me grumpy fundamentally was the last paragraph in your mail23:54
lifelesswhich intended or not I took as an attack23:55
lifelessin generall roll-back is a much safer strategy than roll-forward23:55
*** melwitt has joined #openstack-qa23:55
openstackrecheckConsole logs not available after 13:57s for gate-tempest-dsvm-neutron-full 133557,1,2705af223:55
lifelessand the block is a roll-back strategy23:55
*** DaSchab has joined #openstack-qa23:56
sdaguelifeless: yeh, sorry about that23:56
*** bknudson has quit IRC23:56
sdagueI didn't mean as such, I'd actually said it in a few other "breaks the world emails" in the past23:57
sdagueso it's part of my post amble thinking now23:57
openstackrecheckopenstack/sahara change: https://review.openstack.org/134345 failed gate-sahara-pep8, gate-tempest-dsvm-full, gate-tempest-dsvm-postgres-full, gate-tempest-dsvm-neutron-heat-slow, gate-grenade-dsvm in the gate queue with an unrecognized error23:57
*** achanda has quit IRC23:57
sdaguebut I'll try to do better on that front23:57
lifelesssdague: FWIW one of the reasons I did the release on saturday is that it was more likely than other releases to have fallout, and I'd rather find and fix that during folks weekends than primme time23:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Setup ssh_known_host files for aiopcpu  https://review.openstack.org/13467023:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full  https://review.openstack.org/13463923:58
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: Use private addresses everywhere with aiopcpu  https://review.openstack.org/13507023:58
sdagueah, see I'd rather you did it at a time when we had a bunch of folks around, so we could figure out what was going on together23:59
sdaguebecause it kind of took a team effort to do that23:59
sdagueas there are a lot of moving parts23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!