Monday, 2014-09-22

*** boden has quit IRC00:00
*** mriedem has quit IRC00:02
*** krtaylor has joined #openstack-qa00:07
*** dimtruck is now known as zz_dimtruck00:09
*** zz_dimtruck is now known as dimtruck00:20
*** jecarey_ has joined #openstack-qa00:27
*** jecarey has quit IRC00:29
*** dimtruck is now known as zz_dimtruck00:30
*** zz_dimtruck is now known as dimtruck00:39
*** boden has joined #openstack-qa00:56
*** dims has joined #openstack-qa00:59
*** boden has quit IRC01:01
*** Longgeek has joined #openstack-qa01:04
*** yamahata has joined #openstack-qa01:13
*** dimtruck is now known as zz_dimtruck01:18
*** zz_dimtruck is now known as dimtruck01:19
*** dims has quit IRC01:26
*** rodrigods_ has joined #openstack-qa01:27
*** dims has joined #openstack-qa01:30
*** dims_ has joined #openstack-qa01:31
*** dims has quit IRC01:35
*** dims_ has quit IRC01:40
*** dims has joined #openstack-qa01:41
*** dims has quit IRC01:45
*** edwa66431 has joined #openstack-qa01:49
*** edwa6643 has quit IRC01:51
*** boden has joined #openstack-qa01:57
*** boden has quit IRC02:02
*** dimtruck is now known as zz_dimtruck02:24
*** lordd has joined #openstack-qa02:27
*** lordd has quit IRC02:30
*** lordd has joined #openstack-qa02:43
*** acfleury has joined #openstack-qa02:57
*** boden has joined #openstack-qa02:58
*** cmyster_away is now known as cmyster02:59
*** edwa6643 has joined #openstack-qa03:02
*** boden has quit IRC03:03
*** edwa66431 has quit IRC03:06
*** rodrigods_ has quit IRC03:09
*** lordd has quit IRC03:24
*** dkranz has quit IRC03:24
*** jaypipes has joined #openstack-qa03:25
*** ChanServ sets mode: +o jaypipes03:25
*** pcrews has joined #openstack-qa03:26
*** lordd has joined #openstack-qa03:29
*** lordd has quit IRC03:39
*** zz_dimtruck is now known as dimtruck03:41
*** pcrews has quit IRC03:42
*** edwa6643 has quit IRC03:46
*** dimtruck is now known as zz_dimtruck03:51
*** acfleury has quit IRC03:54
*** chandankumar has joined #openstack-qa03:56
*** boden has joined #openstack-qa03:59
*** chandankumar has quit IRC04:02
*** chandankumar has joined #openstack-qa04:02
*** boden has quit IRC04:03
*** Poornima has joined #openstack-qa04:08
*** Madan has joined #openstack-qa04:10
*** gmann has quit IRC04:27
*** gmann has joined #openstack-qa04:27
*** swamireddy has joined #openstack-qa04:31
*** dims has joined #openstack-qa04:41
*** dims has quit IRC04:46
*** neeti has joined #openstack-qa04:48
*** cnesa13 has quit IRC04:52
*** Ch00k has joined #openstack-qa04:53
*** lordd has joined #openstack-qa04:56
*** boden has joined #openstack-qa05:00
*** boden has quit IRC05:04
*** Longgeek has quit IRC05:07
*** lordd has quit IRC05:10
*** lordd has joined #openstack-qa05:13
*** lordd has quit IRC05:16
*** lordd has joined #openstack-qa05:17
*** Longgeek has joined #openstack-qa05:22
*** Ch00k has quit IRC05:22
*** chandankumar has quit IRC05:23
*** chandankumar has joined #openstack-qa05:26
*** Ch00k has joined #openstack-qa05:27
*** yfried has joined #openstack-qa05:30
*** lordd has quit IRC05:35
*** lordd has joined #openstack-qa05:35
yfriedmasayukig: cyeoh: https://review.openstack.org/#/c/118232/ this is ready, could you guys please take a look?05:36
yfriedandreaf_: ^05:36
*** Ch00k has quit IRC05:36
yfriedcyeoh: https://review.openstack.org/#/c/102700/26/tempest/services/network/resources.py,cm could you please explain your comment here? suggest an alternative?05:37
kashyapyfried, Hi, was looking at this bug - https://bugs.launchpad.net/nova/+bug/137204905:44
kashyapSo, when you set these two05:45
kashyap'notify_nova_on_port_status_changes' 'notify_nova_on_port_data_changes'  to False in nova.conf,05:45
kashyapAbove 64 guests are booted?05:45
yfriedkashyap: you have to set the relevant values in nova.conf (vif_plugging_*) as well or nova would fail on all05:46
yfriedkashyap: but assuming you do, then yes - you can boot 100 VMs and they all get ACTIVE status05:47
*** lordd has quit IRC05:48
kashyapyfried, Can you post your sanitized nova.conf somewhere with the offending case? Just curious, will test in my env.05:48
yfriednova.conf? sure05:48
* kashyap off to make breakfast. 05:49
kashyapYou can post it in the bug, others debugging it might find it useful too.05:50
yfriedkashyap: please take a look at my extra comment05:50
*** evgenyf has joined #openstack-qa05:50
kashyapSure, in a few.05:51
*** rdekel has joined #openstack-qa05:51
yfriedkashyap: added conf files05:53
*** Ch00k has joined #openstack-qa05:57
*** boden has joined #openstack-qa06:00
*** yfried is now known as yfried|afk06:03
*** yamamoto has quit IRC06:04
*** flaper87 has quit IRC06:05
*** flaper87 has joined #openstack-qa06:05
*** yfried|afk is now known as yfried06:05
*** boden has quit IRC06:05
*** bkopilov has quit IRC06:11
*** bkopilov has joined #openstack-qa06:11
*** pkoniszewski has joined #openstack-qa06:14
*** Ch00k has quit IRC06:14
kashyapyfried, Thanks. I'll test in my env today from git & see if I can reproduce it.06:17
*** pkoniszewski has quit IRC06:17
*** yfried is now known as yfried|afk06:18
*** rdekel has quit IRC06:19
*** yfried|afk is now known as yfried06:19
yfriedkashyap: tnx. let me know what you find06:20
*** k4n0 has joined #openstack-qa06:20
*** rdekel has joined #openstack-qa06:21
*** Ch00k has joined #openstack-qa06:25
*** swamireddy1 has joined #openstack-qa06:27
*** e0ne has joined #openstack-qa06:28
*** yamamoto has joined #openstack-qa06:28
kashyapSure.06:28
*** SridharG has joined #openstack-qa06:29
*** e0ne has quit IRC06:30
*** swamireddy has quit IRC06:30
*** Ch00k has quit IRC06:31
*** e0ne has joined #openstack-qa06:34
*** nmagnezi has joined #openstack-qa06:34
*** yamamoto has quit IRC06:35
*** e0ne has quit IRC06:36
*** yfried is now known as yfried|afk06:38
*** e0ne has joined #openstack-qa06:40
*** e0ne has quit IRC06:43
*** vigneshvar has joined #openstack-qa06:45
*** e0ne has joined #openstack-qa06:47
*** e0ne has quit IRC06:49
*** afazekas has joined #openstack-qa06:53
*** yfried|afk is now known as yfried06:58
yfriedanyone here familiar with grenade?07:01
*** boden has joined #openstack-qa07:01
yfriedno idea why this fails on it every time07:02
yfriedhttps://review.openstack.org/#/c/122998/07:02
*** boden has quit IRC07:06
*** jlibosva has joined #openstack-qa07:15
*** jordanP has joined #openstack-qa07:15
*** e0ne has joined #openstack-qa07:29
swamireddy1afazekas: Hi07:32
swamireddy1afazekas:  In the patch https://review.openstack.org/#/c/115944/, I have added a tests for reboot_instance...07:33
*** luqas has joined #openstack-qa07:33
swamireddy1afazekas: But in the tempest/thirdparty/boto/test_ec2_instance_run.py - file, in test_run_terminate_instance(), with one instance, the for loop used...The for loop used for other test cases also - with one intance07:35
swamireddy1afazekas:  Is there any reason for using a for loop for one instance?07:35
*** jlanoux has joined #openstack-qa07:37
*** Albert_13 has joined #openstack-qa07:38
*** e0ne has quit IRC07:38
*** e0ne has joined #openstack-qa07:40
*** gszasz has joined #openstack-qa07:40
*** Longgeek has quit IRC07:40
*** luqas__ has joined #openstack-qa07:41
*** luqas has quit IRC07:44
*** mpaolino has joined #openstack-qa07:48
afazekasswamireddy1: :)07:48
afazekasswamireddy1: it could work without the for loop, but in theory a reservation can have multiple instances.07:49
afazekasasserting the number of instances in the reservation (1) and using the [0]th could work in most cases07:53
*** gszasz has quit IRC07:53
*** tkammer has joined #openstack-qa07:58
*** jlibosva has quit IRC07:59
*** Longgeek has joined #openstack-qa08:01
*** jlibosva has joined #openstack-qa08:01
*** safchain has joined #openstack-qa08:02
*** tkammer has quit IRC08:03
*** gfidente has joined #openstack-qa08:08
afazekasswamireddy1: as dkranz pointed out that test case was created for terminating the instance without waiting for runing/ACTIVE state. might be better to create new one for reboot.08:09
*** bkopilov has quit IRC08:10
afazekasLooks like the usage of for loop for one instance is confusing (and slower) most places (maybe exuding termination) it can be changed to `assert len 1` and using the first[0] one.08:12
*** markus_z has joined #openstack-qa08:13
*** e0ne has quit IRC08:13
*** e0ne has joined #openstack-qa08:16
*** tkammer has joined #openstack-qa08:17
*** jlibosva1 has joined #openstack-qa08:18
*** chandankumar has quit IRC08:18
*** jlibosva has quit IRC08:21
*** luqas__ has quit IRC08:24
swamireddy1afazekas: Ok...I created originally as separate test case as test_run_reboot_terminate¨...later as its same as test_run_terminate test case, merged with it..08:25
swamireddy1afazekas: Now Iam confused...08:26
*** boden has joined #openstack-qa08:27
*** swamireddy2 has joined #openstack-qa08:29
swamireddy2afazekas: yes, the for loop not needed for one instance, os we need to either update the same full file or remove the for loop for this patch, rest of the file can be done later08:29
*** bkopilov has joined #openstack-qa08:31
*** swamireddy1 has quit IRC08:31
*** k4n0 has quit IRC08:33
*** ildikov has joined #openstack-qa08:36
*** bkopilov has quit IRC08:38
*** gszasz has joined #openstack-qa08:41
*** Poornima has quit IRC08:41
*** neeti_ has joined #openstack-qa08:45
*** neeti has quit IRC08:47
*** liusheng has joined #openstack-qa08:48
*** tosky has joined #openstack-qa08:49
*** swamireddy has joined #openstack-qa08:50
*** k4n0 has joined #openstack-qa08:50
*** swamireddy2 has quit IRC08:54
*** cnesa13 has joined #openstack-qa08:54
*** bkopilov has joined #openstack-qa08:55
*** luqas__ has joined #openstack-qa08:56
*** Ch00k has joined #openstack-qa08:57
*** Ch00k has quit IRC08:57
*** cnesa13 has quit IRC09:01
*** cnesa13 has joined #openstack-qa09:02
Albert_13hi, I'm developing custom tests, and need to automate some communications betwen servers with different protocols, and I'm considering using twisted framework, but if later on I would like to include my tests into the community, would be a burden the usage of sutch thirdparty frameworks?09:05
*** Ch00k has joined #openstack-qa09:06
*** qba73 has joined #openstack-qa09:06
jordanPAlbert_13, twisted is a huge framework... the best way to answer this question would be to start a new threand on the qa mailing list09:07
*** Longgeek has quit IRC09:08
*** Ch00k has quit IRC09:08
jordanPAlbert_13, my opininon : if contributing upstream could be beneficial to you, you should concider writting your tests the way the community does it. It will be easier for everyone09:08
Albert_13Thanks Jordan09:09
*** Ch00k has joined #openstack-qa09:09
*** Longgeek has joined #openstack-qa09:17
*** e0ne has quit IRC09:24
*** swamireddy has quit IRC09:25
*** e0ne has joined #openstack-qa09:26
*** swamireddy has joined #openstack-qa09:27
*** yfried is now known as yfried|afk09:29
*** yfried|afk is now known as yfried09:29
*** zz_dimtruck is now known as dimtruck09:34
*** tkammer has quit IRC09:36
*** Ch00k has quit IRC09:37
*** yfried is now known as yfried|afk09:39
*** neeti_ has quit IRC09:40
*** neeti has joined #openstack-qa09:41
*** chandankumar has joined #openstack-qa09:42
*** k4n0 has quit IRC09:44
*** dimtruck is now known as zz_dimtruck09:44
*** swamireddy1 has joined #openstack-qa09:47
*** yfried|afk is now known as yfried09:48
*** tkammer has joined #openstack-qa09:49
swamireddy1afazekas: what we do here with adding reboot_instance test? could please advise/09:50
*** swamireddy has quit IRC09:50
*** swamireddy has joined #openstack-qa09:51
*** cnesa13 has quit IRC09:51
*** yfried_ has joined #openstack-qa09:52
*** yfried__ has joined #openstack-qa09:53
*** swamireddy1 has quit IRC09:54
*** neeti has quit IRC09:55
*** yfried has quit IRC09:55
*** cnesa14 has joined #openstack-qa09:55
*** tkammer has quit IRC09:55
*** Madan has quit IRC09:56
*** yfried_ has quit IRC09:56
*** andreaf_ is now known as andreaf10:01
*** Madan has joined #openstack-qa10:02
andreafafazekas, mkoderer_ : https://review.openstack.org/#/q/topic:bp/resource-cleanup,n,z - the framework for the series is merged now, and all changes passing check - they are all identical changes so should be easy to review10:04
*** luqas__ has quit IRC10:04
*** luqas has joined #openstack-qa10:06
*** luqas has quit IRC10:08
*** ildikov_ has joined #openstack-qa10:10
*** tkammer has joined #openstack-qa10:10
*** ildikov has quit IRC10:12
*** Longgeek has quit IRC10:16
*** aix has joined #openstack-qa10:16
*** luqas has joined #openstack-qa10:16
*** Longgeek has joined #openstack-qa10:20
*** luqas has quit IRC10:20
*** mitz_ has joined #openstack-qa10:22
*** k4n0 has joined #openstack-qa10:29
*** evgenyf has quit IRC10:33
*** Albert_13 has quit IRC10:34
*** Albert_13 has joined #openstack-qa10:35
*** luqas has joined #openstack-qa10:36
*** yamahata has quit IRC10:37
*** naggappan has joined #openstack-qa10:40
*** e0ne has quit IRC10:43
naggappanhi i have done openstack-manual commit and i am clear about how to contribute now. Looking forward to commit to tempest and neutron. I checked the https://etherpad.openstack.org/p/icehouse-summit-qa-neutron10:45
naggappanbut most of them are taken by someone else10:45
naggappanis there any thing which someone can suggest  me10:45
*** zz_johnthetubagu is now known as johnthetubaguy10:47
*** Poornima has joined #openstack-qa10:47
*** dmellado has quit IRC10:48
*** evgenyf has joined #openstack-qa10:50
chandankumarnaggappan, hello10:50
chandankumarnaggappan, have you tried to get familiar with tempest?10:50
*** zigo has quit IRC10:50
*** dmellado has joined #openstack-qa10:51
*** zigo has joined #openstack-qa10:52
naggappanchandankumar, i tried to run the tempest and checked. But not gone throught the code of tempest much. But i have created my own scenarios for our office purpose10:52
naggappanif adding more scenarios is best way to start, please point me the link where i can see the blue print of scenarios related to neutron10:53
*** yfried__ has quit IRC10:53
chandankumarnaggappan, try to go through this link https://wiki.openstack.org/wiki/Neutron/TempestAPITests10:53
chandankumarnaggappan, like this blueprint https://blueprints.launchpad.net/tempest/+spec/add-scenario-tests-in-icehouse10:54
naggappanok basic like create a vm allocate newtork,subnet  automatically i have done. Fine let me gothroght blueprints of scenarios and try to get it done10:56
chandankumarnaggappan, just shoot  a mail to the owner on the things you are going to work,10:57
naggappansure10:57
*** dims has joined #openstack-qa10:59
*** nmagnezi has quit IRC11:02
*** tkammer has quit IRC11:05
*** mkollaro has joined #openstack-qa11:08
*** mwagner_lap has quit IRC11:08
*** yfried__ has joined #openstack-qa11:09
*** Ch00k has joined #openstack-qa11:10
*** bkopilov has quit IRC11:10
*** nmagnezi has joined #openstack-qa11:15
*** jyuso065 has quit IRC11:15
*** neeti has joined #openstack-qa11:17
*** tosky has quit IRC11:17
*** tkammer has joined #openstack-qa11:18
EmilienMjogo: sdague: I would need a review on javelin: https://review.openstack.org/#/c/121648/11:21
*** om has joined #openstack-qa11:25
*** luqas has quit IRC11:26
*** yfried__ is now known as yfried|afk11:28
*** evgenyf has quit IRC11:28
*** bkopilov has joined #openstack-qa11:28
*** bkopilov has quit IRC11:32
*** bkopilov has joined #openstack-qa11:33
*** zz_jgrimm is now known as jgrimm11:33
*** om has quit IRC11:34
*** evgenyf has joined #openstack-qa11:40
*** naggappan has quit IRC11:40
*** e0ne has joined #openstack-qa11:42
*** tosky has joined #openstack-qa11:43
*** cmyster is now known as cmyster_away11:46
*** e0ne has quit IRC11:50
*** om has joined #openstack-qa11:52
*** naggappan has joined #openstack-qa11:56
*** yfried|afk is now known as yfried__11:57
*** e0ne has joined #openstack-qa11:58
*** swamireddy has quit IRC12:02
*** luqas has joined #openstack-qa12:03
*** aysyanne has joined #openstack-qa12:04
*** rdekel has quit IRC12:04
*** edwa6643 has joined #openstack-qa12:07
*** mmedvede has joined #openstack-qa12:13
*** openstackgerrit has joined #openstack-qa12:14
*** edwa6643 has quit IRC12:17
*** om has quit IRC12:18
*** edwa6643 has joined #openstack-qa12:20
*** yfried__ is now known as yfried|afk12:25
*** weshay has joined #openstack-qa12:27
*** boden has quit IRC12:30
*** boden has joined #openstack-qa12:30
*** acfleury has joined #openstack-qa12:31
*** yfried|afk is now known as yfried__12:32
*** dims has quit IRC12:38
*** mmedvede has quit IRC12:38
*** andreaf is now known as andreaf_12:38
*** dims has joined #openstack-qa12:38
*** liusheng has quit IRC12:39
*** nmagnezi has quit IRC12:43
*** rfolco has joined #openstack-qa12:44
*** mmedvede has joined #openstack-qa12:45
*** sballe has joined #openstack-qa12:47
*** rdekel has joined #openstack-qa12:48
*** cnesa14 has quit IRC12:50
*** Madan has quit IRC12:50
*** gszasz has quit IRC12:53
*** vigneshvar has quit IRC12:54
*** cnesa14 has joined #openstack-qa12:54
*** gszasz has joined #openstack-qa12:58
*** nmagnezi has joined #openstack-qa12:58
*** jlibosva1 is now known as jlibosva12:59
*** ildikov has joined #openstack-qa13:00
*** ildikov_ has quit IRC13:03
*** toure has joined #openstack-qa13:03
*** mestery has quit IRC13:09
*** mestery has joined #openstack-qa13:09
*** sballe has quit IRC13:12
*** tkammer has quit IRC13:15
*** swamireddy has joined #openstack-qa13:15
*** luqas has left #openstack-qa13:18
*** bknudson has quit IRC13:21
yfried__sdague: https://bugs.launchpad.net/neutron/+bug/1372049 please let me know if the info I provided is any good13:22
yfried__kashyap: were you able to reproduce the bug from this morning?13:22
kashyapyfried__, Hi, I ended up doing some "yak shaving" - as I was stuck with a Keystone issue while trying to invoke db sync13:23
kashyapSo, mostly I investigated that (it's with Juno, M3, on Fedora 21/Rawhide) - https://bugzilla.redhat.com/show_bug.cgi?id=114511313:23
*** mriedem has joined #openstack-qa13:24
kashyapyfried__, So, I'm afraid I didn't get to it yet. And, starting tomorrow my next weeks are just too crazy, too many things going on13:25
yfried__kashyap: np. just wondered if someone else was able to reproduce13:26
openstackgerritSergey Shnaidman proposed a change to openstack/tempest: DHCPv6 network tests  https://review.openstack.org/11745813:26
*** superdan is now known as dansmith13:29
*** tkammer has joined #openstack-qa13:30
*** swamireddy has quit IRC13:37
*** sballe_ has quit IRC13:37
*** sballe has joined #openstack-qa13:37
*** zz_dimtruck is now known as dimtruck13:44
*** toure has quit IRC13:45
*** toure has joined #openstack-qa13:45
*** sabeen1 has joined #openstack-qa13:46
*** dimtruck is now known as zz_dimtruck13:53
*** proverma has joined #openstack-qa13:53
*** chandankumar has quit IRC13:54
*** bknudson has joined #openstack-qa13:56
*** proverma has quit IRC13:58
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add bug for glance failing to start on stable  https://review.openstack.org/12313413:58
sdaguemriedem: so https://bugs.launchpad.net/devstack/+bug/1303813 is showing a ton of hits, but it's not actually the bug that was intended for13:59
sdaguethe real issue is the one above there13:59
sdaguehow would you feel about deleting the signature for 130381313:59
mriedemlooking14:00
mriedemsdague: heh, you pushed the query - feel free to remove it :)14:02
mriedemand you invalidated the bug14:02
sdagueyeh, well it's not being helpful :)14:02
sdagueunfortunately we can't do query subtraction14:02
mriedemsdague: i'm assuming it's a dupe of bug 1331274 14:02
sdagueactually, it's not14:02
sdagueit's actually the fail on the old side14:03
sdaguebut ... close enough14:03
*** gfidente has quit IRC14:04
*** dustins has joined #openstack-qa14:04
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: remove glance not starting signature  https://review.openstack.org/12313614:05
sdagueok, there is the delete14:05
*** rdekel has quit IRC14:06
*** tkammer has quit IRC14:08
*** rbak has joined #openstack-qa14:08
*** dkranz has joined #openstack-qa14:10
*** andreaf has joined #openstack-qa14:15
*** gfidente has joined #openstack-qa14:16
*** gordc has joined #openstack-qa14:19
*** k4n0 has quit IRC14:19
mriedemsdague: commented on https://review.openstack.org/#/c/123134/14:20
*** tkammer has joined #openstack-qa14:20
mriedemsdague: why not tag on g-api?14:20
sdaguemriedem: module:glance is pretty effective14:20
*** sballe_ has joined #openstack-qa14:21
mriedeminstead of the tags, since it's on g-api and g-reg14:21
sdagueyeh, I actually expect hitting the fields is faster than tags14:21
*** neeti has quit IRC14:21
sdagueso I realize that both the fields I added don't change the hits14:21
sdaguebut they do limit the search space dramatically14:22
sdagueso this should make it a very cheap query14:22
mriedemalways a flare for the dramatic with you :P14:22
*** yamahata has joined #openstack-qa14:23
mriedem+W on the series14:23
*** sballe_ has quit IRC14:23
mriedemi plan on cleaning up the closed queries today14:23
*** jecarey_ has quit IRC14:24
*** chandankumar has joined #openstack-qa14:24
sdaguecool14:24
*** sballe has quit IRC14:24
sdaguemriedem: how you feeling about this - https://review.openstack.org/#/c/122150/ ?14:25
sdagueoh, that should have been in -nova14:25
sdaguebut take a look regardless14:25
*** zz_dimtruck is now known as dimtruck14:29
*** andreaf has quit IRC14:31
*** atiwari has joined #openstack-qa14:31
*** nmagnezi has quit IRC14:32
bknudsonI'm going to see if I can figure out what's going on with https://bugs.launchpad.net/glance/+bug/137242214:32
*** acfleury has quit IRC14:33
*** acfleury has joined #openstack-qa14:33
bknudson"Glance exploding on configuration parsing"14:34
*** chandankumar has quit IRC14:36
*** yfried__ has quit IRC14:37
bknudsonLooks like the log file in the bug is already deleted? http://logs.openstack.org/98/122998/2/check/check-grenade-dsvm-partial-ncpu-icehouse/790f63e/logs/old/screen-g-api.txt14:40
bknudsonhttp://logs.openstack.org/98/122998/2/check/check-grenade-dsvm-partial-ncpu-icehouse/790f63e/logs/old/screen-g-api.txt.gz worked14:40
bknudsonstill no stack trace :(14:40
*** Poornima has quit IRC14:45
bknudsonI tried starting glance master using keystoneclient.middleware and started up fine... not sure how to recreate this.14:45
*** sballe has joined #openstack-qa14:48
*** ildikov has quit IRC14:48
bknudsonI tried checking out glance to stable/icehouse and still doesn't fail.14:49
*** Guest75828 has joined #openstack-qa14:52
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Update signature for pip download timeout bug 1270710  https://review.openstack.org/12314714:53
mriedemsdague: jogo: ^14:53
bknudsonpip freeze for the failing job shows "oslo.config==1.2.2.dev3.g7d68dc8 ", whereas my system has "oslo.config==1.4.0"14:53
*** jecarey has joined #openstack-qa14:54
*** SridharG has left #openstack-qa14:54
bknudsonI think that was it... I was able to recreate by "sudo pip install -U "oslo.config==1.2.1"14:56
mtreinishbknudson: oh, yeah that would probably break something...14:56
bknudsonit doesn't fail with "oslo.config==1.3.0"14:57
bknudsoncurrent keystoneclient has "oslo.config>=1.4.0" ... so that would indicate this wasn't running with the correct requirements14:58
openstackgerritRob Crittenden proposed a change to openstack-dev/devstack: Configure endpoints to use SSL natively or via proxy  https://review.openstack.org/9885414:59
mtreinishbknudson: so it's running icehouse on the old side of a grenade run so I'm not sure if the installed version matches that or not. Also that oslo.config version means it's being installed from the git repo15:01
*** kmartin has joined #openstack-qa15:01
mtreinishbknudson: but something definitely isn't getting installed correctly if that's the version in pip-freeze, I'd take a look at the devstack log to see what's installing that version15:01
bknudsonoslo.config has a stable/havana branch, but doesn't have stable/icehouse... it looks like grenade is checking out stable/havana.15:05
mtreinishdhellmann: ^^^15:06
*** naggappan has quit IRC15:06
*** sballe_ has joined #openstack-qa15:06
bknudsonwe'll see if it tries to check out stable/icehouse15:06
*** hemnass is now known as hemna15:06
dhellmannmtreinish: that's odd15:07
openstackgerritA change was merged to openstack-infra/elastic-recheck: add bug for glance failing to start on stable  https://review.openstack.org/12313415:07
mtreinishbknudson: yeah, that's probably what's causing the problems. There might be a devstack-gate, devstack, g-r, or grenade fix then.15:07
mtreinishdhellmann: yeah, especially since this just popped up and I don't think it's on every run15:08
dhellmannmtreinish: We may have said we would go back and create the branches when we needed them, not accounting for grenade's behavior.15:08
bknudsonhttp://logs.openstack.org/98/122998/2/check/check-grenade-dsvm-partial-ncpu-icehouse/790f63e/logs/devstack-gate-setup-workspace-new.txt.gz#_2014-09-22_09_28_18_96515:08
bknudsonit does git_has_branch openstack/oslo.config stable/icehouse15:08
bknudsonbut then it looks like it checks out master anyways.15:09
*** sballe has quit IRC15:09
dhellmannbknudson: so the new client code doesn't work with the old oslo.config library?15:10
bknudsondhellmann: we had a recent change to the auth token middleware (that I think we talked to you about)15:11
dhellmannyeah, this is feeling vaguely familiar15:11
bknudsonwhere it converts the strings in api-paste.ini to the actual type.15:11
dhellmannpulling options -- right15:11
*** toure has quit IRC15:11
bknudsonand that's where it's hitting this with what looks like some pretty old oslo.config code15:11
bknudsonI think this is going to be a general issue going forward, though... grenade is running with current keystoneclient not havana/icehouse keystoneclient, but that's running with old oslo.config15:13
*** toure has joined #openstack-qa15:13
bknudsonseems like grenade should be running with current oslo.config?15:13
dhellmannyeah, it seems like it should either update the requirements for all of the clients or use the old clients until those requirements can be updated15:14
mkollarois there some way to set tox to use globally installed packages and not create a virtualenv? I know using virtualenv is the main purpose of tox, but I need to check my package dependencies and I can't use the command directly - I'd have to rewrite a lot of code15:14
bknudsonkeystoneclient had oslo.config>=1.4.015:14
dhellmannbknudson: right, but apparently a different version of oslo.config is installed?15:14
bknudsondhellmann: the pip freeze output says oslo.config==1.2.2.dev3.g7d68dc815:15
openstackgerritA change was merged to openstack-infra/elastic-recheck: remove glance not starting signature  https://review.openstack.org/12313615:15
bknudsondhellmann: http://logs.openstack.org/98/122998/2/check/check-grenade-dsvm-partial-ncpu-icehouse/790f63e/logs/pip-freeze.txt.gz15:15
bknudsonpeople were saying this was intermittent... maybe we can find one that passed and check out its oslo.config version.15:16
dhellmannbknudson: I'd have to look at the install dance grenade does, but I suspect that's caused by installing the clients, then going back and installing that oslo lib from source (that's the only way to get a dev version)15:16
dhellmanngood idea15:16
bknudsondhellmann: I just tried `sudo pip install -U 1.2.1`15:17
bknudson`sudo pip install -U "oslo.config==1.2.1"15:17
bknudsonso here's a recent stable/icehouse build, where oslo.config==1.4.0  -- http://logs.openstack.org/72/122772/4/check/check-grenade-dsvm/1c316e8/logs/pip-freeze.txt.gz15:19
*** mlavalle has joined #openstack-qa15:19
*** Longgeek_ has joined #openstack-qa15:19
dkranzandreaf_: What was the result of how to handle all the dependent resource cleanup patches?15:20
dkranzandreaf_: Are we just going to revew all of them as is?15:20
*** sballe_ has quit IRC15:21
*** jamielennox has quit IRC15:22
*** Longgeek has quit IRC15:22
*** pcrews has joined #openstack-qa15:23
dhellmannbknudson: we have 2 problems here: why does this only fail for some jobs? and how do we make keystoneclient's option type conversion work for all cases?15:23
*** sballe has joined #openstack-qa15:28
*** toure has quit IRC15:31
*** evgenyf has quit IRC15:31
*** toure has joined #openstack-qa15:31
bknudsondhellmann: I started an etherpad for notes: https://etherpad.openstack.org/p/bug137242215:35
*** Guest75828 is now known as annegentle15:38
*** tkammer has quit IRC15:38
*** Ch00k has quit IRC15:41
*** jhenner has joined #openstack-qa15:43
*** jhenner1 has quit IRC15:43
openstackgerritA change was merged to openstack/tempest: Migrate computev2 API tests to resource_* fixtures  https://review.openstack.org/12153815:44
*** jhenner has quit IRC15:47
*** chandankumar has joined #openstack-qa15:50
bknudsondhellmann: does keystoneclient need to support the icehouse version of oslo.config?15:52
*** Longgeek_ has quit IRC15:55
dhellmannbknudson: Maybe? I think grenade is supposed to be codifying our rules for things like that, but it seems like it has inconsistent behavior.15:56
*** jlibosva has quit IRC15:58
*** sballe has quit IRC16:02
*** jlanoux has quit IRC16:04
*** yfried__ has joined #openstack-qa16:05
*** sballe has joined #openstack-qa16:06
*** sballe has quit IRC16:12
*** chandankumar has quit IRC16:14
*** e0ne has quit IRC16:17
*** sdague has quit IRC16:25
*** Albert_13 has quit IRC16:30
*** markmcclain has joined #openstack-qa16:36
notmynameis there a single list of the hacking rules anywhere?16:36
*** aimon has quit IRC16:36
*** mkollaro has quit IRC16:36
*** yfried__ is now known as yfried|afk16:38
*** yjiang5 has joined #openstack-qa16:39
*** proverma has joined #openstack-qa16:40
*** yfried|afk is now known as yfried__16:41
*** asselin has quit IRC16:48
*** asselin has joined #openstack-qa16:48
*** eglynn__ is now known as eglynn-officeafk16:52
*** yfried__ is now known as yfried|afk16:53
*** markus_z has quit IRC16:53
*** sdague has joined #openstack-qa16:55
*** mpaolino has quit IRC16:57
openstackgerritpritesh proposed a change to openstack-dev/devstack: Remove the Cisco Nexus monolithic plugin support  https://review.openstack.org/12162316:59
*** qba73 has quit IRC17:03
*** jordanP has quit IRC17:08
*** afazekas has quit IRC17:08
*** yamahata has quit IRC17:08
*** marun has joined #openstack-qa17:10
*** e0ne has joined #openstack-qa17:11
openstackgerritThomas Bechtold proposed a change to openstack-dev/devstack: Use correct WSGI dir on SUSE distros  https://review.openstack.org/12318817:11
*** aimon has joined #openstack-qa17:14
*** Ch00k has joined #openstack-qa17:19
*** harlowja_away is now known as harlowja17:21
*** suneelb has joined #openstack-qa17:25
*** chandankumar has joined #openstack-qa17:29
*** melwitt has joined #openstack-qa17:31
*** krtaylor has quit IRC17:32
*** jpmontez has joined #openstack-qa17:35
*** johnthetubaguy is now known as zz_johnthetubagu17:39
*** yfried|afk is now known as yfried__17:41
*** krtaylor has joined #openstack-qa17:41
*** gszasz has quit IRC17:43
*** cnesa14 has quit IRC17:50
*** gfidente has quit IRC17:52
bknudsondhellmann: the change to auth_token isn't especially complicated, so maybe this is the easiest solution: https://review.openstack.org/12319817:53
*** aix has quit IRC17:55
*** jpmontez has quit IRC17:58
*** salv-orlando has joined #openstack-qa18:02
*** proverma has quit IRC18:04
*** harlowja has quit IRC18:05
*** harlowja_ has joined #openstack-qa18:05
openstackgerritJohn Davidge proposed a change to openstack-dev/devstack: Add IPv6 support for tenant data network  https://review.openstack.org/8798718:07
*** yjiang5 has quit IRC18:14
*** chandankumar has quit IRC18:15
*** chandankumar has joined #openstack-qa18:17
*** marun has quit IRC18:18
*** tosky has quit IRC18:19
*** chandankumar has quit IRC18:26
*** yjiang5 has joined #openstack-qa18:30
*** e0ne has quit IRC18:35
*** sballe has joined #openstack-qa18:35
*** e0ne has joined #openstack-qa18:35
openstackgerritJohn Davidge proposed a change to openstack-dev/devstack: Add IPv6 support for tenant data network  https://review.openstack.org/8798718:41
*** jpmontez has joined #openstack-qa18:45
openstackgerritBaodong (Robert) Li proposed a change to openstack-dev/devstack: Add IPv6 support for tenant data network  https://review.openstack.org/8798718:46
*** kmartin has quit IRC18:47
*** openstack has joined #openstack-qa18:56
openstackgerritArmando Migliaccio proposed a change to openstack/tempest: Fix MismatchError for LB scenario test  https://review.openstack.org/12053318:58
*** sabeen1 has quit IRC18:59
*** proverma has joined #openstack-qa19:00
*** dustins has quit IRC19:00
*** dustins has joined #openstack-qa19:03
openstackgerritA change was merged to openstack-dev/devstack: Function for auth_token middleware config  https://review.openstack.org/12288219:04
openstackgerritA change was merged to openstack-dev/devstack: Configurable token hashing algorithm  https://review.openstack.org/11653519:05
*** rockyg has joined #openstack-qa19:07
*** yfried__ is now known as yfried|afk19:07
*** rwsu has joined #openstack-qa19:10
*** sballe_ has joined #openstack-qa19:21
*** proverma has quit IRC19:22
*** sballe has quit IRC19:24
*** rfolco has quit IRC19:24
*** safchain has quit IRC19:27
*** sabeen1 has joined #openstack-qa19:27
*** sballe_ has quit IRC19:32
*** weshay has quit IRC19:38
*** vigneshvar has joined #openstack-qa19:41
*** rfolco has joined #openstack-qa19:46
*** mwagner_lap has joined #openstack-qa19:47
*** jhenner has joined #openstack-qa19:48
*** weshay has joined #openstack-qa19:51
*** proverma has joined #openstack-qa19:51
*** marun has joined #openstack-qa19:51
*** markmcclain has quit IRC19:57
*** jpmontez has quit IRC19:59
*** proverma has quit IRC20:02
*** proverma has joined #openstack-qa20:03
*** proverma has quit IRC20:07
*** jpmontez has joined #openstack-qa20:07
*** proverma has joined #openstack-qa20:08
*** e0ne has quit IRC20:09
*** boden has quit IRC20:11
*** rockyg has quit IRC20:13
clarkbmtreinish: I am looking for an reasonably stable experimental job to run on nodes whose image was built by dib. basically a sanity check before we switch more things to dib built images20:14
clarkbmtreinish: would the tempest ceph job be good? or have any other ideas?20:15
*** sabeen1 has quit IRC20:18
mtreinishclarkb: hmm, I've never looked at results from the tempest ceph job20:19
clarkbmtreinish: np I can probably dig them up20:19
clarkbmtreinish: do you know of any tempest cahnges that are testing the experimental jobs?20:20
mtreinishclarkb: well anything that touches marconi, or the nova v3 api will run the experimental jobs on them because those paths are only enabled in experimental jobs20:21
*** andreaf has joined #openstack-qa20:21
mtreinishbut other than that I don't think we run it as standard operating procedure too often20:21
clarkbthanks20:21
mtreinishhonestly, I think the stability of all the jobs are pretty similar, I'd look at jogo's gate graphs to see if anything is a bit more stable than the others20:22
clarkbmtreinish: I think I will just add a new job then. Because it looks like we fail a lot/most of the experimental jobs20:24
mtreinishclarkb: https://review.openstack.org/#/c/107685/ needs to run the non-isolated experimental jobs which you and jeblair just pushed through20:25
mtreinishclarkb: yeah that's really not too surprising considering how often they get looked at20:25
*** weshay has quit IRC20:25
andreafmtreinish: before I rebase that to make it testable, I'd like to see https://review.openstack.org/#/c/119060 merged - it's +2 from dkranz already, and it's co-authored by you and me so I need someone else to review is. sdague? cyeoh?20:29
*** mriedem has quit IRC20:29
dkranzandreaf: IMO, if two core reviewers co-author something only one other +2 should be required. So I don't see a problem with a +A from mtreinish20:32
mtreinishandreaf: I thought that was the patch I stole the change-id from you, but none of the code was reused? I think you can give it the +A :)20:32
andreafmtreinish, dkranz : ok will do20:33
dkranzandreaf: Did you see my question from earlier about the resource patch sets? Are we full-speed ahead on reviewing/merging those?20:33
andreafdkranz: I missed your question20:34
dkranzandreaf: Just the one I re-asked ^^^20:34
andreafdkranz: so I think we could just try and merge them quickly - they are all the same, and all passing check20:35
dkranzandreaf: I saw briefly your comments with Sean about maybe not doing this20:35
dkranzandreaf: ok.20:35
andreafdkranz: the problem was all the load I caused by rebasing the whole patchset too may times :(20:36
andreafdkranz: the gate is quite busy so I don't know if we need to dose them a few per day only20:37
dkranzandreaf: ok20:37
andreafdkranz, the nova v3 tests are broken already (since they have been removed from gate), so they will fail on the compute v3 change, but not because of the change20:38
andreafdkranz, in fact I included the nova v3 tests mostly for completeness and so I could enforce the hacking rule20:39
dkranzandreaf: I saw that. ok20:39
*** skata has joined #openstack-qa20:40
andreafdkranz: if you have some more time for reviews, https://review.openstack.org/#/c/117673/ (scenario migration) would benefit from a review as well20:42
*** proverma has quit IRC20:45
*** markmcclain has joined #openstack-qa20:50
dkranzandreaf, adam_g : about https://review.openstack.org/#/c/117673/, where is the run showing this test actually passed after the change?20:51
dkranzIt looks ok to me but I like to see it passing before +A20:52
adam_gdkranz, the scenario test @ http://logs.openstack.org/73/117673/7/check/check-tempest-dsvm-ironic-pxe_ssh-nv/e90aebe/logs/testr_results.html.gz (which was failed run, but due to other issues)20:52
mtreinishadam_g: I thought those jobs were killing the regex: http://logs.openstack.org/73/117673/7/check/check-tempest-dsvm-ironic-pxe_ssh-nv/e90aebe/console.html.gz#_2014-09-19_08_29_14_63020:53
mtreinishor are we not quite there yet?20:53
openstackgerritA change was merged to openstack-infra/devstack-gate: Handle @s in log file names by renaming them  https://review.openstack.org/12288520:54
adam_gmtreinish, after everything here https://review.openstack.org/#/q/topic:ironic_infra,n,z is merged, we can kill the regex20:54
*** Ch00k has quit IRC20:54
adam_gmtreinish, final patch there was just approved earlier20:54
mtreinishadam_g: ok cool20:55
adam_gdkranz, FYI those ironic run should pass now /w https://review.openstack.org/#/c/122832/ merged, if you want to recheck before +A20:55
*** vigneshvar has quit IRC20:56
*** proverma has joined #openstack-qa20:57
*** proverma has quit IRC20:58
dkranzadam_g: ok, so those two ironic jobs are supposed to be working. I will try to remember :)21:00
*** proverma has joined #openstack-qa21:01
*** boden has joined #openstack-qa21:12
*** flaper87 is now known as flaper87|afk21:13
fungianybody happen to recognize whether http://logs.openstack.org/12/123112/1/check/check-tempest-dsvm-neutron-full/cdb7110/logs/screen-n-cpu.txt.gz?level=TRACE#_2014-09-22_14_24_22_574 is benign noise from oslo.messaging leaking into n-cpu screen logs?21:15
*** edwa6643 has quit IRC21:15
*** boden has quit IRC21:16
jogoso stable/icehouse is broken21:17
jogoso thats fun21:17
fungialways a blast, yes21:19
mtreinishjogo, fungi: is it just the keystoneclient oslo.config thing? or is there another aspect to it?21:19
dkranzmtreinish: Can you review https://review.openstack.org/#/c/112581/ (cleanup resources after running tempest)? I am not sure about the doc stuff there. It doesn't look quite right but I am not really familiar with that magic.21:20
mtreinishdkranz: oh, yeah sry I forgot about that bp last week. Yeah, the docs aren't right he was closer on the first rev, before he just needed to add an automodule stanza in a new file and put that in the index21:21
mtreinishI'll leave a comment about that21:22
openstackgerritAaron Rosen proposed a change to openstack/tempest: DON"T REVIEW  https://review.openstack.org/12325121:23
jogomtreinish: actually don't know I didn't click on any links21:25
jogoI thought someone else already did21:25
jogoguess not21:25
*** gordc has left #openstack-qa21:26
mtreinishjogo: there was a thread about some of the failures on stable maint and I think it was just that issue oslo.config issue which has a fix in progress I think21:26
mtreinishmorganfainberg: ^^^ right?21:26
fungiaha, here's what i was looking for... http://logs.openstack.org/12/123112/1/check/check-tempest-dsvm-neutron-full/cdb7110/logs/screen-n-api.txt.gz?level=TRACE#_2014-09-22_14_16_48_36021:26
funginova.api.openstack ConnectionFailed: Connection to neutron failed: HTTPConnectionPool(host='127.0.0.1', port=9696): Read timed out. (read timeout=30)21:26
*** mmedvede has quit IRC21:28
jogomtreinish: yup http://logs.openstack.org/81/119081/6/check/check-grenade-dsvm-icehouse/582a26f/logs/old/screen-g-api.txt.gz21:28
jogomtreinish: is at least part of it21:28
*** sabeen1 has joined #openstack-qa21:32
*** dkranz has quit IRC21:33
fungii can't seem to find a bug corresponding to that failure i ended up with... when in doubt assume a nova->neutron interaction failing is a neutron bug, or open against both projects?21:33
*** sabeen1 has quit IRC21:34
*** sabeen1 has joined #openstack-qa21:35
funginova's neutron driver is asking for a ports list via neutronclient, and the connection to neutron times out21:35
andreafstevebaker, masayukig: ping - regarding the autoscaling test - https://review.openstack.org/#/c/122320/21:35
fungiso seems more like neutron21:35
*** toure has quit IRC21:36
clarkbfungi: sounds like neutron to me21:36
fungii'll take it deeper down the rabbit hole into neutron logs then21:37
jogofungi: it does sound like neutron but add nova as well21:37
jogojust to be safe21:37
fungijogo: sure thing--thanks21:38
jogofungi: arosen is one of my go to people for nova/neutron issues21:38
jogoarosen: ^21:38
fungiit's bubbling up in tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic so likely a concurrency-related something or other21:38
mtreinishfungi: maybe not, that one spins up 2 tenants with servers in each and plays some sec group rule games to selectively block ping and ssh and test it21:41
fungioh, hrm21:41
fungiwell, maddeningly i don't see any errors in the q-svc screen log corresponding to that api call21:42
mtreinishit should be relatively well isolated, but there are some issues with those test which have a couple of fixes pending (I think they're probably unrelated, mostly around relying on icmp traffic not working everywhere)21:42
mtreinishfungi: yeah, that's always how this game goes :)21:43
openstackgerritVictoria Martínez de la Cruz proposed a change to openstack/tempest: Updates Tempest to match Zaqar's API name change  https://review.openstack.org/12325221:44
openstackgerritVictoria Martínez de la Cruz proposed a change to openstack/tempest: Updates Tempest to match Zaqar's API name change  https://review.openstack.org/12325221:45
marunmtreinish: Have you seen this?  http://www.amazon.com/Google-Tests-Software-James-Whittaker/dp/032180302721:46
marunmtreinish: I'm a few chapters in and it has some pretty advice on how to approach testing that would seem pretty relevant to openstack.21:47
marunpretty -> pretty sane21:47
marunjaypipes, jogo ^^21:47
mtreinishmarun: hmm, the title sounds familiar, but I haven't read it. Thanks for the suggestion, I'll take a look at it too.21:48
*** aysyanne has quit IRC21:48
marunmtreinish: An interesting tidbit is how google classifies tests into small/medium/large rather than using overloaded terms like unit/functional/etc21:48
*** harlowja_ has quit IRC21:49
marunmtreinish: On one hand it seems silly to have to create new terms, but without that there seems to be a lot of confusion around the different types of testing based on preconceived notions of what a classification like 'functional' or 'integrated' means.21:49
*** harlowja has joined #openstack-qa21:49
*** dustins has quit IRC21:50
jaypipesmarun: bring it to Paris :) I'll definitely steal it ;)21:51
mtreinishmarun: yeah, I can see how having less overloaded terms could help in explaining things and make the classification easier21:52
fungishould i expect a nova driver request id passed via neutronclient to be reflected in the q-svc debug log at least? if it's not there, does that mean the neutron api server never received the request?21:53
jogoThe other is that the book is highly romanticized. It almost reads like a romance, and SETs are the heros.21:53
jogomarun: when your done with it can I borrow it?21:53
mtreinishfungi: nope, there's a bp for that, but I don't know what the status is21:54
mtreinishfungi: https://blueprints.launchpad.net/nova/+spec/log-request-id-mappings21:54
clarkbmtreinish: huh that seems like a bug not a feature21:54
marunjogo: I've heard that comment, too.   Then again, openstack infra is pretty close to the 'productivity engineering' group that SETs are a part of, and romanticizing it doesn't seem like such a bad idea if it allows an increase in available resources.21:55
clarkbfungi: are they trying to say we should be more romantic?21:55
jogomarun: that was a quote from a review21:56
marunjogo: I think we could do worse than add folks with an SET focus to infra21:56
mtreinishclarkb: sigh yeah, but it's a larger effort because it requires client changes everywhere and logging mappings between request-ids. The scope was a bit larger than a bug.21:56
*** dims_ has joined #openstack-qa21:56
jogomarun: yeah21:56
jogomarun: your back in town this week right?21:56
marunjogo: yes21:56
marunjogo: as to borrowing it, I'm afraid I read on kindle. I'll check if it's loanable if reading on a screen doesn't dissuade you.21:57
*** dims_ has quit IRC21:58
clarkbjogo: also, your local library probably does ebook loaning. Its pretty awesome21:58
marun+1 to that21:58
*** dims_ has joined #openstack-qa21:58
jogohmm I don21:58
jogo't have a kindle21:58
* marun needs to get a library card21:58
marunjogo: most devices have a reader, including computers21:59
jogomarun: lunch this week?21:59
mtreinishjogo: there's an android kindle thing you can use21:59
marunjogo: i don't have a kindle either21:59
jogomtreinish: oh nice21:59
*** rodrigods_ has joined #openstack-qa21:59
*** dims has quit IRC21:59
*** edwa6643 has joined #openstack-qa21:59
marunjogo: sure, what day works for you?22:00
*** jpmontez has quit IRC22:00
*** proverma has quit IRC22:01
jogomarun: How does Thursday sound?22:02
marunjaypipes: I'm thinking a cross-project session around in-project testing practice would be really useful.  Maybe on the friday?22:02
openstackgerritAndrea Frittoli  proposed a change to openstack/tempest: Drop autoscaling scenario test.  https://review.openstack.org/12326022:02
marunjogo: Thursday works.  When/where? I'm in the city this time.22:03
andreafstevebaker, masayukig : https://review.openstack.org/#/c/123260/22:03
jogomarun: 11:30 somewhere in the city? we can pick where late in the week22:03
*** cnesa14 has joined #openstack-qa22:04
marunjaypipes: I'm working on ensuring that we talk about testing either in the neutron track or on friday, but maybe a wider focus would be better.  The challenge is in devising a strategy for delivery that is interactive rather than transmissive.22:04
marunjogo: wfm, I'll put it on my calendar.22:04
fungiclarkb: i don't have a romantic bone in my body22:05
jogomarun: great22:06
marunfungi: ...yet ;)22:06
clarkbfungi: just convert your funny bone22:06
fungithat'd be one helluva retrofit22:06
*** boden has joined #openstack-qa22:13
*** mmedvede has joined #openstack-qa22:17
*** boden has quit IRC22:17
jogomtreinish: tempest doesn't make sure instances get deleted fully does it?22:22
*** rodrigods_ has quit IRC22:29
*** proverma has joined #openstack-qa22:30
mtreinishjogo: it depends, in most cases it waits for deletion by looping a get until it gets a 40422:34
mtreinishthere might be some places where it doesn't do that22:34
*** jgrimm is now known as zz_jgrimm22:35
andreafmtreinish: it seems that a few tests are failing in the neutron non-isolated job, I doubt it's related to test-accounts, I'll have a look tomorrow: http://logs.openstack.org/60/119060/6/experimental/check-tempest-dsvm-neutron-full-non-isolated/25600e7/console.html#_2014-09-22_22_25_15_52422:35
mtreinishjogo: it does that for most async resource deletions. That's actually been a periodic issue with cinder in that some volumes take longer than the timeout to disappear22:35
mtreinishandreaf: yeah the nightlies for that job have beeen failing for a while. I haven't had a chance to dig into it22:36
mtreinishandreaf: although that patch doesn't actually use the new backwards compat cred provider yet does it? It just adds the mechanism for it22:37
*** jaypipes has quit IRC22:41
*** jecarey has quit IRC22:41
*** marun has quit IRC22:46
*** marun has joined #openstack-qa22:48
*** rbak has quit IRC22:56
*** proverma has quit IRC23:01
*** bknudson has quit IRC23:02
marunmtreinish: Here's the relevant tott post about google's test classifications: http://googletesting.blogspot.com/2010/12/test-sizes.html23:03
marunjogo: ^^23:03
*** cnesa14 has quit IRC23:03
*** acfleury has quit IRC23:04
mtreinishmarun: hmm, by that chart tempest in the gate is like medium.23:04
mtreinishI would have assumed it was large23:04
*** dimtruck is now known as zz_dimtruck23:05
*** KurtMartin has joined #openstack-qa23:05
*** KurtMartin is now known as kumartin23:06
marunmtreinish: I don't think the chart itself is enough...23:09
*** jpich has joined #openstack-qa23:10
mtreinishmarun: haha, fair enough. It was just colorful so it grabbed my attention23:10
marunmtreinish: Tempest is an outlier in their classification, though.23:11
mtreinishmarun: yeah I guess it would be23:13
openstackgerritAaron Rosen proposed a change to openstack/tempest: Replace wait with communicate to avoid potential deadlock  https://review.openstack.org/12328023:13
marunmtreinish: I think unit ~= small and functional ~= medium for in-project tests.  I don't think any project but swift has in-tree tests that could be considered large.23:13
*** boden has joined #openstack-qa23:13
marunmtreinish: I think tempest scenario tests could properly be considered large, being end-to-end, so long as the suggestions for execution time limits are ignored.23:14
marun900+ second limits would be terrible!23:15
*** sballe has joined #openstack-qa23:15
*** sballe has quit IRC23:15
notmynamemarun: large == extensive coverage, lots of lines?23:16
mtreinishmarun: heh, yeah our current limit when we kill an individual test is 500 sec. Although it's more likely to fail on an internal timeout before that23:16
openstackgerritAaron Rosen proposed a change to openstack/tempest: Replace wait with communicate to avoid potential deadlock  https://review.openstack.org/12328023:17
mtreinishso adding another 400sec would make everyone very upset23:17
marunnotmyname: I think that's part of it anyway.23:18
notmynamemarun: oh. I see the link now23:18
*** boden has quit IRC23:18
marunnotmyname: iirc the swift functional tests are pretty involved in a way that most openstack projects don't attempt to test.23:18
notmynamemarun: swift functional tests are a client that can be run against any arbitrary swift endpoint (including public cloud providers)23:19
notmynamemarun: but we also have "probe tests" which are like cluster integration tests (white box testing. eg write 3 replicas, kill one, make sure replication puts it back). unfortunately, those aren't yet run in the gate23:19
notmynameand, fwiw, on my saio, functests: "Ran 307 tests in 125.440s". unittests: "Ran 3155 tests in 106.491s". probetests: "Ran 19 tests in 457.813s"23:21
marunnotmyname: We're thinking of how to simulating multi-node with fault injection for Neutron with containers...  Not sure how that would work with Swift.23:21
marunnotmyname: It's good to see a healthy split between different types of testing.23:22
marunnotmyname: I'm trying to move Neutron in that direction - we try to do too much in unit tests to the point that nobody really understands that a unit test is supposed to have subsecond execution. :/23:22
notmynamecool23:23
marunnotmyname: Why don't the probe tests run in the gate?23:23
marunnotmyname: Is there a technical limitation?23:23
notmynameI'm proud of our test coverage in swift, but we could certainly be better about some of the unit testing. there are parts that really (_really_) stretch the definition of unit tests23:23
marunmtreinish: 500s! Although, the way things run in the gate resource starvation is a significant factor in execution time.23:25
notmynamemarun: ya, the probe tests require the swift all-in-one setup (ie number of processes, filesystem mountpoints, presence of certain scripts). and the gate is (in general) "run it in devstack". so nobody has taken the time to either rewrite the probetests or rewrite devstack-swift or update the gate to run a SAIO23:26
openstackgerritDavid Lyle proposed a change to openstack/tempest: Restoring dashboard tests  https://review.openstack.org/12328123:26
marunnotmyname: ah, right.23:26
marunnotmyname: I've started thinking of devstack as being an impediment to new kinds of testing.23:27
mtreinishmarun: honestly I haven't see us hit a 500sec per test timeout in well over a year. It's more likely we'll timeout on the 196sec we allocate for build timeouts or ssh timeouts.23:27
marunmtreinish: ah, fair enough.23:27
marunnotmyname: I think it would be helpful if projects could define their deployment semantics using a common framework that something like devstack could consume, but that could be reused to support testing of the projects in isolation.23:28
mtreinishmarun: I also should probably fix the total time reporting from a tempest run because IIRC the number we print is the sum of all the individual tests instead of the end_time - start_time23:29
*** proverma has joined #openstack-qa23:29
*** atiwari has quit IRC23:29
mtreinishright now the output on the console run X tests in Y sec makes it seem like things are really slow...23:29
notmynamemarun: I totally support testing projects in isolation. I've wanted that for a long time23:30
marunmtreinish: Hmmm, and is the summation what appears in the jenkins results?23:30
notmynamemarun: eg there's no reason to do multiple neutron test runs with different DB backends on every swift patch. there's no way a swift patch could break that. but yet that's what happens :-(23:30
mtreinishmarun: the jenkins results are end_time - start_time, but that also includes the devstack time and other related setup23:31
marunnotmyname: doing dependency analysis on each patch is something I'm planning on pushing for.23:31
notmynames/neutron//23:31
marunnotmyname: I'm hoping to start small - limited the integrated jobs that run for Neutron, e.g. don't run integrated jobs if only the test tree was updated.23:31
marunmtreinish: ah, ok.23:31
notmynamemarun: so here's a variation on your proposed "define your deployment semantics" (which to me sounds like "give us a puppet/chef script"..23:32
marunmtreinish: +1 to providing both elapsed and total time23:33
*** yamahata has joined #openstack-qa23:34
notmynamemarun: never mind. I tried typing out my idea, and it's a bad idea and I feel bad.23:34
notmynamemarun: I support your idea :-)23:34
marunnotmyname: heh23:34
marunnotmyname: I'm sure it was well-intentioned.23:35
marunnotmyname: deployment is always a pain point.23:35
*** kumartin is now known as kmartin_away23:35
notmynamemarun: I just realized that my idea would still require something like your's anyway. eg "give me 4 mountpoints at A,B,C,D"23:36
notmynamemarun: isn't that what heat is supposed to solve? ;-)23:36
marunnotmyname: hah23:36
marunnotmyname: so many ways to solve similar problems, I can never keep track23:36
marunnotmyname: I do like the idea of each project owning its deployment semantics, though.23:37
notmynameopenstack projects are required to provide a heat template for their testing. the heat version used is whatever was in the last integrated release23:37
notmynamemarun: +1000 to that!23:37
marunnotmyname: I think we'll start seeing responsibility devolve away from devstack as projects take more responsibility for testing.23:38
marunIn the end, the world will be perfect. ;)23:38
marunnotmyname: I'm not familiar enough with heat to understand the implications of that.23:39
notmynameya, me either23:40
marunnotmyname: Would it be possible to provide a template that would deploy swift?  i.e. replace puppet/chef/etc?23:40
jogomtreinish: re: deleting instances, so any case where an instance fails to delete should cause tempest to fail (in theory, not in reality)?23:41
*** zz_dimtruck is now known as dimtruck23:42
jogomarun mtreinish: https://github.com/Netflix/Hystrix23:42
notmynamemarun: I don't know if such a thing exists today. the 2 ways I've seen to easlity set up swift are https://github.com/swiftstack/vagrant-swift-all-in-one and http://serverascode.com/2014/06/12/run-swift-in-docker.html23:43
jogosomething we may want to consider, Shevek from nebula pointed it out to me a while back23:43
jogohmm its java23:50
jogoit sounds very useful though: https://github.com/Netflix/Hystrix/wiki23:52
jogolifeless: https://github.com/Netflix/Hystrix/wiki23:53
lifelessjogo: +123:53
lifelessjogo: thats a great distributed system design pattern23:53
jogolifeless: so its in java23:54
openstackgerritAaron Rosen proposed a change to openstack/tempest: Use processutils and remove duplicate ping code  https://review.openstack.org/12328523:54
jogolifeless: I think you should port it into python :)23:54
lifelessjogo: I know :)23:54
lifelessjogo: possibly indeed.23:54
jogolifeless: yeah it sounds like something that would help make OpenStack much more reliable23:54
lifelessjogo: I was pondering a python impl of raft actually23:54
lifelesssince I've come to coclude that ampq is the source of much fragility in our design23:55
marunjogo, lifeless: http://the-paper-trail.org/blog/distributed-systems-theory-for-the-distributed-systems-engineer/23:55
jogolifeless: raft?23:55
lifelessjogo: and I'd be included to start at the bottom23:55
marunWe need to spread this as far and wide as possible :)23:55
lifelessjogo: read marun's link.23:55
lifelessjogo: erm actually perhaps not that one; let me see23:55
jogolifeless:  http://raftconsensus.github.io/ ?23:56
marunlifeless: would love to have more/better info if you have it23:56
lifelessjogo: ah, I mean kafka23:56
jogohttp://kafka.apache.org/ ?23:56
lifelessjogo: marun: http://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying23:56
lifeless^ that is totally wortha  read23:56
clarkbkafka has python bindings somewhere. not sure how good they are23:56
lifelessit brought together a bunch of things I already knew23:56
marundanke23:57
lifelessclarkb: I meant impl, since openstack is so java averse.23:57
openstackgerritMiguel Lavalle proposed a change to openstack/tempest: Migrate test_load_balancer_basic to tempest client  https://review.openstack.org/11823223:57
clarkblifeless: I mean why should we care if you have a java service? we run an erlang service as part of this thing23:57
lifelessmarun: also 'release it' is a good book to read about operational readiness of things like openstack23:57
lifelessclarkb: I agree.23:57
lifelessclarkb: I am not endorsing the averseness.23:57
lifelessclarkb: I am merely acknowledging that we're languagist en mass.23:58
*** hemna is now known as hemnass23:58
marunclarkb: java is painful23:58
lifelessclarkb: TBH the JVM is a hell of a lot better operationally than CPython, due to all the things that make getting started with it in the first place hard (like fixed memory footprints)23:58
clarkbmarun: but its a thing you just run and never have to look at the guts of23:59
lifelessclarkb: but - its a much steeper learning curve to operate for first-time folk23:59
clarkblifeless: btw https://bugs.launchpad.net/ubuntu/+source/python3.4/+bug/1367907 has an assignee23:59
marunclarkb: like gerrit? :p23:59
clarkbmarun: no like rabbit. when did you write erlang last?23:59
*** aimon has quit IRC23:59
clarkbor elasticsearch23:59
clarkbmysql and postgres fall in the same bunch too though they are Cish23:59
marungood thing I don't have problems with rabbit23:59
maruntheir contribution model is terrile23:59
marunterrible23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!