Wednesday, 2014-07-09

*** sabeen1 has quit IRC00:03
*** gszasz has quit IRC00:04
*** wramthun has quit IRC00:09
*** dmorita has joined #openstack-qa00:09
*** wramthun has joined #openstack-qa00:09
*** sweston has joined #openstack-qa00:11
openstackrecheckConsole logs not available after 13:30s for check-tempest-dsvm-full 105307,6,1c0da0300:12
*** gfidente has quit IRC00:16
*** dims__ has quit IRC00:20
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-full 100421,17,929a18900:26
openstackrecheckConsole logs not available after 13:23s for check-grenade-dsvm 98688,25,93120c000:39
*** dims__ has joined #openstack-qa00:44
*** salv-orlando has quit IRC00:50
openstackrecheckConsole logs not available after 13:24s for gate-heat-pep8 100424,17,70e57ad00:53
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Merge duplicate code for network quotas tests  https://review.openstack.org/10473700:55
openstackgerritA change was merged to openstack/tempest: Add Ironic show driver API test  https://review.openstack.org/9003501:01
openstackrecheckConsole logs not available after 13:26s for gate-heat-pep8 103441,11,a5f3ab601:06
*** mmaglana has quit IRC01:11
*** ekhugen has joined #openstack-qa01:16
*** ekhugen has quit IRC01:18
*** obondarev has joined #openstack-qa01:19
openstackrecheckConsole logs not available after 13:21s for check-grenade-dsvm 85453,17,de555f301:19
*** aysyd has quit IRC01:23
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 97985,23,bf53e2001:33
openstackgerritA change was merged to openstack-infra/devstack-gate: Stop doing tricky things with mirrors  https://review.openstack.org/10336301:36
*** nosnos has joined #openstack-qa01:44
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-postgres-full 98687,25,6026a3e01:46
*** zhiyan_ is now known as zhiyan01:47
*** arnaud has joined #openstack-qa01:47
*** Sukhdev has quit IRC01:51
*** zhiyan is now known as zhiyan_01:56
*** zhiyan_ is now known as zhiyan01:56
openstackrecheckConsole logs not available after 13:21s for gate-heat-pep8 101782,13,fd66ae402:00
*** sweston_ has joined #openstack-qa02:03
*** jamielennox|away is now known as jamielennox02:12
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 97983,23,6c7dcc702:13
*** jyuso has joined #openstack-qa02:16
*** arnaud has quit IRC02:25
openstackrecheckConsole logs not available after 13:21s for gate-heat-pep8 101397,14,80556f502:26
openstackrecheckConsole logs not available after 13:21s for gate-heat-pep8 101396,14,ca27b0d02:40
*** oomichi has joined #openstack-qa02:45
*** SridharG has joined #openstack-qa02:47
*** harlowja is now known as harlowja_away02:50
openstackrecheckConsole logs not available after 13:21s for gate-keystone-docs 105597,1,fe5965002:53
*** mmaglana has joined #openstack-qa02:58
*** sweston has quit IRC02:58
*** sweston_ has quit IRC02:59
*** arnaud has joined #openstack-qa03:01
*** shardy has quit IRC03:01
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 92443,6,686fe0403:06
*** SridharG has quit IRC03:13
*** adalbas has quit IRC03:17
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python26 105598,1,026ff3703:20
*** nosnos has quit IRC03:20
*** arnaud has quit IRC03:20
*** nati_ueno has quit IRC03:22
*** arnaud has joined #openstack-qa03:27
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-neutron 105599,1,bebc16003:33
*** arnaud has quit IRC03:42
*** arnaud has joined #openstack-qa03:43
openstackrecheckConsole logs not available after 13:21s for gate-grenade-dsvm 100556,2,4657bbf03:46
*** dims__ has quit IRC03:55
*** arnaud has quit IRC03:59
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 105065,1,f7cb97004:00
*** marun has joined #openstack-qa04:03
*** mmaglana has quit IRC04:03
*** yamahata has joined #openstack-qa04:03
*** arnaud has joined #openstack-qa04:05
*** nosnos has joined #openstack-qa04:13
openstackrecheckConsole logs not available after 14:17s for gate-grenade-dsvm 105538,1,5b25a3e04:14
*** sweston has joined #openstack-qa04:15
*** sweston_ has joined #openstack-qa04:17
*** sweston__ has joined #openstack-qa04:17
jogomtreinish: you around?04:18
*** sweston has quit IRC04:18
jogohm maybe not its late04:18
*** sweston has joined #openstack-qa04:18
*** gmann has joined #openstack-qa04:22
*** nosnos has quit IRC04:24
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-postgres-full 98683,25,280fe6104:28
*** yfried__ has quit IRC04:30
*** amitpp has joined #openstack-qa04:32
*** amitpp has quit IRC04:34
openstackgerritGhanshyam Mann proposed a change to openstack/tempest: Adds test for Sec group default rule Nova V2 API  https://review.openstack.org/8792404:35
*** weshay has quit IRC04:38
*** amitpp has joined #openstack-qa04:38
openstackrecheckConsole logs not available after 13:21s for gate-nova-pep8 105613,1,50dc5a504:41
*** SridharG has joined #openstack-qa04:50
*** dims__ has joined #openstack-qa04:51
*** sweston has quit IRC04:54
*** sweston_ has quit IRC04:54
*** sweston__ has quit IRC04:54
openstackrecheckConsole logs not available after 13:21s for gate-tempest-dsvm-postgres-full 102028,2,37be75d04:54
*** dims__ has quit IRC04:56
*** dims__ has joined #openstack-qa04:57
*** sweston has joined #openstack-qa04:57
*** sweston_ has joined #openstack-qa04:58
*** sweston__ has joined #openstack-qa04:58
openstackgerritJoe Gordon proposed a change to openstack/tempest: Make os-quota-class-sets test not break quotas  https://review.openstack.org/10565105:01
*** dims__ has quit IRC05:02
*** ildikov has quit IRC05:02
jogosdague mtreinish: ^05:04
jogoI have a hunch my patch needs at least one more revision05:04
openstackrecheckConsole logs not available after 13:21s for gate-horizon-python26 94706,41,249bb5405:08
*** Madan has joined #openstack-qa05:13
*** morganfainberg_Z is now known as morganfainberg05:18
*** chandankumar has joined #openstack-qa05:19
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-postgres-full 104049,6,602cc2205:21
openstackrecheckConsole logs not available after 13:21s for gate-cinder-python26 104703,4,f6a636705:34
openstackrecheckopenstack/python-openstackclient change: https://review.openstack.org/104946 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/129847205:35
*** yfried__ has joined #openstack-qa05:36
*** nmagnezi has joined #openstack-qa05:37
*** nmagnezi has quit IRC05:38
*** k4n0 has joined #openstack-qa05:38
*** nmagnezi has joined #openstack-qa05:38
*** ildikov has joined #openstack-qa05:46
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 105510,2,b27556605:48
*** Anju has joined #openstack-qa05:49
*** coolsvap|afk is now known as coolsvap05:51
*** nmagnezi_ has joined #openstack-qa05:55
*** nmagnezi has quit IRC05:56
*** dims__ has joined #openstack-qa05:58
*** afazekas is now known as __afazekas05:58
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-postgres-full 105541,3,873bcd306:01
*** dims__ has quit IRC06:03
*** xianghui has joined #openstack-qa06:07
*** mkoderer has joined #openstack-qa06:09
*** ajayaa has joined #openstack-qa06:13
openstackrecheckConsole logs not available after 13:21s for gate-nova-python26 105613,2,4bf111706:15
openstackgerritAmit Ugol proposed a change to openstack/tempest: Added Heat Software Config-Deploy API tests  https://review.openstack.org/8979006:23
*** morganfainberg is now known as morganfainberg_Z06:23
*** tkammer has joined #openstack-qa06:24
*** marun has quit IRC06:27
openstackrecheckConsole logs not available after 13:22s for gate-ceilometer-python26 105625,1,de16aaa06:28
*** Longgeek has joined #openstack-qa06:36
openstackrecheckConsole logs not available after 14:18s for check-tempest-dsvm-full 94130,8,c7a869806:42
openstackgerritafazekas proposed a change to openstack-infra/devstack-gate: Neutron default tenant network type vxlan  https://review.openstack.org/10556906:49
*** arnaud has quit IRC06:53
openstackrecheckConsole logs not available after 13:21s for gate-trove-pep8 105632,2,1f96c1d06:56
*** dims__ has joined #openstack-qa06:58
openstackgerritSridhar Gaddam proposed a change to openstack/qa-specs: Spec: Add Provider Networking Scenario tests  https://review.openstack.org/10409806:59
*** dims__ has quit IRC07:03
*** xianghui has quit IRC07:04
*** luqas has joined #openstack-qa07:05
*** luqas has quit IRC07:07
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-neutron-icehouse 81707,8,113e81407:09
*** luqas has joined #openstack-qa07:10
openstackgerritSridhar Gaddam proposed a change to openstack/qa-specs: Spec: Add Provider Networking Scenario tests  https://review.openstack.org/10409807:15
*** jlibosva has joined #openstack-qa07:20
openstackrecheckConsole logs not available after 13:22s for gate-keystonemiddleware-pep8 105634,1,13ca5ba07:23
openstackrecheckopenstack/python-saharaclient change: https://review.openstack.org/100933 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error07:23
*** afazekas has joined #openstack-qa07:25
openstackrecheckConsole logs not available after 13:24s for gate-python-glanceclient-python27 82126,28,d7bd03a07:37
*** gfidente has joined #openstack-qa07:39
yfried__andreaf_: I think this one https://review.openstack.org/100143 could gain a lot from the refactored scenario tree. it shares a lot of functionality and setup with network_basic_ops specifically.07:46
*** shardy has joined #openstack-qa07:47
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm 100776,3,1e303c807:50
*** masayukig has joined #openstack-qa07:54
*** ildikov has quit IRC07:55
*** safchain has joined #openstack-qa07:58
*** jpich has joined #openstack-qa07:58
*** ildikov has joined #openstack-qa07:58
*** dims__ has joined #openstack-qa07:59
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-full 105635,3,8464ab608:04
*** pcrews has quit IRC08:04
*** dims__ has quit IRC08:04
*** xianghui has joined #openstack-qa08:06
openstackrecheckConsole logs not available after 13:58s for gate-python-ceilometerclient-pypy 66776,13,f2ab02108:18
*** zz_johnthetubagu is now known as johnthetubaguy08:26
*** dims__ has joined #openstack-qa08:28
openstackrecheckConsole logs not available after 13:24s for gate-python-heatclient-python27 105110,4,ec1a70d08:31
*** qba73 has joined #openstack-qa08:31
*** jordanP has joined #openstack-qa08:32
*** dims__ has quit IRC08:34
*** Dafna_away is now known as Dafna08:34
*** nmagnezi_ has quit IRC08:36
*** gszasz has joined #openstack-qa08:37
*** nmagnezi has joined #openstack-qa08:37
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-neutron-icehouse 81707,8,f6ed4c008:44
openstackgerritSébastien Han proposed a change to openstack-dev/devstack: Implement Ceph backend for Glance / Cinder / Nova  https://review.openstack.org/6511308:44
openstackgerritSébastien Han proposed a change to openstack-dev/devstack: Implement Ceph backend for Glance / Cinder / Nova  https://review.openstack.org/6511308:47
*** tosky has joined #openstack-qa08:59
openstackgerritA change was merged to openstack-infra/devstack-gate: No more thinging in functions.sh  https://review.openstack.org/10535009:04
openstackrecheckConsole logs not available after 13:23s for gate-grenade-dsvm 101798,2,7b6013209:10
*** jyuso has quit IRC09:22
*** k4n0 has quit IRC09:24
openstackrecheckConsole logs not available after 13:24s for gate-python-glanceclient-pep8 100440,4,6abbeb609:24
*** Longgeek has quit IRC09:27
*** dims__ has joined #openstack-qa09:30
*** ajayaa has quit IRC09:32
openstackgerritAmit Ugol proposed a change to openstack/tempest: Added Heat Software Config-Deploy API tests  https://review.openstack.org/8979009:33
*** dims__ has quit IRC09:35
*** k4n0 has joined #openstack-qa09:35
*** sweston__ has quit IRC09:36
*** sweston has quit IRC09:36
*** sweston_ has quit IRC09:36
openstackrecheckConsole logs not available after 13:22s for gate-nova-pep8 102064,10,85eca2209:38
*** Anju has quit IRC09:40
*** ajayaa has joined #openstack-qa09:45
*** vrovachev has joined #openstack-qa09:46
kashyapafazekas, When you get a min, what do you think about this change -- https://review.openstack.org/#/c/105473/  I don't feel very strongly about this change (i.e. I'm fine with it despite my comment there)09:48
*** yamahata has quit IRC09:48
*** SridharG has quit IRC09:51
openstackrecheckConsole logs not available after 13:24s for gate-keystone-python26 105652,1,7dfbe2909:52
openstackrecheckopenstack-infra/devstack-gate change: https://review.openstack.org/105350 failed gate-tempest-dsvm-postgres-full in the gate queue with an unrecognized error09:52
afazekaskashyap: Which part is not done by devstack ?09:55
kashyapafazekas, Configuring of EPEL repos09:56
kashyapFor getting python-pip09:56
*** ildikov has quit IRC09:57
kashyapInstead Matt suggests to download a script from here to avoid configuring systems with EPEL09:57
kashyaphttps://bootstrap.pypa.io/get-pip.py09:57
*** Longgeek has joined #openstack-qa09:58
*** Longgeek has quit IRC10:05
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-postgres-full 104026,5,380a8dc10:06
afazekaskeshyap: python-pip-1.3.1-4.el6.noarch.rpm in epel-6   pytthon-pip>=1.4.1 required10:10
afazekasthe `easy_install` would be another way..10:12
*** ildikov has joined #openstack-qa10:16
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-postgres-full 101798,2,dd891fa10:19
*** MIDENN_ has quit IRC10:23
*** dims__ has joined #openstack-qa10:31
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-full 104606,4,52ec3e510:33
*** tkammer has quit IRC10:34
*** dims__ has quit IRC10:36
*** NuclearW0rm has joined #openstack-qa10:38
*** Shrews has quit IRC10:43
NuclearW0rmhi folks10:43
NuclearW0rmhow can print to stdout from tempest tests? or it's better to use logging?10:43
*** NuclearW0rm is now known as sergeysh10:44
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 103380,11,29a942310:46
*** Shrews has joined #openstack-qa10:47
*** yamahata has joined #openstack-qa10:47
*** xianghui has quit IRC10:49
*** tkammer has joined #openstack-qa10:50
*** weshay has joined #openstack-qa10:57
openstackrecheckConsole logs not available after 13:23s for check-grenade-dsvm 105069,3,c5e817c11:00
*** Anju has joined #openstack-qa11:00
*** xianghui has joined #openstack-qa11:03
*** gmann has quit IRC11:08
*** dims__ has joined #openstack-qa11:10
openstackrecheckConsole logs not available after 13:23s for gate-python-novaclient-pep8 105658,1,d5173ae11:13
openstackgerritSean Dague proposed a change to openstack/tempest: Make os-quota-class-sets test not break quotas  https://review.openstack.org/10565111:14
*** tkammer has quit IRC11:15
sdagueafazekas: can you look at that11:15
afazekaskashyap: FYI the pip install is changed recently : https://review.openstack.org/#/c/103735/211:18
afazekassdague: -1 to 0 :)  or :(  ;  good catch, I did not expected it..11:21
sdagueyeh, jogo figured it out11:23
sdaguebut his initial patch was a bit more intrusive, so I cleaned it up11:23
afazekassdague: Co-Authored-By: ?11:26
afazekassdague: Per the current commit message you are both the Author Committer and Co-Author11:27
openstackrecheckConsole logs not available after 13:27s for check-grenade-dsvm-icehouse 89790,14,7d388a411:27
kashyapHow do you  frequently do "git pull" of /opt/stack repos?  Or do you use 'RECLONE=yes' to do a fresh clone on every DevStack install?11:28
Anjusdague, afazekas : Hii, I try to use devstack with oracle distribution, so came to know that devstack is not supported for oracle, although it is working for me now.so could we enable this??11:29
kashyapI use this crude script to do that - http://kashyapc.fedorapeople.org/virt/openstack/update-git.bash11:29
afazekassdague: can you fix the commit message ?11:31
openstackgerritAjaya Agrawal proposed a change to openstack/tempest: Running without keystone v3 doesn't require uri_v3  https://review.openstack.org/10570611:32
sdagueafazekas: I'm not the Author11:33
sdagueoh, I am the author11:34
sdaguewtf11:34
sdagueoh.... right I know why11:34
sdagueafazekas: yes, I will fix11:34
openstackgerritSean Dague proposed a change to openstack/tempest: Make os-quota-class-sets test not break quotas  https://review.openstack.org/10565111:35
Anjusdague: ^^^11:38
*** Longgeek has joined #openstack-qa11:38
openstackrecheckConsole logs not available after 13:30s for gate-nova-python26 94295,27,21f919111:41
*** tkammer has joined #openstack-qa11:44
sdagueAnju: oracle's distro is basically just centos right?11:45
Anjuyes11:45
Anjusame packages.11:46
sdagueAnju: if it's only a flag to make is_fedora return true on oracle, I'm fine with it. However if it gets any more complicated than that, will have to discuss it11:46
AnjuI just change Two line in the script , that was working for me .11:46
Anjuyeah. I will raise a bug . whatever you think you can suggest their .11:47
sdagueAnju: a devstack patch is fine11:48
openstackgerritCedric Brandily proposed a change to openstack/tempest: Add multi-provider extension positive test cases  https://review.openstack.org/10452611:48
openstackgerritCedric Brandily proposed a change to openstack/tempest: Add partial specs (multi-)provider extension positive test cases  https://review.openstack.org/10523411:49
Anjuthankyou sean11:50
openstackrecheckConsole logs not available after 13:25s for check-devstack-dsvm-cells 105661,1,7e024c911:55
*** gszasz has quit IRC12:03
*** dmorita has quit IRC12:03
*** gszasz has joined #openstack-qa12:04
*** Poornima has joined #openstack-qa12:04
*** gszasz has quit IRC12:05
*** gszasz has joined #openstack-qa12:05
openstackgerritCedric Brandily proposed a change to openstack/tempest: Add partial specs (multi-)provider extension positive test cases  https://review.openstack.org/10523412:05
*** nmagnezi has quit IRC12:12
*** ekhugen has joined #openstack-qa12:16
openstackrecheckConsole logs not available after 13:24s for gate-python-glanceclient-pypy 105468,2,6d4d53b12:17
*** aysyd has joined #openstack-qa12:23
*** ArxCruz has joined #openstack-qa12:26
*** nmagnezi has joined #openstack-qa12:28
openstackrecheckConsole logs not available after 13:23s for check-grenade-dsvm 86115,10,184dbc412:31
*** cdent has joined #openstack-qa12:31
*** dims__ has quit IRC12:32
*** dims__ has joined #openstack-qa12:32
*** mwagner_lap has joined #openstack-qa12:36
*** cdent has quit IRC12:36
yfried__ I noticed that sometimes, testr workers might fail and decrease concurrency. is this a known issue?12:38
yfried__ - WARNING: missing Worker 6! Race in testr accounting.12:38
*** adalbas has joined #openstack-qa12:38
yfried__afazekas: http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiUmFjZSBpbiB0ZXN0ciBhY2NvdW50aW5nLlwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiJhbGwiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDA0OTA5NjA4MDA1LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ912:41
*** cdent has joined #openstack-qa12:42
*** mkoderer has quit IRC12:42
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-full 105628,1,cbd075f12:44
*** nmagnezi has quit IRC12:44
*** nmagnezi has joined #openstack-qa12:45
mtreinishyfried__: that's just a counting error in testr, the workers are still there12:47
mtreinishyfried__: https://bugs.launchpad.net/testrepository/+bug/131685812:48
yfried__mtreinish: I ran it with 2 workers and lost one, seems like all tests were executed by the remaining worker => serial run12:48
*** dkranz has joined #openstack-qa12:49
mtreinishyfried__: the concurrency didn't change it's still running with 2 workers12:50
mtreinishit's just the worker # being reported is getting overwritten by testr incorrectly12:50
mtreinishso it looks like it's serial12:50
mtreinishlook at the logs carefully you'll see 2 worker threads started12:51
yfried__tnx\12:53
yfried__tnx12:53
yfried__mtreinish: tnx12:53
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-neutron-heat-slow 104430,2,3c4c54312:58
*** yfried__ has quit IRC12:58
openstackgerritSébastien Han proposed a change to openstack-dev/devstack: Implement Ceph backend for Glance / Cinder / Nova  https://review.openstack.org/6511312:59
vrovachevmtreinish: hi, please see my answers in your spare time: https://review.openstack.org/#/c/71259/13:00
*** sballe has joined #openstack-qa13:01
*** asselin has quit IRC13:07
*** asselin has joined #openstack-qa13:07
*** Anju has quit IRC13:10
*** oomichi has quit IRC13:10
*** zul has quit IRC13:11
openstackrecheckConsole logs not available after 13:22s for gate-tempest-dsvm-full 105361,2,132290613:11
*** ildikov has quit IRC13:14
*** amotoki has quit IRC13:16
*** nsaje is now known as nsaje-commute13:17
*** mriedem has joined #openstack-qa13:18
*** zul has joined #openstack-qa13:18
sdaguemtreinish: so I posted a very long, different set of thoughts to eglynn-offic-afk's email, which I think is a different POV than you have.13:18
sdaguejust read yours after mine went out13:19
mtreinishsdague: ok, different opinions are good :)13:21
mtreinishI'll read yours when I get it13:21
*** Madan has quit IRC13:23
*** Longgeek has quit IRC13:25
openstackrecheckConsole logs not available after 13:23s for gate-python-glanceclient-python26 105468,3,11c415a13:25
*** masayukig has quit IRC13:27
sdaguemriedem: did you see that jogo figured out the fixed ip thing? :)13:28
sdaguemriedem: https://review.openstack.org/#/c/105651/13:28
mriedemsdague: nope, just got in13:28
mtreinishsdague: oh, so it's mriedem fault then :)13:28
*** jgrimm has joined #openstack-qa13:28
mriedemyay13:28
*** Obulpathi has joined #openstack-qa13:29
*** Obulpathi has quit IRC13:29
*** Obulpathi has joined #openstack-qa13:29
*** Obulpathi has quit IRC13:29
*** rodrigods has joined #openstack-qa13:30
*** rodrigods has joined #openstack-qa13:30
mriedemso does the lock not work, or unrelated?13:30
*** Obulpathi has joined #openstack-qa13:30
mriedemoh is devstack setting -1 for default quota (unlimited)?13:30
mtreinishmriedem: it's not enough, because the quotas effect the server creates13:31
mtreinishthe lock only prevents us from overlapping with the other quota tests13:31
*** dustins has joined #openstack-qa13:31
mtreinishbut that test really isn't safe for all of compute13:31
mtreinishsdague: I think we have basically the same opinion on the branchless tempest side of things.13:32
mtreinishI think the only real difference was I said the ceilo tests could have a place in tempest13:32
mriedemmtreinish: sdague: ok i see so set it artificially high to avoid over quota as a result of racing with that test13:32
mriedemi'm surprised that didn't hit in jenkins runs of the tempest change13:33
mtreinishsdague: oh and then there was your rather large section about being burnt out on gate debug :)13:33
*** masayukig has joined #openstack-qa13:34
*** rodrigods has quit IRC13:34
*** Longgeek has joined #openstack-qa13:35
mtreinishmriedem: yeah it's just more heinsenbug races. We'll never see it when we're looking for it13:35
mriedemi see that devstack sets default quotas to -1 if using the fake virt driver in nova, is that used in the gate? assuming only for the large ops test?13:36
mtreinishyeah the fake driver should only be with the large ops tests13:36
mriedemhmm, so how would we get a quota of -1 in a dsvm tempest full run?13:37
sdagueI thought the new default was -113:37
mriedemin nova? news to me.13:37
mriedemlooking13:37
mtreinishmriedem: don't we log the conf files?13:37
mriedemmtreinish: yeah looking13:38
mriedemsdague: mtreinish: http://logs.openstack.org/57/105257/4/check/check-tempest-dsvm-full/9bf9ad1/logs/screen-n-cpu.txt.gz#_2014-07-08_00_33_43_67813:38
mriedemquota_instances=10 by default there13:38
openstackrecheckConsole logs not available after 13:23s for gate-python-keystoneclient-python27 96763,4,95dd57513:39
mriedemso the -1 default quota should only be an issue in the large ops test13:39
*** tkammer has quit IRC13:39
*** dims_ has joined #openstack-qa13:39
*** markmcclain has joined #openstack-qa13:39
*** pcrews has joined #openstack-qa13:40
mriedemconfirming large ops http://logs.openstack.org/57/105257/4/check/gate-tempest-dsvm-large-ops/8b48553/logs/screen-n-cpu.txt.gz#_2014-07-08_00_37_48_53613:40
mriedemchecking where that was failing mostly, if it was large ops then we're good13:41
*** eglynn-regus has joined #openstack-qa13:41
*** yfried__ has joined #openstack-qa13:41
*** davidlenwell_ has joined #openstack-qa13:41
*** yfried__ has quit IRC13:41
*** yfried__ has joined #openstack-qa13:42
*** lifeless1 has joined #openstack-qa13:43
*** SpamapS_ has joined #openstack-qa13:44
mriedemoh nevermind yeah default quota for fixed_ips is -113:44
mriedemso this should fix it, nice work jogo!13:44
*** cnesa has joined #openstack-qa13:44
mriedemand vishy was on the case too13:45
*** dkranz has quit IRC13:45
*** rodrigods has joined #openstack-qa13:45
mriedemmaybe we should have made the quota 255? i think the fixed_ips table is loaded with a range of 25613:46
*** MmikeM has joined #openstack-qa13:46
*** mitz- has joined #openstack-qa13:47
*** dansmith_ has joined #openstack-qa13:47
*** mordred_ has joined #openstack-qa13:47
*** nmagnezi has quit IRC13:48
*** dims__ has quit IRC13:48
*** Poornima has quit IRC13:48
*** gema has quit IRC13:48
*** coolsvap has quit IRC13:48
*** Mmike has quit IRC13:48
*** mitz has quit IRC13:48
*** krtaylor has quit IRC13:48
*** mordred has quit IRC13:48
*** dansmith has quit IRC13:48
*** mordred_ is now known as mordred13:48
*** jogo has quit IRC13:48
*** eezhova has quit IRC13:48
*** davidlenwell has quit IRC13:48
*** SpamapS has quit IRC13:48
*** lifeless has quit IRC13:48
*** anteaya has quit IRC13:48
*** sdague has quit IRC13:48
*** eglynn-offic-afk has quit IRC13:48
*** dansmith_ is now known as dansmith13:48
*** jogo has joined #openstack-qa13:49
mtreinishmriedem: what if there is more than one /24 though?13:49
*** Poornima has joined #openstack-qa13:49
*** gema has joined #openstack-qa13:51
*** cnesa2 has joined #openstack-qa13:51
*** cnesa has quit IRC13:51
*** andreaf has joined #openstack-qa13:51
*** rodrigods has quit IRC13:52
*** yamahata has quit IRC13:52
*** yamahata has joined #openstack-qa13:53
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-full 105477,1,faa442313:53
*** cpallares has joined #openstack-qa13:53
*** sdague has joined #openstack-qa13:53
*** eezhova has joined #openstack-qa13:54
*** anteaya has joined #openstack-qa13:55
*** tkammer has joined #openstack-qa13:55
afazekassdague: Can you be more specific what is the expected change ?  https://review.openstack.org/#/c/98178/13:55
*** nmagnezi has joined #openstack-qa13:56
*** markmcclain has quit IRC13:56
sdagueafazekas: ok, it wasn't clear from the commit message that it was a parity patch13:57
sdaguein the general case we shouldn't unconditionally install that I think, we should only do it when certain services exist13:58
*** coolsvap has joined #openstack-qa14:01
*** cnesa2 has quit IRC14:01
*** mordred has quit IRC14:02
*** mordred has joined #openstack-qa14:02
*** MmikeM is now known as Mmike14:03
*** Mmike has quit IRC14:03
*** Mmike has joined #openstack-qa14:03
*** rbak has joined #openstack-qa14:04
*** markmcclain has joined #openstack-qa14:06
openstackrecheckConsole logs not available after 13:25s for check-grenade-dsvm 105665,4,eb89bb314:06
*** krtaylor has joined #openstack-qa14:09
mtreinishmriedem: on https://review.openstack.org/#/c/99984/ can you just respin it quickly to address oomichi's concern14:10
mtreinishjust what is fair game to decorate14:10
*** obondarev has quit IRC14:11
mriedemmtreinish: yeah, was going to get to that today14:11
*** amitpp has quit IRC14:12
mtreinishmriedem: cool, thanks14:12
mtreinishtoday's a good day to do it, being the qa-specs review day :)14:12
mriedemdoing it now14:12
mriedemsad part is i'm still having some weirdness in the code, but i guess that can be worked14:13
mtreinishmriedem: yeah I'm sure we can figure out the code14:15
*** mdenny has joined #openstack-qa14:17
openstackgerritMatt Riedemann proposed a change to openstack/qa-specs: Check minimum version for CLI tests  https://review.openstack.org/9998414:17
mriedemlet me know about that wording ^14:18
mtreinishmriedem: it looks fine to me14:19
openstackrecheckConsole logs not available after 13:25s for gate-tempest-dsvm-large-ops 103064,6,0b9dc5a14:20
openstackgerritCedric Brandily proposed a change to openstack/tempest: Add partial specs (multi-)provider extension positive test cases  https://review.openstack.org/10523414:20
*** ajayaa has quit IRC14:21
*** jaypipes has joined #openstack-qa14:27
*** ChanServ sets mode: +o jaypipes14:27
cpallaressdague: ping14:29
*** Poornima has left #openstack-qa14:32
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds list users tests in v3  https://review.openstack.org/9370414:32
kashyapcpallares, You might want to ping with context. And, a friendly reminder :-)   --  http://blogs.gnome.org/markmc/2014/02/20/naked-pings/14:33
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-neutron 105476,1,9f9e70e14:34
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: add glance deadlock query  https://review.openstack.org/10575214:34
sdaguemriedem / mtreinish ^^^14:36
mriedemsdague: already got it14:36
*** mkoderer has joined #openstack-qa14:37
mriedemi'll push some e-r queries for uncategorized nova unit test gate fails shortly14:38
openstackgerritA change was merged to openstack-infra/elastic-recheck: add glance deadlock query  https://review.openstack.org/10575214:39
sdaguemriedem: cool14:39
*** rodrigods has joined #openstack-qa14:39
*** rodrigods has quit IRC14:39
*** rodrigods has joined #openstack-qa14:39
openstackgerritA change was merged to openstack/tempest: Make os-quota-class-sets test not break quotas  https://review.openstack.org/10565114:41
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for nova unit test bug 1339739  https://review.openstack.org/10575514:43
cpallareskashyap: My bad, thanks for the link.14:44
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds list users tests in v3  https://review.openstack.org/9370414:45
*** rodrigods has quit IRC14:45
*** gszasz has quit IRC14:45
*** gszasz has joined #openstack-qa14:46
*** morganfainberg_Z is now known as morganfainberg14:46
openstackrecheckConsole logs not available after 13:24s for gate-cinder-docs 104445,1,516e37714:47
*** obondarev has joined #openstack-qa14:48
mtreinishsdague: do you want to give mriedem's spec a review: https://review.openstack.org/99984 if it's all good then I'll push it through14:48
cpallaressdague, kashyap: Hi! I'm an intern working on glance and I'm having an issue with tempest checks, they are failing on my patch for what appears to be reasons unrelated to my patch. I checked the logs a couple of times and I can't find the the specific failures related to the code I'm modifying https://review.openstack.org/#/c/98862/14:48
mriedemcpallares: did you ask for help in #openstack-glance first?14:50
mriedemcpallares: this looks like the failure on setup http://logs.openstack.org/62/98862/8/check/check-tempest-dsvm-full/fda0968/logs/devstacklog.txt.gz#_2014-07-08_16_48_08_65714:50
mriedemcpallares: my guess is you're removing a shell command that devstack is using14:51
mriedemso you'd have to cleanup devstack first14:51
cpallaresmriedem: Hi, yes they all seem to fail at setup.14:51
*** openstackrecheck has quit IRC14:51
mriedemcpallares: yeah, you're breaking devstack :)14:51
*** openstackrecheck has joined #openstack-qa14:51
mriedemis my bet at least14:51
kashyapcpallares, No worries. You're in good hands of mriedem. I'm afraid I've to run out for dinner, it's a bit late here.14:51
cpallareskashyap: Enjoy your dinner14:51
openstackgerritA change was merged to openstack/qa-specs: QA spec for bp:add-basic-tests-for-barbican  https://review.openstack.org/9997814:51
cpallaresmriedem: Thanks you, I'll check in with the devstack people then.14:52
mriedemcpallares: the devstack people are here...14:52
mriedemcpallares: just scan the code in devstack for whatever commands you're removing14:53
mriedemhttp://git.openstack.org/cgit/openstack-dev/devstack/14:53
cpallaresmriedem: Ah thanks!14:53
sdaguecpallares: have you read the logs yet?14:55
mriedemjogo: is the uncategorized bugs page going back 2 weeks? looks like it must - shouldn't that be 10 days now?14:55
mriedemreason i ask is there is a nova unit test fail blip that is over 7 days old and is already fixed14:55
sdaguecpallares: because it seems pretty clear where the failure - http://logs.openstack.org/62/98862/7/check/check-tempest-dsvm-full/79b87ac/logs/devstacklog.txt.gz#_2014-07-07_20_10_37_76614:56
*** cdent has quit IRC14:56
mtreinishmriedem: didn't sdague just push the fix that switched it to 10 days from 14?14:57
sdaguemriedem: uncategorized uses ES to find 'all fails'14:57
mriedemmtreinish: yeah, but the status pages are going back 2 weeks14:57
sdagueso it will always match the dataset in ES14:57
mriedemok14:58
*** cdent has joined #openstack-qa14:58
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for nova unit test bug 1339739  https://review.openstack.org/10575514:58
mriedemso i guess i can push a query to get this one nova unit test fail that is fixed off the uncategorized bugs page14:58
openstackgerritRavikumar Venkatesan proposed a change to openstack/tempest: Change of copyright to HP for keystone regions  https://review.openstack.org/10575914:59
*** Sukhdev has joined #openstack-qa15:00
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Categorize fixed fail for nova bug 1330431  https://review.openstack.org/10576015:01
*** HenryG has joined #openstack-qa15:02
*** weshay has quit IRC15:02
*** afazekas has quit IRC15:04
openstackgerritRavikumar Venkatesan proposed a change to openstack/tempest: Change of copyright to HP for keystone regions  https://review.openstack.org/10575915:04
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-full 105743,1,791029815:05
*** sabeen1 has joined #openstack-qa15:06
*** openstackrecheck has quit IRC15:09
*** openstackrecheck has joined #openstack-qa15:09
*** zhiyan is now known as zhiyan_15:10
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Categorize horizon gate rebase unit test fail  https://review.openstack.org/10576515:12
*** jlibosva has quit IRC15:13
openstackgerritA change was merged to openstack-infra/elastic-recheck: Categorize fixed fail for nova bug 1330431  https://review.openstack.org/10576015:16
*** afazekas has joined #openstack-qa15:18
*** SpamapS_ is now known as SpamapS15:21
*** openstackrecheck has quit IRC15:21
*** openstackrecheck has joined #openstack-qa15:21
*** SpamapS has quit IRC15:21
*** SpamapS has joined #openstack-qa15:21
*** sballe has quit IRC15:21
openstackgerritA change was merged to openstack-infra/elastic-recheck: Categorize horizon gate rebase unit test fail  https://review.openstack.org/10576515:21
*** jaypipes is now known as jay-house-hunter15:22
*** cdent_ has joined #openstack-qa15:22
*** cdent_ has quit IRC15:23
*** nmagnezi has quit IRC15:25
*** cdent has quit IRC15:25
*** cdent has joined #openstack-qa15:25
*** openstackrecheck has quit IRC15:35
*** openstackrecheck has joined #openstack-qa15:36
*** Longgeek has quit IRC15:36
*** masayukig has quit IRC15:37
*** Longgeek has joined #openstack-qa15:37
*** nmagnezi has joined #openstack-qa15:37
openstackgerritSean Dague proposed a change to openstack-infra/elastic-recheck: change to correct quoting, ER doesn't seem to pick this up  https://review.openstack.org/10577015:40
*** Longgeek has quit IRC15:40
*** Longgeek has joined #openstack-qa15:40
sdaguemriedem: I'm really confused why that isn't taking, but I think the quoting might be important15:40
*** Obulpathi has quit IRC15:40
mriedemsdague: i was wondering about that, but it did show up in kibana so figured it was ok15:41
sdagueyeh15:41
sdaguewell I just fast approved the quote change15:41
sdagueif that's a thing, so be it15:41
*** masayukig has joined #openstack-qa15:42
*** mlavalle has joined #openstack-qa15:46
*** marun has joined #openstack-qa15:46
openstackrecheckConsole logs not available after 13:23s for check-grenade-dsvm-partial-ncpu 104148,6,3c0694815:49
openstackgerritA change was merged to openstack-infra/elastic-recheck: change to correct quoting, ER doesn't seem to pick this up  https://review.openstack.org/10577015:53
*** afazekas has quit IRC15:58
*** dkranz has joined #openstack-qa15:58
*** safchain has quit IRC16:00
*** sergeysh has quit IRC16:00
*** k4n0 has quit IRC16:01
openstackrecheckConsole logs not available after 13:22s for check-grenade-dsvm 96184,4,db6191c16:03
*** jay-house-hunter has quit IRC16:05
*** afazekas has joined #openstack-qa16:06
*** openstackrecheck has quit IRC16:06
*** openstackrecheck has joined #openstack-qa16:06
*** arnaud has joined #openstack-qa16:10
openstackgerritPrashanth Hari proposed a change to openstack/tempest: Added function to get region from service contexts  https://review.openstack.org/10577716:11
*** vrovachev has quit IRC16:11
openstackgerritPrashanth Hari proposed a change to openstack/tempest: Added function to get region from service contexts  https://review.openstack.org/10577716:12
openstackgerritPrashanth Hari proposed a change to openstack/tempest: Added function to get region from service contexts  https://review.openstack.org/10578216:13
*** chandankumar has quit IRC16:18
*** coolsvap is now known as coolsvap|afk16:18
*** nati_ueno has joined #openstack-qa16:19
openstackrecheckConsole logs not available after 13:28s for gate-tempest-dsvm-postgres-full 100988,6,0b0b2ff16:21
*** SridharG has joined #openstack-qa16:21
*** arnaud has quit IRC16:23
*** jpich has quit IRC16:25
openstackgerritKyle Mestery proposed a change to openstack-dev/devstack: Make neutron the default in devstack  https://review.openstack.org/10578516:28
*** qba73 has quit IRC16:32
openstackrecheckConsole logs not available after 13:29s for check-tempest-dsvm-postgres-full 105745,2,70ce7c616:34
openstackgerritDean Troyer proposed a change to openstack-dev/devstack: Add pre-install phase for extras.d plugins  https://review.openstack.org/10578916:38
*** aimon has quit IRC16:38
*** jgrimm has quit IRC16:42
*** luqas has quit IRC16:46
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 104088,3,8738c8516:48
openstackgerritRamy Asselin proposed a change to openstack/qa-specs: Add qa spec for bp:stress-api-tracking  https://review.openstack.org/9758916:49
*** sweston has joined #openstack-qa16:52
*** tkammer has quit IRC16:53
*** sweston_ has joined #openstack-qa16:53
*** sweston__ has joined #openstack-qa16:53
mroddendo we have any convention for test docstrings?16:54
mroddenin tempest16:54
sdaguemrodden: not as of yet16:55
*** gszasz has quit IRC16:55
mroddenok, was wondering after doing a bunch of reviews yesterday16:55
sdaguemtreinish: do we have a docs target to generate API docs?16:58
*** amitpp has joined #openstack-qa16:59
*** Sukhdev has quit IRC17:00
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 105746,2,86a2e6317:01
*** jordanP has quit IRC17:01
jogosdague: thanks for fixing up my patch17:03
sdaguejogo: thanks for finding it17:03
EmilienMHello Tempest experts, maybe I could have a review on this patch, fixing a bug in Cinder tests: https://review.openstack.org/#/c/105434/17:03
*** harlowja_away is now known as harlowja17:03
EmilienMsdague: and when you have some time, I have a few patches about Javelin.17:03
openstackgerritSteven Hardy proposed a change to openstack/tempest: orchestration add volume backup/restore scenario test  https://review.openstack.org/9014317:05
*** marun has quit IRC17:07
*** mwagner_lap has quit IRC17:08
*** marun has joined #openstack-qa17:09
jogothings look a bit funny today on http://jogo.github.io/gate/17:10
jogopartial-ncpu17:10
mriedemjogo: i like sand castles17:12
clarkbjogo: there is a new bug in partial-ncpu. I bugged dansmith about it last week but he wanted to weekend :)17:12
clarkbjogo: I submitted a thing to nova bugs let me dig it up17:13
jogoclarkb: thanks17:14
jogomriedem: yeah its a pretty awesome one17:14
openstackrecheckConsole logs not available after 13:21s for check-tempest-dsvm-postgres-full 105744,2,df2225217:14
clarkbarg by scrollback doesn't go back far enough /me goes to log archive17:15
mriedemclarkb: you could just go to nova bugs in launchpad and click on 'reported by me'17:15
clarkbmriedem: that didn't work17:15
clarkbhttps://bugs.launchpad.net/nova/+bug/133747217:16
clarkbbecause someone marked it invalid17:16
* clarkb reads17:16
*** marun has quit IRC17:16
mriedemif bug 1326998 was for the same thing it should be duped, not invalidated17:16
clarkbyes of course its using old code17:17
* clarkb tries not to yell17:17
*** johnthetubaguy is now known as zz_johnthetubagu17:17
mriedemclarkb: so we just need to backport https://review.openstack.org/#/c/98667/ to stable/icehouse right?17:17
clarkbjogo: any chance you can clear up 1337472 and point out that it is using old code as I explained in the bug17:17
clarkbmriedem: that would be one fix yes17:17
clarkbI am going to update the bug and mark it valid again17:18
mriedemclarkb: you can probably mark grenade as invalid right?17:18
clarkbmriedem: I think so17:18
mriedemclarkb: ok, apparently not a clean cherry pick, i can do it locally17:18
clarkbmriedem: jogo ok I updated the bug17:20
*** marun has joined #openstack-qa17:21
jogoclarkb: thanks. mriedem awesome17:21
jogodo we have an e-r query for this bug?17:22
clarkbno I had decided to join dansmith in the holidaying >_>17:22
*** afazekas has quit IRC17:23
jogokk I'll put one together17:24
*** mmaglana has joined #openstack-qa17:24
*** aimon has joined #openstack-qa17:24
jogoI wonder why we saw the sudden spike in this though17:24
clarkbit could be something other than the bug above17:27
jogoyeah, this may be a side effect17:27
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 105743,2,2b0fb3517:28
jogowhoa logstash total jobs is way up17:28
sdaguejogo: yeh, we've not drained the logstash queue in days17:28
jogo:/17:28
mriedemjogo: message:"UnboundLocalError: local variable 'domain' referenced before assignment" AND tags:"screen-n-cpu.txt"17:29
jogomriedem: yp thats what I have in my browser17:29
jogopushing a patch now17:29
mriedemk17:29
clarkbsdague: jogo: but we are getting closer to the problem there I hope. I now have the pipeline between logstash and elasticsearch decoupled even more so that I can see if elasticsearch or logstash is at fault. I am really hoping its logstash and then I can upgrade that pice17:29
sdagueclarkb: colio17:30
jogosweet17:30
sdagueclarkb: are you vacationing or not this week?17:31
clarkbwas vacation this week an option?17:32
openstackgerritJoe Gordon proposed a change to openstack-infra/elastic-recheck: Add query for bug 1326998  https://review.openstack.org/10580617:32
jogomriedem: ^17:32
clarkbsdague: I am not vacationing :) though I will be watching the world cup semi final in a bit17:32
mriedemjogo: got it17:33
sdagueclarkb: ok, I wanted to nudge on the os-loganalyze patches, because there is one more that I want to stick on there for date ranges so I can build a cli toolkit to snag all the fail data17:34
clarkbsdague: ok. I have fallen behind on reviews again...17:34
clarkbwill push those to the top17:34
*** arnaud__ has joined #openstack-qa17:34
jogomriedem: http://logs.openstack.org/79/94679/6/check/check-tempest-dsvm-postgres-full/d2225f5/console.html#_2014-07-09_17_27_46_84417:35
jogohave you seen that?17:35
jogoboto fun17:35
dtroyersdague: when you need a break to think about something that isn't a race condition, the Cinder backend changes (https://review.openstack.org/100271) are working plus one more small change required to (https://review.openstack.org/105789, still in check queue) to clear the way for adding Ceph…17:35
mriedemjogo: yes17:35
dkranzclarkb: Is there a recheck bug number for failures like "Failed to fetch http://mirror.rackspace.com/ubuntu/dists/precise-security/multiverse/i18n/Translation-en_US  Unable to connect to mirror.rackspace.com:http:"17:36
mriedemjogo: https://bugs.launchpad.net/nova/+bug/133884117:36
mriedemjogo: i couldn't find a good fingerprint to hit from tempest.txt17:36
clarkbdkranz: yes there is an apt mirror bug17:36
*** mwagner_lap has joined #openstack-qa17:36
mriedemjogo: there was a boto release on 7/117:36
dkranzclarkb: k, I'll look in infra17:36
clarkbdkranz: https://bugs.launchpad.net/openstack-ci/+bug/1286818 thats it17:37
jogomriedem: i'll take a whack at a fingerprint17:37
mriedemjogo: i do have this one: message:"Unexpected OperationalError raised: (OperationalError) asynchronous connection failed" AND tags:"screen-n-api.txt"17:37
dkranzclarkb: thanks17:37
mriedemjogo: i'll push that up for starters17:37
mriedemjogo: looks like that only fails in postgres jobs17:38
*** Sukhdev has joined #openstack-qa17:38
jogomriedem: that may make sense, http://jogo.github.io/gate/ postgres is spiking failure right now17:39
sdaguedtroyer: cool, will look in a couple17:39
jogoalthough we don't have a lot of data at the moment so could be nothing17:39
sdaguejogo: postgres is also the metadata server17:39
*** afazekas has joined #openstack-qa17:39
mriedemahhh17:39
sdaguehonestly, the problem is almost always the metadata server17:39
sdaguethere is so much network voodoo to make that work right17:39
sdaguemagic network addresses are really silly :)17:40
mroddenhttp://en.wikipedia.org/wiki/Link-local_address17:40
mroddenthey are actually really useful in a lot of cases17:40
*** atiwari has joined #openstack-qa17:41
mroddenbut a link local might not be the best idea for the metadata service17:41
openstackrecheckConsole logs not available after 13:21s for gate-nova-docs 105748,1,55acb2917:41
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for bug 1326998  https://review.openstack.org/10580617:41
openstackgerritMatt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for nova ec2 concurrency bug 1338841  https://review.openstack.org/10581117:42
mriedemjogo: sdague: ^ that's at least part of it17:42
jogomriedem yeah that fingerprint looks about right17:42
jogobut there should be stacktrace17:42
sdaguemriedem: looks good to me17:43
*** cpallares has quit IRC17:43
mriedemjogo: there isn't stack trace in the n-api log17:43
mriedemthe ec2 errors are a bit odd when they are in the log17:43
mriedemnothing in the n-api-meta log either17:43
*** davidlenwell_ is now known as davidlelnwell17:44
jogothis may be a boto issue or something17:44
sdaguemriedem: you assume that n-api-meta has even vaguely sensible logging :)17:44
*** davidlelnwell is now known as davidlelnwell__17:44
*** davidlelnwell__ is now known as davidlelnwell17:44
*** davidlelnwell is now known as davidlenwell17:44
mriedemsdague: well, no, i know better17:45
mriedemjogo: if it started around 7/1 then it could be the new boto release17:45
mriedemi'm running the query back 2 weeks17:45
openstackgerritGreg Lucas proposed a change to openstack-dev/devstack: Avoid uploading trove guest image twice  https://review.openstack.org/10581317:46
mriedemdoesn't seem to show up before 7/817:46
jogoany changes to tempest tests boto tests around then?17:48
mriedemjogo: nope17:49
jogo:/17:49
mriedemthat was the first thing i checked yesterday17:49
openstackgerritA change was merged to openstack-infra/elastic-recheck: Add query for nova ec2 concurrency bug 1338841  https://review.openstack.org/10581117:49
*** tosky has quit IRC17:49
*** tosky__ has joined #openstack-qa17:49
*** openstackrecheck has quit IRC17:50
*** openstackrecheck has joined #openstack-qa17:50
jogomriedem: http://stackoverflow.com/questions/17514633/gevent-and-posgres-asynchronous-connection-failed17:51
mtreinishsdague: api docs for tempest?17:51
mtreinishwe use to have the auto mod doc detection enabled, but a pbr upgrade broke that so we turned it off17:54
*** tosky__ is now known as tosky17:54
sdagueah17:54
jogomtreinish: oh i know how to fix taht17:54
jogomtreinish: https://review.openstack.org/#/c/105554/17:54
*** Obulpathi has joined #openstack-qa17:54
mtreinishjogo: cool17:54
*** Obulpathi has quit IRC17:54
mtreinishjogo: want to push it to tempest also?17:55
* jogo yells at mordred 17:55
sdaguejogo: ok, let me add that to my patch17:55
jogomtreinish: sure17:55
sdaguejogo: actually, I'm building a tox target17:55
sdagueso I can add it here17:55
*** Obulpathi has joined #openstack-qa17:55
jogosdague: thanks17:55
mtreinishsdague: I thought I had a patch for docs target already17:55
mtreinishoh it has a -1 from you: https://review.openstack.org/#/c/101075/17:55
mtreinishI missed that17:56
*** weshay has joined #openstack-qa17:56
jogomriedem: this may  be a real postgres bug17:56
jogopsycopg/connection_int.c:            msg = "asynchronous connection failed";17:56
mriedemjogo: just wondering what triggered it17:56
jogomriedem: yeah17:57
jogovery odd17:57
mriedemi'm not seeing much in nova commits related to this in the last 2 days17:57
mriedemi added a requirement for posix_ipc but it was already in the vm's running the tests17:57
jogoI am guessing a dependency thing17:57
mriedemjogo: me too17:57
sdaguemtreinish: ok, you want me to just patch your patch?17:57
mtreinishsdague: sure17:58
jogoii  python-psycopg2                      2.4.5-1build5                        amd64        Python module for PostgreSQL17:58
mtreinishI clearly forgot about it17:58
mriedemjogo: hmm, check this: http://logs.openstack.org/79/94679/6/check/check-tempest-dsvm-postgres-full/d2225f5/logs/pip-freeze.txt.gz17:58
mriedemjogo: boto==2.20.117:58
mriedemlatest boto is 2.3017:58
openstackgerritA change was merged to openstack/qa-specs: Add qa spec for bp/cli-tests-coverage  https://review.openstack.org/10243317:58
jogomriedem: odd17:59
mordredjogo: what did I do?17:59
*** ildikov has joined #openstack-qa17:59
mriedemjogo: psycopg2==2.4.5 is really old too17:59
jogomriedem: https://review.openstack.org/#/c/105554/17:59
mriedemwtf, why is this job running with such old dependencies?17:59
jogomriedem: I see those versions in dpkg -l18:00
mtreinishmriedem, jogo: are they getting satisfied by site-packages somewhere?18:00
jogomtreinish: yeah18:00
mriedemmtreinish: jogo: i was looking at pip-freeze18:00
jogomriedem: http://logs.openstack.org/79/94679/6/check/check-tempest-dsvm-postgres-full/d2225f5/logs/dpkg-l.txt.gz18:00
jogomordred: https://review.openstack.org/#/c/105554/18:00
*** Longgeek has quit IRC18:01
jogomordred: you broke autodocs18:01
mriedemjogo: is there a bug for that?18:01
jogomriedem: for what?18:01
mriedemi'm not familiar with the pbr docs building stuff18:01
jogooh I didn't file a bug18:01
jogofigured it was by design18:02
mriedemso it's really weird that we're running with boto 2.20 in these tests, this is nova's requirement: boto>=2.12.0,!=2.13.018:04
mriedemboto 2.30 is in the pypi.openstack.org mirror18:04
mriedemso why wouldn't we be running with boto 2.3018:05
sdaguemriedem: is boto provided by the distro?18:05
jogosdague: yup18:05
jogodpkg -l lists it18:05
mriedemoh ok18:05
sdaguemriedem: yep18:05
mriedemhmm, well18:05
sdagueso we're now >= to distro level. We could always bump beyond that18:05
mriedemjogo: sdague: should i try a nova patch that runs with latest boto / psycopg2?18:05
jogomriedem: so its not http://changelogs.ubuntu.com/changelogs/pool/main/p/psycopg2/psycopg2_2.4.5-1build5/changelog18:06
mriedemor just psycopg2 i guess18:06
jogoas that has been out for a while18:06
sdaguemriedem: I'd rather not compile psycopg2 from source18:06
mriedemjogo: yeah since 201218:06
sdaguealso, I'm more trusting of the distro for that18:06
jogomriedem: oh http://logs.openstack.org/79/94679/6/check/check-tempest-dsvm-postgres-full/d2225f5/logs/postgres.txt.gz18:06
jogomriedem: actually its from  Sun, 23 Mar 2014 15:28:31 +000018:07
mriedemERROR:  duplicate key value violates unique constraint "assignment_pkey"18:07
sdaguebecause instagram would break if that's borked18:07
sdaguemriedem: yeh, just looks like someone has crappy code18:07
mriedemjogo: i was looking at this https://pypi.python.org/pypi/psycopg2/2.4.518:07
sdagueand that someone is.... keystone?18:07
mriedemah snap18:08
mriedemyup has to be18:08
jogoI like sorry, too many clients already18:08
sdaguealso nova18:08
sdagueaggregates18:08
*** atiwari has quit IRC18:08
sdagueactually, all those dupings are normal18:08
*** amitpp has quit IRC18:09
sdaguedata validation doesn't happen inside the projects18:09
sdaguethey just send it down to the db, watch it explode, and catch that18:09
mriedemah18:09
openstackrecheckConsole logs not available after 13:24s for gate-horizon-python27 105794,1,b08ac5518:09
sdagueUTC FATAL:  sorry, too many clients already18:09
sdaguethat I think is a real issue18:09
mriedemi don't suppose we index that fil18:10
mriedem*file18:10
*** amitpp has joined #openstack-qa18:10
jogomriedem: I don't think so, we added these files pretty recently18:10
sdaguemriedem: nope18:11
*** xianghui has quit IRC18:11
*** marun has quit IRC18:11
jogobut it looks like we should index them.18:11
sdaguejogo: maybe18:11
jogoclarkb: thoughts on indexing http://logs.openstack.org/79/94679/6/check/check-tempest-dsvm-postgres-full/d2225f5/logs/postgres.txt.gz#_2014-07-09_17_05_3518:11
sdaguethat FATAL should expose up though18:11
*** amitpp has quit IRC18:11
sdagueif it's not, that's a problem18:11
*** marun has joined #openstack-qa18:11
mriedemsdague: not seeing it in logstash yet for "sorry, too many clients already"18:12
jogoI think that becomes Unexpected OperationalError raised: (OperationalError) asynchronous connection failed18:12
mriedemyeah18:12
mriedemprobably18:12
clarkbjogo: it looks fine for indexing but I would like to get idnexing under control before we add more variables18:12
sdagueyeh18:12
mriedemso... https://review.openstack.org/#/c/103206/18:12
jogotime stampps match up18:12
sdagueso we really have the info one layer up18:12
mriedemi hit the asynchronous issue there yesterday18:12
mriedemnow it's merged and it's showing up everywhere18:13
sdaguemriedem: oh... wait... you just added it to glance as well, right?18:13
mriedemsdague: yeah18:13
mriedemso nova and glance and cinder (and trove) are running nproc api workeres18:13
sdagueBug 1339735 - Deadlock updating image properties in glance-registry daemon18:13
mriedemha18:13
mriedemconcurrency ftw18:13
sdagueright so importantly, none of these projects are safe to do that18:13
mriedemsdague: to run concurrent api workers?18:14
sdaguemriedem: yep18:14
mriedemwhy do they have options to enable it?18:14
sdaguebecause no one ever did it18:14
sdagueprobably because they copied it from nova18:14
sdagueactually, this should probably get out on list18:14
sdaguebecause it's kind of a big deal18:15
jogosdague: all the bugs in the postgres logs?18:15
*** hemna_ is now known as hemna18:15
sdaguejogo: looking18:15
sdaguejogo: nope, glance is mostly mysql18:15
jogosdague: I wanted to clarify what you think should be brought to the list18:16
jogomriedem: https://review.openstack.org/#/c/103206/ doesn't allign timestamp wise does it?18:16
sdaguethat glance and cinder don't appear to be multi worker safe18:16
mriedemjogo: yeah18:16
mriedemjogo: i'm seeing 7/8 when the asynchronous call fail show up18:16
sdaguegiven their db access patterns18:16
mriedemjogo: and i saw that in https://review.openstack.org/#/c/103206/ yesterday, see comment 4 in the bug18:16
mriedemhttps://bugs.launchpad.net/nova/+bug/1338841/comments/418:17
*** atiwari has joined #openstack-qa18:17
sdaguebecause this feels like a thing we gave neutron no end of shit for, but it turns out it was actually true across the board18:18
jogomriedem: ohh I see that went to the gate several times18:18
jogoso the timestamps do match up18:18
mriedemjogo: yup18:18
mriedemjogo: sdague: shall i revert?18:18
jogois the issue just too many clients in postgres?18:18
sdaguemriedem: honestly, I'd like the ML thread to figure out what people think we should be doing18:18
jogoand config can resolve?18:18
mriedemjogo: configuring postgres you mean?18:19
mriedemmaybe18:19
mriedemsdague: i'm good with that18:19
sdaguebecause reverting isn't the answer if it's still an option that won't work for people18:19
mriedemsdague: because reverting the change doesn't fix the issue for the world given the options are there to set it in deployments18:19
mriedemsdague: :)18:19
mriedemjinx18:19
sdaguemriedem: :)18:19
* jogo is really happy he wrote https://review.openstack.org/#/c/94314/18:20
openstackgerritafazekas proposed a change to openstack-dev/devstack: Promote libffi-dev as a general dependency  https://review.openstack.org/10583118:20
afazekassdague: ^18:20
sdaguejogo: oh, you want to write something else for me :)18:20
jogobeing I don't know anything about postgres,  I am just making things up18:20
jogoabout the postgres config18:20
sdaguecan we take db dumps at the end of the run?18:21
sdagueI realized that might be helpful in debug.18:21
jogohmmm yeah that could be pretty  cool18:21
jogosdague: I'll add that to my TODO list18:21
sdaguedammit man, you are going to make me propose first, eh?18:22
sdaguemtreinish: so autodoc hits the config explode issue18:22
jogoI find it funny how postgres is polite in its error message18:22
jogoit says sorry18:23
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 95696,6,2e5cbaa18:23
sdagueheh18:23
sdaguemtreinish: so I don't think we actually want autodoc18:24
sdaguebecause it's a ton of noise18:24
sdagueI want to figure out how to get just select classes18:24
*** dims_ has quit IRC18:24
*** morganfainberg is now known as morganfainberg_Z18:25
*** dims_ has joined #openstack-qa18:25
jogomriedem: so for https://bugs.launchpad.net/nova/+bug/1338841 should we bring to ML or just look into finding the right postgres conf?18:26
mriedemjogo: we can do both i think18:26
jogomriedem: cool, you want to draft the email? I am off to lunch18:26
mriedemjogo: i'm trying to get this nova icehouse backport up quick for that grenade failure we talked about earlier18:26
jogomriedem: sweet18:26
mriedemjogo: i can do that in a bit, coffee after this18:26
mordredjogo: I'm sure I did it just to annoy you18:27
mriedembut yeah i'll write it up since i wrote the thing that broke it18:27
mtreinishsdague: oh you can do that manually18:27
mtreinishI think you have to symlink the files to the doc source tree18:27
jogomordred:  ^_^18:27
mtreinishand maybe include that in the index.rst to make it discoverable18:27
mtreinishI'd have to check the sphinx docs to confirm though18:27
jogomtreinish: see https://review.openstack.org/#/c/105552/1/doc/source/devref/compute.rst18:28
jogoyou just need something like that18:28
sdaguejogo: oh, cool18:28
mtreinishjogo: yeah exactly18:28
jogomriedem: and see http://git.openstack.org/cgit/openstack/nova/tree/doc/source/conf.py18:28
* jogo finds food18:28
*** SridharG has quit IRC18:32
*** lifeless1 is now known as lifeless18:33
*** SridharG has joined #openstack-qa18:34
openstackrecheckConsole logs not available after 13:25s for check-tempest-dsvm-postgres-full 94599,12,6eebc6f18:36
*** mriedem has quit IRC18:45
*** mriedem has joined #openstack-qa18:48
openstackrecheckConsole logs not available after 13:21s for gate-python-novaclient-python26 104875,5,80219b418:49
mtreinishsdague: was the intent of: https://review.openstack.org/#/c/103216/1 just to cover api extensions or to also include all feature flags?18:51
*** adalbas has quit IRC18:51
*** cpallares has joined #openstack-qa18:52
sdaguehonestly, extensions or some other way in which it's end user discoverable18:54
sdagueI'm not really thrilled about non discoverable configs in there18:55
sdagueI think the rest of the times we've discussed feature flags they are things which are fine in devstack18:55
mtreinishsdague: ok that's fine. Yeah I guess non-discoverable ones would work fine right in devstack if they're default false18:56
mtreinishsdague: the only other discoverable one I can think of not covered by extensions is api versions18:57
sdagueyeh, api versions would be valid18:57
sdagueI think that would fit pretty reasonably in the framework I described18:58
mtreinishok, do you want to add api versions to the spec, or just assume it's implied? I'm fine either way19:00
mriedemjogo: sdague: jgriffith: http://www.postgresql.org/docs/current/static/runtime-config-connection.html#GUC-MAX-CONNECTIONS19:01
mriedemcould try setting that, or synchronous_commit=off19:03
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-neutron-heat-slow 102178,1,5f15db419:03
*** dims_ has quit IRC19:03
*** adalbas has joined #openstack-qa19:07
jgriffithmriedem: sdague so maybe as Duncan was mentioning we should do something more sane for devstack19:08
jgriffithmriedem: sdague set a value based on num api's on the devstack node19:08
jgriffithlike num-cores / num-apis19:09
sdaguejgriffith: oh, you are thinking that we are exceeding that?19:09
sdagueany idea what the current value is?19:09
jgriffithsdague: 100 is default right?19:09
sdagueit says that19:09
sdagueI find it hard to believe that we exceed that19:09
jgriffithsdague: I don't see anything in startup to change19:10
mriedemit says typically 100 but it's set in initdb19:10
mriedembased on kernel settings19:10
jgriffithsdague: well.. Duncan made an interesting point19:10
mriedem"Determines the maximum number of concurrent connections to the database server. The default is typically 100 connections, but might be less if your kernel settings will not support it (as determined during initdb). This parameter can only be set at server start."19:10
jgriffithsdague: 32 core box * cinder19:10
jgriffithglancece nova etc19:10
sdaguesure19:10
jgriffithalthough it should grab the VCPU count I guess19:10
sdaguethough we know the gate concurency is 419:10
mriedemsdague: but we're running with nproc and the vm's are running 8 VCPUs right?19:11
sdagueoh, right 819:11
sdaguewell we have a process dump on one of those runs?19:11
mriedemso nova (3) cinder (1) glance (2) trove (2) heat (1) neutron (1) ceilometer (1) workers * nproc19:12
jgriffithmriedem: seems like we could hit 100 pretty quick19:12
sdagueyeh19:12
mriedemhttp://logs.openstack.org/12/92512/9/gate/gate-tempest-dsvm-postgres-full/3664f6d/logs/screen-dstat.txt.gz19:13
sdagueso bumping that to 200 might be valid as a test19:13
mriedem15:02:3619:13
sdaguemriedem: what are you pointing out there19:13
mriedemlooks like it's nova-api, swift and keystone when it blows up19:13
sdagueso that's just the most expensive process19:14
mriedemsdague: that's dstat when postgres logs have the 'fatal too many client connections' thing19:14
sdaguewhich is not hugely interesting19:14
sdagueswift doesn't talk to the db19:14
sdagueso, I can buy the idea that we are hitting that. Want to propose increasing it to 200?19:15
sdagueI also wonder if there is a way to get the count over time19:15
mriedemsdague: i can push something up to propose 200 sure19:15
sdaguemriedem: if it goes away after that, I think it's clear19:15
jgriffithsdague: mriedem http://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html19:15
mriedemhttp://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html#sysvar_max_connections19:16
mriedemhttp://dev.mysql.com/doc/refman/5.5/en/too-many-connections.html19:16
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-full 90143,17,53ebe7419:16
mriedemso mysql sets 15119:16
mriedemdocs say it used to be 10019:16
mriedembut apparently that wasn't cutting the mustard19:17
sdagueyeh, so lets set pg to 200, if it goes away, so be it.19:17
mriedemk, working on that now19:17
sdagueI kind of which jaypipes was on right now19:17
mriedemi can still send something to the ML later to fish for PG experts19:17
sdaguebecause he might have some thoughts about what we should be doing here at a macro level19:17
sdaguemriedem: +119:17
mriedembecause fsync=off sounds interesting regardless19:17
mtreinishmriedem: I really like the imagery of fishing PG experts :)19:18
*** arnaud__ has quit IRC19:19
marundkranz: https://review.openstack.org/#/c/72585/19:20
mtreinishsdague: did you see my follow up question about your spec before the pg max connection discussion?19:20
sdaguemtreinish: nope19:20
sdagueoh, I'm going to say it's implied19:21
mtreinishsdague: ok cool, then I'll push the spec through19:21
mriedem11*819:22
mtreinish8819:23
mriedemha oops19:26
mriedemwould be nice if we archived postgresql.conf19:26
openstackgerritA change was merged to openstack/qa-specs: branchless tempest extensions spec  https://review.openstack.org/10321619:28
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-postgres-full 105470,3,a45ada519:30
*** jlibosva has joined #openstack-qa19:32
*** jlibosva has quit IRC19:37
*** Sukhdev has quit IRC19:38
*** amitpp has joined #openstack-qa19:39
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Set postgresql max_connections=200  https://review.openstack.org/10585419:42
mriedemsdague: jogo: jgriffith: ^19:42
jgriffithmriedem: nice!19:42
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 103229,9,049ffb319:43
sdaguemriedem: can you call the var MAX_DB_CONNECTIONS19:44
sdaguebecause it's global19:44
mriedemsdague: sure19:44
sdagueI think after that, I'm good with a +219:44
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Set postgresql max_connections=200  https://review.openstack.org/10585419:45
*** dims has joined #openstack-qa19:46
*** SridharG has quit IRC19:49
mriedemsdague: is it weird that it's the ec2 tests hammering the postgresql failure?19:50
*** masayukig has quit IRC19:50
mriedemor maye that's n-api-meta related19:50
sdaguemriedem: honestly, I think it's probably n-api-meta19:50
sdagueand the fact that we're late in the run19:50
sdaguethat adds another 8 connections, right?19:51
*** amitpp has quit IRC19:52
*** mkoderer has quit IRC19:52
mriedemsdague: yup, n-api-meta has it's own workers19:53
openstackgerritMatt Riedemann proposed a change to openstack-dev/devstack: Set postgresql max_connections=200  https://review.openstack.org/10585419:54
mriedem^ fixes the typo19:54
sdagueyeh, that all adds up then19:54
*** dims_ has joined #openstack-qa19:55
*** masayukig has joined #openstack-qa19:55
*** Sukhdev has joined #openstack-qa19:55
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 92976,3,de5a28219:56
*** dims has quit IRC19:57
*** morganfainberg_Z is now known as morganfainberg19:57
openstackgerritSébastien Han proposed a change to openstack-dev/devstack: Implement Ceph backend for Glance / Cinder / Nova  https://review.openstack.org/6511319:58
openstackgerritA change was merged to openstack/qa-specs: Add spec for bp:/fuzzy-test  https://review.openstack.org/9958519:59
*** arnaud has joined #openstack-qa20:02
*** enikanorov__ has joined #openstack-qa20:05
*** enikanorov has quit IRC20:06
openstackrecheckConsole logs not available after 13:24s for gate-horizon-python26 105803,1,6fa1c1d20:10
*** afazekas has quit IRC20:10
jogomriedem: nice20:11
*** krtaylor is now known as krtaylor_away20:14
*** nati_uen_ has joined #openstack-qa20:18
*** jamielennox is now known as jamielennox|away20:19
*** nati_ueno has quit IRC20:20
*** markmcclain has quit IRC20:23
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-postgres-full 105810,1,9c5d63620:23
*** sweston_ has quit IRC20:27
openstackrecheckConsole logs not available after 13:24s for gate-nova-python26 104001,2,6bce56f20:37
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Initial work to add query namespace to elastic-recheck.  https://review.openstack.org/10195820:43
openstackgerritpatrick-crews proposed a change to openstack-infra/elastic-recheck: Initial work to add query namespace to elastic-recheck.  https://review.openstack.org/10195820:45
*** arnaud has quit IRC20:45
*** nmagnezi has quit IRC20:47
*** salv-orlando has joined #openstack-qa20:49
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-postgres-full 86257,8,9a026b620:50
*** sweston__ has quit IRC20:59
openstackgerritCarl Baldwin proposed a change to openstack-dev/devstack: DEVSTACK PATCH FOR INTERIM DVR TESTING  https://review.openstack.org/10318020:59
openstackgerritPaul Michali proposed a change to openstack-dev/devstack: DEVSTACK PATCH FOR INTERIM DVR TESTING  https://review.openstack.org/10318021:04
openstackrecheckConsole logs not available after 13:35s for gate-nova-python26 105748,1,9cc648221:04
*** ekhugen has quit IRC21:04
*** dustins has quit IRC21:07
dkranzmtreinish: what do you think of my last comment on https://review.openstack.org/#/c/94473/ (tempest.conf auto-gen)21:07
mtreinishdkranz: heh, that was next on my list21:08
*** obondarev_ has joined #openstack-qa21:09
dkranzmtreinish: :)21:09
mtreinishdkranz: but I agree, I think making the spec about the building blocks for the script instead of the script itself is a good call21:09
dkranzmtreinish: great. So if you think my three components are controversisal you can comment, or add any others if you think of them.21:10
*** obondarev__ has joined #openstack-qa21:11
*** jamielennox|away is now known as jamielennox21:11
*** obondarev has quit IRC21:12
*** obondarev_ has quit IRC21:12
*** obondarev__ is now known as obondarev21:12
*** mmaglana has quit IRC21:16
*** mmaglana has joined #openstack-qa21:16
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-neutron 104148,6,887fc4521:17
*** Obulpathi has quit IRC21:22
*** markmcclain has joined #openstack-qa21:22
openstackgerritmelanie witt proposed a change to openstack-infra/elastic-recheck: Extend query for pip download timeout bug 1270710  https://review.openstack.org/10588421:27
*** aysyd has quit IRC21:28
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 102585,5,edaa6af21:30
*** arnaud has joined #openstack-qa21:40
*** sballe has joined #openstack-qa21:42
*** jamielennox is now known as jamielennox|away21:43
openstackrecheckConsole logs not available after 13:22s for check-tempest-dsvm-postgres-full 105813,1,27b715d21:44
*** Sukhdev has quit IRC21:55
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-full 105817,1,fa2ea5a21:57
mriedemmtreinish: good with this now? https://review.openstack.org/#/c/99984/22:00
*** gmann has joined #openstack-qa22:02
mtreinishmriedem: +A22:02
*** jay-house-hunter has joined #openstack-qa22:03
mriedem\o/22:03
mriedemsuckers!22:03
openstackgerritA change was merged to openstack/qa-specs: Check minimum version for CLI tests  https://review.openstack.org/9998422:03
mtreinishheh, I marked it as high prio so I'll bug you about it every week during the meeting :)22:04
*** Sukhdev has joined #openstack-qa22:04
*** gmann has quit IRC22:04
mriedemnice, i just have to figure out the issue with the novaclient decorator thing, otherwise the code is basically ready to go22:04
*** gmann has joined #openstack-qa22:04
mriedemit seems to not be happy if the version you're filtering against is the exact version that's installed22:06
mriedemif it's < the installed version like heatclient it's ok22:06
mriedemi'll probably need to run a wip trace patch to debug what's coming back from the command22:06
*** mriedem has quit IRC22:09
openstackrecheckConsole logs not available after 13:23s for check-tempest-dsvm-postgres-full 105815,1,4581e3522:11
mtreinishmriedem: hmm, is that possibly a versionutils bug?22:11
mtreinishyeah I guess there really isn't a good way to tell unless we print out what we're getting from the command and how it differs from what's expected22:12
*** cdent_ has joined #openstack-qa22:20
*** cdent has quit IRC22:23
*** cdent_ is now known as cdent22:23
openstackgerritDean Troyer proposed a change to openstack-dev/devstack: Re-order top of stack.sh  https://review.openstack.org/10589922:24
openstackrecheckConsole logs not available after 13:24s for check-grenade-dsvm 105816,1,d0027fc22:24
*** weshay has quit IRC22:25
*** sweston has quit IRC22:31
*** weshay has joined #openstack-qa22:33
*** weshay has quit IRC22:33
*** sweston has joined #openstack-qa22:34
*** boris-42 has quit IRC22:37
*** jay-house-hunter has quit IRC22:38
openstackrecheckConsole logs not available after 13:23s for gate-tempest-dsvm-neutron-large-ops 94679,6,debbb1922:38
*** boris-42 has joined #openstack-qa22:39
*** gmann has quit IRC22:51
*** andreaf has quit IRC22:53
openstackrecheckConsole logs not available after 13:29s for check-grenade-dsvm-partial-ncpu-icehouse 104290,6,469740b22:56
*** atiwari has quit IRC22:59
*** adalbas has quit IRC23:00
*** rbak has quit IRC23:03
openstackgerritA change was merged to openstack/qa-specs: Add qa spec for bp/tempest-guest-tests  https://review.openstack.org/9563923:04
dkranzmlavalle: https://bugs.launchpad.net/nova/+bug/131150023:04
morganfainbergmtreinish, ping re https://review.openstack.org/#/c/104610/ have the +2 on matter and stable icehouse https://review.openstack.org/#/q/I13ce159cbe9739d4bf5d321fc4bd069245f32734,n,z we can move forward with the QA /tempest skip23:04
mtreinishmorganfainberg: do you have a link for the tempest skip?23:05
mtreinishI'll give it my +223:05
morganfainberghttps://review.openstack.org/#/c/104610/23:05
morganfainbergit needs a recheck, transient failure it looks like23:05
openstackgerritMorgan Fainberg proposed a change to openstack/tempest: Add a skip for bug #1334368  https://review.openstack.org/10461023:05
* morganfainberg rebased instead23:06
morganfainbergmtreinish, thanks!23:06
mtreinishdkranz: ^^^ that should be an easy +2/+A23:07
mtreinishdkranz: also on https://review.openstack.org/#/c/97589/ you had some concerns did asselin address them?23:07
morganfainberggotta run, no battery left and time to go get food23:07
asselinI resolved some this morning from Masayuki Igawa23:08
*** dkranz has quit IRC23:08
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-neutron 53750,10,3a3850723:10
*** sweston has quit IRC23:11
asselinmtreinish,dkranz Masayuki Igawa had some questions unresolved about including an example for non-stress tests. I had a question of where to put the code: #. common/utils10223:11
asselin#. openstack/common23:11
mtreinishasselin: Masayuki's nick is masayukig :)23:12
asselinthanks23:13
mtreinishasselin: either place is fine really. I personally have never really understood what the utils subdir was for23:13
mtreinishit seems a bit redundant to have a common.utils.*utils.py23:14
mtreinishbut it's probably just a hold over23:14
*** HenryG has quit IRC23:16
asselinmtreinish, ok, I'll put it in common then. Perhaps a new subdir: decorators23:16
mtreinishno I don't think that's necessary, you can just make it a module23:17
*** morganfainberg is now known as morganfainberg_Z23:17
mtreinishbecause the functionality isn't really about a decorator but more the tracking23:17
mtreinishthe decorator is just the convienent api you're proposing we use to enable it23:18
asselinok23:18
asselinso common/tracking.py23:19
mtreinishsure, that works23:20
*** Sukhdev has quit IRC23:21
*** marun has quit IRC23:21
*** markmcclain has quit IRC23:21
*** obondarev has quit IRC23:22
openstackrecheckConsole logs not available after 13:24s for check-tempest-dsvm-neutron-icehouse 105818,1,bf8845023:23
*** krtaylor_away is now known as krtaylor23:24
*** mlavalle has quit IRC23:25
asselinmtreinish, any concerns that there's still references to stress tests in that spec? I'm not sure about take some out, but I'm not attached to them.23:25
mtreinishasselin: no I think concentrating on using it for stress tests is fine23:26
asselinok great23:27
mtreinishasselin: my concerns were that this is probably generally useful and I didn't want to hard couple it to the stress tests23:27
openstackgerritRamy Asselin proposed a change to openstack/qa-specs: Add qa spec for bp:stress-api-tracking  https://review.openstack.org/9758923:27
mtreinisheven if using elsewhere isn't explicitly part of the proposal23:27
asselinmtreinish, yes I agree. it will be good to decouple it too up front.23:28
openstackrecheckConsole logs not available after 13:25s for check-tempest-dsvm-neutron-heat-slow 76002,19,c50b8e423:36
*** gmann has joined #openstack-qa23:37
*** Sukhdev has joined #openstack-qa23:38
*** sabeen1 has quit IRC23:41
*** jamielennox|away is now known as jamielennox23:49
openstackrecheckConsole logs not available after 13:24s for gate-tempest-dsvm-postgres-full 105671,1,e38bc0c23:50
*** marun has joined #openstack-qa23:51

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!