Thursday, 2015-04-09

*** BadCub is now known as BadCub_Hiding00:01
*** mriedem has joined #openstack-qa00:07
*** yamamoto_ has quit IRC00:07
*** sputnik13 has quit IRC00:13
*** tsekiyam_ has joined #openstack-qa00:20
dougwighi qa, i'm looking for a recommendation.  for running lbaas v1 and v2 api tests, i need slightly different installs/neutron configs. is there any precedent for reconfiguring neutron after a batch of tests, and then running again?  or should we always burn another node/job?00:21
*** shashankhegde has joined #openstack-qa00:21
*** mtanino has quit IRC00:22
*** mahito has joined #openstack-qa00:22
*** tsekiyama has quit IRC00:22
*** Sukhdev has quit IRC00:23
*** tsekiyam_ has quit IRC00:24
openstackgerritShigeki Obuchi proposed openstack-dev/devstack: [WIP] add config to connect external network  https://review.openstack.org/17154900:41
*** marun has quit IRC00:43
*** gchamoul- has quit IRC00:44
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE testing overlay network options  https://review.openstack.org/17171400:47
*** bknudson has joined #openstack-qa00:48
*** amotoki has joined #openstack-qa00:49
*** jecarey has joined #openstack-qa00:55
*** Longgeek has joined #openstack-qa00:56
*** marcusvrn has joined #openstack-qa01:01
*** rfolco has quit IRC01:05
*** shashankhegde has quit IRC01:07
*** mtanino has joined #openstack-qa01:21
*** mriedem1 has joined #openstack-qa01:28
*** mriedem has quit IRC01:28
*** yamahata has quit IRC01:28
*** dboik_ has quit IRC01:34
*** shashankhegde has joined #openstack-qa01:47
*** shashankhegde has quit IRC01:53
*** dims has quit IRC01:56
*** harlowja is now known as harlowja_away02:03
*** davideagnello has quit IRC02:04
*** luqas has joined #openstack-qa02:14
*** mahito_ has joined #openstack-qa02:15
*** mahito has quit IRC02:17
*** luqas has quit IRC02:19
openstackgerritZhiQiang Fan proposed openstack-dev/hacking: remove h302 from document  https://review.openstack.org/17191002:33
*** jogo has quit IRC02:34
*** yamamoto has joined #openstack-qa02:36
*** mahito has joined #openstack-qa02:40
*** yamahata has joined #openstack-qa02:40
*** annashen has joined #openstack-qa02:41
*** annashen has quit IRC02:42
*** annashen has joined #openstack-qa02:42
*** mahito_ has quit IRC02:43
*** Longgeek has quit IRC02:43
*** Longgeek has joined #openstack-qa02:44
*** mriedem1 is now known as mriedem_away02:48
*** mahito has quit IRC02:54
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE testing overlay network options  https://review.openstack.org/17171403:03
*** annashen has quit IRC03:07
*** alex_xu has quit IRC03:08
*** pal has joined #openstack-qa03:11
*** annashen has joined #openstack-qa03:14
*** pal has quit IRC03:16
*** mahito has joined #openstack-qa03:19
*** Madan has joined #openstack-qa03:19
*** rushiagr_away is now known as rushiagr03:22
*** Longgeek_ has joined #openstack-qa03:29
*** Longgeek has quit IRC03:30
*** erlon has quit IRC03:31
*** annashen has quit IRC03:32
*** rushiagr is now known as rushiagr_away03:36
*** achanda has quit IRC03:38
*** marcusvrn has quit IRC03:41
*** achanda has joined #openstack-qa03:43
*** yamamoto has quit IRC03:44
*** dims has joined #openstack-qa03:45
*** achanda has quit IRC03:45
*** annashen has joined #openstack-qa03:48
*** jogo has joined #openstack-qa03:50
*** dims has quit IRC03:50
*** annashen has quit IRC03:51
*** davideagnello has joined #openstack-qa03:53
*** artom has quit IRC03:53
*** jogo has quit IRC03:55
*** yamahata has quit IRC03:55
*** yamamoto has joined #openstack-qa03:55
*** yamahata has joined #openstack-qa03:55
*** pal has joined #openstack-qa03:57
*** davideagnello has quit IRC03:57
*** mahito has quit IRC03:58
*** coolsvap|afk is now known as coolsvap04:00
*** achanda has joined #openstack-qa04:01
*** rushiagr_away is now known as rushiagr04:02
*** mahito has joined #openstack-qa04:03
*** achanda has quit IRC04:03
*** jogo has joined #openstack-qa04:05
*** fedexo has joined #openstack-qa04:05
*** rodrigods has quit IRC04:08
openstackgerritIan Wienand proposed openstack-dev/devstack: Add a peak memory tracker to dstat  https://review.openstack.org/17191904:10
ianwfungi/clarkb: ^ kind of what we were talking about with tail of memory stats during runs04:10
*** gchamoul has joined #openstack-qa04:10
*** rodrigods has joined #openstack-qa04:12
*** rushiagr is now known as rushiagr_away04:12
*** gchamoul has quit IRC04:15
*** luqas has joined #openstack-qa04:16
*** gchamoul has joined #openstack-qa04:16
*** yamamoto has quit IRC04:19
*** luqas has quit IRC04:21
*** achanda has joined #openstack-qa04:23
*** achanda has quit IRC04:36
*** mahito has quit IRC04:39
*** yamamoto has joined #openstack-qa04:39
*** mahito has joined #openstack-qa04:40
*** gchamoul has quit IRC04:41
*** neeti has joined #openstack-qa04:41
*** gchamoul has joined #openstack-qa04:42
*** melwitt has quit IRC04:47
*** rushiagr_away is now known as rushiagr04:47
*** achanda has joined #openstack-qa04:48
*** rushiagr is now known as rushiagr_away04:58
*** flwang1 has quit IRC05:05
openstackgerritIan Wienand proposed openstack-dev/devstack: Add a peak memory tracker to dstat  https://review.openstack.org/17191905:07
*** sputnik13 has joined #openstack-qa05:10
*** k4n0 has joined #openstack-qa05:15
*** sslypushenko has quit IRC05:17
*** anshul has joined #openstack-qa05:19
*** pal has quit IRC05:21
*** mahito has quit IRC05:32
*** mahito has joined #openstack-qa05:33
*** sputnik13 has quit IRC05:34
*** annashen has joined #openstack-qa05:34
*** BharatK has joined #openstack-qa05:36
*** bkopilov has quit IRC05:41
*** bkopilov has joined #openstack-qa05:43
*** sks has joined #openstack-qa05:49
*** fedexo has quit IRC05:49
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/168064 failed because of: gate-grenade-dsvm: https://bugs.launchpad.net/bugs/140090505:49
openstackLaunchpad bug 1400905 in OpenStack-Gate "Hash Sum mismatch on apt mirrors" [Undecided,Confirmed]05:49
*** dmorita has joined #openstack-qa05:51
*** Poornima has joined #openstack-qa06:02
*** mtanino has quit IRC06:07
*** mahito has quit IRC06:10
*** yamahata has quit IRC06:16
*** annashen has quit IRC06:16
*** mahito has joined #openstack-qa06:17
*** luqas has joined #openstack-qa06:17
*** annashen has joined #openstack-qa06:18
*** yamahata has joined #openstack-qa06:20
*** mahito has quit IRC06:22
*** dratushnyy has quit IRC06:22
*** luqas has quit IRC06:22
*** mahito has joined #openstack-qa06:26
openstackgerritIan Wienand proposed openstack-dev/devstack: [WIP] Add a peak memory tracker to dstat  https://review.openstack.org/17191906:31
*** k4n0 has quit IRC06:31
*** jlibosva has joined #openstack-qa06:35
*** annashen has quit IRC06:36
*** alex_xu has joined #openstack-qa06:40
openstackgerritArmando Migliaccio proposed openstack-dev/devstack: Avoid flushing PUBLIC_BRIDGE during stacking  https://review.openstack.org/17193106:42
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852506:42
*** rushiagr_away is now known as rushiagr06:43
*** safchain has joined #openstack-qa06:43
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: ***DO NOT MERGE*** Flip DVR bit to collect experimental run datapoints  https://review.openstack.org/17180906:44
*** alex_xu has quit IRC06:47
*** yamahata has quit IRC06:48
*** alex_xu has joined #openstack-qa06:51
*** annashen has joined #openstack-qa06:52
*** annashen has quit IRC06:54
*** annashen has joined #openstack-qa06:58
*** markus_z has joined #openstack-qa07:03
*** jordanP has joined #openstack-qa07:07
*** sergsh has joined #openstack-qa07:10
*** e0ne has joined #openstack-qa07:11
*** gchamoul has quit IRC07:12
openstackrecheckopenstack/ceilometer change: https://review.openstack.org/167370 failed gate-ceilometer-python27 in the gate queue with an unrecognized error07:12
*** afazekas has joined #openstack-qa07:13
*** armax has quit IRC07:13
*** hichihara has quit IRC07:14
*** annashen has quit IRC07:14
*** SridharG1 has joined #openstack-qa07:16
*** mahito has quit IRC07:16
*** salv-orlando has joined #openstack-qa07:17
*** bkopilov has quit IRC07:18
*** sergsh has quit IRC07:20
*** ibiris_away is now known as ibiris07:21
*** sergsh has joined #openstack-qa07:22
*** annashen has joined #openstack-qa07:24
*** luqas has joined #openstack-qa07:26
*** salv-orlando has quit IRC07:27
*** salv-orlando has joined #openstack-qa07:28
*** salv-orl_ has joined #openstack-qa07:30
*** salv-orlando has quit IRC07:31
*** achanda has quit IRC07:31
*** gszasz has joined #openstack-qa07:34
*** ibiris is now known as ibiris_away07:35
*** annashen has quit IRC07:36
*** jhenner has joined #openstack-qa07:36
*** achanda has joined #openstack-qa07:37
openstackgerritAbhishek G M proposed openstack/tempest: Test Creation of server in a shared_network  https://review.openstack.org/16891007:41
*** gfidente has joined #openstack-qa07:45
*** achanda has quit IRC07:48
*** oomichi has joined #openstack-qa07:50
*** salv-orl_ has quit IRC07:50
*** ibiris_away is now known as ibiris07:51
*** e0ne is now known as e0ne_07:52
*** dratushnyy has joined #openstack-qa07:55
*** e0ne_ has quit IRC07:57
openstackgerritAbhishek G M proposed openstack/tempest: Test creation of server attached to created port  https://review.openstack.org/16288607:57
*** e0ne has joined #openstack-qa08:00
*** jamielennox is now known as jamielennox|away08:01
*** jlanoux has joined #openstack-qa08:04
*** e0ne has quit IRC08:06
*** oomichi has quit IRC08:06
*** woodster_ has quit IRC08:10
*** andreykurilin_ has joined #openstack-qa08:27
openstackgerritGhe Rivero proposed openstack-dev/devstack: Add ironic files to .gitignore  https://review.openstack.org/17196608:29
*** jlanoux has quit IRC08:30
*** jlanoux has joined #openstack-qa08:34
*** zz_johnthetubagu is now known as johnthetubaguy08:34
*** yamamoto has quit IRC08:34
*** heyongli has joined #openstack-qa08:38
*** cdent has joined #openstack-qa08:40
*** rwsu has quit IRC08:41
*** jyuso has joined #openstack-qa08:43
*** Poornima has quit IRC08:45
*** jhenner has quit IRC08:52
*** e0ne has joined #openstack-qa08:55
openstackgerritAndrew McDermott proposed openstack-dev/devstack: Add support for arm64 images  https://review.openstack.org/17130008:55
*** Poornima has joined #openstack-qa08:58
*** k4n0 has joined #openstack-qa09:08
*** tosky has joined #openstack-qa09:14
*** boris-42 has joined #openstack-qa09:16
*** jhenner has joined #openstack-qa09:16
*** pcaruana has joined #openstack-qa09:17
*** apevec has joined #openstack-qa09:17
*** apevec has quit IRC09:17
*** apevec has joined #openstack-qa09:17
*** e0ne is now known as e0ne_09:18
*** coolsvap is now known as coolsvap|afk09:18
*** bkopilov has joined #openstack-qa09:19
*** yamamoto has joined #openstack-qa09:20
*** ashishg has joined #openstack-qa09:21
openstackgerritZhenzan Zhou proposed openstack-dev/devstack: Keystone group operation requires Keystone API V3  https://review.openstack.org/17197909:22
*** coolsvap|afk is now known as coolsvap09:24
*** e0ne_ is now known as e0ne09:25
openstackgerritAndrea Frittoli  proposed openstack/tempest: Extend credentials to support roles  https://review.openstack.org/17198009:31
*** haigang has joined #openstack-qa09:39
*** ibiris is now known as ibiris_away09:45
*** ibiris_away is now known as ibiris09:46
*** ihrachyshka has joined #openstack-qa09:52
*** yamamoto has quit IRC09:54
openstackgerritIan Wienand proposed openstack-dev/devstack: [WIP] run dstat with run_process  https://review.openstack.org/17198809:57
openstackgerritMehdi Abaakouk proposed openstack-dev/devstack: rpc: Allow to configure the rabbitmq heartbeat  https://review.openstack.org/17199010:03
*** coolsvap is now known as coolsvap|afk10:06
*** sslypushenko has joined #openstack-qa10:06
*** Madan has quit IRC10:07
*** neeti has quit IRC10:10
*** yamamoto has joined #openstack-qa10:14
*** neeti has joined #openstack-qa10:16
*** dims_ has joined #openstack-qa10:23
*** k4n0 has quit IRC10:25
*** neeti has quit IRC10:30
kirmtreinish: plz review this when have time: https://review.openstack.org/#/c/157816/10:32
*** ibiris is now known as ibiris_away10:33
openstackgerritAbhishek G M proposed openstack/tempest: Test Creation of server in a shared_network  https://review.openstack.org/16891010:34
*** annashen has joined #openstack-qa10:37
*** dmorita has quit IRC10:38
*** jyuso has quit IRC10:41
*** annashen has quit IRC10:41
*** jamielennox|away is now known as jamielennox10:42
*** ashishg has quit IRC10:45
*** SridharG1 has quit IRC10:48
*** e0ne is now known as e0ne_10:49
*** aix has joined #openstack-qa10:51
sdagueianw: if I put this back down to 0.5, which was the original devstack value, would you be ok with - https://review.openstack.org/#/c/171231/ ?10:52
*** Poornima has quit IRC10:54
*** SridharG has quit IRC10:54
*** neeti has joined #openstack-qa10:55
ianwsdague: my main issue is that i haven't seen anything concrete to convince me that a poll (like suggested in https://review.openstack.org/#/c/171357/) won't work10:55
ianwsdague: as for 0.1 v 0.5, just commit 0.1 if you want10:55
ianwjust, as you know, sleep() as a concurrency control never works in general10:56
sdagueso in debugging all the screen stuff interactions before, it wasn't really clear that it was synchronous (even when it worked)10:58
sdaguewhich means I'm not convinced 1267 will actually work on first cycle most of the time anyway10:59
*** e0ne_ has quit IRC10:59
sdagueby just exporting the variable we let folks set something that makes sense for their environment.11:00
ianwsdague: i wouldn't pretend to know how exactly screen "stuffing" works, but i did see the command pasted into the buffer before the shell started.  that's why first time through it does the short sleep11:01
ianwhowever, i think that buffer input was consumed by the shell once it started11:01
sdagueyeh, I spent the better part of a month trying different versions of this kind of thing in grenade before, and never got something which worked reliably.11:02
sdaguewhich is why I'm skeptical. They always looked like they would work on paper, and then, it dropped things on the floor in an unexpected new way.11:03
sdagueso I'm just not thrilled with that kind of debug again. Whereas "increase your SCREEN_SLEEP" is a pretty easy fix for people if they are seeing services not start11:04
ianwsdague: alright, well speeding up devstack is important.  i feel like this is likely to cause a regression but such is life.  i might keep subjecting the poll approach to rechecks and see if anything triggers11:05
sdagueit won't get hit in the gate11:06
sdaguewe don't use screen in the gate11:06
sdaguethis is completely a local dev fix11:06
openstackgerritIan Wienand proposed openstack-dev/devstack: run dstat with run_process  https://review.openstack.org/17198811:06
*** pc_m has joined #openstack-qa11:06
*** Poornima has joined #openstack-qa11:07
ianwsdague: sorry, i mean locally.  i bring up changes in a vm in a cloud of, shall we say, varying performance.  but i have screen turned on so i can jump in on them11:11
sdagueok, but then it would be easy to just set it back to 3 in that config. Which was always a guess anyway. We worked fine in the gate with 1.5 for a while until the new hpcloud nodes rolled out with very weird cpu performance throttling11:14
*** e0ne has joined #openstack-qa11:15
*** johnthetubaguy is now known as zz_johnthetubagu11:16
ianwsure, i don't care about me.  just uneasy about breaking things for people who aren't watching every review11:16
sdaguewell that would be a good case for going back to 0.5, which worked fine in the local case before, then we can locally experiment if smaller values seem to also work11:18
sdagueor, honestly, just make it configurable with the 3 sec default11:18
sdagueand do some experimenting to figure out what's working in our various setups11:18
sdaguewhich I'm fine with as well11:18
*** amotoki has quit IRC11:19
sdagueit would be interesting to see what value you really needed for your slow cloud11:19
*** andreykurilin_ has quit IRC11:20
*** ibiris_away is now known as ibiris11:21
*** BharatK has quit IRC11:22
ianwsdague: in the mean time, i'm very worried we're running out of memory on ci nodes and so looking to get us much better visibility around that11:22
openstackgerritSean Dague proposed openstack-dev/devstack: Make screen sleep time configurable  https://review.openstack.org/17123111:22
*** BharatK has joined #openstack-qa11:22
sdagueianw: yeh, there are a lot of python processes running at this point11:23
ianwsdague: my plan is to at first start tracking peak memory usage in statsd so we can at least pull up a graph of usage11:24
ianwsdague: this might have at least helped me zoom in quicker on the changes that bumped up memory usage for centos11:24
*** haigang has quit IRC11:24
sdaguehave you thought about just graphing the dstat data?11:24
*** yamamoto has quit IRC11:24
*** BharatK has quit IRC11:25
sdaguerun that through matplotlib11:25
sdagueI had this idea at one point of building a visualization of a gate run doing that, and the tempest log, so you could see when various tests were being run, load average, mem profile11:26
ianwsdague: yeah, but i think the granularity of recording v what's happening is a bit low to really correlate11:27
sdaguebecause it's just system level?11:27
ianwyou really need to see a snapshot of the whole system.  for example, seeing that swift was using up X% of memory before a change, and X*2% after11:27
sdagueright, that's true.11:28
ianwi think that's why, as a first pass, showing the peak usage and recording a snapshot of that moment is a good first step11:28
sdaguedstat does have a plugin interface in python11:28
sdaguewhich is one of the reasons it was chosen11:28
sdagueso you could actually just write that in to the existing reporting as well11:29
sdagueI would agree a per service cpu% and mem% would be handy11:29
sdaguethough I'm trying to figure out how we'd figure out there was a regression across multiple runs11:30
ianwso my thought is probably a lot simpler, to start with11:30
ianwwe run a peak memory tracker -> https://review.openstack.org/#/c/171919/3/tools/peakmem_tracker.sh11:30
ianwwe log that to a log-file that gets picked up and stored as usual11:31
ianwwe add to successful verify jobs the statsd insert ... i.e. we keep stats just for committed changes11:31
ianwwe can grow that; start grouping results by service, start doing tree-view html javascript magic, etc11:32
ianwbut i want to take a very small dip before jumping in the deep end11:32
ianwideally, when we run out of memory, you look at the graph and see a committed change that resulted in a lot more memory usage, and start debugging from there11:34
sdagueyeh, unfortunately I think given that dependencies don't go through review, tracking that down to a commit is going to be optimistic11:37
sdaguebut we can try11:37
sdagueit would still be nice if we figured out a way to unify this with dstat, as that's a thing people are used to using to debug odd fails, and if we have other tools in different formats, I think we're just going to be talking different languages.11:38
sdagueianw: heh, so right after you +2ed this - https://review.openstack.org/#/c/171231/ - I changed it :)11:39
sdagueyou want to look again and +2 if you are ok with the new thing11:39
*** Abhishek_ has joined #openstack-qa11:41
Abhishek_hi all, can anyone tell me the exact flow of tempest, i.e; what happens basically when i run "bash tools/pretty_tox.sh volume" ??11:41
*** k4n0 has joined #openstack-qa11:42
Abhishek_How the flow goes in that??11:42
sdagueAbhishek_: that ends up turning into a testr call11:43
*** BharatK has joined #openstack-qa11:43
ianwsdague: yep.  i think though, you could track it.  imagine you look and see a previous devstack run where memory usage was reasonable.  you pull up it's peak memory log and see the relative % of memory taken by various things and compare it to the new one.  say nova increased, then you could drill down into the nova verify jobs and just look at those commits, and where it seemed to jump11:43
Abhishek_sdague: where to find this testr??11:44
sdagueAbhishek_: in your tox directory11:44
*** marcusvrn has joined #openstack-qa11:44
sdagueAbhishek_: this is why the entry point to tempest is to call tox11:44
sdagueit sets up all the correct dependencies11:44
sdagueianw: yep, it could definitely be useful for a set of cases. Such a huge amount of the code we run in a nova process is outside of the nova tree though, so tracking library releases and distro package updates is going to be important as well.11:46
*** hogepodge has quit IRC11:47
*** woodster_ has joined #openstack-qa11:49
*** nikil22 has joined #openstack-qa11:49
*** dkranz has joined #openstack-qa11:50
*** yamamoto has joined #openstack-qa11:50
nikil22hi while running tempest "tempest.thirdparty.infoblox/test_network_basic_ops.py" i get the error as "router not found". I am suprised when i see that it is trying to list the router which i have mentioned in the tempest.conf file from dynamically created project , but the router is available only in demo project11:51
nikil22is there a way to creat a router to available to all project like external network is available to all project with shared option? so that i have to do that to make tempest case pass11:52
*** jamielennox is now known as jamielennox|away11:53
Abhishek_sdague: I found out in the tox that the call is made to testr, and when I opened the file I found that it calls testrepository but I am not able to get the exact file which it runs after that?11:55
*** dratushnyy has quit IRC11:58
sdague.tox/.../bin/testr12:01
*** hogepodge has joined #openstack-qa12:04
*** yamamoto has quit IRC12:06
*** rodrigods has quit IRC12:06
*** rodrigods has joined #openstack-qa12:06
*** yamamoto has joined #openstack-qa12:07
*** dims_ has quit IRC12:10
*** jecarey has quit IRC12:12
*** Abhishek_ is now known as Guest2966412:12
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170012:12
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202312:12
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202412:12
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202512:12
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202612:12
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202712:12
*** dims_ has joined #openstack-qa12:13
*** liusheng has quit IRC12:15
*** mtanino has joined #openstack-qa12:18
*** e0ne is now known as e0ne_12:19
*** bknudson has quit IRC12:20
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202712:20
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202612:20
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202512:20
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202412:20
openstackgerritSean Dague proposed openstack-dev/grenade: remove global per release upgrade scripts  https://review.openstack.org/17160112:20
openstackgerritSean Dague proposed openstack-dev/grenade: restructure upgrades into per project directories  https://review.openstack.org/17137512:21
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170012:21
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202312:21
*** SridharG has joined #openstack-qa12:21
*** aysyd has joined #openstack-qa12:22
*** k4n0 has quit IRC12:23
*** dims__ has joined #openstack-qa12:23
*** neeti has quit IRC12:24
*** jyuso1 has joined #openstack-qa12:24
*** adalbas has joined #openstack-qa12:25
*** dratushnyy has joined #openstack-qa12:26
*** e0ne_ is now known as e0ne12:27
*** dims_ has quit IRC12:27
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202712:27
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202612:27
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202512:27
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202412:27
openstackgerritSean Dague proposed openstack-dev/grenade: remove global per release upgrade scripts  https://review.openstack.org/17160112:27
openstackgerritSean Dague proposed openstack-dev/grenade: restructure upgrades into per project directories  https://review.openstack.org/17137512:27
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170012:27
openstackgerritSean Dague proposed openstack-dev/grenade: fix trueorfalse usage  https://review.openstack.org/17137412:27
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202312:27
*** Guest29664 has quit IRC12:29
sdaguemtreinish / dtroyer - so I'm basically at stack overflow with the grenade patch series at this point. If we don't start merging I don't think I can clearly understand the next steps.12:33
sdagueI'm fine self merging this stuff and chasing any breaks it creates, but there is a lot in flight at this point.12:34
*** neeti has joined #openstack-qa12:36
*** rfolco has joined #openstack-qa12:41
*** zz_johnthetubagu is now known as johnthetubaguy12:41
*** bknudson has joined #openstack-qa12:42
*** mriedem_away is now known as mriedem12:42
*** jyuso1 has quit IRC12:52
*** aix has quit IRC12:53
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202712:54
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202612:54
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202512:54
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202412:54
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202312:54
*** weshay has joined #openstack-qa12:55
*** mtanino has quit IRC13:01
*** aix has joined #openstack-qa13:03
*** e0ne is now known as e0ne_13:04
*** pkoniszewski has joined #openstack-qa13:05
*** lifeless has quit IRC13:07
*** adalbas has quit IRC13:09
*** yamahata has joined #openstack-qa13:10
*** anshul has quit IRC13:11
*** mwagner_lap has quit IRC13:12
*** tochi_ has quit IRC13:13
*** neeti has quit IRC13:15
openstackgerritMerged openstack-dev/devstack: Make screen sleep time configurable  https://review.openstack.org/17123113:15
*** nikil22 has quit IRC13:18
*** apevec has quit IRC13:21
*** anshul has joined #openstack-qa13:24
*** e0ne_ is now known as e0ne13:25
*** dims__ has quit IRC13:28
*** dustins has joined #openstack-qa13:28
*** dims_ has joined #openstack-qa13:28
*** apevec has joined #openstack-qa13:33
*** apevec has quit IRC13:33
*** apevec has joined #openstack-qa13:33
mtreinishsdague: heh, it's a small stack :)13:33
mtreinishI'll start going through them shortly13:33
sdagueyeh, well the problem is, it's a lot of change, so it's a very weird balance between more patches, or bigger patches13:34
sdagueand I also think that this is never going to be perfect patches, given the starting point in grenade, so we should merge "close enough" and apply fixes after the fact.13:35
*** dims__ has joined #openstack-qa13:36
*** dims_ has quit IRC13:37
*** rushiagr is now known as rushiagr_away13:39
*** dboik has joined #openstack-qa13:40
*** sabeen has joined #openstack-qa13:46
sdaguemtreinish: http://logs.openstack.org/00/171700/5/check/check-grenade-dsvm-neutron/20cfb04/logs/grenade.sh.txt.gz#_2015-04-09_13_40_00_782 ?13:50
sdaguetempest blowing up on a verify thing13:52
*** openstackgerrit has quit IRC13:53
*** openstackgerrit has joined #openstack-qa13:53
mtreinishsdague: http://logs.openstack.org/00/171700/5/check/check-grenade-dsvm-neutron/20cfb04/logs/tempest.txt.gz#_2015-04-09_13_40_00_72713:54
sdagueah, yeh, I see the issue13:54
mtreinishsdague: on https://review.openstack.org/#/c/171374/ the commit msg isn't accurate anymore. I +2d it because of the rebase pain, but I think it would be good to make it accurate13:55
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202713:56
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202613:56
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202513:56
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202413:56
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170013:56
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202313:56
*** mwagner_lap has joined #openstack-qa13:58
openstackgerritPeter Stachowski proposed openstack-dev/devstack: Use openstack CLI instead of keystone  https://review.openstack.org/17179313:58
sdaguedtroyer: so... there are a set of patches up top for the various scripts14:02
sdagueI can merge down if you like14:02
openstackgerritJoseph Lanoux proposed openstack/tempest: Add new multi ssh configuration options  https://review.openstack.org/14653514:02
sdagueI pushed them as separate patches this morning so we could figure out the order14:03
dtroyersdague: ok, I'm still loking through 170885 and clearly GetDistro is not the problem (by itself) with experimental…14:03
sdagueyeh, the ironic job is failing on 1 test14:04
sdagueand, honestly, there is nothing of use inside the ironic logs for me to understand why14:04
*** vozcelik has joined #openstack-qa14:05
openstackgerritMehdi Abaakouk proposed openstack-dev/devstack: rpc: Allow to configure the rabbitmq heartbeat  https://review.openstack.org/17199014:06
*** BadCub_Hiding is now known as BadCub14:06
*** yamamoto has quit IRC14:08
sdagueoh, ironic grenade is never used on ironic anyway, so I'm fine with that not working here14:09
*** mtanino has joined #openstack-qa14:09
sdagueI thought I'd have to figure that out14:10
mtreinishsdague: heh I really like that ironic conductor logs the ipmitool --help output three times14:10
sdagueso, I think it's actually that ironic needs it's client upgrade14:10
*** erlon has joined #openstack-qa14:10
sdaguewhich mostly I think means ironic has to upgrade before nova14:11
sdaguebut, honestly, we should figure that out later, because the job doesn't work now anyway, it's not that I broke it14:12
mtreinishthat makes sense to me that it would need to go first14:12
mtreinishsdague: at least part of that failure is being caused by: http://logs.openstack.org/75/171375/6/experimental/check-grenade-dsvm-ironic/25e9870/logs/new/screen-n-cpu.txt.gz?level=TRACE#_2015-04-09_13_42_42_11514:12
sdagueyeh, I think that's a client mismatch expectation14:12
mtreinishnot the node timeout thing,(there was nothing in the logs about that) but the other traceback is caused by that14:12
*** jecarey has joined #openstack-qa14:13
sdaguehonestly, the ironic driver should explode and kill n-cpu on startup if the library is at the wrong version14:13
*** heyongli has quit IRC14:14
sdaguebecause there is no way that's a thing someone would figure out in the field14:14
sdaguethe way it currently fails14:14
*** heyongli has joined #openstack-qa14:15
*** pcaruana has quit IRC14:17
*** lifeless has joined #openstack-qa14:18
*** annashen has joined #openstack-qa14:18
*** sabeen3 has joined #openstack-qa14:19
*** sabeen has quit IRC14:20
*** zz_dimtruck is now known as dimtruck14:28
*** afazekas has quit IRC14:29
*** markus_z has quit IRC14:30
*** rushiagr_away is now known as rushiagr14:30
*** achanda has joined #openstack-qa14:32
*** sks has quit IRC14:34
*** rushiagr is now known as rushiagr_away14:34
*** e0ne is now known as e0ne_14:34
*** malini has joined #openstack-qa14:35
*** e0ne_ is now known as e0ne14:35
*** mriedem has quit IRC14:37
*** annashen has quit IRC14:37
sdagueok, next up, modular shutdown14:39
*** plaurin has joined #openstack-qa14:41
*** achanda has quit IRC14:41
plaurinHi, I was wondering how I can provide a devstack-gate job with a custom local.conf (to build a multi-node environnement)14:41
*** salv-orlando has joined #openstack-qa14:41
jordanPplaurin, we do it this way : https://github.com/NicolasT/openstack-ci-scripts/blob/master/jenkins/cinder-sofs-validate/50-run.sh#L5414:45
jordanPplaurin, several options of course, but the key is to set a variable called DEVSTACK_LOCAL_CONFIG_FILE14:46
plaurinjordanP: Awesome, thank you14:46
*** yamamoto has joined #openstack-qa14:47
plaurinjordanP: This is exactly what I was searching for, you sir made my day14:50
plaurin:)14:50
jordanPyou're welcome :)14:50
*** salv-orlando has quit IRC14:54
openstackgerritMatthew Gilliard proposed openstack/tempest: Test live migrate on a paused instance  https://review.openstack.org/15705414:56
mtreinishgilliard: ^^^ you'll need to update the sample config file on that14:56
mtreinishuse tox -egenconfig14:56
*** amotoki has joined #openstack-qa14:57
openstackgerritMatthew Gilliard proposed openstack/tempest: Test live migrate on a paused instance  https://review.openstack.org/15705414:59
*** jlibosva1 has joined #openstack-qa15:00
*** jlibosva1 has quit IRC15:00
*** jlibosva1 has joined #openstack-qa15:00
*** dboik_ has joined #openstack-qa15:00
*** marun has joined #openstack-qa15:01
*** artom has joined #openstack-qa15:02
*** jlibosva has quit IRC15:02
*** achanda has joined #openstack-qa15:02
*** dboik has quit IRC15:04
*** sergsh has quit IRC15:06
*** yamahata has quit IRC15:10
*** achanda has quit IRC15:11
*** gszasz has quit IRC15:11
*** SridharG has quit IRC15:15
*** annashen has joined #openstack-qa15:16
*** annashen has quit IRC15:17
*** cdent has quit IRC15:18
*** shashankhegde has joined #openstack-qa15:18
*** cdent has joined #openstack-qa15:18
*** armax has joined #openstack-qa15:22
*** amrith is now known as _amrith_15:24
*** annashen has joined #openstack-qa15:27
*** _amrith_ is now known as amrith15:27
*** annashen has quit IRC15:28
*** yamamoto has quit IRC15:29
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: Force openvswitch as the Neutron agent for Ironic  https://review.openstack.org/17211815:29
*** e0ne is now known as e0ne_15:30
*** dboik_ has quit IRC15:30
*** dboik has joined #openstack-qa15:31
*** tsekiyama has joined #openstack-qa15:31
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: Force openvswitch as the Neutron agent for Ironic  https://review.openstack.org/17211815:33
*** tsekiyama has quit IRC15:33
openstackgerritSean M. Collins proposed openstack-dev/devstack: [WIP] Switch the default to Linuxbridge  https://review.openstack.org/16842315:34
*** e0ne_ is now known as e0ne15:36
*** salv-orlando has joined #openstack-qa15:36
*** amrith is now known as _amrith_15:39
sdaguemorganfainberg: ok... so this is interesting15:40
sdaguekeystone can't pass upgrade testing if mod_wsgi is enabled15:40
*** ihrachyshka has quit IRC15:41
morganfainbergwait in what version?15:43
morganfainbergbecause iirc juno was fine and grenade did juno -> master, right?15:43
*** dimtruck is now known as zz_dimtruck15:44
sdagueno, we've got WSGI off in all the grenade jobs15:45
sdagueI was trying to figure out why it was failing for me locallly15:45
sdagueand it's because of that15:46
sdagueno one from keystone ever cycled around on that one15:46
morganfainbergah15:46
morganfainbergcrap15:46
morganfainbergit's cause i'm sure grenade doesn't know how to turn off mod_wsgi keystone15:46
*** mriedem has joined #openstack-qa15:47
sdaguewhich means devstack doesn't know how to do it15:47
sdaguebecause grenade is just calling stop_keystone15:47
morganfainbergyep15:47
morganfainbergdevstack knows it partially just not 100%.15:48
sdaguethe error you get is that keystone.openstack.common.log doesn't exist15:48
*** _amrith_ is now known as amrith15:48
*** adalbas has joined #openstack-qa15:49
morganfainbergugh.15:50
morganfainbergmove to oslo.log broke us :(15:50
morganfainbergthen15:50
morganfainbergok we need to fix devstack.15:50
morganfainbergso it's smarter15:50
openstackgerritMerged openstack-dev/grenade: add modular grenade plan  https://review.openstack.org/17088615:56
*** sputnik13 has joined #openstack-qa15:56
*** dustins has quit IRC15:58
*** yamahata has joined #openstack-qa16:02
*** rwsu has joined #openstack-qa16:02
*** zz_dimtruck is now known as dimtruck16:03
openstackgerritMerged openstack-dev/grenade: make javelin work in a read-only environment  https://review.openstack.org/17097616:04
openstackgerritMerged openstack-dev/grenade: introduce UPGRADE_PROJECTS  https://review.openstack.org/17080816:04
openstackgerritMerged openstack-dev/grenade: refactor to remove functions-common  https://review.openstack.org/17088516:05
openstackgerritMerged openstack-dev/grenade: fix trueorfalse usage  https://review.openstack.org/17137416:05
*** jhenner has quit IRC16:06
*** jlanoux has quit IRC16:06
*** mlavalle has joined #openstack-qa16:07
openstackgerritMerged openstack-dev/grenade: restructure upgrades into per project directories  https://review.openstack.org/17137516:08
openstackgerritMerged openstack-dev/grenade: remove global per release upgrade scripts  https://review.openstack.org/17160116:08
morganfainbergsdague, ok i have an errand to run [must leave in 1hr exactly] on the other side of town16:08
sdagueok16:09
morganfainbergsdague, i'll get someone on the devstack fun right now. if it isn't solved by the time i'm back i'll jump on it.16:09
openstackgerritMerged openstack/tempest: Prevent failures when running as non-admin  https://review.openstack.org/16695516:09
* morganfainberg loves delegating this stuff to folks when possible :)16:09
openstackgerritKirill Shileev proposed openstack/tempest: Check IPv6 mupltiprefix feature  https://review.openstack.org/15781616:10
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202716:11
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202616:11
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202516:11
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202416:11
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170016:11
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202316:11
*** jlibosva1 has quit IRC16:15
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in save-state  https://review.openstack.org/17202716:15
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in stop-base  https://review.openstack.org/17202616:15
openstackgerritSean Dague proposed openstack-dev/grenade: change source ordering in check-sanity  https://review.openstack.org/17202516:15
openstackgerritSean Dague proposed openstack-dev/grenade: reorder clean.sh to remove warnings  https://review.openstack.org/17202416:15
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170016:15
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202316:15
morganfainbergsdague, have a link for the grenade failure in action?16:15
sdaguemtreinish: https://review.openstack.org/171700 includes an updated commit message for why that's conditional16:15
*** shashankhegde has quit IRC16:15
morganfainbergsdague, so i can have some keystone folks pile on it16:15
sdaguemorganfainberg: no, we don't run it in that configuration anywhere16:16
morganfainbergah16:16
morganfainbergok16:16
*** hemnafk is now known as hemna16:16
sdagueand, honestly, right now I'm trying to keep this module grenade refactor in my head16:16
sdagueso I'm not really going to dive into helping people fix that other thing16:16
sdagueit just surfaced when I was trying to do it16:17
*** gyee has joined #openstack-qa16:19
*** luqas has quit IRC16:24
*** melwitt has joined #openstack-qa16:26
*** annashen has joined #openstack-qa16:27
*** Nic has joined #openstack-qa16:34
*** cdent has quit IRC16:34
*** harlowja_away is now known as harlowja16:35
*** malini has quit IRC16:39
*** ymorkovn_ has quit IRC16:40
*** patrickeast has joined #openstack-qa16:42
*** cdent has joined #openstack-qa16:45
openstackgerritSean M. Collins proposed openstack-infra/devstack-gate: Force openvswitch as the Neutron agent for Ironic  https://review.openstack.org/17211816:49
*** davideagnello has joined #openstack-qa16:53
davideagnellodoes Rally provide a way to report or capture intermittent state of a scenario/integration test as it is executed?16:54
*** Nic has quit IRC16:54
*** shashankhegde has joined #openstack-qa16:58
*** Nic has joined #openstack-qa16:59
openstackgerritmelanie witt proposed openstack-dev/devstack: Specify network UUID for network create with cells  https://review.openstack.org/17186516:59
*** e0ne is now known as e0ne_16:59
openstackgerritmelanie witt proposed openstack-dev/devstack: Specify network UUID for network create with cells  https://review.openstack.org/17186517:00
*** malini has joined #openstack-qa17:01
*** dratushnyy has quit IRC17:02
*** e0ne_ is now known as e0ne17:03
*** safchain has quit IRC17:03
*** e0ne has quit IRC17:06
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852517:13
*** openstack has quit IRC17:13
*** openstack has joined #openstack-qa17:14
*** ihrachyshka has joined #openstack-qa17:16
*** achanda has joined #openstack-qa17:17
*** yamamoto has joined #openstack-qa17:18
*** amotoki has quit IRC17:21
*** yamamoto has quit IRC17:23
openstackrecheckopenstack/horizon change: https://review.openstack.org/171423 failed gate-tempest-dsvm-full in the gate queue with an unrecognized error17:23
*** jordanP has quit IRC17:24
*** dustins has joined #openstack-qa17:24
*** luqas has joined #openstack-qa17:24
openstackgerritSwaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu  https://review.openstack.org/15852517:24
*** salv-orlando has quit IRC17:24
sslypushenkoI'm working on accounts generation tools and now I stuck a little. Maybe you can clarify how that tool should interact with user roles. In spec is pointed that tools should create bunch of users with specific roles. Can we think that these all roles existed?17:24
*** boris-42 has quit IRC17:28
*** luqas has quit IRC17:29
*** dboik has quit IRC17:31
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368117:32
openstackgerritAndrea Frittoli  proposed openstack/tempest: Extend credentials to support roles  https://review.openstack.org/17198017:35
openstackgerritAndrea Frittoli  proposed openstack/tempest: Remove unused methods  https://review.openstack.org/16836617:35
openstackgerritAndrea Frittoli  proposed openstack/tempest: Extend get_client_manager to support roles  https://review.openstack.org/16836717:35
*** malini has quit IRC17:36
*** malini has joined #openstack-qa17:36
*** aix has quit IRC17:37
*** cdent has quit IRC17:38
*** gyee has quit IRC17:40
openstackgerritJoe Gordon proposed openstack-dev/grenade: Fix typos in PLUGINS  https://review.openstack.org/17215617:41
*** malini has left #openstack-qa17:45
*** dboik has joined #openstack-qa17:46
*** catohornet has joined #openstack-qa17:48
*** salv-orlando has joined #openstack-qa17:51
*** Sukhdev has joined #openstack-qa17:52
*** e0ne has joined #openstack-qa17:53
*** e0ne is now known as e0ne_17:53
sdaguemtreinish: so... it looks like tempest is not seeing the service list on the new side17:57
*** e0ne_ is now known as e0ne17:57
mtreinishsdague: link? but that shouldn't change in tempest.conf17:57
sdaguemtreinish: well compare http://logs.openstack.org/00/171700/8/check/check-grenade-dsvm-neutron/ec02559/logs/old/tempest_conf.txt.gz17:58
sdaguewith http://logs.openstack.org/00/171700/8/check/check-grenade-dsvm-neutron/ec02559/logs/new/tempest_conf.txt.gz17:58
mtreinishsdague: oh, you're not running lib/tempest on target (because devstack isn't run)17:58
mtreinishso it's not making a new tempest.conf17:58
sdaguewell, except it is17:59
sdagueI'm mostly trying to figure out why that patch broke things17:59
sdaguethe only thing I can think is the closet 'source $dir/stackrc' that was removed17:59
mkoderersdague: jogo: I am thinking to create a "speed mode" in devstack and reduce all sleeps and stuff to an absolute limit17:59
mtreinishsdague: hmm, where does tempest get added to the services list?17:59
mkoderernot for the "gate" but for developers that want to run devstack fast in their env18:00
mkoderersdague: jogo: would this be something intressing for a design session?18:00
sdaguemkoderer: well, I just landed the SCREEN_SLEEP pathes18:01
sdaguepatches18:01
*** anshul has quit IRC18:02
sdaguemtreinish: it should be in the devstack lists right?18:02
mkoderersdague: yeah, but your optimizing it that it also runs in the gate... I would accept if it fails sometimes for me18:02
mkodererbut just an idea :)18:02
sdaguemkoderer: no, it doesn't impact the gate18:03
mtreinishmkoderer: well screen isn't used in the gate because it's too unreliable18:03
mkoderersdague: ah ok yeah right18:03
*** e0ne is now known as e0ne_18:03
mkoderersdague: ok, I will have a look what kind of think are missing to tweak the runtime a bit more18:04
mkodererlet's see what comes out of it18:04
sdaguemkoderer: right now a wheel cache build of eveything in advance would be useful18:04
mtreinishsdague: that's what I was alluding too, it's in the default stackrc18:04
mtreinish(I just double checked)18:04
mtreinishhttp://git.openstack.org/cgit/openstack-dev/devstack/tree/stackrc#n4718:05
*** patrickeast_ has joined #openstack-qa18:05
mtreinishso if we were sourcing it before and aren't now I could see that cause lib/tempest from not being run18:05
sdaguemtreinish: yeh, that's overridden in the gate18:05
mkoderersdague: yeah... I was thinking to have a vagrant box with everything in place18:05
sdaguehttp://logs.openstack.org/00/171700/8/check/check-grenade-dsvm-neutron/ec02559/logs/new/localrc.txt.gz18:05
*** hitalia has quit IRC18:06
*** patrickeast has quit IRC18:06
*** patrickeast_ is now known as patrickeast18:06
sdaguemkoderer: well, devstack-vagrant was an effort to do a bunch of that, just a few too many spinning plates right now18:06
mtreinishsdague: it might help to bake in devpi support as an option to devstack18:06
sdaguemtreinish: might18:07
mtreinishthat would solve most of the caching things for local dev use18:07
mtreinishI think18:07
*** mestery has quit IRC18:07
sdaguemaybe18:08
*** patrickeast has quit IRC18:08
mtreinishsdague: oh, I just took a closer look at that tempest.conf from new18:08
*** e0ne_ has quit IRC18:08
mtreinishlib tempest is being run, but nothing is getting set in the service_available section18:08
mtreinishbut other sections are filled out18:09
sdagueyeh, I don't understand why that would be18:09
mtreinishsdague: there is a separate var for that18:09
mtreinishhttp://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/tempest#n50418:09
mtreinishI can't remember how that gets set18:10
sdaguewhere is the verify config running?18:10
*** mestery has joined #openstack-qa18:10
sdagueI actually have no idea18:10
mtreinishsdague: I just grepped it's set in each of the lib/$service files18:11
mtreinishthe verify command is run before that it looks like: http://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/tempest#n34518:11
sdagueoh, so, yeh, tempest is working by giant side effect18:12
sslypushenkomtreinish: I'm working on accounts generation tools and now I stuck a little. Maybe you can clarify how that tool should interact with user  roles. In spec is pointed that tools should create bunch of users with specific roles. Can we think that these all roles existed?18:12
mtreinishsslypushenko: well there are a few role config options in the tempest config18:13
mtreinishsslypushenko: you can just grab the role names from there18:14
sslypushenkoGood idea! Thx18:14
mtreinishI think it's just admin, swift operator, swift reseller admin, and heat stack owner at this point18:14
sslypushenkoand member18:14
*** anshul has joined #openstack-qa18:15
*** tosky has quit IRC18:15
mtreinishsslypushenko: well I think Member is just the devstack default for swift operator18:15
sdaguemtreinish: so I'm actually confused how this is working at all at the moment18:15
mtreinish"magic" :)18:15
mtreinishI was just thinking that too18:16
mtreinishif the service list is set by appending in each lib file then how does it work on new when we don't call those18:16
mtreinishsdague: although do we really need a new conf for target?18:16
sdaguemtreinish: I don't think so18:17
mtreinishthe only thing would be it won't test new extensions added in target (or anything else new)18:17
sdagueyeh, which should be fine18:19
sdaguethough, I'm going to try a reorder of things here and see if it helps18:19
*** ihrachyshka has quit IRC18:23
*** ibiris is now known as ibiris_away18:26
openstackgerritSean Dague proposed openstack-dev/grenade: reorder imports in stand alone scripts  https://review.openstack.org/17202618:28
openstackgerritSean Dague proposed openstack-dev/grenade: modularize mysql db saving  https://review.openstack.org/17170018:28
openstackgerritSean Dague proposed openstack-dev/grenade: allow GIT_BASE to be overridden  https://review.openstack.org/17202318:28
openstackgerritSean Dague proposed openstack-dev/grenade: modularize shutdown  https://review.openstack.org/17216918:28
sdagueok, I did some squashing there as well18:28
*** marcusvrn has quit IRC18:28
sdagueI wish there was a sane way to tell gerrit that this patch superseeds a few others18:29
*** SergeyLukjanov has quit IRC18:31
*** SergeyLukjanov has joined #openstack-qa18:32
*** vozcelik has quit IRC18:35
*** anshul has quit IRC18:44
*** aix has joined #openstack-qa18:55
*** jecarey has quit IRC18:57
*** anshul has joined #openstack-qa18:59
*** annashen has quit IRC19:03
*** jecarey has joined #openstack-qa19:04
*** mmedvede has quit IRC19:07
*** e0ne has joined #openstack-qa19:10
*** anshul has quit IRC19:20
*** shashankhegde has quit IRC19:20
*** Longgeek_ has quit IRC19:22
openstackgerritAndrea Frittoli  proposed openstack/tempest: Initial class creds creation in test base class  https://review.openstack.org/15368119:27
openstackgerritAndrea Frittoli  proposed openstack/tempest: Extend credentials to support roles  https://review.openstack.org/17198019:27
openstackgerritAndrea Frittoli  proposed openstack/tempest: Remove unused methods  https://review.openstack.org/16836619:27
openstackgerritAndrea Frittoli  proposed openstack/tempest: Extend get_client_manager to support roles  https://review.openstack.org/16836719:27
*** weshay has quit IRC19:29
*** anshul has joined #openstack-qa19:33
*** gfidente has quit IRC19:39
*** mmedvede has joined #openstack-qa19:45
*** e0ne has quit IRC19:49
*** dims__ is now known as dims19:50
*** Sukhdev has quit IRC19:52
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add db api methods to delete old runs and test_runs  https://review.openstack.org/17219019:53
*** jecarey_ has joined #openstack-qa19:56
*** jecarey__ has joined #openstack-qa19:57
*** jecarey has quit IRC19:58
andreafmtreinish: I asked morganfainberg about v3 only devstack - it's in his plans for liberty both not possible right now because of devstack limitations - I marked https://blueprints.launchpad.net/tempest/+spec/keystone-v3-jobs as blocked for now19:59
*** jecarey_ has quit IRC20:01
morganfainbergandreaf, mtreinish, i want to see that in liberty *and* gated on20:01
morganfainbergfwiw20:01
* morganfainberg pretends to not be lurking here too20:01
*** annashen has joined #openstack-qa20:03
mtreinishmorganfainberg: heh, that ship sailed long ago, I know you're always here :)20:05
*** davideagnello has quit IRC20:06
*** davideagnello has joined #openstack-qa20:07
amrithsdague, I'm having no luck with putting (https://review.openstack.org/#/c/171788/) into stable/juno. I would like to but am wondering if you have a couple of minutes to help.20:13
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE testing overlay network options  https://review.openstack.org/17171420:13
*** mwagner_lap has quit IRC20:22
*** achanda has quit IRC20:24
*** luqas has joined #openstack-qa20:27
adam_gsdague, i think this is needed https://review.openstack.org/#/c/172150/20:29
openstackgerritMatthew Treinish proposed openstack-infra/subunit2sql: Add a cli subcommand for deleting old rows  https://review.openstack.org/17220020:30
*** marcusvrn has joined #openstack-qa20:31
*** luqas has quit IRC20:31
*** cody-somerville has quit IRC20:32
*** shashankhegde has joined #openstack-qa20:41
openstackgerritArmando Migliaccio proposed openstack-infra/devstack-gate: ***DO NOT MERGE*** Flip DVR bit to collect experimental run datapoints  https://review.openstack.org/17180920:41
*** shashankhegde has quit IRC20:42
*** shashankhegde has joined #openstack-qa20:42
*** e0ne has joined #openstack-qa20:42
*** e0ne has quit IRC20:43
*** adalbas has quit IRC20:44
*** andreykurilin_ has joined #openstack-qa20:46
openstackrecheckopenstack/nova change: https://review.openstack.org/171912 failed gate-grenade-dsvm, gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error20:48
*** pcrews has quit IRC20:49
*** achanda has joined #openstack-qa20:53
openstackgerritDavanum Srinivas (dims) proposed openstack-dev/devstack: Allow pyngus to skip global requirements check  https://review.openstack.org/17220620:53
*** pcrews has joined #openstack-qa20:53
*** jhenner has joined #openstack-qa20:59
*** mwagner_lap has joined #openstack-qa21:04
*** rfolco has quit IRC21:07
*** aysyd has quit IRC21:08
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Add query for bug 1442367  https://review.openstack.org/17221121:10
openstackbug 1442367 in python-neutronclient "2.4.0 release destroys grenade since stable/juno isn't capped properly" [Critical,Confirmed] https://launchpad.net/bugs/144236721:10
mriedemjogo: mtreinish: ^21:10
*** pkoniszewski has quit IRC21:11
*** anshul has quit IRC21:12
adam_gmriedem, oh, you beat me21:12
mriedemmuwahhaha21:13
adam_gonce https://review.openstack.org/#/c/172150/ and syncs land should be okay21:13
openstackrecheckopenstack/horizon change: https://review.openstack.org/164303 failed gate-grenade-dsvm in the gate queue with an unrecognized error21:16
openstackgerritMerged openstack-infra/elastic-recheck: Add query for bug 1442367  https://review.openstack.org/17221121:18
openstackbug 1442367 in python-neutronclient "2.4.0 release destroys grenade since stable/juno isn't capped properly" [Critical,Confirmed] https://launchpad.net/bugs/1442367 - Assigned to Akihiro Motoki (amotoki)21:18
*** marcusvrn has quit IRC21:24
*** dims has quit IRC21:24
*** anshul has joined #openstack-qa21:25
*** rushiagr_away has quit IRC21:35
*** dkranz has quit IRC21:36
*** dustins has quit IRC21:42
*** openstackrecheck has quit IRC21:42
*** openstackrecheck has joined #openstack-qa21:42
*** Sukhdev has joined #openstack-qa21:45
*** andreykurilin_ has quit IRC21:51
openstackgerritmelanie witt proposed openstack-dev/devstack: Specify network UUID for network create with cells  https://review.openstack.org/17186521:52
*** rushiagr_away has joined #openstack-qa21:54
*** weshay has joined #openstack-qa21:58
openstackgerritMatthew Treinish proposed openstack-infra/devstack-gate: DO NOT MERGE: Test Using secure delete to verify bug  https://review.openstack.org/17222521:59
openstackgerritMerged openstack-dev/hacking: Updated from global requirements  https://review.openstack.org/16642522:01
hogepodgemtreinish: I'm testing the newtork patch, first error is unhashable type: 'dict'22:05
mtreinishhogepodge: yeah, I don't think it comes close too working :(22:05
mtreinishI managed to write a hack of a test patch here: https://review.openstack.org/#/c/158511/22:05
mtreinishand the tempest patch needs some work: http://logs.openstack.org/11/158511/28/check/check-tempest-dsvm-neutron-full/7b32fde/console.html22:06
*** dboik_ has joined #openstack-qa22:06
mtreinishI haven't had a chance to look at it yet22:06
mtreinishhogepodge: thanks for doing the testing though22:06
hogepodgenp22:06
*** pc_m has quit IRC22:07
mtreinishI'll probably ping you about it when I get the test patch passing22:07
hogepodgeIt took me a while. I was trying to use puppet to automate some testing setup, but the modules are deficient in a way I didn't expect. The facility for managing users, networks, and images is pretty cool, but not mature enough to do without a lot of hacking and pulling in dependencies22:08
*** artom has quit IRC22:08
hogepodgeBut it's clarifying my thinking on how to document testing.22:08
*** dboik has quit IRC22:09
openstackgerritMerged openstack-dev/hacking: Fix string formatting in example  https://review.openstack.org/16826922:10
*** dboik_ has quit IRC22:10
mtreinishhogepodge: oh yeah the puppet dsl stuff for doing that. I was never able to make it work, so I would just hard code execs with vars to do what I wanted22:10
mtreinishheh, it was easier for me to think that way22:10
hogepodgemtreinish: I'm tempted to just write my own providers that do what I want directly against the json api, but I fear that may be a twisty maze of passages, all alike22:11
*** Guest77301 has joined #openstack-qa22:11
*** Guest77301 is now known as dims_22:12
openstackgerritWayne Okuma proposed openstack-dev/devstack: Catalog Index Service - glance devstack  https://review.openstack.org/16920022:13
mtreinishhogepodge: well tbh, the json api is pretty simple. For example the tempest clients are pretty minimal. You probably could just abstract some common things and point it at different endpoints and it would just work22:14
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE more network overlay testing  https://review.openstack.org/17222722:17
*** Nic has quit IRC22:18
*** annashen has quit IRC22:18
mtreinishhogepodge: heh, of course it would probably balloon pretty quickly now that I think about it22:19
*** bknudson has quit IRC22:20
mtreinishhogepodge: maybe you could leverage an existing ruby openstack sdk, that might make it simpler22:20
*** Nic has joined #openstack-qa22:21
*** annashen has joined #openstack-qa22:26
*** shashankhegde has quit IRC22:28
*** jecarey__ has quit IRC22:34
openstackgerritClark Boylan proposed openstack-infra/devstack-gate: DO NOT MERGE more network overlay testing  https://review.openstack.org/17222722:35
*** dimtruck is now known as zz_dimtruck22:37
openstackgerritZhenzan Zhou proposed openstack-dev/devstack: Keystone group operation requires Keystone API V3  https://review.openstack.org/17197922:38
*** shashankhegde has joined #openstack-qa22:43
morganfainbergmtreinish, jogo, ttx, dtroyer, looks like we're going to need a stable branch for OSC: http://logs.openstack.org/38/166438/2/check/gate-tempest-dsvm-neutron-src-keystonemiddleware-juno/ac7ec07/logs/devstacklog.txt.gz#_2015-04-09_21_26_04_35122:44
*** yamamoto has joined #openstack-qa22:44
morganfainbergor a cap?22:44
mtreinishmorganfainberg: I think the g-r cap that was just pushed to stable juno should take care of that22:44
morganfainbergah ok22:45
mtreinishbut I could be wrong :)22:45
morganfainbergyeah that failed ~30mins ago22:45
mtreinishhttps://review.openstack.org/#/c/172150/22:45
morganfainbergthat should have landed before the gate job started afaict.22:46
* morganfainberg checks22:47
morganfainbergah nope, 15 mins off22:47
morganfainbergok recheck again22:47
mtreinishmorganfainberg: yeah it wasn't in the list: http://logs.openstack.org/38/166438/2/check/gate-tempest-dsvm-neutron-src-keystonemiddleware-juno/ac7ec07/logs/devstacklog.txt.gz#_2015-04-09_21_22_12_48422:48
morganfainbergmtreinish, yep22:48
morganfainbergmtreinish, hey i came here and bugged you rather than recheck-botted it through ;)22:48
*** yamamoto has quit IRC22:49
mtreinishmorganfainberg: hehe, fair enough22:49
*** dims_ has quit IRC22:52
*** Nic has quit IRC22:54
*** Nic has joined #openstack-qa22:54
*** mlavalle has quit IRC23:01
*** hemna is now known as hemnafk23:02
*** dratushnyy has joined #openstack-qa23:02
*** jhenner has quit IRC23:04
*** mriedem is now known as mriedem_away23:11
mtreinishsdague: something is weird here: http://logs.openstack.org/25/172225/1/check/check-grenade-dsvm/92c3e84/console.html I think the logging is getting messed up now23:16
mtreinishsdague: so I figured it out, we're logging the old tempest run in grenade.sh.txt but the new grenade log in console.html23:19
*** anshul has quit IRC23:25
*** apevec has quit IRC23:28
*** dboik has joined #openstack-qa23:29
*** davideagnello has quit IRC23:29
*** dboik_ has joined #openstack-qa23:29
*** annashen has quit IRC23:32
*** annashen has joined #openstack-qa23:32
*** hichihara has joined #openstack-qa23:33
*** dboik has quit IRC23:33
*** annashen has quit IRC23:34
*** davideagnello has joined #openstack-qa23:37
*** anshul has joined #openstack-qa23:38
*** dims_ has joined #openstack-qa23:38
*** sabeen3 has quit IRC23:38
*** ajmiller has quit IRC23:43
*** tochi has joined #openstack-qa23:43
*** Sukhdev has quit IRC23:45
*** bknudson has joined #openstack-qa23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!