Tuesday, 2013-09-24

RecheckWatchBotopenstack/nova change: https://review.openstack.org/45015 failed tempest with an unrecognized error00:00
*** malini_afk is now known as malini00:02
openstackgerritA change was merged to openstack-dev/devstack: print out git references for trees  https://review.openstack.org/4789500:25
openstackgerritA change was merged to openstack-dev/devstack: Modified ceilometer alarm evaluator console script  https://review.openstack.org/4763700:25
RecheckWatchBotopenstack/nova change: https://review.openstack.org/47646 failed tempest because of: https://bugs.launchpad.net/bugs/122633700:28
RecheckWatchBotopenstack/nova change: https://review.openstack.org/46824 failed tempest because of: https://bugs.launchpad.net/bugs/121191500:29
openstackgerritA change was merged to openstack/tempest: Fix typos in tempest/HACKING.rst Edit  https://review.openstack.org/4783500:32
openstackgerritJamie Lennox proposed a change to openstack-dev/devstack: Fix swift httpd on fedora  https://review.openstack.org/4686500:49
jamielennoxdtroyer or sdague: ^^ was just a required 'recursive' rebase and can be kicked off again00:53
openstackgerritYuuichi Fujioka proposed a change to openstack-dev/devstack: Adds setting for allocation rates  https://review.openstack.org/4730500:57
dtroyerjamielennox: I saw that…am waiting for the checks to complete yet...01:01
jamielennoxdtroyer: no worries, just letting you know01:01
jamielennoxdtroyer: whilst you're here: https://review.openstack.org/#/c/47076/ - this one is failing because of the way grenade imports devstack files01:02
jamielennoxthe SSL functions are put in lib/tls which is not imported by grenade - can you have a look and tell me if this is something that i should fix in grenade or if i should do it differently in the review somehow01:03
*** nosnos has joined #openstack-qa01:03
dtroyerit sounds like you should just need to source lib/tls in upgrade-keystone in Grenade01:04
dtroyerI'll look closer in the morning01:04
*** jasondotstar has joined #openstack-qa01:09
*** morganfainberg has quit IRC01:11
jamielennoxi would prefer to do it a bit more globally as i expect using https certs to be done in other projects as well01:12
*** morganfainberg has joined #openstack-qa01:12
openstackgerritJamie Lennox proposed a change to openstack-dev/devstack: Allow keystone to run from apache  https://review.openstack.org/4686601:14
dtroyerbecause of the way grenade is structured, it would need to be added for each upgrade-* script anyway. those scripts are designed to be run standalone in addition to being run from grenade.sh01:14
*** zhikunliu has joined #openstack-qa01:43
*** russellb has quit IRC01:43
openstackgerritJun Jie Nan proposed a change to openstack-dev/devstack: Pass no proxy to skip proxy using for wget and curl  https://review.openstack.org/4644701:43
*** russellb has joined #openstack-qa01:44
openstackgerritAnjan Tiwari proposed a change to openstack/tempest: port test_absolute_limits into v3 part1  https://review.openstack.org/4788801:44
*** rfolco has joined #openstack-qa01:57
*** malini is now known as malini_afk02:01
RecheckWatchBotopenstack/nova change: https://review.openstack.org/47647 failed tempest with an unrecognized error02:06
*** morganfainberg has quit IRC02:08
*** morganfainberg has joined #openstack-qa02:08
RecheckWatchBotopenstack/neutron change: https://review.openstack.org/47769 failed tempest with an unrecognized error02:12
RecheckWatchBotopenstack/glance change: https://review.openstack.org/47902 failed tempest with an unrecognized error02:13
*** jasondotstar has quit IRC02:14
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/46865 failed tempest because of: https://bugs.launchpad.net/bugs/122198702:17
clarkbevery time that happens it is so awesome02:17
jamielennoxi think that's the first time i've seen it - and i'm impressed02:18
clarkbjamielennox: if you look through scrollback (if you have it) it has been happening periodically for almost a week. jog0 and mtreinish put a thing together that uses the logstash/elasticsearch indexed logs to determine why things are failing if we have written a query for it02:19
clarkbjamielennox: we are workign on making it infra hosted then will send an announcement and should comment on changes directly too02:19
clarkbit is all very exciting02:20
*** bdperkin_gone is now known as bdperkin02:20
jamielennoxthat will be good - instant recheck when something fails will be awesome02:21
jamielennoxthen we just need a way of attaching a filter to a bug report02:23
clarkbjamielennox: yeah that bit is turning out to possibly be the trickiest part02:24
clarkbinitially we think we may double account the filters to keep code simple02:24
clarkbput filter in bug report for humans and put it in the config for the recheckwatcher02:24
*** rfolco has quit IRC02:30
*** morganfainberg has quit IRC02:37
*** morganfainberg has joined #openstack-qa02:37
*** dims has quit IRC02:48
*** jasondotstar has joined #openstack-qa02:49
RecheckWatchBotopenstack/python-novaclient change: https://review.openstack.org/47946 failed tempest with an unrecognized error03:11
RecheckWatchBotopenstack/heat change: https://review.openstack.org/47948 failed tempest with an unrecognized error03:11
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/46866 failed tempest because of: https://bugs.launchpad.net/bugs/122633703:11
RecheckWatchBotopenstack/cinder change: https://review.openstack.org/47741 failed tempest because of: https://bugs.launchpad.net/bugs/122633703:12
RecheckWatchBotopenstack/nova change: https://review.openstack.org/40168 failed tempest because of: https://bugs.launchpad.net/bugs/122633703:12
RecheckWatchBotopenstack/python-novaclient change: https://review.openstack.org/47946 failed tempest because of: https://bugs.launchpad.net/bugs/122633703:12
RecheckWatchBotopenstack/cinder change: https://review.openstack.org/47954 failed tempest with an unrecognized error03:20
openstackgerritZhu Zhu proposed a change to openstack/tempest: Add test for nova API of VM lock/unlock  https://review.openstack.org/4784603:25
*** timello has quit IRC03:39
*** morganfainberg has quit IRC03:39
*** morganfainberg has joined #openstack-qa03:40
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/47888 failed tempest with an unrecognized error03:41
*** timello has joined #openstack-qa03:41
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/46447 failed tempest because of: https://bugs.launchpad.net/bugs/122633703:41
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/46866 failed tempest with an unrecognized error03:54
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas vpnservice test cases  https://review.openstack.org/4733903:59
*** SergeyLukjanov has joined #openstack-qa04:00
*** jasondotstar has quit IRC04:10
*** morganfainberg has quit IRC04:16
*** bdperkin is now known as bdperkin_gone04:16
*** morganfainberg has joined #openstack-qa04:19
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IKE policies tests  https://review.openstack.org/4734804:20
*** SergeyLukjanov has quit IRC04:24
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IPSec policies tests  https://review.openstack.org/4781604:25
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part2  https://review.openstack.org/3960904:29
*** morganfainberg has quit IRC04:35
*** morganfainberg has joined #openstack-qa04:35
*** madan has joined #openstack-qa04:52
RecheckWatchBotopenstack/heat change: https://review.openstack.org/47867 failed tempest because of: https://bugs.launchpad.net/bugs/122198704:56
RecheckWatchBotopenstack/neutron change: https://review.openstack.org/47799 failed tempest with an unrecognized error04:57
*** madan has quit IRC05:01
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/47339 failed tempest because of: https://bugs.launchpad.net/bugs/122633705:01
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/47348 failed tempest because of: https://bugs.launchpad.net/bugs/122633705:11
*** DennyZhang has joined #openstack-qa05:13
*** madan has joined #openstack-qa05:14
RecheckWatchBotopenstack/cinder change: https://review.openstack.org/47264 failed tempest because of: https://bugs.launchpad.net/bugs/122198705:15
*** DennyZhang has quit IRC05:15
RecheckWatchBotopenstack/heat change: https://review.openstack.org/45462 failed tempest because of: https://bugs.launchpad.net/bugs/122633705:17
*** DennyZhang has joined #openstack-qa05:17
*** bashok has joined #openstack-qa05:20
*** DennyZhang has quit IRC05:21
*** DennyZhang has joined #openstack-qa05:21
RecheckWatchBotopenstack/heat change: https://review.openstack.org/45473 failed tempest with an unrecognized error05:22
*** bashok_ has joined #openstack-qa05:25
*** bashok has quit IRC05:28
RecheckWatchBotopenstack/heat change: https://review.openstack.org/47774 failed tempest with an unrecognized error05:44
raiesmtreinish: Please have a look on https://review.openstack.org/#/c/47339/05:53
*** madan has quit IRC05:57
*** prekarat has joined #openstack-qa06:01
*** DennyZhang has quit IRC06:02
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/47348 failed tempest because of: https://bugs.launchpad.net/bugs/122633706:07
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IKE policies tests  https://review.openstack.org/4734806:14
*** Madan has joined #openstack-qa06:17
*** madan_ has joined #openstack-qa06:18
Anjuplease tell me before calling06:23
raiescan any body help me on rebase of https://review.openstack.org/4734806:28
raies?06:28
*** afazekas has joined #openstack-qa06:37
afazekasjog0: looks like this issue still happening: https://bugs.launchpad.net/nova/+bug/122198706:40
jog0afazekas: those were false positives06:41
jog0the query was for setting isntances to error state06:41
jog0afazekas: I used that because the debug level logs that showed the issue aren't logged. And at the time I didn't know the root cause06:42
jog0afazekas: of the recent cases none match the actual bug details  (at least the ones I looked at)06:43
afazekashttp://logs.openstack.org/64/47264/2/gate/gate-tempest-devstack-vm-full/dced339/logs/screen-n-sch.txt.gz#_2013-09-24_04_44_35_20706:43
jog0afazekas: that is a different error. 1221987 was about nova-compute seizing up and not reporting back its heartbeat06:44
jog0so scheduler would fail saying compute-node is dead06:44
openstackgerritZhu Zhu proposed a change to openstack/tempest: Add test for nova API of VM lock/unlock  https://review.openstack.org/4784606:45
*** fbo_away is now known as fbo06:46
afazekasjog0: Ok06:46
afazekasDo we have new bug for the new issue ?06:46
jog0afazekas: no instance going into error state is a very general thing06:56
jog0to not get false positives we need to find the stacktrace underneath06:57
jog0check nova-compute stacktraces06:57
afazekas'Filter RetryFilter returned 0 host(s)'  is it also very general ?06:58
*** jlibosva has joined #openstack-qa06:58
afazekasok06:58
*** tkammer has joined #openstack-qa07:00
afazekashttp://logs.openstack.org/64/47264/2/gate/gate-tempest-devstack-vm-full/dced339/logs/screen-n-cpu.txt.gz#_2013-09-24_04_44_31_806 this was the real issue07:00
afazekas@tags:"logs/screen-n-cpu.txt" AND @message:"ISCSI volume not yet found at: vda. Will rescan & retry.  Try number: 2"07:05
jog0afazekas: that is probably close enough there is also this though http://logs.openstack.org/64/47264/2/gate/gate-tempest-devstack-vm-full/dced339/logs/screen-n-cpu.txt.gz#_2013-09-24_04_44_14_01107:05
jog0anyway its past my bedtime feel free to propose a patch to https://github.com/jogo/elasticRecheck/blob/master/queries.json07:06
jog0moving it to -infra soon07:06
*** prekarat1 has joined #openstack-qa07:06
afazekasBTW: 'Time Limit Exceeded! (400s)while waiting for active, but we got killed.'  I am going to change the image's wait method to abort the test when it gets the killed07:09
afazekasok07:09
*** prekarat has quit IRC07:09
raiesafazekas: hi07:14
raiesplease check https://review.openstack.org/#/c/47339/07:14
*** Madan has quit IRC07:14
*** madan_ has quit IRC07:15
raiesafazekas: are you there ?07:15
* afazekas commented07:16
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part2  https://review.openstack.org/3960907:17
raiesafazekas: looking at07:17
*** Madan has joined #openstack-qa07:19
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas vpnservice test cases  https://review.openstack.org/4733907:26
*** madan_ has joined #openstack-qa07:27
raiesafazekas: done07:27
*** SergeyLukjanov has joined #openstack-qa07:35
*** jhenner has quit IRC07:43
*** annegentle has quit IRC07:44
openstackgerritYang Yu proposed a change to openstack/tempest: Adding glance API DELETE /images/<imageid> tests  https://review.openstack.org/4798307:45
*** annegentle has joined #openstack-qa07:45
openstackgerritYang Yu proposed a change to openstack/tempest: Adding glance API DELETE /images/<imageid> tests  https://review.openstack.org/4798307:50
*** SergeyLukjanov has quit IRC07:53
*** yassine has joined #openstack-qa07:59
*** zhikunliu has quit IRC07:59
*** SergeyLukjanov has joined #openstack-qa08:01
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part1  https://review.openstack.org/3962108:18
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part2  https://review.openstack.org/3960908:18
*** giulivo has joined #openstack-qa08:25
*** Madan1 has joined #openstack-qa08:25
*** Madan has quit IRC08:27
*** madan_ has quit IRC08:28
raiesafazekas: Please check errors during build https://review.openstack.org/#/c/47339/08:28
afazekasit will be an infra related stuff08:38
afazekashttp://status.openstack.org/zuul/08:39
afazekasIt will be discussed on the #openstack-infra08:42
*** prekarat1 has quit IRC08:44
*** madan_ has joined #openstack-qa08:47
*** zhikunliu has joined #openstack-qa08:49
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IKE policies tests  https://review.openstack.org/4734808:56
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IKE policies tests  https://review.openstack.org/4734809:02
*** Madan1 has quit IRC09:06
*** madan_ has quit IRC09:07
*** Madan has joined #openstack-qa09:11
*** ken1ohmichi has quit IRC09:13
openstackgerritMh Raies proposed a change to openstack/tempest: VPNaas IPSec policies tests  https://review.openstack.org/4781609:15
*** bashok_ has quit IRC09:20
*** madan_ has joined #openstack-qa09:20
*** prekarat has joined #openstack-qa09:23
*** jhenner has joined #openstack-qa09:38
openstackgerritFlavio Percoco proposed a change to openstack-dev/devstack: Add marconi support to devstack  https://review.openstack.org/4799909:42
*** thomasbiege1 has joined #openstack-qa09:58
*** bashok has joined #openstack-qa09:58
*** bashok has quit IRC09:58
*** bashok has joined #openstack-qa09:59
*** jhenner has quit IRC10:03
openstackgerritTal Kammer proposed a change to openstack/tempest: Initial basic setup of openstack and tempest config file  https://review.openstack.org/4292010:09
*** bashok_ has joined #openstack-qa10:10
*** zhikunliu has quit IRC10:12
*** bashok has quit IRC10:13
*** thomasbiege1 has quit IRC10:22
*** fbo is now known as fbo_away10:25
*** thomasbiege has joined #openstack-qa10:25
*** malini_afk is now known as malini10:28
*** mordred has quit IRC10:29
*** prekarat has quit IRC10:31
*** prekarat1 has joined #openstack-qa10:31
*** mordred has joined #openstack-qa10:32
*** thomasbiege has quit IRC10:40
*** thomasbiege has joined #openstack-qa10:40
*** bashok__ has joined #openstack-qa10:41
*** bashok_ has quit IRC10:41
openstackgerritTal Kammer proposed a change to openstack/tempest: Refactor and extends the functionality of the TempestConfig  https://review.openstack.org/4800910:42
*** thomasbiege has quit IRC10:47
*** jhenner has joined #openstack-qa11:05
openstackgerritSean Dague proposed a change to openstack-dev/devstack: make git show not display a diff  https://review.openstack.org/4801111:06
*** adarazs_ is now known as adarazs11:13
*** dkranz has quit IRC11:17
openstackgerritHoisaleshwara Madan V S proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part2  https://review.openstack.org/3960911:26
*** bashok_ has joined #openstack-qa11:33
*** bashok__ has quit IRC11:33
*** malini is now known as malini_afk11:42
*** fbo_away is now known as fbo11:43
*** thomasbiege has joined #openstack-qa11:51
*** thomasbiege has quit IRC11:52
*** mriedem has joined #openstack-qa11:57
*** mriedem has quit IRC11:58
*** jhenner has quit IRC12:00
*** tkammer has quit IRC12:02
*** jhenner has joined #openstack-qa12:02
*** afazekas has quit IRC12:02
*** jhenner has quit IRC12:03
*** jhenner has joined #openstack-qa12:03
openstackgerritHoisaleshwara Madan V S proposed a change to openstack/tempest: port test_flavors into v3 part_2  https://review.openstack.org/4803012:06
*** dims has joined #openstack-qa12:08
openstackgerritSean Dague proposed a change to openstack-dev/grenade: cliff 1.4.5 workaround  https://review.openstack.org/4803212:14
*** mriedem has joined #openstack-qa12:17
*** dkranz has joined #openstack-qa12:18
*** afazekas has joined #openstack-qa12:20
*** madan_ has quit IRC12:20
openstackgerritXiang Hui proposed a change to openstack/tempest: Enhance Neutron ports update test  https://review.openstack.org/4689412:20
*** jasondotstar has joined #openstack-qa12:21
*** Madan has quit IRC12:21
*** tkammer has joined #openstack-qa12:22
*** weshay has joined #openstack-qa12:25
openstackgerritIvan-Zhu proposed a change to openstack/tempest: port test_images and test_server_actions into v3 part2  https://review.openstack.org/3960912:28
*** dims has quit IRC12:29
*** dims has joined #openstack-qa12:30
*** adalbas has joined #openstack-qa12:34
*** EmilienM has quit IRC12:35
*** EmilienM has joined #openstack-qa12:36
*** prekarat1 has quit IRC12:37
*** prekarat has joined #openstack-qa12:37
*** weshay has quit IRC12:46
*** mriedem has quit IRC12:46
*** bashok_ has quit IRC12:46
*** weshay has joined #openstack-qa12:46
*** mriedem has joined #openstack-qa12:46
*** DennyZhang has joined #openstack-qa12:47
*** bashok_ has joined #openstack-qa12:47
*** giulivo has quit IRC12:50
*** rfolco has joined #openstack-qa12:51
*** mkoderer_ is now known as mkoderer12:54
*** tkammer has quit IRC12:55
*** tkammer has joined #openstack-qa12:56
*** giulivo has joined #openstack-qa12:57
openstackgerritA change was merged to openstack-dev/grenade: cliff 1.4.5 workaround  https://review.openstack.org/4803212:59
*** afazekas has quit IRC13:03
*** tkammer has quit IRC13:03
*** tkammer has joined #openstack-qa13:04
*** jhenner has quit IRC13:04
openstackgerritEmilien Macchi proposed a change to openstack-dev/devstack: Add Neutron Metering Agent support  https://review.openstack.org/4804213:11
*** thomasbiege has joined #openstack-qa13:22
openstackgerritJulien Danjou proposed a change to openstack-infra/devstack-gate: Enable Ceilometer alarm services  https://review.openstack.org/4804613:25
*** jhenner has joined #openstack-qa13:25
*** JayMcCoy has joined #openstack-qa13:30
*** prekarat has quit IRC13:33
*** malini_afk is now known as malini13:34
openstackgerritJoe Hakim Rahme proposed a change to openstack/tempest: Adds more test to cover Swift tempURL middleware  https://review.openstack.org/4428713:38
*** matsuhashi has quit IRC13:38
*** JayMcCoy has left #openstack-qa13:42
*** sthaha has quit IRC13:47
*** bdperkin_gone is now known as bdperkin13:54
*** nosnos has quit IRC13:54
*** nosnos has joined #openstack-qa13:55
*** nosnos has quit IRC13:58
mriedemopen question, i've been seeing some patches in nova get through the gate with pep8 failures, wondering if anyone knows about this?14:00
mriedemfor example, this patch https://review.openstack.org/#/c/47901/14:00
mriedemdidn't catch this: ./plugins/xenserver/xenapi/etc/xapi.d/plugins/pluginlib_nova.py:115:9: H231  Python 3.x incompatible 'except x,y:' construct14:00
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/48049 failed tempest with an unrecognized error14:01
mtreinishclarkb: it actually already leaves gerrit comments. They just have my name on them now (which is funny because about 50% of the people don't realize it's a bot)14:01
mtreinishclarkb: although that one you're pointing out was a false positive14:01
*** thomasbiege has quit IRC14:03
*** EmilienM has quit IRC14:04
*** EmilienM has joined #openstack-qa14:07
*** thomasbiege has joined #openstack-qa14:08
*** adalbas has quit IRC14:25
openstackgerritMonty Taylor proposed a change to openstack-infra/devstack-gate: Use select-mirror in devstack-gate  https://review.openstack.org/4806414:32
*** jlibosva1 has joined #openstack-qa14:36
*** DennyZha` has joined #openstack-qa14:36
*** DennyZhang has quit IRC14:36
*** jlibosva has quit IRC14:38
*** thomasbiege has quit IRC14:38
*** jlibosva1 has quit IRC14:40
*** timello has quit IRC14:40
*** timello has joined #openstack-qa14:42
*** adalbas has joined #openstack-qa14:46
RecheckWatchBotopenstack/python-ceilometerclient change: https://review.openstack.org/48005 failed tempest because of: https://bugs.launchpad.net/bugs/121191514:56
*** thomasbiege has joined #openstack-qa14:56
*** SergeyLukjanov has quit IRC14:58
*** SergeyLukjanov has joined #openstack-qa14:59
RecheckWatchBotopenstack/ceilometer change: https://review.openstack.org/47995 failed tempest with an unrecognized error15:01
*** jlibosva has joined #openstack-qa15:02
*** RecheckWatchBot has quit IRC15:03
*** RecheckWatchBot has joined #openstack-qa15:04
openstackgerritMate Lakat proposed a change to openstack-dev/devstack: xenapi: Get rid of prompt settings  https://review.openstack.org/4807815:04
*** mlavalle has joined #openstack-qa15:12
*** morganfainberg has quit IRC15:13
*** morganfainberg has joined #openstack-qa15:16
*** dosaboy has quit IRC15:16
*** dosaboy has joined #openstack-qa15:23
*** dosaboy has quit IRC15:24
*** dosaboy has joined #openstack-qa15:24
*** dosaboy has quit IRC15:24
*** dosaboy has joined #openstack-qa15:25
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/46894 failed tempest with an unrecognized error15:27
*** prekarat has joined #openstack-qa15:32
*** prekarat has quit IRC15:32
*** fbo is now known as fbo_away15:33
*** prekarat has joined #openstack-qa15:35
*** psedlak is now known as psedlak|afk15:39
RecheckWatchBotopenstack/ceilometer change: https://review.openstack.org/47608 failed tempest because of: https://bugs.launchpad.net/bugs/122633715:42
*** thomasbiege has quit IRC15:45
*** prekarat has quit IRC15:46
*** jasondotstar has quit IRC15:50
*** atiwari has joined #openstack-qa15:52
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/48009 failed tempest with an unrecognized error15:53
*** hootjr has joined #openstack-qa16:03
*** thomasbiege has joined #openstack-qa16:06
*** thomasbiege has quit IRC16:07
openstackgerritRoman Prykhodchenko proposed a change to openstack-dev/devstack: Expose all versions of Ironic API  https://review.openstack.org/4808816:11
*** jlibosva has quit IRC16:12
*** yassine has quit IRC16:14
openstackgerritKyle Mestery proposed a change to openstack-dev/devstack: Support per-MechanismDriver config with ML2  https://review.openstack.org/4088216:14
*** jlibosva has joined #openstack-qa16:23
RecheckWatchBotopenstack/cinder change: https://review.openstack.org/47954 failed tempest because of: https://bugs.launchpad.net/bugs/122633716:25
*** morganfainberg has quit IRC16:31
*** raies__ has joined #openstack-qa16:31
raies__hi please look at https://review.openstack.org/#/c/47339/16:31
raies__jaypipes: ^^16:32
openstackgerritA change was merged to openstack/tempest: README.rst of tempest stress is misleading  https://review.openstack.org/4788316:33
openstackgerritA change was merged to openstack/tempest: Sync install_venv_common.py from oslo-incubator  https://review.openstack.org/4760216:33
openstackgerritA change was merged to openstack/tempest: Move LockFixture to tempest.common  https://review.openstack.org/4793216:33
raies__sdague: hi please have a look on https://review.openstack.org/#/c/47339/16:34
openstackgerritGiulio Fidente proposed a change to openstack/tempest: makes passing the client optional to utilities in scenario/manager.py  https://review.openstack.org/4718216:34
*** morganfainberg has joined #openstack-qa16:37
raies__mkoderer: https://review.openstack.org/#/c/47339/16:40
openstackgerritMate Lakat proposed a change to openstack-dev/devstack: xenapi: enable user interaction with stack.sh  https://review.openstack.org/4809216:43
RecheckWatchBotopenstack/ceilometer change: https://review.openstack.org/46917 failed tempest because of: https://bugs.launchpad.net/bugs/121191516:44
*** jasondotstar has joined #openstack-qa16:45
*** jlibosva has quit IRC16:46
*** jlibosva has joined #openstack-qa16:46
*** marun has joined #openstack-qa16:47
*** thomasbiege has joined #openstack-qa16:48
openstackgerritTal Kammer proposed a change to openstack/tempest: Initial basic setup of openstack and tempest config file  https://review.openstack.org/4292016:50
*** jhenner has quit IRC16:53
*** EmilienM has quit IRC16:53
*** SergeyLukjanov has quit IRC16:54
*** EmilienM has joined #openstack-qa16:54
openstackgerritTal Kammer proposed a change to openstack/tempest: Refactor and extends the functionality of the TempestConfig  https://review.openstack.org/4800916:55
*** tkammer has quit IRC16:59
sdagueraies__: please stop pinging people every day on your reviews. People will get to them when they get time, and you constantly nagging people is just making people not want to review any of your code17:03
raies__sdague: If it is like this, I am sorry for the inconvenience caused17:04
*** thomasbiege has quit IRC17:10
openstackgerritGiulio Fidente proposed a change to openstack/tempest: makes passing the client optional to utilities in scenario/manager.py  https://review.openstack.org/4718217:18
openstackgerritMate Lakat proposed a change to openstack-dev/devstack: xenapi: enable user interaction with stack.sh  https://review.openstack.org/4809217:18
*** mlavalle has quit IRC17:22
mtreinishsdague: haven't we moved past H3 already? https://bugs.launchpad.net/tempest/+bug/120534417:24
sdagueyes17:24
mtreinishwas that just your script messing up then?17:25
sdagueyep17:26
*** DennyZha` has quit IRC17:30
*** SergeyLukjanov has joined #openstack-qa17:36
*** thomasbiege has joined #openstack-qa17:38
openstackgerritMate Lakat proposed a change to openstack-dev/devstack: xenapi: enable user interaction with stack.sh  https://review.openstack.org/4809217:47
*** mlavalle has joined #openstack-qa17:59
dosaboygiulivo: ping18:04
openstackgerritRoman Prykhodchenko proposed a change to openstack/tempest: API tests for Ironic  https://review.openstack.org/4810918:06
*** jlibosva has quit IRC18:25
*** mriedem has quit IRC18:27
*** mriedem has joined #openstack-qa18:33
*** raies__ has quit IRC18:36
*** hootjr has quit IRC18:38
*** bashok has joined #openstack-qa18:46
*** bashok has quit IRC18:47
*** bashok has joined #openstack-qa18:47
*** bashok_ has quit IRC18:50
openstackgerritGiulio Fidente proposed a change to openstack/tempest: enforce proper formatting of skip message  https://review.openstack.org/4812118:54
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/48088 failed tempest because of: https://bugs.launchpad.net/bugs/122316119:14
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/47837 failed tempest with an unrecognized error19:15
RecheckWatchBotopenstack-infra/devstack-gate change: https://review.openstack.org/48046 failed tempest because of: https://bugs.launchpad.net/bugs/122633719:15
RecheckWatchBotopenstack/tempest change: https://review.openstack.org/47182 failed tempest with an unrecognized error19:16
RecheckWatchBotopenstack/keystone change: https://review.openstack.org/47208 failed tempest because of: https://bugs.launchpad.net/bugs/121839119:16
RecheckWatchBotopenstack/cinder change: https://review.openstack.org/48079 failed tempest because of: https://bugs.launchpad.net/bugs/121773419:16
RecheckWatchBotopenstack-dev/devstack change: https://review.openstack.org/48088 failed tempest with an unrecognized error19:17
jgriffithmtreinish: jog0 so the bot seems to work really well except for the timing19:18
jgriffithmtreinish: jog0 wonder if there's a way to change it from a bot to a process launched on failures in the gate env?19:18
*** bashok_ has joined #openstack-qa19:19
clarkbjgriffith: the problem with timing is it is really expensive to index the giant logs that we produce19:20
clarkbjgriffith: depending on the change I think we can generate close to a gig of uncompressed logs that need to be filtered19:20
clarkbwell closer to 700MB19:20
*** bashok has quit IRC19:21
jgriffithclarkb: ahh... good point19:21
RecheckWatchBotopenstack/nova change: https://review.openstack.org/43268 failed tempest with an unrecognized error19:24
sdagueyeh, I think we might want to have a holistic look at what we can trim from logs19:26
mtreinishsdague: for logstash or in general?19:29
sdagueactually, do any of your fingerprints come from DEBUG lines?19:29
*** bashok__ has joined #openstack-qa19:29
sdagueI wonder if we could just not index DEBUG lines19:30
clarkbsdague: we aren't19:30
mtreinishsdague: I don't think so: https://github.com/jogo/elasticRecheck/blob/master/queries.json19:30
clarkbsdague: you suggested that a while back and I removed DEBUG lines from indexing, but you still have to filter all of the lines19:30
sdaguehmm... do we still feed logstash logs with DEBUG?19:31
sdagueand then have it drop them19:31
sdagueor do we filter first19:31
sdagueclarkb: and appologies in advance for things I should already know, vacation + linuxcon with only a couple weeks inbetween means lots of bits have dropped out of my brain :)19:32
clarkbsdague: we feed everything into logstash and it drops DEBUG before handing to elasticsearch19:33
*** bashok_ has quit IRC19:33
clarkbbecause logstash is supposed to be able to do this filtering for us relatively quickly but it may be failing at that19:33
sdaguemight be worth figuring out if we grep it first to drop those if it speeds up19:33
sdaguebecause our logs are actually pretty little after DEBUG is gone19:34
clarkbyou can't grep and drop though19:34
clarkbbecause our logs are ugly19:34
mtreinishsdague: yeah if you just do grep -v DEBUG it doesn't end up too well19:35
clarkbwell maybe that isn't correct. I think it is possible to have multiline log entries that would be a major pain to grep and drop, but I would have to double check that19:35
clarkblogstash is handling those cases properly (but it slows us down)19:35
*** malini is now known as malini_afk19:35
sdagueso we could use the code that's colorizing as a close aproximation19:36
mtreinishclarkb: I think that's right because things like glanceclient output in nova logs is multiline and debug19:36
*** bashok has joined #openstack-qa19:36
sdagueI was actually going to add a feature to the log colorizer to strip the debug lines to get more reasonable input in the browser19:37
sdagueas a flag19:37
clarkbsdague: that sounds like a reasonable thing to do19:37
clarkband apply it to the frontend of logstash filtering19:37
sdagueyeh19:37
*** bashok__ has quit IRC19:38
sdagueyou fetch for logstash by url, right?19:38
sdaguenot directly off the filesystem19:38
clarkbyup19:39
clarkbso it would be easy to use if the colorizer did it for us :)19:39
sdagueyep19:39
*** bashok has quit IRC19:41
*** bashok has joined #openstack-qa19:42
*** jasondotstar has quit IRC19:54
*** jasondotstar has joined #openstack-qa20:03
*** rockyg has quit IRC20:06
*** thomasbiege has quit IRC20:25
*** krtaylor has quit IRC20:31
*** bashok has quit IRC20:32
*** rockyg has joined #openstack-qa20:33
*** mikal is now known as annegentle_proxy20:38
*** annegentle_proxy is now known as mikal20:38
*** atiwari has quit IRC20:43
*** bdperkin is now known as bdperkin_gone20:43
*** morganfainberg has quit IRC20:47
*** HenryG has joined #openstack-qa20:56
*** thomasbiege has joined #openstack-qa20:57
openstackgerritMate Lakat proposed a change to openstack-dev/devstack: xenapi: enable user interaction with stack.sh  https://review.openstack.org/4809220:59
*** rfolco has quit IRC21:01
openstackgerritDavid Kranz proposed a change to openstack/tempest: Don't log 'Not Found' ERROR during image cleanup  https://review.openstack.org/4814321:11
*** krtaylor has joined #openstack-qa21:13
*** dkranz has quit IRC21:20
*** morganfainberg has joined #openstack-qa21:23
openstackgerritDennyZhang proposed a change to openstack/tempest: _error_in_logs function of stress/driver.py shall check all nodes  https://review.openstack.org/4814721:24
openstackgerritDennyZhang proposed a change to openstack/tempest: _error_in_logs function of stress/driver.py shall check all nodes  https://review.openstack.org/4814721:26
openstackgerritDennyZhang proposed a change to openstack/tempest: _error_in_logs function of stress/driver.py shall check all nodes  https://review.openstack.org/4814721:30
*** thomasbiege has quit IRC21:32
*** jhenner has joined #openstack-qa21:38
*** weshay has quit IRC21:46
*** jasondotstar has quit IRC21:51
openstackgerritA change was merged to openstack-dev/devstack: Fix swift httpd on fedora  https://review.openstack.org/4686521:59
openstackgerritA change was merged to openstack-dev/devstack: Colorize Neutron log output and refactor log setup code  https://review.openstack.org/4300621:59
*** jhenner has quit IRC22:02
*** mlavalle has quit IRC22:16
*** SergeyLukjanov has quit IRC22:17
*** mriedem has quit IRC22:19
*** HenryG has quit IRC22:35
*** giulivo has quit IRC22:35
*** openstackgerrit has quit IRC22:52
*** openstackgerrit has joined #openstack-qa22:52
*** dims has quit IRC22:54
*** dims has joined #openstack-qa23:07
*** krtaylor has quit IRC23:09
*** notmyname has quit IRC23:47
*** hemnafk has quit IRC23:47
*** mikal has quit IRC23:47
*** rahmu has quit IRC23:47
*** bdperkin_gone has quit IRC23:47
*** marun has quit IRC23:47
*** RecheckWatchBot has quit IRC23:47
*** ianw has quit IRC23:47
*** lifeless has quit IRC23:47
*** rockyg has quit IRC23:47
*** dosaboy has quit IRC23:47
*** kashyap has quit IRC23:47
*** klrmn has quit IRC23:47
*** mtreinish has quit IRC23:47
*** soren has quit IRC23:47
*** pleia2 has quit IRC23:47
*** openstackgerrit has quit IRC23:47
*** mordred has quit IRC23:47
*** cyeoh has quit IRC23:47
*** sdague has quit IRC23:47
*** jog0 has quit IRC23:47
*** fungi has quit IRC23:47
*** mikal has joined #openstack-qa23:47
*** bdperkin_gone has joined #openstack-qa23:47
*** bdperkin_gone is now known as bdperkin23:48
*** rahmu has joined #openstack-qa23:48
*** fungi has joined #openstack-qa23:54
*** jog0 has joined #openstack-qa23:54
*** sdague has joined #openstack-qa23:54
*** cyeoh has joined #openstack-qa23:54
*** mordred has joined #openstack-qa23:54
*** openstackgerrit has joined #openstack-qa23:54
*** notmyname has joined #openstack-qa23:54
*** hemnafk has joined #openstack-qa23:54
*** rockyg has joined #openstack-qa23:54
*** marun has joined #openstack-qa23:54
*** dosaboy has joined #openstack-qa23:54
*** RecheckWatchBot has joined #openstack-qa23:54
*** lifeless has joined #openstack-qa23:54
*** ianw has joined #openstack-qa23:54
*** kashyap has joined #openstack-qa23:54
*** klrmn has joined #openstack-qa23:54
*** mtreinish has joined #openstack-qa23:54
*** pleia2 has joined #openstack-qa23:54
*** soren has joined #openstack-qa23:54
*** hemnafk has quit IRC23:54
*** hemnafk has joined #openstack-qa23:54
*** malini_afk is now known as malini23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!