Friday, 2013-09-06

openstackgerritA change was merged to openstack-infra/devstack-gate: Add support for large_ops tempest test  https://review.openstack.org/4377900:03
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a create_server test for flavor authorization  https://review.openstack.org/4399800:53
*** nosnos has joined #openstack-qa00:53
*** sthaha has joined #openstack-qa00:59
openstackgerritRyan Hsu proposed a change to openstack/tempest: Add volume device name and ssh user password options to Tempest configuration  https://review.openstack.org/4500301:13
*** krtaylor has quit IRC01:28
*** jasondotstar has joined #openstack-qa01:32
*** marun has quit IRC01:33
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a create_server test for flavor authorization  https://review.openstack.org/4399801:37
*** ken1ohmichi has joined #openstack-qa01:44
*** ericw has joined #openstack-qa01:44
*** ericw has quit IRC02:05
openstackgerritAngus Salkeld proposed a change to openstack-dev/devstack: Fix Heat's signing_dir  https://review.openstack.org/4536402:12
openstackgerritRyan Hsu proposed a change to openstack/tempest: Add device name, ssh password to Tempest config  https://review.openstack.org/4500302:28
*** ericw has joined #openstack-qa02:42
*** ericw has quit IRC02:45
*** mriedem has quit IRC02:59
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a create_server test for flavor authorization  https://review.openstack.org/4399803:12
*** prekarat has joined #openstack-qa03:22
*** prekarat has quit IRC03:25
*** prekarat has joined #openstack-qa03:27
*** prekarat has quit IRC03:31
*** prekarat has joined #openstack-qa03:31
openstackgerritAngus Salkeld proposed a change to openstack-dev/devstack: Fix Heat's signing_dir  https://review.openstack.org/4536403:35
openstackgerritKen'ichi Ohmichi proposed a change to openstack/tempest: Add a create_server test for flavor authorization  https://review.openstack.org/4399803:52
*** sthaha has quit IRC04:14
openstackgerritZhi Kun Liu proposed a change to openstack/tempest: add server resizing tests  https://review.openstack.org/4473204:49
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds verfication for Bootable Volume  https://review.openstack.org/4262105:36
openstackgerritnayna-patel proposed a change to openstack/tempest: Credentials Keystone V3 API Tests  https://review.openstack.org/3719405:49
*** jhenner has quit IRC06:01
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds verfication for Bootable Volume  https://review.openstack.org/4262106:16
*** jhenner has joined #openstack-qa06:19
*** yassine has joined #openstack-qa07:47
*** ken1ohmichi has quit IRC08:27
*** liuhangbin is now known as Leo-away08:35
openstackgerritBob Melander proposed a change to openstack-dev/devstack: Changes to make Devstack work with Neutron L3 plugin patch.  https://review.openstack.org/2090909:51
*** prekarat has quit IRC09:52
*** prekarat has joined #openstack-qa09:55
*** prekarat1 has joined #openstack-qa09:57
*** prekarat1 has quit IRC09:58
*** prekarat1 has joined #openstack-qa09:58
*** prekarat has quit IRC09:59
*** nosnos has quit IRC11:29
*** dkranz has quit IRC11:51
sdaguelifeless, did you have an easy pointer on how to turn a context into a fixture? would definitely unuglify this - https://review.openstack.org/#/c/45342/11:52
sdaguealso, feel free to say things are still busy with pycon :) it's not pressing, it's just a little beyond my current python-fu11:53
lifelesssdague: http://paste.openstack.org/show/45885/11:56
*** mkollaro has joined #openstack-qa11:59
*** adalbas has quit IRC12:01
sdagueso then do a with lockutis.lock(...) as lock:12:01
sdague    self.useFixture(foo, lock)12:02
sdague?12:02
lifelessno, cause that would enter the loc12:03
lifelesslock = self.useFixture(foo(luckutils.lock(...))12:03
lifeless<... stuff...>12:03
sdagueok, gotcha12:04
sdaguethanks!12:04
lifelessthe lock will be released when the test ends after any test code, teardown code and other cleanups registered after this line12:04
lifelesswarning:! Untested.12:04
sdagueyep, well we have code we know will break if we do it wrong, so we've got a good test :)12:04
*** anteaya has joined #openstack-qa12:05
*** weshay has joined #openstack-qa12:09
*** adalbas has joined #openstack-qa12:18
*** annegentle has quit IRC12:27
openstackgerritSean Dague proposed a change to openstack/tempest: fix race condition between addCleanup and lockutils  https://review.openstack.org/4534212:30
lifelesssdague: don't you also have a ridiculous-core-machien to test on ?12:39
lifelesssdague: so that might be subtley wrong, remind me to eyeball closely after tomorrow 2pm12:40
sdagueyeh, I have some physical boxes that are 2x hexa cores12:41
lifelesssdague: I don't think it will be wrong in a way that matters for you12:41
sdaguelifeless: ok, cool12:41
sdagueyeh, comments always appreciated, but I'll let you get back to more pressing things12:41
lifelessbut we should pull the context wrapper stuff out as a separate concern and make it really robust12:41
lifelessand check the semantics of return codes setc12:42
lifelessetc12:42
lifelesscare to file a bug on fixtures that this isn't a stock thing ?12:42
sdaguelifeless: sure, where's the tracker?12:42
lifelesshow to tell you have durunk enough; you can't type your bugtracker url anymore,12:44
lifelesshttps://bugs.launchpad.net/python-fixtures12:44
sdagueheh12:59
*** annegentle has joined #openstack-qa13:01
lifelesssdague: [context: 0100 here]13:01
*** thomasbiege has joined #openstack-qa13:10
openstackgerritSean Dague proposed a change to openstack/tempest: fix race condition between addCleanup and lockutils  https://review.openstack.org/4534213:16
sdaguelifeless: good enough? https://bugs.launchpad.net/python-fixtures/+bug/122172413:20
*** krtaylor has joined #openstack-qa13:29
openstackgerritSean Dague proposed a change to openstack/tempest: Eliminate the impact of "wait_until='BUILD'"  https://review.openstack.org/4279913:35
sdaguejog0: when you get up, can you test your latest change against this - https://review.openstack.org/#/c/45342/13:50
*** burt has joined #openstack-qa13:56
adalbassdague, i was looking at this review. It passed for me.14:01
sdagueadalbas: right, it needs to run with joe's devstack workers change though14:02
adalbassdague, oh, ok.14:02
*** prekarat1 has quit IRC14:03
*** prekarat has joined #openstack-qa14:03
*** dkranz has joined #openstack-qa14:11
openstackgerritnayna-patel proposed a change to openstack/tempest: Adds verfication for Bootable Volume  https://review.openstack.org/4262114:11
openstackgerritA change was merged to openstack/tempest: Add device name, ssh password to Tempest config  https://review.openstack.org/4500314:15
openstackgerritA change was merged to openstack/tempest: Fix colon in create volume logging output  https://review.openstack.org/4514914:16
openstackgerritChmouel Boudjnah proposed a change to openstack-dev/devstack: Use 1.4.1 of pip.  https://review.openstack.org/4543614:16
openstackgerritA change was merged to openstack-dev/devstack: Fix Heat's signing_dir  https://review.openstack.org/4536414:17
*** mlavalle has joined #openstack-qa14:22
openstackgerritCyril Roelandt proposed a change to openstack-dev/devstack: Swift: configure Ceilometer when it is enabled  https://review.openstack.org/4520114:26
*** prekarat has quit IRC14:32
*** weshay has quit IRC14:39
*** thomasbiege has quit IRC15:09
*** thomasbiege has joined #openstack-qa15:15
dkranzsdague: So I was looking at the various patches for nova v3 api15:17
sdagueok15:17
dkranzsdague: And thinking about the subclass vs copy issue15:17
dkranzsdague: I initial thought was that subclassing would be easier to deal with.15:17
dkranzsdague: But when I looked at the code, it is not really subclassing.15:17
sdagueyeh, there are enough differences, I think we just need a different tree15:18
dkranzsdague: Yes, there is as subclass, but the base class is riddled with "ifs"15:18
dkranzsdague: That is the worst of both worlds IMO15:18
sdagueagreed15:18
dkranzsdague: Do we need a one size fits all for this?15:18
sdaguemeaning?15:18
dkranzsdague: This decision could be made on a class-by-class basis15:19
dkranzsdague: If it is easy to abstract into a real subclass we do that.15:19
dkranzsdague: Otherwise copy15:19
sdagueit could be, but we already do api/image/{v1,v2}15:19
dkranzsdague: I know, but this issue was not really discussed at the time.15:19
dkranzsdague: But I don't really object to copying either.15:20
sdagueyeh15:20
dkranzsdague: How does the nova code deal with this?15:20
sdaguecopy15:20
dkranzsdague: They have the same issue.15:20
sdaguewe threw out the idea of subclassing because of the ifdef issue15:21
dkranzsdague: Well, then we should to I think.15:21
sdagueyep, I'd be good with that15:21
*** ericw has joined #openstack-qa15:21
dkranzsdague: OK, should we discuss this at the meeting next week or try to move with these reviews more quickly>15:22
sdaguesure15:22
dkranzsdague: After meeting, or before?15:22
sdaguedid you want to follow up to Ivan on the list about it? I just haven't gotten around to it yet, and was chasing some other bugs15:22
sdagueoh, I figured follow up on the list15:22
sdagueIvan actually kind of asked the question out there15:22
dkranzsdague: I can do that. Just wanted to make sure we were on the same page.15:23
sdaguegreat, thanks15:23
dkranzsdague: np. I'll do it after lunch.15:23
*** thomasbiege has quit IRC15:25
*** yassine has quit IRC15:47
sdaguedkranz: also this review could use eyes - https://review.openstack.org/#/c/45342/15:55
dkranzsdague: OK, haven't gotten around to reviews yet but will look at this now.15:56
dkranzsdague: I am OK with believing that change is ok.16:00
dkranzsdague: To give it a real +2 I would have to learn more about exactly how the fixture/lock stuff works.16:01
dkranzsdague: Anything that uses __xx__ methods :)16:02
dkranzsdague: I should do that anyway but may not get to it today.16:02
*** thomasbiege has joined #openstack-qa16:05
*** thomasbiege1 has joined #openstack-qa16:15
*** thomasbiege has quit IRC16:16
*** thomasbiege1 has quit IRC16:16
openstackgerritA change was merged to openstack-dev/devstack: Use 1.4.1 of pip.  https://review.openstack.org/4543616:32
openstackgerritA change was merged to openstack-dev/devstack: Rename ceilometer alarm service name  https://review.openstack.org/4521416:32
openstackgerritA change was merged to openstack-dev/devstack: Support OpenSwan in Neturon VPNaaS  https://review.openstack.org/4226516:32
openstackgerritSean McCully proposed a change to openstack/tempest: Changes Test, port is not gauranteed unused  https://review.openstack.org/4545916:42
mkodererdkranz: ping16:46
dkranzmkoderer: Yah16:46
openstackgerritSean McCully proposed a change to openstack/tempest: Changes Test, port is not gauranteed unused  https://review.openstack.org/4545916:46
mkodererdkranz: do you think we can close the stress test bp?16:46
mkodererdkranz: IMHO there isn't anything left to track16:46
dkranzmkoderer: I'm ok with that.16:47
mkodererdkranz: ok cool closed :)16:47
dkranzmkoderer: Certainly the original name of the blueprint doesn't make sense any more.16:48
dkranzmkoderer: We can always create  new one if there are new major features.16:48
mkodererdkranz: that right16:48
mkodererdkranz: I just want to  signalize that most of the work is done16:50
dkranzmkoderer: Sure16:50
mkodererdkranz: mhh I am searching for the "close" button16:51
mkoderercould it be that I am not allowed to close it?16:51
dkranzmkoderer: There is no close. You change the Implementation status16:51
mkodererdkranz: I can't16:52
mkodererthere is no button for it16:52
mkoderermaybe I am blind :)16:52
dkranzmkoderer: I just did it.16:52
dkranzmkoderer: Either you don't have privilege or just didn't see it.16:52
mkodererdkranz: ok thanks16:53
mkodererdkranz: maybe only the one that wrote it can close it16:53
dkranzmkoderer: Not sure.16:53
mkodereranyway.. thanks for all the help, was really fun to work with you folks16:54
mkoderer:)16:54
mkoderersdague: jfyi we closed the bp stress-test16:55
sdaguecool16:55
sdagueyay16:55
mkoderernow I have to find a new field of interest :D16:56
openstackgerritEdward Hope-Morley proposed a change to openstack/tempest: Added cinder-backup functional tests  https://review.openstack.org/4546517:07
jog0sdague: I wonder how many times people have hit the aggregate tempest race without knowing it17:08
sdaguejog0: you mean in production?17:09
jog0sdague: no on jenkins17:09
sdaguewell it didn't expose until testr17:09
jog0sdague: but that too17:09
sdaguebecause we were effectively single threaded17:10
sdaguehonestly, in production, it's probably very rare17:10
jog0sdague: right but it may have been there right after we switched to testr and was too hard to reproduce with single threaded nova-api17:10
sdagueas the admin api is something I wouldn't expect massive parallel attempts on17:10
sdaguejog0: no, you could produce it17:10
sdaguethat's why the locking was there in the first place17:10
jog0sdague: I agree, I am talking about the tempest side bug17:10
sdaguebut the extra workers made the surface change a bit17:11
jog0sdague:  so then ci may have been  hitting it until now just very very infrequently17:11
sdagueyeh17:12
sdaguethough I didn't see it pop up until your change17:12
sdaguedkranz: https://review.openstack.org/#/c/42799/ how about that one for review?17:12
openstackgerritLucas Alvares Gomes proposed a change to openstack-dev/devstack: Missing pxelinux.0 on RedHat systems  https://review.openstack.org/4402417:13
jog0sdague: btw the new fix is really slick17:13
dkranzsdague: Looking...17:14
sdagueyeh, thank lifeless for explaining to me how to do the context -> fixture thing17:14
sdaguehe's going to look at making that pattern part of future fixtures17:14
sdaguewhich would be cool17:15
jog0sdague: nice17:15
dkranzsdague: I presume ->BUILD is the first state transition for a new server?17:15
sdagueyes17:16
sdagueexcept, you can actually get UNKNOWN if you hit it early17:16
dkranzsdague: Right. I'm good with that.17:16
dkranzsdague: Approved.17:17
sdaguecool17:17
openstackgerritLucas Alvares Gomes proposed a change to openstack-dev/devstack: Wrong arguments for die() call  https://review.openstack.org/4546817:17
*** mlavalle has quit IRC17:23
dkranzsdague: I updated the meeting agenda page in order to add an item.17:34
dkranzsdague: I think neutron testing status should be a standing item until it is working.17:35
*** sdague has left #openstack-qa17:40
*** hemnafk is now known as hemna17:40
*** sdague has joined #openstack-qa17:40
sdagueyeh, though unless we get neutron folks in the meetings, I'm not sure it's going to help. Maybe we should join the neutron meetings around that one.17:41
*** mdenny has joined #openstack-qa17:43
*** mkollaro has quit IRC17:50
*** mlavalle has joined #openstack-qa17:55
dkranzsdague: You're right. It should be a standing item on *their* agenda.17:59
dkranzsdague: It seems their meeting is Mondays at 5pm.18:02
*** mkollaro has joined #openstack-qa18:06
openstackgerritA change was merged to openstack-dev/devstack: Fix Neutron issues related to Baremetal service  https://review.openstack.org/4430418:09
*** dosaboy has quit IRC18:09
*** dosaboy has joined #openstack-qa18:11
openstackgerritA change was merged to openstack/tempest: Eliminate the impact of "wait_until='BUILD'"  https://review.openstack.org/4279918:13
*** mkollaro has quit IRC18:18
*** adalbas has quit IRC18:20
*** thomasbiege has joined #openstack-qa18:22
*** jog0 is now known as flashgordon18:23
*** adalbas has joined #openstack-qa18:23
*** thomasbiege has quit IRC18:27
*** russellb is now known as rustlebee18:43
*** thomasbiege has joined #openstack-qa18:52
*** thomasbiege has quit IRC18:55
openstackgerritDoug Hellmann proposed a change to openstack-dev/devstack: Add flag to turn off chown of egg-info dirs  https://review.openstack.org/4524818:58
openstackgerritCyril Roelandt proposed a change to openstack-dev/devstack: Swift: configure Ceilometer when it is enabled  https://review.openstack.org/4520119:09
openstackgerritDoug Hellmann proposed a change to openstack-dev/devstack: Clean up automated changes to requirements  https://review.openstack.org/4547819:32
*** yassine has joined #openstack-qa19:44
*** JD has joined #openstack-qa20:22
*** JD is now known as Guest2141420:23
*** Guest21414 has left #openstack-qa20:23
*** yassine has quit IRC20:25
dkranzsdague: I was trying to track down a flaky from the latest tempest bug ticket.20:28
dkranzsdague: Did you know that n-cpu from a successful run now has 99 ERROR?20:29
sdagueyeh, they are mostly ceilo, right?20:39
sdaguethat's the thing I'll probably dive in on next week, the white list exceptions for logs, so that no more sneak in.20:40
flashgordondkranz: I knew that one20:51
flashgordonI think we filed a bug on it somewhere20:51
flashgordonor told celio ppl20:51
dkranzsdague, flashgordon : No, they are scattered among many things :(20:51
flashgordonsdague: what exceptions qualify for a whitelist? aren't all bad?20:51
flashgordondkranz: have a link?20:52
dkranzflashgordon: Just a sec. You can also just look at any successful run.20:52
flashgordonoh I came in here to drum up a second review on https://review.openstack.org/#/c/45342/ but looks like that won't happen20:52
dkranzflashgordon: http://logs.openstack.org/76/44876/5/check/gate-tempest-devstack-vm-full/f729bb6/console.html20:53
dkranzflashgordon: Well, I already +2'ed it :)20:53
flashgordondkranz: yeah :)20:53
dkranzflashgordon: New nic?20:54
flashgordondkranz: casual nick friday in nova land20:54
dkranzflashgordon: Sorry, I gave you the console link20:55
dkranzflashgordon: http://logs.openstack.org/76/44876/5/check/gate-tempest-devstack-vm-full/f729bb6/logs/screen-n-cpu.txt.gz20:55
flashgordondkranz: wgetting that file right now20:56
dkranzflashgordon: I think a lot of them are log errors being reported from what are in effect client errors, like "not found"20:56
flashgordondkranz: once I get the file over my slow hookup, I was gonna grep for ' ERROR ' and see20:57
dkranzflashgordon: Sure20:58
flashgordonbut that sounds about right20:58
flashgordondkranz: oh i See one now20:59
flashgordoneww20:59
flashgordonhttp://logs.openstack.org/76/44876/5/check/gate-tempest-devstack-vm-full/f729bb6/logs/screen-n-cpu.txt.gz#_2013-09-04_15_48_30_90020:59
dkranzflashgordon: THere is some nasty-looking stuff in there.21:00
dkranzflashgordon: I would not be surprised if there were a few real bugs21:00
openstackgerritKyle Mestery proposed a change to openstack-dev/devstack: Default to linuxbridge and openvswitch drivers for ML2.  https://review.openstack.org/4549321:00
flashgordondkranz: yeah21:01
flashgordonsdague: mentioend whitelisting some stacktraces aren't all stacktraces bad?21:02
flashgordonor is that a gatting trick21:02
dkranzflashgordon: I think they are all bad.21:03
dkranzflashgordon: But they won't all get fixed at once21:03
flashgordondkranz: right21:03
dkranzflashgordon: And we need to prevent new ones from slipping in.21:03
dkranzflashgordon: I went through this a while ago and filed a bunch of bugs but none of them were really addressed I think.21:04
* flashgordon *nod*21:04
dkranzflashgordon: So the plan is to drive them to zero either by fix or whitelist21:04
flashgordondkranz: in the future ping me about the nova bugs21:04
dkranzflashgordon: And then add a test that will fail the build if any new ones show up21:05
dkranzflashgordon: sURE.21:05
flashgordonand I will prod others to get them fixed21:05
dkranzflashgordon: caps lock back off21:05
flashgordonas there is no excuse for nova stacktracing21:05
dkranzflashgordon: That will be really helpful21:05
openstackgerritKyle Mestery proposed a change to openstack-dev/devstack: Default to linuxbridge and openvswitch drivers for ML2.  https://review.openstack.org/4549321:06
flashgordondkranz: glad to help21:06
flashgordondkranz: if you have a tool to gate on stacktraces showing that to the ML may put some fire under people21:08
dkranzflashgordon: I don't think this is really a test per-se. It would be a grep in devstack gate after tempest finishes.21:08
dkranzflashgordon: tempest doesn't really have access to the log files21:09
dkranzflashgordon: without some whitebox trickery that doesn't seem necessary for this21:09
dkranzflashgordon: The stress tests actually do this kind of check but they are not part of the gate.21:10
dkranzflashgordon: And it is turned off by default since it will always fail.21:10
flashgordondkranz: well I am sure with some -infra magic you can turn that grep into a potentailly gating test21:12
flashgordoneven though its not a test as you said21:12
dkranzflashgordon: Yeah. I'll take a look at devstack-gate and see if it is straightforward. I am not a bash wizard.21:13
flashgordondkranz: the #-infra folks are21:16
dkranzflashgordon: :)21:16
flashgordonso I think I found part of the glance client stacktraces stuff21:16
dkranzflashgordon: I try not to bother them if something is simple enough to do myself.21:17
flashgordondkranz: well they maay have some slick way of tying the check in21:24
flashgordonthe bash isn't too bad21:24
dkranzflashgordon: OK, I will send a message to openstack-infra list21:24
flashgordondkranz: you can just ask on IRC21:25
dkranzflashgordon: OK21:25
flashgordondkranz: they are a friendly bunch21:26
clarkbflashgordon: there is a ceilo bug submitted by dhellman about those stacktraces21:26
flashgordonclarkb: yeah that sounds right21:27
flashgordonclarkb: but turns out nova fails too21:27
flashgordonsee http://logs.openstack.org/76/44876/5/check/gate-tempest-devstack-vm-full/f729bb6/logs/screen-n-cpu.txt.gz#_2013-09-04_15_49_01_32321:27
*** adalbas has quit IRC21:37
*** yjiang5 has joined #openstack-qa21:40
*** yjiang5 is now known as bmqq12321:41
*** dkranz has quit IRC21:45
*** jasondotstar has quit IRC21:55
*** burt has quit IRC22:04
*** ericw has quit IRC22:05
*** mlavalle has left #openstack-qa22:33
*** ericw has joined #openstack-qa22:39
*** ranban has joined #openstack-qa22:51
ranbandoes anybody know how to disable the captured logging that gets displayed at the end of a tempest run?22:51
*** ericw has quit IRC22:51
lifelessranban: you don't want logs at all?22:53
ranbanlifeless: yes, i'd like to disable all logs22:54
ranban(for development purposes)22:55
lifelesshmm, I'm not sure, sorry.22:55
*** bnemec_away is now known as bnemec23:09
clarkbranban: there is a way to write it to file, that is how jenkins runs it23:31
clarkbit may need an env var or something like that to be set23:31
ranbanclarkb: i have the "log_file" option in tempest.conf and it does work, however, the log messages still get displayed at the end23:34
lifelessis there something to print a graph of puppet node relationships from a site.pp ?23:36
lifeless^ ECHANNEL23:38
flashgordonhttp://logs.openstack.org/97/45497/2/check/gate-tempest-devstack-vm-postgres-full/01f9c33/logs/screen-n-cpu.txt.gz#_2013-09-06_23_19_16_02223:43
flashgordonWAT23:43
flashgordonohh never mind I +2d the bug fix for this already23:43
*** hemna is now known as hemnafk23:44

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!