Sunday, 2013-08-04

*** rhsu has quit IRC00:26
*** mriedem has joined #openstack-qa01:01
*** prekarat has joined #openstack-qa02:48
*** prekarat has quit IRC02:53
*** SergeyLukjanov has joined #openstack-qa03:18
*** mriedem has quit IRC03:22
*** SergeyLukjanov has quit IRC05:15
*** afazekas has joined #openstack-qa05:17
*** raies has joined #openstack-qa05:21
raiesafazekas: hi05:21
raiesafazekas: please check https://review.openstack.org/#/c/39023/05:25
afazekasraies: I did not seen a newly added issue, +2. Thank you05:27
raiesafazekas: I have seen your +2 Thank you very much :)05:28
afazekasAnju: FYI https://review.openstack.org/#/c/40070/205:28
afazekasAnju: this change aims the fix 422 issue and replacing the error code to 404 when you try an action on a deleted VM05:29
raiesdkranz: please check https://review.openstack.org/#/c/39023/ it is reviewed05:32
afazekasI considered the +2 on Friday, but I got an interrupt  and I had to leave..05:37
raiesafazekas: its ok05:39
raieswaiting for approval05:39
raiesit took so long to be approve05:40
afazekasraies: It is a weekend in many country05:45
afazekasraies: try to create an another change05:46
raiesafazekas: hmm05:46
raiesafazekas: xml support for network API is ready05:47
raiesshould I make a blueprint for this first ? then to submit code ?05:47
afazekasraies: how big will be the total xml support, and how many patches ?05:48
raiesarround 200+ loc05:49
raiesfor now it is one05:49
afazekasraies: IMHO not necessary to create a blueprint for one patch05:50
raiesafazekas: ok i.e i should submit ?05:50
afazekasyou can submit it as dependent patch to your previous one, or you can submit as an individual patch, and you may need to rebase the other patch after the first one merged05:52
afazekasbut in both way, you can get review responses for both patch05:53
raiesok05:53
raiesstill it is dependent on what you review for me i.e. https://review.openstack.org/#/c/39023/05:53
raiesI thought that once https://review.openstack.org/#/c/39023/ is merged then I will submit xml support05:54
afazekasrebase you patch the new patch on the 39023 and the 'git review' will submit it as second change which depends on the previous one05:55
afazekasAs I remember just the second change really changes even if the 'git review' says otherwise05:56
* afazekas not sure05:56
raiesok05:56
raiesthanks for yor input05:56
afazekasif you accidentally lose the +2 because of git review command issue let me know.05:56
raiesok05:57
raiesafazeas: talk to you later and once again thnks for your input05:58
afazekasraies: you are welcome05:59
*** raies has left #openstack-qa06:00
*** SergeyLukjanov has joined #openstack-qa06:36
*** tkammer has joined #openstack-qa07:31
*** jhenner has joined #openstack-qa07:52
*** jhenner has quit IRC07:57
*** SergeyLukjanov has quit IRC07:59
*** SergeyLukjanov has joined #openstack-qa08:00
*** jhenner has joined #openstack-qa08:49
*** jhenner has quit IRC08:53
*** tkammer has quit IRC09:02
*** tkammer has joined #openstack-qa09:28
mkodererafazekas: ping09:46
afazekasmkoderer: pong09:47
mkodererGood morning ;)09:47
afazekasGood morning ;)09:47
mkodererI think my maillist setup is somehow messed up09:48
mkodererhow do I write to the new mailing list?09:48
mkodererwe use the general one right?09:48
afazekasAFAIK you need to write to the dev list with [QA] tag in the subject09:48
mkodererok so I just add this tag to the subject09:49
mkodererwe have a lot of discussions in the reviews about the stress test09:50
afazekashttp://lists.openstack.org/pipermail/openstack-dev/2013-August/012912.html like this09:50
mkodererI think we need to clarify what exactly is the purpose of the stress test as such09:50
afazekasI think we should focus on the integration points first09:51
mkodererI see two use cases09:51
afazekasfloating ip with real end-to-end check (I started something  on Friday, but I got too many interrupts ..)09:51
afazekasthe other should be the volume issue what we seen09:52
afazekasis the volume real visible on the guest09:52
afazekasWith an optional write09:52
afazekasit can be confugurable09:52
mkoderermhh yes sounds good09:52
mkodererif you have a look here https://review.openstack.org/#/c/39752/09:52
afazekasthe snapshot creation also an interesting point09:52
mkodererthere is a more general discussion about "what should we stress test"09:52
afazekascinder can mova images to glance and swift09:53
afazekasmostly the things what can have potential race issues..09:53
mkodererI want to use the stress tests for a different purpose ..09:53
afazekasFor example security rule apply / remove effect time ..09:53
afazekasWhat is your use case ?09:54
mkodererI want to use it in a production like environment to indentify potential problems before there occur09:54
mkoderermy target are more real-life use cases09:54
afazekasJust the end user activity ?09:55
mkodereryes, I want to have a mix of traffic that can occur in a production system09:56
afazekasOr including admin events , or  random system failures ?09:56
mkodereryes maybe everything - I need to plan some scenarios09:56
afazekasso probably multiple tempest run with good filtering and scenario test can help in this09:56
afazekasmkollaro also has this repo for fail injection https://github.com/mkollaro/destroystack09:57
mkodereryes but I need to have a high load, so I like the multiprocessing thing in the stress test09:57
afazekasShe focused on swift, but I hope it can be extended for other serices09:57
afazekasmkoderer: what limits you in the number of tempest process to start ?09:58
mkodererDestoryStack sounds interesting ;)09:58
afazekasI have bunch of idea for creating a DebugStack repo, ..  but time is less :(10:00
mkodererafazekas: I think the handling would be a bit hard10:00
afazekasWe will have many <foobar>Stack project10:00
mkodererputting all together to one statistic is exactly what the stress test runner can do for me10:00
afazekasmkoderer: so the UnitTest runner plugin is actually useful for you ?10:01
mkodereryes for my point of view this is what I need10:01
mkodererbut I feel that we have different opinions within Qa..10:02
afazekasFYI: the subuit has some kind of scheduler plug ability, I did not checked yet, but it can be another option..10:02
afazekasmkoderer: I do not think we have different opinion10:03
afazekasI see even  see more use cases sometimes :)10:03
mkodererok - I suggest to create a HACKING.rst for the stress test10:03
*** SergeyLukjanov has quit IRC10:03
mkodererand there we put the use cases we want to have10:03
afazekasfor me usually not enough to see it is not working, I want to know in fastest way why10:04
mkodererafazekas: that true - maybe a open point10:04
mkodererfor me it's often hard to determin what went wrong in a openstack deployment10:05
afazekasI am considering to implement full systemtap based tracer designed for openstack type apps..10:06
afazekasThe first issue is important for me, because I usually do not really care about the happenings after the first issue10:07
mkodererafazekas: cool.. my master thesis was about systemtap.. long time ago ;)10:07
afazekasSo maybe you know even better it10:07
mkodererquestion is how you want to indentify the first problem?10:08
afazekaslooks like the awk style does not really lets you to process everything in the stap script,  basically I will need a lot of post processing and pre processing, and may be I will have some small blinds spots10:08
afazekasmkoderer: The first test case failure10:09
mkodererI have to think about it10:10
afazekashttp://fedoraproject.org/wiki/Features/SystemtapStaticProbes#Python   python is very noisy ( no real threading  workarounds), so first I would like correlate the syscalls with python stack traces10:12
afazekasThe second usual issue is the process and network traffic connection10:12
mkodererwhat it the current state of systemtap - the time I used it it wasn't really stable10:13
afazekaswith neutron / openvswich  / iptables / namspaces  the in kernel pocket flow also interesting ..10:13
afazekasmkoderer: AFAIK it is stable10:13
mkoderercool... I used dtrace very extensivly on Solaris, and this was really stable even in the kernel10:15
mkodererafazekas: I need to have a look the tap and pyhton10:15
mkodererafazekas: I would really like to help you with it10:16
afazekasmkoderer: the other option would be python remote debuger on every python process (you can modify  some weak symbols + LD_PRELOAD  to have it started where it is needed )10:16
afazekasafter the neutron smoke gate restored we can talk more about this10:18
mkodererafazekas: yes sure I will already have a look about it10:18
mkodererit seems that I have more time next week... our system is now up and running10:19
mkodererso I won't be that busy .. and I will use the time for upstream10:20
*** psedlak has joined #openstack-qa10:20
afazekascool10:26
*** psedlak has quit IRC10:26
mkodererafazekas: when will you add more core reviewers? already next qa meeting?10:27
*** SergeyLukjanov has joined #openstack-qa10:33
afazekasmkoderer: I have no idea. last time when we considered, nobody seamed close  to the core reviewer's review count/month10:35
mkodererok I started this weekend - I will try to review what I can during the week ;)10:36
mkodererbut sure it's hard to get close since I don't have your experience with tempest10:38
mkodererI need long for a review..10:38
afazekasPlease try to do better than usually I , so say 'thank you' and 'please' more frequently, and try to be as much informative as possible when you -1 something10:38
mkodereryes sure and I am always open for feedback ;)10:41
afazekasjaypipes usually has nice/polite review comments, but unfortunate nowadays I rarely see them.10:44
mkodererafazekas: is there a script somewhere where you see the stats out of gerrit10:52
afazekasyes, but I do not know where sdague used it , afaik it is from russelb . You can see some references in the QA mailing list archive10:53
mkodererok I will search it10:54
mkodererI am off for today - have a nice sunday10:54
afazekasbtw the unittest runner thing should be extended by json generator, when you can create unittest pairs.10:55
afazekasThe use case us you have 1 racy test case, and you would like to run it together with all possible conflicting test case10:56
afazekasthe aggragates test case may conflict with the host clients..10:56
mkodererok will have a look at it11:01
afazekasAnd we should think about what should be 10-20 minute stress test run as gate job11:07
afazekasnow 2 complex test case skipped because of the volume issue, and  we lose coverage in another places11:08
afazekasmkoderer: and usually if this happens, when the other bug is fixed, a new one introduced. In this very bad shape, does not really makes sense to attack with real life patters, since we know, it fails even with a mini size pattern.11:11
*** SergeyLukjanov has quit IRC11:26
*** mkollaro has joined #openstack-qa11:37
afazekasmkoderer: <evilmode> would be better to not skip the test when there  is "race" issue in one of the openstack components , it would enforce more people to have a look </evilmode>12:04
mkodererafazekas: I think this we cause a lot of trouble ;)12:14
mkodererafazekas: I think there should be a process to escalate such issues12:14
afazekasI think stress voting gate job, could prevent many of those issues12:18
mkodereryes think so12:19
*** psedlak has joined #openstack-qa12:22
*** giulivo has joined #openstack-qa12:50
*** giulivo has quit IRC12:55
*** giulivo has joined #openstack-qa13:09
*** mriedem has joined #openstack-qa13:36
*** mriedem has quit IRC13:39
*** Anju_ has joined #openstack-qa13:42
*** Anju_ has quit IRC13:46
*** psedlak_ has joined #openstack-qa13:54
*** psedlak has quit IRC13:55
*** Anju_ has joined #openstack-qa13:57
jaypipesafazekas: sorry man, I have been swamped in deployments :(14:05
jaypipesafazekas: will try to do some reviews this week. apologies.14:05
afazekasjaypipes: No problem, thank you14:10
mordredjaypipes: we miss you!14:12
jaypipesmordred: I miss free time!14:12
mordredjaypipes: hire more interns? ;)14:13
jaypipesmordred: lol. fire more internals.14:13
mordredjaypipes: ++14:13
Anju_afazekas:do u devstack environment this time?14:17
afazekasAnju_ : Now I am playing with another thing14:18
Anju_afazekas:ok thanku14:18
afazekasHL2 :)14:19
Anju_HL2?????14:19
afazekashttps://en.wikipedia.org/wiki/Half-Life_214:34
afazekasBTW: if you have install issues on an rpm system you can git revert the braking patch14:37
Anju_okk...afazekas:nice to hear that you r doing something else(other than openstack)14:46
Anju_:P14:46
mkoderergiulivo: ping15:01
giulivopong mkoderer ;15:02
giulivohere but "not very much"15:02
*** raies has joined #openstack-qa15:02
mkodererme either15:02
mkoderergiulivo: I think would be good to start the discussion in the mailing list before the meeting15:03
*** SergeyLukjanov has joined #openstack-qa15:03
giulivonp , it's a good idea15:03
giulivoif you prefer to send the message is okay with me15:03
openstackgerritA change was merged to openstack/tempest: add image tests v2  https://review.openstack.org/3921215:04
mkoderergiulivo: I am totally fine to have a discussion on the meeting15:04
mkodererbut maybe we can already start thinking before15:04
giulivoyeah that was my same intention with the "long" gerrit comment15:04
raiesjaypipes: please check for approval https://review.openstack.org/#/c/39023/15:05
*** SergeyLukjanov has quit IRC15:05
mkodererbut anyway .. I really like the code now ;)15:05
*** SergeyLukjanov has joined #openstack-qa15:05
mkodererI think we can find a good way to get it in15:06
*** SergeyLukjanov has quit IRC15:06
mkodererI just have a problem with a huge work flow without a real use case15:06
giulivomkoderer, that would be in case we merge all of them, right?15:07
mkodererfor me it looks like random actions15:07
giulivobtw, note that we have two sections one for stress tests and one for scenario tests15:07
giulivothis is supposed to be a stress test, not a scenario test15:07
mkodererright15:07
giulivowill you send something to the list?15:09
mkodererbut if you have a combined action that you have to call "sever_actions" just because you don't find a real topic for them15:09
mkoderergiulivo: yes I will do it tomorrow morning15:09
jaypipesraies: done.15:09
giulivomkoderer, also true, so let's see if anything pops up from the list15:10
giulivojaypipes, thanks for reviewing the scenario thing15:10
giulivoactually the response is yes and no15:10
jaypipesgiulivo: no probs. sorry I've been so busy :(15:10
giulivojaypipes, I thought it wasn't useful to check for the api return codes because I wanted to make sure the flow completes15:11
giulivoso didn't have much to "assert" except from actual failures/timeouts15:11
raiesjaypipes: thanks for your quick response15:11
giulivothe particular single actions are tested by the api tests already15:12
giulivoso with the scenario tests, what is that we can check apart from the successful completion of the steps?15:12
giulivomkoderer, ^^15:12
giulivomaybe we can open up the question to both scenario and stress tests15:12
jaypipesgiulivo: OK, no worries. Was just double-checking to see if that was intentional.15:13
jaypipesgiulivo: I will change to approve.15:13
giulivojaypipes, wait, no no15:13
jaypipesheh, ok :)15:13
giulivoI mean, I agree with your concerns15:13
giulivothere is something wrong in my whole approach to that test probabl15:13
giulivolike, I could ssh on the systems and check for the actual disk contents, not sure15:14
jaypipesgiulivo: well, after thinking about what kinds of assertions would make sense there, I don't see much other than perhaps doing a get on the instance info and checking statuses... but that's what wait_for_server_status() does already.15:14
jaypipesgiulivo: and you are not testing for correctness of the get instance return or anything, since that is already tested in many places15:14
mkoderergiulivo: at the end "stress tests" aren't a real test group. I mean every test whether api test or scenario test can be executed as a stress test15:15
jaypipesgiulivo: so I think it's probably best just to put a quick comment in there saying "hey, we aren't doing other assertions here, since we assert for the status in the wait loops and that is all this test is validating"15:15
giulivoyeah os please allow me for a few more time, if I can get anything better in I will otherwise I'll just comment on that15:15
jaypipesno probs.15:16
mkoderergiulivo: if you have a look here https://review.openstack.org/#/c/38980/15:16
jaypipesgiulivo: just ping me when you push a new change.15:16
*** jaypipes has left #openstack-qa15:16
*** jaypipes has joined #openstack-qa15:16
*** ChanServ sets mode: +o jaypipes15:16
jaypipesraies: need a rebase for https://review.openstack.org/3902315:17
raiesjapipes: ok i will do this15:18
giulivomkoderer, thanks for pointing to that15:18
raiesjaypipes: In patch2 "Zhi Kun Liu" and "Sean Dague" suggested not to use assertTrue() as it is not debugable.  Thats why I added an alernative way to do this.15:18
giulivomkoderer, how about we try to make the question broader so we try to find out what is a good approach for both stress and scenario patterns?15:18
raiesjaypipes: I see here that build is beig failed for https://review.openstack.org/#/c/39023/15:19
jaypipesraies: ok, understood.15:19
mkoderergiulivo: yes at the end it is a very general question15:20
jaypipesraies: it is saying you need to rebase: "This change was unable to be automatically merged with the current state of the repository and the following changes which were enqueued ahead of it: 39730, 40046. Please rebase your change and upload a new patchset."15:20
raiesjaypipes: ok thanks for your input15:20
mkodererI see that we have different viewpoints all over QA about stress test, api tests and scenario test15:21
jaypipesraies: are you familiar with how to rebase?15:23
*** adalbas has joined #openstack-qa15:23
raiesjaypipes: yes I am15:24
jaypipesraies: k, lemme know if you need any assistance. thx!15:24
raiesjaypipes: I will do rebase and will let you know soon :)15:24
jaypipescheers15:24
raiesjaypipes: to u to sir once again tanks for your kind support15:26
jaypipesany time.15:27
giulivoafazekas, so hl2 is one of my favourites by far and I enjoyed episode two _very_ much15:37
raiesjaypipes: merging of 39730, 40046 is under process (as jenkins is showng), So rebase  will not be possible now i think. Any alternative way to this ?15:38
jaypipesraies: well, you could premerge those, but that's  dangerous... I'd just wait until they hit trunk.15:39
afazekasgiulivo: I just got the Orange Box,  I started with HL2, Looks like I do not remember to many things, so it is half new again15:40
* afazekas hunt for food15:40
raiesjaypipes: I will wait till them finished and then will rebase it . can jenkins automatically merge my code after 39730, 40046 code merging or I have to it manually using rebase?15:41
* afazekas My be I should turn of my 2th monitor :)15:41
jaypipesraies: gerrit is alerting you that it was not able to rebase your branch onto the other ones, so you will need to manually rebase and fix merge conflicts.15:42
giulivoafazekas, so that game is great because you get into the story and won't stop when it is finished15:42
giulivolet me know when you finished with episode two what you think15:42
raiesjaypipes: ok thank you. I think better be to wait :)15:43
jaypipesraies: yes, will save you a headache ;)15:43
raiesjaypipes: yep !15:43
afazekasgiulivo: I try to rest before entering into the battle with the neutron issue :) , So probably next week (or 2), I will disable all other interrupt ..15:49
*** raies has quit IRC15:52
openstackgerritA change was merged to openstack-dev/devstack: Update to PLUMgrid plugin configuration  https://review.openstack.org/3918216:13
openstackgerritA change was merged to openstack/tempest: White space after # in tempest/api files  https://review.openstack.org/3973016:13
openstackgerritA change was merged to openstack/tempest: Negative attribute added in server negative test  https://review.openstack.org/4004616:13
*** tkammer has quit IRC16:20
openstackgerritanju Tiwari proposed a change to openstack/tempest: Negative tests added for network  https://review.openstack.org/4004916:31
Anju_afazekas :https://review.openstack.org/#/c/40049/ please have look16:36
*** mkollaro has quit IRC16:53
*** mkollaro has joined #openstack-qa16:55
*** mkollaro has quit IRC16:55
afazekasAnju_: LGTM, let's see the jenkins longs after it finished17:15
Anju_afazekas:thanks17:22
openstackgerritafazekas proposed a change to openstack/tempest: Handle the credentials as object  https://review.openstack.org/3864117:22
*** Anju_ has quit IRC17:30
*** raies has joined #openstack-qa17:32
*** raies has quit IRC17:37
*** Anju_ has joined #openstack-qa17:48
*** giulivo has quit IRC17:58
*** psedlak_ has quit IRC18:26
*** Anju_ has left #openstack-qa18:29
*** SergeyLukjanov has joined #openstack-qa19:13
*** SergeyLukjanov has quit IRC20:02
openstackgerritandrea-frittoli proposed a change to openstack/tempest: Whitebox server expects deleted > 0.  https://review.openstack.org/4012923:27

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!