08:59:59 <gmann> #startmeeting qa 08:59:59 <openstack> Meeting started Thu Jan 14 08:59:59 2016 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:00:00 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:00:02 <openstack> The meeting name has been set to 'qa' 09:00:14 <gmann> hi, who's here today? 09:00:30 <masayukig> \o/ 09:00:31 <jlanoux> o/ 09:00:38 <gmann> masayukig: jlanoux hi 09:00:53 <jlanoux> hi gmann! 09:01:25 <gmann> let's wait for sometime to join more people 09:02:40 <gmann> looks like only three of us :). let's start 09:02:40 <masayukig> gmann: sure 09:02:55 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Proposed_Agenda_for_January_14th_2016_.280900_UTC.29 09:02:58 <jlanoux> :) quick meeting then 09:02:59 <gmann> Today agenda ^^ 09:03:12 <gmann> jlanoux: yea, happy to go home early :) 09:03:44 <gmann> #topic QA Code Sprint 09:04:02 <gmann> as mtreinish sent mail on this just putting here for reminder 09:04:17 <gmann> there are many people joining 09:04:19 <gmann> #link https://wiki.openstack.org/wiki/QA/CodeSprintMitakaBoston 09:04:53 <gmann> masayukig: nice to see your name there :) 09:05:29 <masayukig> gmann: yeah, sorry to be not your name there.. :( 09:06:02 <gmann> masayukig: not yet decided. I need to ask. I am afraid India travel conflict with this 09:06:28 <gmann> thats all on this. Let's move 09:06:34 <gmann> #topic Specs Reviews 09:06:40 <masayukig> gmann: OK, I'm looking forward to :) 09:06:46 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z 09:06:49 <gmann> masayukig: Thanks :) 09:07:20 <gmann> There are some spec close to merge 09:07:29 <gmann> one is andreaf one - https://review.openstack.org/#/c/92804/ 09:07:52 <gmann> as andreaf is not here, let's skip. But more reviews are always good on that 09:08:26 <gmann> anything else on spec topic 09:09:06 <masayukig> it seems most of specs got -1 from someone. 09:09:31 <gmann> masayukig: yea. seems like all are in good review progress 09:09:45 <masayukig> gmann: agree 09:10:20 <gmann> let's move if nothing on this 09:10:21 <gmann> #topic Priority Items 09:10:32 <gmann> #link https://etherpad.openstack.org/p/mitaka-qa-priorities 09:10:51 <gmann> one is from me - Tempest Microversion support 09:11:02 <gmann> that was M1 which is already passed 09:11:07 <mkoderer> hi folks 09:11:14 <gmann> there are mainly 2 patches left 09:11:16 <gmann> mkoderer: hi 09:11:36 <gmann> #link https://review.openstack.org/#/q/topic:bp/api-microversions-testing-support+status:open 09:11:51 <gmann> after those, i will plan to migrate the framework in lib 09:12:09 <gmann> and then projects can continue with microversion testing 09:12:36 <gmann> reviews are most welcome on those. 09:12:42 <gmann> want to push those ASAP 09:13:29 <gmann> next is Service Client Migrations which is M2 09:14:14 <gmann> progress is here 09:14:17 <gmann> #link https://etherpad.openstack.org/p/mitaka-tempest-service-clients 09:14:46 <gmann> all compute one are done except keypair which is needed for microversion testing 09:15:00 <gmann> next main focus oomich_away is on neutron client 09:15:29 <masayukig> gmann: it's really great work! 09:15:29 <gmann> next one for M2 - Tempest Lib Migrations 09:15:46 <gmann> masayukig: yea. compute ones were huge 09:16:04 <gmann> jordanP not here 09:16:17 <gmann> jlanoux: do you have anything on ssh validation ? 09:16:59 <jlanoux> well - more work came to it since the summit so I'm not sure this will be completed soon 09:17:27 <jlanoux> it's better to have this feature consolidated before migrating 09:17:32 <gmann> jlanoux: what all we have pending on this, just for ref 09:17:48 <gmann> jlanoux: may be sshable thing and validation on scenario tests side? 09:18:17 <gmann> jlanoux: yea before migration we should have all in better place 09:18:25 <jlanoux> gmann: so I was thinking just to write the wrapper around compute and remote_client 09:18:41 <masayukig> jlanoux: the patch https://review.openstack.org/#/c/264323/ seems good direction to me. 09:18:50 <jlanoux> but Sean would like less complexity and more clarity in the ssh code 09:18:56 <jlanoux> masayukig: yes 09:19:13 <gmann> masayukig: ah thanks 09:19:14 <gmann> #link https://review.openstack.org/#/c/264323/ 09:19:15 <jlanoux> so I think that before thr wrapper, some refactoring needs to happen 09:19:34 <gmann> I will check this tomorrow, was not aware of that 09:19:53 <jlanoux> I rebased this morning - got a +1 from Zuul yesterday 09:20:09 <gmann> jlanoux: currently we have in common->create_test_server r 09:20:14 <gmann> jlanoux: cool 09:20:26 <gmann> jlanoux: are we separating it from there 09:20:58 <jlanoux> gmann: perhaps yes, I need to have a discussion with Andrea and Sean to confirm 09:21:13 <gmann> jlanoux: i see. Thanks 09:21:33 <masayukig> one thing from me, about Tempest CLI progress: https://etherpad.openstack.org/p/tempest-cli-improvements 09:21:36 <gmann> it will be nice to put even more time on this. this is one of the imp validation for our tests 09:21:48 <jlanoux> gmann: +100 09:21:49 <gmann> jlanoux: Thanks for you hard work. 09:21:55 <gmann> masayukig: yea 09:21:56 <masayukig> about legacy commands, almost is done except account_generator. 09:21:57 <gmann> your turn 09:22:11 <gmann> masayukig: I will review that, i thin it is good now 09:22:16 <masayukig> gmann: thanks, sorry for interupting 09:22:17 <masayukig> But I'm not sure new CLIs. 09:22:25 <gmann> masayukig: np 09:22:38 <gmann> masayukig: ok 09:22:43 <masayukig> that's all from me. 09:22:58 <gmann> masayukig: Thanks 09:23:19 <gmann> jlanoux: masayukig also we have ssh as one of key topic for mid cycle and good to be discussed there 09:23:49 <jlanoux> gmann: yes, I cannot attend but Andrea will be there. 09:23:55 <masayukig> gmann: yeah, I suppose so 09:24:01 <gmann> jlanoux: ohk 09:24:07 <masayukig> I will 09:24:17 <gmann> next one i see for M2 is Finalize ssh-auth bp 09:24:25 <gmann> jlanoux: is this same? 09:24:30 <jlanoux> gmann: yep 09:24:43 <gmann> jlanoux: ok. Thanks 09:25:00 <gmann> anything else on priority items? 09:25:48 <gmann> ok, let's move on 09:25:53 <gmann> #topic Tempest 09:26:13 <gmann> from my side is microversion thing which we already discussed 09:26:32 <gmann> masayukig: jlanoux mkoderer anything from your side? 09:26:54 <jlanoux> gmann: not for me 09:26:58 <masayukig> mkoderer: DDT? 09:27:24 <gmann> masayukig: mkoderer spec is merged i think 09:27:56 <masayukig> gmann: yeah, but I think there's some discussion there. 09:28:35 <gmann> masayukig: ok 09:28:51 <masayukig> but it seems mkoderer here right now.. 09:28:51 <jordanP> hi. sorry I am late... 09:28:53 <gmann> masayukig: other projects also use that but not sure 09:29:05 <gmann> jordanP: hi. np! 09:29:06 <masayukig> but it seems mkoderer isn't here right now.. 09:29:13 <gmann> masayukig: yea 09:29:33 <gmann> jordanP: do you have anything on Tempest topic? 09:30:06 <jordanP> nope 09:30:16 <gmann> jordanP: ok 09:30:36 <gmann> there is bug today about tox 2.2.1 fails with recursion 09:30:53 <gmann> #link https://bugs.launchpad.net/tempest/+bug/1534006 09:30:55 <openstack> Launchpad bug 1534006 in tempest "tox == 2.2.1 failed with 'RuntimeError: maximum recursion depth exceeded while calling a Python object'" [Undecided,In progress] - Assigned to Ghanshyam Mann (ghanshyammann) 09:31:06 <gmann> it is fixed in 2.3.1 in case anyone face the issue 09:31:33 <jordanP> I don't think raising to 2.3.1 is a good idea. 2.3.1 is super recent 09:31:44 <gmann> I submitted a patch to raise min version in ini 09:31:47 <gmann> #link https://review.openstack.org/#/c/267382/ 09:31:57 <gmann> jordanP: yea, but it is fixed in that version only 09:32:22 <masayukig> gmann: another solution is using older version, I think 09:32:33 <gmann> masayukig: older than 2.2.0 09:32:54 <jordanP> I am not sure that's the best way to handle that, I'd rather wait mtreinish or sdague opinion. they are experienced in that kind of topic 09:32:57 <masayukig> gmann: yeah. But I'm not sure it's good or bad for us. 09:33:32 <gmann> masayukig: jordanP ok, lets wait for other opinion. 09:33:49 <gmann> I also ok with same and update tox in local env if facing issue 09:33:55 <gmann> as gate is already taking 2.3.1 09:34:25 <mkoderer> sry folks I was distracted 09:35:09 <mkoderer> about DDt.. I need some more feedback for review https://review.openstack.org/#/c/223953/ 09:35:28 <masayukig> #link https://review.openstack.org/#/c/223953/ 09:35:30 <mkoderer> since sdague -1ed the idea of using ddt 09:36:05 <gmann> mkoderer: ok 09:36:21 <mkoderer> for me DDT is used by many projects (unit test) and I don't why this should be a barrier for new test developers 09:36:40 <gmann> mkoderer: i think same issue what sean mentioned we have for using testscenario also (appending something in test name) 09:37:12 <mkoderer> gmann: yeah, testscenario is much more complex IMHO 09:37:41 <masayukig> yeah, I don't want to think about testscenario x DDT 09:37:52 <mkoderer> so I am fine with not doing it.. but we than need to agree that we follow the concept of doing tempest "as simple as possible" 09:37:59 <gmann> mkoderer: yea, for for loop only ddt might be good 09:38:21 <masayukig> gmann: agree 09:38:27 <mkoderer> masayukig: sure... mixing both is overkill :) 09:38:54 * oomich_away sorry for late joining 09:38:54 <gmann> testscenario we have in Nova where we need test duplication at much higher level 09:39:04 <gmann> mkoderer: agree 09:39:11 <gmann> oomich_away: hi 09:39:34 <oomich_away> we already have a lot of issues on the gate even if current impl is simple 09:39:55 <mkoderer> oomich: that also a fair point 09:40:30 <mkoderer> ok so let us collect our thoughts in the review and I will create a ML thread if needed 09:40:33 <oomich> if we want to find more issues on the gate, ddt is nice option at the time 09:40:48 <jordanP> I'd rather have something simple, so although I like ddt in other projecrs, I am not sure it's best for tempest right now 09:41:21 <gmann> yea and we have idempotent_id if anything to be refer in code 09:41:45 <mkoderer> gmann: idempotent_id shouldn't be an issue 09:41:57 <mkoderer> we already discussed that within the spec review 09:42:07 <mkoderer> https://review.openstack.org/#/c/259934/ 09:42:10 <gmann> mkoderer: yea, i mean we can refer with same ID for all generated test case 09:42:19 <mkoderer> gmann: yep ok 09:42:41 <gmann> anyways let's discuss and put our thoughts on review 09:42:48 <mkoderer> gmann: +1 09:43:23 <gmann> anything else on Tempest side? 09:44:00 <gmann> let's move on 09:44:06 <gmann> #topic DevStack + Grenade 09:44:24 <gmann> anything on these or we skip devstack and grenade 09:45:18 <gmann> let's move to next topic 09:45:24 <gmann> #topic Critical Reviews 09:45:40 <gmann> reviews from anyone 09:46:15 <gmann> I have for microversion 09:46:21 <gmann> #link https://review.openstack.org/#/c/265051/ 09:46:34 <gmann> oomich: ^^ if you can look in this too :) 09:46:42 <gmann> oomich: this will be last one 09:47:12 <oomich> gmann: ok ;) 09:47:21 <gmann> oomich: Thanks 09:47:33 <oomich> bug before that, https://review.openstack.org/#/c/244996 is much critical 09:47:48 <oomich> that is the first microversion testing 09:47:57 <oomich> s/bug/but/ 09:48:14 <gmann> oomich: yea, totally agree 09:48:24 <gmann> #link https://review.openstack.org/#/c/244996 09:48:31 <oomich> I have 2 for service client thing: 09:48:31 <gmann> All please review that 09:48:36 <oomich> #link https://review.openstack.org/#/c/266685/ 09:48:52 <oomich> #link https://review.openstack.org/#/c/263982/ 09:49:20 <gmann> oomich: Thanks. I will check 09:49:22 <oomich> I am concentrating on service client migration for neutron now, and they are 09:49:39 <oomich> gmann: thank you also 09:49:56 <gmann> oomich: yea, those are one of most widely used 09:50:27 <gmann> jordanP: i will discuss with you on this after meeting -https://review.openstack.org/#/c/261149/ 09:50:37 <gmann> jordanP: actually i did not get your comments 09:50:44 <gmann> any other reviews 09:51:09 <oomich> gmann: yeah, I am replacing them with tempest-lib's ones on neutron-lbaas side 09:51:24 <gmann> oomich: ohh, cool 09:51:25 <oomich> the repo contains a lot of copy&paste code from tempest 09:51:35 <gmann> oomich: yea they have very old code 09:51:40 <jordanP> gmann, sure 09:51:47 <gmann> oomich: might be huge work there for you :) 09:51:50 <oomich> gmann: right 09:52:04 <gmann> but not sure why they do not switch to plugin 09:52:34 <oomich> gmann: happy if other guys also will replace them 09:52:58 <gmann> oomich: will it be worth to fix the old copy paste code instead of moving to plugin ? 09:53:11 <oomich> gmann: guessing they need help from us for doing that 09:53:44 <gmann> oomich: ohk 09:53:45 <oomich> gmann: I prefer moving to plugin 09:53:58 <oomich> that is clean way 09:54:32 <gmann> oomich: yea, I am asking Mistral also to move to plugin as our colleague working on that 09:54:37 <gmann> and its is in nice progress now 09:54:52 <oomich> cool :) 09:55:06 <gmann> oomich: Thanks for helping them, it is nice 09:55:10 <gmann> let's move on 09:55:12 <gmann> #topic Open Discussion 09:55:26 <gmann> anything else to discuss. 5 min left 09:56:36 <dmellado> oops almost missed the meeting :\ 09:56:41 <dmellado> thought it was on the afternoon today 09:56:42 <gmann> dmellado: hi 09:56:47 <gmann> dmellado: yea about to close 09:56:52 <tosky> a quick request: I understand (and agree) that the road is to move tests as plugins, especially for the projects outside the core 6 09:57:05 <tosky> but in the meantime, can you please look at this smal lchan 09:57:13 <tosky> small change* for sahara? https://review.openstack.org/#/c/255968/ 09:57:19 <gmann> tosky: sure 09:57:31 <gmann> tosky: sahara already has plugin 09:58:13 <tosky> gmann: not completely 09:58:43 <tosky> gmann: I know because I moved them; the plugins are for python clients tests; the review above is for API tests 09:59:08 <gmann> tosky: oh. not for API tests. humm 09:59:15 <gmann> tosky: anyways. I will have look tomorrow. 09:59:23 <gmann> tosky: Thanks 09:59:33 <tosky> as I said, I agree that they need to be moved away :) 09:59:35 <tosky> thanks! 09:59:48 <gmann> tosky: yea that is final goal 10:00:04 <masayukig> it's the time 10:00:09 <gmann> let's close meeting. Timesup 10:00:11 <gmann> masayukig: yea 10:00:17 <gmann> Thanks everyone for joining 10:00:24 <oomich> thanks 10:00:24 <masayukig> thanks all o/ 10:00:34 <dmellado> thanks! 10:00:37 <gmann> #endmeeting 10:00:44 <gmann> #endmeeting