08:59:59 <gmann> #startmeeting qa
08:59:59 <openstack> Meeting started Thu Jan 14 08:59:59 2016 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.
09:00:00 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
09:00:02 <openstack> The meeting name has been set to 'qa'
09:00:14 <gmann> hi, who's here today?
09:00:30 <masayukig> \o/
09:00:31 <jlanoux> o/
09:00:38 <gmann> masayukig: jlanoux hi
09:00:53 <jlanoux> hi gmann!
09:01:25 <gmann> let's wait for sometime to join more people
09:02:40 <gmann> looks like only three of us :). let's start
09:02:40 <masayukig> gmann: sure
09:02:55 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Proposed_Agenda_for_January_14th_2016_.280900_UTC.29
09:02:58 <jlanoux> :) quick meeting then
09:02:59 <gmann> Today agenda ^^
09:03:12 <gmann> jlanoux: yea, happy to go home early :)
09:03:44 <gmann> #topic QA Code Sprint
09:04:02 <gmann> as mtreinish sent mail on this just putting here for reminder
09:04:17 <gmann> there are many people joining
09:04:19 <gmann> #link https://wiki.openstack.org/wiki/QA/CodeSprintMitakaBoston
09:04:53 <gmann> masayukig: nice to see your name there :)
09:05:29 <masayukig> gmann: yeah, sorry to be not your name there.. :(
09:06:02 <gmann> masayukig: not yet decided. I need to ask. I am afraid India travel conflict with this
09:06:28 <gmann> thats all on this. Let's move
09:06:34 <gmann> #topic Specs Reviews
09:06:40 <masayukig> gmann: OK, I'm looking forward to :)
09:06:46 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z
09:06:49 <gmann> masayukig: Thanks :)
09:07:20 <gmann> There are some spec close to merge
09:07:29 <gmann> one is andreaf one - https://review.openstack.org/#/c/92804/
09:07:52 <gmann> as andreaf is not here, let's skip. But more reviews are always good on that
09:08:26 <gmann> anything else on spec topic
09:09:06 <masayukig> it seems most of specs got -1 from someone.
09:09:31 <gmann> masayukig: yea. seems like all are in good review progress
09:09:45 <masayukig> gmann: agree
09:10:20 <gmann> let's move if nothing on this
09:10:21 <gmann> #topic Priority Items
09:10:32 <gmann> #link https://etherpad.openstack.org/p/mitaka-qa-priorities
09:10:51 <gmann> one is from me - Tempest Microversion support
09:11:02 <gmann> that was M1 which is already passed
09:11:07 <mkoderer> hi folks
09:11:14 <gmann> there are mainly 2 patches left
09:11:16 <gmann> mkoderer: hi
09:11:36 <gmann> #link https://review.openstack.org/#/q/topic:bp/api-microversions-testing-support+status:open
09:11:51 <gmann> after those, i will plan to migrate the framework in lib
09:12:09 <gmann> and then projects can continue with microversion testing
09:12:36 <gmann> reviews are most welcome on those.
09:12:42 <gmann> want to push those ASAP
09:13:29 <gmann> next is Service Client Migrations which is M2
09:14:14 <gmann> progress is here
09:14:17 <gmann> #link https://etherpad.openstack.org/p/mitaka-tempest-service-clients
09:14:46 <gmann> all compute one are done except keypair which is needed for microversion testing
09:15:00 <gmann> next main focus oomich_away is on neutron client
09:15:29 <masayukig> gmann: it's really great work!
09:15:29 <gmann> next one for M2  - Tempest Lib Migrations
09:15:46 <gmann> masayukig: yea. compute ones were huge
09:16:04 <gmann> jordanP not here
09:16:17 <gmann> jlanoux: do you have anything on ssh validation ?
09:16:59 <jlanoux> well - more work came to it since the summit so I'm not sure this will be completed soon
09:17:27 <jlanoux> it's better to have this feature consolidated before migrating
09:17:32 <gmann> jlanoux: what all we have pending on this, just for ref
09:17:48 <gmann> jlanoux: may be sshable thing and validation on scenario tests side?
09:18:17 <gmann> jlanoux: yea before migration we should have all in better place
09:18:25 <jlanoux> gmann: so I was thinking just to write the wrapper around compute and remote_client
09:18:41 <masayukig> jlanoux: the patch https://review.openstack.org/#/c/264323/ seems good direction to me.
09:18:50 <jlanoux> but Sean would like less complexity and more clarity in the ssh code
09:18:56 <jlanoux> masayukig: yes
09:19:13 <gmann> masayukig: ah thanks
09:19:14 <gmann> #link https://review.openstack.org/#/c/264323/
09:19:15 <jlanoux> so I think that before thr wrapper, some refactoring needs to happen
09:19:34 <gmann> I will check this tomorrow, was not aware of that
09:19:53 <jlanoux> I rebased this morning - got a +1 from Zuul yesterday
09:20:09 <gmann> jlanoux: currently we have in common->create_test_server r
09:20:14 <gmann> jlanoux: cool
09:20:26 <gmann> jlanoux: are we separating it from there
09:20:58 <jlanoux> gmann: perhaps yes, I need to have a discussion with Andrea and Sean to confirm
09:21:13 <gmann> jlanoux: i see. Thanks
09:21:33 <masayukig> one thing from me, about Tempest CLI progress: https://etherpad.openstack.org/p/tempest-cli-improvements
09:21:36 <gmann> it will be nice to put even more time on this. this is one of the imp validation for our tests
09:21:48 <jlanoux> gmann: +100
09:21:49 <gmann> jlanoux: Thanks for you hard work.
09:21:55 <gmann> masayukig: yea
09:21:56 <masayukig> about legacy commands, almost is done except account_generator.
09:21:57 <gmann> your turn
09:22:11 <gmann> masayukig: I will review that, i thin it is good now
09:22:16 <masayukig> gmann: thanks, sorry for interupting
09:22:17 <masayukig> But I'm not sure new CLIs.
09:22:25 <gmann> masayukig: np
09:22:38 <gmann> masayukig: ok
09:22:43 <masayukig> that's all from me.
09:22:58 <gmann> masayukig: Thanks
09:23:19 <gmann> jlanoux: masayukig also we have ssh as one of key topic for mid cycle and good to be discussed there
09:23:49 <jlanoux> gmann: yes, I cannot attend but Andrea will be there.
09:23:55 <masayukig> gmann: yeah, I suppose so
09:24:01 <gmann> jlanoux: ohk
09:24:07 <masayukig> I will
09:24:17 <gmann> next one i see for M2 is Finalize ssh-auth bp
09:24:25 <gmann> jlanoux: is this same?
09:24:30 <jlanoux> gmann: yep
09:24:43 <gmann> jlanoux: ok. Thanks
09:25:00 <gmann> anything else on priority items?
09:25:48 <gmann> ok, let's move on
09:25:53 <gmann> #topic Tempest
09:26:13 <gmann> from my side is microversion thing which we already discussed
09:26:32 <gmann> masayukig: jlanoux mkoderer anything from your side?
09:26:54 <jlanoux> gmann: not for me
09:26:58 <masayukig> mkoderer: DDT?
09:27:24 <gmann> masayukig: mkoderer spec is merged i think
09:27:56 <masayukig> gmann: yeah, but I think there's some discussion there.
09:28:35 <gmann> masayukig: ok
09:28:51 <masayukig> but it seems mkoderer here right now..
09:28:51 <jordanP> hi. sorry I am late...
09:28:53 <gmann> masayukig: other projects also use that but not sure
09:29:05 <gmann> jordanP: hi. np!
09:29:06 <masayukig> but it seems mkoderer isn't here right now..
09:29:13 <gmann> masayukig: yea
09:29:33 <gmann> jordanP: do you have anything on Tempest topic?
09:30:06 <jordanP> nope
09:30:16 <gmann> jordanP: ok
09:30:36 <gmann> there is bug today about tox 2.2.1 fails with recursion
09:30:53 <gmann> #link https://bugs.launchpad.net/tempest/+bug/1534006
09:30:55 <openstack> Launchpad bug 1534006 in tempest "tox == 2.2.1 failed with 'RuntimeError: maximum recursion depth exceeded while calling a Python object'" [Undecided,In progress] - Assigned to Ghanshyam Mann (ghanshyammann)
09:31:06 <gmann> it is fixed in 2.3.1 in case anyone face the issue
09:31:33 <jordanP> I don't think raising to 2.3.1 is a good idea. 2.3.1 is super recent
09:31:44 <gmann> I submitted a patch to raise min version in ini
09:31:47 <gmann> #link https://review.openstack.org/#/c/267382/
09:31:57 <gmann> jordanP: yea, but it is fixed in that version only
09:32:22 <masayukig> gmann: another solution is using older version, I think
09:32:33 <gmann> masayukig: older than 2.2.0
09:32:54 <jordanP> I am not sure that's the best way to handle that, I'd rather wait mtreinish or sdague opinion. they are experienced in that kind of topic
09:32:57 <masayukig> gmann: yeah. But I'm not sure it's good or bad for us.
09:33:32 <gmann> masayukig: jordanP ok, lets wait for other opinion.
09:33:49 <gmann> I also ok with same and update tox in local env if facing issue
09:33:55 <gmann> as gate is already taking 2.3.1
09:34:25 <mkoderer> sry folks I was distracted
09:35:09 <mkoderer> about DDt.. I need some more feedback for review https://review.openstack.org/#/c/223953/
09:35:28 <masayukig> #link https://review.openstack.org/#/c/223953/
09:35:30 <mkoderer> since sdague -1ed the idea of using ddt
09:36:05 <gmann> mkoderer: ok
09:36:21 <mkoderer> for me DDT is used by many projects (unit test) and I don't why this should be a barrier for new test developers
09:36:40 <gmann> mkoderer: i think same issue what sean mentioned we have for using testscenario also (appending something in test name)
09:37:12 <mkoderer> gmann: yeah, testscenario is much more complex IMHO
09:37:41 <masayukig> yeah, I don't want to think about testscenario x DDT
09:37:52 <mkoderer> so I am fine with not doing it.. but we than need to agree that we follow the concept of doing tempest "as simple as possible"
09:37:59 <gmann> mkoderer: yea, for for loop only ddt might be good
09:38:21 <masayukig> gmann: agree
09:38:27 <mkoderer> masayukig: sure... mixing both is overkill :)
09:38:54 * oomich_away sorry for late joining
09:38:54 <gmann> testscenario we have in Nova where we need test duplication at much higher level
09:39:04 <gmann> mkoderer: agree
09:39:11 <gmann> oomich_away: hi
09:39:34 <oomich_away> we already have a lot of issues on the gate even if current impl is simple
09:39:55 <mkoderer> oomich: that also a fair point
09:40:30 <mkoderer> ok so let us collect our thoughts in the review and I will create a ML thread if needed
09:40:33 <oomich> if we want to find more issues on the gate, ddt is nice option at the time
09:40:48 <jordanP> I'd rather have something simple, so although I like ddt in other projecrs, I am not sure it's best for tempest right now
09:41:21 <gmann> yea and we have idempotent_id if anything to be refer in code
09:41:45 <mkoderer> gmann: idempotent_id shouldn't be an issue
09:41:57 <mkoderer> we already discussed that within the spec review
09:42:07 <mkoderer> https://review.openstack.org/#/c/259934/
09:42:10 <gmann> mkoderer: yea, i mean we can refer with same ID for all generated test case
09:42:19 <mkoderer> gmann: yep ok
09:42:41 <gmann> anyways let's discuss and put our thoughts on review
09:42:48 <mkoderer> gmann: +1
09:43:23 <gmann> anything else on Tempest side?
09:44:00 <gmann> let's move on
09:44:06 <gmann> #topic DevStack + Grenade
09:44:24 <gmann> anything on these or we skip devstack and grenade
09:45:18 <gmann> let's move to next topic
09:45:24 <gmann> #topic Critical Reviews
09:45:40 <gmann> reviews from anyone
09:46:15 <gmann> I have for microversion
09:46:21 <gmann> #link https://review.openstack.org/#/c/265051/
09:46:34 <gmann> oomich: ^^ if you can look in this too :)
09:46:42 <gmann> oomich: this will be last one
09:47:12 <oomich> gmann: ok ;)
09:47:21 <gmann> oomich: Thanks
09:47:33 <oomich> bug before that, https://review.openstack.org/#/c/244996 is much critical
09:47:48 <oomich> that is the first microversion testing
09:47:57 <oomich> s/bug/but/
09:48:14 <gmann> oomich: yea, totally agree
09:48:24 <gmann> #link  https://review.openstack.org/#/c/244996
09:48:31 <oomich> I have 2 for service client thing:
09:48:31 <gmann> All please review that
09:48:36 <oomich> #link https://review.openstack.org/#/c/266685/
09:48:52 <oomich> #link https://review.openstack.org/#/c/263982/
09:49:20 <gmann> oomich: Thanks. I will check
09:49:22 <oomich> I am concentrating on service client migration for neutron now, and they are
09:49:39 <oomich> gmann: thank you also
09:49:56 <gmann> oomich: yea, those are one of most widely used
09:50:27 <gmann> jordanP: i will discuss with you on this after meeting -https://review.openstack.org/#/c/261149/
09:50:37 <gmann> jordanP: actually i did not get your comments
09:50:44 <gmann> any other reviews
09:51:09 <oomich> gmann: yeah, I am replacing them with tempest-lib's ones on neutron-lbaas side
09:51:24 <gmann> oomich: ohh, cool
09:51:25 <oomich> the repo contains a lot of copy&paste code from tempest
09:51:35 <gmann> oomich: yea they have very old code
09:51:40 <jordanP> gmann, sure
09:51:47 <gmann> oomich: might be huge work there for you :)
09:51:50 <oomich> gmann: right
09:52:04 <gmann> but not sure why they do not switch to plugin
09:52:34 <oomich> gmann: happy if other guys also will replace them
09:52:58 <gmann> oomich: will it be worth to fix the old copy paste code instead of moving to plugin ?
09:53:11 <oomich> gmann: guessing they need help from us for doing that
09:53:44 <gmann> oomich: ohk
09:53:45 <oomich> gmann: I prefer moving to plugin
09:53:58 <oomich> that is clean way
09:54:32 <gmann> oomich: yea, I am asking Mistral also to move to plugin as our colleague working on that
09:54:37 <gmann> and its is in nice progress now
09:54:52 <oomich> cool :)
09:55:06 <gmann> oomich: Thanks for helping them, it is nice
09:55:10 <gmann> let's move on
09:55:12 <gmann> #topic Open Discussion
09:55:26 <gmann> anything else to discuss. 5 min left
09:56:36 <dmellado> oops almost missed the meeting :\
09:56:41 <dmellado> thought it was on the afternoon today
09:56:42 <gmann> dmellado: hi
09:56:47 <gmann> dmellado: yea about to close
09:56:52 <tosky> a quick request: I understand (and agree) that the road is to move tests as plugins, especially for the projects outside the core 6
09:57:05 <tosky> but in the meantime, can you please look at this smal lchan
09:57:13 <tosky> small change* for sahara? https://review.openstack.org/#/c/255968/
09:57:19 <gmann> tosky: sure
09:57:31 <gmann> tosky: sahara already has plugin
09:58:13 <tosky> gmann: not completely
09:58:43 <tosky> gmann: I know because I moved them; the plugins are for python clients tests; the review above is for API tests
09:59:08 <gmann> tosky: oh. not for API tests. humm
09:59:15 <gmann> tosky: anyways. I will have look tomorrow.
09:59:23 <gmann> tosky: Thanks
09:59:33 <tosky> as I said, I agree that they need to be moved away :)
09:59:35 <tosky> thanks!
09:59:48 <gmann> tosky: yea that is final goal
10:00:04 <masayukig> it's the time
10:00:09 <gmann> let's close meeting. Timesup
10:00:11 <gmann> masayukig: yea
10:00:17 <gmann> Thanks everyone for joining
10:00:24 <oomich> thanks
10:00:24 <masayukig> thanks all o/
10:00:34 <dmellado> thanks!
10:00:37 <gmann> #endmeeting
10:00:44 <gmann> #endmeeting