08:59:58 <gmann> #startmeeting qa
08:59:59 <openstack> Meeting started Thu Jun 30 08:59:58 2016 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.
09:00:01 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
09:00:03 <openstack> The meeting name has been set to 'qa'
09:00:09 <gmann> hi who's here for today?
09:00:25 <masayukig> o/
09:00:28 <itzkb_> hi
09:00:39 <dmellado> \o
09:00:51 <gmann> masayukig: dmellado itzkb_ hi
09:01:09 <gcheresh> hi
09:01:14 <dmellado> hi everyone
09:01:18 <masayukig> gmann : hi, thank you for hosting today :)
09:01:29 <gmann> np
09:01:36 <gmann> let's start
09:01:49 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_June_30th_2016_.280900_UTC.29
09:02:01 <gmann> ^^ today agenda
09:02:35 <gmann> #topic Specs Reviews
09:03:06 <gmann> sorry let's first go through the Newton priority
09:03:16 <gmann> #topic Newton Priorities
09:03:24 <masayukig> sure
09:03:25 <gmann> #link https://etherpad.openstack.org/p/newton-qa-newton-priorities
09:03:40 <dmellado> no prob gmann
09:04:00 <gmann> first one Cleanup - andreaf
09:04:27 <andreaf> o/
09:04:34 <gmann> andreaf: any new update on this
09:04:39 <gmann> andreaf: nice timing
09:04:43 <dmellado> hi andreaf
09:05:37 <andreaf> gmann: not much on that yet
09:05:44 <gmann> andreaf: ok
09:06:20 <gmann> andreaf: i think mostly like client variable renaming etc after client refactor BP right
09:06:33 <andreaf> gmann: right
09:06:36 <gmann> k
09:06:49 <gmann> next openstack-health
09:06:53 <gmann> masayukig: your turn
09:07:37 <masayukig> sure, but there's not so much progress this time, actually..
09:08:26 <masayukig> one thing is
09:09:01 <masayukig> added "likely bugs" link to launchpad on the top page
09:09:49 <gmann> masayukig: where exactly ?
09:10:30 <masayukig> on http://status.openstack.org/openstack-health/#/ "Failed Tests in Last 10 Failed Runs" - "Likely Bugs" column
09:11:06 <masayukig> I think there's only '-' because no e-r bugs right now.
09:11:27 <gmann> masayukig: nice
09:11:45 <masayukig> that's all from me, so far.
09:11:59 <gmann> masayukig: ok
09:12:03 <gmann> thanks
09:12:22 <gmann> next is  Remaining CLI work
09:12:57 <gmann> mtreinish: has patches up for review
09:13:00 <gmann> #link https://review.openstack.org/#/q/project:openstack/tempest+branch:master+topic:bp/tempest-run-cmd
09:13:37 <gmann> i think nice progress on that
09:13:40 <gmann> next Negative Test (chrishoge, oomichi)
09:13:56 <gmann> saw this patch for that - https://review.openstack.org/#/c/333618/
09:13:56 <patchbot> gmann: patch 333618 - tempest - Add guidance on negative tests in HACKING.rst (MERGED)
09:14:11 * gmann wow patchbot
09:14:29 * masayukig also surprised :)
09:14:41 <gmann> in this i did not find much details about what is criteria of negative tests addition
09:15:12 <gmann> i think we discussed in Austin that, we need clear guidelines for those
09:15:32 <dmellado> gmann: +1
09:15:36 <gmann> hope to see more patches from oomichi or Chris on that
09:15:44 <dmellado> it's not really clear what would be the option to Tempest on that...
09:15:49 <masayukig> gmann : +1
09:15:53 <gmann> dmellado: yea
09:16:48 <gmann> and that would not be easy to define the criteria but we should have something
09:17:30 <masayukig> gmann : agree
09:17:35 <gmann> Next item is - tempest-lib/plugin (gmann)
09:17:45 <gmann> this one is more generic for lib interfaces
09:17:53 <gmann> for service clients-
09:18:05 <gmann> image and identity v2 are moved in lib
09:18:19 <gmann> oomichi: might release the version soon
09:18:52 <gmann> on identity v2 client, some of them we kept in tempest path also not to break neutron etc
09:19:27 <gmann> on release of those as lib interface we can remove those after fixing project using old path
09:20:20 <gmann> Next is Client Manager Refactor
09:20:26 <gmann> andreaf: your turn
09:20:38 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/client-manager-refactor
09:20:55 <gmann> i think you updated those
09:22:12 <andreaf> gmann: yes
09:22:29 <itzkb_> gmann: Where can I find some explanation about this topic?
09:22:31 <andreaf> gmann: the first patch merged - this one is ready https://review.openstack.org/#/c/326667/28
09:22:31 <patchbot> andreaf: patch 326667 - tempest - Factor up (most) CONF value in clients.Manager
09:22:44 <gmann> andreaf: cool
09:23:02 <gmann> itzkb_: you mean Newton priority or client refactor?
09:23:11 <andreaf> gmann: I need still some work on the 2nd patch but I would like to get feedback on the general direction of the patches
09:23:17 <andreaf> gmann: so reviews are welcome
09:23:20 <itzkb_> gmann: client refactor
09:23:23 <gmann> great
09:24:02 <gmann> itzkb_: spec link - https://specs.openstack.org/openstack/qa-specs/specs/tempest/client-manager-refactor.html
09:24:10 <gmann> itzkb_: and on going patches
09:24:20 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/client-manager-refactor
09:24:25 <itzkb_> gmann: thanks
09:24:31 <andreaf> itzkb_: what I'm working on is the client manager refactor, not the client refactor - I'm preparing a client manager that can be exposed as a stable interface to be used by plugins
09:24:31 <gmann> itzkb_: and ping andreaf for more info :)
09:25:05 <dmellado> itzkb_: I told you about this, remember xD
09:25:07 <gmann> andreaf: i will review those tomorrow
09:25:22 <itzkb_> dmellado: yeah ,Just need to figure this out
09:25:32 <gmann> and let's review and get those in or provide feedback
09:25:33 <andreaf> itzkb_: atm most plugins use either manager.Manager or clients.Manager - but they are not stable interfaces
09:26:14 <dmellado> andreaf: any plan to stabilize also the dynamic cred provider?
09:26:22 <dmellado> manila guys were complaining about that
09:26:37 <dmellado> that's why they 'pin' a tempest commit, which is quite annoying
09:26:45 <gmann> dmellado: complaining on interface change?
09:26:59 <dmellado> complaining on tempest not providing stable enough interfaces
09:27:00 <andreaf> dmellado: yes I've been working on that as well - but the dynamic creds provider uses clients which are not stable yet (identity) and the client manager
09:27:21 <dmellado> andreaf: I see, thanks for the update!
09:27:43 <andreaf> dmellado: but I already did a lot of cleanup work in that area already in mitaka times
09:28:12 <dmellado> andreaf: in any case I guess that'd be solve by having the tempest plugin on its own repo too
09:28:20 <dmellado> but anyway, same war as always xD
09:29:31 <gmann> dmellado: yea, it will take time to get all required interfaces as stable
09:29:58 <gmann> let's move on
09:30:01 <gmann> #topic Specs Reviews
09:30:09 <gmann> #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z
09:30:22 <gmann> i saw a new one - https://review.openstack.org/#/c/314704/2/specs/other/policy-testing-on-apis.rst
09:30:22 <patchbot> gmann: patch 314704 - qa-specs - Policy testing APIs
09:30:38 <gmann> seems like new project for policy things
09:31:00 <gmann> mtreinish reviewed that seems.
09:31:18 <gmann> i have not looked into the detail yet
09:32:17 <gmann> seems like testing tempest for all user roles and consider 403 as pass
09:32:49 <masayukig> seems interesting, I'll have a look
09:33:24 <gmann> yea but thats like testing running tempest for all possible combination of policy.json
09:34:01 <gmann> but we cover all tests runs under different type of role like admin owner etc
09:34:32 <masayukig> ok
09:36:02 <gmann> but that can be benefit to capture if any API interacting with multiple service/backend and those have not been honoring the policy.json and have hard coded rule etc
09:36:08 <gmann> just a thought
09:36:14 <gmann> but let's review that
09:36:45 <gmann> anything on spec from anyone
09:37:34 <gmann> ok. let's jump to next
09:37:41 <gmann> #topic Tempest
09:38:36 <gmann> anything new from anyone?
09:39:04 <gmann> i do not have any new to discuss on this
09:39:27 <masayukig> same here
09:39:59 <gmann> one was mtreinish removed the trove tests from tempest
09:40:16 <gmann> and we left with Sahara, Heat and ironic now
09:40:20 <gmann> good move
09:40:41 <masayukig> yeah, is there a list for it?
09:40:49 <tosky> sahara are in fact already moved, and now also on the CI too
09:40:56 <dmellado> oh, hi tosky
09:41:04 <dmellado> I was about to mention that ;)
09:41:07 <masayukig> cool
09:41:23 <gmann> tosky: cool
09:41:35 <gmann> Thanks :)
09:42:21 <andreaf> tosky: so tests can be removed from tempest now?
09:42:42 <gmann> tosky: these one- https://github.com/openstack/tempest/tree/master/tempest/api/data_processing
09:42:54 <tosky> yes, they can; I can put up a review if you want
09:43:33 <tosky> yes, those (see sahara-tests, under sahara_tenpest_plugin)
09:43:34 <gmann> tosky: yea sure, will be nice to review
09:43:44 <andreaf> tosky: that would be nice - we need to remove all references to sahara as well, you can look at the trove removal patch for reference
09:43:57 <tosky> sure
09:44:17 <gmann> tosky: https://review.openstack.org/#/c/302473/
09:44:17 <tosky> but also the client?
09:44:17 <patchbot> gmann: patch 302473 - tempest - Remove trove tests from tempest (MERGED)
09:44:24 <gmann> tosky: yes
09:44:38 <tosky> uh, that one was not.moved
09:44:38 <masayukig> please read http://docs.openstack.org/developer/tempest/test-removal.html when you remove tests :)
09:44:46 <andreaf> #link: trove removal patch: https://review.openstack.org/#/c/302473/
09:44:46 <patchbot> andreaf: patch 302473 - tempest - Remove trove tests from tempest (MERGED)
09:45:15 <gmann> tosky: you mean service clients are not moved?
09:45:25 <tosky> yes
09:45:51 <gmann> tosky: so Sahara plugin use the service clients from tempest.
09:46:45 <tosky> exactly - I wa waiting for.client stabilization
09:48:10 <tosky> what shoul I do then? Keep using the one in tempest for noe?
09:48:11 <gmann> tosky: i feel you can move and later use client manager for registration as andreaf doing that
09:48:56 <gmann> tosky: and till then use the manager class as other plugin doing as of now
09:49:03 <andreaf> tosky, gmann: yes that would be nice - I can help out with using the new interface once it's ready
09:49:20 <gmann> andreaf: great.
09:49:38 <gmann> tosky: shot a patch, we can help if anything missing
09:49:57 <tosky> ok, let's talk post-meeting
09:50:03 <tosky> thanks
09:50:07 <gmann> tosky: cool, Thanks
09:50:17 <gmann> I think we already discussed openstack-health
09:50:21 <gmann> #topic Critical Reviews
09:50:34 <gmann> any key reviews to be done on priority?
09:52:05 <gmann> ok 8 min left
09:52:11 <gmann> let's move to open
09:52:13 <gmann> #topic open
09:52:29 <gmann> anything else to discuss than in agenda
09:52:51 <masayukig> so, https://wiki.openstack.org/wiki/Sprints/QAInfraNewtonSprint
09:53:12 <dmellado> gmann: yep, from my side I've been trying to get some help on the class squash
09:53:15 <dmellado> without that many success
09:53:30 <gmann> dmellado: ohk, no prob
09:53:31 <dmellado> I'll be going to the cycle and will try to get that done there
09:53:38 <gmann> dmellado: cool
09:53:39 <dmellado> mid-cycle
09:53:42 <masayukig> I think we should put topics on the page.
09:53:48 <masayukig> if we have
09:54:05 <gmann> masayukig: ah nice catch :)
09:54:15 <gmann> AI for oomichi
09:54:28 <gmann> #action oomichi to add topic for mid-cycle
09:54:32 <dmellado> also times
09:54:34 <dmellado> ;)
09:54:49 <gmann> but all are welcome to add their topic which you are going to work on those
09:54:57 <gmann> dmellado: :)
09:55:08 <dmellado> ;)
09:55:58 <gmann> anything else or close the meeting
09:56:20 <dmellado> fine for me
09:56:23 <dmellado> thanks everyone!
09:56:27 <masayukig> thanks!
09:56:28 <gmann> Thanks all for joining.
09:56:38 <gmann> #endmeeting