09:01:46 <gmann> #startmeeting qa
09:01:46 <openstack> Meeting started Thu Jul 26 09:01:46 2018 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.
09:01:48 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
09:01:50 <openstack> The meeting name has been set to 'qa'
09:01:52 <mbindlish> hi
09:01:55 <gmann> PING LIST- gmann, andreaf, masayukig, chandankumar, felipemonteiro, frickler, mbindlish
09:02:00 <gmann> who all here today
09:02:05 <masayukig> o/
09:03:43 <gmann> let's start
09:03:51 <masayukig> k
09:03:56 <gmann> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours
09:04:05 <gmann> today agenda ^^
09:04:14 <gmann> #topic Announcement and Action Item (Optional)
09:04:43 <gmann> 1 announcement  -bashate is released
09:04:45 <gmann> #link https://review.openstack.org/#/c/583809/
09:05:02 <gmann> also added bashate as independent release model
09:05:46 <gmann> AI
09:05:56 <masayukig> cool
09:06:05 <gmann> there was 1 action item from last to last meeting
09:06:06 <gmann> #link http://eavesdrop.openstack.org/meetings/qa/2018/qa.2018-07-12-09.00.html
09:06:25 <gmann> 1. gmann to track each planned item and send ML for more volunteer etc
09:06:46 <gmann> i have not sent mail but got BP registered on LP and people can work on those
09:07:15 <gmann> 1 is about filling the schema in microversion which will be pretty easy and straight forward
09:07:26 <gmann> and other is CLI unit test which we will talk later
09:07:36 <gmann> so with that i am closing this action item
09:08:15 <masayukig> ++
09:08:28 <gmann> as this is end of cycle, we need to be more active on such item in starting of stein
09:08:59 <gmann> one more announcement
09:09:27 * masayukig should be active more at least :-p
09:09:43 <gmann> mbindlish: is going to work in QA and help us for tempest and other project work
09:09:50 <gmann> let's welcome mbindlish .
09:10:18 <masayukig> awesome!
09:10:23 <mbindlish> thanks :)
09:10:46 <gmann> that's all om announcement and AI
09:10:55 <gmann> #topic Rocky Priority Items progress
09:11:07 <gmann> #link https://etherpad.openstack.org/p/qa-rocky-priorities-tracking
09:11:28 <gmann> 1. Zuul v3 native jobs - andreaf
09:11:43 <gmann> no progress on this from couple of weeks.
09:11:52 <gmann> 2. Remove Deprecated APIs tests from Tempest. - gmann
09:12:13 <gmann> same on this too. this is not much left and i will complete this in next week as nova FF is done
09:12:35 <gmann> - Tempest Microversion testing fixes - gmann
09:13:18 <gmann> zhufl registered BP for this
09:13:20 <gmann> #link https://blueprints.launchpad.net/tempest/+spec/full-schema-for-all-microversions
09:13:32 <gmann> most of part was done but still need more trivial fixes
09:14:12 <gmann> my idea is to open this BP every cycle to track the schema filling work.
09:14:40 <gmann> and on this we can get more volunteer. and this cycle also i asked few of them
09:15:11 <gmann> other things like scenario manager refactoring etc not in good progress
09:15:15 <gmann> 4. Running patrole on gate- felipemonteiro
09:15:48 <gmann> there are good progress on doc part and i need to do more review there. at least to get multi policy things done in Rocly
09:16:09 <gmann> moving directly to 6
09:16:10 <gmann> 6. Tempest CLI unit tests improvement - mguiney, mbindlish
09:16:39 <gmann> i registered a BP for this work with all background information and example
09:16:41 <gmann> #link https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage
09:16:50 <gmann> mbindlish volunteered to work on this
09:17:09 <masayukig> nice!
09:17:11 <gmann> mbindlish: check the BP and ask if any query you have.
09:17:23 <mbindlish> ok @gmann
09:17:35 <gmann> we hope you to write lot of test case including positive and negative
09:17:47 <mbindlish> sure
09:18:12 <gmann> i have mentioned the example there like how we broke CLI previously which will be easy to understand what kind of testing we are lacking
09:19:33 <gmann> mbindlish: what is your launch [ad ID so that i can assign hat to you
09:19:53 <gmann> i found 2 manikbindlish and manikbindlish19
09:19:59 <gmann> which one is you
09:20:00 <mbindlish> let me check
09:20:23 <mbindlish> manikbindlish
09:21:22 <openstackrecheck> Console logs not available after 20:41s for tempest-full 576236,14,b9fe178
09:21:25 <gmann> ok i have assigned to you
09:22:41 <gmann> 8. Future of OpenStack-Health - masayukig
09:22:53 <gmann> masayukig: anything you want to update on this
09:24:16 <masayukig> I have nothing particular for now. There are some patches from Trevor, can you look at them if you have time :)
09:24:39 <gmann> difficult for me to review :)
09:25:06 <masayukig> heh
09:25:22 <gmann> let's move next
09:25:34 <gmann> #topic OpenStack Events Updates and Planning
09:25:46 <gmann> Etherpad: #link https://etherpad.openstack.org/p/qa-stein-ptg
09:26:20 <gmann> we have etherpad for stein PTG planning  ^^
09:27:21 <gmann> i added 1 more item about plugins service clients interface usage
09:27:24 <gmann> #link http://lists.openstack.org/pipermail/openstack-dev/2018-July/132419.html
09:27:30 <gmann> this mailing list ^^
09:27:52 <gmann> add topic ideas which are want to cover in PTG
09:28:07 <masayukig> thanks, I'll check and add some
09:28:29 <gmann> masayukig: thanks
09:28:59 <gmann> #topic Sub Teams highlights (Sub Teams means individual projects under QA program)
09:29:09 <gmann> Tempest
09:29:18 <gmann> #link https://review.openstack.org/#/q/project:openstack/tempest+status:open
09:30:36 <gmann> finally we merged the neutron skip tests needed for neutron filter validation feature
09:30:57 <gmann> other is ongoing review in tempest.
09:31:17 <gmann> let us know if anything urgent we need to get in for Rocky release
09:31:28 <gmann> Patrole
09:31:34 <gmann> this we already covered
09:31:54 <gmann> any other updates from any subteam
09:32:23 <masayukig> nope(?)
09:33:00 <gmann> ok let's move then
09:33:53 <gmann> #topic Bug Triage
09:34:57 <gmann> as you might know we have gate very unstable since couple of weeks
09:35:08 <gmann> one regular issue is test timeout
09:35:22 <gmann> matt opened a bug for this
09:35:27 <gmann> #link https://bugs.launchpad.net/tempest/+bug/1783405
09:35:27 <openstack> Launchpad bug 1783405 in tempest "Slow tests randomly timing out jobs (which aren't marked slow)" [High,Confirmed] - Assigned to Ghanshyam Mann (ghanshyammann)
09:35:34 <masayukig> yeah
09:35:44 <gmann> this is high priority bug more details on ML
09:35:46 <gmann> #link http://lists.openstack.org/pipermail/openstack-dev/2018-July/132447.html
09:36:26 <gmann> thee are many test which are slow and should be marked as slow so that they can be excluded from regular tempest-full job
09:37:06 <gmann> for audit and mark tests slow i have created a ethercalc to collect the time data
09:37:09 <gmann> #link https://ethercalc.openstack.org/dorupfz6s9qt
09:37:18 <gmann> masayukig: i saw you already voted there
09:37:22 <gmann> thanks for that
09:37:30 <masayukig> gmann: yeah, so, I feel over 100s is long enough
09:37:31 <masayukig> ?
09:38:02 <masayukig> or 120s or more?
09:38:03 <gmann> depends on tests and scenario.
09:38:08 <masayukig> k
09:38:08 <gmann> i though or 120
09:38:14 <gmann> thought
09:38:29 <gmann> but let's get more feedback and voting on that and then we can decide
09:38:58 <masayukig> ok, but should we mark 'slow' asap?
09:39:29 <gmann> as matt mentioned in ML, personality tests can be marked as slow as they takes time and API is deprecated in nova
09:39:33 <gmann> i agree on that
09:39:51 <gmann> masayukig: i think so but based on feedback,
09:40:18 <gmann> today is FF and if those tests create too much issues on gate for RC releases then we need
09:40:33 <gmann> otherwise i do not want to take decision in hurry
09:40:43 <masayukig> yeah, my concern is that it blocks the gate
09:41:18 <gmann> yeah, if it keep blocking gate then yes
09:41:45 <gmann> the avg time i took is for 14 days which might be less?
09:42:00 <openstackrecheck> Console logs not available after 20:37s for legacy-tempest-dsvm-neutron-src 585850,1,8e3114d
09:42:04 <gmann> or we should consider months or 3 months
09:42:26 <masayukig> I think 14 days is enough
09:43:02 <gmann> ok, while marking slow we can anyways check old data also for double check
09:43:10 <masayukig> I guess it might be slower than usual, though
09:43:43 <masayukig> And, the patch should be simple and easy. We can merge it soon.
09:43:52 <gmann> yeah
09:44:00 <gmann> next bug is critical
09:44:04 <gmann> #link https://bugs.launchpad.net/tempest/+bug/1739829
09:44:04 <openstack> Launchpad bug 1739829 in tempest "tempest-full job failing in stable/pike with 404 from keystone during tempest verify-config" [Critical,In progress] - Assigned to Andreas Jaeger (jaegerandi)
09:45:14 <BrinZhang> execuse me, sir, I would like to ask about the devstack@q-agt service. Has this error been solved? http://paste.openstack.org/show/726672/
09:46:29 <gmann> i am not sure if that if fixed
09:46:53 <gmann> by this https://review.openstack.org/#/c/531305/
09:47:14 <gmann> anyway i will double confirm that before closing it
09:47:56 <masayukig> gmann: yeah, The patch says partial-bug
09:48:17 <gmann> masayukig: ok, need to check what left on pike porting
09:49:06 <masayukig> yeah
09:49:12 <gmann> BrinZhang: there are no error on gate are you getting this on master ?
09:49:24 <BrinZhang> yes
09:49:57 <BrinZhang> gmann: this on devstack
09:50:49 <gmann> with ovs agent right
09:51:22 <gmann> I am not aware of that, may be frickler can help ^^
09:52:26 <gmann> on bug triage there are many bugs in New state.
09:53:01 <masayukig> :(
09:53:02 <gmann> we will keep triaging those and mainly keep eyes on gate as Rocky release time
09:53:25 <masayukig> yeah..
09:53:25 <gmann> moving to open discussion
09:53:28 <gmann> #topic Open Discussion
09:53:44 <gmann> anything else to discuss ?
09:53:54 <viks_> hi, i have couple of questions...
09:54:24 <viks_> I get the following error inconsistently when i run the tempest for some tests:
09:54:30 <viks_> `testtools.matchers._impl.MismatchError: ['tmpbAE3za'] matches Contains('tmpbAE3za')`
09:54:45 <viks_> why this happens and how do i resolve it?
09:55:21 <gmann> viks_: do you have full traceback
09:57:12 <viks_> let me check quickly...
09:57:44 <gmann> and also what test is this
09:57:58 <gmann> anyways we can discuss that after office hour also
09:58:13 <gmann> anything else ? any critical review
09:58:36 <viks_> ok
09:59:32 <gmann> let's close it then
09:59:42 <gmann> thanks everyone fro joining
09:59:46 <masayukig> gmann: thanks!
09:59:48 <gmann> #endmeeting