13:00:32 <masayukig> #startmeeting qa
13:00:33 <openstack> Meeting started Tue Jul 28 13:00:32 2020 UTC and is due to finish in 60 minutes.  The chair is masayukig. Information about MeetBot at http://wiki.debian.org/MeetBot.
13:00:34 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
13:00:36 <openstack> The meeting name has been set to 'qa'
13:00:44 <masayukig> Hi, who all are here today?
13:00:52 <kopecmartin> hello o/
13:00:52 <paras333> hey masayukig :)
13:00:55 <gmann> o/
13:01:06 <lpiwowar> Hi:)
13:01:39 <masayukig> kopecmartin: paras333 gmann lpiwowar hi \o/
13:01:46 <openstackgerrit> Merged openstack/tempest master: Stop to use the __future__ module.  https://review.opendev.org/732960
13:02:11 <masayukig> OK, let's start
13:02:22 <masayukig> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting
13:02:33 <masayukig> ^^^^^ This is the agenda for today
13:02:44 <masayukig> #topic Announcement and Action Item (Optional)
13:02:58 <openstackgerrit> Ghanshyam Mann proposed openstack/tempest master: Add glance image import web-download tests  https://review.opendev.org/742295
13:03:50 <masayukig> The summit is going virtual https://www.openstack.org/summit/2020/ . We don't need to worry about the travel this time :)
13:04:04 <svyas> hey
13:04:05 <masayukig> I think there's no action item this time
13:04:10 <masayukig> svyas: hi
13:04:21 <masayukig> #topic Victoria Priority Items progress
13:04:36 <masayukig> #link https://etherpad.opendev.org/p/qa-victoria-priority
13:04:58 <lpiwowar> I fixed the patch to generate documentation for tests: https://review.opendev.org/#/c/735619/
13:05:51 <masayukig> lpiwowar++ cool. That sounds great. I'll check it
13:06:01 <gmann> reviewed most of the 'Description for testcases as docstrings' which are up from zhufl
13:06:13 <gmann> she updated i think, i will re-review.
13:06:15 <lpiwowar> masayukig: Thanks!:)
13:06:26 <masayukig> #link https://review.opendev.org/#/c/735619/
13:07:01 <masayukig> #link https://review.opendev.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/testcase-description
13:07:11 <masayukig> gmann: thanks!
13:07:24 <gmann> few updates from ussuri backlogs
13:07:28 <gmann> RBAC testing strategy
13:08:21 <gmann> i did the first review on system scope patches #link https://review.opendev.org/#/q/topic:admin-auth-system-scope+(status:open+OR+status:merged)
13:08:52 <gmann> and testing those with devstack and tempest support #link https://review.opendev.org/#/q/topic:system_scope_testing+(status:open+OR+status:merged)
13:09:19 <masayukig> gmann: Thanks, cool.
13:09:31 <gmann> but somehow devstack still fail on scope checks while creating the nova flavor. it need system scope token but somehow fail
13:09:44 <masayukig> I'll check them, too.
13:09:46 <masayukig> oh..
13:10:33 <gmann> I added system scope 'all' in devstack where it generate the token for nova flavor.  I have not debugged it thoroughly though
13:10:52 <gmann> other is Adding New glance tests to tempest
13:11:18 <gmann> import tests with glance-direct is merged, and web-download is opending
13:11:20 <gmann> pending
13:11:22 <gmann> #link https://review.opendev.org/#/c/742295/
13:12:00 <gmann> it passed in previous version, i updated it with trivial change. but this is ready to merge
13:12:48 <masayukig> gmann: great. I've copied & pasted the links to the etherpad
13:13:17 <gmann> thanks
13:13:30 <gmann> these are updates from my side
13:13:40 <masayukig> thanks.
13:13:47 <masayukig> any other updates?
13:14:18 <gmann> i think few of the scenario manager patches are ready to review ?
13:14:26 <gmann> but we have not reviewed them
13:14:36 <svyas> with scenario_manager, i find create_volume(), create_keypair() are stable across tempest plugins
13:15:10 <svyas> and they are stable with respect to name, method implementation
13:15:21 <kopecmartin> svyas: that's good news, thanks
13:15:26 <gmann> svyas: ok you mean used as it is what we have in tempest?
13:15:37 <svyas> gmann, exactly
13:15:38 <gmann> no modified version
13:15:40 <gmann> svyas: cool
13:16:05 <gmann> svyas: can you add doc string for those if not and then mark complete in etherpad
13:16:20 <masayukig> #link https://etherpad.opendev.org/p/tempest-scenario-manager
13:16:38 <svyas> gmann, sure.
13:16:50 <gmann> svyas: kopecmartin also we are using this BP in all scenario manager patches right ? #link https://blueprints.launchpad.net/tempest/+spec/tempest-scenario-manager-stable
13:17:01 <gmann> so that i can bookmark those and review in single set
13:17:07 <kopecmartin> gmann: yes
13:17:10 <svyas> gmann, yeah
13:17:11 <gmann> ok, thakns
13:17:14 <gmann> thanks
13:17:52 <gmann> #link https://review.opendev.org/#/q/topic:tempest-scenario-manager-stable+(status:open+OR+status:merged)
13:18:05 <gmann> so there is no open review for this right?
13:18:58 <svyas> still work is in progress
13:19:08 <gmann> ok, feel free to ping if anything ready.
13:19:08 <svyas> so, not fully ready for review
13:19:25 <kopecmartin> gmann: you have one '+' more than needed
13:19:28 <kopecmartin> #link https://review.opendev.org/#/q/topic:bp/tempest-scenario-manager-stable(status:open+OR+status:merged)
13:19:42 <svyas> gmann, https://review.opendev.org/#/c/724631/
13:19:50 <gmann> kopecmartin: thanks
13:19:53 <gmann> svyas: ack
13:20:18 <gmann> we need to get those merged soon along with test doc patches which will be easy to do. those did not get review attention i think
13:21:20 <masayukig> cool, thanks. I've added the link to the etherpads, too.
13:22:31 <masayukig> any other updates? maybe, how about Hacking and/or Bug triage?
13:22:52 <gmann> bug triage we can cover in bug section
13:23:01 <masayukig> gmann: ah, ok
13:23:02 <kopecmartin> we did with lpiwowar some bug triaging, the numbers here #link https://etherpad.opendev.org/p/qa-bug-triage-victoria
13:23:32 <masayukig> kopecmartin: thanks, let's revisit it later
13:23:44 <masayukig> If nothing else, let's move on
13:23:47 <kopecmartin> lpiwowar fixed the check_uuid script #link https://review.opendev.org/#/c/701352/ and improved its unit test coverage #link https://review.opendev.org/#/c/740723/
13:23:53 <kopecmartin> both ready for reviews
13:24:15 <masayukig> kopecmartin: lpiwowar cool
13:24:25 <gmann> kopecmartin: moved the test case desc and volume schema links from bug etherpad to priority etherpad
13:24:39 <lpiwowar> kopecmartin: masayukig thanks
13:25:03 <gmann> thanks lpiwowar , i will check those after meeting. thanks for working on that
13:25:48 <lpiwowar> gmann: ok, thank you!
13:27:12 <masayukig> ok, let's move on
13:27:15 <kopecmartin> btw test_reboot_server_hard doesn't work on arm64, see #link https://bugs.launchpad.net/tempest/+bug/1888224  we should probably skip the test on that architecture #link https://review.opendev.org/#/c/724239/
13:27:16 <openstack> Launchpad bug 1888224 in tempest "test_reboot_server_hard sometimes has kernel panic in Arm64" [Undecided,New]
13:27:32 <kopecmartin> that's all i have regarding bugs :)
13:28:23 <masayukig> kopecmartin: oops, thanks for heads up
13:28:23 <gmann> kopecmartin: hard reboot is hard to verify by API.
13:28:47 <gmann> tempest cannot verify if it is hard or soft reboot.
13:29:07 <gmann> this test was always in question to have in tempest
13:29:33 <gmann> but it should pass with soft reboot if hard reboot not possoble/not-done
13:30:40 <masayukig> gmann: yeah, but I think we should pass with no error at least
13:30:52 <gmann> yeah
13:31:15 <masayukig> ok, next topic
13:31:16 <masayukig> #topic OpenStack Events Updates and Planning
13:31:39 <masayukig> But I already mentioned about the next summit, though.
13:31:50 <masayukig> nothing else from my side
13:32:01 <masayukig> #topic Sub Teams highlights (Sub Teams means individual projects under QA program)
13:32:18 <masayukig> Do you have any updates/highlights on the sub-projects such as Tempest, Patrole and Hacking?
13:32:28 <masayukig> #link https://review.openstack.org/#/q/project:openstack/tempest+status:open
13:32:37 <masayukig> #link https://review.opendev.org/#/q/project:openstack/hacking+status:open
13:32:42 <masayukig> #link https://review.openstack.org/#/q/project:openstack/patrole+status:open
13:32:45 <gmann> Tempest
13:33:26 <gmann> we already discussed on glance testing things and system scope testing which we should get in before m-2 so that projects have the tests running on their gate
13:33:34 <gmann> gate is up for tempest
13:33:44 <gmann> devstack
13:34:25 <gmann> glance standalone things are stable now and dansmith working on fixing uwsgi on glance side and devstack to bring nack with uwsgi by default
13:34:40 <gmann> gate is up for devstack too
13:34:44 <gmann> patrole
13:34:47 <gmann> gate is broken
13:35:05 <gmann> #link https://review.opendev.org/#/c/743064/
13:36:02 <gmann> jobs failing on 'import mock' in tempest/tests/base.py  which was removed from tempest recently, i am not sure why patrole jobs not picking the master tempest where there is no 'import mock'
13:36:50 <gmann> if anyone can debug that, it will be good i will not be able to check that by late this week or next week
13:37:07 <gmann> hacking
13:38:04 <paras333> three new patches are up for review
13:38:08 <gmann> hacking 3.2.0 is released which has the working copy on Ubuntu Focal with moving flake8  to 3.8.0.
13:38:39 <gmann> paras333: thanks, we can release the new version with your checks-moving things
13:38:55 <masayukig> gmann: paras333 thank you so much
13:39:01 <gmann> may be with major version up as that can break many projects when they ugrade to new hacking
13:39:23 <gmann> that's all from me on subteam status
13:41:31 <gmann> masayukig: we can move next
13:41:37 <masayukig> ok
13:41:47 <masayukig> #topic Community goal tracking
13:41:59 <masayukig> #link https://etherpad.opendev.org/p/qa-community-wide-goals-tracking
13:42:20 <gmann> i have done the audit for all QA repo for zuulv3 goal and we are all good
13:42:29 <gmann> i have marked it complete
13:42:51 <gmann> for 2nd goal:
13:43:06 <gmann> i have proposed the testing patches for all the QA repos.
13:43:23 <gmann> few are fixed, few are failing which need debugging and fix accordingly
13:43:53 <masayukig> gmann: thanks for the patches, I'd like to check them
13:43:58 <gmann> #link https://review.opendev.org/#/c/740375/2
13:44:08 <gmann> this is ready to review ^^
13:44:16 * tosky confirms QA is clean from legacy Zuul jobs
13:44:57 <gmann> #link https://review.opendev.org/#/c/740372/3
13:45:00 <gmann> this is also ready ^^
13:45:38 <gmann> I will add Ready-to-review section in etherpad so that those can be reviewed on priority
13:46:13 <masayukig> https://review.opendev.org/#/c/740372/ is this already approved?
13:46:29 <gmann> ah yeah, it is merged too
13:46:46 <masayukig> ok, cool
13:47:01 <paras333> gmann:  can you have a quick look on this one #link https://review.opendev.org/#/c/737634/ as this is the one you have tested yourself as well.
13:47:18 <gmann> paras333: ohk, sure
13:47:25 <gmann> that's all on goal side
13:47:28 <paras333> gmann:  thank you!
13:47:29 <masayukig> thanks
13:47:32 <masayukig> #topic Bug Triage
13:47:40 <masayukig> #link https://etherpad.openstack.org/p/qa-bug-triage-victoria
13:48:30 <kopecmartin> i don't have anything else apart from what i've mentioned already
13:48:30 <masayukig> kopecmartin: any other updates?
13:48:40 <masayukig> kopecmartin: ok, thanks
13:48:49 <masayukig> #topic Critical Reviews
13:49:02 <masayukig> Any patches you'd like to discuss?
13:50:33 <kopecmartin> not from my side, just what was already mentioned
13:50:42 <masayukig> ok, thanks.
13:50:45 <gmann> yeah what we already discussed.
13:50:56 <masayukig> #topic Open Discussion
13:51:36 <masayukig> anything else you'd like to discuss?
13:52:02 <gmann> nothing from my side
13:52:32 <masayukig> Ok, if nothing, let's close the office hour.
13:52:48 <masayukig> thank you all!
13:52:49 <masayukig> #endmeeting