09:00:40 #startmeeting qa 09:00:41 Meeting started Thu Dec 13 09:00:40 2018 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:00:42 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:00:44 The meeting name has been set to 'qa' 09:00:47 who all here today ? 09:01:09 hi 09:05:13 mbindlish: hi 09:05:15 let's start 09:05:23 #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours 09:05:31 ^^ updated the agenda 09:05:45 #topic Announcement and Action Item (Optional) 09:06:38 announcement is about moving the devstack/tempest base jobs to Bionic. patches are merged and till now it is running smoothly 09:06:58 at least we have not heard any issue due to bionic 09:07:09 #topic Stein Priority Items progress 09:07:10 +1 09:07:20 #link https://etherpad.openstack.org/p/qa-stein-priority 09:07:41 1. Planning for Patrole Stable release - felipemonteiro, gmann 09:08:04 i need to check the items pending for that and check with felipe on those. 09:08:17 2. Zuul v3 native jobs - tosky 09:09:37 devstack patch is merged for this. last i talk to tosky, he will continue on this once he finish his priority sahara work. 09:10:20 i am jumping to 6 directly as i did not see any updates on others 09:10:21 6. Tempest CLI unit tests improvement - mguiney, mbindlish 09:10:31 mbindlish: what is status and what all pending on this ? 09:11:01 currently working on account generator, already finished for tempest workspace and tempest run 09:11:27 did we finish all the scenario for tempest workspace and run ? 09:12:02 let me check for tempest run..90% are completed...but completed for workspace 09:12:08 Yang Youseok proposed openstack/os-testr master: Add --failing option to run only failed testcases https://review.openstack.org/624893 09:12:13 all the scenario i mean all possible combination of all possible param of those CLI in term of positive and negative behaviour 09:13:01 I think i have done. but will check again all items, if found anything miss, will add them 09:13:11 ok, thanks 09:14:23 mbindlish: also, are you topicing all your CLI test changes to this BP - https://review.openstack.org/#/q/topic:bp/tempest-cli-unit-test-coverage+(status:open+OR+status:merged) 09:14:32 i am seeing only 3 patch ^^ 09:15:16 @gmann https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage 09:15:36 Anything else need to add somewhere 09:15:46 In this link, mentioned all the pushed patches 09:16:05 ok 09:16:26 7. Proper handling of interface/volume/pci devece attach/detach hotplug/unplug in tempest - afazekas 09:16:33 i think this is done. afazekas ? 09:16:54 11 Migration from Launchpad to storyboard - gmann 09:17:08 i have added the story for required itesm 09:17:38 - Response Scema validation for other component like cinder -zhufl 09:17:55 she has good progress on this but we are holding that till we hear form interop team 09:18:12 i will ping interop team to respond on this after mark reply 09:18:33 that's all from stein tracking 09:18:40 #topic OpenStack Events Updates and Planning 09:19:07 next will be Denver summit and PTG in April end 2019. so we have time so skipping that as of now 09:19:19 #topic Sub Teams highlights (Sub Teams means individual projects under QA program) 09:19:30 Tempest 09:19:53 #link https://review.openstack.org/#/q/project:openstack/tempest+status:open 09:20:01 open reviews 09:20:05 patrole 09:20:16 mbindlish: anything you following in patrole ? 09:20:36 not yet in patrole 09:20:52 ok, did you start the patrole coverage for neutron ? 09:21:08 currently focusing in tempest cli 09:21:13 k 09:21:13 have to start for patrole 09:21:49 #topic Bug Triage 09:22:01 mbindlish: your turn 09:22:04 https://etherpad.openstack.org/p/QA-Stein-Bug-Triage 09:22:31 First 4 we already discussed 09:23:00 5th was also discussed but you have to add some concluded comment on that 09:23:15 mbindlish: progress on L9 is of this week ? 09:24:13 new bugs reduced to 32 from 34 09:24:44 and is it whole QA or just tempest ? 09:24:55 this is tempest 09:25:08 I have to add for complete QA, I forgot 09:25:24 will add in next week's report for complete QA 09:26:19 i need to find out what all sub project you can add but at least tempest, devstack, grenade, patrole etc 09:27:00 mbindlish: go ahead 09:27:05 sure, i will add these 09:27:36 https://bugs.launchpad.net/tempest/+bug/1708550 09:27:37 Launchpad bug 1708550 in tempest "Some network tests do not use preprovisioned networks" [Undecided,New] 09:27:47 you need to add concluded comment on this 09:27:54 from last week discussion 09:28:35 ok. 09:29:01 next is: 09:29:02 https://bugs.launchpad.net/tempest/+bug/1710845 09:29:03 Launchpad bug 1710845 in tempest "Sometimes tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops fail via port in state Down" [Undecided,New] - Assigned to Sofiia Andriichenko (sandriichenko) 09:29:48 seems no progress on this 09:30:01 assigned to Sofiia 09:30:55 mbindlish: what is on this? i saw many patches and comement on this 09:31:08 mbindlish: is it confirmed ? 09:32:22 When I tried, no problem was occured 09:32:38 but seems some times this issue occur due to time 09:32:38 you are saying it is not reproducible ? 09:33:00 may be not always, sometimes it can occur 09:33:38 means it is reproducible. then did you find what is issue on this ? 09:33:38 so need to try its run multiple times 09:33:41 any investigation 09:34:32 because asking author might not get much response. i feel triage more like doing complete investigation from our side and if anything needed then, mark it as incomplete 09:34:55 let me try it more 2-3 times 09:35:17 will confirm the neccasry action for confirm or incomplete 09:35:25 also check from those patches - what there were fixing, what comments from reviewer, why they got abandon 09:36:18 fine 09:36:25 let's move next to bug 09:37:00 https://bugs.launchpad.net/tempest/+bug/1726462 09:37:01 Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] 09:38:18 no assignee of this 09:38:34 but is it triaged ? which side issue is ? 09:38:38 harbott confirm, this issue is hitting 09:39:03 yeah, i see cinder, neutron and tempest. 09:40:10 currently not investigated by me, which side it belongs too 09:40:46 k, let's check what is issue, is it service side or test side 09:40:56 but as per harbott..it is related to neutron 09:41:13 ok, slaweq can check ^^ 09:41:43 description says it is vol availability but i have not checked the details 09:41:55 gmann: hi, what I should check? 09:42:22 slaweq: this one https://bugs.launchpad.net/tempest/+bug/1726462 09:42:23 Launchpad bug 1726462 in neutron "Various gate jobs time out waiting for vol available" [Undecided,Confirmed] 09:43:10 it is marked confirmed on neutron. 09:43:45 yes, I saw it from time to time in neutron jobs 09:43:55 same doubt as frickler mentioned, why neutron is confrmed on this 09:43:57 but I don't have any specific examples now 09:44:08 I don't know TBH :) 09:44:10 i think cinder bug 09:44:31 slaweq: ok. can you mark neutron triage accordingly. because it is confusing otherwise :) 09:44:33 yes, for me it's clearly cinder issue 09:44:38 yeah me too 09:44:44 done 09:44:49 slaweq: thanks. 09:45:01 Brin Zhang proposed openstack/tempest master: Add unittest for types_client https://review.openstack.org/622955 09:45:12 moving to next 09:45:15 https://bugs.launchpad.net/tempest/+bug/1728886 09:45:16 Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] 09:45:22 slaweq: you marked Triaged ? or invalid 09:45:32 triaged as You said 09:46:19 triaged i means mark to real state, invalid, incomplete, confirmed etc 09:46:26 ahh, ok 09:46:28 sorry 09:46:33 not as Triaged state :) it is confusign 09:47:08 ok, set to invalid 09:47:22 slaweq: thanks again 09:47:27 yw 09:47:29 mbindlish: next one 09:47:39 https://bugs.launchpad.net/tempest/+bug/1728886 09:47:40 Launchpad bug 1728886 in tempest "test_port_security_macspoofing_port doesn't work when l2pop and arpresponding are enabled" [Undecided,New] 09:48:49 slaweq: again for you to get more input ^^, but not now when ever you have time 09:50:26 next 09:50:34 moving to next 09:50:35 https://bugs.launchpad.net/tempest/+bug/1733498 09:50:37 Launchpad bug 1733498 in tempest "image.v1.test_image_members failed for “The success code is different than the expected one“" [Undecided,New] - Assigned to Ghanshyam Mann (ghanshyammann) 09:51:13 yeah this one i think i remember, I need to add the v1 tests on separate job 09:51:20 i will check the state of that patch 09:52:12 ok 09:52:12 i think few tests were failing for v1 but i did not check the state later 09:53:19 next: https://bugs.launchpad.net/tempest/+bug/1741373 09:53:20 Launchpad bug 1741373 in tempest "create network resource crashes with dynmaic creds" [Undecided,New] 09:54:24 there is no update on this from long time 09:54:50 mbindlish: same thing, is this happening on gate or were you able reproduce locally ? 09:55:51 I personaly not tried to reproduce this issue, i will check this in this week 09:56:00 k 09:56:35 next: https://bugs.launchpad.net/tempest/+bug/1756262 09:56:36 Launchpad bug 1756262 in tempest "auth_method is not getting set during tempest run using stestr" [Undecided,New] 09:56:51 I treid to reproduce it, but not reproducible 10:00:04 yeah, we take auth_method in considration and only keypair is supported as of now 10:00:08 i will also comment on that 10:00:13 time is up seem 10:00:23 yeah 10:00:38 mbindlish: thanks, let's work on bug things as we discussed today 10:00:43 #topic Critical Reviews 10:00:45 sure 10:00:48 any critical review ? 10:01:04 not from my side 10:01:07 #topic Open Discussion 10:01:21 one bug is listed there- 10:01:29 This bug https://bugs.launchpad.net/tempest/+bug/1783369 is not seen with Swift but affects testing Ceph RGW; anybody willing to look into it? [gfidente] 10:01:30 Launchpad bug 1783369 in tempest "Some ojectstorage tests use skip_path() and assume swift is deployed on the /" [Undecided,Confirmed] 10:02:36 need to investigate this first, nothing to discuss as of now i think 10:02:51 thanks for joining, that's it form today office hour 10:02:54 #endmeeting