09:00:05 #startmeeting qa 09:00:06 Meeting started Thu Nov 17 09:00:05 2016 UTC and is due to finish in 60 minutes. The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot. 09:00:08 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 09:00:10 The meeting name has been set to 'qa' 09:00:33 hello, who all here today? 09:00:37 o/ 09:00:51 * andreaf o/ I'm only half here - ping me if you need me please :) 09:00:53 o/ 09:01:12 Here but barely awake 09:01:21 masayukig: DavidPurcell andreaf hi 09:01:36 andreaf: sure we need you always :) 09:02:01 let's wait for few min in case more people join 09:03:23 ok 09:03:48 dmellado: oomichi : ? 09:04:00 ok, let's start 09:04:05 #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_November_17th_2016_.280900_UTC.29 09:04:10 ^^ today agenda 09:04:27 #topic Ocata Priorities 09:04:36 #link https://etherpad.openstack.org/p/ocata-qa-priorities 09:04:57 ^^ this etherpad has all prioirty items we discussed in Barcelona 09:05:20 we had most of them from O-2 09:05:51 for me this one - Add an option for the number of target VMs to test live-migration 09:06:00 i might start this in next week may be 09:06:10 not so hard so will be quick 09:06:17 cool :) 09:06:35 i also want to do at least 2 VM live migration on gate as default 09:07:02 if that is acceptable as live migration job seems not so stable :) 09:07:50 next one - Remove deep test class Inheritance for easy debugging 09:08:07 we really need some progress in this but not sure whether it is started 09:08:24 ekhugen, dmellado, jhakimra ^^ 09:09:06 this makes debugging easy and much cleanup 09:09:11 yeah 09:09:45 first one - Add an option for stopping cleanup when test failure happens 09:09:56 i did not see its sepc but we can wait on this 09:10:14 dpaterson, mkopec ^^ 09:10:27 those are one for Ocata as this is short cycle 09:10:43 anything else on this? 09:11:18 policy spec is waiting on 2nd +2 09:11:27 and a few typo fixes... 09:11:35 DavidPurcell: cool, ll cover on spec topic 09:11:38 #topic Specs Reviews 09:11:44 okay, sorry I went too early 09:11:58 #link https://review.openstack.org/#/c/382672/ 09:11:59 ? 09:12:07 that's the one 09:12:23 gmann: 09:12:23 #link https://review.openstack.org/#/q/status:open+project:openstack/qa-specs,n,z 09:12:24 o/ 09:12:26 sorry I was late 09:12:32 dmellado: hi, no prob 09:12:48 * masayukig waves to dmellado 09:12:56 \o/ 09:13:02 from my side and alongside mkoderer__ 09:13:19 we're cleaning up manila tempest plugin, which will need also some work on tempest.lib ;) 09:13:23 DavidPurcell: nice, i will check that may be tomorrow morning 09:13:58 gmann: Thanks! It'd be great if we could get it merged by the end of the week :) 09:14:02 dmellado: let me know if you need anything on that :) 09:14:03 DavidPurcell: thanks for that 09:14:18 andreaf: o/ welcome back! sure, will do and I really appreciate it! 09:14:22 DavidPurcell: sure 09:14:44 dmellado: work on tempest.lib you means credential classes you mentioned in summit? 09:15:04 yep, and also at some point I'd like to move some more stuff to tempest.lib 09:15:12 thinking about how to remove some dependencies first 09:15:14 gmann: hi, sorry for my late joining. The gate of airport took time for passing 09:15:24 such as manager and remote_client 09:15:33 dmellado: moving is always great but changing existnig one need backward compatibility manner 09:15:41 oomichi: i knew :) 09:15:48 gmann: yep, I'm aware of it, that's why it's being tough! 09:15:50 dmellado: you mean scenario manager? 09:15:56 dmellado: yea 09:16:07 andreaf: hold on, I'll post the link to the etherpad where we're tracking this 09:16:35 dmellado: yea and paste here too 09:16:54 gmann: andreaf https://etherpad.openstack.org/p/manila_no_tempest_deps 09:17:36 dmellado: cool thanks 09:17:58 dmellado: thanks 09:18:02 andreaf: if you're 'back into business' I'll count you into that ;) 09:18:09 dmellado: so dynamic_credential is on the way to lib 09:18:27 gmann: cool, that'd deff help too 09:18:51 or it is merged, cannot find patch from mtreinish 09:19:14 yes I have some time now for upstream work, so I'll start back on those topics 09:19:35 dmellado: anyays, if you need changes in that we can hold that before moving 09:19:43 andreaf: cool, nice back :) 09:19:47 andreaf: great news. 09:20:09 gmann: I'll have to sync with mkoderer__ later this morning 09:20:20 sure 09:20:22 thanks 09:20:22 I'll let you guys know if I need that after it, but thanks! 09:20:27 next spec - https://review.openstack.org/#/c/173334/ 09:20:30 tempest-resource 09:20:41 so oomichi andreaf its all good it seems. 09:20:51 i will try to review by this week most 09:21:11 gmann: thanks, yeah it is good spec nwo I feel 09:21:22 s/nwo/now 09:21:33 oomichi: andreaf Thanks.. ll check for sure 09:21:50 other spec seems to be rebase 09:22:01 but anything else anyone has on spec? 09:22:48 #topic Tempest 09:22:52 #link https://review.openstack.org/#/q/project:openstack/tempest+status:open 09:22:55 ^^ open reviews 09:23:21 1 thing i want masayukig to bring about new project he added in qa 09:23:26 masayukig: ^^ 09:23:38 yeah, I'll try to save some time to review those specs too 09:23:51 dmellado: cool. thanks 09:23:54 gmann : coverage2sql? 09:23:58 yeah, for unit tests coverage 09:23:58 masayukig: yea 09:24:18 gmann : I'll bring it in the open discussion, though :) 09:24:30 masayukig: ok no prob 09:24:51 on tempest also, I'd like to propose a revert, I added you guys to a review to revert one change in ssh 09:25:00 as it's having issues with ssh on the ironic-inspector plugin 09:25:07 did you have the time to have a look? 09:25:07 dmellado: link? 09:25:09 dmellado: do you have a patch for that? 09:25:11 on it ;) 09:26:11 dmellado: this one? - https://review.openstack.org/#/c/366806/ 09:26:24 https://review.openstack.org/#/c/366806/ 09:26:27 yep, that one 09:26:34 my network was just being slow, thanks for that gmann 09:27:02 that seems puppet job fails, EmilienM needs to review it 09:27:25 dmellado: so what the issue there 09:27:32 no more info in commit message 09:27:35 I've found that without that revert and with the ironic-inspector plugin installed, tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_port_security_disable_security_group hangs forever 09:27:45 I'll take it over and add this information 09:28:00 you can have a look at our related issue here, in any case 09:28:04 https://bugzilla.redhat.com/show_bug.cgi?id=1394744 09:28:04 bugzilla.redhat.com bug 1394744 in openstack-tempest "TestSecurityGroupsBasicOps.test_port_security_disable_security_group test gets halted by giving request timed out." [Unspecified,New] - Assigned to dmellado 09:28:17 dmellado: humm, mainly `recv_exit_status` should be checked after reading 09:29:32 I've checked the bug that led to this issue, and I haven't been able to reproduce it in any case 09:29:41 oomichi: file not found on puppet failure 09:29:52 anyways ll check that 09:30:02 gmann: yeah, that seems another failure.. 09:30:16 oomichi: hidden failure :) 09:30:18 in any case please do review it if you have the time, I'll add EmilienM too 09:30:25 sure 09:30:41 dmellado: ok, that is stared on my list 09:30:41 next thing is baremetal tests removal - https://review.openstack.org/#/c/355586/ 09:30:46 thanks! 09:30:48 oomichi: thanks 09:31:23 this patch is much close, i have -1 for service availability of Ironic service which i feel should be in plugin side 09:31:32 not in tempest.config.py 09:32:08 all other looks fine 09:33:07 any more poitns on tempest side or we jump to bugs 09:33:45 gmann: yeah, basically these options would be on plugin side 09:33:45 Bug Triage: we discussd in barcelona that we will start triage rotation again same way we used to do before 09:33:55 oomichi: ops sorry 09:34:01 gmann: no problem, 09:34:12 oomichi: yea same way congress and ceilometer conrdinate 09:34:32 gmann: config is defined as stable interface also, so it is necessary to take deprecation time 09:34:47 if you want to move them into plugin side 09:34:57 oomichi: i think no till those are register from plugin side 09:35:21 oomichi: becasue if plugin register those and we can access those same way from tempet config 09:35:27 no user effect 09:36:00 gmann: true if no projects are using these options from outside 09:36:02 i mean user can still override moved config in tempest.conf 09:36:25 oomichi: but still other project can get from from tempest inport config right 09:36:50 oomichi: ahh you mean if anyone depends on tempest to register those? 09:36:52 gmann: yeah, if they can use other project as plugin correctly 09:37:13 oomichi: by config do you mean that now plugins can import config from tempest.lib too? 09:37:26 gmann: yeah, that is just a small concern. but as you know, some projects are using the options wrongly as you are fixing 09:37:32 oomichi: but if we keep in tempest conf then plugin needs to wait till those get removed from tempest 09:37:45 oomichi: yea 09:38:12 gmann: I will check the other projects code later 09:38:39 oomichi: ok 09:38:41 dmellado: no, we are defining tempest.conf also as stable interface 09:39:04 * oomichi sorry. my pc battery is super low now. will be off soon 09:39:09 oomichi: i got your concern as some of the network tests using baremtal driver enalbe or not 09:39:13 oomichi: I see, wouldn't you have any link to that commit? I'll look for it otherwise 09:39:19 oomichi: no prob, 09:39:26 oomichi: have a safe flight back 09:39:39 ouch! oomichi safe flight, didn't know you were at the airport ;) 09:39:44 dmellado: https://review.openstack.org/#/c/355586/ 09:39:48 #link https://review.openstack.org/#/c/355586/ 09:39:48 thanks gmann 09:39:54 safe trip oomichi 09:40:16 so on bug side 09:40:24 we started triage rotation 09:40:28 in thsi etherpad 09:40:34 o/ 09:40:40 #link https://etherpad.openstack.org/p/ocata-qa-bug-triage 09:40:57 this week rtoation was luzC 09:41:01 luzC: ^^ 09:41:05 ? 09:41:27 gmann : I think it's me 09:41:36 it's my turn 09:41:40 masayukig: your is next week right 09:41:54 * dmellado getting confused with the dates 09:41:58 masayukig: got it 09:42:09 masayukig: sorry for mis undersatnding the dates 09:42:12 masayukig: go ahead 09:42:16 yup 09:42:52 so, I triaged around 10 bugs 09:43:10 masayukig: nice 09:43:12 so, now there's 25 new bugs 09:43:23 masayukig: any critical one we should focus 09:43:24 #link http://status.openstack.org/bugday/ 09:44:15 masayukig: your patch got merged for graph thing? 09:44:32 not yet... There're 3 critical bugs on launchpad.. 09:44:35 https://bugs.launchpad.net/tempest 09:45:05 But they are a little bit old.. 09:45:24 masayukig: 2 are fix committed 09:45:31 masayukig: and ssh one is yes old one 09:45:35 yeah, and, I'm not sure this status https://bugs.launchpad.net/tempest/+bug/1298472 09:45:35 Launchpad bug 1298472 in tempest "SSHTimeout in tempest trying to verify that computes are actually functioning" [Critical,New] - Assigned to Matt Riedemann (mriedem) 09:46:04 ok 09:46:25 that's it from my side 09:46:37 and about weekly bug report, i did not get much idea about how many triaged or new came up from this- http://status.openstack.org/bugday/ 09:47:05 masayukig: should we start a etherpad where we can write weekly finding on bug triage liek we used to do previously 09:47:31 * oomichi is going back to get power 09:47:39 +1 on that, I think it'd make things clearer 09:47:57 oomichi: congrats on finding a power outlet! 09:48:04 ok will check that 09:48:10 we can see the number from the json file, but the etherpad idea looks good to me :) 09:48:12 dmellado: thanks :) congrats :) 09:48:32 yeah, nice to share current status of bugs 09:48:40 by the etherpad 09:48:42 #action gmann to check weekly bug triage report machenism (etherpad may be) 09:48:47 ok 09:48:54 masayukig: Thanks for that. 09:48:56 fyi, curl http://status.openstack.org/bugday/tempest-bug-stats-daily.json | jq '.records[]["new"]' 09:49:17 something like thit 09:49:18 next week seems skipped and then my turn 09:49:27 yes 09:49:29 masayukig: nice. ll check 09:49:44 so 10 min left 09:49:58 we will skip devstack and grenade is nothing on those 09:50:07 ok 09:50:10 #topic openstack-health 09:50:16 masayukig: ^^ 09:50:20 gmann: it would be nice to describe a new way(maybe etherpad) on https://etherpad.openstack.org/p/ocata-qa-bug-triage 09:50:26 i saw you mapped all summit idea to bugs 09:50:29 * dmellado needs to rush to a meeting, o/ guys 09:50:39 oomichi: sure, ll do that 09:50:42 actually, there's nothing about openstack-health specific things, but 09:50:45 gmann: cool, thanks 09:51:11 I'm thinking about to add a graph from coverage2sql data 09:51:20 masayukig: cool 09:51:28 masayukig: cool, is that easy to do that? 09:51:43 masayukig: ll get all coverage for all project UT ? 09:52:02 It's the best if we can\ 09:52:11 but, it's hard to do it 09:52:38 And we need to collect coverage data like subunit2sql doing 09:52:38 masayukig: is it hard because of much data? 09:52:54 yea, thats true 09:53:09 yes, and a lot of projects aren't getting the data now, 09:53:31 masayukig: ah, a nice point 09:53:46 masayukig: ok, may be we can start with 6 core project and then others 09:53:57 yeah, 09:54:03 gmann: oh, good idea 09:54:24 and we may advertise it after that 09:54:31 yea 09:54:44 it will incourage other projects 09:54:51 masayukig: yeah, most projects tend to follow after core projects do 09:54:57 5 min left, sorry to jump further 09:55:06 np 09:55:07 masayukig: thanks 09:55:10 #topic Critical Reviews 09:55:18 i think we talked on critical reviews 09:55:35 but if anyone want to bring up more please do it 09:55:57 yep, it is nice to move on 09:56:02 k 09:56:02 #topic Open Discussion 09:56:08 anything more to discuss 09:56:16 masayukig: you have one 09:56:30 gmann : thanks 09:56:55 I added a new repo under QA https://launchpad.net/coverage2sql 09:57:09 (I already mentioned, though) 09:57:25 It's on very early stage, 09:57:55 if someone is interested in, any feedbacks are welcome :) 09:58:04 oh, that is registered April, that is older than I expected 09:58:06 masayukig: cool 09:58:15 oomichi : heh 09:58:21 "coverage2sql is a tool for storing data of test coverage into a SQL database." 09:58:25 masayukig: do we have openstack repo already? 09:58:34 oomichi : yup 09:58:45 #link https://git.openstack.org/cgit/openstack/coverage2sql 09:58:55 masayukig: oh, cool :) 09:59:04 yea 09:59:15 1 min left 09:59:24 This definitely looks cool. AT&T is trying to get test coverage up for a lot of services, I'll see if I can get some people to help out with it. :) 09:59:43 DavidPurcell : \o/ 09:59:46 DavidPurcell: great 09:59:52 DavidPurcell: awesome :) 09:59:56 DavidPurcell : welcome! 10:00:01 let's move to qa 10:00:04 thanks all 10:00:06 #endmeeting