Tuesday, 2020-03-03

*** ccamposr has quit IRC00:04
*** mattw4 has quit IRC00:05
*** slaweq has joined #openstack-qa00:11
*** ccamposr has joined #openstack-qa00:16
*** slaweq has quit IRC00:17
*** ccamposr has quit IRC00:21
*** ccamposr has joined #openstack-qa00:37
*** ccamposr has quit IRC00:56
*** slaweq has joined #openstack-qa01:11
*** slaweq has quit IRC01:16
*** mtreinish has quit IRC01:27
*** mtreinish has joined #openstack-qa01:40
*** slaweq has joined #openstack-qa02:11
*** yamamoto has joined #openstack-qa02:14
*** slaweq has quit IRC02:15
*** rcernin_ has joined #openstack-qa02:52
*** rcernin has quit IRC02:55
*** slaweq has joined #openstack-qa03:11
*** slaweq has quit IRC03:16
*** dave-mccowan has quit IRC04:04
*** raukadah is now known as chandankumar04:04
*** slaweq has joined #openstack-qa04:11
*** ricolin has quit IRC04:15
*** slaweq has quit IRC04:17
*** gcheresh has joined #openstack-qa05:10
*** slaweq has joined #openstack-qa05:11
*** slaweq has quit IRC05:16
*** gcheresh has quit IRC05:23
*** rcernin_ has quit IRC05:24
*** ccamel has quit IRC05:34
*** evrardjp has quit IRC05:35
*** evrardjp has joined #openstack-qa05:35
*** camelCaser has joined #openstack-qa05:37
*** gcheresh has joined #openstack-qa06:09
*** igordc has joined #openstack-qa06:09
*** slaweq has joined #openstack-qa06:11
*** igordc has quit IRC06:13
*** slaweq has quit IRC06:16
*** toabctl has quit IRC06:18
*** toabctl has joined #openstack-qa06:22
*** brinzhang has joined #openstack-qa06:32
*** brinzhang_ has joined #openstack-qa06:35
*** brinzhang has quit IRC06:38
*** gcheresh has quit IRC06:40
*** brinzhang has joined #openstack-qa06:40
*** brinzhang has quit IRC06:41
*** brinzhang has joined #openstack-qa06:41
*** brinzhang_ has quit IRC06:43
*** brinzhang has quit IRC06:46
*** brinzhang has joined #openstack-qa06:46
*** brinzhang has quit IRC06:48
*** brinzhang has joined #openstack-qa06:49
*** brinzhang_ has joined #openstack-qa06:59
*** brinzhang has quit IRC07:02
*** slaweq has joined #openstack-qa07:11
*** rcernin has joined #openstack-qa07:13
*** slaweq has quit IRC07:16
openstackgerritAndreas Jaeger proposed openstack/stackviz master: Require stestr  https://review.opendev.org/71091507:23
AJaegerqa team, stestr is not installed in py36 and newer, see https://e17bd6be427f88540e88-ba5467d2de73878d3dd4296de3d69c75.ssl.cf5.rackcdn.com/710754/2/check/openstack-tox-py36/142f610/ - is the above the right change? I wonder what broke...07:23
openstackgerritAndreas Jaeger proposed openstack/stackviz master: Require stestr  https://review.opendev.org/71091507:27
AJaegerI found the culprit - oslotest removed stestr from requirements and had a recent release07:27
*** ricolin has joined #openstack-qa07:33
*** ccamposr has joined #openstack-qa07:43
*** slaweq has joined #openstack-qa07:52
*** gcheresh has joined #openstack-qa08:08
*** tosky has joined #openstack-qa08:20
*** yamamoto has quit IRC08:22
*** iurygregory has joined #openstack-qa08:26
*** yamamoto has joined #openstack-qa08:27
*** tesseract has joined #openstack-qa08:30
*** iurygregory has quit IRC08:36
*** jpena|off is now known as jpena08:41
*** rpittau|afk is now known as rpittau08:41
*** iurygregory has joined #openstack-qa08:41
*** rcernin has quit IRC08:41
*** ralonsoh has joined #openstack-qa08:42
*** gcheresh has quit IRC08:44
*** brinzhang has joined #openstack-qa08:47
*** brinzhang has quit IRC08:49
*** brinzhang has joined #openstack-qa08:49
*** brinzhang_ has quit IRC08:50
*** brinzhang has quit IRC08:51
*** brinzhang has joined #openstack-qa08:52
*** brinzhang has quit IRC08:53
*** brinzhang has joined #openstack-qa08:54
*** udesale has joined #openstack-qa09:14
*** gcheresh has joined #openstack-qa09:16
*** tesseract has quit IRC09:25
*** lucasagomes has joined #openstack-qa09:25
*** tesseract has joined #openstack-qa09:26
*** iurygregory has quit IRC09:27
*** gfidente has joined #openstack-qa09:41
*** yamamoto has quit IRC09:42
*** iurygregory has joined #openstack-qa09:43
*** yamamoto has joined #openstack-qa09:58
*** dtantsur|afk is now known as dtantsur10:03
*** rcernin has joined #openstack-qa10:04
*** brinzhang_ has joined #openstack-qa10:11
*** brinzhang has quit IRC10:15
*** brinzhang has joined #openstack-qa10:24
*** brinzhang_ has quit IRC10:27
*** rcernin has quit IRC10:37
*** gcheresh_ has joined #openstack-qa10:38
*** rcernin has joined #openstack-qa10:38
*** gcheresh has quit IRC10:38
*** brinzhang_ has joined #openstack-qa10:42
*** brinzhang_ has quit IRC10:43
*** brinzhang_ has joined #openstack-qa10:44
*** brinzhang has quit IRC10:45
*** brinzhang_ has quit IRC10:45
*** brinzhang_ has joined #openstack-qa10:46
*** gcheresh_ has quit IRC10:48
*** gcheresh_ has joined #openstack-qa10:50
*** openstackstatus has quit IRC10:59
*** arif-ali has quit IRC11:00
*** brinzhang has joined #openstack-qa11:01
*** brinzhang_ has quit IRC11:03
*** arif-ali has joined #openstack-qa11:04
*** rpittau is now known as rpittau|bbl11:17
*** trident has quit IRC11:46
*** trident has joined #openstack-qa11:49
*** rcernin has quit IRC11:52
*** brinzhang has quit IRC12:21
*** brinzhang has joined #openstack-qa12:22
*** brinzhang_ has joined #openstack-qa12:26
*** brinzhang has quit IRC12:29
*** jpena is now known as jpena|lunch12:32
openstackgerritMartin Kopec proposed openstack/tempest master: Remove deprecated scenario image options  https://review.opendev.org/71099612:41
*** afazekas has joined #openstack-qa12:47
kopecmartinafazekas: https://review.opendev.org/#/c/710148/12:47
kopecmartinafazekas: https://review.opendev.org/#/c/673342/12:47
*** yamamoto has quit IRC12:52
*** brinzhang has joined #openstack-qa13:03
*** rpittau|bbl is now known as rpittau13:04
*** yamamoto has joined #openstack-qa13:06
*** brinzhang_ has quit IRC13:06
* afazekas not sure about 2th one 13:10
*** paras333 has joined #openstack-qa13:16
kopecmartinafazekas: i think this review is ready https://review.opendev.org/#/c/708833 .. that should allow us to save some CI time when used properly13:17
*** udesale_ has joined #openstack-qa13:17
*** brinzhang_ has joined #openstack-qa13:17
*** udesale has quit IRC13:18
arxcruzwow, got a +2 from afazekas after only 6 patch sets! new record :D13:19
*** udesale_ has quit IRC13:24
*** udesale has joined #openstack-qa13:24
*** yamamoto has quit IRC13:29
gmannQA office hour time13:31
gmann#startmeeting qa13:31
openstackMeeting started Tue Mar  3 13:31:09 2020 UTC and is due to finish in 60 minutes.  The chair is gmann. Information about MeetBot at http://wiki.debian.org/MeetBot.13:31
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:31
*** openstack changes topic to " (Meeting topic: qa)"13:31
openstackThe meeting name has been set to 'qa'13:31
*** udesale has quit IRC13:31
kopecmartinhello o/13:31
*** udesale has joined #openstack-qa13:31
*** jpena|lunch is now known as jpena13:32
gmannlet's start13:33
toskyo/13:33
gmann#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours13:33
gmanntoday agenda ^^13:33
gmann#topic Announcement and Action Item (Optional)13:33
*** openstack changes topic to "Announcement and Action Item (Optional) (Meeting topic: qa)"13:34
gmannno action item from previous meeting13:34
gmann#topic Ussuri Priority Items progress13:34
*** openstack changes topic to "Ussuri Priority Items progress (Meeting topic: qa)"13:34
gmann#link https://etherpad.openstack.org/p/qa-ussuri-priority13:34
gmanni am picking only one which has progress.13:35
gmannpy2.7 drop plan for QA13:35
gmannthis is in progress. i have pushed the patches to release few of the QA tools.13:35
gmannpatrole and openstack-health patches are left to merge i think.13:36
gmanni will check today if anything failing there13:36
gmannnew whitebox plugin for tempest13:36
gmann#link https://review.opendev.org/#/c/656890/13:37
gmanni reviewed the spec and almost good to me. i have one question on devstack plugins need.13:38
gmanni will ping artom if he did not notice that and once online13:38
gmannImproving Tempest cleanup13:38
gmannkopecmartin: those are the two patches left for this ? anything else ?13:39
gmanni will review those right after meeting13:39
kopecmartinyes, i have an update regarding that too, a little one13:39
gmannok13:39
kopecmartinat Red Hat we started an 2 month opensource competition this week13:39
kopecmartinthe point is to get young students to work on opensource projects13:40
kopecmartini got tempest there and also one student signed for that13:40
kopecmartin#link https://etherpad.openstack.org/p/tempest-contest-contribution13:40
kopecmartini scoped some work in that etherpad^^13:40
kopecmartinfrom something easy like unit tests up to something a little harder like imporoving cleanup13:40
*** nweinber has joined #openstack-qa13:41
kopecmartinso we'll see what the progress of the student will be .. anyway , i'm happy we got another contributor :)13:41
gmanncool, that is really nice13:41
gmannkopecmartin: you can add unit test for all tempest CLI whatever missing along withcleanup13:41
kopecmartingmann: yeah, sure13:42
gmannthis is BP to show some example also13:42
gmann#link https://blueprints.launchpad.net/tempest/+spec/tempest-cli-unit-test-coverage13:42
gmannkopecmartin: thanks. is it one day hackathon type of for few days ?13:43
gmanns/of/or13:43
kopecmartinit's 2 months13:43
kopecmartinthe student will work on the tasks for 2 months, the point is to learn as much as possible and get someting done in upstream as well13:44
gmannperfect.13:44
gmannlet me know if any help needed.13:44
kopecmartinsure :)13:44
gmann#topic OpenStack Events Updates and Planning13:45
*** openstack changes topic to "OpenStack Events Updates and Planning (Meeting topic: qa)"13:45
gmann#link https://etherpad.openstack.org/p/qa-victoria-ptg13:45
gmanni have requested space of 2-3 members with consideration of canceling also. let's see how it goes13:46
gmann#topic Sub Teams highlights (Sub Teams means individual projects under QA program)13:46
*** openstack changes topic to "Sub Teams highlights (Sub Teams means individual projects under QA program) (Meeting topic: qa)"13:46
gmannTempest13:46
gmann#link https://review.openstack.org/#/q/project:openstack/tempest+status:open13:46
gmannthese are open review. I do not have any specific things to share for Tempest.13:47
gmannanyone has any on Tempest side13:47
kopecmartingmann: if you could review this #link https://review.opendev.org/#/c/708833/13:48
kopecmartinit will help optimize upstream gates13:48
kopecmartinand save some CI time13:48
*** nweinber has quit IRC13:48
gmannok i will check.13:49
*** nweinber has joined #openstack-qa13:49
kopecmartinthe plan is to use the option in tripleo ci jobs and save approx 30 min(maybe more) per each run, which is quite a lot13:49
gmannok13:49
gmannPatrole13:50
gmannpy2 drop patch is passing now.13:50
gmannafazekas: masayukig https://review.opendev.org/#/c/705525/13:51
gmannanything else on subteam side ?13:51
toskyapart from Patrole?13:51
gmannyeah13:51
toskyI answered the questions on the grenade patches and updated them, with one exception: where to set grenade_from_branch/grenade_to_branch13:52
toskyI explained it in the review13:52
gmanntosky: thanks, i will check those13:53
gmann#topic Community goal tracking13:54
*** openstack changes topic to "Community goal tracking (Meeting topic: qa)"13:54
gmannopenstack-health patch is failing on nodejs job which is broken already13:54
gmann#link https://review.opendev.org/#/c/705519/13:55
gmannos-testr is failing on py35, i will check that after meeting13:55
gmann#link https://review.opendev.org/#/c/705522/13:55
gmannpatrole is good to go as i shared earlier.13:55
gmannonce those are done then i will make release for those.13:56
gmanncontributor guide goal is not yet started, i am waiting to merge the final updates on goal doc side13:56
gmann#link Bug Triage13:56
gmann#topic Bug Triage13:57
*** openstack changes topic to "Bug Triage (Meeting topic: qa)"13:57
gmann#link https://etherpad.openstack.org/p/qa-bug-triage-ussuri13:57
gmannkopecmartin: ^^13:57
kopecmartinthe good news is, the numbers are still decreasing13:57
kopecmartinnot as fast as at the beginning, but still13:57
kopecmartini'd like to help paras333 who helped with triaging this week13:57
kopecmartinand also thank afazekas and arxcruz for reviews they have done13:58
*** udesale has quit IRC13:58
kopecmartingmann: btw there are many reviews mentioned in the etherpad, which are mostly ready to be moved forward13:58
*** udesale has joined #openstack-qa13:58
paras333These are the 4 bugs I am triaging this week:  https://bugs.launchpad.net/tempest/+bug/1205344: fixed already13:58
paras333https://bugs.launchpad.net/tempest/+bug/1542527: Not a bug13:58
paras333https://bugs.launchpad.net/tempest/+bug/1865276 in progress13:58
paras333https://bugs.launchpad.net/tempest/+bug/1835058 In progress13:58
openstackLaunchpad bug 1205344 in tempest "mkfs error in test_stamp_pattern" [Medium,Fix released] - Assigned to Paras Babbar (pbabbar)13:58
openstackLaunchpad bug 1542527 in tempest "TestStampPattern fails to call create_server correctly" [Undecided,Incomplete]13:58
*** zigo has quit IRC13:58
openstackLaunchpad bug 1865276 in tempest "ssh.exec_command, exit_status not always properly reported?" [Undecided,New] - Assigned to Paras Babbar (pbabbar)13:58
openstackLaunchpad bug 1835058 in tempest "During instance creation tenant network should be given always " [Undecided,New] - Assigned to Paras Babbar (pbabbar)13:58
gmannok, I will add those for this week review list13:58
kopecmartinin the previous week reports too13:58
gmannany critical or high priority bug/review we need immediate attention13:59
gmanni see there are 9 bug as High importance bug14:00
gmannall are triaged ? waiting for review ?14:00
paras333gmann:  sure, I will take a look after the meeting and let you guys know14:00
kopecmartingmann: those should be triaged first too, we were focusing mainly on new and inProgresss14:00
gmann#link https://bugs.launchpad.net/tempest/+bugs?search=Search&field.importance=High&field.status=New&field.status=Incomplete&field.status=Confirmed&field.status=Triaged&field.status=In+Progress&field.status=Fix+Committed14:01
gmannseems only 1 new bug in High Importance list14:01
gmannparas333: thanks14:01
gmannkopecmartin: ok, if any critical or high priority is there then you can bring those so that we can fix that on priority.14:02
kopecmartingmann: ok14:02
paras333gmann:  I think that also has patch for review https://review.opendev.org/#/c/642237/14:02
paras333gmann:  from first look all seems to have traction and review in progress14:02
gmannmarked two of them as fix released14:03
gmannparas333: i think we have domain things in v3 credential but i will doubel check14:03
paras333gmann:  ack14:04
gmannanything else on bug side ?14:04
gmann#topic Critical Reviews14:04
*** openstack changes topic to "Critical Reviews (Meeting topic: qa)"14:04
gmannI am listing py2 drop patches here. links above14:04
gmannand tosky patches for grenade14:05
gmannand worker one #link https://review.opendev.org/#/c/708833/14:05
gmannanything else which need attention on priority ?14:05
kopecmartingmann: we'd like to get your blessing for this: #link https://review.opendev.org/#/c/703401/14:05
gmannkopecmartin: ohk, i will do after meeting14:05
kopecmartingmann: thank you14:05
toskygrenade patches for the logs: https://review.opendev.org/#/c/637265/ and https://review.opendev.org/#/c/548936/14:06
gmannthanks14:06
gmann#topic Open Discussion14:06
*** openstack changes topic to "Open Discussion (Meeting topic: qa)"14:06
gmannanything else to discuss ?14:07
gmannok, let's close.14:08
gmannthanks everyone for joining14:08
gmann#endmeeting14:08
*** openstack changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/"14:08
openstackMeeting ended Tue Mar  3 14:08:14 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:08
openstackMinutes:        http://eavesdrop.openstack.org/meetings/qa/2020/qa.2020-03-03-13.31.html14:08
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/qa/2020/qa.2020-03-03-13.31.txt14:08
openstackLog:            http://eavesdrop.openstack.org/meetings/qa/2020/qa.2020-03-03-13.31.log.html14:08
openstackgerritGhanshyam Mann proposed openstack/os-testr master: [ussuri][goal] Drop python 2.7 support and testing  https://review.opendev.org/70552214:16
*** rosmaita has joined #openstack-qa14:17
rosmaitagmann: yt?14:18
*** yamamoto has joined #openstack-qa14:18
gmannrosmaita: hi14:19
rosmaitahi ... apologies in advance if you already covered this in an email14:20
rosmaitafor the remove-py2 community goal, what was the ack method? i couldn't find anything in storyboard14:20
rosmaitaand also, what is the completion artifact?14:20
rosmaitapretty sure everything is done in cinder-land14:21
rosmaitabut i just wanted to check if there's anything else i'm supposed to do to close out the goal14:21
gmannrosmaita: i have not created the storyboard for that as it need multiple updates across all repo etc14:21
gmannrosmaita: i think all done on cinder side.14:21
gmanni am going to start the audit right after we finish all remaining repo drop py2. audit will check if anything we missed or need to do.14:22
rosmaitaok, i will cross it off my list ... just wanted to verify that i wasn't missing anything14:22
rosmaitaok, cool, if i don't hear from you, no news is good news!14:22
gmannrosmaita: yeah, cinder is not in my ML list so it is all done there.14:22
gmannthanks for checking.14:22
rosmaitagreat! thanks for driving this, it's good to have it done!14:22
gmannnp!14:23
*** yamamoto has quit IRC14:23
openstackgerritLee Yarwood proposed openstack/tempest master: volume: Introduce extend attached encrypted volume tests  https://review.opendev.org/70690414:24
*** iurygregory has quit IRC14:26
openstackgerritLee Yarwood proposed openstack/devstack master: tempest: Add TEMPEST_EXTEND_ATTACHED_ENCRYPTED_VOLUME  https://review.opendev.org/70722714:27
openstackgerritLee Yarwood proposed openstack/tempest master: volume: Introduce extend attached encrypted volume tests  https://review.opendev.org/70690414:27
AJaegergmann: could you put stackviz on your review queue, please? https://review.opendev.org/710915 https://review.opendev.org/710754 and https://review.opendev.org/71075614:27
*** iurygregory has joined #openstack-qa14:28
gmannAJaeger: checking...14:29
AJaegergmann: thanks, the first change is needed for the second...14:32
AJaeger(and for anything else you want to merge in stackviz)14:32
*** zigo has joined #openstack-qa14:33
gmannAJaeger: i am not sure why oslotest dropped stestr from its requirement, it use stetsr as runner.14:33
AJaegergmann: they moved it to test-requirements14:33
AJaegergmann: that referenced change was merged in January...14:34
gmannok.14:34
gmannbut it started failing now ?14:36
AJaegergmann: yes, new release of oslotest I assume14:37
gmannah ohk, i am wondering if that fail other projects also.14:37
arxcruztosky: +w https://review.opendev.org/#/c/703401/ ?14:38
AJaegergmann: yes, it might break some other repos. in the oslotest change, stephenfin did a review of repos and most include both stestr and olsotest, so are fine. But some repos like stackviz don't, so are broken.14:38
*** brinzhang has quit IRC14:39
*** brinzhang has joined #openstack-qa14:40
gmannyeah, i think ML notification could be good trigger for that.14:40
AJaegerstephenfin: want to write one? ^14:41
gmannAJaeger: you want to move the ppublish to Post ? instead of periodic - https://review.opendev.org/#/c/710754/2/.zuul.yaml14:41
gmannpublish job14:42
AJaegergmann: if we do this, we never update the dependencies.14:43
AJaegergmann: both works, not sure which is better - do you have strong preference?14:44
openstackgerritLee Yarwood proposed openstack/devstack-plugin-ceph master: WIP zuul: Enable TEMPEST_EXTEND_ATTACHED_ENCRYPTED_VOLUME in base py3 job  https://review.opendev.org/70722814:45
toskyarxcruz: I'd say yes, unless you spot something new14:45
arxcruznope, just asking :) done14:45
gmannAJaeger: 'never update the dependencies' ?14:49
gmannohk, you mean on failing status ?14:50
*** artom has joined #openstack-qa14:51
gmannhow about gate pipeline, changes/recheck in gate pipeline should be less than periodic publish. stackviz changes are very less, only few in a cycle.14:51
stephenfinAJaeger: about oslotest.moxstubout being removed?14:55
openstackgerritMerged openstack/stackviz master: Require stestr  https://review.opendev.org/71091514:56
AJaegerstephenfin: about stestr removed from requirements.txt of oslotest14:57
stephenfinah14:57
AJaegergmann: let me update the change...14:57
*** gcheresh_ has quit IRC14:57
stephenfinI will, but there was a major version bump after which indicates that this kind of stuff can happen14:58
AJaegerstephenfin: it still broke stackviz and surprised us ;)15:00
openstackgerritAndreas Jaeger proposed openstack/stackviz master: Switch to native Zuul v3 publish job  https://review.opendev.org/71075415:02
AJaegergmann: moved to post ^15:02
AJaegergmann: and updated the project-config change to have the master there as safety (we don't need it, stackviz has no branches but if we ever do...)15:04
*** gcheresh_ has joined #openstack-qa15:10
*** brinzhang_ has quit IRC15:11
*** rosmaita has left #openstack-qa15:15
openstackgerritAndreas Jaeger proposed openstack/stackviz master: Switch to native Zuul v3 publish job  https://review.opendev.org/71075415:17
*** chandankumar is now known as raukadah15:18
*** udesale_ has joined #openstack-qa15:35
*** udesale has quit IRC15:37
*** dave-mccowan has joined #openstack-qa15:41
*** tesseract has quit IRC15:43
*** dave-mccowan has quit IRC15:46
*** tesseract has joined #openstack-qa15:53
*** rishabhhpe has joined #openstack-qa15:57
rishabhhpeHi All , I am facing with certain test execution ..i had pasted the error log here -: http://paste.openstack.org/show/790258/15:57
*** gcheresh_ has quit IRC16:02
openstackgerritLee Yarwood proposed openstack/tempest master: compute: Add stable device rescue tests with BFV instances  https://review.opendev.org/70143416:04
openstackgerritLee Yarwood proposed openstack/devstack master: tempest: Enable stable_rescue tests with Libvirt  https://review.opendev.org/70081416:04
gmannAJaeger: i think we can move job definition also in-tree - https://review.opendev.org/#/c/710756/216:07
gmannrishabhhpe: that is multi network issue. let me check if we did not fix that tests. where it is failing? on 3rd party CI ?16:08
rishabhhpegmann: yes it is failing on 3rd party CI16:08
*** mattw4 has joined #openstack-qa16:11
gmannrishabhhpe: yeah, we do not pass the network in that test, fixing that... btw your CI job has multiple network ? if not then it is race condition so recheck can work for now. I am fixing the test to explicitly pass the network to nova.16:14
openstackgerritLee Yarwood proposed openstack/tempest master: remote_client: Use blkid -L to find config drive by filesystem label  https://review.opendev.org/71086416:14
AJaegergmann: we have them all in project-config, I would leave it there. publish jobs in general need secrets and this way we have that all together. It should be ok to move but need to check ;)16:16
gmannAJaeger: i see. we can move if we decide to move all other jobs. ok for now.16:17
*** rishabhhpe has quit IRC16:18
openstackgerritGhanshyam Mann proposed openstack/tempest master: Create default network for voluem swap test  https://review.opendev.org/71104916:23
*** rishabhhpe has joined #openstack-qa16:24
gmannrishabhhpe: ^^16:24
rishabhhpegmann: thanks let me check it16:26
rishabhhpegmann: does it require restart of any service ?16:28
*** udesale_ has quit IRC16:29
gmannrishabhhpe: no. just run test again16:29
*** brinzhang_ has joined #openstack-qa16:29
rishabhhpegmann: trying it16:30
*** brinzhang has quit IRC16:32
*** nweinber has quit IRC16:37
rishabhhpegmann: it is working for that test .. but for other test it is failing like test_volumes_negative16:38
rishabhhpedo i need to change all the files in that directory ?16:38
gmannsame error ?16:39
rishabhhpeyes same error16:39
gmannrishabhhpe: this one right ? - tempest/api/compute/volumes/test_volumes_negative.py16:39
rishabhhpeyes .. and may be many more test will be executed after this so it will  be using these files16:40
gmannbut that test does not create the server.16:40
rishabhhpebut i am not sure why it is giving me same error16:43
gmanncan you paste the failure traceback16:43
rishabhhpesure16:43
rishabhhpeplease see it here : http://paste.openstack.org/show/790265/16:44
gmannrishabhhpe: that is separate test, admin one - tempest/api/compute/admin/test_volumes_negative.py16:45
gmannfixing.16:45
*** jpena is now known as jpena|brb16:46
rishabhhpegmann: fixing this one is fine but may be many more will come once i run tempest as a CI16:46
gmannrishabhhpe: ok, does your env create multi network or it is caused by tests race condition only.16:46
rishabhhpei just installed devstack .. on top of it i am running tempest .. and by default three networks came with that16:47
rishabhhpeis there any way to restrict it ?16:47
openstackgerritGhanshyam Mann proposed openstack/tempest master: Create default network for compute voluem test  https://review.opendev.org/71104916:49
gmannthose are ok i think as tenants are different. it might be running tests in parallel.16:49
gmannfixed ^^16:49
gmannrishabhhpe: i can update the tests if more failure. let me know if it pass16:50
rishabhhpeok Sure .. can u share the link ?16:51
gmannrishabhhpe: same patch - https://review.opendev.org/71104916:52
rishabhhpeok16:52
rishabhhpegmann: this one also got passed .. thank you .. will let u know if further test are failed16:55
gmannrishabhhpe: ok, you mean all tests passed this time ?16:56
gmannor just test_volume_negatives16:56
*** tesseract has quit IRC16:58
*** lucasagomes has quit IRC17:00
openstackgerritMerged openstack/patrole master: [ussuri][goal] Drop python 2.7 support and testing  https://review.opendev.org/70552517:04
rishabhhpethis one  just test_volume_negatives17:06
rishabhhpeone more got failed this time with different error -:  just test_volume_negatives17:06
rishabhhpepasted here -:http://paste.openstack.org/show/790267/17:07
gmannrishabhhpe: ok, that is ssh timeout which can be caused from multiple reason.17:08
rishabhhpeok so do u need any more information from my end regarding this ?17:09
*** nweinber has joined #openstack-qa17:09
gmannrishabhhpe: no, if any failure on multi network side, keep reporting. for ssh timeout, it is not completely fixed as it is hard to find the exact root cause17:09
*** rpittau is now known as rpittau|afk17:10
rishabhhpegmann: will u provide fix for this ?17:11
*** dtantsur is now known as dtantsur|afk17:13
*** gcheresh_ has joined #openstack-qa17:19
*** brinzhang has joined #openstack-qa17:19
*** brinzhang_ has quit IRC17:22
*** jpena|brb is now known as jpena17:25
rishabhhpegmann: did u find anything related to that timeout case17:27
gmannrishabhhpe: ssh timeout can be caused by multiple reason so it is not easy to debug or any generic fix.17:34
*** evrardjp has quit IRC17:35
*** evrardjp has joined #openstack-qa17:35
rishabhhpegmann: i tried in two ways one devstack i installed with nova and cinder .. another one with cinder only .. but with cinder only devstack from my all test cases are passing except 5 and while in case nova+cinder many are failing .. can u suggest the way like how i can take my CI forward ?17:38
gmannrishabhhpe: it depends on what type of coverage you want to cover in your CI. for integration testing, we run cincder + nova and few more default services enable. integration tests include all those services involvement. for example creating server using nova and then attach volume from cinder and check read/write data on volume17:40
gmannrishabhhpe: if your CI only need to care on cinder side things then you can run with cinder service only but that will skip the cinder tests if they need nova.17:41
rishabhhpeexactly the same which u mention i need to run ... but somewhere it is lacking in networking what i think17:41
rishabhhpethat i what happening17:41
rishabhhpethat is what happening17:41
gmannmeans integration tests right17:41
rishabhhpegmann can u suggest anything on that part so that i will not get such issue with ssh timeout and instance remaining in spawning state17:42
gmannrishabhhpe: you have all default services from devstack or disable them explicitly ?17:42
*** gcheresh_ has quit IRC17:43
rishabhhperyt now i have all services except some which are not required like heat17:43
gmannyour 3rd party zuul job is derived from which job ? 'devstack-tempest', 'devstack' ?17:43
gmannok17:44
rishabhhpeyour 3rd party zuul job is derived from which job ? 'devstack-tempest', 'devstack' ? did not understand this point17:44
gmanni mean definition of your zuul job. but you mentioned that you are using default from devstack then is fine17:45
gmann'instance remaining in spawning state' , you need to check nova compute logs for exact error17:45
rishabhhpeok17:47
gmannbut few test are passing with server creation etc right ?17:48
rishabhhpeyes few are passing17:49
gmannok that means env is ok and does not miss basic configuration. check nova compute log.17:50
rishabhhpegetting this error continously in log -: http://paste.openstack.org/show/790270/17:51
*** ccamposr__ has joined #openstack-qa17:53
rishabhhpegmann: can it be due to lack of resources ?17:53
gmannrishabhhpe: that is also not generic error, can happen due to multiple reason. basically nova sch is not able to find the  host to boot/migrate the server17:53
gmannis this live migration tests ?17:54
rishabhhpelive migration test is skipped i wil give u the exact name17:54
*** ccamposr has quit IRC17:55
*** igordc has joined #openstack-qa17:59
*** rishabhhpe has quit IRC17:59
*** rishabhhpe has joined #openstack-qa18:00
rishabhhpegmann: not able to get the test name but it surely not  live migration tests18:01
rishabhhpegmann: can it be because of lack of resources available in my nodepool VM as i spawned for 4GB  only18:03
rishabhhpewith 2GB of swap18:03
gmannyeah, that can be one reason. nova sch check where the requested VM can fit on available compute node. though other cases can depends on sch filters18:04
gmannbut i can tell from failing tests if heavy VM is issue18:04
rishabhhpeOK18:05
rishabhhpecan u help me with this test -: http://paste.openstack.org/show/790272/ .. in the mean time i can provide u the test name18:06
toskyI think (but I may be wrong) that usual CI nodes have at leats 8 GB of RAM18:06
gmannthat is on volume in error. you need to check cinder log for exact cause18:07
gmanncinder volume logs should have failure18:07
rishabhhpeok18:07
rishabhhpewell that test name is tempest.api.compute.servers.test_device_tagging.TaggedAttachmentsTest.test_tagged_attachment18:07
*** nweinber has quit IRC18:10
clarkbunfortunately running the openstack control plane does require quite a few resources18:10
gmannthat test does not need any specific VM resource, i think it is default of 64 or 128kb ram seems and disk depends on image you use18:12
*** ccamposr has joined #openstack-qa18:14
rishabhhpegmann: the which i posted above fails with this reason -:  Failed to copy image to volume: Bad or unexpected response from the storage volume backend API: Unable to fetch connection information from backend: 'initiator'18:16
*** ccamposr__ has quit IRC18:16
gmannrishabhhpe: ok, cinder team can help you on this with possible root cause.18:17
gmannit is from volume backend specific which you are configuring your CI18:18
rishabhhpeok let me ping there18:18
AJaegergmann: the stackviz change https://review.opendev.org/710754 passed tests, want to review it again, please?18:20
toskygmann, rishabhhpe: but I'd say that the backend owner is in a better position to debug a backend-specific configuration18:20
gmannAJaeger: thanks. +A18:21
AJaegerthanks!18:21
*** yamamoto has joined #openstack-qa18:21
gmanntosky: i am reviewing the grenade job patch. hope you will be here for some time to discuss the things.18:22
rishabhhpetosky: there are 4 other test cases failing for me .. but with different errors.. and the above one i will check with my team .18:22
openstackgerritArtom Lifshitz proposed openstack/qa-specs master: Whitebox Templest Plugin  https://review.opendev.org/65689018:23
toskygmann: I'm around for another hour, then away for ~40 minutes, back for 20, then away for the evening18:25
gmannok, that works18:25
*** yamamoto has quit IRC18:26
gmanntosky: commented on review. we are missing the tempest logs/config file on old node18:30
toskyouch, forgot that18:31
toskyI probably ignored it becuase of the skip18:31
gmannon grenade_from/to_branch: i am ok to drop the mapping and hard code on backport or new release. we can move those to write-grenade-conf role18:31
gmannok18:31
gmannwrite-grenade-conf role can have their default value and in grenade job (what grenade define) we can skip to override those18:32
toskygoing forward, the run of smoke test may be delegated to run-tempest too18:32
gmannand ask other job like stable or forward testing jobs to override in job18:32
toskybut which values should be in write-grenade-conf exactly?18:32
gmanntosky: by default run-temepst only run smoke tests18:32
toskygmann: yes, but right now it's grenade.sh that calls tempest18:33
gmannthis one - https://review.opendev.org/#/c/548936/110/roles/write-grenade-conf/defaults/main.yaml18:33
toskyoh18:33
gmannohk for old node, yes we can delegate to run-tempest on old node18:33
toskyI guess I can change it directly in the next changeset18:33
gmannthat will be easy to manage log etc18:33
toskyuhm, not sure whether to do it now though18:34
toskythe run-tempest thing, I mean18:34
gmannwhich one? old node tempest or write-grenade-conf18:34
gmannbut how we copy the tempest log from old side18:35
gmanni think we can do in grenade-log role18:35
openstackgerritMerged openstack/stackviz master: Switch to native Zuul v3 publish job  https://review.opendev.org/71075418:35
gmanni am ok to migrate to run-tempest later as long as we have logs copied properly18:36
toskyregarding write-grenade-conf, I guess I left them in the job to have them more visibile, but I guess the role is fine as well18:36
toskyin any case we need to update something when branching, regardless of the location of that definition18:37
gmannyeah, it will be easy to change them on backport and new release than from job side which is more hidden place18:37
gmannyeah, we need to update those both var on brnaching18:37
*** jpena is now known as jpena|off18:41
toskygrenade_to_branch in the new branch, grenade_from_branch in master18:42
toskygmann: a question about copying tempest/etc/tempest.conf, tempest/etc/accounts.yaml, etc to new18:47
gmannyeah. true18:47
toskyas those files are always going to be the ones after the execution, can't we leave them in the root?18:47
toskyso that they are visibile like in a devstack job18:47
toskywhile the logs from smoke tests will end up in their respective directories (old and new)18:48
gmannactually, that was confusing for me as we run tempest on both side.18:48
toskytechnically we could have 3 runs18:48
toskybut just one is the run driver by the variables set in the job (regexp, etc): the final one18:49
toskythe other two are the smoke tests18:49
gmann'variables set in the job' will be new node run only instead of smoke it will run regexp18:50
toskyuhm18:50
gmann3rd can be on new node if TARGET_RUN_SMOKE is true which is not for external usage.18:51
toskyright now,, if you enable smoke on the target, it runs smoke18:51
gmannTARGET_RUN_SMOKE one right ?18:51
toskyyes18:51
gmannthat should not be used by any jobs.18:52
gmannit is only for local testing not for gate18:52
toskyso let's just ignore those results? Or, in the worst case, can I copy them not directly in new/, but in new/smoke?18:52
gmanni am not sure we need that, we can kill that also in future.18:52
toskyoki18:53
gmannor just keep it but no log copy etc18:53
toskygmann: we can't define grenade_from/to_branch in write-grenade-conf, as they are needed by playbooks/pre.yaml too18:57
gmanntosky: ohk, can we define a new role 'configure-grenade-branch' or something and run in pre.yaml ?18:59
gmann'configure-grenade-branches'19:00
*** gcheresh_ has joined #openstack-qa19:01
toskygmann: so, that value will take the two variables by default, and set them as facts if not found?19:03
toskyI wonder if that works, or whether we should switch to new variables for internal usage19:03
gmanntosky: good question, I am not sure how ansible will behave, new var for internal usage seems better19:05
toskyok19:06
gmanntosky: or we can just mention grenade_to_branch: stable/train grenade_from_branch: master19:11
gmannin default.19:11
gmannand if job override then that value will be taken19:11
*** rishabhhpe has quit IRC19:13
toskygmann: yes, the default value for them is fine, but still we need internal variables for all the other usages19:14
gmannwhy? we can use same name19:15
gmanni mean same var19:15
gmannsame way you have currently.19:15
toskyuhm, I'm confused now O.o19:16
gmannnew role will just define the default and remove the grenade_from_branch setting from job definition19:16
toskythat's the question: is a default for a role visible outside the role?19:17
toskyI'm always confused by the ansible not-exactly standard rules for variable scope19:17
gmannand remove default omit from https://review.opendev.org/#/c/548936/110/playbooks/pre.yaml@3219:17
gmannohk, i got your point now19:18
gmannbut how you will set internal var for other usage ? we need to duplicate those in every role using them. right ?19:20
toskyset_fact19:20
toskythose are global variables for sure19:20
gmannohk, yeah19:20
*** ralonsoh has quit IRC19:21
toskyI'm just not sure what happen if I use set_fact on an already-defined default value19:21
gmanninternal var will be set only once.19:21
gmanni mean we have to go with new internal var as you mentioned in starting19:22
toskyyep19:23
*** gfidente is now known as gfidente|AFK19:24
*** mattw4 has quit IRC19:25
*** mvkr has quit IRC19:28
openstackgerritArtom Lifshitz proposed openstack/qa-specs master: Whitebox Templest Plugin  https://review.opendev.org/65689019:37
*** raildo_ has joined #openstack-qa19:39
*** raildo has quit IRC19:39
*** gcheresh_ has quit IRC19:40
openstackgerritMerged openstack/tempest master: Do not force live migration outside of Availability zone  https://review.opendev.org/71014819:52
openstackgerritMerged openstack/grenade master: Add GRENADE_USE_EXTERNAL_DEVSTACK to skip part of the setup  https://review.opendev.org/63726519:52
*** mvkr has joined #openstack-qa19:53
*** nweinber has joined #openstack-qa20:03
*** tosky has quit IRC20:22
*** AJaeger has left #openstack-qa20:23
*** trident has quit IRC20:23
*** trident has joined #openstack-qa20:26
*** rmascena__ has joined #openstack-qa20:26
*** raildo_ has quit IRC20:29
*** slaweq has quit IRC20:46
*** igordc has quit IRC21:08
*** igordc has joined #openstack-qa21:08
*** igordc has quit IRC21:10
*** slaweq has joined #openstack-qa21:11
*** igordc has joined #openstack-qa21:12
*** igordc has quit IRC21:12
*** slaweq has quit IRC21:16
*** nweinber has quit IRC21:17
*** mattw4 has joined #openstack-qa21:42
*** rcernin has joined #openstack-qa21:56
*** slaweq has joined #openstack-qa22:11
*** slaweq has quit IRC22:16
*** mattw4 has quit IRC22:41
*** brinzhang_ has joined #openstack-qa22:42
*** brinzhang has quit IRC22:45
*** mattw4 has joined #openstack-qa22:47
*** mattw4 has quit IRC22:53
*** ccamposr has quit IRC22:57
*** mattw4 has joined #openstack-qa23:00
*** mattw4 has quit IRC23:03
*** slaweq has joined #openstack-qa23:11
*** slaweq has quit IRC23:16
*** rmascena__ has quit IRC23:18
gmannmasayukig: this is passing now - https://review.opendev.org/#/c/705522/623:25
*** brinzhang has joined #openstack-qa23:33
*** brinzhang_ has quit IRC23:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!