Tuesday, 2022-03-22

*** pojadhav|out is now known as pojadhav|rover03:03
*** clarkb is now known as Guest279003:17
*** bhagyashris is now known as bhagyashris|PTO05:43
*** jpena|off is now known as jpena07:52
opendevreviewjiang guodao proposed openstack/devstack master: [DNM] Fix the surrogatepass not allowed error  https://review.opendev.org/c/openstack/devstack/+/74122008:02
*** pojadhav|rover is now known as pojadhav|lunch08:41
*** pojadhav|lunch is now known as pojadhav|rover09:15
*** arxcruz is now known as arxcruz|ruck10:23
opendevreviewLukas Piwowarski proposed openstack/tempest master: Limit installation of new version of paramiko library  https://review.opendev.org/c/openstack/tempest/+/83464610:42
frickleropeneuler job seems to be in a pretty bad state, not sure anyone is around here to take a look https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-openEuler-20.03-SP2&project=openstack/devstack10:49
fricklerand fedora seems like 50% failing, too10:49
*** pojadhav is now known as pojadhav|rover10:59
opendevreviewStephen Finucane proposed openstack/os-testr master: Retire os-testr  https://review.opendev.org/c/openstack/os-testr/+/83465911:42
*** ChanServ changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/"11:52
*** osmanlicilegi is now known as Guest211:59
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test fix for paramiko>2.8.1  https://review.opendev.org/c/openstack/tempest/+/83468613:27
opendevreviewFrancesco Pantano proposed openstack/devstack-plugin-ceph master: Deploy with cephadm  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/82648414:00
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test fix for paramiko>2.8.1  https://review.opendev.org/c/openstack/tempest/+/83468614:03
kopecmartin#startmeeting qa15:00
opendevmeetMeeting started Tue Mar 22 15:00:18 2022 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'qa'15:00
kopecmartin#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Weekly_QA_Team_meeting15:00
kopecmartinagenda ^^15:00
gmanno/15:00
lpiwowarHi o/15:00
*** Guest2790 is now known as clarkb15:01
kopecmartinhello .. great,let's start15:01
kopecmartin#topic Announcement and Action Item (Optional)15:01
kopecmartinhmm, i don't have any announcements for this week15:01
kopecmartin#topic Yoga Priority Items progress15:02
kopecmartin#link https://etherpad.opendev.org/p/qa-yoga-priority15:02
kopecmartinany updates on this front?15:02
kopecmartinnothing specific from my side, i know there are many patches for the tempest-scenario-manager-cleanup15:04
kopecmartini'm slowly reviewing 15:04
kopecmartin#link https://review.opendev.org/q/topic:tempest-scenario-manager-cleanup15:05
gmannI have also reviewed most of them and left comment15:05
kopecmartini saw, thank you gmann15:05
gmannonly concern I still have it many of them will have merge conflict as not all are in dependency series 15:06
gmannwhich will be extra review effort15:06
gmannwhat we can do is if we see any patch in same plugin and not in series then we can ask to do that first.15:06
gmannthat way we can see at the end what all method left in plugin manager15:06
kopecmartinyeah, although the extra effort will be mostly on the owner's side who'll need to rebase, a reviewer can simply check what changed between the patchsets and only revote previous vote if nothing related changed15:07
kopecmartingmann: +1, yep, that's a good idea15:07
kopecmartinrpopelka: ^^15:07
kopecmartinsoniya29: ^^15:08
soniya29kopecmartin, gmann okay15:08
kopecmartinmoving on 15:08
kopecmartin#topic OpenStack Events Updates and Planning15:09
kopecmartinPTG is gonna be in 2 weeks15:09
kopecmartin#link https://etherpad.opendev.org/p/qa-zed-ptg15:09
kopecmartinour etherpad for the topics we will discuss during our sessions ^^15:09
kopecmartinanyone can add their topic there15:09
kopecmartinI'll assign the gathered topics to the specific slots a few days prior the ptg15:10
kopecmartin#topic Gate Status Checks15:11
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking)15:11
kopecmartinno reviews there 15:11
kopecmartin#topic Periodic jobs Status Checks15:11
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-xena-py3&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-train-py3&pipeline=periodic-stable15:12
kopecmartin#link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic15:12
kopecmartinseems all good there \o/15:12
gmannon gate status, as you know this series is merged and centos9-stream job is voting on tempest gate now #link https://review.opendev.org/q/topic:wait_until_sshable_pingable15:12
gmannI proposed to make it voting in devstack side too which is passing now #link https://review.opendev.org/c/openstack/devstack/+/83454615:13
frickleropeneuler and fedora both need to be looked at, see my earlier comments15:13
gmannfor centos9 stream?15:13
fricklergmann: no, independent of that15:13
gmannfrickler: ohk15:14
fricklerkopecmartin: you still have the wrong xena job in your link above15:14
*** pojadhav|rover is now known as pojadhav|out15:14
kopecmartinah, sorry15:14
gmannyeah, not sure about fedora, openeuler and they are not in our testing runtime also. 15:14
gmannfrickler: kopecmartin if there are no maintainer for those then we can remove them temporary and if anyone come back then add them back?15:14
fricklerlajoskatona: ^^ I think fedora was of some interest for neutron?15:15
fricklergmann: I agree for openeuler15:15
kopecmartingmann: no need for removal now, i agree with not using it in gate, but let's keep the job around for a while more 15:16
kopecmartini'm actively looking for new contributors 15:16
gmannkopecmartin: it consume the infra resource15:16
gmannwe can add it in experimental if anyone want to run15:16
fricklerhaving n-v jobs that constantly fail trains people to ignore failures there15:16
gmannyeah15:17
fricklerwhich is something I want to avoid15:17
gmann+115:17
kopecmartinyeah, i agree with that, but it starting passing, didn't it?15:17
gmannfedora?15:17
kopecmartinoh15:17
kopecmartini was still talking about centos streams 8/915:17
gmannI think we are mixing it with centos9 stream :)15:17
kopecmartinyep15:17
fricklerfedora passes like 50%, openeuler fails 100% currently15:17
gmannlet's talk fedora and openeuler15:17
fricklercentos stream seems fine with the recent fixes, I just wonder for how long ;)15:18
lajoskatonafriskler: yea I checked and we have experimental and periodic job with fedora15:18
kopecmartingood, let's put it to experimental queue then .. if someone starts working on that, they can easily run it as experimental15:18
kopecmartinfrickler: i wonder too :D 15:18
kopecmartinfingers crossed 15:18
gmannyou mean fedora as well as openeuler in experimental and fedora in experimental we well as periodic (as it pass 50%) ?15:18
fricklerlajoskatona: do they work or do they also see high failure rates?15:18
lajoskatonafriskler: not that bad, I mean not 100% failure rate: https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-master-fedora15:19
fricklerthat looks slightly better than https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-fedora-latest&project=openstack/devstack , agreed15:20
gmannyeah. just thinking moving it to periodic in devstack side make it less noticeable than n-v ?15:21
gmannthough n-v also does not get more attention  15:21
fricklerwe could still look at it weekly in this meeting15:21
gmannto save infra resource I will vote for 1. openeuler  as experimental 2. fedore in experimental as well as periodic 15:22
fricklerso maybe periodic+experimental would be fine for fedora15:22
gmannyeah15:22
gmann+115:22
kopecmartinsounds good15:22
gmanncoming back to centos9 stream15:22
gmannfrickler: I would like it to be voting because of same point you mentioned about notice of n-v jobs failure15:23
gmannI agree it is not so stable but let's check the data as voting and if it is failing more and no active maintainer to fix it then I will bring this to TC about keeping it in distro or not15:23
gmannas it is passing now this is best chance to check its stability and monitor 15:24
kopecmartinsounds good to me15:25
fricklerI just worried that it will block other things and we'll have to revert that15:25
soniya29sounds good15:25
fricklerbut maybe I'm too pessimistic, so let's give it a try15:26
fricklerand if it fails again soon, I can place one more nail in its coffin ;)15:26
kopecmartini'll add a few new links for the jobs in our agenda, so that we can regularly check how centos and fedora behave 15:27
gmannfrickler: yeah, we can revert as soon as it fails and no one fix it15:27
gmannfrickler: kopecmartin one things if we want to merge it before stable/yoga which will be soon in this week or in zed master ?15:28
gmann*thing is15:28
gmannI mean if we merge now then it will be voting in stable/yoga too. I think it is ok?15:29
kopecmartini think it is ok, if it fails, we'll need to revert it either way (in master or / and in yoga)15:29
gmannok15:29
gmannthat is all on centos9-stream from my side.15:30
kopecmartinack, thanks15:31
kopecmartinmoving on15:31
kopecmartinChanges with Review-Priority == +115:31
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking)15:31
kopecmartinthere are 2, one the centos9 patch15:31
kopecmartin#link https://review.opendev.org/c/openstack/devstack/+/83454615:31
kopecmartinand the other 15:31
kopecmartin#link https://review.opendev.org/c/openstack/devstack/+/83367315:32
kopecmartin#topic Open Discussion15:33
kopecmartinanything for the open discussion?15:33
lpiwowartest_connectivity_between_vms_on_different_networks tempest test is failing (+ some other tempest plugin tests) with paramiko>2.8.1.15:33
lpiwowarHere is a patch that probably fixes the issue (I am just working on testing it)15:34
lpiwowarhttps://review.opendev.org/c/openstack/tempest/+/834686/2/tempest/lib/common/ssh.py ^^15:34
kopecmartinoh , yeah15:34
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/196069215:34
lpiwowarI am not sure whether it is good approach. Disabling rsa-sha2 like this.  15:35
gmannwhat version we test in gate for paramiko ?15:35
fricklerdidn't we fix something similar some weeks ago?15:35
lpiwowar2.8.115:36
gmann2.8.1 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L17915:36
gmannyeah15:36
gmannso it is passing on that but failing with later?15:36
lpiwowarIt is probably known issue: https://opendev.org/openstack/requirements/commit/38976e9fa9d037a2c04dfd4e7b34ee39841305ec15:36
lpiwowarThe first version when it starts failing is paramiko 2.9.115:36
gmannI see15:36
kopecmartinfrickler: you maybe meant this? it's the only think we merged lately related to sha i can remember  - https://review.opendev.org/c/openstack/devstack/+/831245/3/lib/tls15:38
clarkbI've been suggesting that other key type sbe used instead of rsa so that you don't have to reduce your security stance. Granted this is for testing. But it seems like the right thing is to use tools that are considered secure rather than sha1 which people are trying to move away from15:38
fricklerah, we just capped it in u-c and never fixed it for good, ok15:39
gmannwe can test tempest fix with depends-on in requirements 2.9.1 or higher version u-c patch , that can help if that fix all things or not15:39
fricklerclarkb: I like that idea15:40
lpiwowar@gmann Ok, I'll try to test the patch with 2.9.1 and will see. 15:41
fricklerlpiwowar: would you be interested in also trying to look at changing the key type that tempest uses?15:42
lpiwowarI have tried to experiment with the patch locally and it seems that it fixes the issue (at least for some barbican tests) but I need to check if it fixes the bug even for tempest tests.15:42
kopecmartinlpiwowar: maybe after that we could test whether there is another way how to fix the issue, without disabling the algorithms  15:43
clarkbI think ecdsa keys make fips testing easier anyway.15:43
lpiwowar@frickler Yeah, I can check it out. 15:43
lpiwowar@kopecmartin Ok, it sounds good15:44
kopecmartingood, anything else?15:44
gmannI have one topic on os-testr 15:45
gmannyou might see it on ML about retirement of os-testr #link http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027784.html15:45
gmannos-testr is always confused with complete replacement by stestr but it is not15:46
gmannyou can see reply from mtreinish also on what all few CLI/utils it has other than stestr.15:46
gmannIt is not broken and its maintenance  cost is almost none. question is should we retire it and move the existing CLI/utils to other place?  OR just keep it as it is?15:47
gmannother place is another question and if that team is ok to take/maintain those15:47
fricklerdoes it make sense to remove the os-testr binary and just keep what it actually needed?15:48
fricklerbut I'm for keeping it in place, moving to different place isn't worth the action15:48
gmannwe can do that, test running is depreacated since long so we can remove that assuming everyone using stestr15:48
clarkbmaybe add stetsr as a dependency to os-testr so that it pulls in the replacement for that portion15:48
gmannwe can remove that part completely as it was deprecated long time ago and if anyone using it (I know few repo does) then they will be broken and have to move to stestr 15:49
gmannI think that will avoid confusion of seeing os-testr being deprecated long ago but not retire15:50
kopecmartini'm for either having it as is, or removing stestr only from the repo (or putting there a return right at the beginning so that no-one executes that)15:51
gmannthanks for the idea. if that is ok for everyone I can propose and update on ML. stephen is not here so we can get his opnion in ML15:51
kopecmartinputting stestr as a dep would encourage people to continue using os-testr, which is not what we want15:52
gmannyeah, I will say remove it completely and ask to use stestr for test run15:52
kopecmartinand moving the other useful things to a new repo will require work and will cause some problems along the way, so i would avoid this too15:52
gmannyeah15:53
gmannI will push patch and update on ML. 15:54
gmannthat is all from me.15:54
kopecmartinthank you gmann for bringing this up15:54
kopecmartin#topic Bug Triage15:55
kopecmartin#link https://etherpad.opendev.org/p/qa-bug-triage-yoga15:55
kopecmartinwe see a small decrease in the numbers again, yay 15:55
kopecmartinthat's  all from my side too15:55
gmann\o/15:55
lpiwowaro/15:55
kopecmartinif there isn't anything else, let's close the office hour15:55
gmannat least more smooth in yoga release time at least as of now :)15:55
gmannbut still we have 1 more week to go15:56
kopecmartinyeah15:56
gmannyeah, nothing from me15:56
kopecmartinthank you everyone15:56
kopecmartinsee you around15:56
gmannthanks kopecmartin 15:56
kopecmartin#endmeeting15:56
opendevmeetMeeting ended Tue Mar 22 15:56:33 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:56
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.html15:56
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.txt15:56
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.log.html15:56
soniya29thanks kopecmartin 15:56
fricklergmann: just noticed an issue with the c9s patch, commented there, need to add to gate queue15:56
gmannfrickler: ah nice catch. I did for tempest but forget in devstack, will do. 15:57
opendevreviewGhanshyam proposed openstack/devstack master: Make centos-9-stream job voting  https://review.opendev.org/c/openstack/devstack/+/83454615:59
gmannfrickler: kopecmartin ^^15:59
mtreinishclarkb: stestr is a dep of ostestr iirc, it calls the stestr python api directly (I vaguely remember breaking the neutron tests when that merged)16:34
mtreinishgmann: yeah I think dropping the ostestr binary from the os-testr package makes sense to me. We should have deprecated it years ago, long enough that it's probably safe to remove16:34
gmannmtreinish: yeah, I think more than year :)16:35
gmannyeah, June 2019.16:36
*** jpena is now known as jpena|off16:45
*** tosky is now known as Guest3817:04
*** tosky_ is now known as tosky17:04
opendevreviewLuigi Toscano proposed openstack/devstack-plugin-nfs master: Disable horizon from basic tempest tests  https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/83475017:14
mtreinishgmann: oh, that's far more recent than I thought. I assumed it was like mid 2018 :)17:21
gmann:)17:38
opendevreviewLuigi Toscano proposed openstack/devstack-plugin-nfs master: Disable horizon from basic tempest tests  https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/83475020:42

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!