*** pojadhav|out is now known as pojadhav|rover | 03:03 | |
*** clarkb is now known as Guest2790 | 03:17 | |
*** bhagyashris is now known as bhagyashris|PTO | 05:43 | |
*** jpena|off is now known as jpena | 07:52 | |
opendevreview | jiang guodao proposed openstack/devstack master: [DNM] Fix the surrogatepass not allowed error https://review.opendev.org/c/openstack/devstack/+/741220 | 08:02 |
---|---|---|
*** pojadhav|rover is now known as pojadhav|lunch | 08:41 | |
*** pojadhav|lunch is now known as pojadhav|rover | 09:15 | |
*** arxcruz is now known as arxcruz|ruck | 10:23 | |
opendevreview | Lukas Piwowarski proposed openstack/tempest master: Limit installation of new version of paramiko library https://review.opendev.org/c/openstack/tempest/+/834646 | 10:42 |
frickler | openeuler job seems to be in a pretty bad state, not sure anyone is around here to take a look https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-openEuler-20.03-SP2&project=openstack/devstack | 10:49 |
frickler | and fedora seems like 50% failing, too | 10:49 |
*** pojadhav is now known as pojadhav|rover | 10:59 | |
opendevreview | Stephen Finucane proposed openstack/os-testr master: Retire os-testr https://review.opendev.org/c/openstack/os-testr/+/834659 | 11:42 |
*** ChanServ changes topic to "Discussion of OpenStack Quality Assurance Projects (tempest, devstack, grenade, and friends) | docs https://wiki.openstack.org/wiki/QA | specs https://review.openstack.org/#/q/project:openstack/qa-specs | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-qa/" | 11:52 | |
*** osmanlicilegi is now known as Guest2 | 11:59 | |
opendevreview | Lukas Piwowarski proposed openstack/tempest master: DNM: Test fix for paramiko>2.8.1 https://review.opendev.org/c/openstack/tempest/+/834686 | 13:27 |
opendevreview | Francesco Pantano proposed openstack/devstack-plugin-ceph master: Deploy with cephadm https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/826484 | 14:00 |
opendevreview | Lukas Piwowarski proposed openstack/tempest master: DNM: Test fix for paramiko>2.8.1 https://review.opendev.org/c/openstack/tempest/+/834686 | 14:03 |
kopecmartin | #startmeeting qa | 15:00 |
opendevmeet | Meeting started Tue Mar 22 15:00:18 2022 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'qa' | 15:00 |
kopecmartin | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Weekly_QA_Team_meeting | 15:00 |
kopecmartin | agenda ^^ | 15:00 |
gmann | o/ | 15:00 |
lpiwowar | Hi o/ | 15:00 |
*** Guest2790 is now known as clarkb | 15:01 | |
kopecmartin | hello .. great,let's start | 15:01 |
kopecmartin | #topic Announcement and Action Item (Optional) | 15:01 |
kopecmartin | hmm, i don't have any announcements for this week | 15:01 |
kopecmartin | #topic Yoga Priority Items progress | 15:02 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-yoga-priority | 15:02 |
kopecmartin | any updates on this front? | 15:02 |
kopecmartin | nothing specific from my side, i know there are many patches for the tempest-scenario-manager-cleanup | 15:04 |
kopecmartin | i'm slowly reviewing | 15:04 |
kopecmartin | #link https://review.opendev.org/q/topic:tempest-scenario-manager-cleanup | 15:05 |
gmann | I have also reviewed most of them and left comment | 15:05 |
kopecmartin | i saw, thank you gmann | 15:05 |
gmann | only concern I still have it many of them will have merge conflict as not all are in dependency series | 15:06 |
gmann | which will be extra review effort | 15:06 |
gmann | what we can do is if we see any patch in same plugin and not in series then we can ask to do that first. | 15:06 |
gmann | that way we can see at the end what all method left in plugin manager | 15:06 |
kopecmartin | yeah, although the extra effort will be mostly on the owner's side who'll need to rebase, a reviewer can simply check what changed between the patchsets and only revote previous vote if nothing related changed | 15:07 |
kopecmartin | gmann: +1, yep, that's a good idea | 15:07 |
kopecmartin | rpopelka: ^^ | 15:07 |
kopecmartin | soniya29: ^^ | 15:08 |
soniya29 | kopecmartin, gmann okay | 15:08 |
kopecmartin | moving on | 15:08 |
kopecmartin | #topic OpenStack Events Updates and Planning | 15:09 |
kopecmartin | PTG is gonna be in 2 weeks | 15:09 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-zed-ptg | 15:09 |
kopecmartin | our etherpad for the topics we will discuss during our sessions ^^ | 15:09 |
kopecmartin | anyone can add their topic there | 15:09 |
kopecmartin | I'll assign the gathered topics to the specific slots a few days prior the ptg | 15:10 |
kopecmartin | #topic Gate Status Checks | 15:11 |
kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 15:11 |
kopecmartin | no reviews there | 15:11 |
kopecmartin | #topic Periodic jobs Status Checks | 15:11 |
kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-xena-py3&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-train-py3&pipeline=periodic-stable | 15:12 |
kopecmartin | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 15:12 |
kopecmartin | seems all good there \o/ | 15:12 |
gmann | on gate status, as you know this series is merged and centos9-stream job is voting on tempest gate now #link https://review.opendev.org/q/topic:wait_until_sshable_pingable | 15:12 |
gmann | I proposed to make it voting in devstack side too which is passing now #link https://review.opendev.org/c/openstack/devstack/+/834546 | 15:13 |
frickler | openeuler and fedora both need to be looked at, see my earlier comments | 15:13 |
gmann | for centos9 stream? | 15:13 |
frickler | gmann: no, independent of that | 15:13 |
gmann | frickler: ohk | 15:14 |
frickler | kopecmartin: you still have the wrong xena job in your link above | 15:14 |
*** pojadhav|rover is now known as pojadhav|out | 15:14 | |
kopecmartin | ah, sorry | 15:14 |
gmann | yeah, not sure about fedora, openeuler and they are not in our testing runtime also. | 15:14 |
gmann | frickler: kopecmartin if there are no maintainer for those then we can remove them temporary and if anyone come back then add them back? | 15:14 |
frickler | lajoskatona: ^^ I think fedora was of some interest for neutron? | 15:15 |
frickler | gmann: I agree for openeuler | 15:15 |
kopecmartin | gmann: no need for removal now, i agree with not using it in gate, but let's keep the job around for a while more | 15:16 |
kopecmartin | i'm actively looking for new contributors | 15:16 |
gmann | kopecmartin: it consume the infra resource | 15:16 |
gmann | we can add it in experimental if anyone want to run | 15:16 |
frickler | having n-v jobs that constantly fail trains people to ignore failures there | 15:16 |
gmann | yeah | 15:17 |
frickler | which is something I want to avoid | 15:17 |
gmann | +1 | 15:17 |
kopecmartin | yeah, i agree with that, but it starting passing, didn't it? | 15:17 |
gmann | fedora? | 15:17 |
kopecmartin | oh | 15:17 |
kopecmartin | i was still talking about centos streams 8/9 | 15:17 |
gmann | I think we are mixing it with centos9 stream :) | 15:17 |
kopecmartin | yep | 15:17 |
frickler | fedora passes like 50%, openeuler fails 100% currently | 15:17 |
gmann | let's talk fedora and openeuler | 15:17 |
frickler | centos stream seems fine with the recent fixes, I just wonder for how long ;) | 15:18 |
lajoskatona | friskler: yea I checked and we have experimental and periodic job with fedora | 15:18 |
kopecmartin | good, let's put it to experimental queue then .. if someone starts working on that, they can easily run it as experimental | 15:18 |
kopecmartin | frickler: i wonder too :D | 15:18 |
kopecmartin | fingers crossed | 15:18 |
gmann | you mean fedora as well as openeuler in experimental and fedora in experimental we well as periodic (as it pass 50%) ? | 15:18 |
frickler | lajoskatona: do they work or do they also see high failure rates? | 15:18 |
lajoskatona | friskler: not that bad, I mean not 100% failure rate: https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-master-fedora | 15:19 |
frickler | that looks slightly better than https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-fedora-latest&project=openstack/devstack , agreed | 15:20 |
gmann | yeah. just thinking moving it to periodic in devstack side make it less noticeable than n-v ? | 15:21 |
gmann | though n-v also does not get more attention | 15:21 |
frickler | we could still look at it weekly in this meeting | 15:21 |
gmann | to save infra resource I will vote for 1. openeuler as experimental 2. fedore in experimental as well as periodic | 15:22 |
frickler | so maybe periodic+experimental would be fine for fedora | 15:22 |
gmann | yeah | 15:22 |
gmann | +1 | 15:22 |
kopecmartin | sounds good | 15:22 |
gmann | coming back to centos9 stream | 15:22 |
gmann | frickler: I would like it to be voting because of same point you mentioned about notice of n-v jobs failure | 15:23 |
gmann | I agree it is not so stable but let's check the data as voting and if it is failing more and no active maintainer to fix it then I will bring this to TC about keeping it in distro or not | 15:23 |
gmann | as it is passing now this is best chance to check its stability and monitor | 15:24 |
kopecmartin | sounds good to me | 15:25 |
frickler | I just worried that it will block other things and we'll have to revert that | 15:25 |
soniya29 | sounds good | 15:25 |
frickler | but maybe I'm too pessimistic, so let's give it a try | 15:26 |
frickler | and if it fails again soon, I can place one more nail in its coffin ;) | 15:26 |
kopecmartin | i'll add a few new links for the jobs in our agenda, so that we can regularly check how centos and fedora behave | 15:27 |
gmann | frickler: yeah, we can revert as soon as it fails and no one fix it | 15:27 |
gmann | frickler: kopecmartin one things if we want to merge it before stable/yoga which will be soon in this week or in zed master ? | 15:28 |
gmann | *thing is | 15:28 |
gmann | I mean if we merge now then it will be voting in stable/yoga too. I think it is ok? | 15:29 |
kopecmartin | i think it is ok, if it fails, we'll need to revert it either way (in master or / and in yoga) | 15:29 |
gmann | ok | 15:29 |
gmann | that is all on centos9-stream from my side. | 15:30 |
kopecmartin | ack, thanks | 15:31 |
kopecmartin | moving on | 15:31 |
kopecmartin | Changes with Review-Priority == +1 | 15:31 |
kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade+OR+project:openstack/hacking) | 15:31 |
kopecmartin | there are 2, one the centos9 patch | 15:31 |
kopecmartin | #link https://review.opendev.org/c/openstack/devstack/+/834546 | 15:31 |
kopecmartin | and the other | 15:31 |
kopecmartin | #link https://review.opendev.org/c/openstack/devstack/+/833673 | 15:32 |
kopecmartin | #topic Open Discussion | 15:33 |
kopecmartin | anything for the open discussion? | 15:33 |
lpiwowar | test_connectivity_between_vms_on_different_networks tempest test is failing (+ some other tempest plugin tests) with paramiko>2.8.1. | 15:33 |
lpiwowar | Here is a patch that probably fixes the issue (I am just working on testing it) | 15:34 |
lpiwowar | https://review.opendev.org/c/openstack/tempest/+/834686/2/tempest/lib/common/ssh.py ^^ | 15:34 |
kopecmartin | oh , yeah | 15:34 |
kopecmartin | #link https://bugs.launchpad.net/tempest/+bug/1960692 | 15:34 |
lpiwowar | I am not sure whether it is good approach. Disabling rsa-sha2 like this. | 15:35 |
gmann | what version we test in gate for paramiko ? | 15:35 |
frickler | didn't we fix something similar some weeks ago? | 15:35 |
lpiwowar | 2.8.1 | 15:36 |
gmann | 2.8.1 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L179 | 15:36 |
gmann | yeah | 15:36 |
gmann | so it is passing on that but failing with later? | 15:36 |
lpiwowar | It is probably known issue: https://opendev.org/openstack/requirements/commit/38976e9fa9d037a2c04dfd4e7b34ee39841305ec | 15:36 |
lpiwowar | The first version when it starts failing is paramiko 2.9.1 | 15:36 |
gmann | I see | 15:36 |
kopecmartin | frickler: you maybe meant this? it's the only think we merged lately related to sha i can remember - https://review.opendev.org/c/openstack/devstack/+/831245/3/lib/tls | 15:38 |
clarkb | I've been suggesting that other key type sbe used instead of rsa so that you don't have to reduce your security stance. Granted this is for testing. But it seems like the right thing is to use tools that are considered secure rather than sha1 which people are trying to move away from | 15:38 |
frickler | ah, we just capped it in u-c and never fixed it for good, ok | 15:39 |
gmann | we can test tempest fix with depends-on in requirements 2.9.1 or higher version u-c patch , that can help if that fix all things or not | 15:39 |
frickler | clarkb: I like that idea | 15:40 |
lpiwowar | @gmann Ok, I'll try to test the patch with 2.9.1 and will see. | 15:41 |
frickler | lpiwowar: would you be interested in also trying to look at changing the key type that tempest uses? | 15:42 |
lpiwowar | I have tried to experiment with the patch locally and it seems that it fixes the issue (at least for some barbican tests) but I need to check if it fixes the bug even for tempest tests. | 15:42 |
kopecmartin | lpiwowar: maybe after that we could test whether there is another way how to fix the issue, without disabling the algorithms | 15:43 |
clarkb | I think ecdsa keys make fips testing easier anyway. | 15:43 |
lpiwowar | @frickler Yeah, I can check it out. | 15:43 |
lpiwowar | @kopecmartin Ok, it sounds good | 15:44 |
kopecmartin | good, anything else? | 15:44 |
gmann | I have one topic on os-testr | 15:45 |
gmann | you might see it on ML about retirement of os-testr #link http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027784.html | 15:45 |
gmann | os-testr is always confused with complete replacement by stestr but it is not | 15:46 |
gmann | you can see reply from mtreinish also on what all few CLI/utils it has other than stestr. | 15:46 |
gmann | It is not broken and its maintenance cost is almost none. question is should we retire it and move the existing CLI/utils to other place? OR just keep it as it is? | 15:47 |
gmann | other place is another question and if that team is ok to take/maintain those | 15:47 |
frickler | does it make sense to remove the os-testr binary and just keep what it actually needed? | 15:48 |
frickler | but I'm for keeping it in place, moving to different place isn't worth the action | 15:48 |
gmann | we can do that, test running is depreacated since long so we can remove that assuming everyone using stestr | 15:48 |
clarkb | maybe add stetsr as a dependency to os-testr so that it pulls in the replacement for that portion | 15:48 |
gmann | we can remove that part completely as it was deprecated long time ago and if anyone using it (I know few repo does) then they will be broken and have to move to stestr | 15:49 |
gmann | I think that will avoid confusion of seeing os-testr being deprecated long ago but not retire | 15:50 |
kopecmartin | i'm for either having it as is, or removing stestr only from the repo (or putting there a return right at the beginning so that no-one executes that) | 15:51 |
gmann | thanks for the idea. if that is ok for everyone I can propose and update on ML. stephen is not here so we can get his opnion in ML | 15:51 |
kopecmartin | putting stestr as a dep would encourage people to continue using os-testr, which is not what we want | 15:52 |
gmann | yeah, I will say remove it completely and ask to use stestr for test run | 15:52 |
kopecmartin | and moving the other useful things to a new repo will require work and will cause some problems along the way, so i would avoid this too | 15:52 |
gmann | yeah | 15:53 |
gmann | I will push patch and update on ML. | 15:54 |
gmann | that is all from me. | 15:54 |
kopecmartin | thank you gmann for bringing this up | 15:54 |
kopecmartin | #topic Bug Triage | 15:55 |
kopecmartin | #link https://etherpad.opendev.org/p/qa-bug-triage-yoga | 15:55 |
kopecmartin | we see a small decrease in the numbers again, yay | 15:55 |
kopecmartin | that's all from my side too | 15:55 |
gmann | \o/ | 15:55 |
lpiwowar | o/ | 15:55 |
kopecmartin | if there isn't anything else, let's close the office hour | 15:55 |
gmann | at least more smooth in yoga release time at least as of now :) | 15:55 |
gmann | but still we have 1 more week to go | 15:56 |
kopecmartin | yeah | 15:56 |
gmann | yeah, nothing from me | 15:56 |
kopecmartin | thank you everyone | 15:56 |
kopecmartin | see you around | 15:56 |
gmann | thanks kopecmartin | 15:56 |
kopecmartin | #endmeeting | 15:56 |
opendevmeet | Meeting ended Tue Mar 22 15:56:33 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:56 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.html | 15:56 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.txt | 15:56 |
opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2022/qa.2022-03-22-15.00.log.html | 15:56 |
soniya29 | thanks kopecmartin | 15:56 |
frickler | gmann: just noticed an issue with the c9s patch, commented there, need to add to gate queue | 15:56 |
gmann | frickler: ah nice catch. I did for tempest but forget in devstack, will do. | 15:57 |
opendevreview | Ghanshyam proposed openstack/devstack master: Make centos-9-stream job voting https://review.opendev.org/c/openstack/devstack/+/834546 | 15:59 |
gmann | frickler: kopecmartin ^^ | 15:59 |
mtreinish | clarkb: stestr is a dep of ostestr iirc, it calls the stestr python api directly (I vaguely remember breaking the neutron tests when that merged) | 16:34 |
mtreinish | gmann: yeah I think dropping the ostestr binary from the os-testr package makes sense to me. We should have deprecated it years ago, long enough that it's probably safe to remove | 16:34 |
gmann | mtreinish: yeah, I think more than year :) | 16:35 |
gmann | yeah, June 2019. | 16:36 |
*** jpena is now known as jpena|off | 16:45 | |
*** tosky is now known as Guest38 | 17:04 | |
*** tosky_ is now known as tosky | 17:04 | |
opendevreview | Luigi Toscano proposed openstack/devstack-plugin-nfs master: Disable horizon from basic tempest tests https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/834750 | 17:14 |
mtreinish | gmann: oh, that's far more recent than I thought. I assumed it was like mid 2018 :) | 17:21 |
gmann | :) | 17:38 |
opendevreview | Luigi Toscano proposed openstack/devstack-plugin-nfs master: Disable horizon from basic tempest tests https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/834750 | 20:42 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!