Tuesday, 2023-05-30

*** auniyal8 is now known as auniyal04:57
opendevreviewLukas Piwowarski proposed openstack/tempest master: Fix cleanup of resources for object_storage tests  https://review.opendev.org/c/openstack/tempest/+/88157508:35
opendevreviewMaxim Sava proposed openstack/tempest master: Add tests to list hidden images  https://review.opendev.org/c/openstack/tempest/+/88461009:11
opendevreviewDr. Jens Harbott proposed openstack/devstack master: Add option to install everything in global venvs  https://review.opendev.org/c/openstack/devstack/+/55893009:34
opendevreviewMaxim Sava proposed openstack/tempest master: Add tests to list hidden images  https://review.opendev.org/c/openstack/tempest/+/88461011:20
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test tempest-multioned-full-py3 job  https://review.opendev.org/c/openstack/tempest/+/86669211:31
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test tempest-multioned-full-py3 job  https://review.opendev.org/c/openstack/tempest/+/86669211:32
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test tempest-multioned-full-py3 job  https://review.opendev.org/c/openstack/tempest/+/86669211:37
opendevreviewLukas Piwowarski proposed openstack/tempest master: DNM: Test tempest-multioned-full-py3 job  https://review.opendev.org/c/openstack/tempest/+/86669211:55
kopecmartin#startmeeting qa15:00
opendevmeetMeeting started Tue May 30 15:00:10 2023 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'qa'15:00
kopecmartin#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours15:00
kopecmartinagenda ^^15:00
fricklero/ sorry got distracted15:05
kopecmartinnp, me too 15:06
kopecmartinlet's start15:06
kopecmartin#topic Announcement and Action Item (Optional)15:07
kopecmartinthere's gonna be ptg in person in 2 weeks during the summit in vancouver15:08
kopecmartin#topic Bobcat Priority Items progress15:09
kopecmartin#link https://etherpad.opendev.org/p/qa-bobcat-priority15:09
fricklerthe cirros update was done I think?15:10
fricklerhttps://review.opendev.org/c/openstack/devstack/+/88143715:10
kopecmartincorrect15:10
kopecmartinit was15:11
fricklerfor the venv/bookworm patch I pushed an update earlier today and it has some newish failures, need to look into those15:11
frickler#link https://review.opendev.org/c/openstack/devstack/+/55893015:11
kopecmartinack, thanks15:12
fricklerfor cirros there are new versions pending to be released with updated kernels15:12
fricklerbut switching to those should hopefully go much smoother15:13
frickler#link https://github.com/cirros-dev/cirros/issues/10215:13
kopecmartin\o/ at the end it wasn't that bad with the dhcp client change, it just took me forever to find time to propose the changes :/ 15:14
fricklerfor the venv patch maybe someone with more rocky/centos experience could look into the failures one those distros15:15
fricklerseems there are no volunteers around, so we can go on ;)15:19
kopecmartini'll try, at least i'll try to ping someone who can :) 15:19
frickleryay15:19
kopecmartinyeah, sorry, i had to step to a quick call .. 15:19
kopecmartinlet's move on 15:19
kopecmartin#topic OpenStack Events Updates and Planning 15:19
kopecmartinthe etherpads for the upcomming ptg in person in vancouver were autogenerated15:20
kopecmartin#link https://ptg.opendev.org/etherpads.html15:20
kopecmartinhere is ours15:20
kopecmartin#link https://etherpad.opendev.org/p/vancouver-june2023-qa15:20
kopecmartinif anyone has anything to discuss, feel free to add it there in advance15:20
kopecmartinAI for me to promote this on ML and add a structure to the etherpad15:21
kopecmartin#topic Gate Status Checks15:21
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:21
kopecmartin2 reviews there15:21
fricklertwo config error fixes, please approve15:21
* kopecmartin looking15:23
frickleralso CI for those branches seems pretty broken15:23
fricklerbut I guess we cannot simply retire them while others still want to run jobs15:24
kopecmartinuff, yeah, i see we need a lot of non votings15:24
kopecmartinyeah15:24
kopecmartinapproved 15:25
kopecmartin#topic Bare rechecks15:25
kopecmartin#link https://etherpad.opendev.org/p/recheck-weekly-summary15:25
kopecmartinwe're doing good15:25
kopecmartinQA has bare recheck rate below 13% over the last 90 days15:26
kopecmartin#topic Periodic jobs Status Checks15:26
kopecmartinperiodic stable full15:26
kopecmartin#link https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-115:26
kopecmartinperiodic stable slow15:26
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena15:26
kopecmartinperiodic extra tests15:26
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests15:26
kopecmartinperiodic master15:26
kopecmartin#link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic15:26
kopecmartinthe centos 9 stream fips job got fixed15:27
kopecmartinby this15:27
kopecmartin#link https://review.opendev.org/c/openstack/devstack/+/88427715:27
fricklerslow-2023-1 looks unstable. and some errors on master today15:28
kopecmartinyeah, one post failure one timeout, let's monitor that one15:28
kopecmartintempest-full-test-account-no-admin-py3 and one other got broken by enabling enforce scope in glance and nova by default in devstack15:29
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/202085915:29
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/202086015:29
kopecmartinthe other jobs (devstack-no-tls-proxy and tempest-slow-parallel) failed due to a timeout in some requests in a few tests15:30
kopecmartin:/ 15:30
kopecmartinlet's see if it's gonna repeat 15:31
kopecmartin#topic Distros check15:31
kopecmartincs-915:31
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=015:31
kopecmartinfedora15:31
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-fedora-latest&skip=015:32
kopecmartindebian15:32
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=015:32
kopecmartinfocal15:32
kopecmartin#link https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-focal&skip=015:32
kopecmartinrocky15:32
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx15:32
kopecmartinopenEuler15:32
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=015:32
kopecmartinall looks quite good, i expected worse :D 15:32
kopecmartin#topic Sub Teams highlights15:33
kopecmartinChanges with Review-Priority == +115:33
lpiwowaro/15:33
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:33
kopecmartinnothing there15:33
kopecmartin#topic Open Discussion15:34
kopecmartinanything for the open discussion?15:34
frickleryes15:34
fricklerI spoke with elodilles briefly about the pending stable/newton cleanups15:34
gmannfor grenade also ?15:35
fricklergrenade and devstack15:35
gmanncool15:35
fricklernot sure yet how to proceed15:35
fricklerthose eols happened on the edge of transitioning from manual branch deletion to automated15:36
fricklerso either a gerrit admin can clean up manually or we can try to run the automation for those still15:36
gmannif it need more work on automation scripts may be asking gerrit admin to remove manually will be easy15:37
fricklerI'd ask myself for that, by I'd still like to have the approval from the release team first15:38
kopecmartini'd be also for the option that requires less input from our side 15:38
gmann++15:38
frickleryou can see the history quite nicely here https://review.opendev.org/admin/repos/openstack/devstack,tags15:39
frickleranyway, waiting for feedback for now15:41
fricklerand that's it from me15:41
gmannfrickler: thanks for handling it. 15:42
lpiwowarI'd like to mention the failure in the test-account job that started to appear when we enabled the enforce scope in devstack for nova. I want to work on fixing it. Currently there seems to be an issue with getting users from the same project and distinguishing users with member and reader role - for pre-provisioned credentials. I do not know15:42
lpiwowarwhether someone has an idea of how should I proceed or what should I be aware of. I have a rough idea but someone might know more. -- https://review.opendev.org/c/openstack/tempest/+/88450915:42
gmannyeah pre provisioned account if not yet ready for new RBAC, it is not small change15:43
gmannI started looking into those and found the issues but will work this week to propose something 15:43
fricklerso disable scope in that job for now?15:43
gmann*is not yet ready15:43
gmannfrickler: yeah, that is one option. 15:43
gmannuntil we get pre provisioned account setup ready 15:44
gmannI can propose the disable today so that job continue running15:44
lpiwowargmann: ack, sounds good to me:)15:44
lpiwowarThere seems to be a lot of work with the pre-provisioned credentials. 15:45
gmannand once this gets fixed we need to make these jobs voting otherwise they are broken many times15:45
gmannyeah and no admin one also15:45
lpiwowargmann: +1 15:45
lpiwowarI cleaned up some object_storage tests that were causing failure in this job. But once I finished this new error started appearing.15:46
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/199662415:46
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/88157515:46
kopecmartinthe new errors are unrelated to the fix and LP 15:47
gmannk, will check those today or tomorrow 15:47
kopecmartinlpiwowar fixed the bug, thank you, once the gate is stable/fixed, we can proceed 15:47
lpiwowarkopecmartin: ack15:47
kopecmartinthere is one more interesting bug15:47
gmann++ thanks lpiwowar 15:47
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/202065915:47
kopecmartinwhich was caused , somehow, by this15:48
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/88167515:48
kopecmartinthat patch uncovered something broken in the logic 15:48
kopecmartinthere is a fix in progress15:48
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/88458415:48
gmannit did not fail in that change ?15:49
kopecmartinno15:49
kopecmartinit failed in other jobs in totally different project 15:49
kopecmartinin order to fail you had to set this15:49
kopecmartin [network].floating_network_name = public15:49
gmannhumm, some different config15:49
lpiwowarI commented on this today. Is the verify_ssh() function needed altogether? 15:49
kopecmartinyep, and that lead to a different execution path ... 15:49
kopecmartinit's described in the LP15:49
kopecmartinyeah, there is a discussion in 88458415:50
kopecmartinnot sure how to proceed, seems like the whole logic (if else) is quite outdated 15:50
lpiwowarWe wait for the server to be sshable. So create_server() should do the checking instead of the verify_ssh() ? 15:50
kopecmartinanyway, we can continue discussing there 15:50
gmannack, let me check. we can make it more consistent with other tests SSH verification15:50
gmannlpiwowar: yeah15:51
gmannadded it in list, will check this today 15:52
kopecmartinthanks gmann15:52
lpiwowargmann: ack:)15:52
kopecmartini also commented on your comment gmann here15:52
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/87992315:52
kopecmartinregarding the cleanup 15:52
kopecmartinand resource naming15:52
gmannkopecmartin: ack15:53
kopecmartin#topic Bug Triage15:53
kopecmartin#link https://etherpad.openstack.org/p/qa-bug-triage-bobcat15:53
kopecmartinall recorded tehre ^^15:53
kopecmartinand as we've already covered the bugs15:53
kopecmartinthis is all from my side 15:53
kopecmartinif there isn't anything else ...15:54
kopecmartinthank you everyone , see you online 15:54
kopecmartin#endmeeting15:54
opendevmeetMeeting ended Tue May 30 15:54:33 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:54
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2023/qa.2023-05-30-15.00.html15:54
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2023/qa.2023-05-30-15.00.txt15:54
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2023/qa.2023-05-30-15.00.log.html15:54
lpiwowarkopecmartin: thanks!15:54
opendevreviewEduardo Olivares proposed openstack/devstack master: Bump OVN_BRANCH to v21.06.0  https://review.opendev.org/c/openstack/devstack/+/88472016:24
opendevreviewMerged openstack/devstack stable/rocky: [stable-only] CI: Remove broken jobs  https://review.opendev.org/c/openstack/devstack/+/86433817:24
opendevreviewMerged openstack/devstack stable/stein: CI: drop nova-cells-v1 job  https://review.opendev.org/c/openstack/devstack/+/88456217:24
dansmithkopecmartin: frickler: can one of you +W this? https://review.opendev.org/c/openstack/devstack/+/883970 18:07
dansmithor maybe elodilles can do it?18:09
dansmithsome people want to enable this ^ in their jobs because it helps stability, but we need the flag to be available so they can do that18:11
fricklerdansmith: done, next time you can set RP+1 and we'll hopefully handle the patch during our weekly meeting18:14
dansmithoh good to know, thanks18:15
opendevreviewGhanshyam proposed openstack/tempest master: Test Nova and Glance RBAC policy old defaults  https://review.opendev.org/c/openstack/tempest/+/88476418:21
opendevreviewJames Parker proposed openstack/whitebox-tempest-plugin master: Test resize with mem_page_size in flavor  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/82477218:24
opendevreviewJames Parker proposed openstack/whitebox-tempest-plugin master: Test resize with mem_page_size in flavor  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/82477218:27
opendevreviewGhanshyam proposed openstack/tempest master: Enable Nova, Glance RBAC old defaults in pre provisioned account testing  https://review.opendev.org/c/openstack/tempest/+/88476818:51
opendevreviewJakub Skunda proposed openstack/devstack-plugin-nfs master: Switch to bobcat testing runtime  https://review.opendev.org/c/openstack/devstack-plugin-nfs/+/88325519:05
opendevreviewMerged openstack/devstack stable/yoga: Try to reduce mysql memory usage  https://review.opendev.org/c/openstack/devstack/+/88397020:18
opendevreviewMerged openstack/whitebox-tempest-plugin master: Use barbican client from barbican-templest-plugin  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/87871120:33
opendevreviewBrian Haley proposed openstack/devstack master: Install systemd-coredump on Debian-based distros  https://review.opendev.org/c/openstack/devstack/+/88479022:32

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!