Tuesday, 2023-08-22

opendevreviewmelanie witt proposed openstack/tempest master: Make create_server_snapshot work with ephemeral|swap  https://review.opendev.org/c/openstack/tempest/+/89225301:55
opendevreviewmelanie witt proposed openstack/tempest master: Make create_server_snapshot work with ephemeral|swap  https://review.opendev.org/c/openstack/tempest/+/89225301:56
opendevreviewMerged openstack/devstack master: Revert "Woraround systemd issue on CentOS 9-stream"  https://review.opendev.org/c/openstack/devstack/+/89209007:00
opendevreviewJakub Skunda proposed openstack/tempest master: Add option to specify source and destination host  https://review.opendev.org/c/openstack/tempest/+/89112309:58
opendevreviewMartin Kopec proposed openstack/tempest master: Centos-9 isn't yet compatible with global_venv  https://review.opendev.org/c/openstack/tempest/+/89151714:43
kopecmartin#startmeeting qa15:00
opendevmeetMeeting started Tue Aug 22 15:00:19 2023 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'qa'15:00
kopecmartin#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours15:00
kopecmartinagenda ^15:00
lpiwowaro/15:01
frickler\o15:01
kopecmartin\o/15:02
kopecmartin#topic Announcement and Action Item (Optional)15:02
kopecmartinPTL and TC nominations are ongoing 15:02
kopecmartin#link https://governance.openstack.org/election/15:02
kopecmartinlet me know if anyone wanted to be the PTL for QA15:02
kopecmartinif there are not candidates, I'll continue :) but if there are, please, go ahead as i've been the PTL for several cycles already 15:03
fricklerI'm quite fine with you doing most of the work ;-P15:03
kopecmartinI don't feel like i'm doing any work apart from administration :D 15:04
fricklerbut that's exactly the part that I don't want to do, so good fit ;)15:04
kopecmartin:D okey then15:05
kopecmartinmoving on15:05
kopecmartin#topic Bobcat Priority Items progress15:05
kopecmartin#link https://etherpad.opendev.org/p/qa-bobcat-priority15:06
kopecmartinuf, any news? 15:06
* kopecmartin checking the doc15:06
fricklercouple of hickups from global venv still15:07
fricklerafter nova cli get removed, rally found out that they were using it, too15:07
fricklerbut got fixed on their side now15:07
frickleralso https://bugs.launchpad.net/devstack/+bug/203163915:08
kopecmartinright, a similar issue is seen in centos9 jobs15:09
kopecmartinmaybe we could rename that LP 15:09
kopecmartinor create a new one for centos9?15:09
frickleryou can rename it to include all affected distros15:10
fricklerand maybe instead of https://review.opendev.org/c/openstack/tempest/+/891517 change the default in devstack15:10
fricklerdepending on distro15:10
fricklerbecause that will help non-tempest-consumers, too15:11
kopecmartinack, i also put the LP the priority etherpad15:11
kopecmartinright, that would be much smarter!15:11
kopecmartinok, so AI for me is to rename the LP to address all other affected distros plus propose a patch to devstack to temporarily overwrite the default value for centos915:12
kopecmartinas that distro fails on several places 15:13
kopecmartinmoving on15:13
kopecmartin#topic Gate Status Checks15:14
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:14
kopecmartinno patches there15:14
kopecmartinanything urgent to review/15:14
kopecmartin?15:14
fricklerI don't think so15:14
lpiwowarCan somebody take a look at this tempest patch? I was contacted by Tianqi and she waits for the review. Looks like she put a lot of work into the patch => https://review.opendev.org/c/openstack/tempest/+/88966415:15
kopecmartingmann: ^ I don't think i can objectively verify the changes in creds files :/ 15:15
kopecmartinwe'll get to it lpiwowar 15:16
kopecmartin#topic Bare rechecks15:16
kopecmartin#link https://etherpad.opendev.org/p/recheck-weekly-summary15:16
lpiwowarkopecmartin: got it:), I just wanted to mention it here. I added a comment as well but I am not sure about some things in the review as well.15:16
kopecmartinyeah, me too, thanks lpiwowar15:17
kopecmartinwe haven't had any recheck in QA for the past 7 days o.O \o/ nice!15:17
lpiwowar\o/15:18
kopecmartin#topic Periodic jobs Status Checks15:18
kopecmartinperiodic stable full15:18
kopecmartin#link https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-115:18
kopecmartinperiodic stable slow15:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena15:19
kopecmartinperiodic extra tests15:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests15:19
kopecmartinperiodic master15:19
kopecmartin#link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic15:19
kopecmartinall green \o/ but the centos-9 and one other job (known issue)15:19
kopecmartin#topic Distros check15:19
kopecmartincs-915:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=015:19
kopecmartindebian15:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&job_name=devstack-platform-debian-bookworm&skip=015:19
kopecmartinfocal15:19
kopecmartin#link https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-focal&skip=015:19
kopecmartinrocky15:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx15:19
kopecmartinopenEuler15:19
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=015:19
kopecmartinjup, centos-9 ...15:20
kopecmartinthe rest is ok though15:20
kopecmartin#topic Sub Teams highlights15:21
kopecmartinChanges with Review-Priority == +115:21
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:21
kopecmartinno patches15:21
kopecmartin#topic Open Discussion15:21
frickleryes15:21
kopecmartinanything for the open discussion?15:21
fricklerhttps://review.opendev.org/c/openstack/devstack/+/89135315:21
fricklerI just set RP+1 to it a minute age ;)15:21
kopecmartin:) 15:22
fricklerI didn't review it myself yet, but I think it is important to move away from eol etcd15:22
fricklerbut I wonder why bashate doesn't complain about the tab in there15:23
fricklermust be a gap in testing15:23
kopecmartinjust commenting that15:23
kopecmartinright, anything else to go over?15:25
kopecmartin#topic Bug Triage15:27
kopecmartin#link https://etherpad.openstack.org/p/qa-bug-triage-bobcat15:27
lpiwowarIt is small thing. I remind this patch every week now.  => https://review.opendev.org/c/openstack/tempest/+/89079815:27
lpiwowarIt is not urgent:). 15:27
kopecmartinright, i believe gmann has it on his review list but he's been/was on PTO .. 15:27
kopecmartin(if i remember correctly)15:28
kopecmartini'd wait for his feedback as he had latest comments on that 15:28
kopecmartini wanna mention this LP15:28
kopecmartin#link https://bugs.launchpad.net/devstack/+bug/202933515:28
kopecmartinand its relation to this patch15:29
kopecmartin#link https://review.opendev.org/c/openstack/devstack/+/89209015:29
lpiwowarkopecmartin: +1 15:29
kopecmartinnot sure if the LP was caused by the original patch and the revert fixes that, or the revert is just a workaround15:29
frickleroh, I just marked that bug as resolved15:29
kopecmartinperfect 15:30
fricklerthe LP was caused by a bug in centos. the patch made a workaround15:30
fricklernow centos is fixed and the workaround was removed15:30
kopecmartini see, thanks15:30
fricklerbut we should likely reconsider whether we want to support centos as platform15:30
frickleror make everyone use rocky instead for the next cycle15:31
fricklerrocky has been very stable in comparison, at least that's my impression15:31
kopecmartinseems like both (centos stream and rocky) are under Best Effort now15:32
kopecmartin#link https://governance.openstack.org/tc/reference/runtimes/2023.2.html15:32
kopecmartinbut i understand 15:32
frickler"best effort" means we do not need to support them in devstack15:33
kopecmartinif it's under Best Effort, i'd like to have at least some jobs, if centos will be failing too much, we can replace it with rocky on some places to save some resources 15:33
kopecmartinhmm15:33
fricklerand we really do lack people working on it, like for global venv support15:34
kopecmartinyeah, that definitely 15:34
kopecmartini don't have any answer now .. i need to gather more data first15:34
fricklersure, we have a couple of weeks until branching anyway, I think15:35
opendevreviewJan Gutter proposed openstack/devstack master: Update etcd version to 3.4.27  https://review.opendev.org/c/openstack/devstack/+/89135315:35
kopecmartinfrickler: ack, i'll try to keep this in mind and think about it15:37
kopecmartincool, if there isn't anything else, we can call it an hour 15:37
fricklerack15:38
kopecmartinthank you everyone 15:38
kopecmartin#endmeeting15:38
opendevmeetMeeting ended Tue Aug 22 15:38:29 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:38
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2023/qa.2023-08-22-15.00.html15:38
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2023/qa.2023-08-22-15.00.txt15:38
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2023/qa.2023-08-22-15.00.log.html15:38
fricklerthx kopecmartin 15:38
lpiwowarthank you kopecmartin15:38
gmannkopecmartin: lpiwowar 889664 is in my list, I will check it.15:46
gmannlpiwowar: kopecmartin also, 890798, will review today15:47
kopecmartinfrickler: overwriting of the GLOBAL_VENV should go to tools/fixup_stuff.sh, right? .. do we wanna target only centos9 or Rocky too?16:04
fricklerkopecmartin: both are broken, so target both. and I maybe would do it in stack.sh right next to the distro check16:05
ralonsohkopecmartin, hello, maybe you can help me with one issue I have with "neutron-tempest-plugin-dynamic-routing" job. os-ken is defined as required project and is running in the os-ken CI16:10
ralonsohdefinition: neutron-tempest-plugin-dynamic-routing16:10
ralonsohlogs: https://a098a101329f207dfbe7-f81dd8fd4f9add75179602ffbcf81b7d.ssl.cf5.rackcdn.com/890735/3/check/neutron-tempest-plugin-dynamic-routing/24b4f17/job-output.txt16:10
ralonsohbut I don't see os-ken being installed from source16:10
gmannlpiwowar: commented in this, please check https://review.opendev.org/c/openstack/tempest/+/89079816:12
fricklerkopecmartin: bashate seems to ignore tabs in front of comment lines. not sure if that's a bug or a feature?16:13
fricklerhmm, RP+1 isn't carried over across patchsets, I think we want to fix that16:18
melwittI saw this weird job failure in keystone where an AttributeError causes as 500 error, but looking in the code I don't see how it can get into that state https://zuul.opendev.org/t/openstack/build/af86792d15284fbd9db06cf5e5954fb4/log/controller/logs/screen-keystone.txt#131818:23
melwittoh hm, it looks like it only happened with the test change that increased uwsgi threads https://review.opendev.org/c/openstack/devstack/+/891214 so must be something in keystone not working well with threads18:26
kopecmartinralonsoh: i see it being installed on several places, e.g. 2023-08-21 00:45:58.12927018:32
kopecmartinand several times later 18:33
kopecmartinoh, it's not from source, it's pypi? .. based on the requirements.txt of that particular repo/project that is being installed .. i see several version were installed18:34
kopecmartine.g. the last one, right after a few tests failed, os-ken==2.6.0 was installed there18:34
kopecmartinhm, that's tempest, i need a minute to track it all18:35
kopecmartinralonsoh: it's due to upper constraints - https://opendev.org/openstack/requirements/raw/branch/master/upper-constraints.txt 18:38
kopecmartinthe version of os-ken on master branches is restricted to be 2.6.018:38
opendevreviewMartin Kopec proposed openstack/devstack master: Set GLOBAL_VENV to false for centos and rocky  https://review.opendev.org/c/openstack/devstack/+/89239518:42
kopecmartinfrickler: there has been a new comment in https://review.opendev.org/c/openstack/devstack/+/885593 , please check when you have a moment18:45
opendevreviewMartin Kopec proposed openstack/devstack master: Set GLOBAL_VENV to false for centos and rocky  https://review.opendev.org/c/openstack/devstack/+/89239519:25

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!