Tuesday, 2024-05-14

opendevreviewAmit Uniyal proposed openstack/whitebox-tempest-plugin master: evacuation tests  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/91539306:43
opendevreviewMerged openstack/devstack master: Upload images with --file instead of stdin  https://review.opendev.org/c/openstack/devstack/+/91868010:25
opendevreviewStephen Finucane proposed openstack/devstack master: lib/apache: Pass name, not path, to remove_uwsgi_config  https://review.opendev.org/c/openstack/devstack/+/91641113:14
opendevreviewStephen Finucane proposed openstack/devstack master: lib/apache: Reshuffle lines  https://review.opendev.org/c/openstack/devstack/+/90280213:14
opendevreviewStephen Finucane proposed openstack/devstack master: lib/cinder: Migrate cinder to WSGI module path  https://review.opendev.org/c/openstack/devstack/+/90290513:14
opendevreviewStephen Finucane proposed openstack/devstack master: lib/neutron: Migrate neutron to WSGI module path  https://review.opendev.org/c/openstack/devstack/+/91641213:14
opendevreviewMerged openstack/devstack stable/2023.2: [stable-only][CI] Drop periodic jobs  https://review.opendev.org/c/openstack/devstack/+/91775513:35
opendevreviewMerged openstack/devstack stable/2023.1: [stable-only][CI] Drop periodic jobs  https://review.opendev.org/c/openstack/devstack/+/91775713:48
opendevreviewStephen Finucane proposed openstack/devstack master: lib/cinder: Migrate cinder to WSGI module path  https://review.opendev.org/c/openstack/devstack/+/90290514:18
opendevreviewStephen Finucane proposed openstack/devstack master: lib/neutron: Migrate neutron to WSGI module path  https://review.opendev.org/c/openstack/devstack/+/91641214:18
opendevreviewStephen Finucane proposed openstack/devstack master: lib/placement: Migrate placement to WSGI module path  https://review.opendev.org/c/openstack/devstack/+/91958114:18
opendevreviewDan Smith proposed openstack/devstack master: Use OSCaaS to speed up devstack runs  https://review.opendev.org/c/openstack/devstack/+/67601614:31
opendevreviewDan Smith proposed openstack/devstack master: DNM: Test OCaaS  https://review.opendev.org/c/openstack/devstack/+/91868114:31
kopecmartin#startmeeting qa15:00
opendevmeetMeeting started Tue May 14 15:00:15 2024 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'qa'15:00
kopecmartin#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours15:00
kopecmartinafter a while, i'm back, let's go through the agenda 15:01
lpiwowaro/15:01
kopecmartino/15:01
kopecmartin#topic Dalmatian Priority Items progress15:02
kopecmartin#link https://etherpad.opendev.org/p/qa-dalmatian-priority15:02
kopecmartinany news on this front?15:02
* kopecmartin checking15:02
lpiwowarNothing from my side15:03
fricklerdon't think so15:04
kopecmartinyeah15:05
kopecmartinmoving on 15:05
kopecmartin#topic Gate Status Checks15:05
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:05
kopecmartin2 patches there, one with -1 vote and one -1 zuul, hmm15:06
fricklerone is for unmaintained, we shouldn't set RP there imo15:07
fricklerthe other is the one that made me notice the reno stuff15:08
fricklerRP+1 is likely good enough for that15:08
kopecmartinright, i commented , let's leave it with the priority for a week, if it's not updated till then, we'll drop the priority label15:10
kopecmartinabout the unmaintained , it's blocked by grenade job, the patch looks quite simple though15:11
kopecmartinoh, not only grenade , there is one more patch failing 15:11
kopecmartinanything we should do here? 15:11
kopecmartinshould we at least drop (or make non voting) the failing jobs? i don't think they'll get fixed 15:12
kopecmartinam talking about this patch15:13
kopecmartin#link https://review.opendev.org/c/openstack/devstack/+/91672715:13
kopecmartingmann: wdyt? ^15:13
kopecmartinok, let's leave the RP there for couple more days too, at least until i figure out what should/could we do with these unmaintained branches 15:14
kopecmartin#topic Sub Teams highlights15:14
kopecmartinChanges with Review-Priority == +115:14
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)15:14
fricklerIMO ignore unmaintained branches and leave things to the unaintainers15:14
kopecmartinthat would make sense, do they have rights to deal with these patches?15:15
frickleryes. and normal cores don't15:16
kopecmartinahaa15:16
kopecmartinthat's right, i missed this fact .. ok , there is nothing i can do then 15:17
fricklerfor the RP+1 reviews, there was an update just earlier, will need to have another look15:17
kopecmartinyep, great, let's wait for the jobs , i'll review those after the meeting 15:18
kopecmartinmoving on 15:19
kopecmartin#topic Periodic jobs Status Checks15:19
kopecmartinPeriodic stable full: https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-2023-1&job_name=tempest-full-2023-2&job_name=tempest-full-2024-115:19
kopecmartinPeriodic stable slow: https://zuul.openstack.org/builds?job_name=tempest-slow-2024-1&job_name=tempest-slow-2023-2&job_name=tempest-slow-2023-115:19
kopecmartinPeriodic extra tests: https://zuul.openstack.org/builds?job_name=tempest-full-2024-1-extra-tests&job_name=tempest-full-2023-2-extra-tests&job_name=tempest-full-2023-1-extra-tests15:19
kopecmartinPeriodic master: https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic15:19
kopecmartintempest-slow-* fail from time to time but i don't see any pattern15:22
kopecmartinthey look unstable 15:22
kopecmartinthe rest is as usual15:22
kopecmartinlet's wait and see if it gets worse15:23
kopecmartin#topic Distros check15:23
kopecmartinCentos 9: https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=015:23
kopecmartinDebian: https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&job_name=devstack-platform-debian-bookworm&skip=015:23
kopecmartinRocky: https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx15:23
kopecmartinopenEuler: https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=015:23
kopecmartinjammy: https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=015:23
kopecmartinthey seem good \o/15:25
kopecmartin#topic Open Discussion15:26
kopecmartinanything for the open discussion?15:26
lpiwowarImplement purge list patch. Can somebody please take a look at this?:) -> https://review.opendev.org/c/openstack/tempest/+/89784715:27
lpiwowarI think it is really close now. 15:27
kopecmartingmann: we can see the resource_list.json outuput in this one15:27
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/918725/15:27
kopecmartinso we have practically verified the above patch mentioned by lpiwowar15:28
kopecmartinand it's good to go15:28
kopecmartinthen we can move on with the release to announce end of support for zed15:28
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/91813515:28
kopecmartini promised we'll get merged the release by the end of the week O:) 15:28
kopecmartinanything else?15:29
lpiwowarkopecmartin I've checked two random builds for the slow job. And it is failing often on test_volume_migrate_attached ... Two times on mounting / remounting a volume. My guess is that there is maybe missing a wait for the mounting to be successful. 15:29
lpiwowarBut this is just a guess. It reminds me failures Jakub was facing when writing the new tests. 15:30
kopecmartinscenario tests? 15:30
kopecmartinif so, there is a waiter15:30
kopecmartin#link https://opendev.org/openstack/tempest/src/branch/master/tempest/scenario/manager.py#L100715:30
lpiwowarYes15:30
lpiwowarI think it is in the create_timestamp phase. 15:31
lpiwowarI do not know by heart whether there is a waiter or no. 15:31
kopecmartinif the tests call nova_volume_detach then there is 15:31
lpiwowarFrom the traceback it does not look like nova_volume_detach was called -> https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0b6/periodic-stable/opendev.org/openstack/tempest/master/tempest-slow-2023-2/0b632c0/testr_results.html15:32
kopecmartinthe test eventually calls nova_volume_attach15:33
kopecmartin#link https://opendev.org/openstack/tempest/src/branch/master/tempest/scenario/test_volume_migrate_attached.py#L21615:33
kopecmartinand that calls the detach15:33
kopecmartin#link https://opendev.org/openstack/tempest/src/branch/master/tempest/scenario/manager.py#L99215:33
lpiwowarBut that's not where it failed or is it?15:34
kopecmartinthe traceback you shared failed on 15:34
kopecmartinDevice or resource busy15:34
lpiwowarWhen executing:  sudo mount /dev/vdb /mnt15:34
lpiwowarSo I guess there was something mounted to /mnt that was not properly unmounted?15:35
kopecmartinhmm, maybe15:35
kopecmartinit's a race, it happens only from time to time :/ 15:36
lpiwowarYes, it just reminded me the jskunda's patch so I wanted to mention it.15:36
lpiwowarBecause I remember that we were talking about some wait in the create_timestamp function. But I'm not sure.15:37
kopecmartinthere is concurrency 4 in that job, maybe another test tries to create a timestamp too, at the same time, no clue ,feel free to check it out15:40
kopecmartini'll try to give it a few mins 15:40
kopecmartinif there isn't anything else, let's end the call with the bug triage statistics 15:41
kopecmartin#topic Bug Triage15:41
kopecmartin#link https://etherpad.openstack.org/p/qa-bug-triage-dalmatian15:41
kopecmartinthat's all from my side 15:41
kopecmartinthank you and see you all \o15:42
kopecmartin#endmeeting15:42
opendevmeetMeeting ended Tue May 14 15:42:28 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:42
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2024/qa.2024-05-14-15.00.html15:42
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2024/qa.2024-05-14-15.00.txt15:42
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2024/qa.2024-05-14-15.00.log.html15:42
lpiwowarthanks kopecmartin15:42
lpiwowarMaybe a wait here? https://opendev.org/openstack/tempest/src/commit/ccd034eb3a916ce4d3955fa11fe905aa50cbc15d/tempest/scenario/manager.py#L124115:44
fricklerkopecmartin: looking at devstack bugs, can https://bugs.launchpad.net/devstack/+bug/2060551 be marked as resolved?15:54
fungihttps://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/2ZXFBDHUA2XD4QD7R3X4NPKEZEIQLAOI/ looks like someone trying to bring up devstack on ubuntu noble/python 3.1216:47
clarkbI just responded to them16:48
clarkbthey also appear to be using pyyaml that is from the ~xena era16:48
fungioh fun. so could be entirely wrong branch16:48
clarkbyes I suspect some combo of really old devstack + really new ubuntu is simply not going to work and that is what they've run into16:49
clarkbthe specific failure is needing to build a py312 wheel for pyyaml 5.4.1 and devstack expects you to grab prebuilt wheels. But upstream isn't making py312 wheels for old releases16:52
gmannkopecmartin: for unmaintained/yoga, yes those updates needed. but not sure if we can track those changes as per RP because there is separate group who have +2 permission on all unmaintained group not devstack-core17:22
*** dmellado5 is now known as dmellado17:23
*** dmellado5 is now known as dmellado17:33
*** dmellado8 is now known as dmellado17:45
dansmithkopecmartin: clarkb: I think the feedback has been addressed on this, if you want to re-add your +2s https://review.opendev.org/c/openstack/devstack/+/676016/3018:04
clarkbdansmith: yup will rereview after meetings and lunch and all that19:18
dansmiththankas19:47
clarkbfrickler: dansmith ^ I guess I can go ahead and approve that chagne too since the depends on merged?19:52
clarkbI feel like the fact that it is disabled by default makes this compeltely safe then we can start testing improvements and/or enabling it by default as the enxt step and not wait for merging19:52
opendevreviewGhanshyam proposed openstack/tempest master: DNM: testing tempest resource-list cleanup  https://review.opendev.org/c/openstack/tempest/+/91961719:53
dansmithclarkb: certainly can from my perspective :)19:54
clarkbosc                  132 <- from the DNM test change thats 1/4 ish the time it takes otherwise19:54
clarkbI think that alone is worth keeping the momentum here19:54
clarkbwe're saving like 5 minutes every job19:54
clarkbwell when enabled19:54
dansmithyeah19:55
dansmithif it was only 30s or something we could argue, but it's too good IMHO :)19:55
clarkbok I approved it19:56
opendevreviewMerged openstack/devstack master: Use OSCaaS to speed up devstack runs  https://review.opendev.org/c/openstack/devstack/+/67601621:46
dansmithoh snap22:01
opendevreviewClark Boylan proposed openstack/devstack-gate master: Retire devstack gate  https://review.opendev.org/c/openstack/devstack-gate/+/91962622:04

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!