15:00:16 <kopecmartin> #startmeeting qa 15:00:16 <opendevmeet> Meeting started Tue Nov 1 15:00:16 2022 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:00:16 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:00:16 <opendevmeet> The meeting name has been set to 'qa' 15:00:24 <kopecmartin> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours 15:00:26 <kopecmartin> agenda ^ 15:00:26 <eliadcohen> hello all 15:00:30 <kopecmartin> o/ 15:01:34 <kopecmartin> it's been 2 weeks we had this meeting (due to PTG and my PTO) , let's go over the whole agenda today 15:02:19 <kopecmartin> #topic Announcement and Action Item (Optional) 15:02:33 <kopecmartin> we have a new etherpad with the priority items for the new cycle 15:03:00 <kopecmartin> oh, that's the next topic :D 15:03:27 <kopecmartin> anyway, my only announcement is quite obvious, we're at the beginning of another cycle 15:03:40 <kopecmartin> i'm still processing all the things we discussed during the PTG 15:03:46 <kopecmartin> i'm almost done though 15:03:57 <kopecmartin> #topic Zed Priority Items progress 15:04:03 <kopecmartin> :/ 15:04:07 <kopecmartin> #topic Antelope Priority Items progress 15:04:18 <frickler> \o 15:04:21 <kopecmartin> #link https://etherpad.opendev.org/p/qa-antelope-priority 15:04:23 <kopecmartin> o/ 15:04:50 <kopecmartin> the priority etherpad is almost up to date, i'm planning to do a few more additions later today 15:05:42 <lpiwowar> hi o/ 15:05:54 <kopecmartin> i added there also the "default job variant - ovs?" and "cleanup deprecated lib/neutron code" tasks 15:06:06 <kopecmartin> frickler: did we get any feedback on the default ovs job? 15:06:29 <frickler> yes, Neutron prefers to keep OVN the default 15:06:47 <frickler> and slaweq wanted to prepare a patch to make grenade test that variant 15:06:54 <frickler> not sure if that happened yet 15:07:34 <frickler> slaweq also volunteered to do the lib cleanup 15:07:36 <kopecmartin> what about ovn not being product ready, isn't that an issue anymore? 15:07:43 <kopecmartin> frickler: that's great news 15:07:47 <kopecmartin> thank you slaweq 15:07:51 <kopecmartin> it's very much appreciated 15:08:44 <frickler> I think today is a holiday in Poland, but he can update the etherpad when he returns I guess 15:09:07 <eliadcohen> Most of Europe has a holiday yes 15:09:31 <kopecmartin> absolutely, no pressure, important thing is we track it and we are aware of the next step 15:12:05 <kopecmartin> the other tasks in the priority etherpad look quite good, i'll add a few more details to the srbac thing later today 15:12:06 <kopecmartin> let's move on 15:12:07 <kopecmartin> #topic OpenStack Events Updates and Planning 15:12:29 <kopecmartin> we can skip, as we are at the beginning of the cycle 15:12:34 <kopecmartin> #topic Gate Status Checks 15:12:39 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) 15:12:52 <kopecmartin> nothing there 15:12:57 <kopecmartin> anything urgent for review? 15:13:18 <lpiwowar> nothing from my side 15:13:54 <kopecmartin> #topic Bare rechecks 15:13:58 <kopecmartin> #link https://etherpad.opendev.org/p/recheck-weekly-summary 15:14:24 <kopecmartin> we are at <15% .. out of 7 rechecks 15:14:53 <kopecmartin> #topic Periodic jobs Status Checks 15:15:05 <kopecmartin> stable 15:15:09 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-zed&pipeline=periodic-stable 15:15:15 <kopecmartin> master 15:15:17 <kopecmartin> #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic 15:15:55 <kopecmartin> periodic pipeline looks good 15:16:12 <frickler> fips looks broken 15:16:34 <kopecmartin> although it seems that tempest was successful 15:16:37 <kopecmartin> it failed after that 15:18:17 <lpiwowar> Yes, agree. I'm checking it too. 15:20:19 <kopecmartin> i'm staring at the console log but i don't see where exactly it failed 15:20:35 <kopecmartin> maybe here 15:20:54 <kopecmartin> [Capture most recent qemu crash dump, if any] but it says it ignores errors 15:22:25 <lpiwowar> Yeah, I saw this too. The Warnings in the "Generate statistics" task look a bit suspicious. 15:22:36 <frickler> in the latest job, tempest didn't finish, but was interrupted due to timeout 15:22:55 <frickler> 2022-11-01 04:43:02.590005 | RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/tempest/playbooks/devstack-tempest.yaml@master] 15:23:05 <frickler> https://zuul.openstack.org/build/009a202f662e4039801910581e65a704 15:23:27 <kopecmartin> oh, i see! i overlooked that line 15:23:55 <lpiwowar> Ok 15:24:01 <frickler> so maybe increasing the job timeout even more might help 15:24:22 <frickler> or reducing scope for fips 15:25:30 <kopecmartin> what do you mean by reducing scope? running less tests? 15:25:51 <frickler> yes 15:26:18 <frickler> or find out why it is slower than the normal c9 job 15:26:56 <kopecmartin> ok, let's increase a timeout just to confirm it would help, let's also compare the tests (how long they take) with the tests in another yet similar job 15:27:31 <kopecmartin> good, thanks 15:27:37 <kopecmartin> moving on 15:27:38 <kopecmartin> #topic Distros check 15:27:45 <kopecmartin> cs-9 15:27:47 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0 15:27:52 <kopecmartin> fedora 15:27:57 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-fedora-latest&skip=0 15:28:05 <kopecmartin> debian 15:28:06 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=0 15:28:14 <kopecmartin> jammy 15:28:14 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-ubuntu-jammy&job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0 15:29:04 <frickler> cs-9 and fedora have some timeouts too, but only sporadic ones 15:29:50 <kopecmartin> yeah :/ 15:30:27 <kopecmartin> i've just remembered, what's the status of migrating to jammy? 15:30:31 <frickler> I didn't spot any for debuntu, so might be newer version of something, kernel or qemu 15:30:53 <frickler> most obvious blocker for jammy is ceph 15:31:02 <frickler> not sure if anyone wanted to work on that 15:31:13 <frickler> noonedeadpunk made a lot of test patches 15:31:34 <frickler> and a couple of projects fixes issues already, like designate 15:32:01 <kopecmartin> ack, thanks, just wondering, i bet i have the gerrit topic tracking that open somewhere and lost among other tabs 15:32:26 <frickler> #link https://review.opendev.org/q/topic:migrate-to-jammy 15:32:42 <frickler> looks mixed in general 15:32:51 <frickler> so some work to do I guess 15:33:58 <frickler> swift still doesn't even do unit tests on py310 :( 15:35:10 <frickler> they were also late with py3 support, so it will be interesting to see whether they manage to stay integrated 15:35:32 <frickler> gmann: ^^ maybe something for the tc to keep an eye on 15:35:57 <frickler> #link https://review.opendev.org/c/openstack/swift/+/850947 15:39:07 <kopecmartin> efforts affecting everybody are always interesting .. 15:39:12 <kopecmartin> #topic Sub Teams highlights 15:39:17 <kopecmartin> Changes with Review-Priority == +1 15:39:23 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) 15:40:22 <frickler> I think https://review.opendev.org/c/openstack/devstack/+/860976 should go there, too, I just didn't get to it yet after dansmith updated it 15:40:38 <dansmith> \o/ 15:42:31 <frickler> seems interest in openeuler also has dropped off again, no signs of debugging the failures https://review.opendev.org/c/openstack/devstack/+/852237 15:44:00 <kopecmartin> a quick question in 15:44:02 <kopecmartin> #link https://review.opendev.org/c/openstack/devstack/+/861915 15:44:06 * kopecmartin checking the others 15:44:55 <frickler> seeing the merged patches, we should check whether wwe have periodic jobs for rocky and create them if not, also add them to the agenda 15:46:13 <frickler> I'll defer to haleyb for the ovn question 15:47:29 <kopecmartin> frickler: devstack-platform-rocky-blue-onyx is in check queue, isn't that enough? 15:48:58 <frickler> kopecmartin: ah, yes, we don't do periodic for the platform jobs. then just add https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx to the agenda to look at regularly 15:49:20 <kopecmartin> frickler: sounds good, thanks 15:50:19 <kopecmartin> done 15:50:40 <kopecmartin> #topic Open Discussion 15:50:45 <kopecmartin> anything for the open discussion 15:50:45 <kopecmartin> ? 15:51:56 <haleyb> frickler: what's up? 15:52:20 <kopecmartin> haleyb: just a quick question (last comment) in https://review.opendev.org/c/openstack/devstack/+/861915 15:53:23 * haleyb looking 15:53:36 <kopecmartin> thanks 15:53:40 <kopecmartin> #topic Bug Triage 15:53:49 <kopecmartin> #link https://etherpad.openstack.org/p/qa-bug-triage-antelope 15:53:56 <kopecmartin> our new etherpad for bug triaging ^^ 15:54:08 <kopecmartin> this is all from my side 15:54:14 <kopecmartin> if there isn't anything else 15:54:25 <kopecmartin> we can close our office hour 15:54:47 <kopecmartin> thank you everyone 15:54:51 <kopecmartin> #endmeeting