15:00:16 <kopecmartin> #startmeeting qa
15:00:16 <opendevmeet> Meeting started Tue Nov  1 15:00:16 2022 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:16 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:00:16 <opendevmeet> The meeting name has been set to 'qa'
15:00:24 <kopecmartin> #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours
15:00:26 <kopecmartin> agenda ^
15:00:26 <eliadcohen> hello all
15:00:30 <kopecmartin> o/
15:01:34 <kopecmartin> it's been 2 weeks we had this meeting (due to PTG and my PTO) , let's go over the whole agenda today
15:02:19 <kopecmartin> #topic Announcement and Action Item (Optional)
15:02:33 <kopecmartin> we have a new etherpad with the priority items for the new cycle
15:03:00 <kopecmartin> oh, that's the next topic :D
15:03:27 <kopecmartin> anyway, my only announcement is quite obvious, we're at the beginning of another cycle
15:03:40 <kopecmartin> i'm still processing all the things we discussed during the PTG
15:03:46 <kopecmartin> i'm almost done though
15:03:57 <kopecmartin> #topic Zed Priority Items progress
15:04:03 <kopecmartin> :/
15:04:07 <kopecmartin> #topic Antelope Priority Items progress
15:04:18 <frickler> \o
15:04:21 <kopecmartin> #link https://etherpad.opendev.org/p/qa-antelope-priority
15:04:23 <kopecmartin> o/
15:04:50 <kopecmartin> the priority etherpad is almost up to date, i'm planning to do a few more additions later today
15:05:42 <lpiwowar> hi o/
15:05:54 <kopecmartin> i added there also the "default job variant - ovs?" and "cleanup deprecated lib/neutron code" tasks
15:06:06 <kopecmartin> frickler: did we get any feedback on the default ovs job?
15:06:29 <frickler> yes, Neutron prefers to keep OVN the default
15:06:47 <frickler> and slaweq wanted to prepare a patch to make grenade test that variant
15:06:54 <frickler> not sure if that happened yet
15:07:34 <frickler> slaweq also volunteered to do the lib cleanup
15:07:36 <kopecmartin> what about ovn not being product ready, isn't that an issue anymore?
15:07:43 <kopecmartin> frickler: that's great news
15:07:47 <kopecmartin> thank you slaweq
15:07:51 <kopecmartin> it's very much appreciated
15:08:44 <frickler> I think today is a holiday in Poland, but he can update the etherpad when he returns I guess
15:09:07 <eliadcohen> Most of Europe has a holiday yes
15:09:31 <kopecmartin> absolutely, no pressure, important thing is we track it and we are aware of the next step
15:12:05 <kopecmartin> the other tasks in the priority etherpad look quite good, i'll add a few more details to the srbac thing later today
15:12:06 <kopecmartin> let's move on
15:12:07 <kopecmartin> #topic OpenStack Events Updates and Planning
15:12:29 <kopecmartin> we can skip, as we are at the beginning of the cycle
15:12:34 <kopecmartin> #topic Gate Status Checks
15:12:39 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
15:12:52 <kopecmartin> nothing there
15:12:57 <kopecmartin> anything urgent for review?
15:13:18 <lpiwowar> nothing from my side
15:13:54 <kopecmartin> #topic Bare rechecks
15:13:58 <kopecmartin> #link https://etherpad.opendev.org/p/recheck-weekly-summary
15:14:24 <kopecmartin> we are at <15% .. out of 7 rechecks
15:14:53 <kopecmartin> #topic Periodic jobs Status Checks
15:15:05 <kopecmartin> stable
15:15:09 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-zed&pipeline=periodic-stable
15:15:15 <kopecmartin> master
15:15:17 <kopecmartin> #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic
15:15:55 <kopecmartin> periodic pipeline looks good
15:16:12 <frickler> fips looks broken
15:16:34 <kopecmartin> although it seems that tempest was successful
15:16:37 <kopecmartin> it failed after that
15:18:17 <lpiwowar> Yes, agree. I'm checking it too.
15:20:19 <kopecmartin> i'm staring at the console log but i don't see where exactly it failed
15:20:35 <kopecmartin> maybe here
15:20:54 <kopecmartin> [Capture most recent qemu crash dump, if any]  but it says it ignores errors
15:22:25 <lpiwowar> Yeah, I saw this too. The Warnings in the "Generate statistics" task look a bit suspicious.
15:22:36 <frickler> in the latest job, tempest didn't finish, but was interrupted due to timeout
15:22:55 <frickler> 2022-11-01 04:43:02.590005 | RUN END RESULT_TIMED_OUT: [untrusted : opendev.org/openstack/tempest/playbooks/devstack-tempest.yaml@master]
15:23:05 <frickler> https://zuul.openstack.org/build/009a202f662e4039801910581e65a704
15:23:27 <kopecmartin> oh, i see! i overlooked that line
15:23:55 <lpiwowar> Ok
15:24:01 <frickler> so maybe increasing the job timeout even more might help
15:24:22 <frickler> or reducing scope for fips
15:25:30 <kopecmartin> what do you mean by reducing scope? running less tests?
15:25:51 <frickler> yes
15:26:18 <frickler> or find out why it is slower than the normal c9 job
15:26:56 <kopecmartin> ok, let's increase a timeout just to confirm it would help, let's also compare the tests (how long they take) with the tests in another yet similar job
15:27:31 <kopecmartin> good, thanks
15:27:37 <kopecmartin> moving on
15:27:38 <kopecmartin> #topic Distros check
15:27:45 <kopecmartin> cs-9
15:27:47 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0
15:27:52 <kopecmartin> fedora
15:27:57 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-fedora-latest&skip=0
15:28:05 <kopecmartin> debian
15:28:06 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=0
15:28:14 <kopecmartin> jammy
15:28:14 <kopecmartin> #link https://zuul.openstack.org/builds?job_name=devstack-platform-ubuntu-jammy&job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0
15:29:04 <frickler> cs-9 and fedora have some timeouts too, but only sporadic ones
15:29:50 <kopecmartin> yeah :/
15:30:27 <kopecmartin> i've just remembered, what's the status of migrating to jammy?
15:30:31 <frickler> I didn't spot any for debuntu, so might be newer version of something, kernel or qemu
15:30:53 <frickler> most obvious blocker for jammy is ceph
15:31:02 <frickler> not sure if anyone wanted to work on that
15:31:13 <frickler> noonedeadpunk made a lot of test patches
15:31:34 <frickler> and a couple of projects fixes issues already, like designate
15:32:01 <kopecmartin> ack, thanks, just wondering, i bet i have the gerrit topic tracking that open somewhere and lost among other tabs
15:32:26 <frickler> #link https://review.opendev.org/q/topic:migrate-to-jammy
15:32:42 <frickler> looks mixed in general
15:32:51 <frickler> so some work to do I guess
15:33:58 <frickler> swift still doesn't even do unit tests on py310 :(
15:35:10 <frickler> they were also late with py3 support, so it will be interesting to see whether they manage to stay integrated
15:35:32 <frickler> gmann: ^^ maybe something for the tc to keep an eye on
15:35:57 <frickler> #link https://review.opendev.org/c/openstack/swift/+/850947
15:39:07 <kopecmartin> efforts affecting everybody are always interesting ..
15:39:12 <kopecmartin> #topic Sub Teams highlights
15:39:17 <kopecmartin> Changes with Review-Priority == +1
15:39:23 <kopecmartin> #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)
15:40:22 <frickler> I think https://review.opendev.org/c/openstack/devstack/+/860976 should go there, too, I just didn't get to it yet after dansmith updated it
15:40:38 <dansmith> \o/
15:42:31 <frickler> seems interest in openeuler also has dropped off again, no signs of debugging the failures https://review.opendev.org/c/openstack/devstack/+/852237
15:44:00 <kopecmartin> a quick question in
15:44:02 <kopecmartin> #link https://review.opendev.org/c/openstack/devstack/+/861915
15:44:06 * kopecmartin checking the others
15:44:55 <frickler> seeing the merged patches, we should check whether wwe have periodic jobs for rocky and create them if not, also add them to the agenda
15:46:13 <frickler> I'll defer to haleyb for the ovn question
15:47:29 <kopecmartin> frickler: devstack-platform-rocky-blue-onyx is in check queue, isn't that enough?
15:48:58 <frickler> kopecmartin: ah, yes, we don't do periodic for the platform jobs. then just add https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx to the agenda to look at regularly
15:49:20 <kopecmartin> frickler: sounds good, thanks
15:50:19 <kopecmartin> done
15:50:40 <kopecmartin> #topic Open Discussion
15:50:45 <kopecmartin> anything for the open discussion
15:50:45 <kopecmartin> ?
15:51:56 <haleyb> frickler: what's up?
15:52:20 <kopecmartin> haleyb: just a quick question (last comment) in https://review.opendev.org/c/openstack/devstack/+/861915
15:53:23 * haleyb looking
15:53:36 <kopecmartin> thanks
15:53:40 <kopecmartin> #topic Bug Triage
15:53:49 <kopecmartin> #link https://etherpad.openstack.org/p/qa-bug-triage-antelope
15:53:56 <kopecmartin> our new etherpad for bug triaging ^^
15:54:08 <kopecmartin> this is all from my side
15:54:14 <kopecmartin> if there isn't anything else
15:54:25 <kopecmartin> we can close our office hour
15:54:47 <kopecmartin> thank you everyone
15:54:51 <kopecmartin> #endmeeting