| frickler | seems bullseye is hard broken with what looks like some openssl related version mismatch | 08:20 |
|---|---|---|
| *** jpena|off is now known as jpena | 08:29 | |
| *** pojadhav is now known as pojadhav|afk | 11:47 | |
| kopecmartin | #startmeeting qa | 15:00 |
| opendevmeet | Meeting started Tue Nov 8 15:00:42 2022 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'qa' | 15:00 |
| kopecmartin | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 15:00 |
| kopecmartin | agenda ^^ | 15:00 |
| frickler | \o | 15:01 |
| gmann | o/ | 15:02 |
| kopecmartin | o/ | 15:02 |
| dansmith | o/ | 15:03 |
| kopecmartin | #topic Announcement and Action Item (Optional) | 15:03 |
| kopecmartin | no announcements from my side | 15:03 |
| kopecmartin | #topic Antelope Priority Items progress | 15:04 |
| kopecmartin | #link https://etherpad.opendev.org/p/qa-antelope-priority | 15:04 |
| kopecmartin | I've started looking into s-rbac | 15:04 |
| kopecmartin | (again) | 15:04 |
| lpiwowar | o/ | 15:04 |
| soniya | hello | 15:05 |
| kopecmartin | i don't have much updates regarding that yet .. anyway, the priority etherpad should be up to date | 15:05 |
| gmann | this is ready for RBAC #link https://review.opendev.org/c/openstack/devstack/+/861930 | 15:05 |
| gmann | on job with new RBAC enable, there are few test failing but need to debug them why #link https://review.opendev.org/c/openstack/tempest/+/614484 | 15:06 |
| gmann | will continue it this week | 15:06 |
| kopecmartin | perfect | 15:07 |
| kopecmartin | thanks | 15:07 |
| kopecmartin | i added to my review list | 15:07 |
| kopecmartin | *them | 15:07 |
| kopecmartin | #topic OpenStack Events Updates and Planning | 15:07 |
| kopecmartin | nothing here for now | 15:08 |
| kopecmartin | #topic Gate Status Checks | 15:08 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 15:08 |
| kopecmartin | one patch, the s-rbac thing for devstack | 15:08 |
| kopecmartin | i'll review after the meeting | 15:08 |
| kopecmartin | #topic Bare rechecks | 15:09 |
| kopecmartin | #link https://etherpad.opendev.org/p/recheck-weekly-summary | 15:09 |
| kopecmartin | we're doing pretty good, even our gates as we don't have many rechecks | 15:09 |
| kopecmartin | #topic Periodic jobs Status Checks | 15:10 |
| kopecmartin | stable | 15:10 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-zed&pipeline=periodic-stable | 15:10 |
| kopecmartin | master | 15:10 |
| kopecmartin | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 15:10 |
| kopecmartin | all seems good, i looked into the tempest-centos9-stream-fips job | 15:10 |
| kopecmartin | which has been timeouting for some time | 15:11 |
| kopecmartin | I have a WIP patch | 15:11 |
| kopecmartin | #link https://review.opendev.org/c/openstack/tempest/+/863163 | 15:11 |
| kopecmartin | it turned out that the tests, some of them, take longer on a fips env | 15:11 |
| kopecmartin | VMs take longer to spawn | 15:12 |
| kopecmartin | i'll add the tests which take the most of the time , more than 180seconds or so, to the exclude list | 15:12 |
| kopecmartin | #topic Distros check | 15:13 |
| kopecmartin | cs-9 | 15:13 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0 | 15:13 |
| kopecmartin | fedora | 15:13 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-fedora-latest&skip=0 | 15:13 |
| kopecmartin | debian | 15:13 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=0 | 15:13 |
| kopecmartin | jammy | 15:13 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-ubuntu-jammy&job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0 | 15:13 |
| kopecmartin | rocky | 15:13 |
| kopecmartin | https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx | 15:13 |
| frickler | c9s seems failing and thus blocking on yoga | 15:13 |
| frickler | debian likely broken with some openssl issue on master | 15:14 |
| dansmith | I was getting failures to stack on my focal setup yesterday, | 15:14 |
| frickler | I'll try to look at the latter, but help is welcome for both | 15:14 |
| dansmith | due to inability to validate a certificate or something | 15:14 |
| dansmith | is that related? | 15:14 |
| dansmith | Certificate did not match expected hostname: 192.168.122.214. Certificate: {'subject': ((('organizationName', 'OpenStack'),), (('organizationalUnitName', 'DevStack Servers'),), <etc, > | 15:15 |
| frickler | oh, do we need a platform-focal job? | 15:15 |
| frickler | dansmith: doesn't sound related | 15:15 |
| dansmith | ack, I didn't debug much, but a clean deploy and re-stack gave me the same thing | 15:15 |
| dansmith | I just keyed on openssl, carry on :) | 15:16 |
| * kopecmartin was checking the logs | 15:17 | |
| kopecmartin | frickler: i'll check into the logs later more closely | 15:17 |
| gmann | I think we should add focal platform job as we will be supporting it in testing runtime - https://review.opendev.org/c/openstack/governance/+/860599 | 15:17 |
| frickler | ah, wait we didn't switch to jammy yet, we'll need platform-focal afterwards | 15:17 |
| gmann | yeah | 15:18 |
| kopecmartin | how long do we wanna wait until we switch to jammy? | 15:18 |
| frickler | dansmith: but then focal is still our default platform, so since CI isn't completely broken, it very likely is something about your local setup | 15:19 |
| dansmith | frickler: yeah, I know we're still running focal (which is why I am) so must be, but since you mentioned some openssl thing I was hoping there was a lead already | 15:19 |
| gmann | kopecmartin: plan is to do on m-1 (Nov 18) | 15:19 |
| kopecmartin | ack | 15:19 |
| gmann | #link https://etherpad.opendev.org/p/migrate-to-jammy | 15:20 |
| kopecmartin | good, moving on | 15:21 |
| kopecmartin | #topic Sub Teams highlights | 15:21 |
| kopecmartin | Changes with Review-Priority == +1 | 15:21 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 15:21 |
| kopecmartin | one patch, already workflowed | 15:21 |
| kopecmartin | #topic Open Discussion | 15:22 |
| kopecmartin | anything for the open discussion? | 15:22 |
| dansmith | we did a bunch of DNM tests against this yesterday: https://review.opendev.org/c/openstack/devstack/+/814193 | 15:22 |
| dansmith | nova and glance are unaffected by the changes, and cinder seems good too.. no working version of that job, because devstack support is needed to even start fixing it | 15:22 |
| dansmith | frickler was +2 before a tweak, so probably an easy thing to slam in and the cinder peeps are eager to get it | 15:23 |
| frickler | I can have another look, ack | 15:23 |
| frickler | but we'll need to fix bullseye first or make it n-v | 15:24 |
| kopecmartin | yeah, i've just found a thread where someone hit the same issue with openssl | 15:28 |
| kopecmartin | seems like they only updated the version | 15:28 |
| kopecmartin | anyway, if we don't fix it soon, we can make the job n-v | 15:29 |
| kopecmartin | anything else for the open discussion? | 15:29 |
| kopecmartin | #topic Bug Triage | 15:30 |
| kopecmartin | #link https://etherpad.openstack.org/p/qa-bug-triage-antelope | 15:30 |
| kopecmartin | i've recorded the numbers although i haven't had time to triage anything | 15:30 |
| kopecmartin | that's all from my side | 15:31 |
| frickler | regarding storyboard for patrole, there is a discussion going on | 15:31 |
| kopecmartin | thank you everyone | 15:31 |
| frickler | lots of projects want to move back to LP | 15:31 |
| kopecmartin | i'm not surprised | 15:31 |
| frickler | maybe we should consider that, too? | 15:31 |
| gmann | yeah we can move to LP but patrol is almost inactive now a days | 15:32 |
| frickler | https://lists.opendev.org/pipermail/service-announce/2022-November/000048.html | 15:32 |
| gmann | I kept fixing the gate but could not get chance to do that since last cycle | 15:32 |
| frickler | should it be marked as abandoned then instead? | 15:32 |
| gmann | we can wait for this cycle and decide. | 15:33 |
| kopecmartin | we had this discussion during the previous ptg IIRC | 15:33 |
| gmann | and may be keep it in SB if we see there are high chance it will be retired | 15:33 |
| kopecmartin | and we decided to keep it around in case it would be needed for s-rbac | 15:33 |
| kopecmartin | we were hoping that someone new will start taking care of the project | 15:34 |
| kopecmartin | yeah, let's wait and discuss during the next PTG | 15:34 |
| gmann | yeah | 15:34 |
| kopecmartin | anything else? | 15:34 |
| kopecmartin | ack, see you | 15:35 |
| kopecmartin | #endmeeting | 15:35 |
| opendevmeet | Meeting ended Tue Nov 8 15:35:24 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:35 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-08-15.00.html | 15:35 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-08-15.00.txt | 15:35 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-08-15.00.log.html | 15:35 |
| gmann | thanks kopecmartin | 15:35 |
| frickler | o/ | 15:35 |
| lpiwowar | o/ | 15:37 |
| *** gthiemon1e is now known as gthiemonge | 15:43 | |
| opendevreview | Martin Kopec proposed openstack/tempest master: Exclude lengthy tests from tempest-centos9-stream-fips https://review.opendev.org/c/openstack/tempest/+/863163 | 16:17 |
| dansmith | my local stack on focal thing is fixed once I applied OS updates.. my base image was probably more than six months out of date, so I'm guessing maybe a ca-cert expiry or something | 16:37 |
| *** jpena is now known as jpena|off | 17:30 | |
| dansmith | gmann: I'm struggling with this "real image size" job.. I thought it was working, but I seem to be failing tests with volumes some of the time, I suspect perhaps due to space issues | 18:56 |
| dansmith | the last job looked like it was going to give useful data, but it timed out and thus didn't upload the logs | 18:56 |
| dansmith | is it trivial to set the timeout long on one run, or maybe timeout tempest before the build timeout so I can get logs and see what's happening? | 18:56 |
| dansmith | clarkb: maybe you have ideas ^ | 18:57 |
| dansmith | (tl;dr; running tempest with a 1G image instead of 16MiB to catch things that might fail when we're slinging real data) | 18:57 |
| clarkb | the log upload is already on a separate timeout | 18:58 |
| dansmith | this is what I got: https://zuul.opendev.org/t/openstack/build/9b7cecc382d54ae88dd1bf6ea9f64219 | 18:59 |
| dansmith | wait | 18:59 |
| clarkb | the pre-run and run portions of the job have a timeout, then the post-run has a separate timeout specifically to allow you to record logs if the early part of the job goes long | 18:59 |
| clarkb | you do have logs there | 18:59 |
| dansmith | huh, maybe I looked too quickly or something, when I checked the instant the job failed, I got a "the job has no logs" | 19:00 |
| dansmith | yeah, hrm, sorry | 19:01 |
| dansmith | like, literally was looking at "no logs", copied and pasted the url, then refreshed and .. logs | 19:05 |
| opendevreview | Merged openstack/tempest master: Fix server id reference in _rebuild_server_and_check() https://review.opendev.org/c/openstack/tempest/+/862823 | 19:22 |
| gmann | slaweq: I am facing error while creating network in new job enabling the scope and new defaults in neutron, nova side -https://review.opendev.org/c/openstack/tempest/+/614484 | 22:02 |
| gmann | slaweq: it seems Mechanism driver 'ovn' failed in create_network_postcommit - https://zuul.opendev.org/t/openstack/build/930366c016de49c4b7c26f69b371411a/log/controller/logs/screen-q-svc.txt#4406 | 22:02 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!