| *** soniya29|rover is now known as soniya29|rover|afk | 05:59 | |
| *** soniya29|rover|afk is now known as soniya29|rover | 07:46 | |
| *** slaweq_ is now known as slaweq | 07:57 | |
| *** jpena|off is now known as jpena | 08:21 | |
| *** soniya29|rover is now known as soniya29|rover|lunch | 08:25 | |
| *** soniya29|rover|lunch is now known as soniya29|rover | 09:22 | |
| *** akahat|ruck is now known as akahat|ruck|afk | 09:53 | |
| *** pojadhav is now known as pojadhav|dr_appt | 11:09 | |
| *** akahat|ruck|afk is now known as akahat|ruck | 11:32 | |
| opendevreview | Merged openstack/devstack master: Add RBAC scope and new defaults setting support for Nova & Tempest https://review.opendev.org/c/openstack/devstack/+/861930 | 12:17 |
|---|---|---|
| *** pojadhav|dr_appt is now known as pojadhav | 13:25 | |
| *** haleyb_ is now known as haleyb | 14:04 | |
| *** pojadhav is now known as pojadhav|dinner | 14:42 | |
| *** soniya29|rover is now known as soniya29|rover|out | 14:47 | |
| kopecmartin | #startmeeting qa | 15:00 |
| opendevmeet | Meeting started Tue Nov 15 15:00:24 2022 UTC and is due to finish in 60 minutes. The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'qa' | 15:00 |
| kopecmartin | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 15:00 |
| kopecmartin | agenda ^^^ | 15:00 |
| wxy-xiyuan | o/ | 15:01 |
| frickler | \o | 15:02 |
| kopecmartin | o/ | 15:03 |
| kopecmartin | #topic Announcement and Action Item (Optional) | 15:04 |
| kopecmartin | nothing from my side here | 15:04 |
| kopecmartin | #topic Antelope Priority Items progress | 15:04 |
| kopecmartin | #link https://etherpad.opendev.org/p/qa-antelope-priority | 15:04 |
| kopecmartin | regarding srbac | 15:05 |
| kopecmartin | gmann's patch adding enforce_scope for nova in devstack has been merged | 15:05 |
| kopecmartin | #link https://review.opendev.org/c/openstack/devstack/+/861930 | 15:05 |
| kopecmartin | and the tempest's follow up is in check gates right now | 15:07 |
| kopecmartin | #link https://review.opendev.org/c/openstack/tempest/+/614484 | 15:07 |
| kopecmartin | that's all i know for now | 15:07 |
| kopecmartin | regarding the priority items | 15:07 |
| kopecmartin | #topic OpenStack Events Updates and Planning | 15:08 |
| kopecmartin | skipping | 15:08 |
| kopecmartin | #topic Gate Status Checks | 15:08 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 15:08 |
| kopecmartin | nothing there, any urgent / gate blocking patch to review? | 15:09 |
| frickler | nope, debian got fixed, thx clarkb | 15:09 |
| kopecmartin | yeah, that's great | 15:10 |
| kopecmartin | thank you clarkb | 15:10 |
| kopecmartin | #topic Bare rechecks | 15:10 |
| kopecmartin | #link https://etherpad.opendev.org/p/recheck-weekly-summary | 15:10 |
| kopecmartin | 1 out of 5 | 15:11 |
| kopecmartin | could be worse ;) | 15:11 |
| kopecmartin | #topic Periodic jobs Status Checks | 15:11 |
| kopecmartin | stable | 15:11 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-wallaby-py3&job_name=tempest-full-victoria-py3&job_name=tempest-full-ussuri-py3&job_name=tempest-full-zed&pipeline=periodic-stable | 15:11 |
| kopecmartin | master | 15:11 |
| kopecmartin | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 15:11 |
| frickler | there was some zuul issue over the weekend, you can ignore those | 15:11 |
| kopecmartin | oh, yeah, everything is passing now | 15:12 |
| kopecmartin | devstack-no-tls-proxy failed on stable/zed | 15:12 |
| kopecmartin | it hasn't run since | 15:12 |
| * kopecmartin checking the output | 15:12 | |
| kopecmartin | time out, hopefully random | 15:13 |
| frickler | I think yoga is also still blocked by c9s, but I didn't look closer | 15:13 |
| frickler | also as discussed earlier, old stable branches are broken by nova EOL | 15:13 |
| frickler | q-r-s I think | 15:13 |
| frickler | but it seems we are fine with just waiting for devstack to become EOL, too | 15:14 |
| kopecmartin | i think so | 15:14 |
| kopecmartin | #topic Distros check | 15:15 |
| kopecmartin | cs-9 | 15:15 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=0 | 15:15 |
| kopecmartin | fedora | 15:15 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-fedora-latest&skip=0 | 15:15 |
| kopecmartin | debian | 15:15 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&skip=0 | 15:15 |
| kopecmartin | jammy | 15:15 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-ubuntu-jammy&job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=0 | 15:15 |
| kopecmartin | rocky | 15:15 |
| kopecmartin | #link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx | 15:16 |
| frickler | https://review.opendev.org/c/openstack/devstack/+/863451/ is the yoga patch I was referring to | 15:16 |
| * kopecmartin checking cs-9 on yoga | 15:16 | |
| kopecmartin | it's been a week, i'm gonna recheck and if it fails, we'll make it n-v? | 15:18 |
| kopecmartin | the cs jobs are always so volatile | 15:18 |
| frickler | ack | 15:19 |
| kopecmartin | other distros looks quite good though | 15:19 |
| kopecmartin | #topic Sub Teams highlights | 15:20 |
| kopecmartin | Changes with Review-Priority == +1 | 15:20 |
| kopecmartin | #link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 15:20 |
| kopecmartin | nothing here | 15:20 |
| kopecmartin | #topic Open Discussion | 15:20 |
| wxy-xiyuan | Hi, I'd like to say more about openEuler distro job. https://review.opendev.org/c/openstack/devstack/+/852237 | 15:20 |
| kopecmartin | sure wxy-xiyuan | 15:20 |
| wxy-xiyuan | Sorry fo late reply. I spent much time to debug the test failure, since it raise random. The behavior of the failure is that sometime the VM can't be ssh, but the state of the VM is Active and the console log looks OK. | 15:20 |
| wxy-xiyuan | frickler: kopecmartin | 15:21 |
| wxy-xiyuan | From my sight, the case is: neutron try to delete the old OVN db record of the floating ip, but there is no response of OVN, and no error raise from OVN as well. Then neutron treat it works and reuse the flaoting ip with the new VM. So the VM can't be ssh via the flaoting ip since the OVN record is not refreshed. | 15:21 |
| wxy-xiyuan | The OVN version openEuler uses is v20.06.1 from https://opendev.org/openstack/devstack/src/commit/1f5d6c0abba7c18dc809a68ed893a6e8f77b207a/lib/neutron_plugins/ovn_agent#L31 | 15:21 |
| wxy-xiyuan | Then I tried use a new version the same as devstack-platform-ubuntu-jammy-ovn-source does. https://opendev.org/openstack/devstack/src/branch/master/.zuul.yaml#L710 | 15:22 |
| frickler | that sounds like you might want to bring it up with the neutron team | 15:22 |
| wxy-xiyuan | The problem seems fixed now. Until today, daily recheck for openEuler job all runs well. | 15:22 |
| wxy-xiyuan | https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-openEuler-22.03&skip=0 | 15:22 |
| frickler | using ovn from source doesn't sound like a stable solution to me | 15:23 |
| frickler | neutron only added that option as a workaround | 15:23 |
| wxy-xiyuan | yeah, I've asked openEuler to support OVN package in next version. | 15:23 |
| wxy-xiyuan | And I just notice that devstack team seem want to switch to ovs, right? | 15:23 |
| frickler | no, that was discussed, but neutron team prefers ovn in general | 15:24 |
| wxy-xiyuan | Ok. | 15:24 |
| frickler | but I think we use ovs still for debian | 15:24 |
| frickler | so might be an option for openeuler, too | 15:24 |
| wxy-xiyuan | At least OVN works now. what's your suggestion for the next step? | 15:25 |
| wxy-xiyuan | keep rechecking to make sure it works as expect? | 15:25 |
| kopecmartin | how long till openEuler supports OVN package? | 15:26 |
| frickler | maybe you can try to add a second job that uses ovs, then we can see how both options work for a bit | 15:26 |
| kopecmartin | +1 | 15:26 |
| wxy-xiyuan | kopecmartin: the next LTS will be release in 2022.12.30 | 15:26 |
| wxy-xiyuan | frickler: sure. | 15:26 |
| kopecmartin | cool, so in the meantime let's go with frickler's suggestion | 15:27 |
| frickler | so then there is the topic of jammy migration | 15:28 |
| frickler | no progress afaict from either swift or ceph plugin | 15:28 |
| frickler | I was hoping for someone from manila to pick up the latter, but I didn't see anything yet | 15:29 |
| wxy-xiyuan | frickler: kopecmartin thanks for your reply, I'll add one later to take future watching | 15:29 |
| kopecmartin | wxy-xiyuan: thanks | 15:29 |
| kopecmartin | #link https://etherpad.opendev.org/p/migrate-to-jammy | 15:29 |
| kopecmartin | the deadline is Nov 18th | 15:29 |
| kopecmartin | so we'll just switch the jobs then ,right? | 15:29 |
| frickler | I would suggest to do that to increase the pressure, yes | 15:30 |
| kopecmartin | makes sense to me | 15:30 |
| frickler | projects can still override to focal if they think they need more time | 15:30 |
| frickler | but I'm also thinking the TC should oversee that progress | 15:31 |
| *** pojadhav|dinner is now known as pojadhav | 15:31 | |
| frickler | since after all they defined the PTI that way | 15:31 |
| *** akahat|ruck is now known as akahat|ruck|dinner | 15:31 | |
| eliadcohen | If we have time I'd like to ask for assistance on something | 15:32 |
| frickler | gmann: any other opinion? | 15:32 |
| frickler | eliadcohen: sure | 15:32 |
| eliadcohen | I'll wait on gmann , we will better wrap up current topic | 15:32 |
| kopecmartin | manila seems to wait on ceph | 15:33 |
| kopecmartin | so ceph is the blocker it seems | 15:33 |
| frickler | likely he isn't around yet, just pinged since he might answer later | 15:33 |
| kopecmartin | eliadcohen: yep, go ahead | 15:33 |
| frickler | we discussed ceph earlier, distro pkgs are there, no need to wait for IBM imo | 15:33 |
| kopecmartin | frickler: ah, ok, i didn't know that, i just went through the etherpad | 15:34 |
| frickler | eliadcohen: still around? | 15:36 |
| frickler | seems not, maybe we go on and they can ask later? | 15:38 |
| kopecmartin | sure | 15:38 |
| kopecmartin | anything else for the open discussion? | 15:38 |
| lpiwowar | nothing from my side | 15:39 |
| kopecmartin | #topic Bug Triage | 15:40 |
| kopecmartin | #link https://etherpad.openstack.org/p/qa-bug-triage-antelope | 15:40 |
| kopecmartin | numbers recorded but i haven't had time triaging | 15:40 |
| kopecmartin | shame on me | 15:40 |
| kopecmartin | :D | 15:40 |
| eliadcohen | yes sorry | 15:40 |
| kopecmartin | np, how can we help? eliadcohen | 15:40 |
| eliadcohen | Hello, I'd like to ask for a little help figuring out the Zuul errors in https://review.opendev.org/c/openstack/tempest/+/857756 | 15:40 |
| eliadcohen | (Precanned message) | 15:40 |
| eliadcohen | I'm just not clear on some of the Zuul failures around glance-multistore-cinder-import, tempest-full-test-account-py3 etc | 15:41 |
| * kopecmartin checking | 15:42 | |
| eliadcohen | Is there an easy way to figure out if mine is the breaking change? | 15:42 |
| kopecmartin | well, if the jobs pass in other jobs (jobs triggered by other patches) and the failed tests use the code you changed then probably your code caused the failure | 15:43 |
| kopecmartin | otherwise the failures are unrelated | 15:43 |
| lpiwowar | eliadcohen you can run the tox jobs locally using `tox -e py38` for example. | 15:43 |
| eliadcohen | Both make sense | 15:43 |
| eliadcohen | so lpiwowar I can run all these locally and then figure out why they fail. Now suppose it doesn't have to do anything with what I changed? | 15:44 |
| kopecmartin | the tox jobs fail on the new unit test job | 15:44 |
| kopecmartin | #link https://cbde7a5ceb90f79b264f-a3c1233a0305e644b60ccc0279f1954b.ssl.cf2.rackcdn.com/857756/8/check/openstack-tox-py310/ec918e2/testr_results.html | 15:44 |
| kopecmartin | pep8 job is complaining about the length of the lines mostly | 15:44 |
| kopecmartin | i'd start with those first | 15:45 |
| kopecmartin | the failure in glance-multistore-cinder-import seems unrelated (just at the first glance though) | 15:45 |
| lpiwowar | eliadcohen not sure I understand. You've already run the tests locally? | 15:45 |
| eliadcohen | lpiwowar, no, only a few | 15:45 |
| eliadcohen | I'll run all next | 15:46 |
| eliadcohen | Was trying to get a feel for the process | 15:46 |
| eliadcohen | ok, so I'll go at these one by one and we will take it from there offline as needed? | 15:46 |
| lpiwowar | Oh, ok I see. I agree with kopecmartin it is best to start with the pep8 errors. | 15:47 |
| kopecmartin | eliadcohen: sure, sounds like a plan | 15:47 |
| lpiwowar | eliadcohen: ok | 15:47 |
| kopecmartin | cool, anything else we can help with? | 15:47 |
| eliadcohen | That was it on my end gang, thanks! | 15:48 |
| kopecmartin | ok then, that's it from my side too | 15:48 |
| kopecmartin | unless there is anything else | 15:48 |
| kopecmartin | seems not | 15:49 |
| kopecmartin | thanks everyone | 15:49 |
| kopecmartin | #endmeeting | 15:49 |
| opendevmeet | Meeting ended Tue Nov 15 15:49:15 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:49 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-15-15.00.html | 15:49 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-15-15.00.txt | 15:49 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2022/qa.2022-11-15-15.00.log.html | 15:49 |
| lpiwowar | o/ | 15:49 |
| frickler | \o | 15:49 |
| gmann | frickler: eliadcohen kopecmartin : we will not delay migrating base job to Jammy than m-1 otherwise it will be too late for the cycle. I am opening bug for swift and ceph to track and sending another reminder to ML that it is happening on Nov 18 so fix or pin the nodeset on your failing job | 16:24 |
| kopecmartin | great , thanks gmann | 16:24 |
| *** jpena is now known as jpena|off | 17:42 | |
| opendevreview | Eliad Cohen proposed openstack/tempest master: Added funcitonality to wait for port creation https://review.opendev.org/c/openstack/tempest/+/857756 | 18:08 |
| eliadcohen | ok, fixed pep issues, reran the full test locally - passed. I am still seeing pep8 issues flagged on code that wasn't changed | 18:09 |
| eliadcohen | Waiting on Zuul with a new patchset | 18:09 |
| clarkb | eliadcohen: the pep8 job shows you a diff of what exactly you need to change | 18:19 |
| eliadcohen | clarkb, yes that was super-usefull. I followed it. What do we do when it is code that wasn't changed with this review? Do we change it? | 18:20 |
| clarkb | eliadcohen: well you did change it. Your code lacks extra newlines that pep8 wants around the function you added. I'm not sure about the other stuff it is complaining about. It might be some sort of system that ignores errors until someone edits the file then the entire file needs to be fixed? | 18:21 |
| eliadcohen | I don't know... maybe? do I need to recheck to kick the zuul jobs again? I'll take another look at those pep8 diffs, maybe I missed something that was part of my change | 18:23 |
| clarkb | eliadcohen: yes, there are two newlines it wants you to add to what yu changed. https://zuul.opendev.org/t/openstack/build/392ee76580834a408575c77f2ac4f0e1/log/job-output.txt#1025 and https://zuul.opendev.org/t/openstack/build/392ee76580834a408575c77f2ac4f0e1/log/job-output.txt#1033 | 18:24 |
| eliadcohen | oh! | 18:25 |
| clarkb | pushing a new patchste for that will rerun jobs. If that continues to fail with the bits from https://zuul.opendev.org/t/openstack/build/392ee76580834a408575c77f2ac4f0e1/log/job-output.txt#1043-1070 then I suspect this is a cse where any changes to a file are expected to bring that file into compliance | 18:25 |
| eliadcohen | Thank you so much clarkb++ | 18:26 |
| *** akahat|ruck|dinner is now known as akahat|ruck | 18:31 | |
| opendevreview | Ghanshyam proposed openstack/tempest master: Add new tempest job enable the rbac scope checks and new defaults https://review.opendev.org/c/openstack/tempest/+/614484 | 18:46 |
| opendevreview | Eliad Cohen proposed openstack/tempest master: Added funcitonality to wait for port creation https://review.opendev.org/c/openstack/tempest/+/857756 | 18:48 |
| opendevreview | Ghanshyam proposed openstack/tempest master: DNM: Test RBAC Nova service role https://review.opendev.org/c/openstack/tempest/+/864595 | 23:51 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!