| *** ykarel_ is now known as ykarel | 05:04 | |
| opendevreview | Dr. Jens Harbott proposed openstack/devstack master: DNM: test reqs change https://review.opendev.org/c/openstack/devstack/+/988408 | 09:18 |
|---|---|---|
| opendevreview | Francesco Pantano proposed openstack/devstack-plugin-ceph master: Separate replicated and erasure coded pool handling in cephadm https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/966014 | 12:50 |
| opendevreview | Ghanshyam Maan proposed openstack/devstack master: Set password regex for security compliance https://review.opendev.org/c/openstack/devstack/+/957969 | 13:57 |
| *** haleyb is now known as haleyb|away | 14:20 | |
| sean-k-mooney | frickler: fungi gmaan ment to chat about ubuntu 26.04 here | 14:47 |
| sean-k-mooney | so with https://termbin.com/zu13 | 14:47 |
| sean-k-mooney | i can stack and tempst smoke is runnign and so far passing | 14:47 |
| sean-k-mooney | ill add a new job definition to that and push it once this local run is complete | 14:48 |
| sean-k-mooney | } tempest.scenario.test_dashboard_basic_ops.TestDashboardBasicOps.test_basic_scenario [2.939141s] ... FAILED is sofar thte ifrst test to fail with a 500 form horizon | 14:48 |
| sean-k-mooney | well maybe not | 14:49 |
| sean-k-mooney | ill check the service logs after | 14:49 |
| sean-k-mooney | ok so ya 90 passes 6 skips and 1 failure form tempest smoke | 14:50 |
| sean-k-mooney | 2026-05-13 14:48:07.487533 File "/opt/stack/data/venv/lib/python3.14/site-packages/django/template/context.py", line 39, in __copy__ | 14:51 |
| sean-k-mooney | 2026-05-13 14:48:07.487534 duplicate.dicts = self.dicts[:] | 14:51 |
| sean-k-mooney | 2026-05-13 14:48:07.487537 ^^^^^^^^^^^^^^^ | 14:51 |
| sean-k-mooney | 2026-05-13 14:48:07.487538 AttributeError: 'super' object has no attribute 'dicts' and no __dict__ for setting new attributes | 14:51 |
| sean-k-mooney | so that the horizon error which is perhaps a django issue | 14:51 |
| frickler | sean-k-mooney: we bumped sphinx in u-c earlier today, can you check which version you have there? might be not related to py3.14 at all | 14:56 |
| sean-k-mooney | sure | 14:57 |
| frickler | actually we might need even newer sphinx for that https://forum.djangoproject.com/t/which-versions-of-django-will-support-python-3-14/43005 | 14:58 |
| sean-k-mooney | this is hte pip freesze for the devstack venv https://termbin.com/2dwi | 14:58 |
| sean-k-mooney | Django==4.2.30 | 14:59 |
| sean-k-mooney | django-appconf==1.2.0 | 14:59 |
| sean-k-mooney | django-debreach==2.1.0 | 14:59 |
| sean-k-mooney | django_compressor==4.6.0 | 14:59 |
| sean-k-mooney | we do not use sphinx in horzon at runtime right? | 14:59 |
| sean-k-mooney | so ok this is still using django 4 | 14:59 |
| sean-k-mooney | we likely need to use 5.2 | 15:00 |
| frickler | ah, right, I mixed these up | 15:00 |
| sean-k-mooney | so i can try redeploying with that | 15:00 |
| frickler | then you can check https://review.opendev.org/c/openstack/requirements/+/979862 and install that version manually for testing | 15:00 |
| sean-k-mooney | yep im going to commit my local change and push them to the gate to get some ci results | 15:01 |
| sean-k-mooney | but i can restack with taht locally and see what happens | 15:01 |
| sean-k-mooney | there are a couple of other things that are not quite right | 15:02 |
| sean-k-mooney | Time spent in the background minus waits: 3521789902952836 sec | 15:02 |
| sean-k-mooney | Elapsed time: 615 sec | 15:02 |
| sean-k-mooney | Time if we did everything serially: 3521789902953451 sec | 15:02 |
| sean-k-mooney | Speedup: 5.72649e+12 | 15:02 |
| sean-k-mooney | because well its defintly not that much faster | 15:02 |
| frickler | wow, that's impressive. dansmith would be proud ;) | 15:02 |
| dansmith | o.O | 15:07 |
| opendevreview | sean mooney proposed openstack/devstack master: add support for ubuntu 26.04 https://review.opendev.org/c/openstack/devstack/+/988482 | 15:26 |
| sean-k-mooney | frickler: hum devstack-platform-ubuntu-noble is apprently missing | 15:31 |
| sean-k-mooney | ok so https://review.opendev.org/c/openstack/devstack/+/931697/1/.zuul.yaml#b737 broke it | 15:38 |
| opendevreview | sean mooney proposed openstack/devstack master: add support for ubuntu 26.04 https://review.opendev.org/c/openstack/devstack/+/988482 | 15:41 |
| sean-k-mooney | Ran: 1364 tests in 3154.3234 sec. | 15:49 |
| sean-k-mooney | - Passed: 1155 | 15:49 |
| sean-k-mooney | - Skipped: 150 | 15:49 |
| sean-k-mooney | - Expected Fail: 0 | 15:49 |
| sean-k-mooney | - Unexpected Success: 0 | 15:49 |
| sean-k-mooney | - Failed: 59 | 15:49 |
| sean-k-mooney | Sum of execute time for each test: 8642.7657 sec. | 15:49 |
| sean-k-mooney | thats tempest full ish | 15:49 |
| sean-k-mooney | ah OOM killer triggers | 15:50 |
| sean-k-mooney | ya if oom nova-compute i woudl expect some failures | 15:50 |
| sean-k-mooney | (venv) sean@devstack-2604:~/repo/devstack$ free -m | 15:51 |
| sean-k-mooney | total used free shared buff/cache available | 15:51 |
| sean-k-mooney | Mem: 9419 8440 433 12 881 978 | 15:51 |
| sean-k-mooney | Swap: 4095 3894 201 | 15:51 |
| sean-k-mooney | that more then i woudl typiclly expect but then again we normally hvae 8 gigs of swap and i didnt turn on zswap either | 15:51 |
| sean-k-mooney | wigh concrancey 4 i was proably pusshign it a bit too hard | 15:52 |
| sean-k-mooney | ok ya so the resolute job is fialing because of the lack of mirrors ill quickly overried those to use upstream for now | 15:54 |
| opendevreview | sean mooney proposed openstack/devstack master: add support for ubuntu 26.04 https://review.opendev.org/c/openstack/devstack/+/988482 | 16:00 |
| sean-k-mooney | ok that shoudl also workaorund the lack of mirrors ill let that run to completion to make sure it does not regress any of the other distos adn check back | 16:01 |
| sean-k-mooney | that has a depend on against the django verison bump as well so we can see if that fixes horizon | 16:02 |
| sean-k-mooney | ah failed on setting /sys/module/zswap/parameters/zpool that is optinal when usign zswap and we dotn actully need to oride the defautl really | 16:33 |
| sean-k-mooney | frickler: i had to rebase it locally but with django 5.2 i can deploy horizon fine and it appears to be working | 17:29 |
| sean-k-mooney | i have some local fixes for the other issues too | 17:29 |
| sean-k-mooney | basiclly hardernign the sysfs tuning | 17:31 |
| sean-k-mooney | so once the ci reporst back ill push those | 17:31 |
| opendevreview | melanie witt proposed openstack/tempest master: Add test for resize revert with encrypted Cinder volume https://review.opendev.org/c/openstack/tempest/+/961756 | 17:39 |
| gmaan | #startmeeting qa | 18:00 |
| opendevmeet | Meeting started Wed May 13 18:00:41 2026 UTC and is due to finish in 60 minutes. The chair is gmaan. Information about MeetBot at http://wiki.debian.org/MeetBot. | 18:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 18:00 |
| opendevmeet | The meeting name has been set to 'qa' | 18:00 |
| gmaan | today agenda | 18:01 |
| gmaan | #link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours | 18:01 |
| gmaan | who all here today | 18:01 |
| manpreetk | Hi | 18:01 |
| ashigupt | o/ | 18:01 |
| sean-k-mooney | o/ | 18:01 |
| gmaan | let's start | 18:03 |
| gmaan | #topic Announcement and Action Item (Optional) | 18:03 |
| gmaan | 1 action item from previous meeting | 18:03 |
| gmaan | abongale to look into the failing stable/2026.1 devstack-platform-rocky-blue-onyx | 18:03 |
| gmaan | I think he has patch up, let me fdins | 18:04 |
| gmaan | find | 18:04 |
| gmaan | #link https://review.opendev.org/c/openstack/devstack/+/986348 | 18:05 |
| gmaan | this one, i commented on that and it is in WIP now | 18:05 |
| gmaan | so will continue it as action item | 18:05 |
| gmaan | #action abongale to look into the failing stable/2026.1 devstack-platform-rocky-blue-onyx https://review.opendev.org/c/openstack/devstack/+/986348 | 18:06 |
| gmaan | #topic Priority Items progress | 18:06 |
| gmaan | #link https://etherpad.opendev.org/p/qa-2026-2-priority | 18:06 |
| gmaan | I did not get much progress on reewing the RBAC tetsing changes | 18:06 |
| gmaan | but pre provisioed creds job fixes are merged and job is green. I have to skip one or two quota test for swift in that | 18:07 |
| gmaan | I am tracking that as a sepatrate bug | 18:07 |
| gmaan | but I will close the item in etherpad 'Make pre-provisioned credentials stable again' | 18:07 |
| gmaan | anything else on priority items? | 18:08 |
| gmaan | also feel free to propose the item in priority etherpad and we can discuss it in QA office hour to track it properly. | 18:09 |
| gmaan | skipping OpenStack Events Updates and Planning (Optional) | 18:09 |
| gmaan | #topic Gate Status / Blocker Fix / Urgent Change | 18:09 |
| gmaan | #link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade) | 18:09 |
| gmaan | nothing new on the gate blocker or urgent review | 18:09 |
| gmaan | stable/2026.1 devstack platform jobs failing | 18:10 |
| gmaan | #link https://zuul.opendev.org/t/openstack/build/0b9e8482902c48f5a08379acd5286278/log/controller/logs/devstacklog.txt#1679 | 18:10 |
| gmaan | this we already discussed as part of previous meeting action item | 18:10 |
| gmaan | and abongale is working on it | 18:11 |
| gmaan | #topic Priority Review | 18:11 |
| gmaan | #link https://review.opendev.org/q/label:Review-Priority%3D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/devstack+OR+project:openstack/grenade) | 18:11 |
| sean-k-mooney | 18:11 | |
| gmaan | nothing pending on review side except one | 18:11 |
| gmaan | #link https://review.opendev.org/c/openstack/tempest/+/957612 | 18:11 |
| gmaan | I will check it after meeting | 18:12 |
| gmaan | sean-k-mooney: anything you wanted to write? i saw empty msg | 18:12 |
| sean-k-mooney | it can wait | 18:12 |
| gmaan | k | 18:12 |
| sean-k-mooney | i was clicking on the links | 18:12 |
| gmaan | #topic Periodic jobs Status Checks | 18:13 |
| gmaan | let's finish the periodic checks first | 18:13 |
| gmaan | Periodic Master jobs: | 18:13 |
| gmaan | #link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic | 18:13 |
| gmaan | account no admin job failing, I will check it after meeting, as account job is voting in tempest we should make it voting also instead of periodic | 18:14 |
| gmaan | #action move tempest-full-test-account-no-admin-py3 and other pre-prpvosioned account jobs as voting | 18:14 |
| gmaan | #undo | 18:14 |
| opendevmeet | Removing item from minutes: #action move tempest-full-test-account-no-admin-py3 and other pre-prpvosioned account jobs as voting | 18:14 |
| gmaan | #action gmaan to move tempest-full-test-account-no-admin-py3 and other pre-prpvosioned account jobs as voting | 18:15 |
| gmaan | Periodic Stable jobs: | 18:15 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-2024-2&job_name=tempest-full-2025-1&job_name=tempest-full-2025-2&job_name=tempest-full-2026-1&pipeline=periodic-stable&skip=0 | 18:15 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-slow-2024-2&job_name=tempest-slow-2025-1&job_name=tempest-slow-2025-2&job_name=tempest-slow-2026-1&skip=0 | 18:15 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-multinode-2025-1&job_name=tempest-multinode-2025-2&job_name=tempest-multinode-2024-2&job_name=tempest-multinode-2026-1&pipeline=periodic-stable&skip=0 | 18:16 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-2024-2-extra-tests&job_name=tempest-full-2025-1-extra-tests&job_name=tempest-full-2025-2-extra-tests&job_name=tempest-full-2026-1-extra-tests&pipeline=periodic-stable&skip=0 | 18:16 |
| gmaan | all green | 18:16 |
| gmaan | one news on that is as 2024.2 is EOL, tempest has stopped testing/supporting it | 18:16 |
| gmaan | also in tempest plugins, and releasing the 2024.2-last tag for that | 18:17 |
| gmaan | #link https://review.opendev.org/q/topic:%222024-2-last%22 | 18:17 |
| gmaan | I will remove this branch jobs from the meeting links also | 18:17 |
| gmaan | #topic Distros check: | 18:17 |
| gmaan | Centos | 18:17 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&job_name=devstack-platform-centos-10-stream&skip=0 | 18:18 |
| gmaan | recent run pass | 18:18 |
| gmaan | Rocky Linux | 18:18 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx&job_name=tempest-full-rocky&skip=0 | 18:18 |
| gmaan | same | 18:18 |
| gmaan | Ubuntu | 18:18 |
| gmaan | #link https://zuul.openstack.org/builds?job_name=devstack-platform-ubuntu-noble-ovn-source&job_name=devstack-platform-ubuntu-noble-ovs&job_name=devstack-platform-ubuntu-jammy&skip=0 | 18:18 |
| gmaan | same | 18:18 |
| gmaan | #topic Bugs: | 18:19 |
| gmaan | #link https://etherpad.opendev.org/p/qa-bug-triage-and-fix | 18:19 |
| gmaan | nothing on etherpad to discuss | 18:19 |
| gmaan | #topic Open Discussion | 18:19 |
| gmaan | nothing on agenda | 18:19 |
| gmaan | sean-k-mooney: go ahead | 18:19 |
| gmaan | maybe you would like to bring ubuntu 26.04 or something else? | 18:19 |
| sean-k-mooney | cool so i got devstack working on ubuntu 26.04 today | 18:20 |
| sean-k-mooney | i haveone or two other local change that ill push shortly | 18:20 |
| sean-k-mooney | but for the most part thigns appear to work | 18:20 |
| sean-k-mooney | nova's proxies failed but that exepcted because i didnt swap them too threaded mode | 18:20 |
| sean-k-mooney | horizon failed | 18:20 |
| sean-k-mooney | but it work when we bump | 18:20 |
| sean-k-mooney | to django 5.2 | 18:21 |
| sean-k-mooney | the mirrors failed in the job but i have an overeid for that | 18:21 |
| sean-k-mooney | and the mirror setup is happing in parallel | 18:21 |
| sean-k-mooney | so im expecting we can have this workign in the next week or so | 18:21 |
| gmaan | great, thanks for working on it. i read the chat but a few questions | 18:21 |
| gmaan | 'nova's proxies failed but that exepcted because i didnt swap them too threaded mode' | 18:21 |
| gmaan | is it not working on eventlet mode? | 18:22 |
| sean-k-mooney | no on python 3.14 | 18:22 |
| gmaan | oh its py3.14 there. got it | 18:22 |
| sean-k-mooney | until kamil revers fork/spawn | 18:22 |
| sean-k-mooney | ya | 18:22 |
| gmaan | ++ on running it in threading mode | 18:22 |
| sean-k-mooney | so once that fix merges they shoudl be fine | 18:22 |
| sean-k-mooney | im just using the default for the moment | 18:23 |
| sean-k-mooney | and those default to eventlet today | 18:23 |
| gmaan | yeah | 18:23 |
| sean-k-mooney | but the rest of nova worked because the rest of nova is already moved | 18:23 |
| gmaan | yeah | 18:23 |
| gmaan | ' django 5.2': that u-c is bumped for that right? | 18:23 |
| sean-k-mooney | any thing else you wanted to know? | 18:23 |
| sean-k-mooney | ya so there is a patch for that | 18:23 |
| sean-k-mooney | but its not merged yet | 18:24 |
| sean-k-mooney | i rebased it locally and restacked and horizon seam tobe workign fine | 18:24 |
| gmaan | cool, it is fine as long as patch is up | 18:24 |
| gmaan | cool. thanks again nothing else from me on 26.04. I will check the changes | 18:24 |
| sean-k-mooney | i have a depens on form the devstack patch to the requriements bump | 18:24 |
| gmaan | ++ | 18:24 |
| sean-k-mooney | ill likely update it in a few minutes after the meeting | 18:25 |
| sean-k-mooney | i was just waitign for the full ci to report back before doing it | 18:25 |
| gmaan | no hurry | 18:25 |
| gmaan | manpreetk: ashigupt anything else you would like to bring today? other than RBAC test changes review which is already in my list | 18:26 |
| manpreetk | gmaan: Nothing from my side. | 18:26 |
| ashigupt | nothing from me as well | 18:26 |
| gmaan | sean-k-mooney: anything else from you? | 18:27 |
| sean-k-mooney | nope | 18:27 |
| gmaan | ok, let's close. thanks everyone for joining | 18:27 |
| gmaan | #endmeeting | 18:27 |
| opendevmeet | Meeting ended Wed May 13 18:27:31 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 18:27 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/qa/2026/qa.2026-05-13-18.00.html | 18:27 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/qa/2026/qa.2026-05-13-18.00.txt | 18:27 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/qa/2026/qa.2026-05-13-18.00.log.html | 18:27 |
| manpreetk | Thanks, Bye! | 18:27 |
| opendevreview | sean mooney proposed openstack/devstack master: add support for ubuntu 26.04 https://review.opendev.org/c/openstack/devstack/+/988482 | 18:37 |
| opendevreview | Ghanshyam Maan proposed openstack/tempest master: Add 43.3.0 release notes page https://review.opendev.org/c/openstack/tempest/+/988531 | 18:53 |
| opendevreview | Ghanshyam Maan proposed openstack/tempest master: Update ImageQuotaTest with force_tenant_isolation https://review.opendev.org/c/openstack/tempest/+/988532 | 19:02 |
| opendevreview | Ghanshyam Maan proposed openstack/tempest master: Update ImageQuotaTest with force_tenant_isolation https://review.opendev.org/c/openstack/tempest/+/988532 | 19:03 |
| opendevreview | Ghanshyam Maan proposed openstack/tempest master: Update ImageQuotaTest with force_tenant_isolation https://review.opendev.org/c/openstack/tempest/+/988532 | 19:04 |
| sean-k-mooney | frickler: gibi so whiel i was workign on makign devstack work on 26.04 i also made my pci kernel module work with ubuntu 26.04, refactored it to be an external built agaisnt the runnign kernel adn wrpat it all up in a devtack plugin that builds, it injects it and configure nova and or cybort to use it automaticlly | 20:35 |
| sean-k-mooney | https://github.com/SeanMooney/cyborg-extra | 20:35 |
| sean-k-mooney | i need to clen that up a bit more but ill proably go thought the project recation flow and hook this into ci once the devstack supprot it depends on is in place. | 20:39 |
| sean-k-mooney | i have tested this breifly vai https://github.com/SeanMooney/cyborg-extra/blob/master/tools/run-devstack-serial-echo-test.sh and confirmed that i cna boot nova and cybrog isnttances with these fake pci device vfs | 20:39 |
| melwitt | looks like openstac-tox-docs on Tempest is failing with " File "/usr/lib/python3.12/pdb.py", line 215, in <module> | 20:46 |
| melwitt | class Pdb(bdb.Bdb, cmd.Cmd): | 20:46 |
| melwitt | ^^^^^^^ | 20:46 |
| melwitt | AttributeError: module 'cmd' has no attribute 'Cmd'" | 20:46 |
| melwitt | https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-docs&project=openstack/tempest | 20:46 |
| clarkb | melwitt: https://github.com/python/cpython/blob/3.12/Lib/pdb.py#L74 is where cmd appears to be imported. Is it possible there is another module called cmd creating a conflict? | 20:51 |
| clarkb | for example tempest/cmd | 20:51 |
| clarkb | I wonder what is triggering it though. Its a docs build odd to be going through pdb | 20:52 |
| melwitt | it appears to be coming from sphinx | 20:52 |
| melwitt | https://zuul.opendev.org/t/openstack/build/82361697824f43bfa286ae80a6318fe3/log/job-output.txt#1785-1834 | 20:52 |
| clarkb | sphinx 9.0.4 was updated recently via https://review.opendev.org/c/openstack/requirements/+/987973 | 20:54 |
| clarkb | maybe new sphinx imports tempest/cmd in a way that breaks the pdb import? | 20:55 |
| clarkb | `sys.path.insert(0, os.path.abspath('../../tempest'))` that may do it | 20:55 |
| clarkb | https://opendev.org/openstack/tempest/src/branch/master/doc/source/conf.py#L43-L48 | 20:56 |
| clarkb | looking at the docs all of the automodule directives seem to use tempest.foo | 20:59 |
| clarkb | I suspect that we are installing tempest into the normal python path and maybe those pathing directives are completely unnecessary? | 20:59 |
| clarkb | https://zuul.opendev.org/t/openstack/build/82361697824f43bfa286ae80a6318fe3/log/job-output.txt#1303 ya I think that is what is happening | 21:00 |
| clarkb | I have to run out for an errand but I would try dropping that from the sphinx conf.py | 21:01 |
| clarkb | (I was worreid for a minute that maybe the ubuntu package mirror updates we were doing pulled in some package that may have broken things) | 21:01 |
| melwitt | thank you clarkb !! | 22:06 |
| melwitt | gmaan: for your awareness ^ and cc stephenfin for the sphinx expertise | 22:07 |
| JayF | I'll note I've had unrelated docs-build-breakage today caused by the new oslo.versionedobjects, if anyone sees that in their repo https://review.opendev.org/c/openstack/ironic/+/988538 can get you unstuck. (I think there's an oslo-side fix that could work, but I am not worried about if type hints are rendered into autodocs. I'm not sure anyone uses autodocs at all.) | 22:08 |
| melwitt | thanks JayF | 22:38 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!