Tuesday, 2025-08-05

*** mhen_ is now known as mhen01:40
opendevreviewTakashi Kajinami proposed openstack/devstack master: Fix uninialized os_VENDOR  https://review.opendev.org/c/openstack/devstack/+/95648903:50
opendevreviewTakashi Kajinami proposed openstack/devstack master: Drop old libvirt group detection for Ubuntu/Debian  https://review.opendev.org/c/openstack/devstack/+/95652503:57
opendevreviewTakashi Kajinami proposed openstack/grenade master: Fix missing creator role for encrypted volume creation  https://review.opendev.org/c/openstack/grenade/+/95653607:42
opendevreviewTakashi Kajinami proposed openstack/devstack master: Drop old libvirt group detection for Ubuntu/Debian  https://review.opendev.org/c/openstack/devstack/+/95652509:13
opendevreviewTakashi Kajinami proposed openstack/grenade master: Fix missing creator role for encrypted volume creation  https://review.opendev.org/c/openstack/grenade/+/95653610:06
*** ykarel_ is now known as ykarel14:01
stephenfinsean-k-mooney: gmaan: Have you any suggested workarounds or this novnc issue, where installing python-novnc causes global venv packages to be ignore?15:35
stephenfinIt's blocking the oslo.utils gate currently https://review.opendev.org/c/openstack/oslo.utils/+/95291415:35
sean-k-mooneystephenfin: ya so the workaroudn is to swap to using the source install15:36
sean-k-mooneyi tought we did that in devstack already i think i pushed a patch for that15:37
sean-k-mooneylong term we may be able to stop using libvirt-python form the disto but that why we currently use site-packages in teh global venv15:37
gmaanI think we did it in job side but do nt know exactly maybe in destack15:37
sean-k-mooneyright i think we did it in the job not devstack15:38
stephenfinoslo.messaging is failing on the tempest-full-py3 job, which it obviously doesn't define itself. Would it make sense to change the default in DevStack if this is a consistent issue?15:39
sean-k-mooneyhttps://review.opendev.org/c/openstack/neutron/+/94856115:39
sean-k-mooneyso i fixed it in neutron15:39
sean-k-mooneyi tought i also had a devstack patch15:39
stephenfinif you do I can't see it15:39
sean-k-mooneystephenfin: we confimied it as a upstream packaging bug15:40
gmaanit was fixed it in neutron only and I think nova jobs do source install form starting15:40
gmaanbut why oslo.messaging is failing on the tempest-full-py3 job ?15:41
sean-k-mooneyso installing novnc pulls in an olde version fo oslo vis distro packages15:41
stephenfinit's pulling the import from the system rather than the venv15:41
stephenfinand therefore getting a really old version15:42
sean-k-mooneyyep wone that is now below our min requirements in many projects15:42
sean-k-mooneyits missing the image inspection code too i think15:42
stephenfinI don't understand why that is happening. In the event of a conflict between the two, the venv should always win. Or so I thought15:42
gmaanyeah15:43
sean-k-mooneysite packages has prefernce in the python path i bleive15:43
sean-k-mooneynot the other way around15:43
stephenfino rly?15:43
sean-k-mooneyi could be wrong about that but in anycase that is the workaround.15:43
sean-k-mooneywe reported it to zigo and they fixed it in debian15:44
sean-k-mooneynot sure what going to happen for ubuntu15:44
sean-k-mooneystephenfin: are ye now doign a release?15:45
sean-k-mooneythis was previosly only braking jobs that used oslo master15:45
sean-k-mooneybut i guess it makes sense that it affect more thing now 15:45
stephenfinnot yet, but the oslo.utils gate is broken15:45
stephenfinI wonder if the editable install has anything to do with it15:46
sean-k-mooneyso i dont know of a reason not to swap to source install by default15:46
sean-k-mooneywe have it in the zuul tenatnt so i cna push a patch for folks to review if you want15:47
gmaanI agree to do it as default, no objection15:47
sean-k-mooneywell or you can we just need to add novnc as a required project and flip the default then push an dnm to oslo.utils15:47
gmaanthat is what odd to do in tempest-full-py3 15:50
gmaanoh you mean in devstack here? https://github.com/openstack/devstack/blob/master/.zuul.yaml#L37215:50
sean-k-mooneyyes15:50
sean-k-mooneyalthough we coudl do it in devstack itself15:50
sean-k-mooneyand remove the overrides in devstack-base15:51
stephenfinI think there's a bug in Python, pip, or setuptools...15:51
sean-k-mooneystephenfin: maybe but you not really ment ot mix the same dep via both site pacakages and a venv like this15:51
stephenfinI have a local reproducer. The DevStack deploy fails. If I attempt to import oslo_utils in the global venv, it imports the system package15:51
sean-k-mooneycorrect15:51
sean-k-mooneythat was the issue we saw orginally15:52
stephenfinif I then re-install oslo.utils in non-editable mode, it imports the virtualenv version15:52
stephenfinfinally, if I re-re-install oslo.utils in editable mode, it goes back to importing the system package15:52
sean-k-mooneyright so the egg links are slightly diffent 15:53
sean-k-mooneybetween editblae and not15:53
sean-k-mooneyfor non editiabel we put the code dirfectly into the venv site pacakge dir15:53
sean-k-mooneyfor editable it refence where the code is15:53
sean-k-mooneyso the import logic is likely diffent15:53
stephenfinyes, but the import *behaviour* should be consistent, surely15:54
sean-k-mooneyit depend on how they specified it or if its implementation defiend15:54
sean-k-mooneygmaan: since htis also breaks locally how woudl you feel ablout updating the default in devstack and removign the overried in teh zuul jobs15:55
gmaansean-k-mooney: yeah I am ok with that. but keep the NOVNC_FROM_PACKAGE if any job want to override15:58
sean-k-mooneysure ill just change the default to false if tis not already false. i suspect it is and it just overreided in teh base job15:59
gmaanits false https://github.com/openstack/devstack/blob/c05e3f23004030035459a19d57c68e9e6fb404d2/lib/nova#L946C9-L946C2715:59
sean-k-mooneyya it is https://github.com/openstack/devstack/blob/c05e3f23004030035459a19d57c68e9e6fb404d2/lib/nova#L94616:00
gmaanwe can just remove the override from job16:00
sean-k-mooneyso if i just remove the overried in teh zuul jobs, that will fix it for oslo and most other. and any job that need it can opt back in16:00
gmaan++16:00
stephenfinI think that makes sense. Can you please add a note about why we're doing it though (and that it only affects editable installs)16:01
stephenfinI'll try draft a quick bug report for setuptools, since I think that's where the issue is16:01
sean-k-mooneyi can see if i can find the previosu bug? adn link it 16:01
sean-k-mooneystephenfin: the history is the nova novnc proxy used to actully live in the novnc package like 10 years ago16:02
sean-k-mooneyor at least they had some helper files and test utils we used16:02
sean-k-mooneyso they added a oslo dep to the novnc package but never removed it16:03
sean-k-mooneynovnc has not had any python code for 8-10 years16:03
sean-k-mooneybut it still "provieds" python3-novnc16:04
sean-k-mooneyit was completely rewrrient into javascript as part of moving to supprotign html5 16:05
zigoFYI, Trixie has the fix indeed !16:07
zigoNot sure about Ubuntu as well...16:07
sean-k-mooneyzigo: i remember you pushed a patch while on pto16:07
sean-k-mooneystephenfin: https://bugs.launchpad.net/neutron/+bug/210959216:08
zigoMaybe yeah... when I was in China last sping.16:08
sean-k-mooneythat the bug oslo.utils is on it but its still new16:08
sean-k-mooneyill reuse that for the devstack patch to maintin context16:09
opendevreviewsean mooney proposed openstack/devstack master: Use novnc from source by default  https://review.opendev.org/c/openstack/devstack/+/95659517:07
sean-k-mooneystephenfin: ^ ill push a dnm to oslo to confirm but that should resolve the issue. hopefully that is also enough context for us to remember to consider reverting this in the future if we need too.17:16
sean-k-mooneystephenfin: this is the dnm to test it https://review.opendev.org/c/openstack/oslo.utils/+/95659618:09
sean-k-mooneygmaan: where does c10s enablement stand in the qa team. i.e. devsteack adn first/third party ci vai rdo18:25
sean-k-mooneyim asking because the rdo zuul is obvirouly failing on patches to devstack18:25
sean-k-mooneyincluding on https://review.opendev.org/c/openstack/devstack/+/937251 which is adding devstack supprot for c10s 18:25
gmaanthere was some proposal on that to fix18:25
sean-k-mooneybecause of how there jobs are defiend18:25
gmaanyeah this one18:25
sean-k-mooneycorrect. so im wondering if i shoudl help...18:26
sean-k-mooneyi dont realy want to but im wondiering if i shoudl go fix the conflicitng  nodeset defintion and add novnc/novnc to the rdo tenenat definition while im at it.18:26
melwittgmaan: this tempest test about volume snapshots on stopped instance is ready for review. I made it depend on the nova fix bc I wasn't sure how that's normally handled https://review.opendev.org/c/openstack/tempest/+/95630218:27
sean-k-mooneyon one hand i dont personally care about c10s and would perfer to use rocky/almalinux 10  isntead18:27
gmaanmelwitt: ack, will check18:28
sean-k-mooneybut having failign jobs report is also annoying os im debaing if i shoud just go fix that.18:28
sean-k-mooneymelwitt: i think we normally merge the service patch first then the tempest one18:29
gmaanyeah, I think we should discuss it in PTG first, either 3rd party CI is ok or upstream18:29
sean-k-mooneyso with a depend on like you have done18:29
melwittsaweet18:30
gmaanyeah, and nova change passing CI so we are good on this order and no extra things to be done on tempest side to merge nova fix18:30
sean-k-mooneyya its its fine either way im just not sure if we have the mirror and nodepool iamge building update to the new way of doing that18:30
melwittI was thinking about your idea of configuring nfs on the hybrid plug job and changing the name. did you want to do that or did you want me to try it?18:30
sean-k-mooneyi mean if you have time go for it18:31
sean-k-mooneyi would like to do it next cycle but if you have time to do it before then then cool18:31
melwittI think it's important in the context of this bug fix, thats why I was thinking about it18:32
sean-k-mooneydoing it next cycle is just being pargmatic in that i have 2-3 things ahead of it on my mental todo list18:32
melwittok cool, maybe I'll chill then. we have nfs in the experimental queue already (I just didn't notice it before)18:33
sean-k-mooneythe ci change that is before it is i want an experimatal debian 13 job to try testing with python 3.1318:33
sean-k-mooneybasically im going to pivot https://review.opendev.org/c/openstack/nova/+/951749 to a new weekly perodic/experimetnal job for this cycle18:34
melwittah cool18:34
sean-k-mooneyand then i was considerign using the nova-alt-config or nova-goth :) to validate that next cycle when 3.13 is actully part of the testing runtime and debian trix is also added18:35
sean-k-mooneythe hybrid plug job is alreqady using debian 12 to test with spice18:35
sean-k-mooneyhench using it with debian 13 next cycle for spice and py3.13 coverage18:35
melwittmakes sense18:38
opendevreviewMerged openstack/devstack master: Fix uninialized os_VENDOR  https://review.opendev.org/c/openstack/devstack/+/95648920:13

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!