Wednesday, 2023-11-08

opendevreviewOpenStack Proposal Bot proposed openstack/devstack master: Updated from generate-devstack-plugins-list  https://review.opendev.org/c/openstack/devstack/+/90038803:04
opendevreviewyatin proposed openstack/devstack master: [DNM] Debug osc keyring issue #2042943  https://review.opendev.org/c/openstack/devstack/+/90039508:00
opendevreviewLuigi Dino Tamagnone proposed openstack/tempest master: Adding a new config option in tempest.conf as the prefix for the random name resources  https://review.opendev.org/c/openstack/tempest/+/89723109:18
opendevreviewsean mooney proposed openstack/devstack master: add support for zswap and ksmtuned  https://review.opendev.org/c/openstack/devstack/+/89069312:52
opendevreviewsean mooney proposed openstack/devstack master: add support for zswap and ksmtuned  https://review.opendev.org/c/openstack/devstack/+/89069312:56
opendevreviewLuigi Dino Tamagnone proposed openstack/tempest master: Adding a new config option in tempest.conf as the prefix for the random name resources  https://review.opendev.org/c/openstack/tempest/+/89723113:06
sean-k-mooneyclarkb: stephenfin ....13:08
sean-k-mooneyso13:09
sean-k-mooneywith the new pbr release we nolonge rseam to be gettign the warnign about not supportign editbale installs13:09
sean-k-mooneybut its also not producing the wsgi files13:10
sean-k-mooneyso the tox envs are now passing but tempest is now failing13:11
sean-k-mooneyif i do ../.venv-test/bin/python -m  build --wheel ../13:14
sean-k-mooneyform a temp build subdir in nova13:14
sean-k-mooneywith my pyproject.toml change13:14
sean-k-mooneyi see 13:15
sean-k-mooneyadding 'nova-28.1.0.dev39.data/scripts/nova-api-wsgi'13:15
sean-k-mooneyadding 'nova-28.1.0.dev39.data/scripts/nova-metadata-wsgi'13:15
sean-k-mooneyso they are being added to the wheel13:15
sean-k-mooneyso im wondering if the location they are being installed into has changed or something like that13:16
sean-k-mooneylib/python3.11/site-packages/nova-28.1.0.dev39.dist-info/RECORD  in the vnev has the console scripts but not the wsgi scripts13:22
sean-k-mooneyhttps://termbin.com/7u6413:22
stephenfinIn case it's useful, I added a debugging utility to the pyproject_api package, which is another implementation of the PEPs (used by tox)13:26
stephenfinhttps://github.com/tox-dev/pyproject-api/commit/1a95eccb73940990fb058d76be9d2cf5019951e113:26
sean-k-mooneyim currently catureing verbose install logs ill post them shortly13:28
sean-k-mooneythe right versions of pbr are being used but its not cleare why the gap is13:28
sean-k-mooneyhttps://termbin.com/sp7a13:28
sean-k-mooneyhum that not very useful13:30
sean-k-mooneyi also apprently did not properly redirect all out put so ill try that agin13:31
sean-k-mooneyhum no i used  2>&113:31
stephenfinsean-k-mooney: if I do `pip install --no-build-isolation -e .` from the nova repo with your change and a venv that already has the latest pbr, setuptools and pip, I see the wsgi scripts present in `.venv/bin`13:32
sean-k-mooneyim doing it in a clean venv13:32
stephenfinactually, no I don't. damn13:32
stephenfinnova-api- != nova-api-wsgi13:32
sean-k-mooneyyep13:33
sean-k-mooneythe first is the console script 13:33
fricklerwhich distro is this? iirc kopecmartin once found the wsgi scripts in ~/.local somewhere instead of in the venv13:34
stephenfinDebian for sean-k-mooney presumably. Fedora for me13:35
sean-k-mooneydebina sid ya currently13:35
sean-k-mooneythis is failing in the ubuntu 22.04 ci jobs13:35
stephenfinThis is all stemming from our attempts to add pyproject.toml files13:35
sean-k-mooneyalthough i think right now this might only be failingin on the patches adding pyproject.toml13:36
sean-k-mooneyok redirect is working now i can give better logs13:36
sean-k-mooneywe are still showign some warnings13:36
sean-k-mooneyhttps://termbin.com/7oju13:37
sean-k-mooneyim wondiering if its related to the wsgi files being consider data files?13:38
stephenfin:( https://github.com/pypa/setuptools/blob/main/setuptools/config/pyprojecttoml.py#L338-L33913:40
sean-k-mooneydont we override that13:42
stephenfinSo setuptools has special code to handle console_scripts. My random guess is the old stuff where we wrap distutils methods is no longer used with the pyproject stuff 13:42
stephenfini.e. this https://opendev.org/openstack/pbr/src/branch/master/pbr/packaging.py#L45813:43
sean-k-mooneyright i dont think dist utils is used any more13:43
sean-k-mooney yes13:43
sean-k-mooneythat is why we went down the the pyproject.toml approch13:43
stephenfinThis is starting to feel like a lot of work to fix13:43
sean-k-mooneythat was the first ting if found. i.e. that was not being called13:44
sean-k-mooneyits not being installed because we are now buildign the wheel13:44
sean-k-mooneyand then installign that wheel instead of doing a local install13:44
stephenfinwell we're building an editable wheel, which is different13:45
sean-k-mooneyi orgianlly tried to fix it by removign this if https://opendev.org/openstack/pbr/src/branch/master/pbr/packaging.py#L49313:45
sean-k-mooneyso before the editibale patch 13:45
sean-k-mooneythe wheel we were building was being installe in editbale mode properly 13:45
sean-k-mooneyon most envs13:45
sean-k-mooneyjust not when using a non default python version13:46
sean-k-mooneywe likely need to exiplictly loop over the wsgi_scripts13:46
sean-k-mooneyand install them ourselves in pbr13:46
sean-k-mooney 13:49
sean-k-mooneycan we overriede _obtain_entry_points13:49
stephenfinWe can, but they have a big warning at the top of the file indicating that it's private13:51
stephenfinwhich means that's not going to be a stable target13:51
stephenfindon't fancy building our house on sand13:51
sean-k-mooneywell wsgi_scripts is a pbr extention13:51
sean-k-mooneynot a facilaty provided by setup tools13:51
sean-k-mooneyso we need to figure out how we want to supprot that13:52
sean-k-mooneyits understandable that setup tools woudl not handel somethign we are suporting as a feature of pbr13:53
sean-k-mooneybut im not sure if the issue is with the wheel buildign or the wheel install13:54
sean-k-mooneyso the editable wheel that is built by pip just has https://termbin.com/eqsf14:25
sean-k-mooneywhich is fine but the issue is that nothing is actully generating and installing the wsgi_scripts in that case14:26
sean-k-mooneywhere as without the editable support we were buildign a normal wheel and then the fall back was installing that and overlaying the editable whel fiels after14:26
opendevreviewAshley Rodriguez proposed openstack/devstack-plugin-ceph master: [WIP] Add ingress deamon  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/90034814:26
sean-k-mooneyfrickler: clarkb  any ideas how to make pbr do that or any suggestings as to how to adress this?14:27
sean-k-mooneyi think that is what https://opendev.org/openstack/pbr/src/branch/master/pbr/packaging.py#L493-L498 was prehasp trying to do before 14:28
sean-k-mooneyya it is14:29
sean-k-mooneyhttps://opendev.org/openstack/pbr/src/branch/master/pbr/packaging.py#L462-L47214:29
opendevreviewJames Parker proposed openstack/whitebox-tempest-plugin master: [WIP] Add global nodes variable  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/88490314:34
dansmithkopecmartin: gmann: frickler: this fixes a sporadic failure in one of our grenade jobs due to one node not having all the services we actually need: https://review.opendev.org/c/openstack/grenade/+/90025714:37
sean-k-mooneyperhaps we need to implement https://github.com/abravalheri/setuptools/blob/main/setuptools/_distutils/command/build_scripts.py14:46
opendevreviewLuigi Dino Tamagnone proposed openstack/tempest master: Adding a new config option in tempest.conf as the prefix for the random name resources  https://review.opendev.org/c/openstack/tempest/+/89723115:49
opendevreviewJakub Skunda proposed openstack/tempest master: Add scenario test: test instances with cinder volumes  https://review.opendev.org/c/openstack/tempest/+/89873216:56
kopecmartin#startmeeting qa17:00
opendevmeetMeeting started Wed Nov  8 17:00:16 2023 UTC and is due to finish in 60 minutes.  The chair is kopecmartin. Information about MeetBot at http://wiki.debian.org/MeetBot.17:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.17:00
opendevmeetThe meeting name has been set to 'qa'17:00
kopecmartin#link https://wiki.openstack.org/wiki/Meetings/QATeamMeeting#Agenda_for_next_Office_hours17:00
lpiwowaro/17:01
kopecmartino/17:01
kopecmartin#topic Announcement and Action Item (Optional)17:01
kopecmartinwe have a new schedule of office hour17:01
kopecmartinit's gonna alternate, odd weeks Wednesdays at 17:00 UTC (like today)17:02
kopecmartineven weeks Tuesdays at 15:00 UTC (practically as before)17:02
kopecmartinthe reason is to accommodate multiple time zones 17:02
lpiwowar+1 17:02
kopecmartin#topic Caracal Priority Items progress17:03
kopecmartin#link https://etherpad.opendev.org/p/qa-caracal-priority17:03
kopecmartin^^ the priority etherpad for this cycle17:03
kopecmartinall unfinished items from previous etherpad were copied to this one17:03
kopecmartin#topic OpenStack Events Updates and Planning17:04
kopecmartinwe had a virtual PTG 2 weeks ago17:04
kopecmartinagenda:17:04
kopecmartin#link https://etherpad.opendev.org/p/oct2023-ptg-qa17:04
kopecmartina summary was also sent to the ML17:06
kopecmartin#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/WTWU6N77AQS7QHAI6EDD5SHNRNZE4VH6/17:06
kopecmartin#topic Gate Status Checks17:07
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B2+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)17:07
kopecmartinany urgent reviews?17:07
kopecmartin#topic Sub Teams highlights17:08
kopecmartinChanges with Review-Priority == +117:08
kopecmartin#link https://review.opendev.org/q/label:Review-Priority%253D%252B1+status:open+(project:openstack/tempest+OR+project:openstack/patrole+OR+project:openstack/devstack+OR+project:openstack/grenade)17:08
kopecmartinone priority patch17:08
kopecmartinalready workflowed 17:08
kopecmartinlet's get to usual, jobs status17:09
kopecmartin#topic Periodic jobs Status Checks17:09
kopecmartinperiodic stable full17:09
kopecmartin#link https://zuul.openstack.org/builds?pipeline=periodic-stable&job_name=tempest-full-yoga&job_name=tempest-full-xena&job_name=tempest-full-zed&job_name=tempest-full-2023-1&job_name=tempest-full-2023-217:09
kopecmartinperiodic stable slow17:09
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-slow-2023-2&jjob_name=tempest-slow-2023-1&job_name=tempest-slow-zed&job_name=tempest-slow-yoga&job_name=tempest-slow-xena17:09
kopecmartinperiodic extra tests17:09
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-2023-2-extra-tests&job_name=tempest-full-2023-1-extra-tests&job_name=tempest-full-zed-extra-tests&job_name=tempest-full-yoga-extra-tests&job_name=tempest-full-xena-extra-tests17:09
kopecmartinperiodic master17:09
kopecmartin#link https://zuul.openstack.org/builds?project=openstack%2Ftempest&project=openstack%2Fdevstack&pipeline=periodic17:09
kopecmartinI wonder if we need to update these links (i'm copy pasting them from the agenda)17:09
gmanno/17:10
gmannsorry little late17:10
kopecmartinnp, i'm going through the usual 17:10
kopecmartinperiodic jobs seem fine , well tempest-full-test-account-no-admin-py3 doesn't :/ 17:12
kopecmartinlot's of weird errors:17:13
kopecmartinhttps://577c7db1b7d82ddde14e-e0bdf3ad49ea8c697978dcccacccf379.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/tempest/master/tempest-full-test-account-no-admin-py3/831b2e8/testr_results.html17:13
kopecmartinForbidden, Exceeded quota17:13
lpiwowarThat looks strange ... I'm taking a look. 17:14
kopecmartinsome of the failures look similar as in17:15
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/202086017:15
gmann403 one seems valid one and policy changes to new defaults might have caused them. 17:16
gmanndo we have bug for that?17:16
kopecmartinmaybe cause by this? 17:16
lpiwowarrule:create_network is disallowed by policy 17:16
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/89931017:16
kopecmartinno bug apart from the one i shared above (2020860)17:16
gmannok, can you create one and I will fix sometime this or next week17:17
kopecmartinsure, lpiwowar can you please create a new LP? :D 17:17
kopecmartini'm gonna continue with the meeting :) 17:18
lpiwowar:D ok:) 17:18
kopecmartinbtw, gmann can we consider this LP done? 17:18
kopecmartin#link https://bugs.launchpad.net/tempest/+bug/202086017:18
gmannchecking17:18
kopecmartinoh, i've just noticed that the patch has "Related-bug" .. so maybe not17:19
kopecmartinbut it's couple of months old .. 17:19
gmannkopecmartin: no, we did disable the new defaults but we need to run pre-provisioned testing with new default17:20
gmannthis requires more changes in pre provisioned account things17:20
gmannI am keeping this low priority for this cycle17:20
kopecmartinack17:20
gmanncurrently pre provisioned job run on old defaults whihc is just a workaround17:20
kopecmartin#topic Distros check17:21
kopecmartincs-917:21
kopecmartin#link https://zuul.openstack.org/builds?job_name=tempest-full-centos-9-stream&job_name=devstack-platform-centos-9-stream&skip=017:21
kopecmartindebian17:21
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-debian-bullseye&job_name=devstack-platform-debian-bookworm&skip=017:21
kopecmartinrocky17:21
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-rocky-blue-onyx17:21
kopecmartinopenEuler17:21
kopecmartin#link https://zuul.openstack.org/builds?job_name=devstack-platform-openEuler-22.03-ovn-source&job_name=devstack-platform-openEuler-22.03-ovs&skip=017:21
kopecmartinjammy17:21
kopecmartin#link https://zuul.opendev.org/t/openstack/builds?job_name=devstack-platform-ubuntu-jammy-ovn-source&job_name=devstack-platform-ubuntu-jammy-ovs&skip=017:21
kopecmartinall seems good17:24
kopecmartini need to check where we're with openeuler in regards of this libvirt LP 17:24
kopecmartin#link https://bugs.launchpad.net/devstack/+bug/203522417:24
kopecmartin#topic Open Discussion17:26
kopecmartinanything for the open discussion?17:26
lpiwowarJust FYI I'm writing the bug and this one seems to be similar => https://bugs.launchpad.net/tempest/+bug/2020860 . It appeared after NOVA_ENFORCE_SCOPE was changed in devstack. 17:27
kopecmartinthat's what i thought too 17:28
kopecmartinthe job was broken even before, maybe it has several issues17:28
gmannok, can you add those new failing tests also in that bug17:29
gmannotherwise i will forgot those the one failing for 40317:29
lpiwowargmann: ack, I will add it there17:30
gmannlpiwowar: thanks 17:30
kopecmartini have one question about this patch, also commented there17:31
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/87992317:31
kopecmartini think that the point 3 , gmann mentioned in the previous comment, is optional, well it depends on what we wanna achieve 17:31
kopecmartinmy goal is to limit the cleanup tool by default so that it doesn't delete anything that isn't prefixed with tempest-test - in that case we can omit point 317:32
kopecmartinhowever17:32
kopecmartinif we wanna also allow users to customize the prefix, then we need the point 3 obviously 17:32
kopecmartinso my question is more like, do we want to allow users to customize the prefix?17:33
gmannkopecmartin: replied17:33
gmannif we do not make it configure then it seems it will have same issue as we have today17:33
gmannconfiguration make it easy for users to use and detect the tempest created resource eaisly. that can help in our cleanup script or the one if they have any17:34
kopecmartinok, i just wanted to double check as that will require modification of quite a lot of files .. i didn't wanna commit anyone's time if we were't sure we want that 17:34
gmannif we are doing this effort, it is better to make it configurable also17:34
gmannI think if we are fixing that then we should do it fully otherwise sometime later someone will come to make it configurable 17:35
gmannkopecmartin: if you think author scope of work or bandwidth is the issue to do this bug change then we can do it in two steps 1. hard coded value with tempest-test 2. make it confiugrable 17:36
gmanns/bug change/big change17:36
kopecmartinright, i was thinking the same, the author has already 2 commits anyway, this is the other one17:37
kopecmartin#link https://review.opendev.org/c/openstack/tempest/+/89723117:37
gmannohk, did not see that17:37
gmanncan you ask them to make it in dependent so that it will be easy to review both. config one on top of hardcoded value17:38
kopecmartinyep, absolutely 17:38
gmanncool, thanks17:38
gmannI am adding both in my list17:38
kopecmartinthanks17:39
kopecmartin#topic Bug Triage17:39
kopecmartin#link https://etherpad.openstack.org/p/qa-bug-triage-caracal17:39
lpiwowarLink to the bug: 17:39
lpiwowar#link https://bugs.launchpad.net/tempest/+bug/204303817:40
kopecmartinlpiwowar: +117:40
kopecmartinanyway, the bug numbers are recorded17:41
kopecmartini don't have any bug to bring up this time17:41
kopecmartinthat's all from my side17:41
kopecmartinanything else?17:41
gmannnothing else from my side17:42
kopecmartinack, see you all around then :) 17:42
kopecmartinthanks everyone 17:42
lpiwowarnothing from my side17:42
lpiwowarthanks kopecmartin17:42
kopecmartin#endmeeting17:42
opendevmeetMeeting ended Wed Nov  8 17:42:47 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:42
opendevmeetMinutes:        https://meetings.opendev.org/meetings/qa/2023/qa.2023-11-08-17.00.html17:42
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/qa/2023/qa.2023-11-08-17.00.txt17:42
opendevmeetLog:            https://meetings.opendev.org/meetings/qa/2023/qa.2023-11-08-17.00.log.html17:42
gmannkopecmartin: thanks17:42
clarkbstephenfin: sean-k-mooney  off the top of my head I don't know how to fix the wsgi script and console scripts being missing. That said on the console scripts side of things the reason we have our own is the default is super inefficient (it does pkg_resources import iirc which as we all know is slow). Maybe that is no longer a problem and we can simplify? However that doesn't17:48
clarkbhelp with wsgi17:48
opendevreviewyatin proposed openstack/devstack master: [DNM] repro 2  https://review.opendev.org/c/openstack/devstack/+/90044317:52
opendevreviewMerged openstack/grenade master: Set NOVA_VNC_ENABLED: true for subnode in the grenade job  https://review.opendev.org/c/openstack/grenade/+/90025718:01
sean-k-mooneyclarkb: the console script are being cretated18:05
sean-k-mooneyclarkb: because that is supported by setup tools18:06
sean-k-mooneyits just the wsgi scripts18:06
sean-k-mooneyand i think its only for editable installs18:06
sean-k-mooneyclarkb: i unfortuanlly will need to take  as step back form this for a bit as really fixing this was ment ot be a ptg hackaton thing to adress the devstack gloabl_venv supprot for centos18:07
sean-k-mooneysince people were complaining about it.18:07
opendevreviewAshley Rodriguez proposed openstack/devstack-plugin-ceph stable/2023.1: Remote Ceph with cephadm  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/89797218:20
opendevreviewJames Parker proposed openstack/whitebox-tempest-plugin master: Add global nodes variable  https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/88490318:25
*** JayF is now known as JasonF18:53
*** JasonF is now known as JayF18:53
opendevreviewAshley Rodriguez proposed openstack/devstack-plugin-ceph stable/2023.1: Remote Ceph with cephadm  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/89797219:40
opendevreviewAshley Rodriguez proposed openstack/devstack-plugin-ceph master: [WIP] Add ingress deamon  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/90034820:30
opendevreviewAshley Rodriguez proposed openstack/devstack-plugin-ceph master: [WIP] Add ingress deamon  https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/90034820:39
opendevreviewmelanie witt proposed openstack/devstack master: DNM testing  https://review.opendev.org/c/openstack/devstack/+/90026221:35

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!