Tuesday, 2025-05-20

jrossermorning07:36
noonedeadpunko/07:41
kleinigood morning. Is openstack.osa.db_setup documented somewhere? As it seems to be a role, is it useful to utilize include_role like in the os_* roles?07:48
jrosseri'm not sure i quite follow - are you wanting to use that role somewhere outside an osa service role?07:50
jrossercurrently its a role in the openstack-ansible-plugins collection to factor out code that  would otherwise be the same in all the service roles07:51
kleiniI am working on the openstack-ansible-ops/grafana deployment and noonedeadpunk mentioned to use db_setup there instead of mysql_db und mysql_user module07:52
jrosserah ok07:52
kleinigrafana/grafana collection just needs a release: https://github.com/grafana/grafana-ansible-collection/pull/36507:54
jrosserwell, its not really documented at all as its an internal role for OSA07:54
noonedeadpunkI'd take example from smth like glance I guessL: https://opendev.org/openstack/openstack-ansible-os_glance/src/branch/master/tasks/main.yml#L46-L6607:54
jrosserthe best thing to do is look how it is used in the other os_ roles07:54
jrosserbut it really is simple, just a wrapper around community.mysql.mysql_db and community.mysql.mysql_user07:55
kleiniokay, let's try and we will see07:55
opendevreviewMerged openstack/openstack-ansible-plugins master: Update collection version for 2025.2  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95017609:50
kleiniwhere do I get a usable ansible_python_interpreter from? I see them defined in openstack-ansible/playbooks/defaults/source_install.yml. Those variables don't seem to be available within openstack-ansible-ops.09:54
noonedeadpunkI think this is now also imported10:05
noonedeadpunkhttps://opendev.org/openstack/openstack-ansible-plugins/src/branch/master/playbooks/glance.yml#L45-L5410:05
kleiniI am still on 2023.1, so install_defaults is not available. have to find another solution10:20
noonedeadpunkyeah, it's not on 2023.1 :(10:26
noonedeadpunkit was added only on 2024.210:27
kleiniI have a workaround on my staging system.10:28
kleinihttps://paste.qa.open-xchange.com/hawuyewawi.md works10:55
noonedeadpunkkleini: um, is that your internal paste service10:56
noonedeadpunkas I think it resolves to rfc 1918 network10:57
kleiniups11:55
kleinihttps://paste.opendev.org/show/baoKB3VbTj7qeu3phyu6/11:55
opendevreviewMarcus Klein proposed openstack/openstack-ansible-ops master: upgraded grafana.grafana collection does not need ansible fact vars anymore  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/95041113:00
opendevreviewMarcus Klein proposed openstack/openstack-ansible-ops master: grafana.grafana works without ansible fact vars  https://review.opendev.org/c/openstack/openstack-ansible-ops/+/95041113:02
opendevreviewOpenStack Release Bot proposed openstack/openstack-ansible stable/2025.1: Update .gitreview for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041713:25
opendevreviewOpenStack Release Bot proposed openstack/openstack-ansible stable/2025.1: Update TOX_CONSTRAINTS_FILE for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041813:25
opendevreviewOpenStack Release Bot proposed openstack/openstack-ansible master: Update master for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041913:25
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: [doc] Update doc for the stable branch  https://review.opendev.org/c/openstack/openstack-ansible/+/95042814:22
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Start development of 2025.2 (Flamingo)  https://review.opendev.org/c/openstack/openstack-ansible/+/95026114:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Start development of 2025.2 (Flamingo)  https://review.opendev.org/c/openstack/openstack-ansible/+/95026114:48
opendevreviewMerged openstack/openstack-ansible master: Update master for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041914:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Start development of 2025.2 (Flamingo)  https://review.opendev.org/c/openstack/openstack-ansible/+/95026114:58
noonedeadpunk#startmeeting openstack_ansible_meeting15:00
opendevmeetMeeting started Tue May 20 15:00:42 2025 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'openstack_ansible_meeting'15:00
noonedeadpunk#topic rollcall15:00
noonedeadpunko/15:00
jrossero/ hello15:01
noonedeadpunk#topic office hours15:02
noonedeadpunkso I have good and bad news kinda15:03
noonedeadpunkgood one, is that we've branched 2025.115:03
noonedeadpunkAnd we're pretty much in time for the release in 2 weeks15:03
noonedeadpunkdespite most things were not done at last minute, we still having a release with no time to spare15:04
noonedeadpunkAnd I wanted to say with way lower amount of stress as well15:04
noonedeadpunkif not... EL10 situation15:04
jrosseri think we just have to let that go for a while15:05
jrosserseems like something that will eventually come (CI nodes)15:05
noonedeadpunkand here bad news are coming. As python 3.11 is the minimal requirement, I did include drop of all EL9 related jobs to 15:05
noonedeadpunk#link https://review.opendev.org/c/openstack/openstack-ansible/+/95026115:05
jrosseri did a patch also to drop jammy15:05
noonedeadpunkI actually decided it to squash with this one15:06
noonedeadpunkas it would be conflicting anyway15:06
jrosserno problem, yes15:06
noonedeadpunkI did not do any deep clean-up for EL though15:06
noonedeadpunkIT was more of docs/matrix/jobs thing15:06
noonedeadpunkand I wanna start looking locally at el10 support asap15:07
opendevreviewMerged openstack/openstack-ansible stable/2025.1: Update .gitreview for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041715:07
noonedeadpunknasty part, that we will have to backport it for upgrade reasons...15:07
noonedeadpunkand I really don't like this specific part of it15:08
noonedeadpunkBut, well... we have what we have I guess...15:08
jrosserwe certainly do15:08
noonedeadpunkalso I left rocky 9 molecule jobs15:08
noonedeadpunkas where they are used, they should not hurt just for sanity checks of the codepath15:09
jrosseri am not sure how much i like having to backport a ton of stuff either15:10
jrosserit is currently so much work to keep up with the EOL / unmaintained fall out that i just don't know if it is a good idea15:10
noonedeadpunkit can be not _that_ bad if it's the next thing we land15:10
noonedeadpunkas more or less clean backports can be done with a single button in gerrit15:10
noonedeadpunkbut then we're dropping an upgrade path, which is also not good15:11
noonedeadpunkand I think it's me to blame, as I didn't manage to work on support in time, totally missed that we can't do this next cycle15:12
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Start development of 2025.2 (Flamingo)  https://review.opendev.org/c/openstack/openstack-ansible/+/95026115:13
jrosserthats not entirely fair - to land support for a whole OS with major changes that maybe you don't even use for deployments15:13
jrosserimho we really need more hands on the rh derived stuff in total15:13
jrosserthe debian and ubuntu OS upgrades are almost a no-op in comparison15:14
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Start development of 2025.2 (Flamingo)  https://review.opendev.org/c/openstack/openstack-ansible/+/95026115:14
noonedeadpunkwell, I don't use, but it come really handy for me couple of times in arguments15:14
noonedeadpunkwhere it was - "we want EL, as we trust in it" - "well, maybe let;s start with deb, and if it won't work - we can always seamingly migrate to EL?" - "lgtm" kind of conversatrions15:15
noonedeadpunkwe do OS upgrades through re-install anyway btw, so if not mentioning amount of changes required in code/packages/etc - for operators upgradfe process is the same15:16
noonedeadpunkbut I totally get what you're saying15:16
noonedeadpunkand I agree with it15:16
noonedeadpunkjust from the "product" prespective better to have such upgrade release...15:16
NeilHanlonah! 15:17
jrosseryes thats very true15:17
* NeilHanlon got distracted by prometheus15:17
NeilHanlonsorry :D 15:17
jrossereasy to happen :)15:17
noonedeadpunkwe're discussing dropping Rocky support :D15:18
NeilHanlonsry reading back :D15:18
noonedeadpunkso you haven't missed anything important :p15:18
NeilHanlonhah15:18
NeilHanlonno it's OK, i mean.. I get it 15:18
jrosserseems maybe the immediate issue is getting more horsepower on the CI node issue15:18
noonedeadpunkBut in seriosness, I wanna start doing patches this week15:19
jrosseras anyone can do local dev with a cloud image and make patches15:19
jrosserbut we can't test/merge anything right now sensibly15:19
NeilHanlonand I agree w/ jrosser about it not being really all on your plate noonedeadpunk especially when it's _not_ something you deploy actively15:19
NeilHanlonbut passing blame around isn't probably productive :D 15:19
NeilHanlonthe immediate need is to fix for our current users and make sure we can keep pushing code we are confident in because it's passing CI 15:20
noonedeadpunkI'd actually vote on landing EL10 even without testing.... Just openly stating that everywhere to manage expectations15:20
noonedeadpunkas I believe that CI might be solved sooner then later15:21
NeilHanlonanother possible interesting thing re: major version upgrades is Oracle recently did this: https://github.com/openela/leapp-repository15:21
noonedeadpunkwe can add jobs as NV to find issues and them set as voting15:21
NeilHanlonbut that's tangential at this point as it's just more work we'd need to do to maintain actors for doing openstack upgrades atop rocky and i prefer not doing that anyways 15:22
noonedeadpunkright, I prefer not upgrading ubuntu either, whenever I can15:22
noonedeadpunkjsut re-install is way more trivial if you have all internal things automated anyway15:22
noonedeadpunk(and take less time)15:23
jrosseri think i miswrote earlier about OS upgrades, i really meant introducing jobs for a new ubuntu/debian tends to be very trivial15:23
NeilHanlonright, that's sorta the whole reason we use ansible ! 15:23
noonedeadpunkjrosser: yeash, that's true15:23
NeilHanlonjrosser: yeah I think that also threw me off but i still wanted to mention it's technically more possible now15:23
noonedeadpunkapparmor issues were not trivial this time around though15:24
jrosseranyway :) if you want to make some patches regardless that is OK15:24
noonedeadpunkso yeah, I will check on what it would take to add EL10 support with local aio15:25
NeilHanlonhave we poked mnasiadka about the python3.11 stuff btw? 15:25
noonedeadpunkand we'll see if/how/when to land them15:25
jrosseri was thinking to look at the usgi script thing (maybe even later today)15:25
NeilHanlonwe were chatting about NFV sig stuff this morning..15:25
jrosseras i see that some services are migrating with no backward compatibility15:25
NeilHanloni'm almost at the point where like.. i'll just go rebuild all the things we need to make python3.11 work15:25
mnasiadkaWhat python3.11 stuff? :)15:25
noonedeadpunkI now for fact that python3-libvirt is required by nova, and it's shipped only for 3.9 15:26
* NeilHanlon signing myself up for more work as always15:26
mnasiadkaAh, you tried the same thing as me15:26
noonedeadpunkmnasiadka: I learned that with EL8 I think15:26
opendevreviewMerged openstack/openstack-ansible stable/2025.1: Update TOX_CONSTRAINTS_FILE for stable/2025.1  https://review.opendev.org/c/openstack/openstack-ansible/+/95041815:26
noonedeadpunkunder very alike circumstances15:26
noonedeadpunk(or maybe it was 7? who knows)15:26
NeilHanlonEnterprise Linux: the pain that keeps on giving15:27
NeilHanlonwhy do i do this to myself? lol15:27
noonedeadpunkand I have memories of libselinux bindings for python as well, but there were some ways around...15:27
noonedeadpunkNeilHanlon: great question, lol "D15:27
noonedeadpunkbut I'm really impressed how ppl continue shooting themselves in the leg15:28
noonedeadpunkby building against cnetos for EL, and things like that15:28
noonedeadpunkdropping cpu flags for still used hardware...15:28
noonedeadpunkdoh15:28
noonedeadpunkanyway15:29
NeilHanlonpsh isn't everyone replacing their servers every 3 years to fit more pci lanes to inference AI or something?15:29
mnasiadkaShould we all stop supporting EL?:)15:29
NeilHanlonmnasiadka: in protest? :P 15:29
noonedeadpunkNeilHanlon: and also efficiency per watt, and save costs on cooling, sure15:29
NeilHanlonnah i mean, we all know it's been a weird situation the past few years and hasn't gotten really any clearer esp. with the CI situation and not really having any idea what's up with that all15:30
noonedeadpunkmnasiadka: frankly? I'd internally love to do that, but I kinda realize that it's not gonna end well15:30
noonedeadpunkinternally, in terms of very personal opinion15:31
noonedeadpunkas when trying to sell openstack, more then half are not ready to consider anything except EL15:32
noonedeadpunkor at the very least they require the ability of rollback to EL 15:33
NeilHanloni just had that conversation with a colleague in the rocky project on our testing team15:33
NeilHanlonhis boss wants him to investigate openstack and talk to Canonical and he is firmly planted he'd get it from RH instead 15:33
NeilHanloni'm always trying to abduct more people into our cult :P 15:34
noonedeadpunkright :)15:34
noonedeadpunkI especially like cases of moving from VMware due to screwed policies to RH OpenStack15:35
jrossermnasiadka: while you are around - did i understand right that you were looking at the rh-10-ish nodpool images?15:35
noonedeadpunkJust as if IBM is any better then Broadcom at global scale of screwing up customers15:35
mnasiadkaYes, I’m trying to help tonyb in CS10 work15:36
noonedeadpunkI can try to help if there's a need15:37
noonedeadpunkbut I did not have time yet to double check the state after asking in #opendev15:38
NeilHanlonnoonedeadpunk: yeah i chose not to mention that to that colleague :P 15:38
NeilHanlonmnasiadka: and, sorry i fell off, but did you end up working on Rocky 9 nodepool images, too? 15:39
mnasiadka@NeilHanlon: yup, that’s done ;)15:39
NeilHanlonmnasiadka: add another beer to my tab for you15:40
NeilHanlonok, so.. 15:45
NeilHanlonshort term, we drop rocky jobs and backport to the N-1(-1,-1?) releases so we can land changes15:46
NeilHanlonat the same time, we maybe work on landing el10? I volunteer DavidGomez to help. :) 15:46
NeilHanlonnoonedeadpunk: does that seem like a reasonable next steps?15:47
DavidGomezof course, happy to help 15:47
noonedeadpunkNeilHanlon: we don't need to backport jobs removal15:48
noonedeadpunkwe'd need to backport EL10 patches15:48
NeilHanlonah..15:49
noonedeadpunkideally15:49
NeilHanloni had that reversed in my head15:49
NeilHanlonwell, more experience for DavidGomez! lol15:49
noonedeadpunklol, I won't refuse help, sure :)15:49
NeilHanlonsorry david, you can get me back at the next onsite :P 15:49
noonedeadpunkbut also adding rocky 10 image to nodepool would be amazing15:50
DavidGomezhaha not at all, sounds like a good learning opportunity 15:51
noonedeadpunkok, cool, sounds like a plan then15:52
noonedeadpunk#endmeeting15:53
opendevmeetMeeting ended Tue May 20 15:53:51 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:53
opendevmeetMinutes:        https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-05-20-15.00.html15:53
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-05-20-15.00.txt15:53
opendevmeetLog:            https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-05-20-15.00.log.html15:53
NeilHanlonthanks noonedeadpunk for running the meeting as always!15:54
NeilHanlon🫡15:54
noonedeadpunkthanks for coming!15:54
* NeilHanlon goes back to being distracted by prometheus15:54
NeilHanlonwhoever designed all this was a sadist, btw15:54
DavidGomezlater all!15:55
NeilHanlonthanks for hanging DavidGomez :) 15:55
mnasiadka@noonedeadpunk: rocky10 is next on my list after cs10 (but first it needs to be released…)15:55
opendevreviewJonathan Rosser proposed openstack/ansible-role-uwsgi master: Add ability to specify uwsgi module  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/95043715:57
NeilHanlonRocky 10 is pretty close15:59
NeilHanlonwe did an initial compose run last night to see how many packages we needed to re-sign (the system is weird) and it was really clean16:00
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_glance master: Switch from wsgi script to wsgi module  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/95043816:00
jrossernoonedeadpunk: if you think these wsgi module changes are broadly correct i can push more tomorrow16:14
noonedeadpunkjrosser: I think you'll need to drop this? https://opendev.org/openstack/openstack-ansible-os_glance/src/branch/master/vars/main.yml#L5917:05
noonedeadpunkas well17:05
jrosseroh that is a bit horrible17:09
opendevreviewJonathan Rosser proposed openstack/openstack-ansible-os_glance master: Switch from wsgi script to wsgi module  https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/95043821:04

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!