Tuesday, 2025-06-03

opendevreviewMerged openstack/openstack-ansible-os_neutron master: Add EL10 support  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/95132801:27
opendevreviewOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/openstack-ansible/+/95160705:12
noonedeadpunkBaronvaile: couple of month ago we indeed have increased timeouts for fetching UC07:02
noonedeadpunkbut then it was also related to issues with openinfra's gitea mirror07:03
noonedeadpunkit was backported to 2024.1: https://review.opendev.org/q/I42663e8316ef87c12a229517ac0f95f8c6c2c14b07:04
derekokeeffe85Morning jrosser, I was away when you replied. Thanks I'll look at it today07:12
noonedeadpunkNeilHanlon: thanks, I'll check on that!07:18
noonedeadpunkdoh07:26
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Temporary disable molecule jobs  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95161407:38
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Do not verify MariaDB version when installed from distro repos  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95131707:38
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Revert "Temporary disable molecule jobs"  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95161507:42
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95131507:42
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-hardening stable/2025.1: Add support for EL10  https://review.opendev.org/c/openstack/ansible-hardening/+/95161607:43
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server stable/2025.1: Add EL10 support  https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/95161707:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins stable/2025.1: Add support for EL10 to GlusterFS role  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95161807:44
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins stable/2025.1: Update supported platforms for host setup  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95157607:45
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-python_venv_build stable/2025.1: Add support for EL10  https://review.opendev.org/c/openstack/ansible-role-python_venv_build/+/95161907:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: Do not require full git & autoconf on EL  https://review.opendev.org/c/openstack/openstack-ansible/+/95162007:47
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2024.2: Do not require full git & autoconf on EL  https://review.opendev.org/c/openstack/openstack-ansible/+/95162107:48
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2024.1: Do not require full git & autoconf on EL  https://review.opendev.org/c/openstack/openstack-ansible/+/95162207:48
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: Do not enable ebtables on modern kernels  https://review.opendev.org/c/openstack/openstack-ansible/+/95162307:50
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts stable/2025.1: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/95162607:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron stable/2025.1: Add EL10 support  https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/95162707:52
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service purpose for Manila  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:26
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:29
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: fix incorrect use of URL links  https://review.opendev.org/c/openstack/openstack-ansible/+/95163208:34
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL link  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:35
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL links  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:35
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL links  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:36
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL links  https://review.opendev.org/c/openstack/openstack-ansible/+/95162908:39
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95131510:46
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Revert "Temporary disable molecule jobs"  https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/95161510:46
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Add support for generation of SSH keypairs  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/95159010:51
opendevreviewDmitriy Chubinidze proposed openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL links  https://review.opendev.org/c/openstack/openstack-ansible/+/95162910:59
noonedeadpunkhuh, seems COPR is down or smth? https://download.copr.fedorainfracloud.org/results/neil/lxc4.0/epel-10-x86_64/ - results in 50412:34
noonedeadpunkhuh, loaded now...12:35
*** ben is now known as Guest1723613:55
Guest17236Good morning, I was wondering. What would be the best way to un-deploy a service using OSA? I would like to remove cloudkitty from my deployment, but want to make sure I get everything cleaned up nicely.13:56
noonedeadpunko/14:18
noonedeadpunkGuest17236: well. I'm not sure we have that implemented properly. But I can write you down steps :)14:18
opendevreviewTakashi Kajinami proposed openstack/openstack-ansible-os_tempest master: Remove support for sahara and senlin  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/95105314:18
Guest17236noonedeadpunk: that would be great! Thank you :)14:19
noonedeadpunk1. Delete containers: openstack-ansible playbooks/lxc-containers-destroy.yml --limit cloudkitty_all14:19
noonedeadpunk2. Remove rating_hosts from openstack_user_config/conf.d14:20
noonedeadpunk3. Remove containers from inventory: list containers with /opt/openstack-ansible/scripts/inventory-manage.py -l | grep cloudkitty and then remove each as /opt/openstack-ansible/scripts/inventory-manage.py -r <name>14:22
noonedeadpunk3. Delete endpoints from keystone: for endpoint in $(openstack endpoint list --service cloudkitty -f value -c ID); do openstack endpoint delete ${endpoint}; done14:25
noonedeadpunk5. Delete service from keystone: openstack service list | grep cloudkitty; openstack service delete <UUID>14:27
noonedeadpunk6. from utility container enter mysql and drop database cloudkitty;14:27
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Transform GPG/Repo installed to be a list  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/95157414:31
Guest17236Thanks so much noonedeadpunk !14:34
noonedeadpunkprobably you can also clean up rabbitmq... but eh...14:34
noonedeadpunkI can't explicitly recall on how to do that14:35
noonedeadpunkwe probably need to get some tooling in to get this done...14:35
noonedeadpunk#startmeeting openstack_ansible_meeting15:03
opendevmeetMeeting started Tue Jun  3 15:03:58 2025 UTC and is due to finish in 60 minutes.  The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot.15:03
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:03
opendevmeetThe meeting name has been set to 'openstack_ansible_meeting'15:03
noonedeadpunk#topic rollcall15:04
noonedeadpunko/15:04
damiandabrowskihi!15:04
jrosserhello15:06
DavidGomezo/15:08
noonedeadpunk#topic office hours15:09
noonedeadpunkThis week is the deadline for 2025.1 release15:09
noonedeadpunk#link https://releases.openstack.org/flamingo/schedule.html15:09
noonedeadpunkwe do have EL10 topic on hands, and I _think_ it's almost completed. At least the very base version of it15:10
noonedeadpunk#link https://review.opendev.org/q/topic:%22osa/el10%22+status:open15:10
noonedeadpunkcouple of patches still need review there thoughy15:10
noonedeadpunkI've also started backporting to 2025.1: https://review.opendev.org/q/topic:%22osa/el10-stable/2025.1%2215:11
noonedeadpunkbut there are some unobvious dependency chains still15:11
NeilHanlono/ sorry am a bit late today15:12
noonedeadpunkI'm also working on LXC implementation right now15:13
noonedeadpunkthere's quite a solid chaing there already15:13
noonedeadpunk#link https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/951177/15:14
noonedeadpunkand 2 more changes coming there15:15
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Use systmed drop-in overrides for tunning  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/95166515:19
NeilHanlonawesome! :) 15:22
noonedeadpunkother then that...15:25
noonedeadpunkdunno15:25
noonedeadpunkwas working on some Trove improvements15:25
noonedeadpunklike - adding SSH keypair generation alike to how it was done in Octavia15:25
NeilHanlonyea i don't have much as i've been busy with rocky 10 and 9.6 releases for the whole.. month15:25
noonedeadpunkfair enough...15:26
noonedeadpunkI was not actually keeping much track of our CI and CentOS there15:26
noonedeadpunkMariaDB has recently added EL10 worker to their CI. But timeframe for building/publishing packages is still unknown15:27
noonedeadpunk(https://jira.mariadb.org/browse/MDBF-995)15:27
noonedeadpunkso conslusion - please do bunch of reviews and let's try to land the release bumps later this week15:33
noonedeadpunkanother thing - next 2 weeks I will be mostly away15:37
damiandabrowskiokay! will do that tomorrow15:37
noonedeadpunkI will probably be around next Tuesday for the meeting15:37
noonedeadpunkbut that would be mostly it15:37
noonedeadpunkhm, NeilHanlon/DavidGomez - I'm somehow struggling with iptables on CentOS Stream 10. specifically witrh MASQUERADE: https://paste.openstack.org/show/b28f994ezKwyDtgiVrnw/15:46
noonedeadpunkbut it seems it can be the same with ebtables and other things15:47
noonedeadpunkeven simplest rules are failing15:52
noonedeadpunkhttps://paste.openstack.org/show/bvfL7aW66oWOYBnorCNs/15:52
DavidGomezhmm, it looks like the modprobe is in use with kernel 6.12.0-82.el10.x86_64 and the module is available under another kernel version 6.12.0-89.el10.x86_64. Can you switch to 6.12.0-89.el10.x86_64 and try again?15:54
noonedeadpunkdoh15:54
noonedeadpunkDavidGomez: so these modules are still loadable for EL10? https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/master/vars/redhat-9.yml#L31-L4015:55
noonedeadpunkas I think I've dropped them for bad reason....15:56
DavidGomezNot sure but I can look into it15:57
noonedeadpunk#endmeeting16:00
opendevmeetMeeting ended Tue Jun  3 16:00:54 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:00
opendevmeetMinutes:        https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-06-03-15.03.html16:00
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-06-03-15.03.txt16:00
opendevmeetLog:            https://meetings.opendev.org/meetings/openstack_ansible_meeting/2025/openstack_ansible_meeting.2025-06-03-15.03.log.html16:00
noonedeadpunkyeah, ok, so reboot does fix the thing16:04
noonedeadpunkcrap, ok, I figured out things now :(16:09
* noonedeadpunk did bad things16:09
noonedeadpunkhm. so how the **** this happens, that iptables lead to kernel upgrade?16:20
noonedeadpunkhttps://paste.openstack.org/show/bHBToKVMRhxBUajSuAFq/16:20
noonedeadpunkis that "designed" this way?16:20
noonedeadpunkdoh16:23
NeilHanlon🤦‍♂️16:24
NeilHanlonit is probably because iptables Requres: kernel > 6.12.0-89 or so16:24
noonedeadpunknope16:24
noonedeadpunkdnf install iptables kernel-modules-extra-$(uname -r) does dpo the thing16:25
NeilHanlonhmm so basically you can have an iptables that is mismatched from your kernel..16:25
NeilHanlonwonderful16:25
noonedeadpunkyup16:25
noonedeadpunkanother neat thing16:26
noonedeadpunkhttps://paste.openstack.org/show/bHVO6ZlhvGeD0bmOd3GB/16:26
noonedeadpunkcan somebody explain to me how that is happening?16:26
noonedeadpunkbut then https://paste.openstack.org/show/bONh8BH4v6vRx2VVaku6/16:27
NeilHanlonthe different versions?16:28
noonedeadpunkso if you ask for kernel-modules-extra-6.12.0-82* - you don't get new kernel16:28
NeilHanlonohhh, i see what you'resaying..16:28
noonedeadpunkIf you ask for kernel-modules-6.12.0-82* - it's juyst neglected16:29
noonedeadpunkand kernel is being upgraded and kernel-modules-6.12.0-82* not installed16:29
noonedeadpunklike wtf is that16:29
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Revert "Do not enable ebtables on modern kernels"  https://review.opendev.org/c/openstack/openstack-ansible/+/95167916:31
NeilHanloni think it's sort of a "expected" bug.. but it's dumb and really hostile to users16:31
NeilHanlonunfortunately I can't even read the kernel specfile in the state it's in these days in Enterprise Linux16:33
NeilHanlonit's macros stacked on macros stacked on macros stacked on macros .....16:33
noonedeadpunkright...16:33
noonedeadpunkIt's just indeed results in a very unexpected behaviour somehow16:34
noonedeadpunkso I guess in 9 it was not really depending on kernel-modules-extra16:40
NeilHanlonyep16:40
NeilHanlonhttps://gitlab.com/redhat/centos-stream/rpms/iptables/-/blob/c10s/iptables.spec?ref_type=heads#L203-22116:40
NeilHanlonhttps://gitlab.com/redhat/centos-stream/rpms/iptables/-/blob/c9s/iptables.spec?ref_type=heads#L183-19316:41
noonedeadpunkoh... so kernel-core is a new thing?16:41
NeilHanlonyeah iptables-nft having a Requires: on kernel-modules-extra is new16:42
NeilHanlonthe big list in the c10s branch I linked of `Requires: ()` are ternaries basically saying "iptables-nft Requires kernel-modules-extra if kernel-core is installed, or kernel-rt-modules-extra if kernel-rt-core is installed" ... etc16:43
noonedeadpunkbut kernel still depends on kernel-core it seems16:43
NeilHanlonyeah, kernel-core is not new16:43
noonedeadpunkah, right16:43
noonedeadpunkrt16:43
NeilHanlon`kernel` is a 'metapackage' basically, thats only job is to be Provided16:43
NeilHanlonbecause all of kernel-core, kernel-rt-core, kerel-64k-core, etc..., say they "Provide: kernel"16:44
noonedeadpunkNeilHanlon: can you take a quick look at https://review.opendev.org/c/openstack/openstack-ansible/+/951140/2 pls?16:57
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts master: Fix modules load for EL10  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/95168517:24
NeilHanlonnoonedeadpunk: yep! Done17:28
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add EL10 support for LXC containers  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95169018:06
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/95169118:07
noonedeadpunkwe have a race condition for mariadb, as we've landed C10S molecule test before the patch implementing it for mariadb.18:08
noonedeadpunkthus: https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951614/118:08
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-uwsgi master: Add support for EL10  https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/95132518:09
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/95169118:13
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Remove unsupported distros for 2025.2  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95169218:16
noonedeadpunkso, lxc creation seems to pass now...18:21
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Add platform_check role  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95169418:46
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Use platform_check role for AIO bootstrap  https://review.opendev.org/c/openstack/openstack-ansible/+/95169518:50
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: Use platform_check role for AIO bootstrap  https://review.opendev.org/c/openstack/openstack-ansible/+/95169518:51
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Remnove Ubuntu 16.04 reference from deploy guide  https://review.opendev.org/c/openstack/openstack-ansible/+/95169718:58
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_mount master: Install udev without NVR  https://review.opendev.org/c/openstack/ansible-role-systemd_mount/+/95170419:36
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Manage supported platforms in a single place  https://review.opendev.org/c/openstack/openstack-ansible/+/95171019:52
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Add support for generation of SSH keypairs  https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/95159019:56
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Ensure python3-setuptools are installed for EL10  https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/95171220:01
noonedeadpunkLXC has uncovered some issues....20:01
noonedeadpunknot sure, potentially python3-setuptools should be installed on all containers by default...20:02
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-lxc_hosts master: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/95169120:03
noonedeadpunkJust reaslly a bit afraid if https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/951691/3/vars/redhat.yml won't break el920:07
noonedeadpunknah, it's fine20:08
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-os_tempest stable/2025.1: Add EL10 support  https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/95172723:17
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: Add CentOS Stream 10 to molecule tests  https://review.opendev.org/c/openstack/openstack-ansible/+/95172823:17
opendevreviewDmitriy Rabotyagov proposed openstack/ansible-role-systemd_networkd stable/2025.1: Add EL10 support to the role  https://review.opendev.org/c/openstack/ansible-role-systemd_networkd/+/95172923:18
opendevreviewDmitriy Rabotyagov proposed openstack/openstack-ansible-openstack_hosts stable/2025.1: Add support for EL10  https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/95162623:21

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!