Thursday, 2026-04-16

*** Viii4 is now known as Viii01:15
mnasiadkablanson[m]: which gazpacho whiteboard?04:59
blanson[m][@_oftc_mnasiadka:matrix.org](https://matrix.to/#/@_oftc_mnasiadka:matrix.org)   I was in the gazpacho ptg white board and it took me a good 10 minutes to umderstand why stuff wasnt updated 05:07
mnasiadkablanson[m]: we have hibiscus PTG board, but I’ll copy some things over from gazpacho so we can discuss if these are still valid05:33
blanson[m]Yeah then I found The H whiteboard and added some stuff there . I copied some of the gazapacho things I didnt do in G but are still valid05:35
mnasiadkathanks06:11
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop support for running WSGI under Apache  https://review.opendev.org/c/openstack/kolla-ansible/+/98241406:12
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: cinder: Change default destination for cinder-volume/backup containers  https://review.opendev.org/c/openstack/kolla-ansible/+/98000906:40
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: cinder: Change default destination for cinder-volume/backup containers  https://review.opendev.org/c/openstack/kolla-ansible/+/98000906:45
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: cinder: Change default destination for cinder-volume/backup containers  https://review.opendev.org/c/openstack/kolla-ansible/+/98000906:47
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop support for running WSGI under Apache  https://review.opendev.org/c/openstack/kolla-ansible/+/98241407:55
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop support for running WSGI under Apache  https://review.opendev.org/c/openstack/kolla-ansible/+/98241407:55
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add OpenStack Network Exporter for Prometheus  https://review.opendev.org/c/openstack/kolla-ansible/+/95985308:23
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add OpenStack Network Exporter for Prometheus  https://review.opendev.org/c/openstack/kolla-ansible/+/95985308:24
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Cleanup orphan interfaces  https://review.opendev.org/c/openstack/kayobe/+/84003308:38
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Testing  https://review.opendev.org/c/openstack/kolla/+/98490508:47
opendevreviewDoug Szumski proposed openstack/kolla-ansible master: Support multiple Nova Compute Ironic instances  https://review.opendev.org/c/openstack/kolla-ansible/+/97388108:56
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Testing  https://review.opendev.org/c/openstack/kolla/+/98490508:57
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Testing  https://review.opendev.org/c/openstack/kolla/+/98490508:58
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Testing  https://review.opendev.org/c/openstack/kolla/+/98490509:05
tafkamaxok tomorrow maintenance time in prod :)09:09
tafkamaxtest cluster was happy09:10
tafkamaxlet's see if the mariadb logsize thing will fix our backups09:10
tafkamaxInterestingly one of the mariadb nodes got unhappy after stop + reboot09:10
mikalThanks for making an APAC PTG slot. I appreciate it.09:11
tafkamaxredeploy helped, but the only issue in logs we found was that in proxysql the weight of the node changed, which made it unhealthy. 09:11
opendevreviewWill Szumski proposed openstack/kayobe master: [CI]: Fix various issues  https://review.opendev.org/c/openstack/kayobe/+/98474109:25
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Cleanup orphan interfaces  https://review.opendev.org/c/openstack/kayobe/+/84003309:27
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: horizon: add Valkey session cache backend and prefer it  https://review.opendev.org/c/openstack/kolla-ansible/+/98078409:44
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: horizon: add Valkey session cache backend and prefer it  https://review.opendev.org/c/openstack/kolla-ansible/+/98078409:45
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Fix correct Libvirt TLS certificates path  https://review.opendev.org/c/openstack/kayobe/+/98491110:07
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: Implement neutron-ovn-vpn-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/92457510:14
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: Implement neutron-ovn-vpn-agent  https://review.opendev.org/c/openstack/kolla-ansible/+/92457510:15
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: horizon: add Valkey session cache backend and prefer it  https://review.opendev.org/c/openstack/kolla-ansible/+/98078410:18
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: keystone: remove use_stderr to avoid duplicate logs  https://review.opendev.org/c/openstack/kolla-ansible/+/98491210:32
opendevreviewWill Szumski proposed openstack/kayobe master: [CI] Fix various issues  https://review.opendev.org/c/openstack/kayobe/+/98474111:25
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Cleanup orphan interfaces  https://review.opendev.org/c/openstack/kayobe/+/84003311:32
tafkamaxanyone here used docker live-restore functionality with kolla?12:03
chemberv_tafkamax: of course. what is your question?12:24
tafkamaxis it reliable and during major docker version changes, does it usually work?12:24
chemberv_yes, we and our clients use it more than 4years - smooth sailing12:26
tafkamaxok good to know12:27
chemberv_it was a bug in 2024.1 https://bugs.launchpad.net/kolla-ansible/+bug/2065168, but it has been fixed12:29
chemberv_here is config to enable it: docker_custom_config: live-restore: true; docker_systemd_reload: true (also good option)12:30
tafkamaxthx we are just testing it out12:30
chemberv_tafkamax: just saw - your wrote today about mariadb logsize and problems with backs? it hangs? we also have this issue. do you have a solution? 12:33
chemberv_backups..12:34
tafkamaxchemberv_: we are applying this soon on prod cluster12:37
tafkamaxon our biggest cluster it is failing12:37
tafkamaxtomorrow we will do it on a smaller cluster where it works12:37
tafkamaxs/it/backup/12:37
chemberv_can you share please a solution? can't see it in the chat .. or link on a bug? if there is12:38
tafkamaxand then on the larger cluster and see if it works12:38
tafkamaxthe option to update the log file size got merged recently12:38
chemberv_I want join to beta-testing :) 12:38
chemberv_https://review.opendev.org/c/openstack/kolla-ansible/+/983694 this one?12:39
tafkamaxhttps://review.opendev.org/c/openstack/kolla-ansible/+/98369412:39
chemberv_ok. thanks!12:39
tafkamaxit adds the default to 2gb and makes it configurable12:39
tafkamaxmy colleague did some calculations and taking into account that if controllers have 32gb ram where the mariadb lives... (full message at <https://matrix.org/oftc/media/v1/media/download/AcRKYHNEojtJKpRLTJk-AIQiabh0dIGNgWb3AgjoHkncvFup7TBmpriG2yoyEdbyQn3Pw4gq2FbqsKbj_fbQmsBCed3mio-QAG1hdHJpeC5vcmcvbEplcGRTY1hKcnhEVExoanlMRlhlR3B3>)12:41
tafkamaxso we will try 16gb to log size12:42
tafkamaxI was thinking to try incremental and start from smaller and see when it will work12:42
tafkamaxchemberv_: is this also an kolla_ansible valid key? cant find it in kolla-ansible12:43
tafkamaxthe docker_systemd_reload option12:43
chemberv_https://github.com/openstack/ansible-collection-kolla/blob/master/roles/docker/defaults/main.yml#L7112:44
tafkamaxok cheers12:44
*** chemberv_ is now known as chembervint13:03
opendevreviewVerification of a change to openstack/kayobe stable/2025.1 failed: Add Valkey support  https://review.opendev.org/c/openstack/kayobe/+/98024113:38
opendevreviewMerged openstack/kayobe master: [CI] Fix various issues  https://review.opendev.org/c/openstack/kayobe/+/98474114:54
opendevreviewMerged openstack/kolla-ansible master: Fix: Update outdated documentation  https://review.opendev.org/c/openstack/kolla-ansible/+/98208914:54
opendevreviewOwen Jones proposed openstack/kayobe master: Override IPA image distribution/release  https://review.opendev.org/c/openstack/kayobe/+/98495514:57
opendevreviewGrzegorz Bialas proposed openstack/kolla-ansible master: Fix bootstraping prometheus-mysqld-exporter when monitoring group has own hosts  https://review.opendev.org/c/openstack/kolla-ansible/+/98495715:04
opendevreviewOwen Jones proposed openstack/kayobe master: Override IPA image distribution/release  https://review.opendev.org/c/openstack/kayobe/+/98495515:09
opendevreviewDoug Szumski proposed openstack/kolla-ansible master: Add Prometheus integration for Docker  https://review.opendev.org/c/openstack/kolla-ansible/+/93674215:10
opendevreviewMerged openstack/kolla-ansible master: Add OpenStack Network Exporter for Prometheus  https://review.opendev.org/c/openstack/kolla-ansible/+/95985315:54
opendevreviewOpenStack Proposal Bot proposed openstack/kolla-ansible master: Updated ansible-lint j2lint in lint-requirements.txt  https://review.opendev.org/c/openstack/kolla-ansible/+/98500316:16
opendevreviewMichal Nasiadka proposed openstack/ansible-collection-kolla master: test-reqs: pin ansible-lint to 25.12.2 so pcu will update it  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/98500416:17
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Updated ansible-lint j2lint in lint-requirements.txt  https://review.opendev.org/c/openstack/kolla-ansible/+/98500316:20
opendevreviewMerged openstack/ansible-collection-kolla master: test-reqs: pin ansible-lint to 25.12.2 so pcu will update it  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/98500416:35
opendevreviewOpenStack Proposal Bot proposed openstack/ansible-collection-kolla master: Updated ansible-lint in test-requirements.txt  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/98501317:03
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: DNM: OVN - Testing Router External IP allocation on public1  https://review.opendev.org/c/openstack/kolla-ansible/+/98501918:27
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: DNM: OVN - Testing Router External IP allocation on public1  https://review.opendev.org/c/openstack/kolla-ansible/+/98501918:28
opendevreviewVerification of a change to openstack/kayobe master failed: Block until timedatectl status show synchronized  https://review.opendev.org/c/openstack/kayobe/+/98239618:42
opendevreviewMAILLET-CONTOZ Nicolas proposed openstack/kolla-ansible master: Fix typo in neutron group vars  https://review.opendev.org/c/openstack/kolla-ansible/+/98503119:34
opendevreviewPiotr Milewski proposed openstack/kolla-ansible master: DNM: OVN - Testing Router External IP allocation on public1  https://review.opendev.org/c/openstack/kolla-ansible/+/98501919:43
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: cinder: Change default destination for cinder-volume/backup containers  https://review.opendev.org/c/openstack/kolla-ansible/+/98000919:48
opendevreviewMerged openstack/kayobe stable/2025.1: Add Valkey support  https://review.opendev.org/c/openstack/kayobe/+/98024120:14
opendevreviewVerification of a change to openstack/kayobe stable/2025.1 failed: Add support for building valkey images  https://review.opendev.org/c/openstack/kayobe/+/98369120:14
opendevreviewMerged openstack/kolla-ansible master: Updated ansible-lint j2lint in lint-requirements.txt  https://review.opendev.org/c/openstack/kolla-ansible/+/98500320:14
opendevreviewMerged openstack/ansible-collection-kolla master: Updated ansible-lint in test-requirements.txt  https://review.opendev.org/c/openstack/ansible-collection-kolla/+/98501320:14
opendevreviewMerged openstack/kolla-ansible master: horizon: add Valkey session cache backend and prefer it  https://review.opendev.org/c/openstack/kolla-ansible/+/98078421:17
*** jhorstmann is now known as Guest741622:22

Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!