| opendevreview | Michael Still proposed openstack/kolla master: Install the kerbside-proxy wheel into kerbside images. https://review.opendev.org/c/openstack/kolla/+/998073 | 01:35 |
|---|---|---|
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Deploy Kerbside with Kolla-Ansible. https://review.opendev.org/c/openstack/kolla-ansible/+/976889 | 01:45 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Use a routable IP for qemu SPICE consoles. https://review.opendev.org/c/openstack/kolla-ansible/+/967801 | 01:45 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Add kerbside CI scenario jobs. https://review.opendev.org/c/openstack/kolla-ansible/+/988189 | 01:45 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Run the spice-direct tempest test in the kerbside scenario. https://review.opendev.org/c/openstack/kolla-ansible/+/988913 | 01:45 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Run a Kerbside-fronted SPICE tempest test in the kerbside scenario. https://review.opendev.org/c/openstack/kolla-ansible/+/989614 | 01:45 |
| opendevreview | Kim soo proposed openstack/kolla-ansible master: cloudkitty: set cafile for Gnocchi collector https://review.opendev.org/c/openstack/kolla-ansible/+/999042 | 04:05 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Add Aetos ansible role https://review.opendev.org/c/openstack/kolla-ansible/+/997522 | 05:33 |
| opendevreview | Merged openstack/kolla-ansible stable/2026.1: keystone: allow multiple OIDCXForwardedHeaders options https://review.opendev.org/c/openstack/kolla-ansible/+/998900 | 07:29 |
| opendevreview | Merged openstack/kolla-ansible stable/2025.2: keystone: allow multiple OIDCXForwardedHeaders options https://review.opendev.org/c/openstack/kolla-ansible/+/998910 | 07:29 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Add Aetos ansible role https://review.opendev.org/c/openstack/kolla-ansible/+/997522 | 07:29 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999052 | 07:32 |
| fprzewozn | mnasiadka It looks like opensearch password is now leaking to logs with https://review.opendev.org/c/openstack/kolla-ansible/+/998813 merged: kolla-ansible-check: Test for leaked passwords in journal - Leaked secrets found in journal for 1 variable(s): opensearch_dashboards_password. | 07:40 |
| mnasiadka | Great, that means we need opensearch jobs to be voting ;) | 07:41 |
| mnasiadka | Can you propose a revert of that patch? | 07:42 |
| fprzewozn | Sure thing | 07:42 |
| opendevreview | Lukasz Chrustek proposed openstack/kolla-ansible stable/2026.1: [stable-only] Add precheck for legacy Nova mount base https://review.opendev.org/c/openstack/kolla-ansible/+/999058 | 07:48 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Revert "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999060 | 07:48 |
| fprzewozn | mnasiadka https://review.opendev.org/c/openstack/kolla-ansible/+/999060 | 07:49 |
| fprzewozn | job successfully failed :) | 07:49 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible stable/2026.1: Revert "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999061 | 07:51 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: [WIP] Bump ansible version https://review.opendev.org/c/openstack/kayobe/+/995021 | 08:31 |
| *** jhorstmann is now known as Guest14355 | 08:40 | |
| opendevreview | Merged openstack/kolla-ansible stable/2026.1: Revert "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999061 | 08:45 |
| opendevreview | Merged openstack/kolla-ansible master: Revert "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999060 | 08:50 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Add Aetos ansible role https://review.opendev.org/c/openstack/kolla-ansible/+/997522 | 08:51 |
| fprzewozn | mnasiadka we're good now, no longer leaked OpenSearch password errors appear | 08:52 |
| mnasiadka | fprzewozn: thanks | 09:10 |
| opendevreview | Bartosz Bezak proposed openstack/kolla-ansible master: CI: add opensearch jobs to gate https://review.opendev.org/c/openstack/kolla-ansible/+/999072 | 09:17 |
| opendevreview | Bartosz Bezak proposed openstack/kolla-ansible master: CI: add opensearch jobs to gate and make them voting https://review.opendev.org/c/openstack/kolla-ansible/+/999072 | 09:22 |
| opendevreview | Rafal Lewandowski proposed openstack/kayobe master: [WIP] Bump ansible version https://review.opendev.org/c/openstack/kayobe/+/995021 | 10:12 |
| blanson[m] | I won't be able to attend this PM's meeting, will be stuck in client meeting all afternoon | 11:16 |
| mnasiadka | Ah, it’s Wed, geez | 11:17 |
| blanson[m] | yh my neurons connected also about 5 minutes ago | 11:19 |
| tafkamax | blanson[m]: Neutron-metadata-agent ⛔ | 11:22 |
| tafkamax | Neuron-metadata-agent ✅ | 11:22 |
| opendevreview | Merged openstack/kayobe master: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999052 | 11:38 |
| opendevreview | Merged openstack/kolla-ansible master: Fix MariaDB cluster recovery https://review.opendev.org/c/openstack/kolla-ansible/+/998864 | 11:38 |
| opendevreview | Merged openstack/kolla-ansible master: CI: add opensearch jobs to gate and make them voting https://review.opendev.org/c/openstack/kolla-ansible/+/999072 | 11:38 |
| opendevreview | Merged openstack/kolla-ansible stable/2026.1: cinder: Define backend variables in group_vars/all https://review.opendev.org/c/openstack/kolla-ansible/+/999000 | 11:39 |
| opendevreview | Kurt Bendl proposed openstack/kolla-ansible master: DNM: selinux security_opt and policy generation https://review.opendev.org/c/openstack/kolla-ansible/+/986399 | 11:47 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: cinder: Add support for multiple NFS backends https://review.opendev.org/c/openstack/kolla-ansible/+/998453 | 11:49 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add smallstep-ca image https://review.opendev.org/c/openstack/kolla/+/999090 | 11:58 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Fix error when failing to retrieve inspection rule https://review.opendev.org/c/openstack/kayobe/+/999091 | 12:02 |
| kevko | mnasiadka: started to work little bit on letsencrypt (our customer wants dns challenge and i've seen some patches are waiting in queue - not from me) ...but it's already some time i know CI which is testing the LE is broken (passing - but in fact it's not working - I know it because i using it in my testing stacks and have a patch for it | 12:08 |
| kevko | https://review.opendev.org/c/openstack/kolla-ansible/+/988728 <<) ....the reason is that letsencrypt-lego was replaced by http image (your change if you remember) .... so extend start dissapeared and logic with directory creations dissapeared ... here is example https://zuul.opendev.org/t/openstack/build/2ee9ddbdda1346bb84562d1e1f999d53 .... and | 12:08 |
| kevko | inside build logs this one https://fc1836e0795677ee5f1d-07ce942d3c1e47ab31f08fdc85c36f17.ssl.cf1.rackcdn.com/openstack/2ee9ddbdda1346bb84562d1e1f999d53/primary/logs/container_logs/letsencrypt_webserver.txt .... >>> AH00112: Warning: DocumentRoot [/etc/letsencrypt/http-01] does not exist | 12:08 |
| kevko | mnasiadka: to help author with LE dns challenge i wanted to give some love to the LE tests ... but found that we are not checking container_logs ...is it enough implement check container logs ? something similar as check-logs which are checking kolla-logs ? | 12:09 |
| kevko | or better create test-letsencrypt and don't deploy everything but haproxy+pebble+letsencrypt and write some check ? | 12:11 |
| mnasiadka | Doing that in check-logs.sh is fine most probably - don’t we check all container statuses - which would probably mean this one has exited and should raise an error in the CI? | 12:23 |
| opendevreview | Seunghun Lee proposed openstack/kolla-ansible master: Get current endpoint when reconfiguring etcd https://review.opendev.org/c/openstack/kolla-ansible/+/999096 | 12:25 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2026.1: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999104 | 12:42 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.2: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999105 | 12:43 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999106 | 12:43 |
| * frickler also won't be around for the meeting, will catch up later | 12:46 | |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible master: Revert^2 "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999109 | 12:47 |
| opendevreview | Alex Welsh proposed openstack/kolla-ansible master: Revert^2 "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999109 | 12:50 |
| mnasiadka | bbezak frickler kevko mmalchuk gkoper jovial mattcrees dougszu darmach pabloclsn ravlew salmankh amir58118 r-krcek blanson[m] fprzewozn - meeting in 8 minutes | 12:52 |
| kevko | mnasiadka: well, actually container will be running and looks like it's ok ...but get to http://192.0.2.1:8081/.well-known/acme-challenge/whatever will just return 404 Not Found ... | 12:53 |
| opendevreview | Michal Nasiadka proposed openstack/ansible-collection-kolla master: packages: Install kernel-modules-extra on RedHat family https://review.opendev.org/c/openstack/ansible-collection-kolla/+/998441 | 12:54 |
| mnasiadka | kevko: should we have a healthcheck that does that curl? | 12:55 |
| ravlew | o/ | 12:55 |
| priteau | Trivial precheck cleanup waiting for reviews: https://review.opendev.org/c/openstack/kolla-ansible/+/998104 | 12:58 |
| mnasiadka | #startmeeting kolla | 13:00 |
| opendevmeet | Meeting started Wed Jul 29 13:00:34 2026 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:00 |
| opendevmeet | The meeting name has been set to 'kolla' | 13:00 |
| mnasiadka | #topic rollcall | 13:00 |
| mnasiadka | o/ | 13:00 |
| opendevreview | Merged openstack/kolla-ansible master: glance: add enable_cinder_backend_privileged for cinder store https://review.opendev.org/c/openstack/kolla-ansible/+/961235 | 13:00 |
| priteau | \o | 13:00 |
| fprzewozn | o/ | 13:01 |
| bbezak | O/ | 13:01 |
| butjar[mit] | o/ | 13:01 |
| kevko | mnasiadka: yeah, we can | 13:01 |
| kevko | mnasiadka: but i am not sure if job fail if healthech of docker container reporting unhealthy ? | 13:02 |
| kbendl | o/ | 13:02 |
| kevko | \o | 13:02 |
| mnasiadka | kevko: we have a script for checking if all containers are healthy | 13:03 |
| mnasiadka | (In CI) | 13:03 |
| mnasiadka | And blanson[m] has some patch to wait on kolla_container actions until container is healthy | 13:03 |
| mnasiadka | #topic agenda | 13:03 |
| mnasiadka | * Current cycle planning | 13:03 |
| mnasiadka | * Additional agenda (from whiteboard) | 13:03 |
| mnasiadka | * Open discussion | 13:03 |
| mnasiadka | #topic Current cycle planning | 13:04 |
| mnasiadka | Ok, let’s start with that | 13:04 |
| mnasiadka | I posted ansible bump patches, I think the Kolla one went through, the K-A one not yet | 13:04 |
| mnasiadka | #link https://review.opendev.org/c/openstack/kolla-ansible/+/996745 | 13:04 |
| mnasiadka | I rechecked it | 13:04 |
| mnasiadka | ravlew: you’re working on the Kayobe one? | 13:05 |
| ravlew | indeed I am | 13:05 |
| mnasiadka | ok | 13:06 |
| mnasiadka | RMQ bump is in | 13:06 |
| mnasiadka | I think we should bump MariaDB as well | 13:06 |
| mnasiadka | Ok then, any other features somebody is working on and need reviews? | 13:07 |
| fprzewozn | Yeah | 13:08 |
| fprzewozn | https://review.opendev.org/c/openstack/kolla-ansible/+/997522 + https://review.opendev.org/c/openstack/kolla/+/997478 | 13:08 |
| fprzewozn | and https://review.opendev.org/c/openstack/kolla-ansible/+/998453 | 13:08 |
| fprzewozn | aetos and multi nfs backend | 13:08 |
| mnasiadka | Ok, Aetos - while I can understand it’s use - what tenant level metrics are we exposing today that are usable through it? | 13:11 |
| fprzewozn | node exporter works right away, ceilometer ones still require pushgateway in standard way, but can be replaced with two recording rules in prometheus, giving f.e. watcher complete set of metrics needed for balancing | 13:12 |
| fprzewozn | recording rules that are gathering metrics from libvirt_exporter | 13:13 |
| mnasiadka | I don’t think we have a ready out of the box config for ceilometer and pushgateway - but it might be a nice replacement / alternative for openstack-exporter? | 13:13 |
| fprzewozn | yeah, it's not currently present in Kolla | 13:14 |
| mnasiadka | Would be a nice improvement | 13:14 |
| dougszu | pushgateway we dropped a while ago, because it doesn't work like you expect | 13:14 |
| fprzewozn | I'll be trying to change Watcher code so it will utilise libvirt metrics directly, so there will be room for selection | 13:14 |
| mnasiadka | Regarding watcher - I don’t think we have any CI scenarios testing watcher - so maybe putting that together in one scenario is a nice long term plan | 13:14 |
| mnasiadka | (If we care for it) | 13:15 |
| fprzewozn | adding pushgateway and requiring ceilometer is not required at all here, it can all be done with libvirt_exporter and prometheus | 13:15 |
| dougszu | cool, | 13:15 |
| fprzewozn | but it needs a bit of changes in watcher itself first :) | 13:15 |
| fprzewozn | aetos itself is running fine there with code I've uploaded | 13:16 |
| opendevreview | Merged openstack/kolla-ansible master: Remove old enable_ceph precheck https://review.opendev.org/c/openstack/kolla-ansible/+/998104 | 13:16 |
| fprzewozn | I've added support for password based auth (in Aetos code) recently, so it nicely fits Kolla default config for prometheus | 13:16 |
| mnasiadka | Ok, thanks fprzewozn for the background - I’ll have a look in Aetos patches | 13:18 |
| fprzewozn | thanks | 13:19 |
| mnasiadka | We sort of discussed the open topics from the whiteboard | 13:19 |
| mnasiadka | So let’s go directly to open discussion | 13:19 |
| mnasiadka | #topic Open discussion | 13:19 |
| dougszu | I started the patch for Ironic multi-conductor: https://review.opendev.org/c/openstack/kolla-ansible/+/995977 | 13:19 |
| mnasiadka | Anybody anything? | 13:19 |
| ravlew | I'm looking for another pair of core eyes if anyone would be so kind: | 13:20 |
| ravlew | https://review.opendev.org/c/openstack/kolla-ansible/+/969053 | 13:20 |
| dougszu | Basically on the above - I added it before the AI policy, but it is mirrored directly on the nova-multi-compute-ironic patch which did not use AI - so hopefully that is acceptable | 13:20 |
| ravlew | https://review.opendev.org/c/openstack/kayobe/+/997692 | 13:20 |
| mnasiadka | dougszu: we’ll have a look, but if you just copied some existing approach that’s probably not significant work ;-) | 13:21 |
| dougszu | thanks, yeh, that it my thought at least - there is no copywrite risk | 13:23 |
| dougszu | or copyright should I say | 13:23 |
| mnasiadka | yup | 13:24 |
| mnasiadka | Ok then | 13:24 |
| mnasiadka | If there’s nothing more - I’ll give you back 36 minutes of your lives | 13:24 |
| mnasiadka | Thank you all for coming | 13:24 |
| mnasiadka | #endmeeting | 13:24 |
| opendevmeet | Meeting ended Wed Jul 29 13:24:29 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 13:24 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2026/kolla.2026-07-29-13.00.html | 13:24 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2026/kolla.2026-07-29-13.00.txt | 13:24 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2026/kolla.2026-07-29-13.00.log.html | 13:24 |
| blanson[m] | kevko: https://review.opendev.org/c/openstack/kolla-ansible/+/986237 it has conflict but it should work ? | 13:55 |
| blanson[m] | maybe ? | 13:55 |
| blanson[m] | I need to resolve it | 13:55 |
| kevko | blanson[m]: w8 a minute | 13:57 |
| kevko | blanson[m]: can I resolve ? | 13:58 |
| blanson[m] | hum yh sure go ahead | 13:58 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Add wait_for_healthy check to container workers https://review.opendev.org/c/openstack/kolla-ansible/+/986237 | 14:05 |
| kevko | blanson[m]: this should work of course, but it was conflicting with timezone patch which wasn't mine :) ..but hope resolved good | 14:06 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: DNM: test wait_for_healthy behavior https://review.opendev.org/c/openstack/kolla-ansible/+/988415 | 14:06 |
| kevko | blanson[m]: btw, nice idea :) | 14:40 |
| opendevreview | Michal Arbet proposed openstack/kolla master: Add smallstep-ca image https://review.opendev.org/c/openstack/kolla/+/999090 | 14:47 |
| opendevreview | Seunghun Lee proposed openstack/kolla-ansible master: Get current endpoint when reconfiguring etcd https://review.opendev.org/c/openstack/kolla-ansible/+/999096 | 16:42 |
| opendevreview | Merged openstack/kayobe stable/2025.2: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999105 | 16:54 |
| opendevreview | Merged openstack/ansible-collection-kolla master: packages: Install kernel-modules-extra on RedHat family https://review.opendev.org/c/openstack/ansible-collection-kolla/+/998441 | 16:55 |
| opendevreview | Merged openstack/kayobe stable/2026.1: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999104 | 16:55 |
| opendevreview | Merged openstack/kayobe stable/2025.1: CI: Install correct kernel-modules-extra version https://review.opendev.org/c/openstack/kayobe/+/999106 | 16:57 |
| blanson[m] | kevko: thanks ! yh ideally I'd like to make a proper restart with like, disabling/enabling haproxy backends when upgrading | 18:14 |
| blanson[m] | but that's a story for another time | 18:14 |
| opendevreview | Merged openstack/kayobe master: Fix error when failing to retrieve inspection rule https://review.opendev.org/c/openstack/kayobe/+/999091 | 18:27 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2026.1: Fix error when failing to retrieve inspection rule https://review.opendev.org/c/openstack/kayobe/+/999171 | 18:42 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.2: Fix error when failing to retrieve inspection rule https://review.opendev.org/c/openstack/kayobe/+/999172 | 18:43 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: Fix error when failing to retrieve inspection rule https://review.opendev.org/c/openstack/kayobe/+/999173 | 18:43 |
| opendevreview | Merged openstack/kolla-ansible master: Revert^2 "Ensure OpenSearch waits for recovery during upgrade" https://review.opendev.org/c/openstack/kolla-ansible/+/999109 | 18:59 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Fix support matrix note about Rocky Linux 9 https://review.opendev.org/c/openstack/kayobe/+/999190 | 20:51 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Update guidance about install method https://review.opendev.org/c/openstack/kayobe/+/999194 | 21:06 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!