| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/2026.1: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989452 | 04:34 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989435 | 04:34 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989435 | 04:37 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/2026.1: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989452 | 04:37 |
| mnasiadka | blanson[m], bbezak, frickler: gate unblocker - https://review.opendev.org/c/openstack/kolla-ansible/+/989452 | 04:38 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible stable/2026.1: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989452 | 06:07 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Replace /etc/localtime bind mount with TZ env variable https://review.opendev.org/c/openstack/kolla-ansible/+/989435 | 06:07 |
| opendevreview | Merged openstack/kayobe master: [release] Sync with Kolla Ansible for 2026.1 https://review.opendev.org/c/openstack/kayobe/+/989458 | 06:34 |
| opendevreview | Merged openstack/kayobe master: Fix broken conditional release note formatting https://review.opendev.org/c/openstack/kayobe/+/989437 | 07:28 |
| blanson[m] | mnasiadka: still needs merging on master or the docker release fixes all ? | 07:41 |
| mnasiadka | It doesn’t need, but I think it’s a nice improvement to not bind mount /etc/localtime ;) | 07:42 |
| blanson[m] | agreed | 07:45 |
| blanson[m] | unexpected feature :D | 07:45 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989487 | 07:57 |
| blanson[m] | https://bugs.launchpad.net/kolla-ansible/+bug/2153544 mnasiadka that's a pretty funny one I have 0 idea as to why my specific setup breaks | 08:34 |
| tafkamax | Hi I have a question from you operators. We are planning upgrades for the summer and are thinking how to do it. Because last year it went terribly wrong, because we actually changing our setup to a supported setup. Anyway. I would like to do the upgrade using --limit so first of all using --limit control and then doing compute nodes via --limit so all I can migrate VM-s from compute-to-compute. Do you do something like that or bring | 08:35 |
| tafkamax | down the whole cluster so no VM-s are running? | 08:35 |
| opendevreview | Leonie Chamberlin-Medd proposed openstack/kayobe master: Deploy more containers https://review.opendev.org/c/openstack/kayobe/+/922402 | 08:36 |
| blanson[m] | documentation says --limit on upgrade is a bit dangerous, but I assume that if you do the entire control plane first, this would be safe ? I would've advised to do as you suggested, --limit control then maybe --limit network if you have dedicated network nodes, then afaik you can restart services in place on compute nodes but I'm unsurewith k-a. safety net would be to empty portions at a time, upgrade, then move on ? | 08:39 |
| tafkamax | if I do a full upgrade then VM-s restart am I right? | 08:40 |
| tafkamax | e.g. --limit compute | 08:40 |
| blanson[m] | afaik you don't have to restart anything, we did upgrades (tho not k-a but still upgraded the entire cluster), and nothing needed restart afterward on the client side. VMs may lose connectivity for a while when ovs repopulates the local vswitch but that's about it ? | 08:42 |
| tafkamax | hmm okay | 08:42 |
| tafkamax | for computes we do --stop compute-node and then do upgrades on it. | 08:42 |
| tafkamax | e.g. packages, firmware so-on | 08:42 |
| tafkamax | and that works fine | 08:43 |
| tafkamax | not K-A upgrades though | 08:44 |
| opendevreview | Leonie Chamberlin-Medd proposed openstack/kayobe master: Deploy more containers https://review.opendev.org/c/openstack/kayobe/+/922402 | 08:44 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 08:46 |
| mnasiadka | blanson[m]: I’m still amazed it works in CI and doesn’t on your env | 08:47 |
| mnasiadka | blanson[m]: do you have some overrides on kolla-toolbox image, or what the heck? | 08:47 |
| blanson[m] | I have no idea how I broke it yes it's quite fascinating | 08:48 |
| blanson[m] | no I'm using the quay images | 08:48 |
| blanson[m] | the only "unsupported thing I do is running the deployment from arch instead of a supported OS, but that should virtually have 0 impact on this specific thing | 08:49 |
| blanson[m] | everything else is completely standard, debian13 or ubuntu2404 VMs, upstream test images, everything is following the documentation lol | 08:50 |
| opendevreview | Bertrand Lanson proposed openstack/kolla-ansible master: fix kolla_toolbox running with wrong HOME env https://review.opendev.org/c/openstack/kolla-ansible/+/989493 | 09:11 |
| opendevreview | Leonie Chamberlin-Medd proposed openstack/kayobe master: Deploy more containers https://review.opendev.org/c/openstack/kayobe/+/922402 | 09:12 |
| *** jhorstmann is now known as Guest9871 | 09:51 | |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Switch to CentOS Stream 10 IPA images https://review.opendev.org/c/openstack/kayobe/+/965243 | 10:09 |
| opendevreview | Merged openstack/kayobe-config-dev master: CI: Sync jobs with kayobe https://review.opendev.org/c/openstack/kayobe-config-dev/+/989421 | 10:16 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Synchronise IPA documentation with defaults https://review.opendev.org/c/openstack/kayobe/+/989503 | 10:31 |
| opendevreview | Matt Crees proposed openstack/kayobe master: Deploy more containers https://review.opendev.org/c/openstack/kayobe/+/922402 | 11:51 |
| opendevreview | Verification of a change to openstack/kayobe master failed: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989487 | 11:59 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 12:23 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 12:30 |
| Sylvr_ | Hello everypony :) I'm trying to deploy kayobe with a seed-vm (with the Ansible Control Host acting as the Seed Hypervisor too), when configuring the firmware as bios the seed-vm is stuck in a boot loop (I see grub trying to boot but it loops), as efi it crashes (X64 Exception Type - 06(#UD - Invalid Opcode) CPU Apic ID) | 12:34 |
| Sylvr_ | At first, I thought it was because I didn't specify LVM setup for the seed-hypervisor, and wrongfully tried to fix it by writing the configuration for LVM/libvirt pool manually, but it did not fix the issue. Could it be caused by the hardware being to old ? Should I just abandon with the seed-vm setup ? | 12:37 |
| priteau | Sylvr_: which OS are you using? | 12:37 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 12:43 |
| Loan | Hi, I submitted a small bug fix at https://review.opendev.org/c/openstack/kolla-ansible/+/987365 — could someone take a look? It's been open for 16 days. | 12:46 |
| opendevreview | Bertrand Lanson proposed openstack/kolla-ansible master: fix kolla_toolbox running with wrong HOME env https://review.opendev.org/c/openstack/kolla-ansible/+/989493 | 12:50 |
| opendevreview | Merged openstack/kolla-ansible master: ironic: remove ironic-inspector migration tasks https://review.opendev.org/c/openstack/kolla-ansible/+/988667 | 13:03 |
| *** ChanServ changes topic to "IRC meetings on Wednesdays @ 13:00 UTC - https://docs.openstack.org/kolla/latest/contributor/meeting.html | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b" | 13:36 | |
| mnasiadka | blanson[m]: any chance to have a unit test that would replicate the failure? | 13:46 |
| mnasiadka | Loan: 16 days is not that long, and we’ve been busy releasing 2026.1 | 13:46 |
| blanson[m] | mnasiadka: good point, let me see if I can break it on purpose or if it's just dark magic | 13:47 |
| Vii | for information: there is a memory leak in horizon after switching to uwsgi | 13:48 |
| Vii | on my DEV ENV horizon eats 24gb | 13:48 |
| Vii | tests various ways to limit his memory | 13:48 |
| Vii | horizon:2025.2-ubuntu-noble Up 23 hours (healthy) | 13:50 |
| mnasiadka | Well, have you raised that with Horizon folks? | 13:50 |
| Vii | horizon 0.13% 7.021GiB / 47.05GiB | 13:50 |
| Vii | horizon:2025.2-ubuntu-noble Up 1 weeks (healthy) | 13:51 |
| Vii | horizon 1.01% 25.98GiB / 47.05GiB | 13:52 |
| Vii | not yet, tests: uwsgi reload-on-rss, limit-as etc | 13:52 |
| opendevreview | Loan Harrouin proposed openstack/kolla-ansible master: Fix Docker cpuset dimension comparison https://review.opendev.org/c/openstack/kolla-ansible/+/987365 | 13:59 |
| tafkamax | I checked my horizon usage and its at 975MB | 14:06 |
| tafkamax | docker container stats horizon | 14:06 |
| Vii | uWSGI? 2025.2 | 14:06 |
| tafkamax | and 550mb on other cluster | 14:06 |
| tafkamax | 2025.2 | 14:06 |
| tafkamax | I think uwsgi if its default, I havent changed it. | 14:06 |
| tafkamax | yeah uwsgi shows docker logs | 14:07 |
| tafkamax | * docker logs horizon | 14:07 |
| Vii | but we may not have the same dashboards loaded | 14:07 |
| tafkamax | true | 14:07 |
| tafkamax | You mean themes or dashboard extensions/plugins? | 14:08 |
| tafkamax | We dont run octavia/magnum/masakari. I don't know what else has UI components :D | 14:08 |
| Vii | i have octavia | 14:08 |
| Vii | masakari too | 14:09 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 14:18 |
| Sylvr_ | priteau : My Ansible Control Host/Seed-Hypervisor is running Ubuntu server24.04 | 14:20 |
| opendevreview | Will Szumski proposed openstack/kayobe master: [CI] Improve network connectivity check https://review.opendev.org/c/openstack/kayobe/+/986145 | 14:40 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: Allow to continue when some hosts are unreachable https://review.opendev.org/c/openstack/kayobe/+/910509 | 14:46 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: DNM: Test --continue-on-unreachable https://review.opendev.org/c/openstack/kayobe/+/910511 | 14:46 |
| opendevreview | aydin tabatabaei proposed openstack/kolla-ansible master: prometheus: fix custom alertmanager config Jinja2 conflict https://review.opendev.org/c/openstack/kolla-ansible/+/988445 | 14:53 |
| opendevreview | Piotr Milewski proposed openstack/kolla-ansible master: Remove obsolete settings from Horizon config https://review.opendev.org/c/openstack/kolla-ansible/+/989547 | 15:06 |
| opendevreview | Merged openstack/kayobe master: Deploy more containers https://review.opendev.org/c/openstack/kayobe/+/922402 | 15:10 |
| opendevreview | Merged openstack/kolla-ansible master: mariadb: remove clustercheck container removal https://review.opendev.org/c/openstack/kolla-ansible/+/988668 | 15:11 |
| opendevreview | Merged openstack/kayobe master: Synchronise IPA documentation with defaults https://review.opendev.org/c/openstack/kayobe/+/989503 | 15:11 |
| opendevreview | Verification of a change to openstack/kayobe master failed: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989487 | 15:20 |
| priteau | Sylvr: And the hardware, is it recent? | 15:41 |
| opendevreview | Piotr Milewski proposed openstack/kolla-ansible master: Silence healthcheck requests in uWSGI logs https://review.opendev.org/c/openstack/kolla-ansible/+/989557 | 15:49 |
| opendevreview | Piotr Milewski proposed openstack/kolla-ansible master: Silence health checks and OPTIONS requests in uWSGI logs https://review.opendev.org/c/openstack/kolla-ansible/+/989557 | 15:59 |
| opendevreview | Merged openstack/kayobe master: Stop caching kolla_ansible_host_vars facts https://review.opendev.org/c/openstack/kayobe/+/986621 | 16:22 |
| opendevreview | Merged openstack/kayobe master: CI: Replace use of deprecated cp -n option https://review.opendev.org/c/openstack/kayobe/+/989359 | 16:22 |
| opendevreview | Merged openstack/kayobe master: tests: trim low-signal nmstate unit test permutations https://review.opendev.org/c/openstack/kayobe/+/987824 | 16:22 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [DNM] Enhance TLS configuration and certificate handling in Kolla https://review.opendev.org/c/openstack/kolla-ansible/+/937108 | 16:32 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Add let's encrypt support for ProxySQL https://review.opendev.org/c/openstack/kolla-ansible/+/936922 | 16:34 |
| opendevreview | Will Szumski proposed openstack/kayobe-config master: [2026.1] Synchronise config with kayobe https://review.opendev.org/c/openstack/kayobe-config/+/989581 | 17:22 |
| opendevreview | Merged openstack/kolla-ansible master: glance: remove tls-proxy container removal https://review.opendev.org/c/openstack/kolla-ansible/+/988669 | 17:33 |
| opendevreview | Merged openstack/kolla-ansible master: neutron: remove tls-proxy leftovers after G cycle https://review.opendev.org/c/openstack/kolla-ansible/+/988670 | 17:33 |
| opendevreview | Merged openstack/kolla-ansible master: tests: remove keystone apache log exclusion https://review.opendev.org/c/openstack/kolla-ansible/+/988671 | 17:33 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [DNM] Check drain while upgrading rabbitmq https://review.opendev.org/c/openstack/kolla-ansible/+/951133 | 17:35 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [DNM] Allow enabling both novnc and spice consoles simultaneously https://review.opendev.org/c/openstack/kolla-ansible/+/966111 | 17:36 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: [DNM] Add service-api-paste role for api-paste.ini management https://review.opendev.org/c/openstack/kolla-ansible/+/952700 | 17:37 |
| opendevreview | Michal Arbet proposed openstack/kolla-ansible master: Make Ceph keyring extraction compatible with variable substitution https://review.opendev.org/c/openstack/kolla-ansible/+/965471 | 17:40 |
| opendevreview | Hao Wang proposed openstack/kolla-ansible master: Support deploy Zaqar with kolla-ansible https://review.opendev.org/c/openstack/kolla-ansible/+/892615 | 17:42 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: Bind inspection store to internal network https://review.opendev.org/c/openstack/kayobe/+/989586 | 17:54 |
| opendevreview | Will Szumski proposed openstack/kayobe-config-dev master: Synchronize config for 2026.1 https://review.opendev.org/c/openstack/kayobe-config-dev/+/989587 | 17:56 |
| opendevreview | Merged openstack/kayobe master: [CI] Improve network connectivity check https://review.opendev.org/c/openstack/kayobe/+/986145 | 18:01 |
| opendevreview | Merged openstack/kayobe master: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989487 | 18:54 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: Bind inspection store to internal network https://review.opendev.org/c/openstack/kayobe/+/989586 | 19:21 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.2: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989606 | 19:22 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: Revert "CI: Exclude docker-ce 29.5.1 on CentOS/Rocky Linux" https://review.opendev.org/c/openstack/kayobe/+/989607 | 19:22 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Make the MariaDB WSREP sync wait defensive. https://review.opendev.org/c/openstack/kolla-ansible/+/989612 | 19:39 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Allow requiring secure channels with SPICE https://review.opendev.org/c/openstack/kolla-ansible/+/967802 | 19:40 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Deploy Kerbside with Kolla-Ansible. https://review.opendev.org/c/openstack/kolla-ansible/+/976889 | 19:40 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Use a routable IP for qemu SPICE consoles. https://review.opendev.org/c/openstack/kolla-ansible/+/967801 | 19:40 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Add kerbside CI scenario jobs. https://review.opendev.org/c/openstack/kolla-ansible/+/988189 | 19:40 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Run the spice-direct tempest test in the kerbside scenario. https://review.opendev.org/c/openstack/kolla-ansible/+/988913 | 19:40 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Run a Kerbside-fronted SPICE tempest test in the kerbside scenario. https://review.opendev.org/c/openstack/kolla-ansible/+/989614 | 19:40 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2025.1: Bind inspection store to internal network https://review.opendev.org/c/openstack/kayobe/+/989586 | 20:37 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!