| opendevreview | Verification of a change to openstack/kolla-ansible stable/2025.2 failed: Fix OVN SB relay port calculation for relay counts > 9 https://review.opendev.org/c/openstack/kolla-ansible/+/993718 | 01:44 |
|---|---|---|
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 05:16 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 05:22 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 05:24 |
| mnasiadka | blanson[m]: ^^ that should be good now, I managed to not break anything now ;) | 05:25 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 06:06 |
| mnasiadka | or I did ;) | 06:06 |
| tafkamax | OK so we are almost ready to upgrade our 2025.1 clusters to 2025.2, our test cluster migration worked except neutron-ovn-metadata, that service seems to be flapping on one compute node and on the other it is constantly in a down state. | 06:46 |
| tafkamax | So I understand in 2025.1 -> 2025.2 the neutron-ovn-agent was split into pieces so the metadata agent wouldn't affect the whole networking being part of the neutron-ovn-agent. | 06:47 |
| tafkamax | We have deployed fresh 2025.2 clusters where all is ok, but we havent done an upgrade yet from 2025.1 | 06:47 |
| Vii | I upgraded a few test envs 2025.1 -> 2025.2 and had no problems with ovn. You need to check the logs | 06:48 |
| tafkamax | hmm I ran the RMQ script to fix the fanout thingys | 07:05 |
| tafkamax | this seems to have helped, also the ctrl-s were close to OOM | 07:05 |
| Vii | During the upgrade... I enabled the services... I set the queue deletion policy to rbmq... and the upgrade... after the start I had new queues... I disabled the deletion policy | 07:07 |
| tafkamax | How do you set the queue deletion policy? Is there a docs link? | 07:07 |
| Vii | rabbitmqctl set_policy expiry ".*" '{"expires":60000}' --apply-to queues | 07:10 |
| Vii | after 1 minute they will be deleted | 07:10 |
| Vii | https://www.rabbitmq.com/docs/policies | 07:11 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 07:14 |
| tafkamax | Vii: thx! | 07:15 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 07:25 |
| tafkamax | I have a question regarding neutron_ovn_agent https://docs.openstack.org/kolla-ansible/latest/reference/networking/neutron.html#ovn-ml2-ovn | 07:30 |
| tafkamax | Do we need to to update the docs? AFAIK in 2025.2 the ovn_agent takes over more jobs than just qos and hw-offload? mnasiadka | 07:30 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 07:51 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 08:00 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Remove cgi-bin creation in gnocchi and masakari https://review.opendev.org/c/openstack/kolla/+/993880 | 08:01 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: CI: add Rocky 10 aarch64 jobs https://review.opendev.org/c/openstack/kayobe/+/992288 | 08:04 |
| opendevreview | Bartosz Bezak proposed openstack/kayobe master: CI: add Rocky 10 aarch64 jobs https://review.opendev.org/c/openstack/kayobe/+/992288 | 08:04 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 08:17 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: neutron: Remove legacy upgrade logic https://review.opendev.org/c/openstack/kolla-ansible/+/992880 | 08:33 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: neutron: Split neutron role into neutron and neutron-agents https://review.opendev.org/c/openstack/kolla-ansible/+/975614 | 08:33 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: neutron: Drop DHCP agent support in ML2/OVN deployments https://review.opendev.org/c/openstack/kolla-ansible/+/992881 | 08:33 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 08:54 |
| *** jhorstmann is now known as Guest11543 | 09:23 | |
| opendevreview | Jed Preist proposed openstack/kolla stable/2025.2: [2025.2 and older] Create Ironic temp directory https://review.opendev.org/c/openstack/kolla/+/993769 | 09:24 |
| mnasiadka | blanson[m]: I think https://review.opendev.org/c/openstack/kolla/+/993034 is good to merge now | 09:40 |
| blanson[m] | damn everything fixed already I reviewed this way too late last night | 09:41 |
| mnasiadka | haha | 09:46 |
| blanson[m] | yh this looks okay to me, we use podman builds so I'm not super familiar with buildkit | 09:48 |
| mnasiadka | We don’t use podman at all currently | 09:48 |
| mnasiadka | That reminds me about https://review.opendev.org/c/openstack/kolla-ansible/+/993094 | 09:49 |
| blanson[m] | but logic-wise it is sound | 09:49 |
| blanson[m] | oh I saw you fixed this one aswell | 09:49 |
| blanson[m] | guess I forgot to +2 again | 09:49 |
| blanson[m] | oh no I did +2, it got reset | 09:50 |
| blanson[m] | re +2'd | 09:50 |
| mnasiadka | Btw blanson[m] - is that known to you: https://zuul.opendev.org/t/openstack/build/6be75ae3f72a44bfa7e5a794d4747ced/log/primary/logs/ansible/reconfigure#24159 ? | 09:51 |
| mnasiadka | Podman seems to translate "/:/host:ro,rslave", to "/:/host:rprivate,rw,rbind", ? | 09:51 |
| mnasiadka | Or do we do that in kolla_container? | 09:51 |
| blanson[m] | nope | 09:53 |
| blanson[m] | on trixie so it's a fairly recent podman | 09:53 |
| blanson[m] | I can have a look in kolla_container | 09:54 |
| blanson[m] | but I don't recall running into this | 09:54 |
| mnasiadka | That blocks switch to OVN as default for now | 09:54 |
| mnasiadka | So I might dig that on my own | 09:54 |
| mnasiadka | ;) | 09:54 |
| blanson[m] | how does that only trigger in this specific context ? | 09:59 |
| mnasiadka | Because we only have aio podman jobs, and we enable prometheus in them to test network exporter :) | 10:09 |
| blanson[m] | yh but I mean it should fail elsewhere than your ovn patch no ? or does it not run often enough that we had the issue yet ? | 10:14 |
| mnasiadka | It doesn’t run at all with podman right now | 10:21 |
| blanson[m] | hmmm | 10:24 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: Add support for VAST Cinder driver https://review.opendev.org/c/openstack/kolla-ansible/+/959524 | 10:54 |
| opendevreview | Merged openstack/kolla-ansible master: kolla_container/podman: Create bind mounted directories if they don't exist https://review.opendev.org/c/openstack/kolla-ansible/+/993094 | 11:26 |
| opendevreview | Merged openstack/kolla master: kolla-build: Add Docker BuildKit support via docker buildx build https://review.opendev.org/c/openstack/kolla/+/993034 | 11:26 |
| mnasiadka | blanson[m]: that means prometheus_node_exporter with new enough podman is a bit broken ;) | 11:35 |
| opendevreview | Dawud proposed openstack/kolla-ansible master: prometheus: Fix Grafana blackbox endpoint checks https://review.opendev.org/c/openstack/kolla-ansible/+/988713 | 11:36 |
| opendevreview | Merged openstack/kolla-ansible master: Set Ironic tempdir https://review.opendev.org/c/openstack/kolla-ansible/+/993343 | 11:37 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: neutron: Switch neutron_plugin_agent default to ovn https://review.opendev.org/c/openstack/kolla-ansible/+/970114 | 11:38 |
| blanson[m] | mnasiadka: I'll test this in a trixie vm real quick | 11:39 |
| blanson[m] | if it's a genuine podman bug or smthg we're doing wrong | 11:40 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Remove cgi-bin creation in gnocchi and masakari https://review.opendev.org/c/openstack/kolla/+/993880 | 11:55 |
| mnasiadka | blanson[m]: findmnt -o TARGET,PROPAGATION / shows / is private, and podman 5.x will convert the mount to private in that case | 12:01 |
| mnasiadka | I love these security features | 12:01 |
| mnasiadka | Well, it’s sort of podman 5.x and new kernel mix | 12:02 |
| blanson[m] | gotta love security features | 12:04 |
| blanson[m] | docker doesnt give a crap and let you do it ? | 12:04 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Revert "CI: Temporarily disable keepalived track script" https://review.opendev.org/c/openstack/kolla-ansible/+/993097 | 12:09 |
| mnasiadka | blanson[m]: seems so | 12:12 |
| opendevreview | Michal Nasiadka proposed openstack/ansible-collection-kolla master: podman: Add kolla-make-root-rshared.service https://review.opendev.org/c/openstack/ansible-collection-kolla/+/993903 | 12:12 |
| mnasiadka | Something like that probably | 12:12 |
| blanson[m] | lol | 12:17 |
| blanson[m] | yh this works | 12:17 |
| blanson[m] | podman just likes to do weird stuff | 12:18 |
| blanson[m] | he's a special child | 12:20 |
| opendevreview | Michal Nasiadka proposed openstack/ansible-collection-kolla master: podman: Add kolla-make-root-rshared.service https://review.opendev.org/c/openstack/ansible-collection-kolla/+/993903 | 12:49 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: neutron: Switch neutron_plugin_agent default to ovn https://review.opendev.org/c/openstack/kolla-ansible/+/970114 | 12:50 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: octavia: Support OVN in auto_configure https://review.opendev.org/c/openstack/kolla-ansible/+/970250 | 12:51 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Remove cgi-bin creation in gnocchi and masakari https://review.opendev.org/c/openstack/kolla/+/993880 | 12:53 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 12:58 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 12:58 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 12:59 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: Add support for VAST Cinder driver https://review.opendev.org/c/openstack/kolla-ansible/+/959524 | 13:17 |
| opendevreview | Jed Preist proposed openstack/kolla-ansible stable/2026.1: Set Ironic tempdir https://review.opendev.org/c/openstack/kolla-ansible/+/993766 | 13:34 |
| opendevreview | Jed Preist proposed openstack/kolla-ansible stable/2025.2: Set Ironic tempdir https://review.opendev.org/c/openstack/kolla-ansible/+/993768 | 13:34 |
| opendevreview | Merged openstack/kolla stable/2025.1: masakari: Ensure log files are owned by masakari user https://review.opendev.org/c/openstack/kolla/+/993314 | 13:53 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 14:01 |
| Vii | mnasiadka: https://zuul.opendev.org/t/openstack/build/36d4651a72bf422eaa5114a204a1d82b | 14:11 |
| Vii | ERROR:kolla.common.utils:"docker buildx" is not available. Install the docker-buildx-plugin or disable BuildKit with "--nobuildkit". | 14:11 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: Add support for VAST Cinder driver https://review.opendev.org/c/openstack/kolla-ansible/+/959524 | 14:11 |
| mnasiadka | Vii: yeah, we probably need that in setup_gate.sh | 14:11 |
| mnasiadka | Because kolla-ansible doesn’t use the kolla-build role yet… | 14:12 |
| Vii | yes :) | 14:12 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: Add support for VAST Cinder driver https://review.opendev.org/c/openstack/kolla-ansible/+/959524 | 14:22 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: CI: Install docker-buildx-plugin in setup_gate https://review.opendev.org/c/openstack/kolla-ansible/+/993932 | 14:37 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Remove cgi-bin creation in gnocchi and masakari https://review.opendev.org/c/openstack/kolla/+/993880 | 14:37 |
| opendevreview | Pierre Riteau proposed openstack/kolla master: Update Prometheus to version 3.5.4 https://review.opendev.org/c/openstack/kolla/+/993943 | 14:47 |
| opendevreview | Piotr Milewski proposed openstack/kolla-ansible master: CI: Install docker-buildx-plugin in setup_gate https://review.opendev.org/c/openstack/kolla-ansible/+/993932 | 14:49 |
| opendevreview | Verification of a change to openstack/kolla master failed: Add YAML support to kolla_set_configs engine https://review.opendev.org/c/openstack/kolla/+/982275 | 14:54 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 15:01 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 15:09 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: fix build-date LABEL invalidating Docker layer cache https://review.opendev.org/c/openstack/kolla/+/993960 | 15:19 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: normalize mtime in archive creation to fix same-day cache busting https://review.opendev.org/c/openstack/kolla/+/993961 | 15:19 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: normalize mtime in archive creation https://review.opendev.org/c/openstack/kolla/+/993961 | 15:23 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: fix build-date LABEL invalidating Docker layer cache https://review.opendev.org/c/openstack/kolla/+/993960 | 15:24 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: normalize mtime in archive creation https://review.opendev.org/c/openstack/kolla/+/993961 | 15:24 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: VAST Manila driver https://review.opendev.org/c/openstack/kolla-ansible/+/959440 | 15:31 |
| opendevreview | Michal Nasiadka proposed openstack/ansible-collection-kolla master: podman: Add kolla-make-root-rshared.service https://review.opendev.org/c/openstack/ansible-collection-kolla/+/993903 | 15:32 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 15:39 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 15:39 |
| opendevreview | Doug Szumski proposed openstack/kolla-ansible master: Add support for Glance to use Cinder via VAST https://review.opendev.org/c/openstack/kolla-ansible/+/981184 | 16:08 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 16:17 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Implement multi-stage builds for OpenStack services and auxiliary tools https://review.opendev.org/c/openstack/kolla/+/969968 | 16:17 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: fix build-date LABEL invalidating Docker layer cache https://review.opendev.org/c/openstack/kolla/+/993960 | 16:34 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: kolla-build: normalize mtime in archive creation https://review.opendev.org/c/openstack/kolla/+/993961 | 16:34 |
| opendevreview | Merged openstack/kolla-ansible master: Revert "CI: Temporarily disable keepalived track script" https://review.opendev.org/c/openstack/kolla-ansible/+/993097 | 16:44 |
| opendevreview | Merged openstack/kolla-ansible master: CI: Install docker-buildx-plugin in setup_gate https://review.opendev.org/c/openstack/kolla-ansible/+/993932 | 19:07 |
| opendevreview | Merged openstack/kolla-ansible master: Remove obsolete settings from Horizon config https://review.opendev.org/c/openstack/kolla-ansible/+/989547 | 21:43 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!