| opendevreview | Merged openstack/openstack-ansible-os_nova master: docs: fix for formatting https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/984370 | 07:57 |
|---|---|---|
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Add support for hashi_vault PKI backend https://review.opendev.org/c/openstack/openstack-ansible/+/948888 | 09:38 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Enable openbao jobs https://review.opendev.org/c/openstack/openstack-ansible/+/948889 | 09:38 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Update ceph-ansible to stable-9.0 https://review.opendev.org/c/openstack/openstack-ansible/+/988043 | 09:48 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-plugins master: Enable CI jobs again https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/988116 | 09:56 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible-plugins master: Enable CI jobs again https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/988116 | 09:56 |
| opendevreview | Merged openstack/openstack-ansible-os_keystone master: Remove temporary change for multiple memcached back-end instances breaks caching https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/973129 | 10:01 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron master: Update OVN to version 26.03 for RHEL https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/973121 | 10:04 |
| opendevreview | Merged openstack/openstack-ansible-os_ceilometer master: Restore AIO job https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/985351 | 10:41 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron master: Change tag for 'Including plugin-specific tasks' to neutron-config https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/987886 | 10:59 |
| opendevreview | Merged openstack/openstack-ansible-os_glance master: Revert Swift retries value once fix is merged https://review.opendev.org/c/openstack/openstack-ansible-os_glance/+/982527 | 11:06 |
| opendevreview | Merged openstack/openstack-ansible master: Remove deprecated HSTS Policies https://review.opendev.org/c/openstack/openstack-ansible/+/981232 | 11:23 |
| opendevreview | Merged openstack/openstack-ansible master: Update path to test-requirements.txt for molecule https://review.opendev.org/c/openstack/openstack-ansible/+/980200 | 11:23 |
| kleini | I am doing kind of distro upgrade on an infra node. Actually, I am replacing a x86_64 node with an aarch64 node. I disabled that node in haproxy and shut it down. On the step to remove that node from RabbitMQ cluster, the rabbitmqctl forget_cluster_node command is stuck for a very long time. | 12:46 |
| kleini | Last time I tried that, the cluster ended in an inconsistent state and I had to run osa.rabbitmq_server playbook with rabbitmq_upgrade=true to get all quorum queues again onto all nodes. | 12:48 |
| noonedeadpunk | um, so I' | 12:53 |
| noonedeadpunk | I' | 12:53 |
| noonedeadpunk | damn | 12:53 |
| noonedeadpunk | So before doing anything with rabbitmq node, I usually do `rabbitmq-diagnostics check_if_node_is_quorum_critical` these days | 12:54 |
| noonedeadpunk | as it shows if it's ok or not ok to actually remove node from the cluster and not get stuck | 12:55 |
| kleini | I did that check and everything was fine. Do I need to remove the node before shutting it down? | 12:59 |
| opendevreview | Merged openstack/openstack-ansible-openstack_hosts master: Add Ubuntu 26.04 support https://review.opendev.org/c/openstack/openstack-ansible-openstack_hosts/+/985218 | 13:01 |
| noonedeadpunk | I think stopping the service and then removing it is kinda correct sequence of actions | 13:08 |
| kleini | shutting down node sounds similar to stopping service | 13:09 |
| jrosser | we were not brave enough to replace one control plane node x86 -> aarch64 | 13:13 |
| jrosser | i think we just put a 4th repo container on it and that was enough | 13:13 |
| jrosser | yes just repo and utility on the arm controller | 13:15 |
| kleini | unbelievable how fast these Ampere One cpus are. AMD EPYC is not that fast with OSA deployment. | 13:22 |
| noonedeadpunk | well, let us know how arm deployment will go :) | 13:27 |
| kleini | setup_hosts 8m17s on aarch64 vs 11m30s on x86_64 | 13:27 |
| noonedeadpunk | I hope we have covered most of places for multi-arch support | 13:27 |
| kleini | https://paste.opendev.org/show/bBmPO34BVFJ5hjWZL9gy/ <- outcome of waiting to get rabbitmq node removed | 13:29 |
| noonedeadpunk | i have not seen things like that, but they are scary | 13:31 |
| noonedeadpunk | it looks more of an issue with streams, then with quorum to me | 13:31 |
| noonedeadpunk | *queues | 13:31 |
| opendevreview | Merged openstack/openstack-ansible master: Add Ubuntu 26.04 molecule jobs https://review.opendev.org/c/openstack/openstack-ansible/+/987132 | 13:31 |
| noonedeadpunk | but does the node still shows up for disk or smth in cluster_status? | 13:31 |
| noonedeadpunk | as frankly - failed streams are nightmare for me, as I have not figured out how to deal with them properly | 13:32 |
| noonedeadpunk | it seems sometime rabbit can get fully stuck with unroutable streams... | 13:32 |
| kleini | steps have been: 1. check_if_node_is_quorum_critical, 2. cluster_status. both fine! power off node. cluster_status still lists node as disk node. then forget_cluster_node, which is stuck for long time. you see output in paste. | 13:36 |
| kleini | longer paste with cluster_status. unfortunately output of check_if_node_is quorum_critical is gone in console. | 13:38 |
| noonedeadpunk | yeah, I really can't comment on that... | 13:47 |
| noonedeadpunk | It sounds all was done according to expectations and best of my knowledge | 13:47 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Use correct libxml package name https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/988232 | 13:59 |
| kleini | no, erlang-base packages for arm64 although state differently here: https://www.rabbitmq.com/docs/install-debian#erlang-repositories | 13:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Install Skyline Console to be installed from PyPi https://review.opendev.org/c/openstack/openstack-ansible/+/988464 | 14:06 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_skyline master: Fix skyline yarn-based installation https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/981149 | 14:06 |
| noonedeadpunk | damn, `Provides amd64 packages only.` | 14:07 |
| kleini | https://www.rabbitmq.com/docs/install-debian#apt-launchpad-erlang <- packages are available, but 'erlang-base=1:26.2.*-1' does not match ''1:26.2.5.15-1rmq1ppa1~ubuntu24.04.1 | 14:09 |
| opendevreview | Kostiantyn Velychkovskyi proposed openstack/openstack-ansible-os_skyline master: Fix Object Storage section for RGW https://review.opendev.org/c/openstack/openstack-ansible-os_skyline/+/982629 | 14:09 |
| kleini | enough for today, will provide changes on Friday. tomorrow public holiday | 14:10 |
| noonedeadpunk | I wonder if we should try to use launchpad or just distro install for rabbitmq on arm | 14:13 |
| * noonedeadpunk has no arm haredware handy to play | 14:14 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Install Skyline Console from PyPi https://review.opendev.org/c/openstack/openstack-ansible/+/988464 | 14:14 |
| kleini | will ask Friday morning for your decision. | 14:14 |
| opendevreview | Merged openstack/openstack-ansible-haproxy_server master: ansible-lint: Fix yaml[truthy] https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/968754 | 19:01 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Update ceph-ansible to stable-9.0 https://review.opendev.org/c/openstack/openstack-ansible/+/988043 | 21:06 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Add support for hashi_vault PKI backend https://review.opendev.org/c/openstack/openstack-ansible/+/948888 | 21:11 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Enable openbao jobs https://review.opendev.org/c/openstack/openstack-ansible/+/948889 | 21:13 |
| opendevreview | Merged openstack/openstack-ansible master: docs: add doc-pot-filter.sh to include deploy-guide in translation https://review.opendev.org/c/openstack/openstack-ansible/+/978913 | 23:32 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!