| noonedeadpunk | mornings | 07:04 |
|---|---|---|
| noonedeadpunk | jrosser: nothing at this point :) | 07:04 |
| noonedeadpunk | will push patches asap | 07:04 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Freeze roles for 30.0.0.0b1 release https://review.opendev.org/c/openstack/openstack-ansible/+/931611 | 07:24 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Unfreeze roles after milestone release https://review.opendev.org/c/openstack/openstack-ansible/+/931612 | 07:29 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2024.1: Bumps SHAs for 2024.1 https://review.opendev.org/c/openstack/openstack-ansible/+/931740 | 07:40 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.2: Bump SHAs for 2023.2 https://review.opendev.org/c/openstack/openstack-ansible/+/931741 | 07:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Bump SHAs for 2023.1 https://review.opendev.org/c/openstack/openstack-ansible/+/931742 | 07:58 |
| jrosser | noonedeadpunk: how did you get on with magnum? | 08:19 |
| noonedeadpunk | I haven't tested CAPI yet xD | 08:23 |
| noonedeadpunk | Though playbooks finished | 08:23 |
| noonedeadpunk | so stopped at creating a template and upload images | 08:24 |
| * noonedeadpunk playing at free time with it | 08:24 | |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Use ceph mirror in CI jobs https://review.opendev.org/c/openstack/openstack-ansible/+/923777 | 08:35 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Update rabbitmq and erlang repo locations to the current recommended locations. https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931753 | 09:07 |
| jrosser | ^ i wonder if we should update the stable branches as well | 09:07 |
| noonedeadpunk | and gpg keys are the same? | 09:15 |
| jrosser | i think so | 09:17 |
| noonedeadpunk | then these are pretty much same... | 09:19 |
| noonedeadpunk | yeah, might be worth backporting overall | 09:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Simplify haproxy_service_configs defenition https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931762 | 10:27 |
| jrosser | noonedeadpunk: https://discourse.ubuntu.com/t/needrestart-changes-in-ubuntu-24-04-service-restarts/44671 | 10:32 |
| jrosser | ^ pretty big behaviour change here | 10:32 |
| noonedeadpunk | I actually think that in Ansible it was restarting services before? | 10:38 |
| noonedeadpunk | I can also recall some extra apt args somewhere.... | 10:39 |
| noonedeadpunk | ah, it was this https://opendev.org/openstack/openstack-ansible-lxc_hosts/src/branch/master/templates/prep-scripts/debian_prep.sh.j2#L11 | 10:41 |
| noonedeadpunk | so potentially here where it might hit us | 10:42 |
| noonedeadpunk | but I kinda quite sure that services were restarted on ubuntu anyway before. As we were hitting an issue with OVS when running upgrades with -e package_state=latest. Then OVS will restart and before it goes fully up - neutron-opvs-agent can be resturted as well leading to utter mess | 10:45 |
| noonedeadpunk | and as we don't have triggers for ovs restart on itself (do we?) - I think it was caused by needrestart anyway& | 10:45 |
| jrosser | well, we had an interesting case | 10:49 |
| jrosser | "it looks like the issue is that if an apt upgrade or install actually does anything it will invoke needrestart to see if services need to be restarted, and according to its heuristics jenkins-agent always needs restarting because it's constantly grabbing and deleting temporary jars from the controller" | 10:49 |
| noonedeadpunk | oh, well... | 10:50 |
| noonedeadpunk | so it goes through all services, not only ones that were touched by install... | 10:51 |
| jrosser | yeah | 10:51 |
| noonedeadpunk | that's.... unexpected indeed | 10:51 |
| jrosser | so for example, libc update, i expect will restart * | 10:51 |
| noonedeadpunk | huh | 10:53 |
| noonedeadpunk | it would be interesting to spawn an AIO from old noble, disable security repo, and then check.... | 10:53 |
| noonedeadpunk | asbase seems to have older glibc then security | 10:54 |
| jrosser | you can disable the new behaviour then have it report what needs restarting | 10:54 |
| noonedeadpunk | and we can control that with openstack_hosts_package_manager_default_conf | 10:54 |
| noonedeadpunk | (I guess) | 10:55 |
| noonedeadpunk | so potentially we can add override for noble to revert the behaviour | 11:08 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Allow to filter applicable haproxy hosts for service config https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931772 | 11:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Allow to filter applicable haproxy hosts for service config https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931772 | 12:04 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Simplify haproxy_service_configs defenition https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931762 | 12:38 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Simplify haproxy_service_configs defenition https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931762 | 12:48 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Allow to filter applicable haproxy hosts for service config https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931772 | 12:50 |
| opendevreview | Merged openstack/openstack-ansible-ops master: Ensure that k8s hostname is lowercased https://review.opendev.org/c/openstack/openstack-ansible-ops/+/931548 | 13:58 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add erlang package defenition to defaults https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931794 | 14:02 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Add erlang package defenition to defaults https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931794 | 14:10 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Revert "Add retries for feature flags check" https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931797 | 14:41 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Fail in when installing RabbitMQ/Erlang versions not possible https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931798 | 14:48 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Proceed with installation/upgrade even if cluster not healthy https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931800 | 14:55 |
| noonedeadpunk | we were reported somewhere on ^ but can't find now where.... | 14:56 |
| noonedeadpunk | also - I'm not sure if we actually need that on master.... | 14:58 |
| noonedeadpunk | maybe it;s only applicable on stable branches | 14:58 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Remove feature flags pre-upgrade step https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/931801 | 14:59 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server master: Fail in when installing RabbitMQ/Erlang versions not possible https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931798 | 15:00 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server stable/2024.1: Proceed with installation/upgrade even if cluster not healthy https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/931802 | 15:03 |
| noonedeadpunk | #startmeeting openstack_ansible_meeting | 15:03 |
| opendevmeet | Meeting started Tue Oct 8 15:03:32 2024 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:03 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:03 |
| opendevmeet | The meeting name has been set to 'openstack_ansible_meeting' | 15:03 |
| noonedeadpunk | #topic rollcall | 15:03 |
| noonedeadpunk | o/ | 15:03 |
| jrosser | o/ hello | 15:05 |
| NeilHanlon | hiya | 15:06 |
| noonedeadpunk | #topic office hours | 15:06 |
| noonedeadpunk | so it seem right now we do have broken upgrade jobs for 2023.1 | 15:06 |
| noonedeadpunk | due to missing repo mirrors I assume, | 15:06 |
| noonedeadpunk | as it;s where they're failing | 15:07 |
| noonedeadpunk | and I guess we have 2 ways here - either drop upgrade jobs, as 2023.1 going to unmaintained very soon | 15:07 |
| noonedeadpunk | or stop using infra mirror for mariadb | 15:07 |
| jrosser | is it that the mirror has not been kept up to date? | 15:10 |
| noonedeadpunk | actually, thinking about that, I wonder if that's just mariadb pulled the trigger... | 15:11 |
| jrosser | it just seems to stop at 10.5.9 | 15:11 |
| noonedeadpunk | you mean the infra one? | 15:12 |
| jrosser | well i don't know - it's just a pass though proxy isnt it? with caching? | 15:13 |
| noonedeadpunk | I think so, yeah | 15:13 |
| jrosser | right, so same is seen here https://downloads.mariadb.com/MariaDB/ | 15:13 |
| jrosser | i thought i started a patch ages ago to update the location, but somehow it was not needed? | 15:14 |
| noonedeadpunk | yeah | 15:14 |
| noonedeadpunk | as current one was maintianing more versions or smth | 15:14 |
| noonedeadpunk | but the link you supplied doesn't contain anything modern at all? | 15:15 |
| * noonedeadpunk already can't recall | 15:17 | |
| jrosser | huh everything is a magic setup script how | 15:18 |
| jrosser | *now | 15:18 |
| noonedeadpunk | there's https://mirror.mariadb.org/repo/ as well | 15:18 |
| noonedeadpunk | but they keep only "latest" | 15:18 |
| noonedeadpunk | but I think it's not what happening | 15:20 |
| noonedeadpunk | I guess repo is just not browsable | 15:20 |
| noonedeadpunk | or maybe 10.11 is the last release there.... | 15:20 |
| noonedeadpunk | yeah.... | 15:21 |
| noonedeadpunk | probably indeed it's time to switch then :( | 15:22 |
| noonedeadpunk | I wonder how ours 11.4 patch even worked then | 15:23 |
| noonedeadpunk | #link https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/922377 | 15:23 |
| jrosser | did they fix the TLS stuff for localhost? | 15:24 |
| noonedeadpunk | um, yes, but in 11.4.4 | 15:24 |
| noonedeadpunk | which is not released yet | 15:24 |
| noonedeadpunk | and that was your patch: https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/924354 | 15:26 |
| noonedeadpunk | seems it needs to be revised again | 15:26 |
| noonedeadpunk | so we're just lucky to have 10.11 in there, while 10.6 just gone | 15:27 |
| jrosser | urgh yes and before we didnt have to rely on any pinning because there was a repo per release | 15:28 |
| noonedeadpunk | yeah | 15:29 |
| noonedeadpunk | and mirror.mariadb.org also tends to maintian only last N releases, which is annoying as well | 15:29 |
| noonedeadpunk | Another thing, I decided to clean-up a rabbitmq role a bit | 15:30 |
| noonedeadpunk | and also look into how we're doing upgrades | 15:31 |
| noonedeadpunk | with idea to finally split "rabbitmq_upgrade" with re-installing/bootstrapping cluster | 15:31 |
| noonedeadpunk | to make upgrade in fact rolling | 15:31 |
| noonedeadpunk | during that was able to reproduce previously reported issue, where running rabbitmq_upgrade on failing cluster was just failing | 15:36 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Remove upgrade jobs for 2023.1 https://review.opendev.org/c/openstack/openstack-ansible/+/931813 | 15:39 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2023.1: Bump SHAs for 2023.1 https://review.opendev.org/c/openstack/openstack-ansible/+/931742 | 15:40 |
| noonedeadpunk | We're coming closer to PTG and I guess we need to pick a time for that | 15:49 |
| noonedeadpunk | trcky thing - I am happen to travel that specific week | 15:50 |
| noonedeadpunk | But I think smth like since 16 utc should work for me.... | 15:51 |
| noonedeadpunk | or like Friday once I'm back :( | 15:58 |
| noonedeadpunk | #endmeeting | 16:03 |
| opendevmeet | Meeting ended Tue Oct 8 16:03:10 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:03 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-10-08-15.03.html | 16:03 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-10-08-15.03.txt | 16:03 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-10-08-15.03.log.html | 16:03 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server unmaintained/zed: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/931820 | 16:32 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server unmaintained/zed: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/931820 | 16:35 |
| noonedeadpunk | jrosser: does ansible_facts['architecture'] report aarch64 on ARM hosts? | 18:08 |
| noonedeadpunk | or I messed up? | 18:09 |
| jrosser | umm | 18:09 |
| noonedeadpunk | and it's arm64 | 18:09 |
| * jrosser at wrong computer | 18:09 | |
| noonedeadpunk | jsut looking at https://opendev.org/openstack/openstack-ansible-galera_server/src/commit/e5b4fd0d55a6e581d50bea929fe964879f6e6335/defaults/main.yml#L58-L62 | 18:09 |
| noonedeadpunk | and then checking https://mirror.mariadb.org/yum/10.11/ | 18:09 |
| noonedeadpunk | where only aarch64: arm64 is reversed kinda | 18:10 |
| jrosser | probably quickest to find an arm zuul job and look in the zuul_info dir | 18:10 |
| noonedeadpunk | ah, fair | 18:10 |
| noonedeadpunk | though not easy to find one these days :( | 18:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server unmaintained/zed: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/931820 | 18:14 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible unmaintained/zed: Disable galera repo mirrors https://review.opendev.org/c/openstack/openstack-ansible/+/931835 | 18:17 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server unmaintained/zed: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/931820 | 18:17 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server unmaintained/zed: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/931820 | 18:18 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server master: Use mirror.mariadb.org to install packages from https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/924354 | 18:38 |
| jrosser | noonedeadpunk: https://zuul.opendev.org/t/openstack/build/391ad63363344661889e74f2c501bf9a/log/zuul-info/host-info.ubuntu-noble-arm64.yaml#8 | 18:41 |
| noonedeadpunk | mhm | 18:46 |
| noonedeadpunk | I wonder then if mariadb is the only thing that won't work with our current mappings | 18:47 |
| noonedeadpunk | and only for EL | 18:48 |
| noonedeadpunk | or arm64/aarch64 is distro-different thing | 18:49 |
| noonedeadpunk | in general | 18:49 |
| opendevreview | Merged openstack/openstack-ansible-os_magnum master: Update the api-paste configuration https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/930842 | 23:40 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!