| opendevreview | Merged openstack/openstack-ansible-os_trove stable/2025.2: Handle missing provider network definition safely https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/991314 | 00:41 |
|---|---|---|
| gokhan | Good Morning Folks, I am trying epoxy distrubution upgrade from jammy to noble. I had problem on glusterfs. we need to upgrade glusterfs serfer from 10.x t0 11.x https://paste.openstack.org/show/bVikirWDtzyU3XIXL997/ | 06:43 |
| noonedeadpunk | gokhan: right, that is correct. you indeed need to upgrade gluster from PPA | 09:40 |
| noonedeadpunk | I think we need to upgrade the deploy guide | 09:44 |
| gokhan | noonedeadpunk, yes, I haven't seen any other problem yet. It has been done seamlessly :) | 10:04 |
| opendevreview | Takashi Kajinami proposed openstack/openstack-ansible-os_neutron master: Remove options for monolithic neutron-server https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/991555 | 10:14 |
| noonedeadpunk | gokhan: if you can propose a patch to docs for the upgrade - it would be very welcomed | 10:17 |
| opendevreview | Takashi Kajinami proposed openstack/openstack-ansible-os_neutron master: Remove options for monolithic neutron-server https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/991560 | 10:20 |
| opendevreview | Merged openstack/openstack-ansible master: Add information about Ubuntu 26.04 support https://review.opendev.org/c/openstack/openstack-ansible/+/989095 | 10:32 |
| opendevreview | Merged openstack/openstack-ansible master: [doc] Document glusterfs_reset_peers https://review.opendev.org/c/openstack/openstack-ansible/+/966209 | 10:32 |
| gokhan | noonedeadpunk, after upgrade ı will propose thanks :) | 10:42 |
| f0o | noonedeadpunk: before I go insane, stable/2024.2 still instals caracal on ubuntu 22.04 but will install dalmatian on 24.04 right? (https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/stable/2024.2/vars/ubuntu.yml#L86) | 11:32 |
| f0o | if that is the case, is 2024.2 backwards compatible to 2024.1 ? Or will I run into dragons? | 11:33 |
| jrosser | f0o: a particular release of OSA (stable/2024.2) should always install the same openstack version | 12:09 |
| jrosser | you have linked there to the repo for ubuntu-cloud-archive, is the question related to that? | 12:10 |
| f0o | jrosser: that what I assumed | 12:10 |
| f0o | yeah it's related to that as we use `distro` | 12:11 |
| jrosser | oh well :( | 12:11 |
| f0o | hah | 12:11 |
| jrosser | then your compatibility matrix is way more complicated | 12:11 |
| jrosser | you have to see if canonical did, or did not release openstack packages for the version/distro you're interested in | 12:11 |
| jrosser | and if they didn't, you cant use that combination | 12:11 |
| f0o | yeah I'm starting to realize it and scratching my head on how to migate to a better state without breaking everthing in the process | 12:11 |
| jrosser | distro install == sad times, imho | 12:12 |
| jrosser | for many reasons | 12:12 |
| f0o | yeah :/ | 12:12 |
| jrosser | the reason UCA is included like that is that there are some useful depenancies in there even for source installs | 12:13 |
| jrosser | even if they don't take openstack itself from UCA | 12:13 |
| f0o | I know a switch from distro to source (or viceversa) is not directly supported. what would the right way forward be here? cordon/evacuate one physical box at a time, reinstall it using 24.06 + source, repeat? | 12:14 |
| f0o | this would mean I need to go back to 2024.1 since I'm on caracal everywhere | 12:15 |
| f0o | or can I run a mix between 2024.1 and 2024.2 for some time? | 12:15 |
| jrosser | the grid here says that for stable/2024.2 you can only install dalmation from 2024.2 distro installs on ubuntu 24.04 https://docs.openstack.org/openstack-ansible/latest/admin/upgrades/compatibility-matrix.html | 12:15 |
| f0o | oh 24.04 cant do source on caracal haha nice | 12:16 |
| f0o | my only hope now is that a mix of 2024.1 and 2024.2 is possible so I can reinstall every host one by one with source | 12:16 |
| jrosser | becasue 24.04 would not have been a released OS at the point caracal was released? | 12:16 |
| jrosser | this follows the openstack PTI | 12:17 |
| jrosser | we can only support an OS that openstack development was done on during its dev cycle (by the nova/cinder/glance/... teams) | 12:17 |
| f0o | so what's the interop between 2024.1 and 2024.2 looking like? Can they run together in a mixed environment so I can replace the hosts one by one or am I forever stuck on 22.04+distro? | 12:18 |
| jrosser | i think i would have to see what noonedeadpunk thinks about doing a rolling conversion from distro to source | 12:19 |
| jrosser | but the upgrade from one branch to the next is tested quite thoroughly | 12:19 |
| jrosser | keeping the install method the same | 12:20 |
| f0o | or is the migration: revert to 2024.1, evacutate/cordon nodes, reinstall 22.04 + source, repeat - once all nodes are 22.04+source then upgrade to 2024.2 - once its 2024.2, evacuate/cordon nodes, reinstall 24.04 + source, repeat. Now all nodes are 2024.2 on ubuntu 24.04 with source | 12:20 |
| f0o | my largest conern right now is that OSA is at stable/2024.2 but since all nodes are ubuntu 22.04 it does run caracal packages. Downgrading to 2024.1 might add regression in playbooks and similar. | 12:21 |
| noonedeadpunk | so distro -> source, I would assume, process should be like OS reinstall | 12:21 |
| noonedeadpunk | except you also override install_method for the re-installed hosts in group_vars | 12:22 |
| noonedeadpunk | (and for containers) | 12:22 |
| noonedeadpunk | so you need to be wise about group names, that it included both hosts and containers | 12:22 |
| noonedeadpunk | I think we should have that | 12:22 |
| noonedeadpunk | and ensure that repo_containers are spawned | 12:22 |
| jrosser | i don't know if the compatbility matrix is right for F and G releases but we don't state any supported distro installs for those | 12:23 |
| f0o | I guess my question boils down to, can I from 22.04+distro (forced caracal) do a full reinstall to 24.04+source (dalmatian) and have them both run without issues - Or is this a 2-3x roundtrip thing | 12:23 |
| noonedeadpunk | f0o: nothing stopps you to override SHAs to caracal for source install | 12:23 |
| noonedeadpunk | and have mathing service versions | 12:23 |
| jrosser | you can even copy the vars from the caracal release branch and put them in your group_vars | 12:24 |
| noonedeadpunk | yeah ^ | 12:24 |
| noonedeadpunk | so it should not be impossible to do | 12:25 |
| jrosser | like these https://github.com/openstack/openstack-ansible/blob/stable/2024.1/inventory/group_vars/glance_all/source_git.yml | 12:25 |
| jrosser | i am not sure what our current best advice would be around choosing between distro and source | 12:26 |
| f0o | hah | 12:26 |
| jrosser | source is certainly more flexible, and we tend to enable source installs on distros before the distro packages are available (or never are) | 12:26 |
| f0o | I'll get to draft something and if possible run it past you next week just for a sanity check | 12:26 |
| jrosser | and then support tends to remain for OS beyond when canonical publish UCA packages, so you get a pretty wide overlap of openstack and OS versions | 12:27 |
| jrosser | this really does help to avoid being boxed in a corner with impossible or very difficult upgrades where * has to change in one step | 12:27 |
| f0o | So Jammy does not have Dalmatian but it has Gazpacho | 12:40 |
| f0o | but not Epoxy | 12:41 |
| f0o | Can I jump 2024.1 -> 2026.1 ? | 12:41 |
| f0o | and from 2026.1 then switch out the OS'es without touching OpenStack by just replacing the hosts entirely | 12:42 |
| f0o | tackle distro->source migration once I got an aligned OS<>OSA map | 12:42 |
| f0o | just wondering what should be done first since I'm tackling two different desyncs here | 12:43 |
| noonedeadpunk | f0o: just keep in mind that 2024.1 is in default repos of 24.04 | 12:48 |
| noonedeadpunk | so you don't need UCA for it | 12:48 |
| noonedeadpunk | ah | 12:48 |
| f0o | OH | 12:48 |
| f0o | that might make things easier | 12:49 |
| noonedeadpunk | or smth like that | 12:49 |
| noonedeadpunk | so ubuntu, unklike debian, does have upgrade path for distro | 12:49 |
| noonedeadpunk | except broken glance, proposed issue, etc | 12:49 |
| noonedeadpunk | but in general... | 12:49 |
| f0o | but ok, so can I disable UCA via a group-override? | 12:51 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Replace netcat with socat https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/991614 | 12:51 |
| noonedeadpunk | I think we don't enable it by default | 12:51 |
| f0o | it is for distro | 12:52 |
| noonedeadpunk | it could be that we don't have 24.04 support for 2024.1 though ..... | 12:52 |
| f0o | yep | 12:52 |
| noonedeadpunk | crap | 12:52 |
| noonedeadpunk | but isn't there uca for 2024.2 and 22.04? | 12:52 |
| f0o | but if I do an ovverride of openstack_hosts_package_repos:[] effectively removing _package_repos (https://opendev.org/openstack/openstack-ansible-openstack_hosts/src/branch/stable/2024.2/vars/ubuntu.yml#L86) then no UCA should be installed eventho I'm on stable/2024.2 OSA version | 12:53 |
| f0o | this would make my 24.04 pull all openstack pacakges from main repos, making them 2024.1 right? | 12:53 |
| noonedeadpunk | it has gazpacho? https://ubuntu-cloud.archive.canonical.com/ubuntu/dists/jammy-updates/ | 12:53 |
| noonedeadpunk | for jammy? | 12:53 |
| f0o | yeah it has gazpacho but not epoxy haha | 12:53 |
| f0o | I would've been with with SLURP'ing to epoxy | 12:54 |
| noonedeadpunk | right, but you should be able to upgrade OS on 2024.2? | 12:54 |
| noonedeadpunk | right... | 12:54 |
| noonedeadpunk | well, it's release timing of ubuntu which is unfortunate with openstack | 12:54 |
| f0o | Right now I think I need to resolve the desync between Ubuntu 22.04 and OSA stable/2024.2 which despite being 2024.2 does actually install 2024.1 | 12:54 |
| noonedeadpunk | this time we made balder move and getting 26.04 for 2026.1 | 12:54 |
| noonedeadpunk | yes, I think this is smth to address, and then you should be able to upgrade OS nicely on 2024.2 | 12:55 |
| f0o | so removing UCA from 24.04 nodes would make me have OSA stable/2024.2 but all nodes on 22.04+2024.1 and 24.04+2024.1 | 12:55 |
| f0o | then I can remove the UCA-removal override and do an upgrade to 2024.2 | 12:55 |
| f0o | then OSA, OS and Ubuntu releases all align again being stable/2024.2, 24.04, 2024.2 | 12:56 |
| noonedeadpunk | /o\ | 12:56 |
| f0o | this would then be the "clean" state. Then I can do a swap from distro->source | 12:56 |
| noonedeadpunk | I am lost, sorry :D | 12:56 |
| f0o | me too, thats my I'm being verbose haha | 12:56 |
| f0o | but I think I'm getting somewhere, at very least if I do all of this, I will end up with a state where OSA version aligns with the package version and aligns with the Ubuntu-Version (as per support matrix) | 12:57 |
| f0o | and from there I can then plan removal of distro | 12:58 |
| noonedeadpunk | jrosser: do you recally any apparmor thing around netcat for 24.04? | 13:08 |
| noonedeadpunk | or should we just do https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/991614 ? | 13:08 |
| jrosser | hmm i dont recall anything specific - andrewbonney? | 13:09 |
| jrosser | is there an ubuntu launchpad issue for that? | 13:10 |
| andrewbonney | I don't remember this, but we're a bit behind on upgrades so may just not have spotted it yet | 13:10 |
| noonedeadpunk | no, no issue | 13:10 |
| noonedeadpunk | but CI fails on infra jobs | 13:10 |
| noonedeadpunk | https://zuul.opendev.org/t/openstack/build/cfd32936538745c3bcf02b4523e0663e | 13:11 |
| noonedeadpunk | and I can easily reproduce that | 13:11 |
| noonedeadpunk | it also kinda cleaner with socat... but I am a bit afraid about some modules, like haproxy, which rely on netcat specifically | 13:13 |
| noonedeadpunk | the thing is that `Disabling haproxy backends` is skipped on aio envs | 13:15 |
| noonedeadpunk | but module somehow works.... | 13:17 |
| noonedeadpunk | jrosser: if you have a minute - can you check https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/991302 - Damian is away today | 13:19 |
| noonedeadpunk | out of really important ones left https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/990811 | 13:20 |
| noonedeadpunk | but maybe we can backport it | 13:20 |
| noonedeadpunk | I think I will go and propose branching at this point | 13:20 |
| noonedeadpunk | vexxhost proxy though https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/981710 | 13:21 |
| noonedeadpunk | I'd say we should be able to backport it as well... | 13:22 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_octavia master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/991707 | 18:11 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_octavia master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/991707 | 18:11 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_magnum master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/972889 | 18:19 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_magnum master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/972889 | 18:19 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_swift master: Update outdate information in bindep.txt https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/972882 | 18:26 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_swift master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/972882 | 18:26 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_swift master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/972882 | 18:29 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_designate master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/972887 | 18:30 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_designate master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/972887 | 18:31 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_designate master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/972887 | 18:31 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_designate master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/972887 | 18:31 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_freezer master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_freezer/+/991710 | 18:32 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_freezer master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_freezer/+/991710 | 18:33 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_freezer master: Remove v1 API https://review.opendev.org/c/openstack/openstack-ansible-os_freezer/+/991716 | 18:37 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_freezer master: Remove v1 API https://review.opendev.org/c/openstack/openstack-ansible-os_freezer/+/991716 | 18:38 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_blazar master: Update outdate information in bindep.txt https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/972892 | 19:05 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_blazar master: Update outdate information in bindep.txt https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/972892 | 19:05 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_blazar master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/972892 | 19:05 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_blazar master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/972892 | 19:05 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_masakari master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/973134 | 19:08 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_masakari master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/973134 | 19:08 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_masakari master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/973134 | 19:08 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible-os_masakari master: Add information about manage configuration by OSA https://review.opendev.org/c/openstack/openstack-ansible-os_masakari/+/973134 | 19:09 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!