| opendevreview | Merged openstack/openstack-ansible master: Add AIO bootstrap support for EL10 https://review.opendev.org/c/openstack/openstack-ansible/+/951140 | 04:57 |
|---|---|---|
| opendevreview | Merged openstack/openstack-ansible master: Remove LIBSYSTEMD_VERSION override for AIO https://review.opendev.org/c/openstack/openstack-ansible/+/951324 | 04:57 |
| opendevreview | OpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/c/openstack/openstack-ansible/+/951607 | 05:47 |
| kleini | Upgrade in production A->C failed to upgrade RabbitMQ. Somehow during install of first RabbitMQ it stopped all instances and the restart of first instance failed. cluster_status JSON output now contains Errors on feature flags on stdout, parsing JSON results in non-sense and playbook failes here: https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/branch/stable/2024.1/tasks/rabbitmq_feature_flags.yml#L43 | 08:03 |
| kleini | I am trying to recover now | 08:03 |
| noonedeadpunk | Under no conditions it should have stopped all cluster nodes... | 08:09 |
| kleini | https://paste.opendev.org/show/bTLFSqNWOZyOFtxstWqw/ | 08:09 |
| kleini | I could reproduce the problem | 08:09 |
| noonedeadpunk | this task is called multiple times, just in case. | 08:09 |
| kleini | nodes 1: should not be stopped but all nodes are stopped again | 08:09 |
| noonedeadpunk | but task is not really executed.... | 08:10 |
| noonedeadpunk | and it's just running service locally: https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/branch/master/tasks/rabbitmq_stopped.yml#L16 | 08:10 |
| noonedeadpunk | so pretty much `systemctl stop rabbitmq-server` | 08:11 |
| kleini | https://paste.opendev.org/show/bs03sm8L3JfEXxx0mMMQ/ <- it is coming from Ansible, but why? | 08:15 |
| kleini | it says always skipping "Ensure RabbitMQ nodes [1:] are stopped" | 08:18 |
| jrosser | in your first paste that says "skipping" for that task | 08:18 |
| jrosser | which i think is what noonedeadpunk meant with saying they are not really executed | 08:19 |
| kleini | https://paste.opendev.org/show/bIOyDzDYxBqJI4aHtHQ6/ <- okay, here the nodes, which are not the upgrader are stopped | 08:21 |
| kleini | then the upgrader node is stopped and the whole cluster is dead | 08:21 |
| kleini | https://docs.openstack.org/openstack-ansible/2024.1/admin/upgrades/major-upgrades.html#upgrade-infrastructure <- says rabbitmq_upgrade=true | 08:31 |
| kleini | https://opendev.org/openstack/openstack-ansible/src/branch/stable/2024.1/playbooks/rabbitmq-install.yml#L61 <- here nodes 1: are stopped, then node 0 is upgraded but starting fails | 08:32 |
| noonedeadpunk | so why are they stopped when you're running the playbook for the fiurst time? | 08:38 |
| noonedeadpunk | oh | 08:38 |
| noonedeadpunk | I see what you mean now | 08:39 |
| kleini | will check later, why node 0 did not want to start without the others after upgrade | 08:39 |
| noonedeadpunk | I think we have also refactored all of that lately... | 08:40 |
| noonedeadpunk | along with adding more checks before starting the upgrade | 08:41 |
| noonedeadpunk | ok, so on 2024.1 in feature flags are checked before upgrade starts, and at the very end here, when all nodes should have been upgraded: https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/branch/stable/2024.1/tasks/main.yml#L85-L87 | 08:43 |
| noonedeadpunk | but yes, if first node fails to start, running playbook again will fail as cluster not healthy | 08:43 |
| noonedeadpunk | oh... or it just proceeds skipping all checks... | 08:44 |
| noonedeadpunk | kleini: what rabbitmq version you got in? It's not >=4.0, right? | 08:45 |
| kleini | https://paste.opendev.org/show/b63rWHtnHEageTyNsRww/ <- the checks here https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/branch/stable/2024.1/tasks/rabbitmq_feature_flags.yml#L43 fail due to errors in stdout of JSON cluster_status | 08:46 |
| kleini | rabbit@controller1-rabbit-mq-container-70bd14b9: RabbitMQ 3.13.7 on Erlang 26.2.5.12 | 08:46 |
| noonedeadpunk | oh, interesting... never seen that.... | 08:47 |
| kleini | with removing the stop of non-upgrader nodes, I was able to get through upgrade process of RabbitMQ | 08:47 |
| kleini | That must be a bug in RabbitMQ to print error messages on stdout and not stderr | 08:49 |
| kleini | https://paste.opendev.org/show/bqVrzGja0GJxiH88Ew43/ <- RabbitMQ upgrade from 3.11.13 to 3.13.7 and it refused to start, because it could not connect to the other nodes | 09:18 |
| noonedeadpunk | well, if it did not have features enabled which are required now in 3.13 - that would explain it | 09:22 |
| noonedeadpunk | as some which are optional in 3.11 are required in 3.13 | 09:22 |
| noonedeadpunk | so it's really important to enable them | 09:22 |
| noonedeadpunk | and given https://paste.opendev.org/show/b63rWHtnHEageTyNsRww/ - I'm not sure they were | 09:22 |
| noonedeadpunk | thus it feels that smth is off in the cluster, though it was not self-reporting about it in any way | 09:23 |
| kleini | I did start nodes 1: again manually to recover from totally broken cluster. And node 0 could then not talk to nodes 1: because they are still on old version. | 09:27 |
| kleini | The first upgrade try to start node 0 failed because it could not connect to the other nodes | 09:27 |
| noonedeadpunk | the reason why could be absent features on other nodes, as their enablement failed with stack trace in paste you've provided | 09:28 |
| noonedeadpunk | as they are only compatible if all required feature flags are present | 09:28 |
| kleini | only for correct history: I tried upgrade with rabbitmq_upgrade=true. it stopped nodes 1:. Upgrade of node 0 failed because of connect to nodes 1: failed. I have no information about feature flags of node 0 during that failure. | 09:30 |
| kleini | Logs from OSA are not visible in terminal history anymore from that time. I am sorry. Checking logs of node 0 during that time about feature flags. | 09:31 |
| noonedeadpunk | osa save the log file to /openstack/log/ansible-logging/ansible.log | 09:37 |
| noonedeadpunk | but well, if rabbitmq did stdout and exit with code 0 even though flags were not enabled... | 09:38 |
| noonedeadpunk | but also not sure if they were | 09:38 |
| noonedeadpunk | it's really worth to be checked with `rabbitmqctl list_feature_flags` on currently running nodes | 09:39 |
| noonedeadpunk | as frankly it looks like smth is off with mnesia db somewhere... | 09:42 |
| kleini | https://paste.opendev.org/show/bjuEQY8Xlv7HnfpetTO1/ | 09:48 |
| kleini | https://paste.opendev.org/show/bujgOSVLskNdvizBhSWm/ <- feature flags | 09:49 |
| kleini | ups, logs not complete | 09:51 |
| noonedeadpunk | that looks right | 10:05 |
| noonedeadpunk | all which are required are enabled | 10:05 |
| noonedeadpunk | khepri_db is experimental, so it's expected to leave disabled | 10:05 |
| kleini | https://paste.opendev.org/show/bYue1fFabRnzhgwgGjuW/ <- This is my first failed run. And there I read, that task for enable all feature flags is skipped | 10:06 |
| kleini | and that is not reproducible as I don't have now one of the old RabbitMQs running anymore | 10:08 |
| kleini | so, information about problem cause is lost | 10:08 |
| kleini | we can only assume returned list of RabbitMQ 3.11.13 features did not contain any disabled one | 10:10 |
| noonedeadpunk | yeah, so that should not be an issue or deal breaker for startup of the upgraded one | 10:11 |
| noonedeadpunk | so the only suggestion I would have, to remove upgraded one from the cluster, reset the node, and re-add to cluster | 10:11 |
| noonedeadpunk | so `stop_app` on the upgraded one, execute `forget_cluster_node` on the active ones with reference to upgraded one | 10:12 |
| noonedeadpunk | `force_reset` , `join_cluster` , `start_app` on the upgraded one | 10:13 |
| noonedeadpunk | that should wipe mnesia db basically | 10:14 |
| kleini | and start of RabbitMQ 3.13.7 failed with https://paste.opendev.org/show/bqVrzGja0GJxiH88Ew43/ meaning node 0 assumed somehow not to be the last node to be shut down, which is wrong as OSA log shows, other nodes are down | 10:14 |
| noonedeadpunk | what is the cluster list? | 10:14 |
| kleini | cluster list? | 10:15 |
| kleini | three nodes | 10:15 |
| noonedeadpunk | don't you accidentally have controller1-rabbit-mq-container-70bd14b9 added 2 times there or smth | 10:15 |
| noonedeadpunk | ok | 10:15 |
| noonedeadpunk | but now you have it running on 02 and 03, 01 still refuses to start? | 10:16 |
| noonedeadpunk | or you have everything down? | 10:16 |
| kleini | https://paste.opendev.org/show/bxSARndcuDqnsHIQGpdu/ <- three nodes | 10:17 |
| noonedeadpunk | yeah, but in rabbitmqctl cluster_status also 2 nodes? | 10:17 |
| noonedeadpunk | As I can recall seeing once that some node was added 2 times to the cluster for some reason... | 10:18 |
| noonedeadpunk | * also 3 nodes | 10:18 |
| kleini | I recovered by starting 1: manually. then manual start of 0 was successful, too. rerun rabbitmq-install.yml and fail with list_feature_flags containing error messages in stdout. manual check of running_nodes, alarms and partitions and disable those when conditions in rabbitmq_feature_flags.yml. then rerun, require again to manually start nodes 1: otherwise start of node 0 fails again, and then everything was successful | 10:20 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: Add CentOS Stream 10 to molecule tests https://review.opendev.org/c/openstack/openstack-ansible/+/951728 | 10:22 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/2025.1: Add CentOS Stream 10 to molecule tests https://review.opendev.org/c/openstack/openstack-ansible/+/951728 | 10:22 |
| kleini | So I have all nodes upgraded and rerunning works. I don't see anywhere duplicate nodes in cluster_status | 10:22 |
| kleini | Where did you see a dublicate node in cluster_status? | 10:22 |
| noonedeadpunk | in disk nodes | 10:23 |
| noonedeadpunk | but it was a while ago and only once and could be some operator mistake as well | 10:23 |
| noonedeadpunk | and frankly - I can't even remember if it was my environment or someone from irc/bug report/etc | 10:24 |
| kleini | checked cluster_status again and it looks fine. three nodes everywhere, no differences | 10:29 |
| noonedeadpunk | ++ | 10:46 |
| noonedeadpunk | rabbit keeps bringing surprises.... | 10:46 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_trove master: Add support for generation of SSH keypairs https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/951590 | 11:53 |
| opendevreview | Merged openstack/openstack-ansible-galera_server master: Temporary disable molecule jobs https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951614 | 12:51 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: fix incorrect use of bool values https://review.opendev.org/c/openstack/openstack-ansible/+/951632 | 12:57 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove resolved bug + duplicated phrase from sentence https://review.opendev.org/c/openstack/openstack-ansible/+/951518 | 13:22 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove resolved bug + duplicated phrase from sentence https://review.opendev.org/c/openstack/openstack-ansible/+/951518 | 13:23 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:47 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:47 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:49 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:50 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:50 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: Move deploy-guide under docs for translation https://review.opendev.org/c/openstack/openstack-ansible/+/949497 | 13:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: [doc] Remove Ubuntu 16.04 reference from deploy guide https://review.opendev.org/c/openstack/openstack-ansible/+/951697 | 13:53 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: scaling deployment with MariaDB and RabbitMQ https://review.opendev.org/c/openstack/openstack-ansible/+/949979 | 14:45 |
| mgariepy | anyone seen this task taking a very long time to run ? TASK [python_venv_build : Fail if wheels are not built for multiple hosts] | 14:56 |
| mgariepy | it's on yoga fyi | 14:56 |
| mgariepy | ansible-playbook is taking 100% cpu... not much else going on | 14:57 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: scaling deployment with MariaDB and RabbitMQ https://review.opendev.org/c/openstack/openstack-ansible/+/949979 | 15:07 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: proper highlighting of states in HAProxy https://review.opendev.org/c/openstack/openstack-ansible/+/951480 | 15:11 |
| noonedeadpunk | mgariepy: it should be a simple assertion. But Ansible might hide next task output under the hood | 15:20 |
| noonedeadpunk | so while executing task + 1 for a while still show-up N-1 | 15:20 |
| noonedeadpunk | which would be package installation I guess.. | 15:21 |
| noonedeadpunk | still should not take too long though | 15:21 |
| mgariepy | ps auxf doesnt show anything. | 15:23 |
| noonedeadpunk | huh | 15:24 |
| noonedeadpunk | I was jsut spotting kinda alike behavior with tempest, when ansible was showing smth like "Installing packages into venv" but in fact was already running tempest tests | 15:25 |
| noonedeadpunk | so maybe it's building wheels or smth at this point and didn't sync output | 15:25 |
| mgariepy | bash /usr/local/bin/openstack-ansible os-nova.... then python3 form ansbile-runtime under and nothuing else | 15:25 |
| noonedeadpunk | then dunno... | 15:26 |
| mgariepy | after a while, like time to socket to expire. the next tasks is printed `TASK [python_venv_build : include_tasks]` | 15:26 |
| mgariepy | but i only have this: Z+ 15:25 0:06 | \_ [ansible-playboo] <defunct> | 15:27 |
| noonedeadpunk | maybe related to ssh options and session persistance... | 15:27 |
| noonedeadpunk | but then it would be random places | 15:27 |
| noonedeadpunk | not a specific one | 15:27 |
| mgariepy | always this place even if i comment preview tasks in the playbook | 15:28 |
| mgariepy | tried to flush cache. | 15:28 |
| noonedeadpunk | it was *backported* to Yoga | 15:28 |
| noonedeadpunk | but no idea if you have that | 15:28 |
| noonedeadpunk | https://review.opendev.org/q/I54a9e637c9575c32429d28b89541ba026580e511 | 15:28 |
| noonedeadpunk | you probably should as it was quite early in Yoga | 15:29 |
| mgariepy | yes i do. | 15:29 |
| mgariepy | ;et | 15:30 |
| mgariepy | let's run -vv .. :/ | 15:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Add El10 support https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/951784 | 15:31 |
| noonedeadpunk | doh. forgot to push that one :( | 15:31 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_horizon master: Add EL10 support https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/951784 | 15:31 |
| mgariepy | -vv does help. to see it seems to do something tho. | 15:42 |
| mgariepy | not sure why it's slow like that. | 15:42 |
| mgariepy | something like 3-5 sec per host. | 15:43 |
| mgariepy | i have about 120 on this cluster | 15:44 |
| mgariepy | wow 7 sec for the second task.. | 15:45 |
| mgariepy | newer release are way better lol. | 15:48 |
| mgariepy | once every 7 second one more line.. Task "" has been omitted from the job because the conditional "["nova_install_method == 'source'", 'venv_wheel_build_enable | bool', 'inventory_hostname in _venv_wheels_first_play_hosts']" was evaluated as "False" | 15:50 |
| mgariepy | 100 cpu for this. | 15:50 |
| mgariepy | that's impressive how wasteful it is haha | 15:51 |
| noonedeadpunk | huh, indeed | 15:54 |
| noonedeadpunk | that's not fun at all :( | 15:55 |
| noonedeadpunk | there could also be differences in imports/includes which did not play well together | 15:55 |
| mgariepy | yep. | 15:56 |
| mgariepy | strace was showing a bunch the lstat on various directory | 15:56 |
| mgariepy | i'm not patient enough to wait for 2 tasks for 15 minutes each without any output. lol | 15:58 |
| mgariepy | running upgrade on 2024.1 the other with a similar sized cluster was way faster. | 16:04 |
| mgariepy | which i though at first that it was due to nvme vs sata ssd.. haha | 16:05 |
| opendevreview | Merged openstack/openstack-ansible master: docs: fix incorrect use of bool values https://review.opendev.org/c/openstack/openstack-ansible/+/951632 | 16:09 |
| opendevreview | Merged openstack/openstack-ansible master: docs: fix minor grammar mistake https://review.opendev.org/c/openstack/openstack-ansible/+/951497 | 16:09 |
| opendevreview | Merged openstack/openstack-ansible master: docs: add guilabels for managing images page https://review.opendev.org/c/openstack/openstack-ansible/+/951514 | 16:09 |
| opendevreview | Merged openstack/openstack-ansible master: docs: minor instructions update for managing instances https://review.opendev.org/c/openstack/openstack-ansible/+/951515 | 16:09 |
| noonedeadpunk | I kinda if that is smth else potentially | 16:20 |
| noonedeadpunk | like how variables are structured | 16:21 |
| noonedeadpunk | or maybe hashi vault is used there? | 16:21 |
| mgariepy | no hashivault. | 16:21 |
| noonedeadpunk | as remote loopback can be also very slow | 16:22 |
| mgariepy | i really feel like it's ansible code issues here. | 16:22 |
| noonedeadpunk | extremely likely... | 16:23 |
| mgariepy | yeah | 16:24 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: proper highlighting of states in HAProxy https://review.opendev.org/c/openstack/openstack-ansible/+/951480 | 16:24 |
| mgariepy | it's really annoying anyway | 16:26 |
| mgariepy | let's exclude half the computes.. | 16:34 |
| mgariepy | should be at least twice as fast lol. | 16:35 |
| noonedeadpunk | you should be able to set smth like `nova_compute_serial: 30%` or smth... | 16:41 |
| noonedeadpunk | but also I wonder if worth increasing amount of ansible forks? | 16:42 |
| noonedeadpunk | not sure if it helps if 100% cpu is used anyway | 16:42 |
| mgariepy | already a 150 forks | 16:44 |
| noonedeadpunk | um | 16:44 |
| noonedeadpunk | have you tuned SSHD settings for that? | 16:44 |
| mgariepy | it was working for the last upgrade. | 16:45 |
| mgariepy | when it hangs it not doing ssh connection. | 16:46 |
| noonedeadpunk | talkign about smth like that: https://bugs.launchpad.net/openstack-ansible/+bug/1479812/comments/10 | 16:46 |
| noonedeadpunk | it's been a while... But I'd assume it still an issue | 16:46 |
| noonedeadpunk | as you also have a delegated task to repo container right where it hanfs | 16:47 |
| noonedeadpunk | like dunno... | 16:48 |
| mgariepy | i'll run the cmputes nodes in 2 batches. not a big deal | 16:48 |
| mgariepy | there is something really weird with that particual release of ansible. | 16:49 |
| mgariepy | i'll try with nova_compute 35% next time around. | 16:54 |
| opendevreview | Merged openstack/openstack-ansible master: docs: Correct service name for Manila + fix URL links https://review.opendev.org/c/openstack/openstack-ansible/+/951629 | 17:03 |
| noonedeadpunk | these should pretty much conclude el10 topic, at least core parts: https://review.opendev.org/q/topic:%22osa/el10%22+status:open | 17:32 |
| noonedeadpunk | rest we will discover when CI will be available I guess | 17:33 |
| opendevreview | Merged openstack/openstack-ansible-galera_server master: Do not verify MariaDB version when installed from distro repos https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951317 | 18:09 |
| mgariepy | yoga is my less favorite release in a while lol. | 18:48 |
| mgariepy | yoga > 2023.1 is painless usually ? | 18:49 |
| noonedeadpunk | usually :) | 18:50 |
| mgariepy | lol. | 18:50 |
| noonedeadpunk | I was always upgrading to 2023.1 from xena | 18:50 |
| mgariepy | so from yoga should be easy | 18:50 |
| mgariepy | ever swapped network switches from one vendor to another one in prod? | 18:54 |
| mgariepy | everything is bonded on 2 switches | 18:54 |
| mgariepy | and obviously there are no room to just install a new switch under the one that needs to swap out. | 18:55 |
| jrosser | is it mlag | 18:55 |
| mgariepy | yep | 18:56 |
| jrosser | probably the only option is to just remove one entirely and break the mlag setup from the switch POV | 18:56 |
| mgariepy | our plan is pretty much break mlag, swap 1 switch, poweroff everything, and powert back on validating network. on the new one. | 18:57 |
| jrosser | you may not need to power off | 18:58 |
| mgariepy | not quite sure how to pass the undernet vlan on the new one. | 18:58 |
| jrosser | if you down the relevant interface on all the servers then you can perhaps fail it over | 18:58 |
| mgariepy | network underneat is vxlan accross DC rooms. | 18:59 |
| jrosser | oh ok :) | 18:59 |
| mgariepy | lol | 18:59 |
| mgariepy | only vlan it would have been a lot easier i think | 19:00 |
| jrosser | i think so | 19:00 |
| mgariepy | haha yeah. | 19:00 |
| jrosser | i have a similar migration to do but it's leaf/spine so i can do one pod at once | 19:01 |
| jrosser | which is perhaps easier | 19:01 |
| mgariepy | i only have 2 ""pods"" to do. | 19:01 |
| jrosser | so lonk as the vxlan is interoperable (hahahaha) | 19:01 |
| mgariepy | but the network span accross them | 19:01 |
| mgariepy | lol the reason we need to migrate is because your statement doesn't work (LOL) | 19:02 |
| mgariepy | compat issues | 19:02 |
| jrosser | excellent :) | 19:02 |
| mgariepy | cumulus to sonic fyi. | 19:02 |
| jrosser | we attempt cisco to arista | 19:03 |
| mgariepy | we are too poor for arista here :D ahah | 19:03 |
| * jrosser bought loads of used stuff recently | 19:04 | |
| jrosser | cannot afford new | 19:04 |
| mgariepy | we were mosly using cumulus until covid hit and we were not able to get hardware enymore. | 19:04 |
| mgariepy | the sad part about sonic is that the open version is not working. | 19:05 |
| mgariepy | looks like nova will succeed! with serial 35% and 30 forks | 19:11 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server stable/2025.1: Do not verify MariaDB version when installed from distro repos https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951806 | 19:45 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server stable/2024.2: Do not verify MariaDB version when installed from distro repos https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951807 | 19:45 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-galera_server stable/2024.1: Do not verify MariaDB version when installed from distro repos https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951808 | 19:46 |
| opendevreview | Merged openstack/openstack-ansible master: docs: proper highlighting of states in HAProxy https://review.opendev.org/c/openstack/openstack-ansible/+/951480 | 19:47 |
| opendevreview | Merged openstack/openstack-ansible master: docs: scaling deployment with MariaDB and RabbitMQ https://review.opendev.org/c/openstack/openstack-ansible/+/949979 | 19:47 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: wip https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 20:00 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: wip https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 20:03 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: wip https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 20:05 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text Change-Id: I214a1922aeb1bd436fb315ea9ce22acaa8d3872d https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 20:06 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 20:06 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove deprecated nova and neutron CLI clients https://review.opendev.org/c/openstack/openstack-ansible/+/951507 | 20:17 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove duplicate code blocks https://review.opendev.org/c/openstack/openstack-ansible/+/947634 | 20:44 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove duplicate code blocks https://review.opendev.org/c/openstack/openstack-ansible/+/947634 | 20:47 |
| opendevreview | Merged openstack/openstack-ansible-galera_server master: Add support for EL10 https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/951315 | 20:48 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove duplicate code blocks https://review.opendev.org/c/openstack/openstack-ansible/+/947634 | 20:50 |
| opendevreview | Merged openstack/openstack-ansible-os_tempest master: Remove support for sahara and senlin https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/951053 | 20:50 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove deprecated nova and neutron CLI clients https://review.opendev.org/c/openstack/openstack-ansible/+/951507 | 20:55 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 22:39 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 22:39 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 22:41 |
| opendevreview | Dmitriy Chubinidze proposed openstack/openstack-ansible master: docs: remove duplicate code blocks https://review.opendev.org/c/openstack/openstack-ansible/+/947634 | 22:50 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 22:57 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 23:09 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text and few mistakes https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 23:10 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: small fix for formatting text and few mistakes https://review.opendev.org/c/openstack/openstack-ansible/+/951811 | 23:16 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: wip https://review.opendev.org/c/openstack/openstack-ansible/+/951816 | 23:41 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: wip https://review.opendev.org/c/openstack/openstack-ansible/+/951816 | 23:43 |
| opendevreview | Ivan Anfimov proposed openstack/openstack-ansible master: docs: MySQL replaced to MariaDB in deploy-guide https://review.opendev.org/c/openstack/openstack-ansible/+/951816 | 23:43 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!