| opendevreview | Merged openstack/openstack-ansible-os_swift master: Replace get_md5 parameter to stat module https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/922283 | 09:03 |
|---|---|---|
| opendevreview | Merged openstack/openstack-ansible-os_nova master: Update conditions for kernel statoverride https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/922557 | 09:10 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron stable/2023.2: Remove handler delegation for DB contract https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/922556 | 09:14 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2024.1: Update conditions for kernel statoverride https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/922712 | 09:23 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.2: Update conditions for kernel statoverride https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/922713 | 09:23 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_nova stable/2023.1: Update conditions for kernel statoverride https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/922714 | 09:23 |
| jrosser | so we always refer to openstack-ansible-plugins as a sha rather than `master` - is that a limitation of ansible-galaxy? | 09:44 |
| opendevreview | Merged openstack/openstack-ansible master: Update pip/wheel/setuptools/uwsgi versions to latest https://review.opendev.org/c/openstack/openstack-ansible/+/922376 | 09:45 |
| opendevreview | Merged openstack/openstack-ansible-galera_server stable/2023.2: Fix condition in cluster state checks https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/922554 | 10:04 |
| damiandabrowski | jrosser: that's a good question...I don't think it's because of ansible-galaxy limitation | 10:19 |
| damiandabrowski | I just tried it with version: master and it worked fine | 10:19 |
| jrosser | i wonder if it looks for a tag, would be interesting to see if it actually has deployed master | 10:31 |
| damiandabrowski | https://paste.openstack.org/show/bW852qmgMAqRqx8zvUKG/ | 10:46 |
| damiandabrowski | looks good I think and it contains recent commit: https://github.com/openstack/openstack-ansible-plugins/commit/bbaf62e9233bd240da2bd3d613062cdeb9b5101e | 10:47 |
| damiandabrowski | jrosser: this is the culprit: https://github.com/ceph/ceph-ansible/commit/1121e6d98a41a913886240bcb873380008afcafc | 11:06 |
| damiandabrowski | so i think we should include one more change in your patch https://review.opendev.org/c/openstack/openstack-ansible/+/921976 | 11:06 |
| damiandabrowski | which is to replace 'client.rgw.' ~ hostvars[inventory_hostname]['ansible_facts']['hostname'] ~ '.rgw0': { | 11:06 |
| damiandabrowski | with 'client.rgw.' ~ rgw_zone ~ '.' ~ hostvars[inventory_hostname]['ansible_facts']['hostname'] ~ '.rgw0': { | 11:06 |
| damiandabrowski | in inventory/group_vars/ceph-rgw.yml | 11:07 |
| damiandabrowski | and possibly also define default value for rgw_zone in OSA inventory | 11:12 |
| noonedeadpunk | jrosser: it's jsut me forgettign to switch to master after branching | 11:25 |
| noonedeadpunk | so we can totally run master | 11:26 |
| jrosser | ah ok - i was just looking back through the git blame and that one seemed to be SHA for a long time, so i hesitated to make a patch setting to master | 11:27 |
| noonedeadpunk | but also we kinda need to change version for each release in plugins... | 11:29 |
| noonedeadpunk | as otherwise it's confusing as hell | 11:29 |
| noonedeadpunk | but I wonder if it would make sense to align with osa versioning | 11:31 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins stable/2023.1: Update plugins collection version https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/922720 | 11:33 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins stable/2023.2: Update plugins collection version https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/922721 | 11:34 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins stable/2024.1: Update plugins collection version https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/922722 | 11:34 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Update plugins collection version https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/922723 | 11:34 |
| noonedeadpunk | #startmeeting openstack_ansible_meeting | 15:03 |
| opendevmeet | Meeting started Tue Jun 25 15:03:02 2024 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:03 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:03 |
| opendevmeet | The meeting name has been set to 'openstack_ansible_meeting' | 15:03 |
| noonedeadpunk | #topic office hours | 15:03 |
| jrosser | o/ hello | 15:03 |
| noonedeadpunk | o/ | 15:03 |
| noonedeadpunk | hey | 15:03 |
| damiandabrowski | hi! | 15:03 |
| noonedeadpunk | I clean forgot that I will need to leave shortly - so let's make this quick :) | 15:03 |
| noonedeadpunk | So ceph-ansible 9.0 issue I think Damian you was working on | 15:04 |
| noonedeadpunk | and had some progress from what I recall? | 15:04 |
| NeilHanlon | o/ - am only kinda around today | 15:04 |
| noonedeadpunk | sorry, 8.0 | 15:04 |
| noonedeadpunk | ++ | 15:04 |
| jrosser | yes it looks like there was a renaming of the service for rgw which we need to accomodate | 15:05 |
| damiandabrowski | yeah, this patch is responsible for the issue: https://github.com/ceph/ceph-ansible/commit/1121e6d98a41a913886240bcb873380008afcafc | 15:05 |
| damiandabrowski | I proposed a solution above ^ | 15:05 |
| jrosser | would you like to make a patch - else i can do that? | 15:05 |
| damiandabrowski | if we apply a fix in a separate patch, we'll probably have circular dependency :/ | 15:06 |
| damiandabrowski | i can push a commit to your change if you don't have anything against it | 15:07 |
| damiandabrowski | https://review.opendev.org/c/openstack/openstack-ansible/+/921976 | 15:07 |
| jrosser | sure thats no problem, i don't mind | 15:07 |
| noonedeadpunk | so, I guess I'd define `rgw_zone` to value of ceph_cluster_name if it makes any sense? | 15:07 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-ceph_client/src/branch/master/defaults/main.yml#L52-L54 | 15:08 |
| jrosser | i think `default` | 15:08 |
| jrosser | you may have multiple zone groups in one cluster | 15:08 |
| noonedeadpunk | aha | 15:08 |
| damiandabrowski | okok, I'll try to figure out how to apply the fix in a separate change but if I won't be able to come up with anything wise, I'll just push a commit to your change | 15:08 |
| noonedeadpunk | ok, fair enough | 15:08 |
| jrosser | you can just edit my change, that will be easier | 15:09 |
| noonedeadpunk | nah, you should edit Jonathan's one | 15:09 |
| noonedeadpunk | otherwise it won't pass CI | 15:09 |
| damiandabrowski | ok | 15:09 |
| jrosser | thankyou for finding that :) | 15:09 |
| damiandabrowski | I also need to figure out how to not break environments that use recent OSA version with ceph-ansible 7.0 | 15:09 |
| damiandabrowski | no problem at all ;) | 15:09 |
| noonedeadpunk | there's a ML asking for some assistance with Central Logging in OSA | 15:09 |
| noonedeadpunk | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/B26UYEP7NA5YTCPABLO5TSKU63JLCVJR/ | 15:09 |
| jrosser | i also did reply to mariusz about mcapi on debian but did not have change to test that myself yet | 15:10 |
| noonedeadpunk | I was going to answer something about ELK role, but then thought if maybe jrosser you had some ideas about what reply would be the best | 15:10 |
| jrosser | yeah, elk role is kind of expert level stuff somehow | 15:11 |
| noonedeadpunk | yeah, I didn't come to a point of testing capi yet :( | 15:11 |
| jrosser | hah no worries, at this moment i am working on tooling for offline installs | 15:11 |
| noonedeadpunk | so - better say that you can grab journald from metal hosts with whatever you want, but also we have elk role just in case? | 15:12 |
| jrosser | yes so it depends - one aspect is inventory integration | 15:12 |
| jrosser | perhaps thats something we should have an example of, how to deploy some easy collector but not a whole stack | 15:13 |
| jrosser | and then the other aspect is deploying a whole elk stack which is way more scope than that | 15:13 |
| noonedeadpunk | yeah... | 15:13 |
| noonedeadpunk | though I think deploying elk stack is also quite valuable | 15:14 |
| jrosser | yes, the roles are pretty complete and very flexible | 15:14 |
| noonedeadpunk | ok, I will try come up with something unless you want to :) | 15:14 |
| jrosser | but they do only get very irregular maintainance | 15:14 |
| jrosser | sure no problem | 15:14 |
| noonedeadpunk | I was going on to check on mariadb 11.4 - but didn't manage yet | 15:15 |
| jrosser | right i did have some time on that | 15:16 |
| noonedeadpunk | and also - by end of the week (or likely somewhere during weekends) we'd need to have a bugfix release - or at least sha bump proposed. Will see how things land, but would be nice to also land known backports until then | 15:16 |
| jrosser | ^ so on that andrewbonney is just preparing for a lab deploy of C | 15:16 |
| jrosser | we may find some thing this week | 15:16 |
| noonedeadpunk | (how things land for services) | 15:16 |
| jrosser | and on mariadb the issue seems to be around TLS | 15:17 |
| noonedeadpunk | yep | 15:17 |
| jrosser | well, first the client name is changed mariadb<>myqsl but that is an easy patch | 15:17 |
| jrosser | but the startup script fails due to tls trouble, i think we drop our custom certs and something is broken with the client not knowing about the ca | 15:17 |
| noonedeadpunk | But tls is kinda weird | 15:17 |
| noonedeadpunk | Yeah | 15:18 |
| damiandabrowski | regarding central logging: we also have https://github.com/openstack/openstack-ansible-plugins/tree/master/roles/journald_remote which may be helpful | 15:18 |
| noonedeadpunk | Potentially it expects different format or smth | 15:18 |
| noonedeadpunk | Oh, yes, that is great point Damian! | 15:18 |
| noonedeadpunk | Journald remote on itself not very well developed iirc, but yeah | 15:19 |
| noonedeadpunk | There was also some playbook for journal2gelf for graylog | 15:19 |
| noonedeadpunk | Which I used... 4y ago | 15:19 |
| damiandabrowski | yeah, i remember some issues with logs rotation | 15:22 |
| noonedeadpunk | Also, talking about logs... Ovn still does not use journal in our setup... | 15:22 |
| damiandabrowski | https://github.com/systemd/systemd/issues/5242 | 15:22 |
| damiandabrowski | porbably this one | 15:22 |
| noonedeadpunk | Also I have patches regarding oslo_concurrency in my backlog | 15:24 |
| noonedeadpunk | And, overall, seems this release might be quite busy with adding new os support | 15:25 |
| noonedeadpunk | In terms of el10 and Ubuntu 24.04 | 15:25 |
| noonedeadpunk | But likely makes sense to do el10 for the next one even | 15:26 |
| noonedeadpunk | As it will appear too late, imo | 15:26 |
| jrosser | yes i have a list too with these on | 15:26 |
| jrosser | i can do some - was thinking to look at 24.04 quite soon | 15:27 |
| noonedeadpunk | ++, that would be sweet | 15:27 |
| jrosser | on also we did a bobcat upgrade last week | 15:27 |
| jrosser | and when upgrading nova, performance (horizon responsiveness) seems to be quite a lot worse | 15:28 |
| noonedeadpunk | Huh | 15:28 |
| jrosser | so there is something odd happening there and we did not yet dig into it | 15:28 |
| jrosser | but i know you have done rally stuff in the past? | 15:28 |
| noonedeadpunk | Well, we do have one bobcat region, but it's a new one, so hard to judge on performance so far | 15:29 |
| jrosser | andrewbonney: was looking at this a small amount | 15:29 |
| noonedeadpunk | Well, yeah, I did used rally in CI periodically some time ago | 15:29 |
| noonedeadpunk | So have a comparable results and to judge on API responsiveness | 15:30 |
| noonedeadpunk | But not now... Though might make total sense to do that before upgrades to caracal then... | 15:30 |
| jrosser | i think the first place we might look is the database, perhaps sqlalchemy changes bring somethng there | 15:31 |
| noonedeadpunk | Well, it's still sqlalchemy <2 there | 15:32 |
| noonedeadpunk | Just some work was done for compatibility with 2.0 | 15:33 |
| noonedeadpunk | Even in caracal it's not 2.0 yet | 15:33 |
| noonedeadpunk | So sqlalchemy should be pretty much same version as for Antelope just in xase | 15:33 |
| jrosser | hmmmm | 15:33 |
| noonedeadpunk | But mariadb version? | 15:34 |
| noonedeadpunk | Did we used same lts as for Antelope? | 15:34 |
| jrosser | yes 10.11 in both cases | 15:36 |
| noonedeadpunk | Well.... | 15:36 |
| noonedeadpunk | Some compatibility things could bring regression ofc... | 15:36 |
| noonedeadpunk | But dunno | 15:37 |
| noonedeadpunk | Sorry, I need to run now | 15:40 |
| noonedeadpunk | So if anything - let's catch up slightly later :) | 15:40 |
| noonedeadpunk | #endmeeting | 15:41 |
| opendevmeet | Meeting ended Tue Jun 25 15:41:28 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:41 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-06-25-15.03.html | 15:41 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-06-25-15.03.txt | 15:41 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2024/openstack_ansible_meeting.2024-06-25-15.03.log.html | 15:41 |
| balsa | Looking for some deployment advice, I've been running a deployment using Kolla for a few years and want to see if the openstack-ansible grass was greener, I've got a 8 node cluster with rather limited networking (A public IP subnet of /24 and a /25, and two L2 VLANs that I can use really any ips with) All 8 nodes are identical (2 100Gbit networking, 2 13TB NVME) Looking over the guides for Openstack Anible, its rather compl | 20:18 |
| balsa | Kolla really likes when you can deploy from a dedicated VM, openstack-ansible is throwing a fit since the management IPs of the boxes are in that /25 range, Ansible it self doesn't seem to understand the mangement ip vs the internal ranges, I'm using a /22 on the L2 VLAN, but the deployment VM is not on that VLAN as its across the datacenter. I /do/ have a ssh config that uses one of the hosts as a jump box, in kolla this w | 20:21 |
| balsa | in openstack-ansible its really mad in transfering files over. I'm also rather confused but some of the configuration examples since its not /really/ a AIO (one node should be mgr only, the rest are compute / storage | 20:22 |
| balsa | so to keep this simple, is there a way to "clean" up a failed deployment well besides the lxc-container-destory playbook | 20:24 |
| jrosser | balsa: there are people around here mostly during EU working hours | 20:39 |
| jrosser | your messages are truncated - are you using some sort of irc gateway service? | 20:40 |
| balsa | I'm using the OFTC webirc client | 20:42 |
| balsa | Guess that would do it | 20:42 |
| balsa | too add to my main issue of the setup-hosts.yml playboot failing, https://paste.opendev.org/show/bdb9OJnUxC4Uqq2pTi2Y/ | 20:45 |
| balsa | playbook* everything works up until that step, something is missing somewhere | 20:46 |
| Balsa | there, switched over to a better client | 20:55 |
| jrosser | it is very kate here - eu tz is best | 20:59 |
| jrosser | *late | 20:59 |
| jrosser | but there is config possible to separate the ssh addresses from the internal network | 20:59 |
| jrosser | that is not the default though | 21:00 |
| Balsa | It had seemed to ignore that value when I applied it. My openstack_user_config.yml https://paste.debian.net/hidden/4ade0e9d/ | 21:02 |
| Balsa | Its all good jrosser if you are EUTZ, Ill loop back around during EUTZ primetime, I'm UTC-5 right now | 21:03 |
| opendevreview | Damian Dąbrowski proposed openstack/openstack-ansible master: Switch to ceph-ansible stable-8.0 https://review.opendev.org/c/openstack/openstack-ansible/+/921976 | 22:03 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!