| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Test on ARM64 https://review.opendev.org/c/openstack/openstack-ansible/+/872423 | 08:43 |
|---|---|---|
| noonedeadpunk | mornings | 09:09 |
| noonedeadpunk | BobZannapolis: well, to spawn a vm on a specific hypervisor you can use scheduler hints. So likely you can iterate over hypervisor list and supply it as a hint to server create command | 09:10 |
| jrosser | erlang on arm is unfortunate - looks like the only reasonable place to get the pacakges from is here http://packages.erlang-solutions.com/ubuntu/pool/ | 09:44 |
| jrosser | idk if we should move back to that, and ask again if we can have an infra mirror of it | 09:45 |
| noonedeadpunk | well. I wonder if mirroring will help actually. As it was out of sync iirc? And for mirroring it should also support rsync | 09:59 |
| noonedeadpunk | ie we were struggling from broken metadata | 09:59 |
| noonedeadpunk | which will likely jsut be pulled in to mirrors as is? | 10:00 |
| jrosser | hmm depends what tool makes the mirror i think - if it recomputes the Packages file or just blindly rsyncs everything | 10:02 |
| jrosser | looks like it is reprepro | 10:05 |
| jrosser | noonedeadpunk: if you have good ideas about how we can get arm64 jobs running would be interested - we're about to deploy arm nodes so i'd like to get some coverage of that | 10:06 |
| noonedeadpunk | I don't have any better idea then to add repos conditionally based on arch though | 10:14 |
| noonedeadpunk | but yes, rabbit quite a mess overall | 10:14 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Allow to manage more the one vhost with mq_setup https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/875399 | 10:33 |
| opendevreview | Merged openstack/openstack-ansible-galera_server stable/zed: Allow maridbcheck socket to FreeBind https://review.opendev.org/c/openstack/openstack-ansible-galera_server/+/874732 | 10:47 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Support erlang installation for arm64 hosts https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/875629 | 10:48 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Test on ARM64 https://review.opendev.org/c/openstack/openstack-ansible/+/872423 | 10:48 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Support erlang installation for arm64 hosts https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/875629 | 11:26 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Support erlang installation for arm64 hosts https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/875629 | 12:09 |
| noonedeadpunk | hm, looks like plugins repo does not really test patch content | 12:52 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible stable/zed: Do not run dstat by default https://review.opendev.org/c/openstack/openstack-ansible/+/875608 | 12:54 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-ceph_client master: Improve regexp for fetching nova secret from files https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/871819 | 12:57 |
| *** lowercase is now known as Guest6173 | 13:42 | |
| *** lowercase_ is now known as lowercase | 13:42 | |
| opendevreview | Merged openstack/openstack-ansible-os_neutron stable/zed: Generate OVN certs only for OVN scenario https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/874837 | 14:26 |
| noonedeadpunk | no way! zuul now does spot nested ansible and prints output of issue with regards to it? | 14:56 |
| noonedeadpunk | Like valuable output here - https://zuul.opendev.org/t/openstack/build/b7778621493d4f9cb5551850eaf984be | 14:56 |
| noonedeadpunk | but yeah - seems like plugins repo testing is broken | 14:56 |
| noonedeadpunk | #startmeeting openstack_ansible_meeting | 15:00 |
| opendevmeet | Meeting started Tue Feb 28 15:00:04 2023 UTC and is due to finish in 60 minutes. The chair is noonedeadpunk. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'openstack_ansible_meeting' | 15:00 |
| noonedeadpunk | #topic rollcall | 15:00 |
| noonedeadpunk | o/ | 15:00 |
| jrosser | o/ hello | 15:00 |
| noonedeadpunk | #topic office hours | 15:02 |
| noonedeadpunk | I don't have much this time. I've started looking into quorum queues and by far found that plugins repo does not test actual code. Repo is in required-projects but likely we don't install collection from zuul path for some reason | 15:04 |
| noonedeadpunk | jrosser: I know you've proposed patch to change approach there a bit but it failed as well - I didn't have time to check what went wrong there | 15:04 |
| noonedeadpunk | will have some deeper look during the week | 15:05 |
| jrosser | i've not had time to look either | 15:05 |
| noonedeadpunk | Also I've spawned 3VMs aio to play with haproxy patches, but haven't started playing much | 15:05 |
| noonedeadpunk | We've breifly discussed yestarday where it's worth to pay attention - like handler dynamic naming and virtual groups | 15:06 |
| noonedeadpunk | It's also absolutely worth splitting changes of haproxy_services format and adoption for splitting configs into 2 patches | 15:07 |
| noonedeadpunk | As of now I tried sandbox without LE, and it seems like approach overall working. The only thing that came to my mind - it will be way trickier to expand pool of haproxies or add some new host | 15:08 |
| noonedeadpunk | as basically you'll need to run setup-everything. Might be not a big deal given documentation and working tags though | 15:09 |
| noonedeadpunk | I've also tried bumping mariadb version to 10.11 and it obviously didn't "just worked" as package names seems to have changed. | 15:16 |
| noonedeadpunk | And now it seems to be aligned with distro names ie not having major version at the end | 15:17 |
| noonedeadpunk | It seems they've stopped doing that since 10.8. So some work is needed there for sure | 15:18 |
| noonedeadpunk | I also need these 2 features to inventory land or have some decent alternative to them for 2023.1 | 15:20 |
| noonedeadpunk | #link https://review.opendev.org/c/openstack/openstack-ansible/+/870113 | 15:20 |
| noonedeadpunk | #link https://review.opendev.org/c/openstack/openstack-ansible/+/869762 | 15:20 |
| noonedeadpunk | As we rely on them as of today in concept deployment | 15:20 |
| noonedeadpunk | (which should become prod by summer) | 15:21 |
| noonedeadpunk | Another possibly sad topic is uwsgi. I assume some might have read MLs regarding this. In short uwsgi is in maintenance only as of today (and for the last year) | 15:22 |
| noonedeadpunk | There're discussions ongoing on what should we all do with regards to that and if there should be some tested by default wsgi backend | 15:28 |
| noonedeadpunk | Or at very least I'd love that this was a thing ^ | 15:28 |
| jamesdenton_ | o/ | 15:32 |
| noonedeadpunk | I was thinking that at worst it might be worth renaming uwsgi role to jsut wsgi and have an option to setup gunicorn as well | 15:32 |
| jrosser | sorry also in another meeting right now | 15:35 |
| noonedeadpunk | no worries | 15:35 |
| noonedeadpunk | I think that's kind of it from my side. I don't think we have any new bugs to discuss | 15:37 |
| noonedeadpunk | But reviews on stable branches backports are super welcome to get new releases | 15:37 |
| jrosser | i will also try to look at the haproxy stuff | 15:41 |
| jrosser | i'd like to try the add_host approach | 15:41 |
| noonedeadpunk | So basically get rid of delegate_to approach? | 15:45 |
| noonedeadpunk | The thing I'm concerned about, is that with dynamic group, when adding haproxy hosts to glance_api, for example, it will result in placing template on hosts that are not intended for that. But maybe indeed there's a way for that | 15:47 |
| noonedeadpunk | I was trying to focus on handlers thing now as it's quite annoying as well. | 15:47 |
| noonedeadpunk | at least concept overall is working from what I can tell. | 15:48 |
| jrosser | i was hoping that `add_host` would let you do new_group = haproxy_all hosts [also member of glance_all] | 15:54 |
| jrosser | then be able to run against `new_group` which would just be haproxy_all hosts but also with glance vars | 15:54 |
| noonedeadpunk | well, then role will run against all hosts in this new group, isn't it? | 16:03 |
| noonedeadpunk | So it will deploy haproxy.conf on both haproxy_all and glance_all | 16:03 |
| jrosser | i don't know - i need to make some quick test playbook to see | 16:05 |
| noonedeadpunk | Maybe, if add haproxy_all to glance_all temporary instead of new_group and run against haproxy_all will do the trick... But it kind of depends in glance_all is group that consist of children or not... | 16:06 |
| noonedeadpunk | but yeah, worth checking this for sure | 16:06 |
| noonedeadpunk | #endmeeting | 16:06 |
| opendevmeet | Meeting ended Tue Feb 28 16:06:58 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:06 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2023/openstack_ansible_meeting.2023-02-28-15.00.html | 16:06 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/openstack_ansible_meeting/2023/openstack_ansible_meeting.2023-02-28-15.00.txt | 16:06 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/openstack_ansible_meeting/2023/openstack_ansible_meeting.2023-02-28-15.00.log.html | 16:06 |
| noonedeadpunk | jrosser: setting handlers as variables looks like working nicely | 16:55 |
| jrosser | oh cool | 16:55 |
| noonedeadpunk | I was a bit o_O but it works :) | 16:56 |
| jrosser | do you think that completely indpendant of the haproxy work we should change make `cert installed` overridable in the PKI role | 16:56 |
| noonedeadpunk | yes, totally | 16:56 |
| jrosser | then make the handler names specific in the service roles | 16:56 |
| noonedeadpunk | Well. | 16:56 |
| noonedeadpunk | We can make it specific only for haproxy for now | 16:56 |
| noonedeadpunk | As you can pass `handler name` on the pki role include | 16:57 |
| jrosser | oh well i meant really as we add TLS to the roles | 16:57 |
| noonedeadpunk | But yeah, we can provide role specific handler names everywhere if we want to | 16:57 |
| noonedeadpunk | But we don't have to except for haproxy | 16:57 |
| jrosser | then that will make the need for the dummy handlers file go away? | 16:58 |
| noonedeadpunk | yup | 16:58 |
| jrosser | and also remove that kind of duplicate tasks file | 16:58 |
| noonedeadpunk | Well. I was going to do include there | 16:58 |
| noonedeadpunk | as we might indeed need to inlcude vars as an extra | 16:59 |
| noonedeadpunk | Dunno if damiandabrowski will be mad at me but I'm going to push some updates... | 16:59 |
| noonedeadpunk | Also I've found weird things going on with tags - I "accidentally" spawned only 1 haproxy host and then added 2 more, so had to test how haproxy-service-config tag does work. While it works - rabbit role somehow fails as it's start being executed | 17:00 |
| noonedeadpunk | But I'd blame role itself | 17:00 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/ansible-role-pki master: Allow to provide custom handler names https://review.opendev.org/c/openstack/ansible-role-pki/+/875757 | 17:15 |
| noonedeadpunk | this ^ | 17:15 |
| jrosser | out of interest can that be a list? | 17:21 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Simplify haproxy_service_configs structure https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/871188 | 17:30 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Fix tags usage for letsencrypt setup https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/875772 | 17:38 |
| noonedeadpunk | jrosser: hm...... | 17:38 |
| noonedeadpunk | let me see.... | 17:39 |
| jrosser | i was just checking the definition of notifiy and its string or list | 17:39 |
| noonedeadpunk | The most tricky thing how to define meta in handlers/main.yml | 17:39 |
| noonedeadpunk | And whether it would like meta handler in loop | 17:40 |
| jrosser | oh yes | 17:40 |
| jrosser | i was wondering if there was ever a use case for in the playbook calling the PKI role you want to make it trigger several handlers | 17:40 |
| noonedeadpunk | Well, maybe there is but I don't know yet about them | 17:41 |
| jrosser | it's kind of two things | 17:41 |
| jrosser | as they're noop handlers then if it's a list it can be hander_list[0] othewise the string | 17:43 |
| jrosser | i don't have a example of where it being a list would be useful but it just replicates the underlying behaviour of notify: | 17:44 |
| noonedeadpunk | lol, yes, you can | 17:44 |
| noonedeadpunk | should I change it to be a list though? | 17:45 |
| noonedeadpunk | but yeah... probably... | 17:45 |
| jrosser | well in defaults/main it can be a string for sure | 17:46 |
| jrosser | but passing as notify: - {{ string-or-list }} looked a bit suspicious | 17:46 |
| jrosser | instead notify: "{{ string-or-list }}" | 17:47 |
| noonedeadpunk | hm, I wonder if we need these meta handlers... | 17:47 |
| jrosser | i think we do in case the calling role doesnt have any | 17:48 |
| noonedeadpunk | ah! I got what you mean | 17:48 |
| noonedeadpunk | but that would be tricky for these meta... | 17:48 |
| noonedeadpunk | as then you should kind of pick if it's a list or string we're listening to | 17:49 |
| noonedeadpunk | as you can't do {{ var[0] }} for example | 17:49 |
| jrosser | `{{ ((handlers is not string) and (handlers is iterable)) | ternary(handlers[0], handlers) }}` | 17:51 |
| jrosser | ^ guess | 17:51 |
| noonedeadpunk | well... | 17:51 |
| noonedeadpunk | what is more suspicious.... | 17:51 |
| noonedeadpunk | jrosser: you can;t do handlers[0] as then handlers[1:] are undefined and role is unhappy | 17:56 |
| jrosser | even if those exist in the calling playbook? | 17:57 |
| noonedeadpunk | and yeah, you can't do loop in handlers either | 17:57 |
| jrosser | well i don't mean playbook do i | 17:57 |
| noonedeadpunk | nah, it's for usecase when they don't exist in playbook | 17:58 |
| noonedeadpunk | *role | 17:58 |
| noonedeadpunk | welll. | 17:59 |
| noonedeadpunk | I have an idea :D | 17:59 |
| noonedeadpunk | why in the world I didn't try to use listen there at first | 18:00 |
| noonedeadpunk | nah, variable in listen is not renderred | 18:01 |
| noonedeadpunk | So. To be frank I'd prefer restrict this to be a string rather string or list, as for some roles where handlers are undefined this might be quite breaking | 18:02 |
| jrosser | ok - just so we don't misunderstand this is what i was thinking https://etherpad.opendev.org/p/pki-handlers | 18:03 |
| noonedeadpunk | And well, given that variables are not respected in listen - you can't use them in service role handlers anyway | 18:03 |
| jrosser | lets keep it simple then :) | 18:09 |
| noonedeadpunk | It would be quite simple to change that anytime to be frank | 18:11 |
| noonedeadpunk | but not from string-or-list to just string.... | 18:11 |
| jrosser | grrr https://github.com/esl/packages/issues/15 | 18:21 |
| mgariepy | still better than some other project .. | 18:31 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Prepare haproxy role for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/875779 | 18:31 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible master: Test on ARM64 https://review.opendev.org/c/openstack/openstack-ansible/+/872423 | 18:31 |
| noonedeadpunk | huh, old good erlang repo... | 18:32 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Prepare service roles for separated haproxy config https://review.opendev.org/c/openstack/openstack-ansible/+/871189 | 18:33 |
| noonedeadpunk | I've decided to push changes to reflect progress on handlers - will try to check dynamic groups tomorrow | 18:34 |
| noonedeadpunk | hopefully they will pass lol | 18:35 |
| noonedeadpunk | I'm still not fully understand https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/875779/1/tasks/haproxy_service_config_temporary.yml but since it's marked as temporary and if we can drop this right after all changes land - I'm good to leave it as is | 18:37 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-haproxy_server master: Serialise initial issuing of LetsEncrypt certificates https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/875781 | 18:46 |
| jrosser | noonedeadpunk: here is a placeholder patch for race condition with LE - i realise that i've never seen this becasue we have 2 haproxy nodes and the OSA playbook has serial: 50% so it is sequential by good luck for me | 18:47 |
| jrosser | not quite sure what happens with 3 haproxy in a more standard setup...... | 18:48 |
| noonedeadpunk | aha I can recall you discussing that | 18:54 |
| noonedeadpunk | Hm | 18:56 |
| noonedeadpunk | Seems like erlang 24 has fully dissapeared from cloudsmith | 18:56 |
| noonedeadpunk | at least for centos. | 18:59 |
| noonedeadpunk | dogh | 18:59 |
| noonedeadpunk | 23 is still present.... | 19:17 |
| noonedeadpunk | packagecloud does have 24.... | 19:18 |
| noonedeadpunk | pffff | 19:18 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-rabbitmq_server stable/xena: Install erlang from packagecloud for RHEL https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/875782 | 19:25 |
| noonedeadpunk | I'm quite open to ideas. Like building these from sources | 19:28 |
| noonedeadpunk | Or having apt/rpm proxy on repo hosts | 19:28 |
| jrosser | as we version it specifically we could grab the file and install it just with apt directly | 19:39 |
| jrosser | there used to be a thing to do that in the rabbitmq role i think | 19:39 |
| spatel | jamesdenton_ around | 19:49 |
| spatel | I have stupid question about LACP | 19:49 |
| spatel | Do you configure LACP active on one side and passive on other side? or both active - active mode | 19:50 |
| jamesdenton_ | either or | 19:51 |
| jamesdenton_ | i guess it depends on which side you want to initiate the bundle, or either side | 19:52 |
| spatel | I am running both side active when i connect to switches.. | 19:52 |
| jamesdenton_ | that's prob fine | 19:52 |
| spatel | Hmm just thinking about advantage of doing passive | 19:53 |
| spatel | why passive mode invented :) | 19:53 |
| jamesdenton_ | prob a good question for google | 19:53 |
| jamesdenton_ | https://techdocassets.pluribusnetworks.com/netvisor/nv1_700/CG/UnderstandingtheLinkAggregationC.html | 19:54 |
| jamesdenton_ | In active mode LACP always (unconditionally) sends frames along the configured links that are intended to be bundled together. In passive mode, instead, LACP does not initiate a conversation/negotiation until it hears from the peer (this is typically the default configuration). Hence, for the negotiation to start at least one of the peers needs to be switched to active mode by the network administrator. | 19:54 |
| spatel | +1 | 19:57 |
| spatel | i was trying to find usage case where passive is very important :) | 19:57 |
| spatel | Good read - https://www.reddit.com/r/networking/comments/39x8qw/do_you_have_a_use_case_for_lacp_in_passive_mode/ | 19:58 |
| spatel | We have Cisco switch and other end HP switch so thought i can make HP passive if its best practice to fix hardware | 19:58 |
| noonedeadpunk | jrosser: was it for rabbit though? I'm looking at rocky and it was packagecloud | 20:14 |
| noonedeadpunk | I can recall smth like that but think it was galera or smth.... | 20:15 |
| jrosser | hmm yes I’m sure there was a “file” | 20:15 |
| noonedeadpunk | or smth that has not that many dependant packages... | 20:15 |
| jrosser | method for one of these | 20:15 |
| jrosser | but taken out long ago I think | 20:15 |
| noonedeadpunk | ah, yes, it was rabbit you're right | 20:16 |
| noonedeadpunk | https://opendev.org/openstack/openstack-ansible-rabbitmq_server/src/tag/queens-eol/vars/debian.yml | 20:16 |
| noonedeadpunk | so it was only rabbit but not erlang.... | 20:16 |
| noonedeadpunk | and we were still downloading from packagecloud.... | 20:16 |
| noonedeadpunk | Packagecloud don't have erlang for deb, cloudsmith rotate things, and packages.erlang-solutions.com jsut almost always broken | 20:18 |
| noonedeadpunk | for rpm we can indeed get things from github even - they publish .rpms there in releases | 20:19 |
| noonedeadpunk | but not deb... | 20:19 |
| noonedeadpunk | /o\ | 20:19 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-rabbitmq_server master: Support erlang installation for arm64 hosts https://review.opendev.org/c/openstack/openstack-ansible-rabbitmq_server/+/875629 | 20:41 |
| Mohaa | Cool: https://openapm.io/landscape | 21:28 |
| spatel | noonedeadpunk did we eve thought about to implement OpenSearch with OSA? https://opensearch.org/ | 21:43 |
| spatel | or not really osa but have playbook in ops-tool | 21:44 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!