Thursday, 2024-09-26

stankevko Yes that is the patch indeed. https://youtu.be/lR5Odyr1efQ03:47
stankevko wait you can do consul for masakari instead of pacemaker?03:49
kevkohaha, interisting that oslo stuff with consul :D 07:36
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Switch mariadb's loadbalancer from HAProxy to ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/91372407:37
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add backend TLS between MariaDB and ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/90991207:37
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Switch mariadb's loadbalancer from HAProxy to ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/91372407:49
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add backend TLS between MariaDB and ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/90991207:49
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add frontend TLS ability to ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/92550007:49
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add frontend database TLS for Keystone  https://review.opendev.org/c/openstack/kolla-ansible/+/92550707:51
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add frontend TLS ability to ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/92550007:56
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add frontend database TLS for Keystone  https://review.opendev.org/c/openstack/kolla-ansible/+/92550707:56
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible stable/2024.1: [2024.1-only] fluentd: don't check labels in check_mode  https://review.opendev.org/c/openstack/kolla-ansible/+/93049608:01
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Create cluster in Magnum jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/90449308:06
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Create cluster in Magnum jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/90449308:41
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Drop support for py38, py39  https://review.opendev.org/c/openstack/kolla-ansible/+/92940808:51
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Add ansible-core as a dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/92236908:51
kevkomnasiadka: is there a reason why we are not running apache as a user not root ? 08:53
kevkomorning btw 08:53
opendevreviewMichal Nasiadka proposed openstack/kolla master: CI: bump aarch64 job timeouts  https://review.opendev.org/c/openstack/kolla/+/93054109:00
mnasiadkakevko: I remember something regarding wsgi09:01
kevkomnasiadka: because i am very curious about that ...work on some controversial patch :) ..so i am looking into deeply 09:01
kevkoi think permissions ...09:01
opendevreviewJakub Darmach proposed openstack/kayobe master: CI: bump previous release to 2024.1 in Dalmatian  https://review.opendev.org/c/openstack/kayobe/+/93027709:01
kevkonevermind, would it be welcome ? 09:03
mnasiadkaI think the big question we need to ask, is if we want to use mod_wsgi09:06
SvenKieskekevko: only thing apache needs root for is open port 80/443 (not technically correct, you need just CAP_NET_BIND_SERVICE ) 09:06
kevkomnasiadka: yeah, that's another question ... because of that wsgi script pbr (or what is it ... ) will not be generated anymore , right ? 09:07
kevkobut i think apache + wsgi working very nice, isn't it ? 09:07
SvenKieskeok that seems to need root permissions if you want to change the user (for the user change of course): https://modwsgi.readthedocs.io/en/develop/configuration-directives/WSGIDaemonProcess.html09:08
SvenKieskebut that's technically not apache needing it but wsgi09:08
mnasiadkakevko: but we don't really need Apache, we could think of using something like gunicorn (because uwsgi is basically dead)09:09
mnasiadkaApache/nginx could be used for Keystone because of OIDC/SAML209:09
SvenKieskeif you look at gunicorn docs it still states:  Gunicorn is a WSGI HTTP server. It is best to use Gunicorn behind an HTTP proxy server. We strongly advise you to use nginx. 09:10
SvenKieskeso not really a solution to replace nginx in front, if even the devs don't trust it ;)09:11
SvenKieskeor outdated web page, IDK.09:11
SvenKieskebut it doesn't inspire confidence, either way :)09:11
kevkoIn my opinion, it's quite cobbled together in the Kolla repository regarding Apache 09:14
kevkoso i am playing with it little bit 09:14
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: octavia: Use valid_interfaces instead of endpoint_type  https://review.opendev.org/c/openstack/kolla-ansible/+/91235909:18
kevkoSvenKieske: regarding apache ..don't you need also log directory to be writeable ? 09:25
SvenKieskewell yes, but you just set appropriate permissions on those or directly forward to a decent logshipper, e.g. via piped logs: https://httpd.apache.org/docs/current/logs.html#piped09:28
SvenKieskethat's quite nice if you need e.g. to split access logs for different users with different permissions and different access log folders. but don't do it in bash, it's a performance and ordering nightmare09:30
Fl1ntHi everyone!09:48
Fl1ntquick question, let say on a configuration template I want to retrieve the host management IP what is the variable name we use on kolla-ansible?09:49
kevkoHi 09:49
kevkoapi_interface_address 09:49
Fl1ntI want to do something like: hostvars[host]['mgmt_address']09:49
kevkoyep09:50
Fl1ntkevko, is api_interface the internal api interface and not the mgmt_net?09:50
Fl1ntOr maybe management network was deprecated long time ago?09:51
kevkomaybe 09:51
kevkoapi_interface_address is that address on internal network to which is for example send haproxy the traffic 09:52
Fl1ntyes, the problem is I want to safely fallback on the host internal management interface, not really the interface where APIs services bind.09:52
opendevreviewJakub Darmach proposed openstack/kayobe master: Add support for Ubuntu Noble Numbat (24.04) LTS  https://review.opendev.org/c/openstack/kayobe/+/93002609:59
opendevreviewMichal Nasiadka proposed openstack/kayobe master: kolla-build: Add support for cross-arch builds  https://review.opendev.org/c/openstack/kayobe/+/93020410:05
kevkoSvenKieske: mnasiadka: What are u saying for oslo spec from bobcat ? http driver for rpc clients 10:10
kevkohttps://opendev.org/openstack/oslo-specs/commit/b440f3dccd2edf6e55a5384b0364be69a291a8a2  << Consul :-O 10:10
kevko:D 10:10
mnasiadkaI'm not going into the game of packaging Consul in Kolla :)10:11
kevkohaha :D 10:11
kevkono - i am really curious ...10:11
kevkoi already implemented downstream :) 10:11
kevkoand working nice 10:11
opendevreviewMichal Nasiadka proposed openstack/kayobe master: kolla-build: Add support for cross-arch builds  https://review.opendev.org/c/openstack/kayobe/+/93020410:13
kevkoFl1nt so network_interface ? > https://docs.openstack.org/kolla-ansible/latest/admin/production-architecture-guide.html#address-family-configuration-ipv4-ipv610:16
kevkoFl1nt: api_interface is default  = network_interface ...but i think you can specify it separately 10:16
Fl1ntkevko, we use multiple vlans, so our network_interface default to the nic that handle address less neutron provider nic, api_interface use 10.2.0.0/24 where management use 10.1.0.0/24 but I'll use api_interface for the patch tho and discuss that point with you all on the review directly.10:18
Fl1ntif anyone have a better suggestion I'll be glad to implement it on the patch10:19
kevkoFl1nt: i am not sure if understand 10:46
Fl1ntDon't worry, I'll push the patch and we can then discuss further on the review itself as it comes with docs/reno etc, that would be easier to understand ^^10:48
kevkookay 10:50
kevkoI'm discovering chaos in permissions, in kolla the combination of set_configs, set gid for kolla logs, and the fact that every project uses it differently is terrifying me11:16
opendevreviewMichal Nasiadka proposed openstack/kolla master: dev-mode: Run kolla_install_projects using sudo  https://review.opendev.org/c/openstack/kolla/+/93055911:40
mnasiadkakevko: we broke dev-mode ^^ ;-)11:41
opendevreviewRafal Lewandowski proposed openstack/kolla-ansible master: [WIP] Enable ML2/OVN and distributed FIP by default.  https://review.opendev.org/c/openstack/kolla-ansible/+/90495911:45
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add ansible-core as a dependency  https://review.opendev.org/c/openstack/kolla-ansible/+/92236911:48
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: CI: Create cluster in Magnum jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/90449311:53
Fl1ntJust to be noticed, I'll rename the current prometheus_bmc_exporter patchset/effort to prometheus_ipmi_exporter in order to be more readable and allow for prometheus_redfish_exporter introduction letting user choose which interface they want to use.11:54
SvenKieskemnasiadka: doesn't this need a backport, or did we only break master? so add reno/bug pls if it's not only affecting master.11:54
mnasiadkaonly master11:54
SvenKieskeah, that's good11:55
opendevreviewMichal Nasiadka proposed openstack/kayobe master: Revert "[release] Use OpenStack 2024.1 release"  https://review.opendev.org/c/openstack/kayobe/+/93056612:21
opendevreviewMichal Nasiadka proposed openstack/kayobe master: Revert "[release] Use OpenStack 2024.1 release"  https://review.opendev.org/c/openstack/kayobe/+/93056612:24
opendevreviewJakub Darmach proposed openstack/kayobe master: CI: bump previous release to 2024.1 in Dalmatian  https://review.opendev.org/c/openstack/kayobe/+/93027712:32
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057112:35
opendevreviewMerged openstack/kolla-ansible master: Drop support for py38, py39  https://review.opendev.org/c/openstack/kolla-ansible/+/92940812:50
kevkomnasiadka: I will check ... I don't think it will be something hard to fix... 12:53
kevkomnasiadka: will be near PC in minutes 12:53
mnasiadkakevko: https://review.opendev.org/c/openstack/kolla/+/930559 - fix here12:54
kevkomnasiadka: I would say that it's a bug that has been there, but just showed up now.12:59
mnasiadkakevko: not really, we merged patches that completely reworked dev-mode12:59
mnasiadkahttps://review.opendev.org/c/openstack/kolla/+/925712 - this one13:00
kevkoah , ok 13:01
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057113:13
opendevreviewGaël THEROND proposed openstack/kolla-ansible master: Add new hardware prometheus exporter:  https://review.opendev.org/c/openstack/kolla-ansible/+/93057913:15
Fl1ntraaaaah fuuu... it created a new review...13:18
opendevreviewJakub Darmach proposed openstack/kayobe master: Add support for Ubuntu Noble Numbat (24.04) LTS  https://review.opendev.org/c/openstack/kayobe/+/93002613:19
opendevreviewJakub Darmach proposed openstack/kayobe master: Bump previous release to 2024.1 in Dalmatian  https://review.opendev.org/c/openstack/kayobe/+/93027713:22
opendevreviewJakub Darmach proposed openstack/kayobe master: Bump previous release to 2024.1 in Dalmatian  https://review.opendev.org/c/openstack/kayobe/+/93027713:23
opendevreviewGaël THEROND proposed openstack/kolla-ansible master: Add new hardware prometheus exporter:  https://review.opendev.org/c/openstack/kolla-ansible/+/92221113:42
Fl1ntkevko, if you ever feel motivated to give a review to this patch :D Your remarks will be welcomed.13:44
kevkoFl1nt: this one ? ^ 13:49
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057113:49
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057113:50
Fl1ntkevko, yep, this one :D https://review.opendev.org/c/openstack/kolla-ansible/+/92221113:50
Fl1ntbut feel free to ignore it if you ever have anything more urgent, I've it working on prod so it's basically just a contribution back to upstream :D13:51
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057113:51
kevkoFl1nt: you can chech mine https://review.opendev.org/c/openstack/kolla/+/915440 < :) 13:53
kevkoFl1nt: and this https://review.opendev.org/c/openstack/kolla/+/829295 13:53
kevkomnasiadka: btw, you mentioned yesterday that you will check my patches tomorrow (today) ...did you have a time ? 13:54
opendevreviewMichal Nasiadka proposed openstack/kolla master: DNM: Try building aarch64 on x86  https://review.opendev.org/c/openstack/kolla/+/93057113:55
opendevreviewJakub Darmach proposed openstack/kayobe master: Add support for Ubuntu Noble Numbat (24.04) LTS  https://review.opendev.org/c/openstack/kayobe/+/93002613:55
Fl1ntkevko, sure14:00
Fl1ntkevko, nice work on the config.json reconciliation functions.14:05
mnasiadkaSvenKieske: https://review.opendev.org/c/openstack/kolla-ansible/+/912420 - do you have time to have a look? I would prefer to have something instead of discussing about the ideal solutions.14:06
kevkoFl1nt: yeah, working ... 14:06
Fl1ntkevko, regarding the monkey patching to, instead of using a specific patch block, why don't you just let the user leverage the footer block? That's indeed how we currently do it.14:08
Fl1ntI mean, keep the macro but located on footer.14:08
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Rewrite kolla-ansible CLI to python  https://review.opendev.org/c/openstack/kolla-ansible/+/92311014:15
kevkodetail14:16
Fl1ntaaaah nevermind, I've catchup on why ^^14:17
Fl1ntok, gotsha.14:17
Fl1ntjust for me to be sure kevko, do we agree that when you talk about patch, you talk about git diff patch right? Not just simple overrides right?14:18
Fl1ntseems so from the kolla_patch.sh script, but I do prefer to ask before making any comment :D14:20
kevkoFl1nt: yeah, the reason is that sometimes we find a really dangerous or breaks-everything bug ... for example oslo librarry ...instead of build your own pip package repo ...or complicated overrides ... or no need to modify upper constraints ..you just download a patch from gerrit ...fit to your file ....and build 14:22
kevkoFl1nt: you can't build your version - can conflict,  even if you will - you need to fix also requirements, ...like you need to do several things to fix something in image .... this is just about add a patchfile and run the build 14:23
Fl1ntgot it yep, that's pretty much how we currently do it on our side but with an external to kolla-ansible mecanism so glade someone worked on it on upstream cool14:28
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Reintroduce kolla-ansible check  https://review.opendev.org/c/openstack/kolla-ansible/+/59973514:29
Fl1ntkevko, which buddy are you on the patch? Can't Bartosz?14:31
SvenKieskemnasiadka: sorry, currently not really much time, on sunday maybe. but I'm not really blocking on that review, am I? :)14:31
Fl1nt-can't14:31
Fl1ntkevko, done14:34
kevkoFl1nt: /whois kevko :D 14:38
kevkoMichal Arbet14:39
Fl1ntYeah I saw the review owner too late :p14:46
Fl1ntdumb me is sleepy ^^ Too much patching for today :D14:46
kevkoI went to go sleep at 5 am ..and i woke up at 8 30 :D 14:47
Fl1ntkevko, ah ah ah did a bit of a similar schedule, went to sleep at 9pm then woke up a 3am didn't sleep up till 4:30 and wake up at 9am again ^^15:05
opendevreviewGrzegorz Koper proposed openstack/kolla-ansible master: Fixing hardcoded ceph.conf paths in libvirt templates  https://review.opendev.org/c/openstack/kolla-ansible/+/93060315:33
greatgatsbykevko: thanks for the oslo http driver link, very interesting.  Hope it gets some traction.16:07
opendevreviewVerification of a change to openstack/kayobe stable/2024.1 failed: Avoid shared IPA image cache on Ansible control host  https://review.opendev.org/c/openstack/kayobe/+/92963716:22
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Rewrite kolla-ansible CLI to python  https://review.opendev.org/c/openstack/kolla-ansible/+/92311017:27
opendevreviewMerged openstack/kayobe stable/2024.1: Avoid shared IPA image cache on Ansible control host  https://review.opendev.org/c/openstack/kayobe/+/92963723:19

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!