Tuesday, 2024-09-03

stanHow do you guys plan for DR? Openstack itself gives very little option to back my vm to another openstack cluster.01:40
mnasiadkathanks frickler 04:46
opendevreviewMerged openstack/kolla master: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92746105:51
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2024.1: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777306:02
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.1: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777406:02
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2023.2: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777506:03
SvenKieskemorning o/07:13
sylvrmorning ! :)07:14
SvenKieskeI hope all the people who can vote already voted on the technical committee election? :)07:38
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Don't notify handlers during copy-cert  https://review.opendev.org/c/openstack/kolla-ansible/+/92465107:41
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Rewrite kolla-ansible CLI to python  https://review.opendev.org/c/openstack/kolla-ansible/+/92311007:44
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Refactor dev mode  https://review.opendev.org/c/openstack/kolla-ansible/+/92571407:50
opendevreviewMerged openstack/kolla master: Fix symlinking of openstack-base source  https://review.opendev.org/c/openstack/kolla/+/92475908:22
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Reintroduce kolla-ansible check  https://review.opendev.org/c/openstack/kolla-ansible/+/59973508:30
kevkofrickler: what does 'jinxed it means' ? :D  What I did ? :D 08:35
kevkomorning08:37
opendevreviewBartosz Bezak proposed openstack/kolla master: Add ovn-bgp-agent / FRR / Horizon BGPVPN dashboard  https://review.opendev.org/c/openstack/kolla/+/89161708:55
fricklerkevko: you talked bad about the CI and it reacted promptly with a gate failure ;) 08:55
fricklersomething is jinxed when it is the target of a bad spell from a witch or wizard. or at least I think so, beware I'm not a native speaker either08:58
kevkofrickler: aaah :D ok 08:59
kevkofrickler: lastly i deployed default kolla setup with quorum queues and it works nice ...but whole stack will stop work after few hours ...because out of ram ..and OOM 09:00
sylvrHello ! I'd like to have my monitoring host to be the same as my control host. I modified etc/kayobe/kolla.yml with :09:05
sylvr```09:05
sylvrkolla_overcloud_inventory_top_level_group_map:09:05
sylvr  control:09:05
sylvr    groups:09:05
sylvr      - controllers09:05
sylvr      - monitoring09:05
sylvr```09:05
sylvrwhich according to the comment in the file and the doc should map the kayobe "control" group to the kolla-ansible controllers and monitoring hosts, but I don't find any open http ports(on the kolla_VIP) allowing access to grafana, did I get the mapping the wrong way ? Thanks :)09:05
sylvrkolla-ansible controllers and monitoring groups*09:11
SvenKieskethis is so on point (thus I advise to always "source $foo" instead of ". $foo" in bash scripts): https://morizbuesing.com/blog/greppability-code-metric/09:12
SvenKieskewould be nice to get this merged: https://review.opendev.org/c/openstack/kolla-ansible/+/91540309:34
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2024.1: Fix symlinking of openstack-base source  https://review.opendev.org/c/openstack/kolla/+/92779809:43
kevkoSvenKieske: btw, we lastly forgot to discuss https://review.opendev.org/c/openstack/kolla/+/926744 vs https://review.opendev.org/c/openstack/kolla-ansible/+/926632 << My opinion is to just make images simpler than add some special role to fetch additional information to just render into some templates ... symlinks are normal way how to handle such10:10
kevkostuff10:10
opendevreviewMerged openstack/kolla stable/2023.2: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777510:11
opendevreviewMerged openstack/kolla stable/2024.1: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777310:11
opendevreviewMerged openstack/kolla stable/2023.1: keystone: Fix requests-kerberos installation  https://review.opendev.org/c/openstack/kolla/+/92777410:13
kevkoIt seems to me that it's getting quieter around here :D 11:51
mnasiadkaIt’s just because I’m in Korea12:10
kevkooh ! vacation ? :) 12:41
kevkoHope that not in North Korea :D 12:41
SvenKieskeopeninfra asia12:45
fricklerhttps://2024.openinfraasia.org/12:45
opendevreviewMichal Nasiadka proposed openstack/kolla stable/2024.1: Fix symlinking of openstack-base source  https://review.opendev.org/c/openstack/kolla/+/92779812:59
kevkomeh, i would like to go also :/13:12
kevkoI need to ask my bosses :D 13:12
kevkofolks, it's now second day i am wondering about oslo_concurrency and lock_path ...i think we are not using it  in kolla in good way 13:13
kevkoin 99% of cases it is totally fine ..but i am wondering how it should be 13:14
kevkofrickler: lastly you gave me a bug into my head about oslo locking :/ 13:22
PrzemekKis this event free ?13:27
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Lock path to /dev/shm  https://review.opendev.org/c/openstack/kolla-ansible/+/92775213:50
SvenKieskePrzemekK: I don't think you need to pay if you are an openstack contributor in some way. but the travel costs can be quite high I guess. I don't know if there is the possibility to get foundation funding for that13:53
PrzemekKok i was thinking that is also online event. Maybe some will be published to https://www.youtube.com/@OpenInfraFoundation14:00
PrzemekKjust watching something about rabbit :D https://www.youtube.com/watch?v=M6mR8YpkRu814:01
kevkoSvenKieske: I think we payed for summit when I was in Berlin twice 14:03
SvenKieskekevko: for the actual tickets? so last openinfra day europe was pretty certainly free if had contributions (commits merged) in the last 6 or 12 months, but I never went to an in person summit, yeah those did cost money afaik in the past.14:04
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Lock path to /dev/shm  https://review.opendev.org/c/openstack/kolla-ansible/+/92775214:21
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Move to high level client in DockerWorker  https://review.opendev.org/c/openstack/kolla-ansible/+/90829514:49
kevkouuuuu, i found very strange stuff in kolla :D 15:36
kevkosome containers has host /dev/shm ..some doesnt't have ..even if ipc_mode is private there is a /dev:/dev mounted ...oh that's mess ...:'(15:37
kevkoi know that there is a reason somewhere and somewhere no ... but it's mess :( 15:49
opendevreviewIvan Vnučko proposed openstack/kolla-ansible master: Add backend to kolla_externally_managed_cert behaviour  https://review.opendev.org/c/openstack/kolla-ansible/+/92785316:16
SvenKieskekevko: well in general you don't want to expose arbitrary sub trees of /dev/ but I know some container need direct device access, afaik neutron for example. so I'm not sure it's a mess, but maybe badly documented? :)17:17
kevkoSvenKieske: yeah, i know ..but i am looking around stuff about queue_manager ...and if i turned off manager .. there is fanout queue with some ID ..but everytime old is removed .. when i turn on ... every restart create new queue ...and old is not deleted 17:27
kevkoit's look like a bug 17:27
SvenKieskeno? at least from what you describe this sounds exactly like the behaviour I would expect if queue manager is off? Maybe I misunderstood? If the manager is off, you get random uuid queue names which get recreated (with differen uuid) when removed.17:29
SvenKieskeif you use queue_manager you should get something like $hostname_%processname_$number or something like that17:30
SvenKieskebut I have only read docs and code so far, never actually tried it :D17:30
kevkoSvenKieske: yes ...17:33
kevkoSvenKieske: but what with the old queue ? 17:33
opendevreviewMerged openstack/kolla stable/2024.1: Fix symlinking of openstack-base source  https://review.opendev.org/c/openstack/kolla/+/92779817:35
SvenKieskekevko: ah I see, from which one did you migrate? quorum queues? ha? or plain old non ha queues?17:35
kevkoSvenKieske: https://ibb.co/CJzTZys 17:35
kevkoSvenKieske: no, I just turned on use_queue_manager = True 17:36
kevkoSvenKieske: on test 17:36
SvenKieskemhm, classic queues, good question! for the approach where I implemented quorum queues for fanout/transient I made sure to "migrate" everything in our tests/upgrade.sh wait a second..17:36
kevkoSvenKieske: I need to go from pc ...because my bageteria will close :D ..but i have a bouncer on irc ..i am very curious 17:37
SvenKieskehttps://review.opendev.org/c/openstack/kolla-ansible/+/927497/5/tests/upgrade.sh17:37
SvenKieskebasically I just reintroduced reconfigure rabbitmq and rabbitmq-reset-state, this leads to downtime of course17:38
SvenKieskebut at least upgrade CI is green with this :)17:38
SvenKieskeso maybe a bad solution but it works, should also work for stream I guess17:38
SvenKieskeI also need to run now! :D17:38
SvenKieskethis is c&p from our old solution when we migrated from classic/ha queues to quorum queues :)17:39
SvenKieskeHTH17:39
SvenKieskesee you tomorrow17:39
SvenKieskeo/17:39
kevkoSvenKieske: what I am trying to say that if you don't have manager turned on ..you restart cider volume for example and you see that queue disappeared and the new one is created with new id ... When I turn on manager ... I can see hostname-processname:number ...but if I restart ..old one persist and new one is created with new number ...did you get17:41
kevkoit ? 17:41
kevkoThis is not about kolla ...this is about the patches around queue manager and Oslo messaging and friends 17:42
kevkoSvenKieske: I am not saying it's not working ...CI is just about functionality ..not about stability 17:43

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!