Wednesday, 2024-09-04

mnasiadkaMorning00:55
opendevreviewMichal Nasiadka proposed openstack/kolla master: pyinotify is no longer needed  https://review.opendev.org/c/openstack/kolla/+/91787101:13
opendevreviewMichal Nasiadka proposed openstack/kolla master: pyinotify is no longer needed  https://review.opendev.org/c/openstack/kolla/+/91787101:13
opendevreviewMichal Nasiadka proposed openstack/kolla master: pyinotify is no longer needed  https://review.opendev.org/c/openstack/kolla/+/91787101:21
opendevreviewMichal Nasiadka proposed openstack/kolla master: pyinotify is no longer needed  https://review.opendev.org/c/openstack/kolla/+/91787101:21
samcat116Is there a specific reason that Neutron and glance and some other services have no way to configure caching with memcached?01:55
opendevreviewMerged openstack/kolla-ansible master: harden haproxy TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91540302:43
opendevreviewMerged openstack/kolla-ansible master: CI: validate prometheus configs  https://review.opendev.org/c/openstack/kolla-ansible/+/92620902:43
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package Closes-Bug: https://bugs.launchpad.net/kolla/+bug/2078886  https://review.opendev.org/c/openstack/kolla/+/92788603:43
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package Closes-Bug: #2078886  https://review.opendev.org/c/openstack/kolla/+/92788603:45
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package Closes-Bug: #2078886  https://review.opendev.org/c/openstack/kolla/+/92788704:07
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92788604:11
mnasiadkasamcat116: you're asking for Kolla-Ansible - or in general Neutron/Glance/etc do not have memcached support?04:23
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92788604:37
opendevreviewBui Doan Dang proposed openstack/kolla stable/2023.1: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789004:46
opendevreviewBui Doan Dang proposed openstack/kolla stable/2023.2: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789104:47
opendevreviewBui Doan Dang proposed openstack/kolla stable/2024.1: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789204:47
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549804:48
opendevreviewBui Doan Dang proposed openstack/kolla master: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92788604:51
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549804:54
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549804:55
opendevreviewBui Doan Dang proposed openstack/kolla stable/2024.1: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789204:57
opendevreviewBui Doan Dang proposed openstack/kolla stable/2023.2: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789104:58
opendevreviewBui Doan Dang proposed openstack/kolla stable/2023.1: Fix cinder-backup: add missing sysfsutils,lsscsi package  https://review.opendev.org/c/openstack/kolla/+/92789004:59
opendevreviewRoman Krček proposed openstack/kolla master: Refactor dev mode  https://review.opendev.org/c/openstack/kolla/+/92571206:22
opendevreviewRoman Krček proposed openstack/kolla master: Refactor dev mode  https://review.opendev.org/c/openstack/kolla/+/92571206:37
opendevreviewMagnus Lööf proposed openstack/kolla-ansible master: Enable TLS backend for designate  https://review.opendev.org/c/openstack/kolla-ansible/+/86652406:40
opendevreviewRoman Krček proposed openstack/kolla-ansible master: Reintroduce kolla-ansible check  https://review.opendev.org/c/openstack/kolla-ansible/+/59973506:56
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Implement TLS for Redis  https://review.opendev.org/c/openstack/kolla-ansible/+/90918808:04
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Implement TLS for Redis  https://review.opendev.org/c/openstack/kolla-ansible/+/90918808:05
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add caching options  https://review.opendev.org/c/openstack/kolla-ansible/+/92710408:21
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add Redis as caching backend for Keystone  https://review.opendev.org/c/openstack/kolla-ansible/+/90920108:26
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add caching options  https://review.opendev.org/c/openstack/kolla-ansible/+/92710408:40
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add Redis as caching backend for Nova  https://review.opendev.org/c/openstack/kolla-ansible/+/90920308:40
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add caching options  https://review.opendev.org/c/openstack/kolla-ansible/+/92710408:46
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add Redis as caching backend for Placement  https://review.opendev.org/c/openstack/kolla-ansible/+/90922208:46
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add caching options  https://review.opendev.org/c/openstack/kolla-ansible/+/92710408:53
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add Redis as caching backend for Heat  https://review.opendev.org/c/openstack/kolla-ansible/+/90922408:55
opendevreviewOlivier Delhomme proposed openstack/kolla-ansible master: Use all-in-one inventory by default  https://review.opendev.org/c/openstack/kolla-ansible/+/91399308:58
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add Redis as caching backend for Ceilometer  https://review.opendev.org/c/openstack/kolla-ansible/+/92672109:00
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add certificates for RabbitMQ internode TLS  https://review.opendev.org/c/openstack/kolla-ansible/+/92138009:01
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add support for RabbitMQ internode tls  https://review.opendev.org/c/openstack/kolla-ansible/+/92138109:02
PrzemekKCould someone add to https://docs.openstack.org/kolla-ansible/latest/reference/networking/neutron.html information how to configure OVN BGP and VPNaaS https://review.opendev.org/q/topic:%22frr-ovn-bgp-agent%22 https://review.opendev.org/c/openstack/kolla-ansible/+/92457509:04
SvenKieskePrzemekK: I would expect that docs on this are added in those Changes?09:34
SvenKieskeI'll make a comment, blocking on that, there should be some docs for such a new feature, thanks for bringing it to attention.09:35
PrzemekKyes i expect this because for example in bgp there is needed to manually create frr.conf and its specific to enviroment 09:40
opendevreviewSven Kieske proposed openstack/kolla-ansible stable/2024.1: CI: validate prometheus configs  https://review.opendev.org/c/openstack/kolla-ansible/+/92791209:50
opendevreviewSven Kieske proposed openstack/kolla-ansible stable/2023.2: CI: validate prometheus configs  https://review.opendev.org/c/openstack/kolla-ansible/+/92791309:51
opendevreviewSven Kieske proposed openstack/kolla-ansible stable/2023.1: CI: validate prometheus configs  https://review.opendev.org/c/openstack/kolla-ansible/+/92791409:51
bbezakPrzemekK: Docs would be added as soon as I'll come up with good solution, as I'm not fan of change owner approach where there is no default frr.conf10:01
opendevreviewOlivier Delhomme proposed openstack/kolla-ansible master: Use all-in-one inventory by default  https://review.opendev.org/c/openstack/kolla-ansible/+/91399310:30
opendevreviewPiotr Parczewski proposed openstack/kayobe master: Fix missing Ubuntu ACL package  https://review.opendev.org/c/openstack/kayobe/+/92792211:39
samcat116Kolla specifically11:42
opendevreviewPiotr Parczewski proposed openstack/kolla master: Add Let's Encrypt custom arguments support  https://review.opendev.org/c/openstack/kolla/+/91661711:48
bbezakmeeting in 4 ! mgoddard mnasiadka bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter jsuazo jovial osmanlicilegi mattcrees dougszu darmach12:56
bbezak#startmeeting kolla13:00
opendevmeetMeeting started Wed Sep  4 13:00:15 2024 UTC and is due to finish in 60 minutes.  The chair is bbezak. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
opendevmeetThe meeting name has been set to 'kolla'13:00
bbezak#topic rollcall13:00
mattcreeso/13:01
r-krceko/13:01
mmalchuk\o13:01
SvenKieskeo/13:01
mhinero/13:01
kevko\o/13:01
frickler\o13:01
bbezak#topic agenda13:02
bbezak* Roll-call13:02
bbezak* Agenda13:02
bbezak* Announcements13:02
bbezak* Review action items from the last meeting13:02
bbezak* CI status13:02
bbezak* Release tasks13:02
bbezak* Regular stable releases (first meeting in a month)13:02
bbezak* Current cycle planning13:02
bbezak* Additional agenda (from whiteboard)13:02
bbezak* Open discussion13:02
bbezak#topic CI status13:02
bbezakLooks green13:02
mmalchukYoga broken13:03
bbezakwhich is suspicious13:03
mmalchukhttps://review.opendev.org/c/openstack/kolla-ansible/+/92783613:03
bbezakright c813:03
mmalchukquick fix13:03
mmalchukhttps://review.opendev.org/q/Ib82833168efc2a6e2b4f1178258840d08deb78ef13:03
mmalchuklong fix13:03
bbezakyoga is somehow unmaintained :)13:03
kevkoYep13:03
mmalchukyep, but should be fixed if possible13:03
mmalchukfixes provided13:04
bbezakit will eventually13:04
bbezakthx <mmalchuk13:04
fricklerbut from unmaintained team, not from kolla team13:04
mmalchukbut it still CI in Kolla project)13:04
fricklerIMO not13:05
mmalchuklets drop unmaintained branches... and the problem is gone13:05
bbezakthose are a bit limbo state indeed13:05
SvenKieskeis there an unmaintained ci irc channel? not that I want to join that :D13:06
fricklerSvenKieske: yes #openstack-unmaintained13:06
mmalchukthanks13:06
SvenKieskeah nice to know, so we can redirect people there I guess? :)13:06
fricklerbut it's unmaintained and unoffical ;)13:06
SvenKieske:D13:06
bbezakit would be /dev/null I guess13:06
mmalchukthe same peoples there)13:06
mmalchukanyway please merge: https://review.opendev.org/c/openstack/kolla-ansible/+/92783613:07
mmalchukquick fix13:07
SvenKieskepersonally, I have no issue with unmaintained branches, I don't need to do anything there, sometimes I get some mail because of a backport, but I can quickly filter those out.13:07
bbezak#topic Release tasks13:07
mmalchukand I'll push folks from unmaintained irc channel13:08
bbezakwe're R-413:08
bbezaknothing major from the release tasks there13:08
bbezak#topic Regular stable releases (first meeting in a month)13:09
bbezakI'll handle releases after the meeting13:09
bbezak#topic Current cycle planning13:09
SvenKieskeI have a - maybe not that encouraging - update with regards to the mirror stuff13:10
kevkoCan we discuss https://review.opendev.org/c/openstack/kolla/+/926744 vs https://review.opendev.org/c/openstack/kolla-ansible/+/926632 ...same problem different solution 13:10
bbezakI've managed to touch a bit OVN BGP agent changes - will need to spawn proper test env for it now. As I've fixed it to be at least deployable13:10
bbezakbut it is not easily configurable at this stage13:10
bbezakbut I have ideas13:10
SvenKieskenice :) I followed some of those patches along13:11
bbezakkevko: let's wait for mr PTL to be back to discuss those two variants, as one of it is his mnasiadka13:12
SvenKieskethe tl;dr for moving rmq or possible other packages into openinfra based mirrors is: I asked over at #opendev and was basically told "it's a bad idea to build your own images, why don't you use upstream" (this is very oversimplified of course, no direct quote)13:12
kevkobbezak: okay, no problem ..but any opinions ? 13:13
SvenKieskeso they rather would see less mirrored "external" packages imho then adding more. I can understand some of the motivation, but I'm not sure I agree with everything.13:13
bbezaknot at this point kevko. didn't have time to look there. will do later on13:14
kevkoOkay 👍13:14
SvenKieskeI did look at both, but I really haven't got a very distinct opinion which I find better, need to think about that some more..13:14
SvenKieskeon their own they both look reasonable13:14
bbezakok, maybe post some of the details if you like to the etherpad SvenKieske13:15
SvenKieskebbezak: okay, will update that (hopefully today)13:16
SvenKieskethere's a related point on the additional agenda, but lets discuss this then I guess.13:16
SvenKieskeso later I mean13:16
mattcreesSvenKieske are you suggesting that's a dead end on the mirrors then? Or just that the opendev folks will need more convincing13:16
SvenKieskenot sure :D they seemed not really convinced, yes. but my request was not very concrete, maybe if I just propose rabbitmq mirrorring it's not so scary.13:17
SvenKieskeI would try one time more I guess and then give up.13:18
*** ravlew is now known as Guest248613:18
bbezakI think we could go now to13:18
bbezak#topic Additional agenda (from whiteboard)13:19
opendevreviewMerged openstack/kolla-ansible master: CI: also redirect stderr during cert generation  https://review.opendev.org/c/openstack/kolla-ansible/+/92753013:19
bbezakRabbitmq magic13:19
SvenKieskeyeah, I tried to write up and catch all the patchsets floating around, first off, to have awareness, because I accidently wrote a patchset when there already existed some.13:20
mattcreesI'm going to add some comments into the whiteboard, basically saying I would like everything to be configurable ;) 13:20
SvenKieskeplease do :)13:21
bbezakgood SvenKieske, thx. I like us to have good working defaults13:22
bbezakwith possible other options as mattcrees says13:22
bbezaklet's discuss that in etherpad as this will be longer discussion I think13:22
mattcreesFor sure, when I say "everything configurable" I don't mean it all stays disabled by default. Just want operators to have the option in case they hit issues CI doesn't catch13:22
SvenKieskeyeah sure13:23
SvenKieskeI also very munch like the queue_manager thing from kevko, but he was still testing that, does that work now kevko?13:23
kevkoNo 13:24
kevkoThere is a bug 13:24
SvenKieske:/13:24
kevkoIt works half13:24
mattcreesA bug with oslo.messaging, or the KA patches? 13:24
kevkoBecause of containerized environment there is a bad design how to check if the process is same or not 13:25
kevkoSo it's working ..but queues are not reused13:25
SvenKieskeyeah, oslo.messaging built it, that this information is shared via  /dev/shm afiak13:25
kevkoThat's not problem I would say 13:25
SvenKieskeso we would need to expose the same /dev/shm per host for all containers belonging to the same service13:25
SvenKieskeyes not really a problem, just annoying I guess :)13:26
kevkoWell I like that feature so I will play around this 13:26
SvenKieskeok I guess we have consensus to make this stuff configurable by the user with some sane defaults13:27
mattcreesCould be improved in a follow-up patch I suppose? If it still works, just inefficiently 13:27
SvenKieskeit might get buggy if the queue names differ, I'm not 100% sure.13:27
kevkoWell, now it's not in Kolla ...and I prefer to not give a user an option if it is not working ok13:28
kevkoQueue manager is false by default and Kolla not setting to yru for now ...let's leave it as it is now 13:28
kevko*true ..sorry mobile 13:29
bbezakin the meantime I merged your backports from whiteboard SvenKieske, and your quick fix in unmaintained/yoga mmalchuk13:29
mmalchukthanks13:29
SvenKieskethanks!13:29
bbezaklet's go swiftly to13:30
bbezak#topic Open discussion13:30
mhinerHello. I have noticed that podman part of kolla_container doesn't set KOLLA_SERVICE_NAME environment variable on container creation as docker part does.13:30
mhinerDo you think it deservers a fix?13:30
mmalchukplease review backports: https://review.opendev.org/q/Ib9afd84cac1fcbd96f98b4720ea9c6503bbdb12413:31
SvenKieskemhiner: sounds like a simple fix I guess :)13:31
SvenKieskemattcrees: did you happen to get to the root cause why our rabbitmq mirrors still work after https://www.rabbitmq.com/blog/2024/08/11/package-repository-updates ?13:31
mhineryeah, will take care of it soon13:32
bbezakwill check mmalchuk13:32
mmalchukthanks13:32
SvenKieskewill also look into those mmalchuk13:32
kevkomhiner: I think it should be fixed 13:32
mattcreesSvenKieske no, I haven't found time to look into that yet.13:32
mattcreesWe should probably move off them anyway13:33
chembervintHi, me again with my old patch ... https://review.opendev.org/c/openstack/kolla-ansible/+/920377 :) I really not sure that we have to add something to the documentation at the moment .. 13:33
SvenKieskeyeah, the blog says:  The previously used domain names won't go away, however, this migration would make your setup more future-proof for large infrastructure changes our team expects to happen in the rest of 2024.13:33
SvenKieskeso I guess they will go away sooner or later13:33
mattcreesAh ok, I'd read that as they were hanging around until Aug 18th. Guess they mean they'll still be available for longer 13:34
mattcreesI'll propose a patch moving to the new ones 13:35
bbezakI'll check your change chembervint. IIRC there was some queries of healtcheck failing to be added to the doc13:37
chembervintand also I want to discuss if do we need a feature - it seams we have need ability to custom systemd unit files for different kolla services. use-cases: 1. config different stuff such as OOM killer strategy and so on. 2. we have to configure dependencies between services - example - restart of ovs_db container should trigger also restart of neutron-openvswitch-agent to sync openflow rules. and actually we have a bunch of useca13:37
chembervintses, where such dependencies could increase realiability of the system. what do you think?13:37
bbezakright the mnasiadka comment13:38
bbezakCould you please raise a bug in launchpad with description of the feature request chembervint ?13:39
SvenKieskeyes, I personally think it would be good to be able to configure systemd unit dependencies properly - if not done already - to address these usecases13:40
chembervintyes, of course. Just wanted to ask your first opinion :)) 13:40
SvenKieskeand yes we should probably have a proper bug for that, very nice :)13:40
bbezakwe will review it there. as recently we are doing more of bug triaging13:41
chembervintok, we will do bug+commit this-next week13:41
bbezakthx13:42
bbezakanything more to discuss today?13:43
bbezakI guess not. thank you all!13:43
bbezak#endmeeting13:43
opendevmeetMeeting ended Wed Sep  4 13:43:51 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:43
opendevmeetMinutes:        https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-09-04-13.00.html13:43
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-09-04-13.00.txt13:43
opendevmeetLog:            https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-09-04-13.00.log.html13:43
mattcreesCheers all :) 13:44
mmalchukthanks bbezak 13:44
SvenKieskethanks all13:53
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Add initial support for systemd-networkd link configuration  https://review.opendev.org/c/openstack/kayobe/+/92162814:31
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Set KOLLA_SERVICE_NAME in Podman containers  https://review.opendev.org/c/openstack/kolla-ansible/+/92799715:07
opendevreviewMark Goddard proposed openstack/kolla-ansible stable/2024.1: Apply public firewalld rules immediately  https://review.opendev.org/c/openstack/kolla-ansible/+/92799815:10
opendevreviewMerged openstack/kolla-ansible stable/2024.1: hardening horizon: don't mount hosts /tmp  https://review.opendev.org/c/openstack/kolla-ansible/+/92746815:11
opendevreviewMerged openstack/kolla-ansible stable/2023.2: hardening horizon: don't mount hosts /tmp  https://review.opendev.org/c/openstack/kolla-ansible/+/92746915:11
opendevreviewMerged openstack/kolla-ansible stable/2023.1: hardening horizon: don't mount hosts /tmp  https://review.opendev.org/c/openstack/kolla-ansible/+/92747015:12
opendevreviewSven Kieske proposed openstack/kolla-ansible stable/2024.1: CI: also redirect stderr during cert generation  https://review.opendev.org/c/openstack/kolla-ansible/+/92801616:21
PrzemekKIs this correct ? api_workers = {{ neutron_api_workers }} neutron_api_workers: "{{ openstack_service_workers }}" openstack_service_workers: "{{ [ansible_facts.processor_vcpus, 5] | min }}"  For 8 vcpu I have error The number of nodes in the Hash Ring (6) is higher than the number of API workers (5) for host "xxx".17:21
PrzemekKSomething is not right and OVSDB events could be missed because of this. Please check the status of the Neutron processes, this can happen when the API workers are killed and restarted. Restarting the service should fix the issue, see LP #2024205 for more information.17:22
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Add initial support for systemd-networkd link configuration  https://review.opendev.org/c/openstack/kayobe/+/92162819:02
opendevreviewMaksim Malchuk proposed openstack/kayobe master: Add initial support for systemd-networkd link configuration  https://review.opendev.org/c/openstack/kayobe/+/92162819:04
opendevreviewVictor Chembaev proposed openstack/kolla-ansible master: Fix os-brick multipathd del map fails for SAN multipath devices  https://review.opendev.org/c/openstack/kolla-ansible/+/92807619:11
opendevreviewVictor Chembaev proposed openstack/kolla-ansible master: Fix os-brick multipathd del map fails for SAN multipath devices  https://review.opendev.org/c/openstack/kolla-ansible/+/92807719:12

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!