Wednesday, 2024-10-30

opendevreviewJay Jahns proposed openstack/kolla-ansible master: Ensure backend defaults are present in template  https://review.opendev.org/c/openstack/kolla-ansible/+/93369602:00
opendevreviewMerged openstack/kolla-ansible stable/2024.2: Update .gitreview for stable/2024.2  https://review.opendev.org/c/openstack/kolla-ansible/+/93358207:44
opendevreviewMerged openstack/kolla-ansible stable/2024.2: Update TOX_CONSTRAINTS_FILE for stable/2024.2  https://review.opendev.org/c/openstack/kolla-ansible/+/93358307:46
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix TLS settings when letsencrypt turned on  https://review.opendev.org/c/openstack/kolla-ansible/+/92597110:13
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Don't notify handlers during copy-cert  https://review.opendev.org/c/openstack/kolla-ansible/+/92465110:14
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Performance: Don't notify handlers during config  https://review.opendev.org/c/openstack/kolla-ansible/+/74516410:14
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Refactor services' check-containers and optimise  https://review.opendev.org/c/openstack/kolla-ansible/+/77324310:14
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix unintentional trigger of ansible handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/92414510:14
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test custom handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/93176110:14
opendevreviewPierre Riteau proposed openstack/kayobe master: CI: Skip test_ntp_clock_synchronized on Ubuntu 24.04  https://review.opendev.org/c/openstack/kayobe/+/93346310:19
fricklerkoalas: reminder that we've moved to meeting back 1h in order to keep the same slot in european timezones (so starting 3h from now, not 2h) https://review.opendev.org/c/opendev/irc-meetings/+/93355611:00
opendevreviewMatt Crees proposed openstack/kolla-ansible master: Fix cinder etcd3gw backend_url  https://review.opendev.org/c/openstack/kolla-ansible/+/93372611:02
fricklermnasiadka: bbezak: SvenKieske: I've updated the bug template at https://bugs.launchpad.net/kolla-ansible/+configure-bugtracker to drop the source/binary question which seems obsolete and added a reference to quay.io, please check whether that looks reasonable to you11:09
frickler(noticed that when looking at https://bugs.launchpad.net/kolla/+bug/2084983)11:10
opendevreviewVerification of a change to openstack/kayobe master failed: Replace use of kolla-ansible --key argument  https://review.opendev.org/c/openstack/kayobe/+/93359511:11
SvenKieskefrickler: that language regarding "official images or selfbuilt" can be read as us preferring users to use "official" images, where in reality we advise users to do the reverse: self building. maybe we can make that more clear, that the quay.io images are discouraged?11:11
SvenKieskethe rest LGTM I think, good to remove the "binary" option.11:13
kevkoanybody for second +2 and +w https://review.opendev.org/c/openstack/kolla/+/915440 ? SvenKieske already voted 11:38
luca_hello, not sure if this is the right place for this question, sorry in advance if it's not. I installed and trying to make ironic work with kolla-ansible, i managed to start the inspection of a machine but i get an authorization error Access was denied to the following resource: baremetal:port:create, there is already a bug opened https://bugs.launchpad.net/kolla-ansible/+bug/2064655.12:06
luca_I was wondering if you have any hints on how to fix it, i know ironic-inspector is deprecated and i should use the agent, but as far as i understand kolla is not really supporting it. I tried adding system_scope=all to the ironic-inpector.conf, but this resulted in another error (Failed to start inspection: The baremetal-introspection service for 10.48.10.254:us-hou-01 exists but does not have any supported versions.)12:07
luca_should i change the policy of ironic in order to have baremetal ports created by the inspector user or is there an easier way? Thanks12:07
kevkoluca_: feel free to provide your custom policy file 12:16
*** ChanServ changes topic to "IRC meetings on Wednesdays @ 14:00 UTC - https://docs.openstack.org/kolla/latest/contributor/meeting.html | Whiteboard: https://bit.ly/2MM7mWF | IRC channel is *LOGGED* @ http://goo.gl/3mzZ7b"12:36
fricklerone day I'll also get rid of those ugly shortener links12:37
fricklerSvenKieske: yes, I stumbled about that, too, but not sure how to best phrase it? maybe s/official/upstream/ for a start?12:39
kevkocommunity ? 12:45
fricklerkevko: that might also be an option, yes13:08
kevkonice, we merged python kolla-ansible and -i as inventory is not working ? :D 13:49
kevkoah, ok ..working ..but command needs to be first 13:49
kevkothen inventory 13:49
bbezakHi13:56
bbezakmeeting in 4 13:56
bbezakmnasiadka bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter jsuazo jovial osmanlicilegi mattcrees dougszu darmach13:56
fricklerkevko: yes, that's due to how cliff works, gets mentioned in the release notes, though13:59
bbezak#startmeeting kolla14:00
opendevmeetMeeting started Wed Oct 30 14:00:07 2024 UTC and is due to finish in 60 minutes.  The chair is bbezak. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'kolla'14:00
bbezak#topic rollcall14:00
SvenKieskeo/14:00
frickler\o14:00
Pcmalih_Having hard time booting node using ironic (redfish)14:00
mattcrees[m]o/14:00
kevko\o/14:00
mnasiadkao/14:01
luca_kevko: i did not yet tried a custom policy file, my issue is that with default ironic policy ironic-inspector service created by kolla is not able to create port, the policy in question is baremetal:port:create (role:admin and system_scope:all) or (role:service and system_scope:all) and i am not sure on how to fix it14:01
Pcmalih_Wondering if ironic really works with baremetal when deployed using kolla-Ansible? 14:01
mnasiadkaGuys, there's a meeting14:02
bbezakluca_, Pcmalih_ let's discuss that after the meeting14:02
mnasiadkaQuestions after the meeting14:02
luca_ok14:02
Pcmalih_Appreciate if anyone share their experience. 14:02
mnasiadka#topic agenda14:02
mnasiadka* CI status14:02
mnasiadka* Release tasks14:03
mnasiadka* Open discussion14:03
mnasiadka#topic CI status14:03
mnasiadkaSeems it's sort of green, Kayobe has some clock sync issues, but apart of that looks ok14:03
mnasiadka#topic Release tasks14:03
mnasiadkathe only task now is to get from rc1 to final for Dalmatian14:03
mnasiadkathere are some Kayobe related patches that we merged, and once Kayobe is all green - I'll post rc2 and then final14:04
mnasiadkaOnce we have final, we need to remember about the deploy guide patch14:04
mnasiadkaAnything I missed regarding making final release?14:04
kevkoWell, I don't even want to reach out anymore. :)14:05
mnasiadkareach out?14:05
kevkohttps://review.opendev.org/c/openstack/kolla/+/915440 < second +2 missing 14:06
mnasiadkaWell, this needs to wait for Epoxy14:06
kevkookay, no problem 14:06
mnasiadkaok then14:07
mnasiadkaNext week probably we can look at those unmerged patches by kevko and others - once we have final release14:08
mnasiadka#topic Open discussion14:08
mnasiadkaAnybody anything?14:08
chembervintHi. yes, I have one question ... just a second :)14:09
mattcrees[m]Could we priorities some reviews for this patch please? Upgrades to Caracal break on Octavia without it right now: https://review.opendev.org/c/openstack/kolla-ansible/+/93240814:09
mnasiadkakevko frickler bbezak can you have a look? ^^14:10
jovialI have a couple of topics after we've finished with this one14:11
fricklerack, on it14:11
chembervintwe are currently looking for a ability to control OOM score for kolla containers. we are ready to add it to kolla. couple of questions: 1) is there difference to put in into systemd units or into docker\podman-worker modeule 2) do we need only OOM-score or OOM-disable also? 3) do we need ability to adjust OOM-score for each container, or kolla-wide?14:11
kevkoyep14:12
mnasiadkachembervint: you're being extremely vague, but I assume you want to put OOMScoreAdjust=xxx in systemd unit?14:13
mnasiadkaI mean probably nobody currently has insight what is possible in docker/podman, and what is possible in systemd apart that variable14:14
mnasiadkaSo you'd need to tell us about pros and cons14:14
chembervintmnasiadka: either OOMScoreAdjust=xxx in systemd unit or oom_score_adj into kolla_dcocker.py (docker run option)14:14
mnasiadkadoes podman have the same option?14:15
chembervintyes, like a docker - the same14:15
mnasiadkaso which one is a better solution?14:15
SvenKieske:)14:17
kevkomnasiadka: hmm, shouldn't we move creation of database to some separate task and call in upgrade and also bootstrap ? 14:17
mnasiadkakevko: this is a one off, it's needed only in that stable branch14:17
fricklerkevko: this is a one off only in 2023.2 and 2024.1, so worth no extra effort IMO14:17
kevkomnasiadka: because if we merge that https://review.opendev.org/c/openstack/kolla-ansible/+/932408 ...we will have same tasks in two files ... in bootstrap.yaml and upgrade.yaml14:17
mnasiadkaI'm fine if anybody wants to go the extra mile on this, but I don't :)14:17
chembervintI'm not sure for the moment. I've wanted to discuss it with you :) but ok - I will research more on systemd vs docker - where we have to apply this. And what do you think - do we need ability to adjust it for each kolla container, or kolla-wide setting will be enough?14:17
mnasiadkachembervint: let's start with kolla-wide, no need to overcomplicate if there's no requirement14:18
fricklerchembervint: what's your use case for this in general? don't you have enough memory on your controllers?14:18
kevkomnasiadka: well, what I am trying to say ...we can call creation of DB and user everytime ...during the config phase ...or somewhere around ...as that ansible module works fine ...create if db not exist ..and just touch if already exist 14:18
chembervintok! thank you! will do my best and bring the patch soon 14:19
mnasiadkakevko: if you want to rework all roles in master - I'm fine with that, but then we won't backport this - this is a one off for upgrade from Antelope to Bobcat/Caracal, and it's perfectly fine it's not perfect14:20
kevkoi mean ..every time in context deploy, config, upgrade ... (in deploy phase before boostrap-service)14:20
kevkohmm, okay ..i am just trying to review every time :D 14:21
SvenKieskemhm14:21
mnasiadkaAdded +w14:22
mnasiadkajovial: your turn?14:22
jovialthanks. Firstly just an update from the PTG. I emailed openstack-dicusss about the recommended tooz driver: https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/JTYWG37I4OS7QSVIPY5DPMF5SFTVMY5I/14:23
mnasiadkaNo answers at all :)14:23
jovialIndeed14:23
SvenKieskewhy is this octavia thing only a single release thing though? I mean I believe you, but I don't understand the issue it seems :D14:23
jovialI didn't miss any important tags in the subject did I?14:24
SvenKieskere: tooz: it might be better to ping individual contributors to that codebase? :)14:24
mnasiadkawe introduced a new database in MariaDB just for Octavia, we didn't add creating it to upgrade, just to deploy14:24
kevkoSvenKieske: persistence_database (jobboard) was added in some release ... don't remember which 14:24
chembervintfrickler: we have a lot of memory on controllers. but, you know, different services could waste a huge amount of memory esecially if they experiencing the problems. bugs, memory leaks ... we've faced such problems even with a ethernet kernel module how eat all memory .. 14:24
mnasiadkajovial: no, I'll try to ask Oslo folks, maybe we'll get an answer14:25
mnasiadkajovial: anything else?14:25
SvenKieskejovial: well you could have added some context to your mail: without it, it just reads like some curiosity, not that you really need the information urgently :)14:25
jovialJust a request to get this patch merged for 2024.2: https://review.opendev.org/c/openstack/kolla-ansible/+/920294 (might be a long shot)14:25
SvenKieskebut also might be oslo people didn't read it, maybe tagging it with oslo might move more eyes14:25
mnasiadkawell, posted something on oslo channel, let's see14:26
jovialthanks mnasiadka - it would be good to get an answer :)14:26
fricklerthe oslo team is very small, similar to reqs team14:26
chembervintjovial: our experience is to use tooz + redis - redis is much more faster than a etcd. kolla os already ready for redis. it works really fine. and also we've tested tooz+consul - also works fine, if you already using the consul.14:27
kevko+1 14:27
mnasiadkajovial: I'm afraid it's rc1, I wouldn't like to make the release process more complicated - can we come back to it in 2025.1 (and if it's a bug - we could backport)14:27
mnasiadkaI think so many people use Redis, and I think Octavia jobboard (at least in kolla-ansible) requires redis, so we shouldn't really overcomplicate things14:28
jovialYeah, fair enough. I'm calling it a bug, but its a matter of interpretation there :laughs:14:28
kevkoif not all people :D 14:28
mnasiadkaOnce valkey is in Debian packages - we'll move to valkey in 2025.1 and that's it14:28
kevkoHmm, maybe I should create and build valkey for debian :) 14:29
mnasiadkaok, anything else? :)14:29
mnasiadkakevko: it's built for unstable, but seems it's not on the FTP - I have no clue why it takes so long14:29
kevkomnasiadka: it's in trixie already 14:30
mnasiadkaok, it wasn't there like two weeks ago14:30
kevkomnasiadka: yeah, it's debian policy to have some package in unstable for some time ..then it's automatically moved 14:30
mnasiadkaDo we need to think about moving to Trixie in 2025.1? When is it due for releasing?14:31
kevko2025 i think 14:32
mnasiadkaOk, then maybe we need to jump in 2025.1, we'll see14:32
kevkojune maybe :) 14:32
mnasiadkaor in 2025.214:32
mnasiadkaok then14:32
mnasiadkaI see no more topics14:32
mnasiadkaThanks for coming guys14:33
mnasiadkajovial: let's focus on kayobe rc1 and kolla-ansible rc214:33
mnasiadkaSee you next week14:33
mnasiadka#endmeeting14:33
fricklerbbezak needs to end it14:34
bbezak#endmeeting14:34
opendevmeetMeeting ended Wed Oct 30 14:34:12 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:34
opendevmeetMinutes:        https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-10-30-14.00.html14:34
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-10-30-14.00.txt14:34
opendevmeetLog:            https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-10-30-14.00.log.html14:34
SvenKieske:D14:34
SvenKieskethank you14:34
Pcmalih_Hi #mnasiadka14:34
Pcmalih_Can we talk about ironic issues for few minutes?14:35
SvenKieskeit seems no oO14:37
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix TLS settings when letsencrypt turned on  https://review.opendev.org/c/openstack/kolla-ansible/+/92597115:35
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Don't notify handlers during copy-cert  https://review.opendev.org/c/openstack/kolla-ansible/+/92465115:35
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Performance: Don't notify handlers during config  https://review.opendev.org/c/openstack/kolla-ansible/+/74516415:35
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Refactor services' check-containers and optimise  https://review.opendev.org/c/openstack/kolla-ansible/+/77324315:35
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix unintentional trigger of ansible handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/92414515:35
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test custom handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/93176115:35
kevkoSvenKieske, mnasiadka: i forgot ..this should be merged before dalmatian I would say https://review.opendev.org/c/openstack/kolla-ansible/+/92597115:38
mnasiadkathat's a bug, can be backported :)15:39
opendevreviewMerged openstack/kolla-ansible stable/2024.1: Fix Octavia service upgrade failure from 2023.1  https://review.opendev.org/c/openstack/kolla-ansible/+/93240815:39
kevkomnasiadka: okay, nevermind ...15:42
opendevreviewVerification of a change to openstack/kayobe master failed: Replace use of kolla-ansible --key argument  https://review.opendev.org/c/openstack/kayobe/+/93359515:57
opendevreviewMatt Crees proposed openstack/kolla-ansible stable/2023.2: Fix Octavia service upgrade failure from 2023.1  https://review.opendev.org/c/openstack/kolla-ansible/+/93375716:00
opendevreviewJake Hutchinson proposed openstack/kayobe master: Add loop control to custom DNF repos  https://review.opendev.org/c/openstack/kayobe/+/93376116:37
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible stable/2024.2: DNM: Run all jobs  https://review.opendev.org/c/openstack/kolla-ansible/+/93376216:41
opendevreviewWill Szumski proposed openstack/kayobe master: Aligns Kayobe Ansible version with Kolla Ansible  https://review.opendev.org/c/openstack/kayobe/+/92663916:46
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix TLS settings when letsencrypt turned on  https://review.opendev.org/c/openstack/kolla-ansible/+/92597116:47
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Don't notify handlers during copy-cert  https://review.opendev.org/c/openstack/kolla-ansible/+/92465116:47
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Performance: Don't notify handlers during config  https://review.opendev.org/c/openstack/kolla-ansible/+/74516416:47
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Refactor services' check-containers and optimise  https://review.opendev.org/c/openstack/kolla-ansible/+/77324316:47
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: Fix unintentional trigger of ansible handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/92414516:47
opendevreviewMichal Arbet proposed openstack/kolla-ansible master: [DNM] Just test custom handlers  https://review.opendev.org/c/openstack/kolla-ansible/+/93176116:47
opendevreviewWill Szumski proposed openstack/kayobe master: Support running without root privileges  https://review.opendev.org/c/openstack/kayobe/+/92343016:51
opendevreviewWill Szumski proposed openstack/kayobe master: Support running without root privileges  https://review.opendev.org/c/openstack/kayobe/+/92343016:52
*** amorin_ is now known as amorin17:35
opendevreviewMerged openstack/kolla-ansible master: Prevent accidental downgrades of RabbitMQ  https://review.opendev.org/c/openstack/kolla-ansible/+/92991217:59
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be offline momentarily at 20:30 utc (half an hour from now) to apply a configuration change20:02
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be offline momentarily to apply a configuration change20:31
opendevreviewVerification of a change to openstack/kayobe master failed: Replace use of kolla-ansible --key argument  https://review.opendev.org/c/openstack/kayobe/+/93359520:39
opendevreviewMerged openstack/kayobe master: Replace use of kolla-ansible --key argument  https://review.opendev.org/c/openstack/kayobe/+/93359523:56

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!