opendevreview | Michal Nasiadka proposed openstack/kolla stable/xena: fluentd: cap elasticsearch again https://review.opendev.org/c/openstack/kolla/+/882772 | 07:04 |
---|---|---|
opendevreview | Michal Nasiadka proposed openstack/kolla stable/xena: fluentd: cap elasticsearch again https://review.opendev.org/c/openstack/kolla/+/882772 | 07:06 |
opendevreview | Michal Nasiadka proposed openstack/kolla master: CI: Fix publish take 2 - add secret https://review.opendev.org/c/openstack/kolla/+/882805 | 07:22 |
opendevreview | Merged openstack/kolla master: CI: Fix publish take 2 - add secret https://review.opendev.org/c/openstack/kolla/+/882805 | 08:33 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Revert "Revert "ansible: bump min to 2.13 and max to 2.14"" https://review.opendev.org/c/openstack/kolla-ansible/+/881018 | 09:09 |
opendevreview | Merged openstack/kolla stable/xena: fluentd: cap elasticsearch again https://review.opendev.org/c/openstack/kolla/+/882772 | 10:39 |
opendevreview | Michal Nasiadka proposed openstack/kolla stable/wallaby: fluentd: cap elasticsearch again https://review.opendev.org/c/openstack/kolla/+/882776 | 10:42 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: Fix AttributeError: 'Runtime' object has no attribute 'exec' https://review.opendev.org/c/openstack/kayobe/+/882820 | 12:12 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: fix molecule job https://review.opendev.org/c/openstack/kayobe/+/882820 | 12:43 |
mnasiadka | mgoddard mnasiadka hrw bbezak frickler kevko SvenKieske - meeting in 10 | 12:50 |
SvenKieske | mnasiadka: meeting? :) | 13:02 |
mnasiadka | ah sorry | 13:02 |
mnasiadka | #startmeeting kolla | 13:02 |
opendevmeet | Meeting started Wed May 10 13:02:23 2023 UTC and is due to finish in 60 minutes. The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot. | 13:02 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 13:02 |
opendevmeet | The meeting name has been set to 'kolla' | 13:02 |
mnasiadka | #topic rollcall | 13:02 |
ramona-beermann[m] | o/ | 13:02 |
mnasiadka | o/ | 13:02 |
bbezak | o/ | 13:02 |
mmalchuk | \o | 13:03 |
SvenKieske | o/ | 13:03 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 13:03 |
SvenKieske | sorry, my laptop just crashed.. | 13:03 |
mnasiadka | #topic agenda | 13:04 |
mnasiadka | * CI status | 13:04 |
mnasiadka | * Release tasks | 13:04 |
mnasiadka | * Regular stable releases (first meeting in a month) | 13:04 |
mnasiadka | * Current cycle planning | 13:04 |
mnasiadka | * Additional agenda (from whiteboard) | 13:04 |
mnasiadka | * Open discussion | 13:04 |
mnasiadka | #topic CI Status | 13:04 |
mnasiadka | seems we're green now | 13:05 |
mnasiadka | after all those weird breakages | 13:05 |
mnasiadka | #topic Release tasks | 13:05 |
mnasiadka | Basically 1st of June is release deadline for cycle-trailing projects | 13:05 |
mmalchuk | Kayobe CI red | 13:05 |
mnasiadka | mmalchuk: so please update the whiteboard | 13:05 |
mmalchuk | fix: https://review.opendev.org/c/openstack/kayobe/+/882820 | 13:05 |
mmalchuk | lets merge it and it will be green | 13:06 |
mnasiadka | So we need to start cutting corners - for the 1st June deadline | 13:06 |
mnasiadka | I had a look in the Ansible bump issue | 13:06 |
mnasiadka | Found the commit in ansible-core that broke us, will start thinking how to overcome it | 13:07 |
mmalchuk | it not ansible, it molecule | 13:07 |
mnasiadka | #link https://github.com/ansible/ansible/issues/79776 | 13:07 |
mmalchuk | setup.cfg have ansible-compat >= 2.2.0 | 13:07 |
mnasiadka | mmalchuk: I'm not speaking about your patch | 13:07 |
mmalchuk | ok. sorry | 13:07 |
SvenKieske | this is the patch in question mnasiadka talks about afaik: https://review.opendev.org/c/openstack/kolla-ansible/+/881018 | 13:08 |
SvenKieske | mnasiadka: if I could speed up something/help somewhere, just ask :) | 13:09 |
mnasiadka | yup, updated it with a link to a bug that broke us ;-) | 13:09 |
SvenKieske | nice | 13:09 |
mnasiadka | There is one patch in Kolla that will need merging, but first Rocky needs to have centos-release-openstack-antelope - I raised a bug in Rocky bug tracker and it seems it's in progress | 13:10 |
SvenKieske | there's an upstream fix already merged it seems? https://github.com/ansible/ansible/pull/79804 | 13:10 |
mnasiadka | SvenKieske: it's the fix that broke us :) | 13:10 |
SvenKieske | ouch :D | 13:10 |
mnasiadka | testing now with force_handlers: true/false if that's an easy fix | 13:10 |
mnasiadka | but probably not | 13:10 |
SvenKieske | ok | 13:11 |
mmalchuk | mnasiadka whiteboard updated | 13:13 |
mnasiadka | Would be nice to get some reviews on https://review.opendev.org/c/openstack/kolla/+/882343 - it seems the version check is broken now ;-) | 13:13 |
mnasiadka | and we need it for https://review.opendev.org/c/openstack/kolla/+/825786/27 | 13:14 |
SvenKieske | I can review that. in general it would be nice if dependencies are tracked/mentioned somewhere in the commit message or the bugtracker | 13:15 |
mnasiadka | well, those patches are stacked one on another, you can see that in the gerrit ui | 13:16 |
mnasiadka | relation chain - top right | 13:16 |
mnasiadka | #topic Current cycle planning | 13:16 |
mnasiadka | I think we've done that in the release tasks (I mean the planning) | 13:16 |
mnasiadka | #topic Additional agenda (from whiteboard) | 13:17 |
SvenKieske | yeah, in this case it's there, but not always ;) related to that: WIPs are often initially not marked as WIP, but maybe I'm just to fast to review. | 13:17 |
mnasiadka | SvenKieske: well, some people mark WIP in commit message, some people mark it as a flag in Gerrit, some people do both, some people do none :) | 13:17 |
mnasiadka | (mattcrees): With this precheck now added, should we enable RabbitMQ HA queues by default in Antelope? Precheck: https://review.opendev.org/c/openstack/kolla-ansible/+/880274 | 13:18 |
mnasiadka | mattcrees: around? | 13:18 |
mattcrees | Yep | 13:18 |
mattcrees | Basically as the topic says, if people are happy that the precheck is enough then IMO we should enable RabbitMQ HA queues by default | 13:18 |
mnasiadka | I think it would be good to change the default, I already squashed 5+ bugs from people running non-HA on multinode with known problems | 13:19 |
SvenKieske | yeah, that would be nice, was there already a change open for that? | 13:19 |
mattcrees | There's also backports of the precheck ongoing | 13:19 |
mattcrees | SvenKieske: I don't think so, I'll propose one now | 13:20 |
mnasiadka | I just merged the backports | 13:20 |
SvenKieske | nice, will review, you can ping me about it | 13:20 |
mattcrees | Will do | 13:20 |
mnasiadka | #agreed to change the RMQ HA queues by default in Antelope | 13:21 |
SvenKieske | the backports already all have one +2 and are just missing workflow/verified, so I guess I can't do much there | 13:21 |
mnasiadka | There's a topic by ihalomi - but he's not around | 13:21 |
mnasiadka | so I'll leave it for next week | 13:21 |
mnasiadka | #topic Open discussion | 13:21 |
mnasiadka | Anyone, anything? | 13:21 |
SvenKieske | yeah regarding: https://review.opendev.org/c/openstack/kolla/+/825786 he asked for help but there are still unadressed comments, so. | 13:21 |
mmalchuk | Kayobe reviews | 13:22 |
mmalchuk | 1. https://review.opendev.org/c/openstack/kayobe/+/882820 | 13:22 |
mmalchuk | 2. https://review.opendev.org/c/openstack/kayobe/+/881679 | 13:22 |
mmalchuk | both CI | 13:22 |
mmalchuk | mgoddard ask to fix kayobe-seed-images-* jobs ^^^ it fixed | 13:23 |
mmalchuk | molecule broken recently | 13:23 |
mmalchuk | also fixed | 13:23 |
mnasiadka | I've sent that on a different communication channel to Kayobe cores inside StackHPC, let's see if that gets reviewed. | 13:24 |
mmalchuk | thanks | 13:24 |
mnasiadka | SvenKieske: I have a feeling we need to push it over so it gets merged | 13:24 |
SvenKieske | yeah, might be, the docs comments can be addressed by us, I think. the tests not passing is the bigger issue I guess. | 13:26 |
mnasiadka | I'll have a look, probably we need to mock the docker version in more places | 13:27 |
mnasiadka | or once for everything that is not pre3.0.0 | 13:27 |
SvenKieske | appreciated, as I'm still not very familiar with this part of the code. | 13:28 |
mnasiadka | I started triaging the bugs, kolla and kayobe look fine, kolla-ansible is another 180 bugs to triage | 13:28 |
mnasiadka | but I should get there before the summit, and we could start having weekly bug reports on the ML | 13:29 |
mnasiadka | or bugs managed in a proper way | 13:30 |
mnasiadka | Ok, anything else? or should we call it a day? | 13:30 |
SvenKieske | yeah, bug reports on the ML might be nice, I like that when neutron et al do this | 13:30 |
SvenKieske | I have the next meeting already scheduled, so.. | 13:30 |
mnasiadka | Ok then, thanks for coming - see you next week :) | 13:31 |
mnasiadka | #endmeeting | 13:31 |
opendevmeet | Meeting ended Wed May 10 13:31:07 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 13:31 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-10-13.02.html | 13:31 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-10-13.02.txt | 13:31 |
opendevmeet | Log: https://meetings.opendev.org/meetings/kolla/2023/kolla.2023-05-10-13.02.log.html | 13:31 |
mmalchuk | mnasiadka thanks | 13:31 |
SvenKieske | yeah, thanks! | 13:32 |
opendevreview | Matt Crees proposed openstack/kolla-ansible master: Enable RabbitMQ HA queues by default https://review.opendev.org/c/openstack/kolla-ansible/+/882825 | 13:33 |
opendevreview | Matt Crees proposed openstack/kolla-ansible master: Enable RabbitMQ HA queues by default https://review.opendev.org/c/openstack/kolla-ansible/+/882825 | 13:48 |
opendevreview | Merged openstack/kayobe master: CI: fix molecule job https://review.opendev.org/c/openstack/kayobe/+/882820 | 13:50 |
opendevreview | Matt Crees proposed openstack/kolla-ansible master: Enable RabbitMQ HA queues by default https://review.opendev.org/c/openstack/kolla-ansible/+/882825 | 13:50 |
opendevreview | Merged openstack/kolla stable/wallaby: fluentd: cap elasticsearch again https://review.opendev.org/c/openstack/kolla/+/882776 | 13:53 |
mattcrees | On the topic of RabbitMQ, there's also a backport chain still ongoing that would be nice to get merged: https://review.opendev.org/c/openstack/kolla-ansible/+/876830 | 14:01 |
SvenKieske | mattcrees: as already said, either mnasiadka or frickler (on vacation) need to +2 them and start gating, I don't hold such powers for now, sorry. I could ping my boss if it's really urgent. | 14:07 |
mattcrees | No worries, the urgent ones were for the precheck, which mnasiadka has set off to merge now. These others can wait for frickler to get back, they're only neccessary to faciliate disabling RMQ HA when it was previously enabled | 14:10 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: CI: Fix kayobe-seed-images-* jobs https://review.opendev.org/c/openstack/kayobe/+/881679 | 14:17 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 14:18 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 14:18 |
opendevreview | Merged openstack/kolla-ansible stable/yoga: Add precheck to fail if RabbitMQ HA needs configuring https://review.opendev.org/c/openstack/kolla-ansible/+/880841 | 14:55 |
opendevreview | Merged openstack/kolla-ansible stable/zed: Add precheck to fail if RabbitMQ HA needs configuring https://review.opendev.org/c/openstack/kolla-ansible/+/880840 | 14:55 |
opendevreview | Merged openstack/kolla-ansible stable/xena: Add precheck to fail if RabbitMQ HA needs configuring https://review.opendev.org/c/openstack/kolla-ansible/+/880842 | 15:00 |
opendevreview | Maksim Malchuk proposed openstack/kayobe master: Add custom user_data content configuration for Bifrost https://review.opendev.org/c/openstack/kayobe/+/879554 | 15:30 |
atmark | how often the kolla images in dockerhub are built? | 16:34 |
mnasiadka | in theory daily, unless a publish job fails | 16:47 |
mnasiadka | ah, dockerhub | 16:47 |
mnasiadka | not really, weekly | 16:47 |
mnasiadka | and we're rather going to drop the dockerhub repo | 16:48 |
mnasiadka | quay.io is daily | 16:48 |
opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Revert "Revert "ansible: bump min to 2.13 and max to 2.14"" https://review.opendev.org/c/openstack/kolla-ansible/+/881018 | 16:51 |
supamatt | mnasiadka: I'm hitting this bug, https://launchpad.net/bugs/1875223 | 18:20 |
supamatt | and I saw you had a change to fix this issue, https://review.opendev.org/c/openstack/kolla-ansible/+/868929 | 18:20 |
supamatt | Do I need to define the leader in the ovn-nb-db_leader inventory group? | 18:20 |
opendevreview | sean mooney proposed openstack/kolla-ansible master: always add service_user section to nova.conf https://review.opendev.org/c/openstack/kolla-ansible/+/882893 | 20:05 |
sean-k-mooney | hi folks o/ just in case you are not aware the embargo on https://bugs.launchpad.net/nova/+bug/2004555 lifted eairlier today. when the fix merges in nova it will break the ablity for kolla to deploy nova | 20:06 |
sean-k-mooney | as of the cve fix the [service_user] section will become requried for nova to work | 20:07 |
sean-k-mooney | it has been recommended but optional for years but now it will be a requriement | 20:07 |
sean-k-mooney | i put togheter a minimal patch above but i have not tested it | 20:07 |
sean-k-mooney | that shoudl be sufficent to deploy nova but it likely need a release note and it will need to be backported to all releases where the cve is resloved. it looks like the plan is to backport it to wallaby | 20:09 |
mmalchuk_ | embargo? lol | 20:09 |
*** mmalchuk_ is now known as mmalchuk | 20:09 | |
sean-k-mooney | can someone form the kolla team take over that patch. i might have time to update it but likely not | 20:09 |
sean-k-mooney | mmalchuk: ya the CVE was embargoed until eiarler today. i was not read in on it so just leaned of it when it was made public | 20:10 |
mmalchuk | sean-k-mooney I'm on #openstack-security jfyi | 20:11 |
sean-k-mooney | oh ok cool | 20:11 |
sean-k-mooney | so all the installer tools that dont already use the [service_user] will need to be updated | 20:12 |
mmalchuk | lets wait for CI and wait for rewivers | 20:12 |
sean-k-mooney | oh ya no rush the nova patch is not meged yet | 20:12 |
sean-k-mooney | there isnt an issue in kolla | 20:12 |
sean-k-mooney | it just kolla will need to be adapted to ensure the reslvent config section is preent for nova to work | 20:13 |
sean-k-mooney | i use kolla at home so just decied to get a minimal patch up before i finish for the day | 20:13 |
mmalchuk | pass -1 until it merged and CI passed | 20:14 |
sean-k-mooney | well the code change does not depend on the nova fix | 20:14 |
sean-k-mooney | the servie user has existed and is used for other things for many years | 20:14 |
sean-k-mooney | i was suprised that kolla was not already using it | 20:15 |
sean-k-mooney | but sure no rush | 20:15 |
mmalchuk | sure, but openstack itself does | 20:15 |
sean-k-mooney | anyway food arrieved so chat to ye later o/ | 20:15 |
mmalchuk | I'v added PTL in review | 20:15 |
mmalchuk | too | 20:15 |
mmalchuk | thanks a lot | 20:16 |
mmalchuk | folks, please review: https://review.opendev.org/c/openstack/kolla-ansible/+/881469 | 20:20 |
mmalchuk | this need to backported asasp | 20:21 |
mmalchuk | asap* | 20:21 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!