Wednesday, 2024-04-24

opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549800:00
mnasiadkamorning07:13
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Implement TLS for Redis  https://review.opendev.org/c/openstack/kolla-ansible/+/90918807:40
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549807:42
opendevreviewMerged openstack/kolla-ansible master: Allow overriding of Skyline logos  https://review.opendev.org/c/openstack/kolla-ansible/+/90948108:18
opendevreviewSven Kieske proposed openstack/kolla-ansible master: Add ovn-exporter  https://review.opendev.org/c/openstack/kolla-ansible/+/85549809:13
opendevreviewMerged openstack/kolla master: Replace meeting time by link to the meetings page  https://review.opendev.org/c/openstack/kolla/+/91668509:22
opendevreviewMichal Nasiadka proposed openstack/kolla master: swift-base: fix rsync missing for rpm installs  https://review.opendev.org/c/openstack/kolla/+/91648909:41
opendevreviewBartosz Bezak proposed openstack/kolla master: horizon/neutron: Add FWaaS plugin  https://review.opendev.org/c/openstack/kolla/+/91485509:45
opendevreviewMerged openstack/kolla master: Revert Deprecation of Masakari  https://review.opendev.org/c/openstack/kolla/+/91638609:53
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Add the neutron-fwaas  https://review.opendev.org/c/openstack/kolla-ansible/+/91485410:21
opendevreviewPierre Riteau proposed openstack/kolla-ansible master: Replace meeting time by link to the meetings page  https://review.opendev.org/c/openstack/kolla-ansible/+/91668611:15
opendevreviewMerged openstack/kolla master: Nova: fix swtpm and swtpm-tools missing from deb installs  https://review.opendev.org/c/openstack/kolla/+/91661511:24
opendevreviewGrzegorz Bialas proposed openstack/kolla master: Check if archive is tarfile  https://review.opendev.org/c/openstack/kolla/+/91419311:50
opendevreviewGrzegorz Bialas proposed openstack/kolla master: adding rpm/deb support  https://review.opendev.org/c/openstack/kolla/+/91452911:50
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: neutron: Rework vpnaas support  https://review.opendev.org/c/openstack/kolla-ansible/+/91689312:22
opendevreviewJakub Darmach proposed openstack/kolla master: Add exclude for permissions in kolla config.json file  https://review.opendev.org/c/openstack/kolla/+/65562012:31
mnasiadkafrickler: got a minute to have a look in https://review.opendev.org/c/openstack/kolla/+/916102 ?12:32
mnasiadkamgoddard mnasiadka bbezak frickler kevko SvenKieske mmalchuk gkoper jangutter jsuazo jovial osmanlicilegi mattcrees dougszu - meeting in 1012:52
opendevreviewMaksim Malchuk proposed openstack/kolla stable/2023.2: Nova: fix swtpm and swtpm-tools missing from deb installs  https://review.opendev.org/c/openstack/kolla/+/91676712:59
mnasiadka#startmeeting kolla13:00
opendevmeetMeeting started Wed Apr 24 13:00:00 2024 UTC and is due to finish in 60 minutes.  The chair is mnasiadka. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
opendevmeetThe meeting name has been set to 'kolla'13:00
mnasiadka#topic rollcall13:00
mnasiadkao/13:00
opendevreviewMaksim Malchuk proposed openstack/kolla stable/2023.1: Nova: fix swtpm and swtpm-tools missing from deb installs  https://review.opendev.org/c/openstack/kolla/+/91676813:00
mmalchuk\o13:00
SvenKieskeo/13:00
r-krceko/13:00
bbezako/13:00
mhinero/13:00
frickler\o13:00
mnasiadka#topic agenda13:03
mnasiadka* CI status13:03
mnasiadka* Release tasks13:03
mnasiadka* Regular stable releases (first meeting in a month)13:03
mnasiadka* Current cycle planning13:03
mnasiadka* Additional agenda (from whiteboard)13:03
mnasiadka* Open discussion13:03
mnasiadka#topic CI status13:03
mnasiadkaOctavia still bleeding red13:03
mnasiadkaSeems cascade delete is failing13:03
mnasiadkaon unplugging the VM port, or something similar13:03
mnasiadkaworking on getting to the bottom of it in https://review.opendev.org/c/openstack/kolla-ansible/+/91603713:04
mnasiadka#topic Release tasks13:04
mnasiadkaSoo... I'd like to close down the number of patches we want to have in Kolla Caracal13:05
mnasiadkahttps://review.opendev.org/q/project:openstack/kolla+status:open+NOT+label:Workflow%3C%3D-1+NOT+label:Code-Review%3C%3D-2+label:Review-Priority%3D113:05
mnasiadkaIf anybody thinks we should add something more - let me know13:05
SvenKieskeok, is there some kind of deadline for this?13:07
mnasiadkathe same comes with kolla-ansible - but I'd like to get Kolla released first13:07
mnasiadkadeadline? Let's say two weeks13:07
mnasiadka(because I'm off next week - 1st of May is public holiday in a lot of places)13:07
mnasiadkaSo I assume we should cancel the meeting next week13:08
SvenKieskesounds good13:08
fricklersame here, ack13:08
mnasiadkaok then, let's move on13:08
mnasiadka#topic Current cycle planning13:08
fricklerwhat about stsble?13:08
fricklerdo you want a final release for stable/zed before it moves to unmaintained?13:08
mnasiadkaWell, from one perspective it would make sense - but we as SHPC don't really need that13:09
mnasiadkaSo if somebody volunteers for last Zed release - I'm happy to +113:09
fricklerI don't need it either13:10
fricklerso fine without one, just note the deadline for that is next week, too13:10
SvenKieskekevko is not here13:10
SvenKieskeguess he could care ;)13:10
SvenKieskewell maybe not, afaik he has his downstream mirrors etc.13:11
mnasiadkaWell then - the absent don't get a vote I'd say - so let's just go with moving zed to unmaintained13:11
mnasiadkaI'll find the release patches after the meeting and +1 them13:12
mnasiadkaCurrent cycle for us is still Caracal - so I think we have enough of a plan.13:12
mmalchukI care13:12
mmalchukbut ok13:12
mnasiadkammalchuk: do you want to raise the release patch for Zed?13:12
mmalchukmnasiadka I care to postpone move to unmaintained13:13
mmalchukcan we?13:13
fricklerno, the deadline for that is set13:14
mnasiadkawe still maintain the unmaintained, however that sounds13:15
mmalchukok lets move13:15
mnasiadka#topic Additional agenda (from whiteboard)13:16
mnasiadka(SvenKieske): cores: please review the following:13:16
mnasiadka ovn-exporter https://review.opendev.org/c/openstack/kolla-ansible/+/855498 CI is now greenish found bugs, which I need to fix first13:16
mnasiadkaneutron service limit https://review.opendev.org/c/openstack/kolla-ansible/+/877776 one +2 left to go13:16
mnasiadkaadd new sysctl role: https://review.opendev.org/c/openstack/kolla-ansible/+/912351 one +2 left to go13:16
mnasiadkacell0 VIP change fix https://review.opendev.org/c/openstack/kolla-ansible/+/910924 one +2 left to go13:16
mnasiadkanote from me: feel free to remove stuff from this list if it's merged , thanks! I also think this is just a temporary list, should probably just use the review board instead.13:16
mnasiadkafrickler/bbezak: willing to have a look in the bottom three?13:17
SvenKieskeI already crossed out the ovn-exporter, found a myriad of bugs, likely will even need to fix those upstream first I guess.. :-/ thanks for the pointers all.13:18
bbezakwill do, neutron needs outside SHPC I recon13:18
SvenKieskeafaik frickler had some good comments on the neutron change which should be addressed13:19
mnasiadkaah13:19
frickleryes, was just checking whether there had been a response yet13:19
mnasiadkanow it's more visible with -1 :)13:20
mnasiadkaok, so the bottom two pretty please13:20
mnasiadkaand let's move forward13:20
fricklerand I'm not too sure about the two others, maybe someone else can care for those13:20
jovialSorry, missed the comments, will try and update the service limit patch next week13:20
mnasiadkaI think bbezak can have a look in those13:20
mnasiadka(r-krcek)13:20
mnasiadkaplease review https://review.opendev.org/c/openstack/kolla-ansible/+/91235113:20
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/91237813:20
mnasiadkahttps://review.opendev.org/c/openstack/kolla-ansible/+/91092413:20
mnasiadkafirst one is sysctl role once again13:20
mnasiadkasecond one is trove, looks ok, but I'm no trove expert13:21
mnasiadkaand the third one is cell0 once again13:22
fricklertrove is dead, can we deprecate and drop it?13:22
fricklerno PTL13:22
mnasiadkaah13:22
mnasiadkathen let's drop it13:22
mnasiadkaany volunteer?13:22
fricklerI'll add that to my list13:23
mnasiadkathanks13:23
mnasiadka#agreed to deprecate and drop Trove since the project has no PTL13:24
mnasiadka(mhiner): migration patch https://review.opendev.org/c/openstack/kolla-ansible/+/83694113:24
mnasiadkanova_conductor tries to contact openvswitch_db container 30 secs before it gets deployed13:24
mnasiadkathis creates error message in nova logs and nova_conductor is deemed unhealthy and fails my CI tests (kolla-ansible-rocky9-container-engine-migration)13:24
mnasiadkaany tips on how to remedy this, please?13:24
mnasiadkamhiner: my question is - how does that work in Docker land?13:24
mhineryou mean Podman to Docker migration?13:24
mnasiadkaNo, I mean when you use Docker - we don't have that problem13:25
fricklerdoes the ovs creation take too long or does the migration need a better ordering of actions?13:26
mnasiadkaAnd nova_conductor_healthcheck_test: ["CMD-SHELL", "healthcheck_port nova-conductor {{ om_rpc_port }}"] basically means healthchecks only check RMQ connectivity13:26
mnasiadkaunless it's an ERROR in the logs because of which CI is failing13:26
mhinerit is ERROR in the logs13:26
SvenKieskeit was on the PTG topics for nova to implement better healthchecks upstream :D13:27
mnasiadkait's rather unrelated to their PTG topic13:27
mhinerand it happens because nova_conductor tries to contact openvswitch_db 30secs before it gets created13:28
fricklerI also wonder why nova needs to talk to ovs at all, but that's another topic13:28
fricklerI'll take a look at the logs later13:28
mnasiadkawell, should we have openvswitch before nova in site.yml?13:29
mhinerwe can try that13:29
mhinerbut the strange thing is this does not happen in regular deployment13:29
mhineronly in migration "redeployment"13:30
mnasiadkabecause we have VMs running on the redeployment?13:30
fricklermaybe need to stop nova before migrating ovs?13:30
mnasiadkaAt what stage conductor needs to run OVS commands?13:30
mnasiadkaWell, if we're aiming for a rolling migration - that might be complicated13:31
mnasiadkamaybe we need to stop Nova before the migration13:31
mhinerby stopping Nova, do you mean all VMs? because otherwise all containers are stopped and removed before redeploying13:32
SvenKieskecould this be related to the neutron ovs integration bridge which nova can use? But I'm just guessing.13:33
fricklerI was wondering whether the error might be from the old container, but it is the new one which is unhealthy13:33
frickleralso just noticing that the patch needs a rebase, can you look into that, please?13:33
mnasiadkaI think it's still a bit weird, that if Nova requires OVS to run - we deploy Nova first, and then OVS13:33
mhinerI compared times of redeployment and the ERROR msg and it should be the new container13:34
mhinerfrickler: will do the rebase13:34
jovialI agree that it seems like we should configure ovs before nova13:35
SvenKieskedepends on the nova scenario I think. e.g. if you use sriov some scenarios do that with ovs afaik. but I don't think we do use that in CI, do we?13:35
SvenKieskebut yeah, in general it seems better to setup ovs before nova13:35
mnasiadkalet's try that, maybe we should basically analyse site.yml a bit and see if there's anything we could improve13:36
mnasiadkabut that's for D rather13:36
mnasiadkaok then, let's move on13:36
mnasiadka#topic Open discussion13:36
mnasiadkaAnybody anything?13:36
kevkohi, sorry, another meeting :'( 13:37
mmalchukreviews13:37
mmalchukmerge of backports13:38
mmalchukhttps://review.opendev.org/q/Ib6c725880caaa7f39bb269bd8398f3894eb033c513:38
mmalchukhttps://review.opendev.org/c/openstack/kolla-ansible/+/91515613:38
mmalchukhttps://review.opendev.org/c/openstack/kolla-ansible/+/90749513:38
mmalchukkayobe13:38
mmalchukhttps://review.opendev.org/c/openstack/kayobe/+/91613813:38
mmalchuka-c-k13:38
mmalchukhttps://review.opendev.org/c/openstack/ansible-collection-kolla/+/91614313:38
mmalchukthats all for now13:39
SvenKieskeah right, i also did some backports of the mariadb cluster recovery fix: https://review.opendev.org/#/q/Iea2661c9d5d262cf99edd5f5b567f252607a000313:39
jovialmmalchuk, I've marked 916138 as RP +113:39
SvenKieskethose should be trivial I guess :)13:39
mnasiadkaSo basically https://review.opendev.org/q/(project:openstack/kolla-ansible+OR+project:openstack/ansible-collection-kolla)+status:open+NOT+label:Workflow%3C%3D-1+NOT+label:Code-Review%3C%3D-2+branch:%5Estable/.*+status:open+NOT+label:Review-Priority%3D-113:39
SvenKieskeLGTM I guess13:40
SvenKieskeI need to compile for myself a fresh list of patches I have in flight, I tend to lose track of those (at least in my head :D)13:41
mnasiadkaok then, let's have a look at those backports mgoddard, bbezak, kevko and frickler 13:42
mnasiadkaAnd I guess that's it13:42
mnasiadkaThanks for coming - and the next meeting is in two weeks time!13:43
mnasiadka#endmeeting13:43
opendevmeetMeeting ended Wed Apr 24 13:43:27 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:43
opendevmeetMinutes:        https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-04-24-13.00.html13:43
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-04-24-13.00.txt13:43
opendevmeetLog:            https://meetings.opendev.org/meetings/kolla/2024/kolla.2024-04-24-13.00.log.html13:43
bbezakthx13:43
SvenKieskethanks, have a nice vacation (guess I'll work)13:43
mmalchukthanks mnasiadka 13:44
opendevreviewMerged openstack/kolla master: swift-base: fix rsync missing for rpm installs  https://review.opendev.org/c/openstack/kolla/+/91648913:47
opendevreviewMaksim Malchuk proposed openstack/kolla stable/zed: Nova: fix swtpm and swtpm-tools missing from deb installs  https://review.opendev.org/c/openstack/kolla/+/91676913:52
opendevreviewMaksim Malchuk proposed openstack/kolla stable/2023.2: swift-base: fix rsync missing for rpm installs  https://review.opendev.org/c/openstack/kolla/+/91677013:53
opendevreviewMaksim Malchuk proposed openstack/kolla stable/2023.1: swift-base: fix rsync missing for rpm installs  https://review.opendev.org/c/openstack/kolla/+/91677113:54
opendevreviewMaksim Malchuk proposed openstack/kolla stable/zed: swift-base: fix rsync missing for rpm installs  https://review.opendev.org/c/openstack/kolla/+/91677213:54
opendevreviewMichal Arbet proposed openstack/kolla-ansible stable/2023.2: Extend init-runonce.sh script - create addiditonal resources  https://review.opendev.org/c/openstack/kolla-ansible/+/91488113:57
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: WIP: Add action for getting container names list  https://review.opendev.org/c/openstack/kolla-ansible/+/90583713:59
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Add container engine migration scenario  https://review.opendev.org/c/openstack/kolla-ansible/+/83694113:59
opendevreviewMatúš Jenča proposed openstack/kolla-ansible master: Add backend TLS between MariaDB and ProxySQL  https://review.opendev.org/c/openstack/kolla-ansible/+/90991213:59
opendevreviewMichal Arbet proposed openstack/kolla-ansible stable/2023.1: Extend init-runonce.sh script - create addiditonal resources  https://review.opendev.org/c/openstack/kolla-ansible/+/91486014:02
kevkocan anybody say to /me what all versions of osbpo  openstack apt repositories should have python3-docker in newer version ? 14:03
opendevreviewMartin Hiner proposed openstack/kolla-ansible master: Add container engine migration scenario  https://review.opendev.org/c/openstack/kolla-ansible/+/83694114:08
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: WIP: rabbitmq: Add support for using stream queues for fanout  https://review.opendev.org/c/openstack/kolla-ansible/+/91691114:11
opendevreviewMerged openstack/kolla master: horizon/neutron: Add FWaaS plugin  https://review.opendev.org/c/openstack/kolla/+/91485514:15
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Freezer  https://review.opendev.org/c/openstack/kolla-ansible/+/91691414:17
SvenKieskekevko: I guess mhiner can tell you?14:20
opendevreviewMichal Arbet proposed openstack/kolla-ansible stable/2023.2: Extend init-runonce.sh script - create addiditonal resources  https://review.opendev.org/c/openstack/kolla-ansible/+/91488114:23
mhinerkevko: minimum version should be 6.0, otherwise it's up to you14:25
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Solum  https://review.opendev.org/c/openstack/kolla-ansible/+/91691514:39
opendevreviewMerged openstack/kolla master: kolla-toolbox: Use py311 on rpm distros  https://review.opendev.org/c/openstack/kolla/+/91610214:48
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Sahara  https://review.opendev.org/c/openstack/kolla-ansible/+/91691814:50
opendevreviewJakub Darmach proposed openstack/kolla master: Add exclude for permissions in kolla config.json file  https://review.opendev.org/c/openstack/kolla/+/65562014:57
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Senlin  https://review.opendev.org/c/openstack/kolla-ansible/+/91692215:06
opendevreviewMerged openstack/kolla-ansible master: Update cell0 database connection  https://review.opendev.org/c/openstack/kolla-ansible/+/91092415:24
opendevreviewMerged openstack/kolla-ansible master: Add sysctl role  https://review.opendev.org/c/openstack/kolla-ansible/+/91235115:24
opendevreviewMerged openstack/kolla-ansible stable/2023.2: Fix Skyline API Server TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91458815:24
opendevreviewMerged openstack/kolla-ansible stable/2023.1: Fix Skyline API Server TLS configuration  https://review.opendev.org/c/openstack/kolla-ansible/+/91458715:24
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Murano  https://review.opendev.org/c/openstack/kolla-ansible/+/91692815:42
opendevreviewMichal Nasiadka proposed openstack/kolla-ansible master: Drop Vitrage  https://review.opendev.org/c/openstack/kolla-ansible/+/91692915:49
opendevreviewMichal Nasiadka proposed openstack/kolla master: Drop Vitrage  https://review.opendev.org/c/openstack/kolla/+/91693015:55
mnasiadkaok, enough drops15:58
opendevreviewMerged openstack/kayobe master: Fix default place for Ubuntu Apt keyrings  https://review.opendev.org/c/openstack/kayobe/+/91613816:28
fricklerin german we say "der drops ist gelutscht", which means something like "all done" ;)16:28
mnasiadkahaha16:29
frickleralso I noticed that trove may not be completely done yet, there was a late PTL candidacy which may possibly still turn into an appointment. so I'll wait for a week or two with that16:29
mnasiadkafrickler: I think last Trove PTL was also a Kolla core - wuchunyang17:00
mnasiadkaso lets leave trove for now17:00
mnasiadkathe same goes for Watcher17:00
opendevreviewMerged openstack/kolla-ansible master: Fix 'cinder-backup' service when Swift with TLS enabled  https://review.opendev.org/c/openstack/kolla-ansible/+/90749517:14
kevkolol, I know what version of python3-docker ..that it's 6.*.*17:29
kevkoi've asked for bpo repo :D 17:30
kevkoas osbpo has repo for every openstack version 17:30
kevkoand some of them has bullseye and bookworm ...17:30
kevkoso i suppose that bookworm only ...17:30
kevkoall bookworm 17:30
g3ek_hello guys, anyone have successfully installed 2023.1, 2023.2 or master lately? I am always getting some error on my side. I can install ZED, but I would want the latest working version possible.17:38
mnasiadkag3ek_: what error?17:41
mnasiadkakevko: leave bullseye alone ;)17:42
g3ek_on cinder-olume `tooz.coordination.ToozConnectionError: invalid username-password pair` and nova-compute `2024-04-23 21:11:30.299 7 ERROR oslo_service.service libvirt.libvirtError: authentication failed: authentication failed`17:42
g3ek_I have generate my password using kolla-genpwd17:43
g3ek_mnasiadka: I forgot to tag you17:48
kevkomnasiadka: http://osbpo.debian.net/debian/dists/bookworm-caracal-backports-nochange/main/binary-amd64/Packages << docker done 17:50
g3ek_Anyone have an idea?18:16
kevkog3ek_: invalid user or password 18:24
g3ek_I see that, but I havent changed the password manually on anything. I tried to reinstall from scratch. Normally it should use the password from /etc/kolla/password and not get this error. I mainly want to know if others are getting the same issues on cinder-volume and nova-compute with 2023.2, 2023.1, master18:29
opendevreviewMaksim Malchuk proposed openstack/kolla-ansible stable/2023.2: Fix 'cinder-backup' service when Swift with TLS enabled  https://review.opendev.org/c/openstack/kolla-ansible/+/91677420:39
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/2023.2: Fix default place for Ubuntu Apt keyrings  https://review.opendev.org/c/openstack/kayobe/+/91677520:50
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/2023.1: Fix default place for Ubuntu Apt keyrings  https://review.opendev.org/c/openstack/kayobe/+/91677620:51
opendevreviewMaksim Malchuk proposed openstack/kayobe stable/zed: Fix default place for Ubuntu Apt keyrings  https://review.opendev.org/c/openstack/kayobe/+/91677720:52
opendevreviewJakub Darmach proposed openstack/kolla master: Add exclude for permissions in kolla config.json file  https://review.opendev.org/c/openstack/kolla/+/65562021:21

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!