Wednesday, 2026-03-18

opendevreviewMerged openstack/python-octaviaclient master: reno: Update master for unmaintained/2024.1  https://review.opendev.org/c/openstack/python-octaviaclient/+/96570713:34
viniciusrhi13:45
gthiemonge#startmeeting Octavia16:00
opendevmeetMeeting started Wed Mar 18 16:00:11 2026 UTC and is due to finish in 60 minutes.  The chair is gthiemonge. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
opendevmeetThe meeting name has been set to 'octavia'16:00
gthiemongeo/16:00
raineszmo/16:02
viniciusro/16:02
rcruise-redhato/16:02
gthiemonge#topic Announcements16:03
gthiemonge* Gazpacho Release16:03
gthiemongewe passed RC116:03
gthiemongeunfortunately, we noticed that octavia-dashboard was broken16:04
gthiemongewe fixed it with the help of the horizon folks, patch is already on stable/2026.116:04
gthiemongeI proposed a patch to release a RC2 for octavia-dashboard, it's in CR-1 (from me) but I'll CR+1 soon16:05
gthiemonge(I was waiting for any potential new issues)16:05
gthiemongei guess that's it, does anyone have any announcements to make?16:06
viniciusrHi everyone, I'm Vinicius Rodrigues16:07
viniciusrI'm currently doing a technical studentship at CERN and will be resuming development on Octavia active-active load balancing.16:07
viniciusrLooking forward to collaborating with the team!16:07
gthiemongeviniciusr: welcome! great to have you here!16:08
raineszmo/ welcome16:08
viniciusrthank y'all :)16:08
gthiemonge#topic Brief progress reports / bugs needing review16:10
gthiemongethis week I've spent some time trying to understand what was happening in the CI, a lot of failures in the active-standby test16:10
gthiemongethe reason is very busy cloud during the last weeks of the release cycle, hosts are slow, and sometimes some actions that should take only a few seconds take minutes (for instance in the jobs, the POST /vip to the amphora took more than 3 min, on my workstation, it takes 1 sec)16:12
gthiemongenothing to really worry about16:12
opendevreviewMerged openstack/python-octaviaclient master: Bump requirement for osc-lib  https://review.opendev.org/c/openstack/python-octaviaclient/+/97880816:12
opendevreviewMerged openstack/python-octaviaclient master: Move tests to use osc_lib.test  https://review.opendev.org/c/openstack/python-octaviaclient/+/97880916:12
rcruise-redhatI've been making some fixes to this CR: https://review.opendev.org/c/openstack/octavia/+/97140816:14
rcruise-redhatIt's currently failing some tests in tempest so I need to look into that before it's ready16:14
gthiemongercruise-redhat: I think it's similar to the problem I described ^16:15
rcruise-redhatOh okay, I might recheck it then16:15
gthiemongehttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f3c/openstack/f3c7831f737e42bd9fb3b9f76916864b/controller/logs/octavia-amphora_log.txt16:16
gthiemongeyou'll find "WORKER TIMEOUT" in the logs16:16
gthiemongefew minutes after a "POST /1.0/plug/vip/fd15:82a4:7c97:1::3516:16
gthiemonge"16:17
gthiemongeanyway, I'll continue to investigate those timeout issues16:18
gthiemonge#topic Open Discussion16:19
raineszmI'm just trying to debug some amphora issues with the ubuntu packaging. Are there any tricks for debugging an amphora live?16:21
raineszmUnfortunately, because it fails the health check it gets torn down after a while as I'm still digging around16:22
rcruise-redhatHave you got an instance of Devstack running?16:23
gthiemongeraineszm: you can shutdown the octavia health-manager, amphorae will never be destroyed and recreated16:23
rcruise-redhat gthiemonge: beat me to it :)16:23
raineszmHaha16:23
raineszmI thought I tried disabling the health-manager service but I'll try again.16:24
raineszmrcuise-redhat: I was going to say I can't use devstack because I need to specifically test amphorae built from the .debs, but I release it doesn't matter how the cloud is deployed, just the amphorae16:25
raineszmTY16:25
rcruise-redhatNP, I think in devstack the health-manager has a slightly cryptic name, devstack@o-hm.service or similar16:25
raineszmoh. I still need a +2/workflow on these stable backports https://review.opendev.org/c/openstack/octavia/+/97877116:26
raineszmyeah. devstack is quite cryptic in its naming.16:26
gthiemongeanother method is to set heartbeat_timeout to a very huge value (1 day): https://docs.openstack.org/octavia/latest/configuration/configref.html#health_manager.heartbeat_timeout16:26
raineszmexcellent.16:26
raineszmTBH debugging an amphora is rough without building in some custom tools to the image16:27
rcruise-redhatAnother another option is to just create a server from the amphora image16:27
gthiemongeack I'll approve the patches on stable/* (I can't on unmaintained)16:27
raineszmgthiemonge: ty16:27
gthiemongercruise-redhat: but you'll not get the metadata set by the octavia worker16:28
raineszmexactly16:28
rcruise-redhatAh yes, then you'll need to do it via octavia16:28
raineszmI spent a lot of time just poking around with virt-ls and virt-cat before just building a new image with sosreport baked in16:28
gthiemongeI had tools for devstack: https://github.com/gthiemonge/devstack-helpers/blob/master/ds-amphora-image-patch16:29
raineszmooh very nice.16:30
rcruise-redhatyeah, when in doubt, go raid Greg's github for useful stuff16:31
gthiemongelol, most of the stuff is old and I'm not sure it still works16:32
raineszmStill a great starting point.16:32
gthiemongehttps://github.com/gthiemonge/devstack-helpers/blob/master/ds-amphora-sync16:33
gthiemonge^ this one updates the code of a running amphora16:33
gthiemongeit probably needs to be adjusted16:34
gthiemongeraineszm: don't hesitate to ask here if you need help to debug an amphora16:36
raineszmgthiemonge: thanks. It's on the back burner for a moment while I finish something else up but then it's probably top of my list16:36
gthiemongeack16:37
gthiemongeanything else for today's meeting, guys?16:37
rcruise-redhatNothing from me16:37
raineszmTHat's all from me16:39
gthiemongeok!16:39
gthiemongehave a good one!16:39
gthiemonge#endmeeting16:39
opendevmeetMeeting ended Wed Mar 18 16:39:50 2026 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:39
opendevmeetMinutes:        https://meetings.opendev.org/meetings/octavia/2026/octavia.2026-03-18-16.00.html16:39
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/octavia/2026/octavia.2026-03-18-16.00.txt16:39
opendevmeetLog:            https://meetings.opendev.org/meetings/octavia/2026/octavia.2026-03-18-16.00.log.html16:39
raineszmhave a good one o/16:47

Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!