Wednesday, 2022-07-20

*** ysandeep|out is now known as ysandeep01:52
*** ysandeep is now known as ysandeep|afk03:23
*** ysandeep|afk is now known as ysandeep10:14
opendevreviewTakashi Kajinami proposed openstack/octavia-dashboard master: Test with the latest master of Horizon  https://review.opendev.org/c/openstack/octavia-dashboard/+/85052013:18
opendevreviewconna proposed openstack/octavia stable/yoga: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85048113:20
opendevreviewconna proposed openstack/octavia stable/xena: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85048213:21
opendevreviewconna proposed openstack/octavia stable/wallaby: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85048313:23
opendevreviewconna proposed openstack/octavia stable/victoria: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85048413:23
opendevreviewconna proposed openstack/octavia stable/ussuri: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85052213:32
*** ysandeep is now known as ysandeep|afk13:37
opendevreviewconna proposed openstack/octavia stable/train: Fix update/delete listener CA/CRL error  https://review.opendev.org/c/openstack/octavia/+/85048513:38
*** ysandeep|afk is now known as ysandeep14:13
opendevreviewVishal Manchanda proposed openstack/octavia-dashboard master: [DNM] Test octavia-dashboard with Firefox browser  https://review.opendev.org/c/openstack/octavia-dashboard/+/85052814:19
opendevreviewTom Weininger proposed openstack/octavia master: Add element for TuneD and Tuna  https://review.opendev.org/c/openstack/octavia/+/84912914:47
opendevreviewTom Weininger proposed openstack/octavia master: Amphora vertical scaling optimization in Octavia  https://review.opendev.org/c/openstack/octavia/+/84913014:47
gthiemonge#startmeeting Octavia16:00
opendevmeetMeeting started Wed Jul 20 16:00:32 2022 UTC and is due to finish in 60 minutes.  The chair is gthiemonge. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
opendevmeetThe meeting name has been set to 'octavia'16:00
gthiemongeHi Folks16:00
johnsomo/16:00
tweiningo/16:00
gthiemonge#topic Announcements16:01
gthiemonge** PTL on vacation16:02
gthiemongeI'm on PTO for the next 2 weeks16:02
tweiningI hope you'll find a cool spot ;)16:02
gthiemongeI propose that we cancel the weekly meetings until I'm back16:02
gthiemongetweining: ;)16:02
johnsomEnjoy the time away!16:02
oschwartEnjoy gthiemonge!16:02
gthiemongeif you're ok with that, the next meeeting will be on Aug 10th16:03
tweiningack16:03
johnsomYeah, things have been quiet, so a break from the weekly meetings is probably fine.16:03
gthiemongethanks16:03
gthiemongeit gives you time for reviewing my patches16:03
oschwartI am fine with Aug 10th16:03
gthiemonge#topic CI Status16:05
gthiemongewe had an issue this week with a new release of pyroute216:06
gthiemongethis release (0.7.1) has a bug in the ip "rule" module16:06
gthiemongeit adds invaluid rules (no error when adding a rule, but it doesn't work)16:06
johnsomYeah, that release broke neutron too. I hope the new 0.7.2 is in better shape16:06
gthiemongeso it breaks the network connectivity in the amphora (unresponsive VIP)16:07
gthiemongeyeah the bug is fixed, and they released 0.7.216:07
gthiemongethere's a patch to bump pyroute16:07
gthiemongehttps://review.opendev.org/c/openstack/requirements/+/85030116:07
gthiemongeso please keep an eye on the CI results in case there's another issue with it16:07
tweiningok16:08
gthiemongein neutron, it was easy to spot where the error was (they got exception) but in the amphora, I only saw a weird output when running "ip rule show" in the haproxy ns16:08
*** ysandeep is now known as ysandeep|out16:11
johnsomYeah, silent failures like that are horrible. Good catch on tracking it down!16:11
gthiemonge#topic Brief progress reports / bugs needing review16:13
gthiemongewell I was busy with this pyroute2 issue...16:13
tweiningI could give a short update from the cpu pinning front...16:13
tweininghttps://review.opendev.org/q/topic:amp-cpu-pinning+-status:abandoned16:13
tweiningI didn't update the proposal anymore. it was pretty clear to me what to do, so I started the implementation already16:14
gthiemongeI hope I will be able to test it soon!16:15
tweiningI extended the amphora API a bit and now octavia can set the cpumap setting in the haproxy config automatically16:15
tweiningin other words: the HAProxy part works16:16
johnsomHow is that going? I haven't had time to look at it recently16:16
tweiningI also worked on implementing the element recently16:16
tweiningit uninstalls irqbalance and install tuned and tuna. I created a new "amphora" tuned profile based on the cpu-partitioning profile from Red Hat16:17
tweiningI thought I would need to get the total number of vCPUs in the amp in order to configure it, but today it turned out that I don't need it.16:18
tweiningso, all the IRQs and processes that are movable are pinned to vCPU0 now16:18
johnsomNIC interrupts as well?16:19
tweiningbut since HAProxy does it's own pinning it uses the other vCPUs16:19
tweiningjohnsom: https://paste.opendev.org/show/bWg97HanXFatbg4nkd6H/16:21
tweiningbut that is an older version. I think it's only 3 IRQs now that couldn't get moved.16:22
johnsomvirtio3 is the lb-mgmt-net NIC?16:22
johnsomI hate that about the virtio drivers, they aren't very discriptive.16:23
tweiningthat should be the up to date list https://paste.opendev.org/show/b1k7qw4rNHW8KAYKEDiz/16:23
gthiemongewe need to check what happens when we add a new NIC16:24
tweiningI didn't figure out how these interrupts are mapped16:24
tweiningyet16:24
johnsomAck16:24
johnsomYeah, it's the VIP/member NICs that are the important part for mapping the interrupts. lb-mgmt-net is low volume16:25
gthiemongehey, as time flies, it would be great if you could review/test this patch chain:16:27
gthiemonge#link https://review.opendev.org/c/openstack/octavia/+/660239/16:27
tweiningwrt processes I was able to pin all by pinning systemd, which is quite convenient16:27
gthiemonge(it contains the multi-VIP support and the fix for plugging many subnets from the same network on the member ports)16:27
gthiemonge(huge patches)16:27
johnsomIt looks like the first patch in the chain is failing unit tests: https://review.opendev.org/c/openstack/octavia/+/812368/1216:28
johnsomWell, functional actually16:28
gthiemongegrmpf16:29
gthiemongeyeah this is the mock for pyroute2 that I need to apply in my patch16:29
gthiemongeso the tests fail because of the tests :D16:29
gthiemonge#topic Open Discussion16:31
gthiemongeanything else?16:33
johnsomNothing from me this week16:34
tweiningone note16:34
tweiningabout irq pinning16:34
oschwartNothing from me16:34
tweiningI do that using a kernel cmdline parameter (irqaffinity AFAIR) so I would expect that it will apply to all new IRQs as well16:35
tweiningbut that needs to be verified16:35
tweiningnothing else from me16:35
gthiemongeok16:36
gthiemongethank you folks!16:36
gthiemonge#endmeeting16:36
opendevmeetMeeting ended Wed Jul 20 16:36:25 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:36
opendevmeetMinutes:        https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.html16:36
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.txt16:36
opendevmeetLog:            https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.log.html16:36
johnsomo/16:36
opendevreviewMichael Johnson proposed openstack/octavia master: Reconfigure amphora network interfaces seamlessly  https://review.opendev.org/c/openstack/octavia/+/81236822:02
opendevreviewMichael Johnson proposed openstack/octavia master: Remove netaddr module requirement  https://review.opendev.org/c/openstack/octavia/+/85059023:46

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!