*** ysandeep|out is now known as ysandeep | 01:52 | |
*** ysandeep is now known as ysandeep|afk | 03:23 | |
*** ysandeep|afk is now known as ysandeep | 10:14 | |
opendevreview | Takashi Kajinami proposed openstack/octavia-dashboard master: Test with the latest master of Horizon https://review.opendev.org/c/openstack/octavia-dashboard/+/850520 | 13:18 |
---|---|---|
opendevreview | conna proposed openstack/octavia stable/yoga: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850481 | 13:20 |
opendevreview | conna proposed openstack/octavia stable/xena: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850482 | 13:21 |
opendevreview | conna proposed openstack/octavia stable/wallaby: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850483 | 13:23 |
opendevreview | conna proposed openstack/octavia stable/victoria: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850484 | 13:23 |
opendevreview | conna proposed openstack/octavia stable/ussuri: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850522 | 13:32 |
*** ysandeep is now known as ysandeep|afk | 13:37 | |
opendevreview | conna proposed openstack/octavia stable/train: Fix update/delete listener CA/CRL error https://review.opendev.org/c/openstack/octavia/+/850485 | 13:38 |
*** ysandeep|afk is now known as ysandeep | 14:13 | |
opendevreview | Vishal Manchanda proposed openstack/octavia-dashboard master: [DNM] Test octavia-dashboard with Firefox browser https://review.opendev.org/c/openstack/octavia-dashboard/+/850528 | 14:19 |
opendevreview | Tom Weininger proposed openstack/octavia master: Add element for TuneD and Tuna https://review.opendev.org/c/openstack/octavia/+/849129 | 14:47 |
opendevreview | Tom Weininger proposed openstack/octavia master: Amphora vertical scaling optimization in Octavia https://review.opendev.org/c/openstack/octavia/+/849130 | 14:47 |
gthiemonge | #startmeeting Octavia | 16:00 |
opendevmeet | Meeting started Wed Jul 20 16:00:32 2022 UTC and is due to finish in 60 minutes. The chair is gthiemonge. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
opendevmeet | The meeting name has been set to 'octavia' | 16:00 |
gthiemonge | Hi Folks | 16:00 |
johnsom | o/ | 16:00 |
tweining | o/ | 16:00 |
gthiemonge | #topic Announcements | 16:01 |
gthiemonge | ** PTL on vacation | 16:02 |
gthiemonge | I'm on PTO for the next 2 weeks | 16:02 |
tweining | I hope you'll find a cool spot ;) | 16:02 |
gthiemonge | I propose that we cancel the weekly meetings until I'm back | 16:02 |
gthiemonge | tweining: ;) | 16:02 |
johnsom | Enjoy the time away! | 16:02 |
oschwart | Enjoy gthiemonge! | 16:02 |
gthiemonge | if you're ok with that, the next meeeting will be on Aug 10th | 16:03 |
tweining | ack | 16:03 |
johnsom | Yeah, things have been quiet, so a break from the weekly meetings is probably fine. | 16:03 |
gthiemonge | thanks | 16:03 |
gthiemonge | it gives you time for reviewing my patches | 16:03 |
oschwart | I am fine with Aug 10th | 16:03 |
gthiemonge | #topic CI Status | 16:05 |
gthiemonge | we had an issue this week with a new release of pyroute2 | 16:06 |
gthiemonge | this release (0.7.1) has a bug in the ip "rule" module | 16:06 |
gthiemonge | it adds invaluid rules (no error when adding a rule, but it doesn't work) | 16:06 |
johnsom | Yeah, that release broke neutron too. I hope the new 0.7.2 is in better shape | 16:06 |
gthiemonge | so it breaks the network connectivity in the amphora (unresponsive VIP) | 16:07 |
gthiemonge | yeah the bug is fixed, and they released 0.7.2 | 16:07 |
gthiemonge | there's a patch to bump pyroute | 16:07 |
gthiemonge | https://review.opendev.org/c/openstack/requirements/+/850301 | 16:07 |
gthiemonge | so please keep an eye on the CI results in case there's another issue with it | 16:07 |
tweining | ok | 16:08 |
gthiemonge | in neutron, it was easy to spot where the error was (they got exception) but in the amphora, I only saw a weird output when running "ip rule show" in the haproxy ns | 16:08 |
*** ysandeep is now known as ysandeep|out | 16:11 | |
johnsom | Yeah, silent failures like that are horrible. Good catch on tracking it down! | 16:11 |
gthiemonge | #topic Brief progress reports / bugs needing review | 16:13 |
gthiemonge | well I was busy with this pyroute2 issue... | 16:13 |
tweining | I could give a short update from the cpu pinning front... | 16:13 |
tweining | https://review.opendev.org/q/topic:amp-cpu-pinning+-status:abandoned | 16:13 |
tweining | I didn't update the proposal anymore. it was pretty clear to me what to do, so I started the implementation already | 16:14 |
gthiemonge | I hope I will be able to test it soon! | 16:15 |
tweining | I extended the amphora API a bit and now octavia can set the cpumap setting in the haproxy config automatically | 16:15 |
tweining | in other words: the HAProxy part works | 16:16 |
johnsom | How is that going? I haven't had time to look at it recently | 16:16 |
tweining | I also worked on implementing the element recently | 16:16 |
tweining | it uninstalls irqbalance and install tuned and tuna. I created a new "amphora" tuned profile based on the cpu-partitioning profile from Red Hat | 16:17 |
tweining | I thought I would need to get the total number of vCPUs in the amp in order to configure it, but today it turned out that I don't need it. | 16:18 |
tweining | so, all the IRQs and processes that are movable are pinned to vCPU0 now | 16:18 |
johnsom | NIC interrupts as well? | 16:19 |
tweining | but since HAProxy does it's own pinning it uses the other vCPUs | 16:19 |
tweining | johnsom: https://paste.opendev.org/show/bWg97HanXFatbg4nkd6H/ | 16:21 |
tweining | but that is an older version. I think it's only 3 IRQs now that couldn't get moved. | 16:22 |
johnsom | virtio3 is the lb-mgmt-net NIC? | 16:22 |
johnsom | I hate that about the virtio drivers, they aren't very discriptive. | 16:23 |
tweining | that should be the up to date list https://paste.opendev.org/show/b1k7qw4rNHW8KAYKEDiz/ | 16:23 |
gthiemonge | we need to check what happens when we add a new NIC | 16:24 |
tweining | I didn't figure out how these interrupts are mapped | 16:24 |
tweining | yet | 16:24 |
johnsom | Ack | 16:24 |
johnsom | Yeah, it's the VIP/member NICs that are the important part for mapping the interrupts. lb-mgmt-net is low volume | 16:25 |
gthiemonge | hey, as time flies, it would be great if you could review/test this patch chain: | 16:27 |
gthiemonge | #link https://review.opendev.org/c/openstack/octavia/+/660239/ | 16:27 |
tweining | wrt processes I was able to pin all by pinning systemd, which is quite convenient | 16:27 |
gthiemonge | (it contains the multi-VIP support and the fix for plugging many subnets from the same network on the member ports) | 16:27 |
gthiemonge | (huge patches) | 16:27 |
johnsom | It looks like the first patch in the chain is failing unit tests: https://review.opendev.org/c/openstack/octavia/+/812368/12 | 16:28 |
johnsom | Well, functional actually | 16:28 |
gthiemonge | grmpf | 16:29 |
gthiemonge | yeah this is the mock for pyroute2 that I need to apply in my patch | 16:29 |
gthiemonge | so the tests fail because of the tests :D | 16:29 |
gthiemonge | #topic Open Discussion | 16:31 |
gthiemonge | anything else? | 16:33 |
johnsom | Nothing from me this week | 16:34 |
tweining | one note | 16:34 |
tweining | about irq pinning | 16:34 |
oschwart | Nothing from me | 16:34 |
tweining | I do that using a kernel cmdline parameter (irqaffinity AFAIR) so I would expect that it will apply to all new IRQs as well | 16:35 |
tweining | but that needs to be verified | 16:35 |
tweining | nothing else from me | 16:35 |
gthiemonge | ok | 16:36 |
gthiemonge | thank you folks! | 16:36 |
gthiemonge | #endmeeting | 16:36 |
opendevmeet | Meeting ended Wed Jul 20 16:36:25 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:36 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.html | 16:36 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.txt | 16:36 |
opendevmeet | Log: https://meetings.opendev.org/meetings/octavia/2022/octavia.2022-07-20-16.00.log.html | 16:36 |
johnsom | o/ | 16:36 |
opendevreview | Michael Johnson proposed openstack/octavia master: Reconfigure amphora network interfaces seamlessly https://review.opendev.org/c/openstack/octavia/+/812368 | 22:02 |
opendevreview | Michael Johnson proposed openstack/octavia master: Remove netaddr module requirement https://review.opendev.org/c/openstack/octavia/+/850590 | 23:46 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!