Tuesday, 2025-09-23

ralonsoh_mnaser, sorry, I'm not understanding the problem07:33
ralonsoh_can you open a LP bug with the description?07:33
*** ralonsoh_ is now known as ralonsoh07:33
opendevreviewMerged openstack/neutron master: [OVN] ovsdbapp ``chassis_del`` removes ``Chassis_Private`` too  https://review.opendev.org/c/openstack/neutron/+/96121708:49
ralonsohhi folks, if you have a couple of mins: https://review.opendev.org/c/openstack/neutron-lib/+/96161208:57
ralonsohthanks in advance08:58
ralonsohin any case, I'm adding this to the on-demand section today08:58
opendevreviewMerged openstack/neutron master: Fix typo in warning log  https://review.opendev.org/c/openstack/neutron/+/96172509:28
opendevreviewRodolfo Alonso proposed openstack/neutron master: [eventlet-removal] Don't use eventlet in the unit/functional tests  https://review.opendev.org/c/openstack/neutron/+/95225809:55
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM - Testing patch Neutron functional  https://review.opendev.org/c/openstack/neutron/+/95221009:55
opendevreviewRodolfo Alonso proposed openstack/neutron master: Remove the ``eventlet.Timeout`` testcase capture  https://review.opendev.org/c/openstack/neutron/+/96120209:56
opendevreviewLajos Katona proposed openstack/neutron-tempest-plugin master: Add test "test_sg_rule_quota_with_default_sg_rules"  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/92646911:16
haleyb#startmeeting networking13:00
opendevmeetMeeting started Tue Sep 23 13:00:27 2025 UTC and is due to finish in 60 minutes.  The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
opendevmeetThe meeting name has been set to 'networking'13:00
haleybPing list: bcafarel, elvira, frickler, mlavalle, mtomaska, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, haleyb, ralonsoh, sahid13:00
mlavalle\o13:00
ralonsohhello13:00
cbuggyo/13:01
haleybhi everyone13:01
lajoskatonao/13:01
rubasovo/13:01
haleyb#announcements13:01
haleybWe are currently in Week R-1 of Flamingo13:01
haleybSeptember 26th, 2025 is the deadline for final 2025.2 "Flamingo" release candidates13:02
bcafarelo/13:02
haleybWe will then enter a quiet period until we tag the final release on October 1st, 202513:02
haleybTeams should be prioritizing fixing release-critical bugs, before that deadline13:02
haleybI have not seen any changes that require another RC tag, please ping me if there is one13:03
haleybReminder: Release blockers will need to be merged to master, then cherry-picked to stable/2025.213:03
haleybOtherwise it's time to start planning the 2026.1 "Gazpacho" development cycle13:03
haleybThe next OpenInfra PTG will take place October 27-31, 2025 and registration for the event is now open13:04
haleyb#link https://ptg.openinfra.dev/13:04
haleybhopefully people have signed-up13:04
haleybplease start thinking of any topics you want to discuss13:05
haleybReminder: If you have a topic for the drivers meeting on Friday, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers13:05
haleybAnd continue to use the priorities dashboard for important changes or things ready to merge, think there are a few there13:06
haleybthere are some topics for this friday's meeting hopefully we have quorum13:06
haleybthat was all announcements, anything else?13:06
mtomaskao/ question from me13:07
haleybsure13:07
mtomaskaIn regards to this https://review.opendev.org/c/openstack/python-neutronclient/+/960846 patch. I would like to move the tapas OSC client to to the openstackclient repo13:07
haleybmtomaska: that was going to be a discussion at the ptg, since there are a number of things on neutronclient to move13:08
mtomaskaI see it was discussed on Sept 12 in drivers meeting, but it was not clear to me if there is anything blocking us moving it to the openstackclient repo.13:08
lajoskatonaWe discussed this topic on a previous drivers meeting, so I think you can move the code13:08
mtomaskaACK, I will start moving it then. Thank you!13:09
ralonsohso it would be preferable to move any CLI code to OSC13:09
haleybmtomaska: if you want to take ownership of that it would be great13:09
lajoskatonaTill we have no release I think not much review can be expected for new things13:09
lajoskatonayeah thanks for jumping in to this topic13:10
ralonsohhaleyb, I think mtomaska will handle it, for sure13:10
mtomaskayes :)13:10
haleybperfect :)13:10
mtomaskathanks all, that is all from me13:10
haleybok, moving on13:11
haleyb#topic bugs13:11
haleybrubasov was the deputy last week, his report is at13:11
haleyb#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/ILBNVTADPGM4TA5NDJIJZZ3DGV4K62MU/13:11
haleybwe can go through the unassigned13:11
haleyb#link https://bugs.launchpad.net/neutron/+bug/212425413:12
haleyb[L3] A router with multiple GW ports, if the first is deleted, the GW info is empty13:12
ralonsohyeah, the behaviour is weird13:12
ralonsohif you add GW1, then GW2 and then remove GW1, the GW info of the router is empty13:12
ralonsohbut we still have GW2 present13:12
ralonsohso this is a router with one single GW and should be present there13:13
haleybright, seems related to the multiple gw code13:13
ralonsohI provided the steps (4)13:13
ralonsohyes it is13:13
haleybfnordahl: can you look at https://bugs.launchpad.net/neutron/+bug/2124254 just to confirm what should be happening when you remove one GW from a router? maybe it's something we forgot to add a test for13:14
ralonsoh(if not, maybe next week I can take it, but not right now)13:14
haleybi can loop back with frode later as he might be busy13:15
ralonsohand this is a candidate to be backported, for sure13:15
haleybyes, maybe one of us here can take it possibly too13:15
haleybnext one13:16
haleyb#link https://bugs.launchpad.net/neutron/+bug/212426913:16
haleybCan't bind an HA router_gateway port to chassis13:16
haleybi see there were some comments13:16
ralonsohyeah, rubasov is correct there: we use gateway_chassis for LRP, not ha_chassis_group13:16
ralonsohbut the other problem is the exception in the logs13:17
rubasovI just changed that to incomplete13:17
ralonsohI requested the steps to reproduce it13:17
rubasovwe need more info as Rodolfo wrote13:17
ralonsohand the other point here is if he defined correctly the GW chassis13:17
ralonsoh(also commented in c#3)13:17
ralonsoh"I don't care about this feature, I just want my routers to work." 13:18
haleyback, will follow to see comments13:18
ralonsoh^^ I love this sentece13:18
haleybwe all want our routers to work :)13:19
haleybnext one13:20
haleyb#link https://bugs.launchpad.net/neutron/+bug/212384813:20
haleyb[ovn-octavia-provider] Octavia LB not reachable with custom firewall appliance13:20
haleybi see froyo asked to contact OVN core team, but there was an additional comment13:21
haleybhe must be back from leave to take a look?13:22
ralonsohyes he is back13:22
rubasovI hope he can look again because that was above my level of understanding octavia with ovn13:23
haleybi'll assume he is watching as he commented last week, will leave a response to him then13:23
rubasovI just marked it incomplete instead13:23
haleybgreat, thanks13:24
haleybthe last two were marked invalid, and we can cover the RFE ones friday13:24
haleybany other bugs to discuss?13:24
haleybmlavalle is the bug deputy this week, lajoskatona next week - that good for both?13:25
lajoskatonaYes, I am prepared :-)13:25
mlavalleok with me13:25
haleybgreat, thanks!13:25
haleyb#topic specs13:26
haleyb#link https://review.opendev.org/q/project:openstack/neutron-specs+status:open13:26
haleybjust a reminder there might be specs in need of review13:26
haleybsomething i will look at once Flamingo is shipped13:26
haleyb#topic community goals13:27
haleyblajoskatona: we can start with neutronclient13:27
lajoskatonaThe only new is that for nova there is the first green patch: https://review.opendev.org/c/openstack/nova/+/92802213:28
lajoskatonafor networks13:28
lajoskatonaso I can go to the next thing like subnets or ports13:28
haleybgreat news! that was a lot of testing changes 8-o13:29
lajoskatonayes deeply hardcoded everywhere, so like a n operation :-)13:30
haleyb:)13:31
haleybralonsoh: and i'll let you give status update on eventlet13:31
ralonsohYeah, I rebased https://review.opendev.org/c/openstack/neutron/+/952258/13:31
ralonsohnote: the ovs tempest job failed because of a OOM13:31
ralonsoh^^ please review this patch 13:32
ralonsohthere are some other patches (lajos is pushing them) to fix other projects13:32
ralonsohhttps://review.opendev.org/q/topic:%22eventlet-removal%2213:32
ralonsohthat's all (I still need to update other patches for Neutron to completely remove eventlet)13:33
lajoskatonaI have to collect my strength to work on them again13:33
ralonsohI'll review them and push new PS if needed13:33
haleybralonsoh: ack, thanks for all the work on that, i think my review found mostly nits and some leftover code, otherwise good13:34
ralonsoh++13:34
haleyb#topic on-demand13:35
haleybthere was one topic from ralonsoh i just forgot to clean wiki to remove older one13:35
ralonsohyeah, one sec13:35
haleyb#link https://review.opendev.org/c/openstack/neutron-lib/+/96161213:35
ralonsohSo this is related to the multihoming GW for OVN issue13:36
ralonsohI found that we are reviewing the router.enable_snat from the GW information13:36
ralonsohbut this is stored in the router table13:36
ralonsohalthough this is set/defined in the GW API (add_gateway_port, update_gateway_port)13:37
ralonsohand regardless of the number of GWs in a router13:37
ralonsohthis flag is unique and global for "router" object13:37
ralonsoh^^ this extension is making it public (as read-only) in the router13:37
ralonsohthat's all, that was a justification for this new extension13:38
haleybralonsoh: so this flag cannot be set during router creation, correct?13:38
ralonsohkind of, let me explain13:38
ralonsohyou can do "router create --eanble_snat --external_gateway public router1"13:39
ralonsohthat will issue two http requests: one for crouter create, another for GW add (with the flag)13:39
ralonsohif you do "rotuer create --enable_snat router1" that fails because the GW is missing13:39
ralonsohhowever, the router creation will set the default value13:39
ralonsohI commented that here: https://review.opendev.org/c/openstack/neutron-lib/+/961612/comment/f3164856_ee71b484/13:40
haleybralonsoh: ack, that explains why the latest PS removed a line from the POST section13:41
ralonsohyes, exactly13:41
ralonsohthanks to slaweq's comment13:41
haleybthanks, will look after meeting13:42
haleybare there any other topics for on-demand?13:42
mlavallehaleyb, where are we adding topics for the PTG?13:42
ralonsohI think we can (as we have done before) create our etherpad13:43
haleybmlavalle: last ptg someone created all the etherpads, but i can go create one so we can add topics13:43
ralonsohand then, when the official one is created, move all to this one13:43
ralonsoh(we have done this before)13:44
haleybyeah, let me make one13:44
ralonsoh++13:44
mlavalleyes, that was really me question. whether we have an etherpad already created13:44
haleyb#link https://etherpad.opendev.org/p/oct2025-ptg-neutron13:46
haleybi need to clean it up as i copied from last falls ptg13:46
mlavallethanks haleyb 13:47
haleybok, any other topics?13:48
lajoskatona+113:48
lajoskatonano question from me, thanks13:48
mnaseri have a nasty race bug that i have a reproducer up for, but i can keep it post meeting :)13:48
haleybmnaser: did you file a bug with the info?13:49
mnaserhttps://bugs.launchpad.net/neutron/+bug/2125500 and a very easy reproducer13:49
haleyboh, 12 minutes ago, which is why it wasn't triaged yet13:50
mnaseryes, sorry, got to getting it through this morning once i got a reproducer13:50
ralonsohso you add subnets to a network and a port doesn't receive all IPs??13:50
ralonsohin the OVN DB, I guess, right?13:50
mnaseryes, the metadata port specifically13:50
mnaseri thought oVN db at first.. but now.. nope, neutron db too :X13:51
ralonsohso in the mysql DB too??13:51
mnaserwhen i wwas playing with this and did 48 subnets, i see 46 fixed_ips in mysql13:51
mnaseryep13:51
ralonsohok, that's a problem, for sure13:51
ralonsohlet me check that13:51
ralonsohI'm setting importance to high13:51
mnaserthank you, i will spin up a devstack and reproduce in that as well just to try and eliminate factors (maybe galera is doing something funky who knows)13:52
ralonsohbut these CLI commands are executed serially13:52
mnasernope, you notice i have an '&' in the for loop13:52
ralonsohah ah ah13:52
mnaserso they actually all get backgrounded and start blasting in parallel in the background13:53
ralonsohhow many API workers??13:53
mnaser8 api, 8 rpc X 313:53
mnaserso 3 control plane nodes with 8api/8rpc each13:53
ralonsohok13:53
ralonsohcan you execute that and retrieve the API logs from the 3 controllers??13:54
ralonsohif that is possible13:54
mnaserof course13:54
ralonsohif you have sensitive data, please hide it13:54
mnaserill add it to the bug log, might be a bit, yea, there might be noise, so ill try to clear it up :p13:54
ralonsohin debug mode, if possible. That will help us to debug this problem13:54
haleyband i'm assuming running serially is Ok? just slow13:55
mnaserwell, this user is using heat to bring up these subnets13:55
mnaserso serially works fine afaik and is "slow" enough to be ok, but when using heat, it just goes and blasts away and brings this13:55
haleybright13:56
mnaserfwiw this issue started at first when they had 48 subnets, i looked at their stuff and said hey, you can make this into like 12 smaller networks with 4 subnets instead13:56
mnaserand the issue still occured, but i cannot reproduce it with 4 subnets just via cli myself, so that tells me this is a "under load" thing13:56
haleyback, thanks, we will take a look13:57
mnaseryep, logs coming on up, ill keep digging too if i can get somewhere13:57
haleybanything else? i have a hard stop in :213:58
haleyb#endmeeting13:58
opendevmeetMeeting ended Tue Sep 23 13:58:25 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:58
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2025/networking.2025-09-23-13.00.html13:58
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2025/networking.2025-09-23-13.00.txt13:58
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2025/networking.2025-09-23-13.00.log.html13:58
haleybthanks for coming everyone, ahve a good week13:58
ralonsohbye13:58
mnasero/13:58
mlavalle\o13:58
lajoskatonao/13:59
mtomaska_o/14:00
mnasergot logs in there14:14
*** sean-k-mooney is now known as sean-k-mooney-pto14:51
ivvehhello there folks, having a odd issue with neutron cluster where neutron-server in all ctrl nodes keep enumerating geneve mesh likeso: %(geneve_vni_1_741082)s, %(geneve_vni_1_741083)s, %(geneve_vni_1_741084)s across all possible vnis.. anyone seen this before?16:10
ivvehdid full ovn, ovs, neutron restart to get a clean cluster start but its just back on track and can't start the api properly due to this16:10
ivvehwell, seems neutron-server doesn't like very large vni ranges.. could this be considered a bug?16:56
ivvehi only used 3.4million out of the 16.7 something possible16:57
opendevreviewArnaud Morin proposed openstack/neutron master: Add a new option to skip loading Trunk extension  https://review.opendev.org/c/openstack/neutron/+/91397918:57
*** QG0 is now known as QG23:50

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!