Tuesday, 2025-02-04

opendevreviewliuyulong proposed openstack/neutron master: Fullstack case for metadata path  https://review.opendev.org/c/openstack/neutron/+/88809802:33
opendevreviewliuyulong proposed openstack/neutron master: Add devstack plugin to enable ovs metadata_path  https://review.opendev.org/c/openstack/neutron/+/92858602:33
opendevreviewliuyulong proposed openstack/neutron master: Fullstack case for metadata path  https://review.opendev.org/c/openstack/neutron/+/88809808:13
opendevreviewliuyulong proposed openstack/neutron master: Add devstack plugin to enable ovs metadata_path  https://review.opendev.org/c/openstack/neutron/+/92858608:13
opendevreviewSlawek Kaplonski proposed openstack/neutron master: QinQ implementation for the ML2/OVN backend  https://review.opendev.org/c/openstack/neutron/+/93763308:17
slaweqralonsoh ykarel_ lajoskatona hi, please check https://review.opendev.org/q/topic:%22bug/2096912%22 when You will have few minutes, those patches should fix our grenade jobs08:18
slaweqfrickler hi, maybe also you can take a look at the devstack and grenade patches in ^^08:19
slaweqthx in advance08:19
ralonsohsure, let me check08:24
lajoskatonaslaweq: checking08:39
slaweqthx guys08:46
opendevreviewRodolfo Alonso proposed openstack/neutron master: [OVN] Fix metadata server when body response is empty  https://review.opendev.org/c/openstack/neutron/+/94067908:47
opendevreviewRodolfo Alonso proposed openstack/neutron master: WIP == [OVN] Avoid race condition in Port_Group deletion  https://review.opendev.org/c/openstack/neutron/+/94068008:52
priteauralonsoh: Hola. Do you think we could reopen this bug? https://bugs.launchpad.net/neutron/+bug/2093258. We are sometimes seeing the same trace, but we are using MariaDB, not PostgreSQL.09:02
priteauSorry for the large amount of logs shared via paste, you can of course look at the Zuul build logs while they are still available.09:03
fricklerslaweq: +2d, not sure if that is urgent enough I should single-approve?09:06
karolinkuHey, I'm planning to work on adding support for keyfiles in Glean project (https://issues.redhat.com/browse/RDO-443). It is related to support for Centos 10 release. Is that OK for you to add such feature?09:08
fricklerkarolinku: glean isn't a neutron deliverable, it doesn't even belong to openstack, you may want to discuss in the #opendev channel instead. I would also consider it possibly kind of deprecated, maybe switching to using cloud-init proper might be another option09:16
ralonsohpriteau, let me check09:17
ralonsohpriteau, what is port 0b07901b-fd8b-44f6-b452-e60f817df53b? 09:24
ralonsohand why this port doesn't have str attributes?09:24
ralonsohcan you check that in your database?09:24
ralonsohstd attributes*09:25
ralonsohwhat version are you using?09:27
priteauralonsoh: I am sorry, since this is in a Zuul CI job, the environment and database are gone09:27
priteauThis is all using master code09:27
priteauCould be up to a day old since we use Kolla images, but not more than that09:27
ralonsohso this is a VM port, by default all ports have std attr09:28
ralonsohthis error makes no sense09:28
ralonsohthis is a baremetal instance?09:28
ralonsohyes09:28
priteauYes, bare metal instance. 0b07901b-fd8b-44f6-b452-e60f817df53b is the server UUID09:29
ralonsohI need to check the neutron port creation call09:29
priteauThe full neutron-server logs are here: https://d58e03ce2f5a9d20c8f0-76770e8376bdcb5a12e0ef605f8b8d22.ssl.cf1.rackcdn.com/940187/1/gate/kayobe-overcloud-ubuntu-noble/6f7cb47/primary/kolla/neutron/neutron-server.txt09:30
ralonsohpriteau, is this error happening always?09:32
priteauNo, it's only occasional. Might be a race condition?09:32
priteauBut I have definitely seen it multiple times in the past few days09:33
ralonsohthere is a race condition there because there is a delete and get calls at the same time09:34
ralonsohbut both the port and the stdatr registers are deleted at the same time09:34
ralonsohbut 09:35
ralonsoh        return sa.orm.relationship(StandardAttribute,09:35
ralonsoh                                   lazy='selectin',09:35
ralonsoh                                   cascade='all, delete-orphan',09:35
ralonsoh                                   single_parent=True,09:35
ralonsoh                                   uselist=False)09:35
ralonsohthat means to retrieve this field we issue a second query09:36
ralonsohyou are retrieving the port db register but not the stdattr field just for a few milliseconds09:36
ralonsohactually I think I'm going to revert https://review.opendev.org/c/openstack/neutron-lib/+/92392609:39
ralonsohslaweq, lajoskatona ^09:39
ralonsohhttps://review.opendev.org/c/openstack/neutron-lib/+/923926 was added to be postgresql compatible09:39
ralonsohbut this is introducing a possible race condition09:39
ralonsohbecause we have dropped the support for this backend, I'm going to revert this change09:40
priteauSounds good, thanks for the analysis.09:40
priteauI will keep monitoring our CI jobs to let you know if we stop seeing the error after the revert.09:41
slaweqralonsoh +1 for me, lets keep mysql/mariadb working the best as we can09:45
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Revert "Change the ``StandardAttribute`` load method to "selectin""  https://review.opendev.org/c/openstack/neutron-lib/+/94068209:49
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Revert "Change the ``StandardAttribute`` load method to "selectin""  https://review.opendev.org/c/openstack/neutron-lib/+/94068209:51
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM - Test "neutron-ovn-tempest-ipv6-only-ovs*" with WSGI  https://review.opendev.org/c/openstack/neutron/+/93997709:57
lajoskatonaralonsoh: ack, thanks09:57
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: ovs: reimplement signals handling  https://review.opendev.org/c/openstack/neutron/+/93932110:07
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: ovs: remove the usage of eventlet in the OVS agent  https://review.opendev.org/c/openstack/neutron/+/93776510:07
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: agent/linux: remove eventlet usage from of_monitor  https://review.opendev.org/c/openstack/neutron/+/94068410:07
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: agent/linux: remove eventlet usage from ip_conntrack  https://review.opendev.org/c/openstack/neutron/+/94068510:07
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: agent/linux: remove eventlet usage from ip_lib  https://review.opendev.org/c/openstack/neutron/+/94068610:07
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: agent/linux: remove eventlet usage from ip_conntrack  https://review.opendev.org/c/openstack/neutron/+/94068510:12
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: agent/linux: remove eventlet usage from ip_lib  https://review.opendev.org/c/openstack/neutron/+/94068610:12
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: ovs: reimplement signals handling  https://review.opendev.org/c/openstack/neutron/+/93932110:12
opendevreviewSahid Orentino Ferdjaoui proposed openstack/neutron master: ovs: remove the usage of eventlet in the OVS agent  https://review.opendev.org/c/openstack/neutron/+/93776510:12
opendevreviewRodolfo Alonso proposed openstack/neutron master: [DNM] Check functional failure  https://review.opendev.org/c/openstack/neutron/+/94012810:30
opendevreviewRodolfo Alonso proposed openstack/neutron master: [FT] Relax the active wait period in ``TestAsyncProcess``  https://review.opendev.org/c/openstack/neutron/+/94068710:30
ralonsohfolks, please check https://review.opendev.org/c/openstack/neutron/+/94068711:02
ralonsohthe CI patch (https://review.opendev.org/c/openstack/neutron/+/940128) is passing11:02
opendevreviewRodolfo Alonso proposed openstack/neutron master: [OVN] Fix metadata server when body response is empty  https://review.opendev.org/c/openstack/neutron/+/94067911:07
opendevreviewMerged openstack/ovn-bgp-agent master: Use BFD sessions for local OVN  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/93688112:31
opendevreviewMaor Blaustein proposed openstack/neutron master: Fix LRP.external_ids router name prefix  https://review.opendev.org/c/openstack/neutron/+/94044513:11
opendevreviewyatin proposed openstack/neutron unmaintained/2023.1: [DNM] Check devstack-tobiko-neutron  https://review.opendev.org/c/openstack/neutron/+/94069613:28
haleyb#startmeeting networking14:00
opendevmeetMeeting started Tue Feb  4 14:00:30 2025 UTC and is due to finish in 60 minutes.  The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'networking'14:00
haleybPing list: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, haleyb, ralonsoh14:00
mlavalle\o14:00
elvirao/14:00
mtomaskao/14:00
slaweqo/14:00
frickler\o14:00
ralonsohhello14:01
cbuggyo/14:01
lajoskatonao/14:01
haleyb#announcements14:01
rubasovo/14:01
haleybWe are in week R-8 of Epoxy14:01
mblue_o/14:01
haleybE-3 milestone at week R-5 (Feb 24)14:02
sahido/14:02
bcafarelo/14:02
haleyb#link https://releases.openstack.org/epoxy/schedule.html14:02
haleybSo about 3 weeks until feature freeze14:02
haleybAny code changes for RFEs should be posted very soon14:03
haleybReminder: If you have a topic for the drivers meeting on Friday, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers14:03
haleybI will triage by thursday and send email about meeting14:04
haleybAnd of course a reminder to use the priorities dashboard for patches in the "ready to merge" state14:04
haleybThose should be focus of reviews14:04
haleybWe merged the Linuxbridge driver removal last week )-;14:05
haleybor :)14:05
bcafarel\o/14:05
lajoskatonayesterday we discussed the side effects of it as bagpipe is broken since that14:06
slaweqone thing to mention regarding linux bridge removal14:06
slaweqduring the FOSDEM there was OpenStack BoF session14:06
slaweqthere was pretty many operators there14:06
lajoskatonaI checked this morning and part of bagpipe is fully lb dependent (I was in the beleief that everything is working in it on OVS and lb)14:06
slaweqand I asked about LB if anyone is really using it and that we removed it14:06
slaweqand good news is that nobody from those people was actually shocked with this, and nobody told us that is still using LB :)14:07
lajoskatonagood news really :-)14:07
slaweqso this is kind of confirmation that we did right thing with it IMHO14:07
haleybphew, i thought you were going to say they got their pitchforks14:07
ralonsohso what should we do with bagpipe?14:08
slaweqhaha, then I would not be here today probably :P14:08
haleyblajoskatona: has there been work on moving to OVS, etc?14:08
lajoskatonaralonsoh: as I checked this morning the part realted to SFC is mostly linuxbridge14:08
lajoskatonahaleyb: I don't know about it, at least not in the last ~4 years let's say14:09
haleyband sorry i was out yesterday and didn't see your message in scrollback until just now14:10
lajoskatonahaleyb: no problem, today with the meeting is perhaps better anyway14:10
ralonsohwe can make this public, sending a mail with a warning14:11
lajoskatona+114:11
ralonsohand asking developers to support OVN in bagpipe14:11
ralonsohif not, we'll need to retire it along with LB14:11
ralonsohlast release note with a new feature is from rocky14:13
ralonsohhttps://docs.openstack.org/releasenotes/networking-bagpipe/rocky.html14:13
ralonsohand it says that evpn is supported in OVS too14:13
lajoskatonaralonsoh: agree, if there's users for it than its time to raise their hands (we, Ericsson seems to stopped using it in the last years)14:13
haleybi was just checking the repo and there hasn't been a lot of development, mostly fixing bugs as we've moved forward with python14:13
ralonsohmaybe (maybe) we can remove just the sfc part14:14
lajoskatonathat was my guess also14:14
lajoskatonaralonsoh: I can check it if it is a simple operation to safely cut and add documentation, and reduce the test coverage for it14:15
ralonsohcool, let's do this first14:15
lajoskatonalet's wait this week than, I check it in a time boxed manner, and let's check this topic next week14:15
haleyblajoskatona: ack, can you file a bug with this info so we don't forget?14:16
lajoskatonasure14:16
haleybthe other email i sent last week to ML was regarding removal of dibbler PD driver. I don't see any responses so we can merge that this week as well14:17
haleyb#link https://review.opendev.org/c/openstack/neutron/+/93428314:18
haleybthe other thing i did last week was remove the inclusion of networking-ovn-core into neutron-core - i sent email to list "promoting" Terry into the neutron-core group14:20
haleyblast announcement is it's PTL/TC election season for 2025.2 cycle14:21
haleybnomination period starts tomorrow14:21
slaweqthat is correct, please expect kick off email tomorrow night14:22
haleyband if anyone is interested in PTL please ping me, I am more than happy to talk about it14:22
haleybbut i would gladly server another term/cycle14:23
lajoskatonathanks haleyb14:23
haleybi have no other announcements, anyone else?14:24
mlavallehaleyb: yaay! thanks14:24
haleyb#topic bugs14:24
haleybmtomaska was bug deputy last week14:25
haleyb#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/P5KLBE5NEY7LEJASIWMOVFIK4LDLXYC2/14:25
mtomaskayep o/14:25
haleybcritical one has a patch in the gate queue14:26
haleyb#link https://bugs.launchpad.net/neutron/+bug/209691214:26
haleybso all good there14:26
ralonsohand another 3 dependant patches14:26
haleyboh14:26
ralonsohhttps://review.opendev.org/q/topic:%22bug/2096912%2214:27
haleybperfect, thanks for fixing that slaweq and to reviewers14:28
*** ykarel_ is now known as ykarel14:28
haleybnext was marked high14:29
haleyb#link https://bugs.launchpad.net/neutron/+bug/209694114:29
haleyb[OVN Routed Provider Networks] : New Compute nodes are not added to their segment aggregate14:29
haleybotherwiseguy picked that up14:29
slaweqyw :)14:29
haleyb#link https://review.opendev.org/c/openstack/neutron/+/93599014:29
slaweqI needed it to make my QinQ patches to be merged :)14:30
haleybslaweq: yes, i saw those were in the queue related to the change14:30
haleybnext bug is14:31
haleyb#link https://bugs.launchpad.net/neutron/+bug/209698314:31
haleyb[OVN] Error executing command (LspGetUpCommand): ovsdbapp.backend.ovs_idl.idlutils.RowNotFound14:31
haleybralonsoh: you filed this14:31
ralonsohit seems that is not affecting the API14:31
ralonsohbut it is horrible to see that in the logs14:31
mtomaskaThis one is pretty high IMO. I was on PTO last week so I did not have much time to sit down and track it. 14:32
ralonsohif this is a expected behaviour, we should format the logs differently14:32
ralonsohI wouldn't say high14:32
mtomaskaAgree, very "bad" log to see14:32
ralonsohthat happens when we try to bind a port but this is no longer present14:32
ralonsohand we try to find it in the OVN DB14:32
mtomaskaI feel like it might cause lot of customer support tickets.... 14:33
mtomaskaif we know why it is happening then why not just catch it and not log it?14:34
haleybright, should this be in try/except if it's ok?14:34
ralonsohbetter ovn lookup with default value14:35
ralonsohbut this is for the developer taking this bug14:35
ralonsohmtomaska, it is needed first to properly investigate the cause14:35
otherwiseguyYeah, I'm trying to investigate this a bit too in concert with my patch for resolving some race conditions between inserts and updates/deletes that happen on different workers.14:35
mtomaskabut from the bug I was not sure if we know for a fact that this is safe to catch. It seems like we need better RCA before making that conclusion. No? 14:36
ralonsohof course, that requires a previous investigation14:36
ralonsohmy report only presents the consequences, not the causes14:36
mtomaskaACK14:36
haleybok, otherwiseguy did you want to take that one as well?14:37
mtomaskaI can look into it. I just dont know how much time I am committing :)  14:37
otherwiseguyhaleyb: mtomaska: I can take it since I'm looking at it regardless :)14:38
ralonsohthanks folks14:38
haleybok, thanks terry14:38
mtomaskaotherwiseguy++14:39
haleybnext one is ovn-related14:40
haleyb#link https://bugs.launchpad.net/neutron/+bug/209693114:40
haleybDuplicate packets with router betwen flat network and vlan network14:40
ralonsohhold on, now I realize14:42
mtomaskaO yeah that one. My first instinct is that , "yeah maybe OVN does that under some circumstances" but then I did not really fully understand his network. I see he posted his ovn nb db output14:42
ralonsohthat could be also related to https://review.opendev.org/c/openstack/neutron/+/94045414:42
ralonsohwe found that when "playing" with flat networks14:42
ralonsohthat was something solved in 2024.2 but not backported14:42
ralonsohI'll ask this folk to test with these new patches14:43
haleybralonsoh: thanks, i would not have made that connection14:43
haleyband last bug14:44
ralonsoh(and now you are here, please review https://review.opendev.org/q/topic:%22bug/2073987%22)14:44
haleyb#link https://bugs.launchpad.net/neutron/+bug/209721214:44
haleybResolv.conf search domain is different from the network's dns_domain14:44
haleybralonsoh: ack, will do14:45
mtomaskaI asked mlavalle to take a quick look. As it requires dns extension. 14:45
mlavalleI haven't had time to llok at it. But I'll do it later today14:46
haleybmlavalle: thanks!14:46
mlavalle:-)14:46
haleybalright, any other bugs to dicsuss?14:46
ralonsohyes14:46
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/209325814:46
ralonsohreopened today14:46
ralonsohc#3 has the request and c#4 has the context14:47
ralonsohand the patch: https://review.opendev.org/c/openstack/neutron-lib/+/94068214:47
ralonsoh(also in the IRC history today)14:47
ralonsohthat's all from me14:48
haleybthanks for looking into it, will review after meeting14:49
haleyb#topic community goals14:49
haleyblajoskatona: i'll let you go first with any neutronclient update14:50
lajoskatonasome progress in reviews for Horizon patches14:50
lajoskatonahttps://review.opendev.org/q/topic:%22bug/1999774%22+status:open14:50
haleybthanks, i see a new one was added will take a look later14:51
haleyband last is eventlet14:52
lajoskatonathat is cleaning in test files for old data containers14:52
ralonsohabout eventlet, there are two fronts14:52
ralonsohOVS agent: sahid's patches14:52
ralonsohsahid, something to comment?14:52
ralonsohand the Neutron API, in particular now the OVN hash ring. I've pushed https://review.opendev.org/c/openstack/neutron/+/940256 and the upper 2 patches14:53
lajoskatonahttps://review.opendev.org/q/topic:%22bug/2087939%22+owner:sahid.ferdjaoui@industrialdiscipline.com14:53
opendevreviewMerged openstack/ovn-octavia-provider master: Remove join on helper request daemon thread  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/93879714:54
ralonsohotherwiseguy, made some comments but I would like to remark that the periodic maintenance task no longer works if the API is idle14:54
sahidralonsoh: sorry nothing at that point, continuing my progresses14:54
ralonsohthis is why I'm changing how the hash ring nodes are refreshed14:54
ralonsohsahid, thanks!14:54
otherwiseguyralonsoh: but will work if you change the executor from SynchronousExecutor14:54
ralonsohI did that before and didn't work14:55
ralonsohI proposed a testing patch14:55
otherwiseguy(not specifically for the reworked hashring, but I tested it and it worked)14:55
ralonsohI'll find this patch after the meeting14:55
otherwiseguyhasring touches went from like 5 to one every 15 seconds or whatever.14:56
ralonsohyes, executed by worker 1 in each node14:56
ralonsoh(that's all from me)14:58
haleyback, thanks for the update14:58
haleyb#topic on-demand14:58
haleybany other topics?14:59
haleybi have a hard stop in :114:59
lajoskatonaI have one small thing, please review these:14:59
lajoskatonahttps://review.opendev.org/q/owner:katonalala@gmail.com+label:Review-Priority%3D2+status:open14:59
lajoskatonaand Liu also has some patches as review prioriy+2, I tested the metadata things from him14:59
lajoskatonathat's it :-)14:59
haleyblajoskatona: yes, i will look at those as well, thanks for the reminder15:00
haleybok, have a good week everyone and thanks for attending15:00
haleyb#endmeeting15:00
opendevmeetMeeting ended Tue Feb  4 15:00:38 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:00
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2025/networking.2025-02-04-14.00.html15:00
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2025/networking.2025-02-04-14.00.txt15:00
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2025/networking.2025-02-04-14.00.log.html15:00
mlavalle\o15:00
ralonsohbye15:00
slaweqo/15:01
ralonsohotherwiseguy, let me push again the patch with the other factory15:01
ralonsohand on top a testing patch15:01
otherwiseguyralonsoh++15:02
opendevreviewRodolfo Alonso proposed openstack/neutron master: WIP == [OVN] Avoid race condition in Port_Group deletion  https://review.opendev.org/c/openstack/neutron/+/94068015:02
lajoskatonao/15:03
opendevreviewRodolfo Alonso proposed openstack/neutron master: DNM - Test "neutron-ovn-tempest-ipv6-only-ovs*" with WSGI  https://review.opendev.org/c/openstack/neutron/+/93934715:15
opendevreviewRodolfo Alonso proposed openstack/neutron master: POC == WIP == Change PeriodicWorker executor to ThreadPoolExecutor  https://review.opendev.org/c/openstack/neutron/+/94070715:15
ralonsohotherwiseguy, ^^15:15
opendevreviewMerged openstack/neutron master: [FT] Relax the active wait period in ``TestAsyncProcess``  https://review.opendev.org/c/openstack/neutron/+/94068715:16
otherwiseguyralonsoh: thanks. iirc, when I looked at the logs, there was some issue on the hashring where the first minute or so there was still some delay, but after that things actually started working normally (as opposed to with Synchronous, it never recovered)15:16
otherwiseguyI didn't figure out why that was though.15:17
opendevreviewLajos Katona proposed openstack/neutron master: WIP: [dhcp] Add DHCP domain_name option from network properties  https://review.opendev.org/c/openstack/neutron/+/87882015:18
opendevreviewLajos Katona proposed openstack/networking-bgpvpn master: DNM: test master  https://review.opendev.org/c/openstack/networking-bgpvpn/+/94071215:32
opendevreviewRodolfo Alonso proposed openstack/neutron master: [OVN] Fix metadata server when body response is empty  https://review.opendev.org/c/openstack/neutron/+/94067915:57
opendevreviewMerged openstack/tap-as-a-service master: Do not set ageing in case of system datapath type  https://review.opendev.org/c/openstack/tap-as-a-service/+/92240018:02
cardoeslaweq: Since you're on the TC call with me I figured I could ask you. I'm working with Ironic + Neutron (and Nova). We're specifically working with L2VNI with VXLAN. Today we're hacking on our own ML2 mechanism driver. I know ovn-bgp-agent has a RFE for L2VNI support which doesn't exist today. What would be the best way to engage with the neutron folks on what I would need to make this a reality?18:17
*** iurygregory_ is now known as iurygregory18:55
opendevreviewBrian Haley proposed openstack/neutron master: Skip certain port init steps if the device is new  https://review.opendev.org/c/openstack/neutron/+/90055321:24

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!