Tuesday, 2024-05-28

opendevreviewSlawek Kaplonski proposed openstack/os-ken master: Add pre-commit configuration  https://review.opendev.org/c/openstack/os-ken/+/91829207:23
opendevreviewyatin proposed openstack/neutron stable/2024.1: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92060807:53
opendevreviewyatin proposed openstack/neutron stable/2023.1: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92060907:58
opendevreviewyatin proposed openstack/neutron stable/2023.1: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92060907:59
*** srelf_ is now known as Continuity08:02
opendevreviewyatin proposed openstack/neutron stable/2023.2: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92061008:02
opendevreviewyatin proposed openstack/neutron stable/2023.1: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92060908:03
opendevreviewyatin proposed openstack/neutron unmaintained/zed: [stable only] Do not fail on missing logical router ports  https://review.opendev.org/c/openstack/neutron/+/92062108:04
opendevreviewMerged openstack/ovsdbapp stable/2024.1: Handle IPv6 addresses for LB IP port mappings  https://review.opendev.org/c/openstack/ovsdbapp/+/91514308:54
opendevreviewMerged openstack/ovsdbapp master: Use log.warning() from the logging library  https://review.opendev.org/c/openstack/ovsdbapp/+/92040409:20
opendevreviewLajos Katona proposed openstack/neutron-dynamic-routing master: DNM: test master  https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/92061909:28
opendevreviewTakashi Kajinami proposed openstack/neutron-fwaas master: Drop usage of subtransactions=True  https://review.opendev.org/c/openstack/neutron-fwaas/+/92064409:52
opendevreviewTakashi Kajinami proposed openstack/neutron-dynamic-routing master: Drop usage of subtransactions=True  https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/92064509:54
opendevreviewyatin proposed openstack/neutron master: [DNM] check cover job with swap  https://review.opendev.org/c/openstack/neutron/+/92064810:06
opendevreviewMerged openstack/neutron stable/2023.2: Return both project_id when validating auto allocate network  https://review.opendev.org/c/openstack/neutron/+/92048110:22
opendevreviewMerged openstack/ovsdbapp stable/2023.2: Handle IPv6 addresses for LB IP port mappings  https://review.opendev.org/c/openstack/ovsdbapp/+/91514410:29
opendevreviewMerged openstack/ovsdbapp stable/2023.1: Handle IPv6 addresses for LB IP port mappings  https://review.opendev.org/c/openstack/ovsdbapp/+/91514510:43
*** haleyb|out is now known as haleyb13:25
haleyb#startmeeting networking14:00
opendevmeetMeeting started Tue May 28 14:00:16 2024 UTC and is due to finish in 60 minutes.  The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'networking'14:00
haleybPing list: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki, haleyb, ralonsoh14:00
mlavalle\o14:00
elvirao/14:00
obondarevo/14:00
lajoskatonao/14:00
ykarelo/14:00
ihrachyso/14:00
bcafarelo/14:00
slaweqo/14:00
rubasovo/14:01
haleyb#topic announcements14:01
haleybWe are now in Dalmatian release week (R - 18)14:01
haleyb#link https://releases.openstack.org/dalmatian/schedule.html14:01
haleybso libraries have been released14:02
haleybReminder if you have a topic for the drivers meeting on Fridays, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers14:03
haleybI really had no other announcements14:03
lajoskatonaI have one small14:04
haleybsure14:04
lajoskatonaNext Monday is Openinfra Day Budapest: https://oideurope2024.openinfra.dev/hungary/?_ga=2.48816486.198551210.1716904953-1866571429.169392273614:04
lajoskatonaif you have a chance to be there you are my guest to a beer :-)14:04
slaweqI wish to be there but no chance :/14:05
haleybi was just in Europe, but had to come back home, so no beer for me :(14:05
lajoskatonatiming is critical :-)14:05
haleybyes, enjoy the meet-up!14:06
haleybany other announcements?14:07
lajoskatonanot from me, thanks14:07
haleybi actually might be out some of the day if anyone is looking for me14:07
haleyb#topic bugs14:08
haleybi was the deputy last week, here is a link to my report14:08
haleyb#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/JJ5FDIAWXMLG5LGZC4G4E5Y72G26ECFB/14:08
haleybi had a couple of bugs to discuss14:09
haleyb#link https://bugs.launchpad.net/neutron/+bug/206698914:09
haleybVirtual function is being attached to port regardless of the exclude_devices configuration14:09
haleybi asked for more information last week bug nothing yet14:09
haleybdidn't know if someone had seen something like this before or maybe just an edge case?14:10
opendevreviewTakashi Kajinami proposed openstack/neutron-fwaas master: DNM: Run migration tool  https://review.opendev.org/c/openstack/neutron-fwaas/+/92067214:10
haleybok, i'll just wait for submittors response as i don't have any sriov equipment to test on at the moment14:11
haleybnext one14:12
haleyb#link https://bugs.launchpad.net/neutron/+bug/206718314:12
haleybProperly Use Network's DNS Domain in Assignment and DHCP14:12
haleybi know we have been bad at breaking things adding DNS domains before, so wanted to get some eyes on this14:13
haleybthe proposed change is at https://review.opendev.org/c/openstack/neutron/+/92045914:13
mlavalleI'll take a look14:14
haleybmlavalle: thanks14:15
haleybthere was one more bug from me14:16
haleyb#link https://bugs.launchpad.net/nova/+bug/206579014:16
haleybNova fails to live migrate instance with dash separated MAC14:16
haleybneutron doesn't care if you use : or - for a MAC delimiter as both are Ok for netaddr.EUI format14:17
haleybbut it causes an issue in live migration14:17
lajoskatonathis smells like comming from near netaddr 14:17
lajoskatonabut just a quick tip14:17
haleybthe ask was to have neutron always use : but i'd be worried we break something by doing it in the API14:18
haleybplus we'd have to updated every port on a DB upgrade14:19
haleybimo it would be better to document around it by saying : is the way14:19
haleybany opinions on that?14:20
rubasovI have a vague memory of an old neutron bug that made me open this: https://github.com/netaddr/netaddr/issues/25014:22
rubasovbut having a hard time finding the neutron bug itself14:22
haleybinteresting, must have been neutron with the mac prefix14:23
haleybso no opinions, i will have to look at either documenting or forcing to : in some local testing when i have time14:26
haleybi did have another bug to discuss from last week14:27
haleyb#link https://bugs.launchpad.net/neutron/+bug/206582114:27
haleybthis is the cover job failing with "Killed"14:27
haleybi have two updates14:28
haleyb1) reverting the sqlalchemy update makes it go away14:28
haleyb2) running the cover job with --concurrency 4 makes it (usually) go away14:28
haleybi think it was successful 18/20 with that change14:29
haleyband i saw today ykarel proposed a change to use swap which also helped14:29
ihrachysshould we tell mike?..14:29
ykarelyes in swap patch patch 15/15 passed14:31
rubasov(found the old mac address formatting bug (https://bugs.launchpad.net/neutron/+bug/1995732) but the wrongly formatted mac was never returned by the api at that time, so it's not a precedent in any way)14:31
haleybihrachys: yes, we should but i still don't know if it's the root cause and the job has little info14:31
ihrachysmaybe he's aware of something that is expected to raise the memory consumption...14:32
ihrachysI'd recheck a bit more and then pull Mike in; he probably would want to know at least :)14:32
ykareli noticed even with older sqlachemy memory consumption was high when running tests, and with newver versions it increased more and hit the border14:32
haleybi know other jobs can generate much more info in the post state, if we even had ps output it might help14:32
ykarel++ ihrachys 14:32
ihrachyswe have memory tracker logs in devstack jobs; wonder if there's an observable difference there.14:33
haleybykarel: right, if we were near the edge and had 8 threads running could have gone over14:33
ykarelmyself atleast have not checked it in memory tracker devstack logs, but agree it's worth to check14:35
haleybi did not see in job logs unless i looked in the wrong places14:35
ihrachysnot in this job; in devstack jobs14:36
ykarelalso issue is seen only in cover job, not in other unit-tests jobs, so coverage run adding to memory consuption14:36
haleybihrachys: if you have a pointer i'd appreciate it, if i can add something to this job might help (i'll look in devstack repo)14:38
ykarelhaleyb, https://31eb70649c494f0b332d-b9c14e29079b515b3d9c294293d431fb.ssl.cf1.rackcdn.com/917951/2/check/neutron-tempest-plugin-ovn/0a24577/controller/logs/screen-memory_tracker.txt14:39
ykarel^ what ihar referring, and this enabled with a devstack service14:39
ykarelenable_service memory_tracker14:39
haleybah, so maybe a simple change for our testing14:39
haleybykarel++14:39
haleybno karma bot here :(14:39
ykareldirectly would not work as cover job not involve devstack but something similar could be done14:40
ihrachysnot sure if you can enable it in cover job easily; but we could compare mem consumption in tempest jobs with sqla1 and 2 and see if there's a difference in base line / peak for neutron-server.14:40
ykarel+114:40
haleybok, will look later/tomorrow14:41
haleybthanks for the discussion14:41
haleybany other bugs?14:41
haleyb#topic specs14:42
haleybthink jus one open14:42
haleyb#link https://review.opendev.org/c/openstack/neutron-specs/+/89921014:42
haleyblajoskatona: did your comment get addressed?14:42
lajoskatonaI have to check it14:43
lajoskatonawill do it today14:43
haleyback, thanks14:43
haleyb#topic community-goals14:43
haleybnot sure if any progress was made on our goals? didn't see any patches14:44
lajoskatonanot from me14:44
haleybok, thanks for update14:45
slaweqnothing from me neighter this week14:46
haleyback14:46
haleyb#topic on-demand14:46
haleybi had one topic, but will let others go first14:46
haleybok, i'll go then14:47
haleybi noticed last week there was a little frustration that some ML2/OVS changes were taking a long time to get merged14:48
haleyb(sorry for being direct)14:49
haleybi wanted to make sure we do try and spend some time on these changes, even if OVN is the center of most of our attentions14:49
haleybI asked Liu to add things to the wiki that he wanted help prioritizing14:50
haleyb#link https://wiki.openstack.org/wiki/Network/Meetings14:50
ihrachyswe could have a shared dashboard with prioritized patches... :)14:51
haleybwhile we can't go through them all in 10 minutes, if you have knowledge in the areas in these reviews please spend a little time on them14:51
haleybihrachys: i think we have a dashboard like that14:51
haleybi'll just never find it in all these tabs14:52
haleybbut not all of these have priority +214:52
mlavallehttps://review.opendev.org/dashboard/?title=Neutron+Priorities+Dashboard&foreach=(project:openstack/neutron+OR+project:openstack/neutron-lib+OR+project:openstack/neutron-tempest-plugin+OR+project:openstack/python-neutronclient+OR+project:openstack/neutron-specs+OR+project:openstack/networking-bagpipe+OR+project:openstack/networking-bgpvpn+OR+project:openstack/networking-odl14:52
mlavalle+OR+project:openstack/networking-ovn+OR+project:openstack/networking-sfc+OR+project:openstack/neutron-dynamic-routing+OR+project:openstack/neutron-fwaas+OR+project:openstack/neutron-fwaas-dashboard+OR+project:openstack/neutron-vpnaas+OR+project:openstack/neutron-vpnaas-dashboard+OR+project:openstack/os-ken+OR+project:openstack/ovsdbapp)+status:open&High+Priority+Changes=lab14:52
mlavalleel:Review-Priority=2&Priority+Changes=label:Review-Priority=1&Blocked+Reviews=label:Review-Priority=-114:52
mlavalleoops, too long14:52
mlavallesorry14:52
lajoskatonaI can't find it in the docs, but perhaps my grep was leaky14:53
lajoskatonaI have it finally: https://docs.openstack.org/neutron/10.0.1/dashboards/index.html14:54
ihrachyswe can try to review some of these; but long term, ml2/ovs support will necessarily lose a lot of eyeballs - most contributors are from redhat (reviews and commits), and we are dropped ml2/ovs support completely in the next redhat builds. there will be less expertise and less motivation.14:55
haleybihrachys: yes, and canonical defaults to OVN as well, very few running ML2/OVS14:56
lajoskatonaNo this is the correct page: https://docs.openstack.org/neutron/latest/contributor/dashboards/index.html14:56
haleyblajoskatona: yes, thanks, and i do see one of Liu's review topics there14:56
lajoskatonaAt Ericsson we default to OVS mostly at the moment14:57
haleybthe point was that we still have some large deployments running ml2/ovs in China, and they still find bugs there14:57
haleybi just wanted everyone to be aware of the issue14:59
haleybwe are at end of the hour14:59
lajoskatonathanks haleyb, good to discuss such topics in the open15:00
haleybCI meeting will start soon, video this week i believe15:00
haleyb#endmeeting15:00
opendevmeetMeeting ended Tue May 28 15:00:33 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:00
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2024/networking.2024-05-28-14.00.html15:00
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2024/networking.2024-05-28-14.00.txt15:00
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2024/networking.2024-05-28-14.00.log.html15:00
mlavalle\o15:00
lajoskatonao/15:00
ykarelyeap video today15:00
ykarel#startmeeting neutron_ci15:00
opendevmeetMeeting started Tue May 28 15:00:58 2024 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'neutron_ci'15:00
ykarelPing list: bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira15:01
ykarelThis will be video meeting today: https://meetpad.opendev.org/neutron-ci-meetings15:01
mlavalle\o15:01
ykarel#topic Actions from previous meetings15:04
ykarelykarel to check failure in test_virtual_port_host_update_upon_failover functional test15:04
ykarelThe timeout for the check was 10 second but it took over that15:04
ykarellooks specific to slow node as seen high i/o wait around the failure and dstat output not collected for around 12 seconds15:04
ykarel#topic Stable branches15:05
ykarelall good15:05
ykarel#topic Stadium projects15:05
ykarelsfc/bagpipe failures15:05
ykarelhttps://zuul.openstack.org/builds?job_name=openstack-tox-py312&project=openstack/networking-bagpipe15:05
ykarelhttps://zuul.openstack.org/build/9e488f528fa446d187f0c3dfdb3759b215:05
ykarel#action lajoskatona to look at failures at sfc and bagpipe 15:07
ykarel#topic Rechecks15:07
ykarel#topic Unit tests15:08
ykarelcover job in master still fails randomly https://bugs.launchpad.net/neutron/+bug/206582115:08
mlavallehttps://bugs.launchpad.net/neutron/+bug/206740015:09
ykarel#topic fullstack/functional15:10
ykareltest_keepalived_multiple_sighups_does_not_forfeit_primary15:10
ykarelFileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp1wazqa_a/tmpjkdncasq/state_pathxn7q193j/ha_confs/b88f637a-1cd7-477b-b3fd-5e673fb52daa/state'15:10
ykarelhttps://c3380332c392aeb2c300-d82475c388238604ca15d044b3307e59.ssl.cf2.rackcdn.com/920481/1/gate/neutron-fullstack-with-uwsgi/e4302a8/testr_results.html15:10
ykarel#topic Tempest/Scenario15:12
ykareltest_volume_attachment15:12
ykarel Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer15:12
ykarel    https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_abe/periodic/opendev.org/openstack/neutron/master/openstacksdk-functional-devstack-networking/abe567d/testr_results.html15:12
ykarel    https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b07/periodic/opendev.org/openstack/neutron/master/openstacksdk-functional-devstack-networking/b07a577/testr_results.html15:12
ykarel#action ykarel to report lb for volume tests15:13
ykarel#topic Grafana15:13
ykarelhttps://grafana.opendev.org/d/f913631585/neutron-failure-rate15:13
ykarel#topic On Demand15:15
ykarelhttps://review.opendev.org/q/topic:%22ovsdbapp_release%2215:16
opendevreviewTakashi Kajinami proposed openstack/neutron-fwaas master: DNM: Run migration tool  https://review.opendev.org/c/openstack/neutron-fwaas/+/92067215:18
ykarelhttps://review.opendev.org/q/I447990509cdea9830228d3bc92a97062cc57a47215:18
ykarelthx everyone15:20
ykarel#endmeeting15:20
opendevmeetMeeting ended Tue May 28 15:20:27 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:20
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-05-28-15.00.html15:20
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-05-28-15.00.txt15:20
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2024/neutron_ci.2024-05-28-15.00.log.html15:20
opendevreviewLucas Alvares Gomes proposed openstack/neutron-specs master: OVN BGP Agent EVPN Advertisement API Extension  https://review.opendev.org/c/openstack/neutron-specs/+/92068115:21
lajoskatonao/15:21
opendevreviewJay Jahns proposed openstack/neutron master: Add network dns_domain to dns assignment if present  https://review.opendev.org/c/openstack/neutron/+/92045915:26
ihrachyshaleyb just realized that one doesn't get into the bug deputy list automatically; you can add me to the list15:30
opendevreviewRoberto Acosta proposed openstack/neutron master: [ML2/OVN] Add external_ids key for Static Routes  https://review.opendev.org/c/openstack/neutron/+/90748915:33
opendevreviewRoberto Acosta proposed openstack/neutron master: [ML2/OVN] Add external_ids key for Static Routes  https://review.opendev.org/c/openstack/neutron/+/90748915:36
haleybihrachys: i can add you at the end, looks like it would be first week of September15:44
ihrachysworks for me, thanks haleyb 15:45
racostalajoskatona, haleyb, Do you know if this topic will be discussed this Friday?  https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/ZRDT2W53GWSB5DPCDGW6CJWFULSGKU6Z/#ZRDT2W53GWSB5DPCDGW6CJWFULSGKU6Z15:50
racostaI don't know if Christian reached any conclusion about this RFE...15:51
opendevreviewBrian Haley proposed openstack/neutron master: DNM: Debug cover job failure  https://review.opendev.org/c/openstack/neutron/+/92015016:09
ykarelhaleyb, when you get chance https://review.opendev.org/q/topic:%22ovsdbapp_release%2216:14
ykarelthx in advance16:17
opendevreviewBrian Haley proposed openstack/neutron master: DNM: Debug cover job failure  https://review.opendev.org/c/openstack/neutron/+/92015016:18
opendevreviewBrian Haley proposed openstack/neutron master: DNM: Debug cover job failure  https://review.opendev.org/c/openstack/neutron/+/92015017:28
lajoskatonaracosta: it is in the agenda: https://wiki.openstack.org/wiki/Meetings/NeutronDrivers#Agenda, so if we have enough people to discuss I suppose we can discuss it17:46
lajoskatonahaleyb: -----------------^17:46
racostaack17:50
opendevreviewRoberto Acosta proposed openstack/neutron master: [RFE] [OVN] - IPv6 Distributed routing  https://review.opendev.org/c/openstack/neutron/+/86751318:45
opendevreviewJay Jahns proposed openstack/neutron master: Add network dns_domain to dns assignment if present  https://review.opendev.org/c/openstack/neutron/+/92045923:13
opendevreviewJay Jahns proposed openstack/neutron master: Add network dns_domain to dns assignment if present  https://review.opendev.org/c/openstack/neutron/+/92045923:15
opendevreviewJay Jahns proposed openstack/neutron master: Add network dns_domain to dns assignment if present  https://review.opendev.org/c/openstack/neutron/+/92045923:16
opendevreviewJay Jahns proposed openstack/neutron master: Add network dns_domain to dns assignment if present  https://review.opendev.org/c/openstack/neutron/+/92045923:18

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!