Tuesday, 2022-04-12

supamatti would be really nice to get this merged soon, https://review.opendev.org/c/openstack/neutron-vpnaas/+/76535300:23
supamatt*it would be00:24
supamattUsing this now and haven't had any issues so far00:24
opendevreviewJakub Libosvar proposed openstack/neutron master: DNM WIP: Don't register config options on imports  https://review.opendev.org/c/openstack/neutron/+/83739200:44
opendevreviewZhouHeng proposed openstack/neutron master: [ovn]Set NB/SB "connection" inactivity probe support multi addresses  https://review.opendev.org/c/openstack/neutron/+/82526901:34
opendevreviewZhouHeng proposed openstack/neutron-fwaas master: [CI]Remove lower-constraints testing  https://review.opendev.org/c/openstack/neutron-fwaas/+/83641902:00
opendevreviewZhouHeng proposed openstack/neutron master: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/82542802:52
opendevreviewZhouHeng proposed openstack/neutron master: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/82542803:01
opendevreviewyatin proposed openstack/neutron stable/yoga: Enable dstat and memory_tracker in functional/fullstack jobs  https://review.opendev.org/c/openstack/neutron/+/83732804:26
opendevreviewyatin proposed openstack/neutron master: [DNM] multinode ovn grenade with ovs/ovn source  https://review.opendev.org/c/openstack/neutron/+/83745404:38
opendevreviewyatin proposed openstack/neutron master: Also add B324 to bandit skip list for python3.9+  https://review.opendev.org/c/openstack/neutron/+/83746206:54
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Refactor session "is_active" handling for sqlalchemy-20  https://review.opendev.org/c/openstack/neutron-lib/+/82873807:19
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove _create_network & _log_console_output  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83749507:28
*** zhouhenglc_ is now known as zhouhenglc07:48
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Increase code coverage  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/83736907:54
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Increase code coverage  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/83736908:27
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Increase code coverage  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/83736908:31
opendevreviewFernando Royo proposed openstack/networking-ovn stable/train: Increase code coverage  https://review.opendev.org/c/openstack/networking-ovn/+/83750709:14
opendevreviewFernando Royo proposed openstack/ovn-octavia-provider stable/ussuri: Increase code coverage  https://review.opendev.org/c/openstack/ovn-octavia-provider/+/83736909:15
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove _get_server_port_id_and_ip4 & check_floating_ip  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83750809:16
opendevreviewBernard Cafarelli proposed openstack/neutron stable/yoga: [stable/yoga] Drop -master jobs  https://review.opendev.org/c/openstack/neutron/+/83751009:25
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: Make _create_loginable_secgroup_rule public  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751109:33
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Make _create_loginable_secgroup_rule public  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751109:36
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Replace security groups related methods  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751309:41
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove setup_clients method  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751709:47
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [fwaas] Remove secgroup creation related methods  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751910:03
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [fwaas] Remove create_server & _create_network  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83752010:07
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [fwaas] Remove _log_console_output & ping_ip_address  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83752110:10
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove _get_server_port_id_and_ip4 & create_floating_ip  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83750810:17
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Make _create_loginable_secgroup_rule public  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751110:17
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Replace security groups related methods  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751310:17
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove setup_clients method  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751710:17
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [fwaas] Remove _get_server_port_id_and_ip4 & create_floating_ip  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83754510:19
opendevreviewRodolfo Alonso proposed openstack/neutron master: [WIP][OVN] Handle OVN agents when "Chassis" register is deleted  https://review.opendev.org/c/openstack/neutron/+/81813210:26
ykarelslaweq, lajoskatona do you know in which job vzctl will be used? context https://review.opendev.org/c/openstack/neutron/+/82225310:59
ykarel^ has broken arm64 unit test jobs, likely fips functional tests job will also be broken running on centos11:00
slaweqykarel: in u/s I'm not sure if it will be as we don't have scenario test for ndproxy11:00
ykarelsorry centos job will not be broken as platform:dpkg is specified, so only ubuntu arm64 jobs are broken11:01
opendevreviewFernando Royo proposed openstack/networking-ovn stable/train: Increase code coverage  https://review.opendev.org/c/openstack/networking-ovn/+/83750711:01
opendevreviewFernando Royo proposed openstack/networking-ovn stable/train: Increase code coverage  https://review.opendev.org/c/openstack/networking-ovn/+/83750711:02
ykarelslaweq, ok then will propose to remove it from bindep.txt and in future can be handled based on where it will be used11:06
opendevreviewyatin proposed openstack/neutron master: Drop vzctl dep from bindep package list  https://review.opendev.org/c/openstack/neutron/+/83755211:10
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Replace security groups related methods  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751311:31
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Replace security groups related methods  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751311:33
opendevreviewRoman Popelka proposed openstack/neutron-tempest-plugin master: [bgpvpn] Remove setup_clients method  https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83751711:33
opendevreviewyatin proposed openstack/neutron master: ovn migration: Fix check for stack name  https://review.opendev.org/c/openstack/neutron/+/83578611:47
lajoskatonaslaweq, ykarel: hi, api tests are on the pipe for NDP proxy: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/82779112:05
ykarellajoskatona, and those tests will need vzctl?12:10
ykarelanyway devstack jobs i think don't use bindep.txt12:10
opendevreviewFernando Royo proposed openstack/networking-ovn stable/train: Increase code coverage  https://review.opendev.org/c/openstack/networking-ovn/+/83750712:10
lajoskatonaykarel: let me check12:18
slaweqlajoskatona: obondarev can You maybe +W https://review.opendev.org/c/openstack/neutron/+/826872 ?13:07
slaweqthx in advance13:07
obondarevsure13:07
slaweqthx13:08
slaweqcan You also look at https://review.opendev.org/c/openstack/neutron/+/834171 when You will have some time?13:08
slaweqralonsoh: bcafarel can one of You +W https://review.opendev.org/c/openstack/neutron/+/833205 ?13:10
slaweqthx in advance13:10
ralonsohsure13:10
slaweqthx13:13
slaweqralonsoh: lajoskatona can one of You also check https://review.opendev.org/q/Ia082f8531ffcc1599206124774599dcdb500274a ?13:13
slaweqthx in advance13:13
bcafarellooking13:21
opendevreviewDaniel Alvarez proposed openstack/neutron master: [ovn][migration] Leave VIF details untouched  https://review.opendev.org/c/openstack/neutron/+/83756613:25
*** dasm|off is now known as dasm13:25
ralonsohslaweq, bcafarel https://review.opendev.org/q/I7c36b09309c1ef66608afacfb281b6f4b06ea5b813:34
ralonsohslaweq, ^ this is your payback hehehe13:34
lajoskatonaslaweq: sure13:34
lajoskatonaralonsoh: sure for that one also :-)13:34
ralonsohhehehe thanks13:34
slaweqralonsoh: sure13:35
lajoskatonaslowly gain on things around me13:35
bcafarelralonsoh: ack, also looking at that set then13:36
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Refactor session "is_active" handling for sqlalchemy-20  https://review.opendev.org/c/openstack/neutron-lib/+/82873813:55
lajoskatona#startmeeting networking14:00
opendevmeetMeeting started Tue Apr 12 14:00:23 2022 UTC and is due to finish in 60 minutes.  The chair is lajoskatona. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'networking'14:00
mlavalle o/14:00
lajoskatonaHi14:00
obondarevhi14:00
slaweqhi14:01
lajoskatonaLet's start14:02
lajoskatona#topic Announcements14:02
lajoskatonaZed schedule: https://releases.openstack.org/zed/schedule.html14:02
lajoskatonaand the usual release countdown mail:  R-25: http://lists.openstack.org/pipermail/openstack-discuss/2022-April/028102.html14:02
lajoskatonabut what is more interesting: Zed folder is ready: https://review.opendev.org/c/openstack/releases/+/83617514:03
lajoskatonaso we can release :-)14:03
ralonsohhello14:03
lajoskatonaHi ralonsoh14:03
lajoskatonafor ovsdbapp a new version is already out14:03
lajoskatonabefore the PTG we discussed to release on older branches also, I will check this week14:04
lajoskatonaDo you have comments for the announcements or releases?14:05
slaweq++ for releases of older branches too14:05
lajoskatona#topic Community Goals14:06
lajoskatonaI just would like to touch this topic to summarize what happened last week on the TC discussions14:07
lajoskatonaWe have 2 goals if I understand well:14:07
lajoskatonaone is the SRBAC14:07
lajoskatonaand the other is the sqlalchemy 2.0, am I right?14:07
ralonsohI think so14:08
mlavallewhat's the S in SRBAC?14:08
lajoskatonaok, thanks14:08
slaweq"Secure"14:08
slaweqmlavalle: ^^14:09
mlavallethanks14:09
slaweqsqlalchemy will not be community goal14:09
slaweqbut we have 214:09
slaweqSecure RBAC14:09
slaweqand FIPS14:09
lajoskatonasalweq: ok, I forgot FIPS14:10
lajoskatonawith that we are good, we have jobs already for that14:10
slaweqfor FIPS we should be good as we have CI jobs in periodic queue already14:10
slaweqscenario are even run on Centos 914:10
slaweqand seems to be ok14:10
slaweqfor SRBAC I have patch https://review.opendev.org/c/openstack/neutron/+/83714014:10
lajoskatonaslaweq: thanks, sounds good14:11
slaweqafter which I think we should be able to test together with Nova team14:11
slaweqI will sync with gmann on that when this patch will be merged14:11
lajoskatonaslaweq: ok, 14:11
lajoskatonaOk, we can move on then, and if we need any more attention (like review priority) let's discuss it14:13
slaweqsure14:13
slaweqthx14:13
lajoskatonathanks for the feedback for the goals14:13
lajoskatona#topic Bugs14:13
lajoskatonaReport from rubasov: http://lists.openstack.org/pipermail/openstack-discuss/2022-March/027944.html14:13
lajoskatonarubasov is on PTO14:14
lajoskatonafew bugs which need some attention as rubasov has no background on them:14:14
lajoskatonaovn-octavia-provider does not report status correctly to octavia #link https://bugs.launchpad.net/neutron/+bug/196577214:14
lajoskatonaovn-octavia-provider associates to wrong logical router when LogicalRouterPortEvent is fired and network has multiple routers #link https://bugs.launchpad.net/neutron/+bug/196605214:14
lajoskatonaI will try to fetch ltomasbo ifhe can check these 214:15
lajoskatonaok, next week: ralonsoh: http://lists.openstack.org/pipermail/openstack-discuss/2022-April/027993.html14:15
lajoskatonaand the final report: from lucasgomes http://lists.openstack.org/pipermail/openstack-discuss/2022-April/028124.html14:16
lajoskatona[OVN] External subscribers to feed generated in Openstack fails if no internal VM is subscribed to that feed first #link https://bugs.launchpad.net/neutron/+bug/196799614:16
lajoskatonaI listed it here because it is interesting as lucasgomes wrote as comment that this is a core OVN bug14:17
lajoskatonaI am just wandering if we can have some more official contact with OVN or OVS community?14:17
ralonsohwe just drop questions in the OVS/OVN mailing list14:18
ralonsohand we have core developers in contact with the community14:18
ralonsohbut this is from RH point of view...14:19
lajoskatonaralonsoh: yeah that was my feeling :-)14:19
lajoskatonait is not frequesnt as I see that we have bugs like this that the soultion is in core OVS or in OVN, so perhaps we can live without it14:20
lajoskatonaok, let's keep it in mind and if things go wrong direction let's check it14:21
lajoskatonaand another hyper interesting bug: Doc needed for configuring neutron AZs for edge #link https://bugs.launchpad.net/neutron/+bug/196805714:21
lajoskatonathis is the Redhat downstream bug for edge deplyoment14:21
lajoskatonawe discussed last week with designate team14:21
lajoskatonathanks for it14:21
mlavalleI'll keep an eye on that one14:22
lajoskatonamlavalle: thanks, I will check also14:23
lajoskatonaactually thats all for bugs from me, if you have nothing to add14:23
lajoskatonaThis week jlibosva is the deputy, and next week obondarev will be the deputy14:24
lajoskatona#topic On Demand Agenda14:25
lajoskatonaI have one small thing to share for outreachy14:25
lajoskatonathere's somebody who would like to work on the neutron project14:25
lajoskatona#link https://bugs.launchpad.net/neutron/+bug/187031914:25
mlavallethat's good news14:26
lajoskatonathis afternoon I hope I can meet with her (i think) and check where we can start the mentoring :-)14:26
mlavallewhere or when?14:26
lajoskatonabut I got another mail today that somebody else also interested, so have to check the process with outreachy organizers :-)14:27
slaweq\o/14:27
lajoskatonamlavalle: 16:00 UTC google meet14:27
bcafarelneutron is trending :)14:27
ralonsoh+114:27
lajoskatonaexactly14:27
lajoskatonaand that's it from me for today14:28
mlavallelajoskatona: what I meant is when is the intern expected to start working with us?14:28
opendevreviewSlawek Kaplonski proposed openstack/neutron master: Remove "allow_overlapping_ips" config option  https://review.opendev.org/c/openstack/neutron/+/83728614:29
lajoskatonamlavalle: I have to check that also, but asked about possible task, and started devstack so I suppose now14:29
mlavalleack14:29
lajoskatonaok if nothing more, let's close for today14:30
lajoskatona#endmeeting14:30
opendevmeetMeeting ended Tue Apr 12 14:30:42 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:30
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-12-14.00.html14:30
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-12-14.00.txt14:30
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2022/networking.2022-04-12-14.00.log.html14:30
mlavalleo/14:30
lajoskatonaBye14:30
obondarevo/14:30
ralonsohbye14:30
slaweqo/14:31
bcafarellajoskatona: for ovn-octavia-provider bugs you can also ping froyo (ltomasbo may be hard to catch the next few weeks)14:32
bcafarel(sorry just catching up on meeting)14:32
froyolajoskatona, sorry I lose some msgs from channel, ping me if you need any help14:34
opendevreviewDaniel Alvarez proposed openstack/neutron master: [ovn][migration] Leave VIF details untouched  https://review.opendev.org/c/openstack/neutron/+/83756614:36
fricklerwasn't there an issue recentish with duplicate address errors for the IPv6 metadata address? someone asked in #openstack and I fail to find the matching bug14:54
lajoskatonabcafarel: thanks14:54
opendevreviewMerged openstack/neutron master: [quota] Enable ``DbQuotaDriverNull`` as a production driver  https://review.opendev.org/c/openstack/neutron/+/82787514:55
lajoskatonafroyo: Hi, if you can check 2 recent bugs for ovn-octavia-provider: https://bugs.launchpad.net/neutron/+bug/1965772 & https://bugs.launchpad.net/neutron/+bug/196605214:55
froyolajoskatona: sure, I'll take a look14:55
lajoskatonafroyo: thanks14:56
slaweq#startmeeting neutron_ci15:00
opendevmeetMeeting started Tue Apr 12 15:00:26 2022 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'neutron_ci'15:00
slaweqhi15:00
ralonsohhi15:00
slaweqGrafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=115:00
mlavalleo/15:01
lajoskatonao/15:01
bcafarelo/15:02
slaweqok, I think we can start15:02
slaweq#topic Actions from previous meetings15:03
ykarelo/15:03
slaweqwe have pretty long list of action items from last time15:03
slaweq    mlavalle will continue work on https://bugs.launchpad.net/neutron/+bug/194528315:03
mlavalleI haven't found instances of that in openserach15:03
mlavalleopensearch15:03
mlavallemaybe I don't know how to use it well, yet15:04
mlavalleI'll keep searching and querying15:04
slaweqok15:05
slaweqnext one15:06
slaweqslaweq to add extra logs to fullstack tests to investigate https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_366/830623/1/check/neutron-fullstack-with-uwsgi/366febd/testr_results.html15:06
slaweq    Patch https://review.opendev.org/c/openstack/neutron/+/83407015:06
slaweqnext one15:07
slaweq    slaweq to continue investigation on nova-neutron notifications issue https://bugs.launchpad.net/neutron/+bug/196389915:07
slaweq    Fix merged  https://review.opendev.org/c/openstack/neutron/+/83485215:07
slaweqnext one15:07
slaweqlajoskatona to create yoga templates in neutron-tempest-plugin jobs15:07
lajoskatonathat is merged15:08
slaweqgreat, thx15:08
slaweqnext one15:08
slaweqmlavalle to add note about rechecking with reason15:08
mlavalleworking on this15:08
mlavalleI'll finish this week15:09
slaweqok15:09
lajoskatonacool15:09
slaweq#action mlavalle to add note about rechecking with reason15:09
slaweqnext one15:09
slaweqralonsoh to propose patch to run mysql functional tests in serial15:09
ralonsohmerged15:09
slaweqgreat15:10
slaweqnext one15:10
slaweq    slaweq to investigate "inprogress" tests which are interrupted somehow https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a75/833620/4/check/neutron-functional-with-uwsgi/a75e59b/testr_results.html15:10
slaweq    Bug reported https://bugs.launchpad.net/neutron/+bug/196639415:11
slaweq    Patch https://review.opendev.org/c/openstack/neutron/+/836426 merged, but we also have now https://review.opendev.org/c/openstack/neutron/+/836120/ so we can investigate memory usage a bit more15:11
slaweqand the last one from my list15:11
slaweq    slaweq to report bug about https://12ef4cf37bb4f9cf8615-49968699300828e6c9b78fd54dff75ef.ssl.cf5.rackcdn.com/828687/8/gate/neutron-functional-with-uwsgi/3688faf/testr_results.html15:11
slaweq    Bug https://bugs.launchpad.net/neutron/+bug/196603515:11
slaweqobondarev is investigating that (at least trying to)15:12
slaweqand that's all actions from last meeting15:12
slaweqI think we can move on to the next topic now15:12
slaweq#topic Stable branches15:12
slaweqany updates bcafarel ?15:12
bcafarellajoskatona++ quickly fixed yoga branch last week, the rest is in good shape15:13
bcafarelvictoria is going EM soon I have to check the pending backports to get a last release15:13
lajoskatona++15:13
slaweqok15:13
slaweqso we should also tag neutron-tempest-plugin for victoria when it will go EM15:14
bcafarelgreat point yes indeed!15:14
lajoskatonaisn't that done together with tempest?15:14
slaweqlajoskatona: I'm not sure15:14
lajoskatonaI can check with kopecmartin or gmann15:14
slaweqthx lajoskatona 15:15
slaweq#action lajoskatona to check with QA team if neutron-tempest-plugin tag for victoria EM will be done together with tempest15:15
lajoskatona+115:15
gmannack, I will plan that for tempest this week sometime.15:16
slaweqthx gmann 15:16
lajoskatonathanks15:16
slaweqok, I think we can move on now15:16
slaweq#topic Stadium projects15:17
slaweqlajoskatona: any updates here?15:17
slaweqI checked weekly jobs today15:17
slaweqhttps://zuul.openstack.org/buildsets?project=openstack%2Fnetworking-sfc&project=openstack%2Fnetworking-bagpipe&project=openstack%2Fnetworking-bgpvpn&project=openstack%2Fnetworking-odl&project=%09openstack%2Ftap-as-a-service&project=openstack%2Fneutron-vpnaas&project=openstack%2Fneutron-dynamic-routing&branch=master&pipeline=periodic-weekly&skip=015:17
slaweqand it seems that py39 job in networking-odl is failing15:17
slaweq https://zuul.openstack.org/build/0412f7ed782d400598fe51a08949b08e15:17
slaweqdo You know about it?15:17
lajoskatonaI have tocheck that15:17
lajoskatonaanother thing is that mnaser would like to work on vpnaas issues15:18
lajoskatonaI have to check with him what does this mean15:18
slaweqthat's good news15:18
mnaseryeah, i can try and have a look at it, we use it in prod and we have a few atches we're running with locally (that are proposed upstream but would like to have them landed)15:18
slaweq#action lajoskatona to check failing py39 job in networking-odl15:18
lajoskatonamnaser: thanks15:19
bcafarelthat's good news15:19
slaweqanything else regarding stadium projects' CI?15:20
lajoskatonamnaser: would be good to have somebody who can check time-to-time if the jobs are passing or if there's new bugs15:20
slaweqor can we move on?15:20
lajoskatonaI think we can15:20
mnaserlajoskatona: i will try and make that effort, as long as i can get +2's and +W's in return :)15:20
slaweqmnaser: sure :)15:20
slaweqthx15:20
mlavallemnaser: I'll help with that15:20
mnaser+115:21
mlavallewill it be you submitting the patches?15:21
mlavallemnaser: ^^^15:21
mnasermlavalle: probably yeah, at least to fix the func jobs15:21
lajoskatonamnaser: we can add you I suppose to the core group for vpnaas also15:21
mnaseri'd be okay with that too, i think it would be also good to clear up the backlog of stuff there15:22
mlavallestill, he cannot +2 +W himself15:22
lajoskatonamlavalle: that's true, but more eyes on hanging patches15:23
mlavalle+115:23
lajoskatonawe can discuss that offline, and continue the ci meeting I think, sorry15:23
mnaser+115:23
slaweqsure, no problem at all :)15:23
slaweqok, lets move one with CI meeting then15:24
slaweq#topic Grafana15:24
slaweqhttps://grafana.opendev.org/d/f913631585/neutron-failure-rate15:24
slaweqit seems for me that still our biggest problem is functional tests job in check queue :/15:24
slaweqand in gate queue too15:25
ralonsohmost of these failures are due to pyroute215:25
lajoskatonaralonsoh: do we have to use new version?15:26
slaweqI saw many failures related to the timeout while waiting on the transition of the router15:26
ralonsohwe should merge your retry patch15:26
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/83301515:27
lajoskatonaahh, ok, I forgot that, and thought it is merged :-)15:28
slaweqapproved :)15:28
ralonsohslaweq, btw, I'm working on a patch to replace the keepalived-state-change monitor15:28
ralonsohinstead of using a python binary15:28
ralonsohto use a shell script15:28
slaweqralonsoh: great, I hope that will help too15:28
ralonsoh(but I didn't have time to continue wiht that)15:28
slaweqbecause that job is basically killing us currently15:28
slaweqshould we maybe mark those l3 ha tests as unstable temporary?15:29
slaweqto make job more stable15:29
slaweqwdyt?15:29
ralonsohI wouldn't15:29
ralonsohit is not blocking completely the CI15:29
slaweqcompletly no, but number of rechecks is going high15:29
ralonsohok then15:30
slaweqok, maybe it's not that bad yet15:30
slaweqso lets wait for next week15:30
mlavalle+115:32
slaweqok, so for functional job failures, list of examples is in the etherpad https://etherpad.opendev.org/p/neutron-ci-meetings#L6715:33
slaweqbut most of them (or even all) are related to those pyroute2 issues, like e.g.:15:34
slaweqhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_170/836120/5/gate/neutron-functional-with-uwsgi/1701f9a/testr_results.html15:34
slaweqhttps://b5e0246d2a61241093f5-52f9a55e019565a745f2bb8d45b0d6fa.ssl.cf1.rackcdn.com/836725/2/check/neutron-functional-with-uwsgi/ad2bdce/testr_results.html15:34
slaweqor to the issue with router transition to primary state:15:34
slaweq    https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_868/835786/1/check/neutron-functional-with-uwsgi/8688fff/testr_results.html15:34
slaweq    https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_0e9/837146/1/check/neutron-functional-with-uwsgi/0e9f5a8/testr_results.html15:34
slaweqso I think we can move on to the next topic now15:35
slaweq#topic Tempest/Scenario15:35
slaweqhere I (again) found one old issue with linuxbridge job:15:36
slaweqhttps://4de9725805f5e105f3a0-621008116cc26c58a3190713e2eda213.ssl.cf1.rackcdn.com/836863/3/check/neutron-tempest-plugin-scenario-linuxbridge/95dd563/testr_results.html15:36
slaweqfailed to transition device to DOWN state15:36
slaweqI think lajoskatona was trying to fix it some time ago15:36
slaweqright lajoskatona ?15:36
lajoskatonaslaweq: yeah, I think I remember15:37
slaweqnow, giving what we discussed during ptg, should we simply skip that test in the linuxbridge job?15:37
slaweqwdyt?15:37
lajoskatona+115:38
slaweqok, I will propose patch for that15:38
ralonsohwith a NOTE15:38
ralonsohmaybe we should add this to the docs first15:38
lajoskatonathis is the patch for the above issue I think: https://review.opendev.org/c/openstack/neutron/+/827728 I have to check it again when I have some time15:38
slaweq#action slaweq to skip failing linuxbridge scenario test15:38
ralonsohjust the warning15:38
slaweqralonsoh: sure15:38
ralonsohperfect15:38
lajoskatona+115:38
slaweqI also started patch https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83691215:39
slaweqto remote neutron-tempest-plugin-api job and run those tests in the "scenario" jobs15:39
slaweqbut it's not ready yet15:39
slaweqI need to check why some tests are failing there15:39
slaweqbut please be ready for review of it soon :)15:40
ralonsohsure15:40
slaweqok, and last topic from me today15:40
slaweq#topic Periodic15:40
slaweqJobs results: http://zuul.openstack.org/buildsets?project=openstack%2Fneutron&pipeline=periodic&branch=master15:40
mlavallespeaking of tempest, if you have a chabce, review https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/83441115:40
slaweqwe do have couple of issues to investigate there15:40
mlavalleit's an easy one15:40
slaweqsure mlavalle 15:40
slaweqgetting back to periodic15:41
slaweqneutron-ovn-tempest-ovs-master-fedora - broken again15:41
slaweqanyone wants to check it?15:41
slaweq:)15:41
mlavalleagain15:41
slaweqand the same for neutron-ovs-tempest-slow15:41
mlavalleI'll look at it15:41
slaweqmlavalle: thx15:41
slaweq#action mlavalle to check neutron-ovn-tempest-ovs-master-fedora periodic job15:42
slaweqso I will check neutron-ovs-tempest-slow15:42
slaweq#action slaweq to check neutron-ovs-tempest-slow periodic job15:42
slaweqthere is also "propose-translation-update" which has some problem with pyroute2 version15:42
slaweqhttps://zuul.openstack.org/build/8a44d67db5474acdb1cfce78d4ba04cd15:42
slaweqanyone have cycles to check it this week?15:43
ykareli can check15:43
slaweqthx ykarel 15:43
slaweq#action ykarel to check failing propose-translation-update periodic job15:43
slaweqok, and that's all what I had for today15:44
slaweqdo You have any other topics to discuss today?15:44
ralonsohah, this is the doc/requirements.txt file15:44
slaweqif not, I will give You few minutes back15:44
mlavallewell, not a short one but we didn't get to the top of the hour15:44
mlavallenot bad15:44
ralonsohjust one little topic15:44
ralonsohhttps://review.opendev.org/c/openstack/neutron-lib/+/828738/18/.zuul.yaml15:44
ralonsohthis is an example15:44
ralonsohI know we are always talking about reducing CI jobs15:44
ralonsohbut having tempest jobs in n-lib is very useful15:45
slaweqI agree15:45
ralonsohdo you agree with adding them to the n-lib zuul deifnition?15:45
slaweqthat's why we added neutron-tempest-plugin-api job there some time ago15:45
slaweqbut if You think that adding scenario jobs too also make sense, I'm ok with that15:45
mlavalleme too15:45
ralonsohI can add only OVS native and OVN15:46
lajoskatonaagree15:46
ralonsohskipping hybrid and Linux Bridge15:46
ralonsohperfect15:46
ykarel+115:46
ralonsohthanks a lot15:46
slaweqactually if You will remove neutron-tempest-plugin-api from check queue in that Your patch, it will help me with my "consolidation" patch :)15:46
mlavallewe should try to reduce the number of jobs but not to the point where we are opening holes15:46
mlavallein our testing15:46
ralonsohperfect15:46
slaweq#action ralonsoh to add neutron-tempest-plugin jobs to the neutron-lib CI15:47
slaweqthx ralonsoh for bringing it up15:47
ykarelsmall one: https://review.opendev.org/c/openstack/neutron/+/837552 to fix arm64 unit test jobs15:47
lajoskatonaykarel: I try to check if the pkg is needed for the API tests for NDP proxy15:48
lajoskatonabut let's remove it from bindep.txt now15:48
ykarellajoskatona, yes bindep.txt is not getting used in devstack jobs, so i think it's fine15:49
ralonsohhold on15:49
ralonsohok, but it is better to have an explanation from the commiter15:50
* mlavalle just W+ it15:50
lajoskatonaralonsoh: you mean from NDP proxy dvelopers?15:50
ralonsohI think this is a leftover, this is not needed for NDP, if I'm not wrong15:51
ralonsohin any case, this is a feature in development now15:51
ralonsohwe can read it if needed15:51
slaweq++15:51
lajoskatonaok, ack15:52
slaweqok, I think that with this we can conclude the meeting for today :)15:52
slaweqthx for attending15:52
ralonsohbye!15:52
mlavalleo/15:53
slaweqhave a great week and see You online15:53
lajoskatonabye15:53
slaweq#endmeeting15:53
opendevmeetMeeting ended Tue Apr 12 15:53:13 2022 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:53
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-12-15.00.html15:53
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-12-15.00.txt15:53
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2022/neutron_ci.2022-04-12-15.00.log.html15:53
bcafarelo/15:55
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Add "neutron-tempest-plugin-api" to CI  https://review.opendev.org/c/openstack/neutron-lib/+/83759016:01
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Refactor session "is_active" handling for sqlalchemy-20  https://review.opendev.org/c/openstack/neutron-lib/+/82873816:02
ironfootHas anybody seen something like this before in their dhcp agents?16:13
ironfoot    neutron.agent.linux.ip_lib.AddressNotReady: Failure waiting for address fe80::a9fe:a9fe to become ready: Duplicate address detected16:13
ironfoot 16:13
ironfootI've heard there was once a bug with metadata agent and HA, but I can't find anything16:13
ralonsohironfoot, only with this little information, I'll say the problem is when spawning the metadata proxy16:18
ralonsohhttps://github.com/openstack/neutron/blob/master/neutron/agent/metadata/driver.py#L265-L27116:18
ironfootapologies, was trying to see if this was something people knew about, as it was mentioned in other channel.16:29
ironfootThis is a "regular" xena deployment using kolla, with 3 network nodes. Currently trying to debug why dhcp stops working on some networks, disabling and enabling dhcp on these networks works for some time.16:29
opendevreviewMerged openstack/neutron stable/train: Check whether vxlan group and local addresses are IPv4 or IPv6  https://review.opendev.org/c/openstack/neutron/+/83320516:31
opendevreviewMerged openstack/neutron master: [API] Return 403 for POST requests when user is not authorized  https://review.opendev.org/c/openstack/neutron/+/83417116:31
ironfootI noticed this  error in the logs, but doesn't look related. All neutron agents seem up and happy. So, trying to understand if:16:32
ironfoot- this issue is really bad16:32
ironfoot- what is causing it16:32
ralonsohironfoot, we need more information. Please, open a LP bug and upload all the logs16:39
ralonsohnot only a small snippet16:39
ralonsohbut the whole files16:39
ralonsohironfoot, this could be only a exception message during the wait process16:40
ralonsohthat means this is not bad at all16:40
haleybralonsoh: DAD failures should persist until address is removed/re-added, I actually wonder if your IPv6 fix for MLD would help here? Either way a bug would be a first step16:45
ralonsohhaleyb, what fix?16:46
*** dmellado_ is now known as dmellado16:46
haleybralonsoh: i thought you had a fix to drop IPv6 packets in HA routers16:58
ralonsohhaleyb, https://review.opendev.org/c/openstack/neutron/+/83619816:58
ralonsohbut this is not related16:58
haleybi must be thinking of a different patch16:59
opendevreviewRodolfo Alonso proposed openstack/neutron-lib master: Add "neutron-tempest-plugin-jobs" to CI  https://review.opendev.org/c/openstack/neutron-lib/+/83759017:34
opendevreviewMerged openstack/neutron stable/victoria: When creating a VXLAN interface, a device is mandatory  https://review.opendev.org/c/openstack/neutron/+/83320618:11
lajoskatonamnaser: Hi, back to vpnaas18:26
lajoskatona mnaser: so Neutron team regularly checks neutron-vpnaas as it is a stadium, we try to keep the CI also green, but the problem now is that nobody remained who can touch the failing tests18:27
lajoskatonamnaser: so if you can give that know-how let's say and the team can give the usual make it in a shape stuff that would be great18:29
mnaserlajoskatona: yeah i have played enough with it to be able to at least unblock the gate and keeps things 'moving'18:58
lajoskatonamnaser: cool, could you reply my mail to make it visible for the community (perhaps let's wait a little more and hope that other operators come and invest to keeping their favorite project alive)19:01
opendevreviewMerged openstack/neutron stable/xena: Force security_group_id uuid validation of sg rules  https://review.opendev.org/c/openstack/neutron/+/83730919:11
opendevreviewMerged openstack/neutron stable/wallaby: Force security_group_id uuid validation of sg rules  https://review.opendev.org/c/openstack/neutron/+/83733019:13
opendevreviewMerged openstack/neutron stable/victoria: Force security_group_id uuid validation of sg rules  https://review.opendev.org/c/openstack/neutron/+/83733219:25
opendevreviewMerged openstack/neutron stable/ussuri: Force security_group_id uuid validation of sg rules  https://review.opendev.org/c/openstack/neutron/+/83733319:25
opendevreviewJakub Libosvar proposed openstack/neutron master: DNM WIP: Don't register config options on imports  https://review.opendev.org/c/openstack/neutron/+/83739219:34
opendevreviewJakub Libosvar proposed openstack/neutron master: [ovn][migration] Leave VIF details untouched  https://review.opendev.org/c/openstack/neutron/+/83756619:44
opendevreviewMerged openstack/neutron stable/train: Clean duplicated QoS bandwidth related methods in ovs_lib module  https://review.opendev.org/c/openstack/neutron/+/83594819:53
opendevreviewMerged openstack/neutron stable/train: Fix ingress bandwidth limit in the openvswitch agent  https://review.opendev.org/c/openstack/neutron/+/83594919:57
opendevreviewMerged openstack/neutron stable/train: Ensure that re_added ports are DOWN before set back to UP  https://review.opendev.org/c/openstack/neutron/+/83633220:04
opendevreviewMerged openstack/neutron master: Add retry for privsep get_link_devices  https://review.opendev.org/c/openstack/neutron/+/83301520:26
*** dasm is now known as dasm|off22:55

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!