Tuesday, 2021-04-13

*** mlavalle has quit IRC00:12
*** ralonsoh has joined #openstack-meeting-305:29
*** ralonsoh has quit IRC05:29
*** ralonsoh has joined #openstack-meeting-305:30
*** Luzi has joined #openstack-meeting-305:50
*** slaweq has joined #openstack-meeting-305:52
*** eolivare has joined #openstack-meeting-306:46
*** BakaKuna has joined #openstack-meeting-306:50
*** suzhengwei has joined #openstack-meeting-306:59
*** tosky has joined #openstack-meeting-307:49
*** e0ne has joined #openstack-meeting-307:54
*** suzhengwei has quit IRC08:20
*** Luzi has quit IRC08:47
*** Luzi has joined #openstack-meeting-308:48
*** yamamoto has quit IRC09:48
*** yamamoto has joined #openstack-meeting-309:51
*** yamamoto has quit IRC09:58
*** yamamoto has joined #openstack-meeting-310:28
*** yamamoto has quit IRC10:42
*** baojg has quit IRC11:16
*** baojg has joined #openstack-meeting-311:18
*** yamamoto has joined #openstack-meeting-311:18
*** yamamoto has quit IRC11:29
*** yamamoto has joined #openstack-meeting-312:02
*** yamamoto has quit IRC12:06
*** artom has joined #openstack-meeting-312:15
*** e0ne has quit IRC12:19
*** yamamoto has joined #openstack-meeting-313:14
*** tosky has quit IRC13:19
*** tosky has joined #openstack-meeting-313:25
*** tosky has quit IRC13:29
*** tosky has joined #openstack-meeting-313:29
*** mlavalle has joined #openstack-meeting-313:40
*** Luzi has quit IRC13:49
*** lpetrut has joined #openstack-meeting-313:56
*** haleyb has left #openstack-meeting-314:01
*** haleyb has joined #openstack-meeting-314:01
slaweq#startmeeting networking14:02
openstackMeeting started Tue Apr 13 14:02:00 2021 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
slaweqhi14:02
*** openstack changes topic to " (Meeting topic: networking)"14:02
ralonsohhi14:02
openstackThe meeting name has been set to 'networking'14:02
slaweqsorry for being late, too many pings on different irc channels14:02
*** obondarev has joined #openstack-meeting-314:02
bcafarel:)14:02
bcafarelo/14:02
obondarevhi14:02
rubasovo/14:03
amotokio/14:03
haleybhi14:03
slaweq#topic announcements14:03
*** openstack changes topic to "announcements (Meeting topic: networking)"14:03
slaweqStable Wallaby should be released tomorrow - thanks everyone involved in that release14:04
*** lajoskatona has joined #openstack-meeting-314:04
lajoskatonaHi14:04
slaweqon Thursday at 1400 UTC there will be Wallaby Release Community Meeting14:05
slaweqI will give some short update about Neutron there14:06
slaweqit will be on Zoom and on Youtube14:06
slaweqhttp://lists.openstack.org/pipermail/openstack-discuss/2021-April/021673.html14:06
slaweqnext week is virtual PTG14:07
slaweqplease register to it if You didn't yet14:07
slaweqand please add Your topics ideas to the etherpad https://etherpad.opendev.org/p/neutron-xena-ptg14:07
slaweqtomorrow or on Thursday I will start working on the schedule for our sessions14:07
slaweqthere will be for sure cross project session with Nova on Friday14:08
slaweqand some RBAC policies related sessions which I want to include in our agenda as at least some of us may be interested to join14:08
slaweqwe will also have session with Interop WG but I don't know yet when exactly it will be14:09
slaweqand that's all regarding announcements for today14:09
slaweqanything else You want to announce now?14:09
*** Luzi has joined #openstack-meeting-314:10
*** njohnston has joined #openstack-meeting-314:11
slaweqok, so let's move on14:12
slaweq#topic Blueprints14:12
*** openstack changes topic to "Blueprints (Meeting topic: networking)"14:12
slaweqdo You have any updates about any of the BPs?14:12
slaweqI have just quick update about https://blueprints.launchpad.net/neutron/+spec/secure-rbac-roles14:14
slaweqI was recently working a lot on adding some tests for new policies14:15
slaweqpatches are available at https://review.opendev.org/q/topic:%2522secure-rbac%2522+(status:open+OR+status:merged)+project:openstack/neutron14:15
slaweqthere are also some fixes to bugs which I found14:15
slaweqthank You for reviewing those patches and please review those which aren't yet :)14:15
*** yamamoto has quit IRC14:15
slaweqalso I added some topics about how new policies should works to the PTG agenda so we will discuss them there together14:16
slaweqand that's all from my side14:17
*** macz_ has joined #openstack-meeting-314:17
slaweqI think we can move on14:18
slaweqthere is nothing regarding community goals today14:18
slaweqso let's get straight to the next topic14:18
slaweq#topic Bugs14:18
*** openstack changes topic to "Bugs (Meeting topic: networking)"14:18
slaweqmlavalle was bug deputy, report: http://lists.openstack.org/pipermail/openstack-discuss/2021-April/021766.html14:18
slaweqit seems for me from this report that all bugs are in good shape and has got assignment or at least someone who is looking at them14:19
slaweqany other bugs You want to talk about today?14:20
*** lpetrut has quit IRC14:20
ralonsohif you have time: https://bugs.launchpad.net/neutron/+bug/192359214:21
openstackLaunchpad bug 1923592 in neutron "[Routed networks] Router routes to other segment CIDRs should have a gateway IP" [Undecided,New] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)14:21
ralonsohjust to check if what is reported is correct14:21
slaweqsure14:21
slaweqok, I guess that there are no other bugs to discuss today14:24
slaweqour bug deputy for this week is rubasov14:24
slaweqand next week is ralonsoh's turn14:24
ralonsohok14:24
slaweqare You ok with that14:24
slaweq?14:24
ralonsohsure14:24
slaweqthx14:24
rubasovon it14:24
slaweqthank You both for confirmation14:24
slaweqok, last topic for today14:25
slaweq#topic Neutron performance subteam14:25
*** openstack changes topic to "Neutron performance subteam (Meeting topic: networking)"14:25
slaweqthere wasn't that topic on the meetings since long time14:25
slaweqbut recently obondarev is doing great job with performance improvements in Neutron14:25
slaweqand I wanted to mention it here14:25
obondarevthanks slaweq14:25
ralonsoh+114:25
slaweqobondarev's patches are https://review.opendev.org/q/owner:oleg.bondarev%2540huawei.com+project:openstack/neutron+status:open14:26
slaweqthx obondarev for that great work14:26
obondarevmore to come)14:26
slaweqI think that You are becoming natural leader of that perf team :)14:26
obondarev:D14:26
slaweqok, and that's all what I have for today14:27
slaweqis there anything else You want to talk about with the team?14:27
slaweqif not I will give You back about 30 minutes today14:28
ralonsohno thanks14:28
slaweqok, so thx for attending the meeting today14:29
slaweqand have a great week14:29
obondarevo/14:29
ralonsohbye14:29
slaweqsee You all online and on the ptg next week14:29
slaweqo/14:29
rubasovo/14:29
slaweq#endmeeting14:29
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"14:29
openstackMeeting ended Tue Apr 13 14:29:58 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:30
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-04-13-14.02.html14:30
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-04-13-14.02.txt14:30
openstackLog:            http://eavesdrop.openstack.org/meetings/networking/2021/networking.2021-04-13-14.02.log.html14:30
amotokio/14:30
lajoskatonaBye14:30
bcafarel+1 on Oleg's patches :)14:30
*** obondarev has quit IRC14:32
*** jlibosva has joined #openstack-meeting-314:39
*** yamamoto has joined #openstack-meeting-314:50
*** Luzi has quit IRC14:51
*** yamamoto has quit IRC15:01
slaweq#startmeeting neutron_ci15:01
openstackMeeting started Tue Apr 13 15:01:37 2021 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: neutron_ci)"15:01
openstackThe meeting name has been set to 'neutron_ci'15:01
slaweqhi15:01
ralonsohhi15:01
bcafarelo/15:02
slaweqping lajoskatona15:02
slaweqok, lets start15:03
slaweqGrafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate15:03
slaweq#topic Actions from previous meetings15:04
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"15:04
slaweqralonsoh to check failed qos scenario test15:04
lajoskatonaHi, I am here15:04
ralonsohyes, I didn't replicate the error15:04
ralonsohand I didn't see it again15:04
ralonsohand reviewing the logs, I didn't see why the QoS was not applied15:04
ralonsohsorry, no solution for this one15:05
slaweqralonsoh: ok, so let's not bother with this for now15:05
slaweqwe will get back to it when it will be happening more often15:05
ralonsohok15:05
slaweqralonsoh: thx for checking it15:05
slaweqnext one15:05
slaweqbcafarel to update grafana dashboards with stable/wallaby15:05
bcafarelsent and merged (I think), looking for the link15:05
bcafarelyep https://review.opendev.org/c/openstack/project-config/+/786008 merged, also good time to ping other for release-related changes15:06
bcafarellike https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/785092 (switch to -wallaby variant jobs)15:07
slaweqthx bcafarel15:07
slaweqok, next one15:08
slaweqralonsoh to check failed test_get_egress_min_bw_for_port functional test15:08
ralonsohyes, one sec15:08
ralonsoh#link https://review.opendev.org/c/openstack/neutron/+/78515815:08
ralonsohthis actually a pre-check that must be always true15:08
ralonsohthis is not solving the error15:09
lajoskatonaIf I understand well we will have clean feedback if there are policies on port15:10
ralonsohsorry, someone else pinged me15:10
ralonsohthis patch will provide info if any other qos is set before the test15:10
slaweqso this may help to understand what the issue is there15:11
ralonsohsure15:11
slaweqwhich is good step forward IMO :)15:11
slaweqthx ralonsoh15:11
slaweqok, and the last one15:12
slaweqralonsoh to update LB installation guide with info about legacy ebtables15:12
ralonsohdone15:12
ralonsohone sec15:12
ralonsohI don't find it15:12
ralonsohhttps://review.opendev.org/c/openstack/neutron/+/78513715:13
slaweqthx15:13
slaweqit's merged already15:13
slaweqand that were all action items from last week15:13
slaweqlet's move on15:13
slaweq#topic Stadium projects15:13
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"15:14
slaweqlajoskatona: any updates?15:14
slaweqor issues15:14
lajoskatonaNothing what I have seen, so seems to be quiet everywhere15:14
slaweq++15:14
slaweqthx15:14
slaweq#topic Stable branches15:15
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)"15:15
slaweqas bcafarel  already mentioned there are some patches https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/785092 and https://review.opendev.org/c/openstack/neutron/+/78509315:16
slaweqwhich are for wallaby's ci15:16
slaweqand I will need to do similar patches for stadium projects15:16
slaweqI will do them this week15:16
slaweq#action slaweq to update wallaby's scenario jobs in neutron-tempest-plugin15:17
slaweqbcafarel: anything else regarding stable branches ci?15:17
bcafarelrecent branches look OK overall15:18
bcafarelstein has https://bugs.launchpad.net/neutron/+bug/1923412 small fix needed15:18
openstackLaunchpad bug 1923412 in neutron "[stable/stein] Tempest fails with unrecognized arguments: --exclude-regex" [Critical,Triaged]15:18
bcafarelrocky I wonder, it seems iptables_hybrid job is consistently failing (like on https://review.opendev.org/c/openstack/neutron/+/770794 )15:18
bcafarelbut I did not have time to check this week sorry :(15:18
ralonsohI'll try to check it15:20
slaweqthere are some failing tests there15:20
slaweqbut also it fails on collecting logs after job's failure15:20
slaweqthere is some error in subunit2html.py15:21
slaweqI wonder when we will be able to EOL those branches which runs on python 2.7 still15:21
slaweqand on Ubuntu Xenial15:21
slaweqhmm15:22
slaweqinteresting15:22
slaweqUbuntu Xenial support ends in April 2021 according to https://lists.ubuntu.com/archives/ubuntu-announce/2016-April/000207.html15:22
slaweqand we are still using it for testing Queens and Rocky15:23
ralonsohI think we can try to bump this library to 1.1.015:23
ralonsohwe are still using 1.0.015:23
slaweqsorry, wrong link, good one is https://wiki.ubuntu.com/Releases15:23
slaweqok, bcafarel can You report an issue regarding that rocky jobs?15:24
bcafarelslaweq: sure will do later tonight (I will check on other backports too to confirm)15:24
slaweqand I will send an email to the community to ask what we should do with that15:24
slaweqthx bcafarel15:24
slaweq#action bcafarel to report stable/rocky ci failures on LP15:24
slaweq#action slaweq to send email about testing older branches on Ubuntu Xenial15:25
slaweqahh, wait15:25
slaweqXenial's standard support ends this month15:25
slaweqbut EOL will be in 202415:25
slaweqso we still can use it :)15:25
slaweqI will not send any email about it15:25
slaweqsorry for the noise15:25
slaweqok, I think we can move on15:26
slaweq#topic Grafana15:26
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"15:26
slaweqhttp://grafana.openstack.org/dashboard/db/neutron-failure-rate15:26
slaweqit seems we are better with functional job finally15:27
slaweqbut we have some issue with neutron-tempest-plugin-scenario jobs15:27
slaweqas most of them failing at around 20-30 % of times15:27
slaweqexcept that I think that things are pretty ok15:29
slaweqlet's talk about some specific issues15:30
slaweq#topic fullstack/functional15:30
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)"15:30
slaweqI found (again) this week failure of     test_keepalived_spawns_conflicting_pid_vrrp_subprocess15:30
slaweqhttps://7c4af2962e649c78a0b8-8dbbf393fa4fd2548b6eb8c45bf2a7e6.ssl.cf2.rackcdn.com/785011/1/check/neutron-functional-with-uwsgi/dc727d9/testr_results.html15:30
slaweqbut I think we marked those tests as unstable, didn't we?15:30
ralonsohyes, same problem as before15:30
ralonsohthe sigterm signal do not reply15:30
ralonsohand the thread never ends15:31
slaweqyes, but is the patch which markes that as unstable merged already?15:31
slaweqdo You remember that patch?15:31
ralonsohnope, I think we removed it15:31
ralonsohwe'll need to propose it again15:31
slaweqahh, ok15:31
slaweqmaybe we should then mark them as unstable until we will fix that issue completly15:32
slaweqralonsoh: will You propose it?15:32
ralonsohperfect15:32
ralonsohyes15:32
slaweqthx15:32
slaweq#action ralonsoh to mark test_keepalived_spawns_conflicting_pid_vrrp_subprocess functional test as unstable15:32
slaweqok, regarding fullstack15:33
slaweqI just want to ask You about review of the patch  https://review.opendev.org/c/openstack/neutron/+/78374815:33
slaweqit's new fullstack test to add15:33
slaweqfor segmentation_id updates15:33
slaweqno rush but if You will have few minutes, please take a look15:33
slaweqnext topic15:33
slaweq#topic Tempest/Scenario15:33
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"15:33
slaweqhere there is most "hot" issue for this week15:34
slaweqI noticed that in all our neutron-tempest-plugin scenario jobs random tests are failing due to ssh failure15:34
slaweqevery time there is problem with accessing metadata service15:34
slaweq    https://f237087178b608be7cbc-a3abe88e6ab2911093ccea19e77537d0.ssl.cf5.rackcdn.com/785749/1/check/neutron-tempest-plugin-scenario-linuxbridge/f746672/testr_results.html15:35
slaweq    https://5e09181bcc1a50499619-17764b56a5c622705c872e3c7dca2597.ssl.cf2.rackcdn.com/769788/6/check/neutron-tempest-plugin-scenario-openvswitch/32b4182/testr_results.html15:35
slaweq    https://f3719601e38156e4ec26-626e176c8fffa963d6c301ab5a223935.ssl.cf1.rackcdn.com/785633/2/check/neutron-tempest-plugin-scenario-linuxbridge/4fcd101/testr_results.html15:35
slaweq    https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_da7/785895/1/check/neutron-tempest-plugin-scenario-linuxbridge/da7ea5e/testr_results.html15:35
slaweq    https://5b963027deeaf11430aa-de753611fe18d17817cd3cc57c427456.ssl.cf1.rackcdn.com/785895/1/check/neutron-tempest-plugin-scenario-openvswitch/ce74a5b/testr_results.html15:35
slaweq    https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_785/785889/3/check/neutron-tempest-plugin-scenario-openvswitch/785f8bb/testr_results.html15:35
slaweq    https://3acd25be4b1698636631-3e445c1a5b8a8c84f71b5a61cff5a09b.ssl.cf5.rackcdn.com/785950/1/check/neutron-tempest-plugin-scenario-linuxbridge/5c9ea3c/testr_results.html15:35
slaweqthose are examples of the failures15:35
slaweqall those jobs runs with "ha=True" so keepalived is involved in the router's namespace15:35
slaweqany volunteer to investigate it?15:35
ralonsohI could do it15:35
slaweqI think that maybe https://review.opendev.org/c/openstack/neutron/+/782679 may be useful for debugging that issue15:36
slaweqahh, no15:36
slaweqsorry15:36
slaweqit's only for grenade jobs15:36
slaweqwe should do similar change for neutron-tempest-plugin jobs also15:37
ralonsohok15:37
slaweqralonsoh: I will open LP for that issue15:37
ralonsohso you think this is a problem in the iptables rule?15:37
slaweqI forgot to do it before the meeting15:37
slaweqidk but maybe can be15:37
ralonsohping me with the LP link15:37
slaweqsure, I will15:37
slaweq#action slaweq to report LP with metadata issue in scenario jobs15:39
slaweq#ralonsoh to check metadata issue in scenario jobs15:39
slaweqok, that's all regarding scenario jobs for today15:41
slaweq#topic Periodic15:41
*** openstack changes topic to "Periodic (Meeting topic: neutron_ci)"15:41
slaweqperiodic jobs looks pretty ok recently15:41
slaweqone thing I want to ask You is to review  https://review.opendev.org/c/openstack/neutron/+/78566015:42
ralonsohsure15:42
slaweqas we recently discovered that periodic jobs based on tripleo are testing neutron Victoria every day15:42
slaweqwhich basically doesn't makes any sense :)15:42
ralonsohups...15:42
slaweqso this patch ensures that neutron is from master branch in that jobs always15:42
slaweqok, that's all from my side15:43
bcafarelhe, nice catch15:43
slaweqdo You have anything else to discuss today?15:43
ralonsohno, thanks15:43
slaweqahh, one last thing - next week's meeting will be cancelled as we have ptg in the same time15:44
slaweqok, so if there are no other topics, we can finish earlier today15:44
slaweqthx for attending the meeting15:44
slaweq#endmeeting15:44
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:44
openstackMeeting ended Tue Apr 13 15:44:49 2021 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:44
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-04-13-15.01.html15:44
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-04-13-15.01.txt15:44
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2021/neutron_ci.2021-04-13-15.01.log.html15:44
ralonsohbye15:44
bcafarelo/15:45
lajoskatonabye15:48
*** e0ne has joined #openstack-meeting-316:35
*** e0ne has quit IRC16:38
*** e0ne has joined #openstack-meeting-316:42
*** jlibosva has quit IRC17:24
*** e0ne has quit IRC17:38
*** eolivare has quit IRC18:00
*** yamamoto has joined #openstack-meeting-318:38
*** yamamoto has quit IRC18:43
*** ralonsoh has quit IRC19:13
*** baojg has quit IRC19:13
*** baojg has joined #openstack-meeting-319:15
*** lajoskatona has quit IRC20:12
*** BakaKuna has quit IRC21:46
*** yamamoto has joined #openstack-meeting-322:00
*** fnordahl has quit IRC22:37
*** yamamoto has quit IRC22:41
*** yamamoto has joined #openstack-meeting-322:42
*** macz_ has quit IRC23:26
*** tosky has quit IRC23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!