Tuesday, 2020-11-10

*** e0ne has quit IRC00:21
*** mlavalle has quit IRC00:33
*** baojg has quit IRC01:57
*** baojg has joined #openstack-meeting-301:58
*** baojg has quit IRC02:28
*** baojg has joined #openstack-meeting-302:29
*** psachin has joined #openstack-meeting-303:22
*** macz_ has joined #openstack-meeting-304:28
*** macz_ has quit IRC04:33
*** baojg has quit IRC04:41
*** baojg has joined #openstack-meeting-304:41
*** baojg has quit IRC05:13
*** baojg has joined #openstack-meeting-305:14
*** baojg has quit IRC05:21
*** baojg has joined #openstack-meeting-305:21
*** baojg has quit IRC06:21
*** baojg has joined #openstack-meeting-306:21
*** ralonsoh has joined #openstack-meeting-307:22
*** tosky has joined #openstack-meeting-307:32
*** slaweq has joined #openstack-meeting-307:44
*** baojg has quit IRC08:14
*** baojg has joined #openstack-meeting-308:15
*** tosky has quit IRC08:23
*** SotK has quit IRC09:00
*** SotK has joined #openstack-meeting-309:01
*** baojg has quit IRC09:28
*** baojg has joined #openstack-meeting-309:29
*** tosky has joined #openstack-meeting-309:31
*** lifeless has joined #openstack-meeting-309:53
*** lpetrut has joined #openstack-meeting-310:08
*** e0ne has joined #openstack-meeting-310:39
*** baojg has quit IRC11:14
*** baojg has joined #openstack-meeting-311:14
*** e0ne has quit IRC11:21
*** e0ne has joined #openstack-meeting-311:33
*** Luzi has joined #openstack-meeting-311:51
*** baojg has quit IRC12:16
*** baojg has joined #openstack-meeting-312:16
*** genekuo has joined #openstack-meeting-312:34
*** macz_ has joined #openstack-meeting-313:33
*** macz_ has quit IRC13:37
*** baojg has quit IRC13:55
*** baojg has joined #openstack-meeting-313:56
*** obondarev has joined #openstack-meeting-313:56
*** mlavalle has joined #openstack-meeting-313:59
*** lajoskatona has joined #openstack-meeting-313:59
slaweq#startmeeting networking14:00
openstackMeeting started Tue Nov 10 14:00:17 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
slaweqhi14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: networking)"14:00
openstackThe meeting name has been set to 'networking'14:00
mlavalleo/14:00
obondarevhi14:00
rubasovhello14:01
lajoskatonaHi14:01
amotokio/14:01
bcafarelo/14:01
slaweqok, lets start14:01
slaweq#topic Announcements14:02
*** openstack changes topic to "Announcements (Meeting topic: networking)"14:02
slaweqralonsoh is now core in neutron stable branches - congrats and welcome in the stable team ralonsoh :)14:02
ralonsohhi (sorry, I'm late)14:02
ralonsohthanks!14:02
bcafarelwelcome to stable land :)14:03
mlavallecongrats!14:03
ralonsohthank you all14:03
slaweqfirst milestone in the Wallaby is week of Nov 30th14:03
*** andy_ has joined #openstack-meeting-314:03
slaweqand just a reminder - gerrit outage planned Nov 20 - 23 - http://lists.opendev.org/pipermail/service-announce/2020-October/000012.html14:05
njohnstono/14:05
slaweqthat's all announcements from me for today14:05
slaweqdo You have anything else to announce?14:05
slaweqok, so I think we can move on14:09
slaweq#topic Blueprints14:09
*** openstack changes topic to "Blueprints (Meeting topic: networking)"14:09
slaweqWallaby-1 https://bugs.launchpad.net/neutron/+milestone/wallaby-114:09
slaweqI don't have too much updates for today14:09
slaweqdo You have any?14:09
bcafarellooks like not a lot :)14:11
mlavalleJust about address groups14:11
mlavallehangyang and I continue making progress. I just got the two patches for the RPC channel update approved. Thanks for your reviews14:11
mlavallenext step is the change to the OVS firewall itself14:12
mlavallethat's all14:12
slaweqmlavalle: speaking about this BP14:14
slaweqI was checking today this problem with grenade jobs in https://review.opendev.org/#/c/751110/14:14
slaweqand I found new bug  https://bugs.launchpad.net/neutron/+bug/1903696 which is causing this issue14:14
openstackLaunchpad bug 1903696 in neutron "Security group OVO object don't reloads and make compatible rules objects" [High,Confirmed] - Assigned to Slawek Kaplonski (slaweq)14:14
mlavalleThank you so much!14:15
mlavalleI see the comment in the patch14:15
mlavallemuch appreciated!14:16
obondarevnice catch14:16
slaweqyw14:17
mlavalleyeah, nice catch!14:17
slaweqthx :)14:17
slaweqok, if there is no more updates about BPs I think we can move on14:18
*** baojg has quit IRC14:19
slaweq#topic Community Goals14:19
*** openstack changes topic to "Community Goals (Meeting topic: networking)"14:19
*** baojg has joined #openstack-meeting-314:19
slaweqhere again I don't have too much update for today14:20
slaweqI have on my todo action to create list of required privsep migration changes14:20
slaweqbut I didn't made it yet14:20
slaweqamotoki, ralonsoh: any other updates?14:21
ralonsohno for this topic14:21
amotokithe policy file format proposal https://review.opendev.org/#/c/759881/ is still in review.14:21
slaweqk14:22
amotokinova and cinder already made the change, so I believe we can do the same regardless of it is approved or not.14:22
slaweqsounds good for me amotoki :)14:22
amotokiI am preparing it.14:22
slaweqthx14:22
amotokinp14:22
slaweqok, lets move on14:24
slaweq#topic bugs14:24
*** openstack changes topic to "bugs (Meeting topic: networking)"14:24
slaweqralonsoh was our bug deputy last week14:24
slaweqralonsoh: any bugs You want to highligh here?14:24
ralonsohsorry, I didn't write the mail...14:24
ralonsohmy bad!14:24
ralonsohyesterday I was in PTO14:25
slaweqnp14:25
ralonsohsorry! I'll do it today14:25
*** artom has quit IRC14:25
*** artom has joined #openstack-meeting-314:26
slaweqsure14:26
slaweqwe can just talk about bugs here :)14:26
ralonsohnothing from my side14:26
slaweqok, so lets move on14:27
slaweq#topic Neutron performance subteam14:27
*** openstack changes topic to "Neutron performance subteam (Meeting topic: networking)"14:27
slaweqI just wanted to mention here that with mlavalle we are planning for next week to do some profiling of the DHCP/L3 agents14:28
slaweqwe will keep You updated here about our progress14:28
mlavalle:-)14:28
slaweqand that's basically all from my side for today14:29
slaweqdo You have anything else You want to discuss here?14:29
ralonsohjust one patch14:30
ralonsohthe transition to the new facade14:30
ralonsohhttps://review.opendev.org/#/c/715315/14:30
ralonsohlast PS: all test are passing but 4 FTs14:30
ralonsohlooks very good!14:30
ralonsohthat's all14:30
bcafarelniiiice14:31
slaweqcongrats ralonsoh!14:31
lajoskatona+114:32
amotoki+114:32
obondarevgreat!14:32
slaweqok, I think that with this very good news we can finish our meeting today :)14:34
slaweqthx for attending and see You online14:34
slaweqand on ci meeting in about 25 minutes :)14:34
slaweqbye14:34
slaweq#endmeeting14:34
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"14:34
openstackMeeting ended Tue Nov 10 14:34:44 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:34
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-11-10-14.00.html14:34
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-11-10-14.00.txt14:34
openstackLog:            http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-11-10-14.00.log.html14:34
ralonsohbye14:34
lajoskatonabye14:34
amotokibye good night14:35
rubasovbye14:35
slaweq#startmeeting neutron_ci15:00
openstackMeeting started Tue Nov 10 15:00:24 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
slaweqhi15:00
*** openstack changes topic to " (Meeting topic: neutron_ci)"15:00
openstackThe meeting name has been set to 'neutron_ci'15:00
ralonsohhi15:00
obondarevo/15:00
slaweqGrafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate15:01
slaweqplease open now and we can move on :)15:01
lajoskatonaHi15:01
bcafarelhey again15:01
slaweq#topic Actions from previous meetings15:02
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"15:02
slaweqslaweq to propose patch to check console log before ssh to instance in tempest15:02
slaweq    Patch https://review.opendev.org/#/c/761964/15:02
slaweqI need to address gmann's comments there15:02
slaweqnext one15:03
slaweqslaweq to check failing neutron-grenade-ovn job15:03
slaweqI still didn't had time for that one15:03
slaweq#action slaweq to check failing neutron-grenade-ovn job15:03
slaweqralonsoh to check fullstack issue https://bugs.launchpad.net/neutron/+bug/190267815:03
openstackLaunchpad bug 1902678 in neutron "[Fullstack] Wrong output of the cmdline causes tests timeouts" [Critical,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)15:03
ralonsoh#link https://review.opendev.org/#/c/761202/15:04
bcafareloops I know the author of the linked change15:05
ralonsohhehehe that was a side effect15:05
slaweqthx, approved15:07
slaweqok, next one15:07
slaweqslaweq to blacklist some cinder related tests in the neutron-tempest-* jobs15:07
slaweq    I started proposing something else, first in grenade jobs:15:07
slaweq    https://review.opendev.org/#/c/761518/15:07
*** Luzi has quit IRC15:07
slaweqbasically I think that we can disable cinder services in our jobs15:07
slaweqwe don't need to test cinder in our gate so if we will disable cinder services we will have 2 adventages:15:08
slaweq- no cinder related tests run in the jobs15:08
slaweq- less resources used by job15:08
ralonsoh+1 to this15:08
slaweqI first want to try with grenade but later will do the same for scenario jobs also15:08
lajoskatona+115:08
slaweqand that's all regarding actions from last week15:10
slaweqI think we can move on15:10
slaweq#topic Stadium projects15:10
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"15:10
slaweqlajoskatona: anything regarding stadium projects' ci for today?15:11
lajoskatonanothing  in my mind15:11
bcafarelone stadium/stable topic https://bugs.launchpad.net/neutron/+bug/190368915:11
openstackLaunchpad bug 1903689 in neutron "[stable/ussuri] Functional job fails - AttributeError: module 'neutron_lib.constants' has no attribute 'DEVICE_OWNER_DISTRIBUTED'" [Medium,New]15:11
bcafarelsfc and fwaas functional are broken on ussuri, not sure for other stadium projects - look like they do not cap the neutron-lib version used?15:11
lajoskatonaI need to go for some help ti infra or qa team regardning some hard to fix ODL job failures, but that;s a small thing15:11
slaweqbcafarel: will You take care of it with?15:14
slaweqis it reported somewhere on LP?15:14
bcafarelif I find some time for it yes, but most probably not this week :)15:15
slaweqbcafarel: ok, please at least report it on LP so we will not lost it15:15
bcafarelslaweq: it is, bug 1903689 (a few lines above)15:16
openstackbug 1903689 in neutron "[stable/ussuri] Functional job fails - AttributeError: module 'neutron_lib.constants' has no attribute 'DEVICE_OWNER_DISTRIBUTED'" [Medium,New] https://launchpad.net/bugs/190368915:16
slaweqok, thx bcafarel15:18
slaweqok, lets move on then15:18
slaweq#topic Stable branches15:18
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)"15:18
slaweqbcafarel: any updates here?15:18
bcafarelwe disabled rally job in rocky, details in https://review.opendev.org/#/c/761391/15:19
bcafarelfull support branches I saw patches requiring a few rechecks, but no big issue at least (timeouts, volume test, etc)15:20
slaweqthx15:21
slaweqyes, rocky should be finally unblocked with that Your patch15:21
slaweqsorry, I forgot about dashboards15:22
slaweqVictoria dashboard: http://grafana.openstack.org/d/pM54U-Kiz/neutron-failure-rate-previous-stable-release?orgId=115:22
slaweqUssuri dashboard: http://grafana.openstack.org/d/dCFVU-Kik/neutron-failure-rate-older-stable-release?orgId=115:22
bcafarelone thing we may need for stable is https://review.opendev.org/#/c/761178/ devstack backport, but I did not have time to check if we hit this issue too in stable15:23
bcafarelthough first we need it in master :)15:23
slaweqI saw this only on master branch15:23
*** lpetrut has quit IRC15:24
slaweqok, anything else regarding stable branches' ci?15:25
bcafarelnot from me15:25
slaweqok, lets move on then15:25
slaweq#topic Grafana15:25
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"15:25
slaweq#link http://grafana.openstack.org/dashboard/db/neutron-failure-rate15:26
slaweqin overall it looks as usuall15:27
slaweqbut functional and fullstack tests are failing pretty often recently15:27
slaweqlets discuss about them now15:28
slaweq#topic fullstack/functional15:28
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)"15:28
slaweqI found today few cases where some ovn functional tests are failing like:15:29
slaweqhttps://cd9fca83cb14b422f67b-df162b2d8bf471312ec213b580870b4a.ssl.cf5.rackcdn.com/752795/20/check/neutron-functional-with-uwsgi/1243600/controller/logs/dsvm-functional-logs/neutron.tests.functional.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_ovsdb_monitor.TestNBDbMonitorOverSsl.test_global_events/testrun.txt15:29
slaweqso it's some error 500 from the server15:29
slaweqdid You saw it also maybe?15:29
bcafarelnot familiar with this one15:30
ralonsoha couple of times, yes15:30
ralonsohI think this is related to the DB transaction15:30
ralonsohI can check it15:30
slaweqralonsoh: thx15:30
slaweqI will open LP for that also15:31
slaweqand will send You link to it15:31
ralonsohthanks15:31
slaweq#action slaweq to report bug regarding error 500 in ovn functional tests15:31
slaweq#action ralonsoh to check error 500 in ovn functional tests15:31
slaweq:)15:31
slaweqthx15:31
slaweqother issue which I saw (again) recently was timeout in namespace operations:15:32
slaweqhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ef3/759908/3/check/neutron-functional-with-uwsgi/ef3de15/testr_results.html15:32
slaweqralonsoh: I was pretty sure You were fixing such bug some time ago, no?15:33
ralonsohthis is on "set_link_attribute" method15:33
*** baojg has quit IRC15:36
slaweqso is it different one?15:36
ralonsohI think so15:36
slaweqok, I will open LP for that one too15:37
slaweq#action slaweq to report LP regarding functional test timeout on set_link_attribute method15:37
slaweqok, I think we can move on to the next topic now15:37
slaweq#topic Tempest/Scenario15:38
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"15:38
slaweqfirst of all there are some patches which can hopefully improve a bit our ci: https://review.opendev.org/#/q/topic:improve-neutron-ci+(status:open+OR+status:merged)15:39
slaweqplease review them if You will have few minutes :)15:39
slaweqand tbh I didn15:39
slaweqI didn't found any new issues there - in most cases those jobs are failing due to bug in devstack (fixed by Nate), kernel panic in guest vms, or some timeouts15:40
lajoskatonaI think this is the fix from Nate: https://review.opendev.org/76117815:41
slaweqlajoskatona: yes15:42
slaweqdo You have maybe any examples of the failures which You would like to discuss here?15:42
slaweqor maybe anything else regarding our CI?15:43
* mlavalle will review those patches15:43
bcafarelall good from me (busy catching up on these improve-neutron-ci reviews)15:43
slaweqthx15:44
slaweqif there is nothing else, I think we can finish earlier today15:44
slaweqthx for attending this meeting and have a great day15:45
slaweqo/15:45
bcafarelo/15:45
ralonsohbye15:45
slaweq#endmeeting15:45
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:45
openstackMeeting ended Tue Nov 10 15:45:12 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:45
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-11-10-15.00.html15:45
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-11-10-15.00.txt15:45
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-11-10-15.00.log.html15:45
lajoskatonaBye15:46
*** lajoskatona has left #openstack-meeting-315:46
*** obondarev has quit IRC15:49
*** macz_ has joined #openstack-meeting-315:55
*** baojg has joined #openstack-meeting-317:17
*** e0ne has quit IRC17:19
*** e0ne has joined #openstack-meeting-317:21
*** ralonsoh has quit IRC17:49
*** psachin has quit IRC18:15
*** e0ne has quit IRC18:43
*** gmann is now known as gmann_lunch19:29
*** baojg has quit IRC19:46
*** baojg has joined #openstack-meeting-319:47
*** tosky has quit IRC20:42
*** tosky has joined #openstack-meeting-320:42
*** baojg has quit IRC20:51
*** baojg has joined #openstack-meeting-320:51
*** slaweq has quit IRC21:47
*** raildo has quit IRC22:01
*** baojg has quit IRC22:24
*** baojg has joined #openstack-meeting-322:25
*** gmann_lunch is now known as gmann22:27
*** ianychoi has quit IRC22:52
*** ianychoi has joined #openstack-meeting-322:52
*** tosky has quit IRC22:55
*** baojg has quit IRC22:56
*** baojg has joined #openstack-meeting-322:57
*** baojg has quit IRC23:43
*** baojg has joined #openstack-meeting-323:44

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!