| opendevreview | Merged openstack/neutron master: Check a namespace existence by checking only its own directory https://review.opendev.org/c/openstack/neutron/+/814868 | 02:47 |
|---|---|---|
| sapd1 | Hi all, I'm trying to use distributed DHCP feature (https://specs.openstack.org/openstack/neutron-specs/specs/wallaby/distributed_dhcp.html). because my environment does not have L3 router so normally, the VM will get metadata from DHCP namespace. With this feature, the DHCP namespace is gone. So how do we handle the metadata ? Can we use ovn-metadata-agent in this case? | 03:31 |
| opendevreview | Manu B proposed openstack/python-neutronclient master: Add neutron and osc commands for bgp speaker router association https://review.opendev.org/c/openstack/python-neutronclient/+/803318 | 06:45 |
| opendevreview | Tobias Urdin proposed openstack/neutron master: Set RPC timeout in PluginReportStateAPI to report_interval https://review.opendev.org/c/openstack/neutron/+/815310 | 07:14 |
| opendevreview | Przemyslaw Szczerbik proposed openstack/neutron master: Fix placement allocation update for port with network QoS policy https://review.opendev.org/c/openstack/neutron/+/815421 | 08:37 |
| opendevreview | Merged openstack/neutron stable/xena: [OVN Migration] Remove qr and dhcp ports from the nodes https://review.opendev.org/c/openstack/neutron/+/815236 | 08:38 |
| opendevreview | Merged openstack/neutron stable/wallaby: [OVN Migration] Remove qr and dhcp ports from the nodes https://review.opendev.org/c/openstack/neutron/+/815237 | 08:38 |
| opendevreview | Dr. Jens Harbott proposed openstack/neutron-tempest-plugin master: Add a config option for BGP speaker scheduling https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815294 | 08:39 |
| opendevreview | Merged openstack/neutron-fwaas stable/ussuri: Fix pdf build and drop lower-constraints job https://review.opendev.org/c/openstack/neutron-fwaas/+/800954 | 08:49 |
| opendevreview | Merged openstack/neutron stable/victoria: [OVN Migration] Remove qr and dhcp ports from the nodes https://review.opendev.org/c/openstack/neutron/+/815238 | 09:31 |
| opendevreview | Merged openstack/neutron stable/ussuri: [OVN Migration] Remove qr and dhcp ports from the nodes https://review.opendev.org/c/openstack/neutron/+/815239 | 09:31 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron-tempest-plugin master: [stable/stein] Regroup tests exclusion list and add new failing one https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815458 | 09:48 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 09:49 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 09:55 |
| ralonsoh | slaweq, ^^ | 09:55 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVS] Workaround when OpenFlow controller restarts https://review.opendev.org/c/openstack/neutron/+/815459 | 09:55 |
| ralonsoh | ^^ | 09:55 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 09:57 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 10:00 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 10:04 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: Remove some scenario jobs from the check and gate queues https://review.opendev.org/c/openstack/neutron/+/815465 | 10:26 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: Cleaning of the zuul's project.yaml file https://review.opendev.org/c/openstack/neutron/+/815466 | 10:26 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/xena: [OVN Migration] Remove trunk's subports from the nodes https://review.opendev.org/c/openstack/neutron/+/815432 | 10:31 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/wallaby: [OVN Migration] Remove trunk's subports from the nodes https://review.opendev.org/c/openstack/neutron/+/815433 | 10:31 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/victoria: [OVN Migration] Remove trunk's subports from the nodes https://review.opendev.org/c/openstack/neutron/+/815434 | 10:32 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/ussuri: [OVN Migration] Remove trunk's subports from the nodes https://review.opendev.org/c/openstack/neutron/+/815435 | 10:32 |
| opendevreview | Slawek Kaplonski proposed openstack/networking-ovn stable/train: [OVN Migration] Remove trunk's subports from the nodes https://review.opendev.org/c/openstack/networking-ovn/+/815469 | 10:41 |
| tobias-urdin | ralonsoh: see my answer to your comment on https://review.opendev.org/c/openstack/neutron/+/815310 | 11:01 |
| tobias-urdin | maybe you have a better idea on how to solve it, i'm open to any suggestions but adding a configuration option or using report_interval both seems like valid options | 11:02 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/victoria: [ovn] Stop monitoring the SB MAC_Binding table to reduce mem footprint https://review.opendev.org/c/openstack/neutron/+/814870 | 11:03 |
| ralonsoh | tobias-urdin, I would like other reviewers to check my proposal | 11:04 |
| ralonsoh | adding longer timeouts is usually not the solution | 11:04 |
| tobias-urdin | it's the opposite way around, shorter timeout :) | 11:08 |
| ralonsoh | tobias-urdin, then you fail faster informing to the server | 11:09 |
| ralonsoh | why not using cast? and then the server can send the "agent_revived" status | 11:09 |
| tobias-urdin | i can't talk to why cast() cannot be used, i'll refer to the link Oleg posted | 11:12 |
| tobias-urdin | our issue is that report_state call() timeout should be decoupled from rpc_response_timeout because it doesn't make sen | 11:12 |
| tobias-urdin | sense that it gets timeout once and doesn't have a way to try again until n-server agent_down_time expires | 11:13 |
| ralonsoh | so again, you can use cast, that won't block the agent | 11:13 |
| ralonsoh | if the server receives this event and if needed, can send back an agent_revived status | 11:14 |
| ralonsoh | in any case, I won't block the review but I don't like this approach | 11:14 |
| tobias-urdin | we'll if we can come to the decision that cast() is safe then fine, it was changed in ~2015 with this https://review.opendev.org/c/openstack/neutron/+/232661 see the closed-bug link there | 11:16 |
| tobias-urdin | another alternative is to decouple report_state from using rpc_response_timeout config option to something new to make it configurable | 11:17 |
| tobias-urdin | even the default rpc_response_timeout=60 doesn't makes sense for report_state with a report_interval=30 default value since it's blocking so that agent will miss two state reportings and n-server will assume it's dead | 11:18 |
| tobias-urdin | i agree with your proposal as well, just more impact on the change | 11:21 |
| tobias-urdin | let's see if we maybe can get some more input | 11:21 |
| tobias-urdin | slaweq: ^ https://review.opendev.org/c/openstack/neutron/+/815310 | 11:21 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Sync QoS policies https://review.opendev.org/c/openstack/neutron/+/813052 | 11:29 |
| slaweq | tobias-urdin: I will check that patch later today | 11:43 |
| opendevreview | Merged openstack/neutron stable/victoria: Delete SG log entries when SG is deleted https://review.opendev.org/c/openstack/neutron/+/810871 | 12:10 |
| opendevreview | Merged openstack/neutron stable/ussuri: Delete SG log entries when SG is deleted https://review.opendev.org/c/openstack/neutron/+/810851 | 12:10 |
| opendevreview | Merged openstack/neutron stable/ussuri: Delete log entries when SG or port is deleted https://review.opendev.org/c/openstack/neutron/+/815300 | 12:13 |
| opendevreview | Manu B proposed openstack/python-neutronclient master: Add neutron and osc commands for bgp speaker peer association https://review.opendev.org/c/openstack/python-neutronclient/+/803458 | 12:13 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron-tempest-plugin master: [stable/stein] Regroup tests exclusion list and add new failing one https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815458 | 12:15 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron stable/ussuri: [ovn] Stop monitoring the SB MAC_Binding table to reduce mem footprint https://review.opendev.org/c/openstack/neutron/+/814869 | 12:32 |
| opendevreview | Lucas Alvares Gomes proposed openstack/networking-ovn stable/train: [ovn] Stop monitoring the SB MAC_Binding table to reduce mem footprint https://review.opendev.org/c/openstack/networking-ovn/+/814878 | 12:38 |
| *** Guest3656 is now known as redrobot | 13:03 | |
| *** lbragstad6 is now known as lbragstad | 13:28 | |
| opendevreview | Slawek Kaplonski proposed openstack/networking-bgpvpn stable/xena: Dropping lower constraints testing (stable Xena) https://review.opendev.org/c/openstack/networking-bgpvpn/+/815505 | 13:39 |
| slaweq | bcafarel: ralonsoh: please check ^^ when You will a minute | 13:39 |
| slaweq | thx in advance | 13:40 |
| bcafarel | slaweq: sure dropping l-c, sounds not too complicated to check | 13:40 |
| ralonsoh | sure | 13:42 |
| ralonsoh | slaweq, you should remove lower-constrainsts.txt file too, right? | 13:43 |
| slaweq | ralonsoh: damn, true :) | 13:43 |
| slaweq | sorry | 13:43 |
| opendevreview | Slawek Kaplonski proposed openstack/networking-bgpvpn stable/xena: Dropping lower constraints testing (stable Xena) https://review.opendev.org/c/openstack/networking-bgpvpn/+/815505 | 13:44 |
| ralonsoh | slaweq, sorry | 13:44 |
| ralonsoh | and the tox.ini definition | 13:44 |
| ralonsoh | sorry!! | 13:44 |
| slaweq | :/ | 13:44 |
| slaweq | sorry for doing it so badly :) | 13:44 |
| ralonsoh | hahaha I did the same before! | 13:44 |
| opendevreview | Slawek Kaplonski proposed openstack/networking-bgpvpn stable/xena: Dropping lower constraints testing (stable Xena) https://review.opendev.org/c/openstack/networking-bgpvpn/+/815505 | 13:45 |
| opendevreview | Merged openstack/neutron stable/xena: Delete log entries when SG or port is deleted https://review.opendev.org/c/openstack/neutron/+/815245 | 13:49 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: Check quota limits https://review.opendev.org/c/openstack/neutron/+/801470 | 13:55 |
| mlavalle | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Oct 26 14:00:09 2021 UTC and is due to finish in 60 minutes. The chair is mlavalle. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| mlavalle | hi there! | 14:00 |
| ralonsoh | hi | 14:00 |
| bcafarel | o/ | 14:00 |
| isabek | Hi! | 14:00 |
| obondarev | hi | 14:00 |
| mlavalle | lajoskatona asked me to facilitate today's meeting while he is off on vacation | 14:00 |
| njohnston | o/ | 14:00 |
| rubasov | o/ | 14:01 |
| slaweq | hi | 14:01 |
| mlavalle | ok, it seems the usual suspects are here, so let's get going | 14:01 |
| mlavalle | agenda as always is here: https://wiki.openstack.org/wiki/Network/Meetings | 14:02 |
| amotoki | hi | 14:02 |
| mlavalle | #topic Announcements | 14:02 |
| mlavalle | lajoskatona sent the PTG summary to the ML yesterday before leaving: http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025528.html | 14:03 |
| mlavalle | please take a look and make sure your topics are properly recorded in that summary | 14:03 |
| * mlavalle updated the meeting agenda with the PTG summary | 14:05 | |
| mlavalle | There are some good recorded topics in Openinfra Live that folks might be interested in reviewing: https://openinfra.dev/live/#all-episodes | 14:06 |
| mlavalle | I personally attended recently live the Neutron discussion for large operators: https://www.youtube.com/watch?v=4ZLqILbLIpQ | 14:07 |
| mlavalle | lajoskatona, slaweq and other members of the community did a great job discussing the challenges of deploying Neutron at large scale. njohnston made some good comments also | 14:09 |
| mlavalle | Yoga schedule is here: https://releases.openstack.org/yoga/schedule.html | 14:10 |
| mlavalle | any other announcements form the team? | 14:10 |
| mlavalle | ok, I take the silence as a no | 14:11 |
| bcafarel | :) | 14:12 |
| mlavalle | #topic Blueprints | 14:12 |
| mlavalle | The blueprints for this cycle are here: https://wiki.openstack.org/wiki/Network/Meetings#Blueprints | 14:13 |
| mlavalle | any updates from the team? | 14:13 |
| slaweq | not from me | 14:14 |
| mlavalle | ok, let's move on | 14:14 |
| mlavalle | #topic Community Goals | 14:14 |
| mlavalle | The community goal for this cycle is "Consistent and secure default RBAC" and is outlined here: https://governance.openstack.org/tc/goals/selected/yoga/consistent-and-secure-rbac.html | 14:15 |
| mlavalle | I think on Friday we left that discussion while still was going on to return to the Neutron PTG | 14:16 |
| mlavalle | has anybody heard / read the final outcome? | 14:16 |
| amotoki | IIUC we didn't get a consensus to make it the community goal in this cycle. | 14:16 |
| ralonsoh | There are up to 8 proposed solutions | 14:17 |
| ralonsoh | https://etherpad.opendev.org/p/policy-popup-yoga-ptg | 14:17 |
| ralonsoh | to the alternative taken last cycle | 14:17 |
| mlavalle | Thanks! at the end of the meeting I'll update the meeting agenda with this information | 14:18 |
| amotoki | ralonsoh: do you mean 8 possible ways found in "Scratch Paper" section? | 14:18 |
| ralonsoh | yes | 14:18 |
| amotoki | thanks | 14:19 |
| slaweq | I will keep an eye on it | 14:19 |
| slaweq | and I'm also in touch with lbragstad about that | 14:19 |
| mlavalle | cool. Thanks. | 14:20 |
| mlavalle | Let's move on then | 14:20 |
| lbragstad | o/ i plan to have something more digestible today in the community goal | 14:20 |
| ralonsoh | thanks | 14:20 |
| lbragstad | https://review.opendev.org/c/openstack/governance/+/815158 | 14:20 |
| mlavalle | @lbragstad thanks for the update | 14:21 |
| mlavalle | #topic Bugs | 14:21 |
| mlavalle | The week before the PTG, lucasagomes was the bugs deputy: http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025419.html | 14:22 |
| mlavalle | anything you would like to highlight lucasagomes ? | 14:22 |
| mlavalle | There are 3 bugs that require further triaging | 14:23 |
| lucasagomes | mlavalle, hi there, haven't prepared anything for this... so yes, in reality there's 2 as one was marked as incomplete there | 14:23 |
| lucasagomes | the OVN one I can take a look and triage it | 14:23 |
| lucasagomes | I mean https://bugs.launchpad.net/neutron/+bug/1946764 | 14:24 |
| mlavalle | Thanks for the update and for triaging that bug | 14:24 |
| lucasagomes | np, so there's this one https://bugs.launchpad.net/neutron/+bug/1946781 left to be triaged too | 14:25 |
| lucasagomes | if someone has some spare time | 14:25 |
| mlavalle | and there is a confirmed bug that requires owner: https://bugs.launchpad.net/neutron/+bug/1946589 | 14:25 |
| ralonsoh | I'll take last one | 14:26 |
| ralonsoh | 1946589 | 14:26 |
| mlavalle | cool. Thanks! | 14:26 |
| mlavalle | moving on to last week, the deputy was jlibosva: http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025516.html | 14:27 |
| mlavalle | The following bugs seem to be confirmed and require and assignee: | 14:28 |
| mlavalle | https://bugs.launchpad.net/neutron/+bug/1948457 | 14:28 |
| mlavalle | https://bugs.launchpad.net/neutron/+bug/1948452 | 14:29 |
| slaweq | that last one I moved to os-vif | 14:29 |
| slaweq | as neutron don't create or remove qvo ports IIRC | 14:29 |
| mlavalle | oh yeah, I saw the email. Thanks for clarifying | 14:29 |
| ralonsoh | about the first one, I'll try to take care of it | 14:29 |
| mlavalle | ralonsoh: why don't you let me take it? it would be my first ovn bug. If I get lost, I'll go to you crying for help, ok? | 14:30 |
| ralonsoh | perfect | 14:30 |
| mlavalle | ralonsoh: most likely, voy a chillar (I'm going to cry), ok? | 14:31 |
| ralonsoh | hehehe | 14:31 |
| mlavalle | any other bugs we should discuss today? | 14:32 |
| slaweq | not from me | 14:33 |
| ralonsoh | no | 14:33 |
| mlavalle | does anybody know who is the bugs deputy this week? The rotation schedule has been updated already and this week doesn't show anymore | 14:33 |
| obondarev | o/ | 14:33 |
| obondarev | I am | 14:33 |
| mlavalle | perfect, we are in very capable hands. Thanks! | 14:34 |
| obondarev | :) | 14:34 |
| obondarev | thanks mlavalle! | 14:34 |
| mlavalle | #topic L3 | 14:35 |
| mlavalle | Do we have anything to discuss here? | 14:35 |
| slaweq | ping liuyulong | 14:36 |
| slaweq | I guess liuyulong is not available, so probably nothing to discuss regarding L3 | 14:38 |
| mlavalle | yeap, let's move on | 14:38 |
| mlavalle | #topic Ryu and os-ken | 14:38 |
| ralonsoh | hi, three updates | 14:38 |
| ralonsoh | 1) initial sync is ongoing: https://review.opendev.org/q/project:openstack%252Fos-ken+status:open | 14:39 |
| ralonsoh | 2) there are two blockers right now: | 14:39 |
| ralonsoh | https://review.opendev.org/c/openstack/os-ken/+/813834 | 14:39 |
| ralonsoh | https://review.opendev.org/c/openstack/os-ken/+/813830 | 14:39 |
| ralonsoh | and 3) there are no new patches in ryu (apart from the upper list) | 14:39 |
| ralonsoh | slaweq, ^^ if you don't mind to check those patches | 14:40 |
| slaweq | ralonsoh: sure | 14:40 |
| ralonsoh | that's all | 14:40 |
| mlavalle | Thanks for the concise update | 14:41 |
| mlavalle | #topic Performance subteam | 14:41 |
| mlavalle | Yhere are patches up for review here: https://review.opendev.org/q/owner:oleg.bondarev%2540huawei.com+project:openstack/neutron+status:open | 14:41 |
| mlavalle | anything you want to say obondarev ? | 14:41 |
| opendevreview | Slawek Kaplonski proposed openstack/os-ken master: Choose the highest TLS version https://review.opendev.org/c/openstack/os-ken/+/813830 | 14:42 |
| obondarev | actually these are not regarding performance :) | 14:42 |
| obondarev | it's for local IP feature | 14:42 |
| obondarev | there are no performance patches currently AFAIK | 14:42 |
| mlavalle | ok, we should probably update the meeting agenda and remove that url | 14:43 |
| obondarev | yep | 14:43 |
| mlavalle | cool | 14:43 |
| mlavalle | #topic Docs | 14:43 |
| mlavalle | does anybody have an update here? | 14:43 |
| mlavalle | it seems the answer is nope | 14:45 |
| mlavalle | #topic neutron-lib | 14:45 |
| mlavalle | we have this in the meeting agenda: https://etherpad.opendev.org/p/neutron-lib-volunteers-and-punch-list | 14:46 |
| mlavalle | is this still going on? | 14:46 |
| slaweq | mlavalle: I guess this is very outdated | 14:47 |
| slaweq | actually we agreed some time ago on one of the PTGs to not force movement of everything to neutron-lib anymore | 14:47 |
| mlavalle | yeah, that is what I suspected... I'll talk to lajoskatona about that section next week | 14:47 |
| slaweq | ++ | 14:48 |
| mlavalle | #topic On demand agenda | 14:48 |
| mlavalle | I don't see any topics there. Does anybody have anything to discuss? | 14:49 |
| slaweq | not me :) | 14:49 |
| bcafarel | not me either | 14:50 |
| mlavalle | ok | 14:50 |
| mlavalle | Thanks for attending | 14:50 |
| slaweq | thx | 14:50 |
| bcafarel | o/ | 14:50 |
| slaweq | please remember that we will have ci meeting in 10 minutes :) | 14:50 |
| slaweq | o/ | 14:50 |
| ralonsoh | bye | 14:51 |
| mlavalle | No drivers meeting on Friday slaweq ralonsoh amotoki njohnston | 14:51 |
| ralonsoh | thanks | 14:51 |
| mlavalle | #endmeeting | 14:51 |
| opendevmeet | Meeting ended Tue Oct 26 14:51:30 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:51 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2021/networking.2021-10-26-14.00.html | 14:51 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2021/networking.2021-10-26-14.00.txt | 14:51 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2021/networking.2021-10-26-14.00.log.html | 14:51 |
| amotoki | thanks | 14:51 |
| slaweq | mlavalle: thx for info, I will be off on Friday so it's even better :) | 14:53 |
| mlavalle | slaweq: have fun! | 14:53 |
| slaweq | mlavalle: thx a lot | 14:53 |
| rubasov | o/ | 14:54 |
| opendevreview | Merged openstack/networking-bgpvpn stable/train: Run TripleO jobs on CentOS8 instead of CentOS7 https://review.opendev.org/c/openstack/networking-bgpvpn/+/809504 | 14:58 |
| slaweq | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Oct 26 15:00:16 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| slaweq | welcome on the CI meeting :) | 15:00 |
| obondarev | hi | 15:01 |
| bcafarel | o/ | 15:01 |
| slaweq | ping ralonsoh :) | 15:02 |
| ralonsoh | sorry | 15:02 |
| slaweq | ok, I think we can start | 15:02 |
| slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:02 |
| slaweq | Please open now :) | 15:02 |
| slaweq | #topic Actions from previous meetings | 15:02 |
| slaweq | slaweq to check bug https://bugs.launchpad.net/neutron/+bug/1946187 | 15:03 |
| slaweq | I checked it | 15:03 |
| slaweq | and It's in fact the same issue like in https://bugs.launchpad.net/neutron/+bug/1944201 - ovs-agent is down thus HA ports are DOWN and routers aren't becoming to be primary | 15:03 |
| slaweq | and about https://bugs.launchpad.net/neutron/+bug/1944201 we will talk later :) | 15:04 |
| slaweq | so next one | 15:04 |
| slaweq | bcafarel to check n-t-p issue in Stein branch | 15:04 |
| * bcafarel catches on | 15:04 | |
| bcafarel | it is mostly good, let me find patch | 15:05 |
| bcafarel | https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/813840 fixes it (by pinning version) | 15:05 |
| bcafarel | I have another patch in progress to update the excluded tests list https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815458 as some tests are unstable in that pinned version | 15:05 |
| slaweq | bcafarel: ok, please let me know when this will be ready to go, I will review it | 15:06 |
| mnaser_ | hi folks | 15:07 |
| slaweq | mnaser_: hi | 15:07 |
| mnaser_ | is there any good way of profiling neutron-server api calls :) | 15:07 |
| mnaser_ | i've got a stein deployment (yes i know :() with around ~1500 ports | 15:07 |
| bcafarel | slaweq: sure! running a few rechecks to see if we should filter out a few extra ones, I will ping when ready for review) | 15:07 |
| slaweq | mnaser_: we are now in the middle of the ci meeting :) | 15:07 |
| mnaser_ | and occasionally see api calls that take nearly 2-3s | 15:07 |
| mnaser_ | oh im sorry, i didnt see the topic update, /me hides | 15:07 |
| mnaser_ | (i saw end meeting earlier but didntsee the new start) | 15:08 |
| slaweq | mnaser_: np | 15:08 |
| slaweq | mnaser_: in the dev env You can use https://docs.openstack.org/neutron/latest/contributor/internals/code_profiling.html | 15:08 |
| slaweq | would that be ok for You? | 15:09 |
| slaweq | ok, let's get back to the ci :) | 15:09 |
| slaweq | I guess we can skip stadium projects today as lajoskatona is off | 15:09 |
| slaweq | so lets move on directly to the next one | 15:09 |
| slaweq | #topic Stable branches | 15:09 |
| slaweq | bcafarel: any updates, except that Stein fix | 15:09 |
| bcafarel | I have https://bugs.launchpad.net/neutron/+bug/1948804 for train | 15:10 |
| bcafarel | neutron-tempest-plugin jobs fail as they do not find guestmount, seems related to the switch to minimal image | 15:10 |
| slaweq | ups | 15:11 |
| slaweq | so we should use normal image for train jobs probably | 15:11 |
| bcafarel | with these branches I guess just switching back to older image should be good enough fix | 15:11 |
| slaweq | yeah | 15:11 |
| bcafarel | ok I wanted to confirm before sending patch :) I will get one out | 15:11 |
| slaweq | thx a lot | 15:11 |
| slaweq | #action bcafarel to switch to use regular ubuntu image in the train jobs, related to https://bugs.launchpad.net/neutron/+bug/1948804 | 15:12 |
| bcafarel | full support branches are good, we should just watch out to clear out the backports queue before ussuri gets its last release | 15:12 |
| slaweq | ahh, ussuri is going to EM soon, right? | 15:12 |
| bcafarel | yes http://lists.openstack.org/pipermail/openstack-discuss/2021-October/025276.html https://etherpad.opendev.org/p/neutron-stable-ussuri-em | 15:13 |
| bcafarel | planned date is 2021-11-12 | 15:13 |
| slaweq | thx, I will check that etherpad this week | 15:14 |
| bcafarel | and that's all for stable | 15:15 |
| slaweq | thx bcafarel | 15:16 |
| slaweq | so let's move on | 15:16 |
| slaweq | #topic Grafana | 15:16 |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:16 |
| slaweq | in general I don't see any major issues on the graphs | 15:16 |
| slaweq | even fullstack/functional jobs are pretty ok this week | 15:17 |
| slaweq | do You have anything regarding our dashboard or can we move on? | 15:18 |
| bcafarel | looks good to me (which is nice to say) | 15:19 |
| slaweq | ok, so lets talk about some specific jobs | 15:19 |
| slaweq | #topic fullstack/functional | 15:19 |
| slaweq | here I found 2 failures which looked pretty similar: | 15:19 |
| slaweq | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_eff/815280/2/check/neutron-functional-with-uwsgi/eff69a3/testr_results.html | 15:19 |
| slaweq | https://02ffbd184b4d2054d841-93a4b6f56916009ea1b2d500657cc17f.ssl.cf1.rackcdn.com/802037/4/check/neutron-functional-with-uwsgi/9be975c/testr_results.html | 15:19 |
| slaweq | anyone wants to investigate that? | 15:20 |
| ralonsoh | I'll do it | 15:20 |
| ralonsoh | is there a LP bug? | 15:20 |
| slaweq | ralonsoh++ thx | 15:20 |
| slaweq | no, I didn't opened bug yet | 15:20 |
| ralonsoh | I'll create one | 15:21 |
| slaweq | thx | 15:21 |
| slaweq | #action ralonsoh to open LP bug and check functional failure with missing snat namespace | 15:21 |
| slaweq | #topic Tempest/Scenario | 15:21 |
| slaweq | and that's main topic for today :) | 15:21 |
| slaweq | because we still have https://bugs.launchpad.net/neutron/+bug/1944201 which is killing our CI | 15:22 |
| slaweq | generally about 95% of ovs scenario jobs are failing due to that issue | 15:22 |
| slaweq | ralonsoh: has some idea how to improve that | 15:22 |
| ralonsoh | https://review.opendev.org/c/openstack/neutron/+/815459 | 15:22 |
| ralonsoh | and CI is passing | 15:23 |
| slaweq | thx ralonsoh | 15:23 |
| slaweq | I +2 it | 15:23 |
| slaweq | obondarev: and I also replied to Your comment there | 15:24 |
| ralonsoh | I did too | 15:24 |
| slaweq | neutron-ovs-agent is not using greenthreads AFAIR | 15:24 |
| ralonsoh | it is | 15:24 |
| slaweq | so it should be ok IMO | 15:24 |
| ralonsoh | we monkey patch all agents | 15:24 |
| slaweq | ahh | 15:24 |
| ralonsoh | but I replied to the comment | 15:24 |
| ralonsoh | there is one single thread executing the ovs agent code | 15:24 |
| ralonsoh | other threads are attending rpc events, ovsdb updates or OF events | 15:25 |
| slaweq | ahh, right, things like fdb_add/remove are processed by separate greenthread workers | 15:25 |
| ralonsoh | exactly | 15:25 |
| slaweq | or port/network_update notifications | 15:25 |
| slaweq | ok | 15:25 |
| slaweq | ralonsoh: I rechecked it to see once again results :) | 15:26 |
| slaweq | I hope You don't mind | 15:26 |
| ralonsoh | perfect | 15:26 |
| slaweq | I hope that this will help | 15:27 |
| slaweq | for now lets move on | 15:27 |
| obondarev | ralonsoh: I'll check your reply, thanks | 15:27 |
| slaweq | as follow up from the ptg discussions I proposed today improvement of our CI: https://review.opendev.org/c/openstack/neutron/+/815465 | 15:27 |
| obondarev | ralonsoh: aren't rpc threads using os_ken? | 15:28 |
| ralonsoh | obondarev, no, only main thread. But we can talk later | 15:29 |
| obondarev | sure, thanks | 15:29 |
| ralonsoh | slaweq, just one comment | 15:29 |
| ralonsoh | "neutron-ovn-tempest-slow" is multinode but "neutron-ovn-tempest-ipv6" is single node | 15:29 |
| slaweq | ralonsoh: yes, I just noticed that | 15:29 |
| ralonsoh | but I think the patch is valid | 15:29 |
| slaweq | we can make neutron-ovn-tempest-ipv6 to be multinode job | 15:29 |
| slaweq | and still we will have less jobs :) | 15:29 |
| ralonsoh | perfect | 15:29 |
| ralonsoh | exactly | 15:29 |
| ralonsoh | +1 to this idea | 15:30 |
| slaweq | ok, I will update my patch and ping You to review it again | 15:30 |
| slaweq | obondarev: bcafarel please also review it and tell me what do You think about it | 15:30 |
| obondarev | sure | 15:30 |
| bcafarel | slaweq: sure, already in my to-review tabs :) | 15:30 |
| slaweq | thx | 15:30 |
| slaweq | it should remove 4 jobs from our check queue and 2 jobs from gate | 15:31 |
| slaweq | so IMHO good improvement :) | 15:31 |
| ralonsoh | of course! | 15:31 |
| slaweq | ok, moving on | 15:32 |
| slaweq | during checking today ci results I noticed that in some cases size of neutron logs is insane | 15:32 |
| slaweq | like e.g. linuxbridge log in https://94d5d118ec3db75721c2-a00e37315b6784119b950c4b112ef30c.ssl.cf2.rackcdn.com/807687/4/gate/neutron-tempest-plugin-scenario-linuxbridge/b23d411/controller/logs/screen-q-agt.txt | 15:32 |
| slaweq | which is about 200 MB | 15:32 |
| ralonsoh | the iptables debug mode | 15:33 |
| ralonsoh | that will add a huge extra to the log file | 15:33 |
| slaweq | ahh, right | 15:33 |
| slaweq | we enabled it some time ago in other agents too IIRC | 15:33 |
| slaweq | ok | 15:34 |
| slaweq | that's all what I had for today regarding scenario jobs | 15:34 |
| slaweq | #topic On Demand | 15:34 |
| slaweq | anything else You want to discuss today? | 15:34 |
| ralonsoh | I'm ok | 15:34 |
| slaweq | ok, 2 quick things from me | 15:35 |
| slaweq | as follow up after ptg, please expect some doodle with question about time slot for that meeting | 15:36 |
| slaweq | I will try to send it this week | 15:36 |
| slaweq | I will send email to the ML | 15:36 |
| slaweq | and second thing: | 15:36 |
| slaweq | also as a result of the CI discussion | 15:36 |
| slaweq | *ptg discussion | 15:36 |
| slaweq | next week we can do meeting on video - wdyt? | 15:36 |
| obondarev | + | 15:37 |
| slaweq | and keep irc opened for all the time to have action items, etc. | 15:37 |
| ralonsoh | +1 to video calls | 15:37 |
| slaweq | #action slaweq to prepare doodle with question about new time slot for CI meetings | 15:37 |
| ralonsoh | will be nice to have at least one video call per week | 15:38 |
| slaweq | #action slaweq to prepare ci meeting on tue 2.11 as video call | 15:38 |
| slaweq | and that's all from me for today | 15:38 |
| slaweq | if You don't have anything else, I think we can finish earlier today | 15:39 |
| bcafarel | sounds good for both (well for all 3 topics with "finish earlier") | 15:39 |
| slaweq | LOL | 15:39 |
| slaweq | thx for attending meeting today | 15:39 |
| ralonsoh | bye! | 15:39 |
| slaweq | and see You all online | 15:39 |
| bcafarel | o/ | 15:39 |
| slaweq | #endmeeting | 15:39 |
| opendevmeet | Meeting ended Tue Oct 26 15:39:55 2021 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:39 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-10-26-15.00.html | 15:39 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-10-26-15.00.txt | 15:39 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2021/neutron_ci.2021-10-26-15.00.log.html | 15:39 |
| obondarev | o/ | 15:39 |
| obondarev | ralonsoh: regarding greenthreads in OVS agent - I think I got what you mean: only thread running rpc_loop is doing os_ken calls, right? | 15:40 |
| ralonsoh | yes, the rpc loop (very bad naming) | 15:40 |
| ralonsoh | this is the only one doing those calls | 15:40 |
| obondarev | for fdb_add() - isn't it called by rpc thread? | 15:40 |
| ralonsoh | no, it isn't | 15:41 |
| ralonsoh | this is an event called method | 15:42 |
| ralonsoh | I mean this is actually an RPC event driven method | 15:42 |
| obondarev | ralonsoh: it's called by rpc callback https://github.com/openstack/neutron/blob/master/neutron/plugins/ml2/drivers/l2pop/rpc_manager/l2population_rpc.py#L37-L39 | 15:45 |
| ralonsoh | yes, it is | 15:45 |
| obondarev | I thought those are executed by separate green thread | 15:46 |
| ralonsoh | this is not in the main thread | 15:46 |
| ralonsoh | it is, yes | 15:46 |
| ralonsoh | but this call returns quickly | 15:46 |
| ralonsoh | the life of this execution is short | 15:46 |
| obondarev | I see, workaround is still valid anyway | 15:47 |
| obondarev | just wanted to confirm | 15:47 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: Remove some scenario jobs from the check and gate queues https://review.opendev.org/c/openstack/neutron/+/815465 | 15:47 |
| ralonsoh | obondarev, no, you are right there | 15:47 |
| ralonsoh | I missed this part, the l2pop | 15:47 |
| obondarev | ralonsoh: prabably a blocking (not monkey patched) sleep() would be better, right? | 15:48 |
| ralonsoh | obondarev, time library is monkey patched | 15:48 |
| obondarev | not sure I remember how it could be done, yeah | 15:48 |
| ralonsoh | it is the same calling time.sleep and eventlet.time | 15:49 |
| ralonsoh | sorry evenlet.sleep | 15:49 |
| obondarev | yes | 15:49 |
| ralonsoh | it is possible, maybe, to refer to the patched library, accessing to the evenlet dictionary | 15:49 |
| ralonsoh | were all patches libraries are listed | 15:49 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron-tempest-plugin master: [stable/{train,stein}] Use old guest image for these branches https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815518 | 15:50 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/train: Remove dhcp_extra_opt name after first newline character https://review.opendev.org/c/openstack/neutron/+/810878 | 15:50 |
| opendevreview | Lucas Alvares Gomes proposed openstack/networking-ovn stable/train: [ovn] Stop monitoring the SB MAC_Binding table to reduce mem footprint https://review.opendev.org/c/openstack/networking-ovn/+/814878 | 15:59 |
| opendevreview | Merged openstack/networking-bgpvpn stable/xena: Dropping lower constraints testing (stable Xena) https://review.opendev.org/c/openstack/networking-bgpvpn/+/815505 | 16:32 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [TESTING ONLY- DNM]Add Local IP Extension and DB https://review.opendev.org/c/openstack/neutron/+/815095 | 16:37 |
| opendevreview | Merged openstack/neutron master: Remove trunk related functions from neutron devstack plugin https://review.opendev.org/c/openstack/neutron/+/812658 | 18:04 |
| opendevreview | Merged openstack/neutron master: Enhanced set of warnings if an answers file or a templates directory is used. https://review.opendev.org/c/openstack/neutron/+/812762 | 18:04 |
| opendevreview | Merged openstack/neutron master: Check subnet in "_remove_subnet_dhcp_options" https://review.opendev.org/c/openstack/neutron/+/815280 | 19:06 |
| opendevreview | Merged openstack/neutron master: Replace "tenant_id" with "project_id" https://review.opendev.org/c/openstack/neutron/+/814805 | 19:17 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron-tempest-plugin master: [stable/stein] Regroup tests exclusion list and add new failing ones https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815458 | 19:47 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/stein: [DNM] Test neutron-tempest-plugin fix https://review.opendev.org/c/openstack/neutron/+/813841 | 19:47 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron-tempest-plugin master: [stable/{train,stein}] Use old guest image for these branches https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/815518 | 19:49 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!