| opendevreview | Brian Haley proposed openstack/neutron master: Delete network namespace on last port deletion https://review.opendev.org/c/openstack/neutron/+/880006 | 00:43 |
|---|---|---|
| opendevreview | Brian Haley proposed openstack/neutron master: Delete network namespace on last port deletion https://review.opendev.org/c/openstack/neutron/+/880006 | 00:53 |
| opendevreview | liuyulong proposed openstack/neutron master: Refactor for ovs qos driver meter limit features https://review.opendev.org/c/openstack/neutron/+/860766 | 01:52 |
| opendevreview | liuyulong proposed openstack/neutron master: Add meter bandwidth limit support https://review.opendev.org/c/openstack/neutron/+/860767 | 01:52 |
| opendevreview | yatin proposed openstack/neutron stable/zed: [stable/zed only] Drop -master jobs https://review.opendev.org/c/openstack/neutron/+/880020 | 06:38 |
| opendevreview | yatin proposed openstack/neutron stable/2023.1: [stable/2023.1 only] Drop -master jobs https://review.opendev.org/c/openstack/neutron/+/880021 | 06:43 |
| opendevreview | yatin proposed openstack/ovn-octavia-provider stable/2023.1: [stable/2023.1 only] Drop -master jobs https://review.opendev.org/c/openstack/ovn-octavia-provider/+/880022 | 06:49 |
| *** elodilles_pto is now known as elodilles | 07:24 | |
| lajoskatona | sahid: Hi, sorry for disturbing, could you please check this bug: https://bugs.launchpad.net/ubuntu/+source/neutron/+bug/2015090 , as I see the reporter beleives that hit one of the corner-cases of the multisegment work | 07:52 |
| sahid | lajoskatona: o/ hello, sure give me a moment i will look at it | 08:04 |
| sahid | i think haleyb aslo noticed an interesting one :D | 08:05 |
| lajoskatona | sahid: thanks | 08:07 |
| sahid | lajoskatona: I replied, hum... yes looks like a corner case, i asked whether we can get a bit more details | 08:34 |
| opendevreview | Merged openstack/neutron master: Fix NoSuchOptError error in Ipam unit tests https://review.opendev.org/c/openstack/neutron/+/879908 | 08:40 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-tempest-plugin master: Set unlimited SG rules quota in security groups scenario tests https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/880029 | 09:18 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-tempest-plugin master: Set unlimited SG rules quota in security groups scenario tests https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/880029 | 09:20 |
| opendevreview | Slawek Kaplonski proposed openstack/python-neutronclient master: Remove the CLI code from the Neutron client. https://review.opendev.org/c/openstack/python-neutronclient/+/871711 | 09:56 |
| opendevreview | Slawek Kaplonski proposed openstack/python-neutronclient master: Remove the CLI code from the Neutron client. https://review.opendev.org/c/openstack/python-neutronclient/+/871711 | 10:49 |
| opendevreview | Merged openstack/neutron stable/zed: [stable/zed only] Drop -master jobs https://review.opendev.org/c/openstack/neutron/+/880020 | 10:51 |
| opendevreview | Merged openstack/neutron stable/2023.1: [stable/2023.1 only] Drop -master jobs https://review.opendev.org/c/openstack/neutron/+/880021 | 10:51 |
| sahid | o/ an easy one that is missing +w https://review.opendev.org/c/openstack/neutron/+/872762 if someone avail :-) | 10:53 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/wallaby: Reset member provisioning status to NO_MONITOR when a HM is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876509 | 10:55 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/yoga: Reset member provisioning status to NO_MONITOR when a HM is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876501 | 11:05 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/zed: Reset member provisioning status to NO_MONITOR when a HM is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876498 | 11:08 |
| opendevreview | Slawek Kaplonski proposed openstack/python-neutronclient master: Remove the CLI code from the Neutron client. https://review.opendev.org/c/openstack/python-neutronclient/+/871711 | 11:13 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/wallaby: Remove HM uuiid from LB external_ids when the HM's pool is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876510 | 11:14 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/yoga: Remove HM uuiid from LB external_ids when the HM's pool is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876502 | 11:14 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/zed: Remove HM uuiid from LB external_ids when the HM's pool is deleted https://review.opendev.org/c/openstack/ovn-octavia-provider/+/876499 | 11:14 |
| opendevreview | Merged openstack/neutron master: rbacs: fix typo, s/cxt/ctx https://review.opendev.org/c/openstack/neutron/+/872762 | 12:32 |
| opendevreview | Lajos Katona proposed openstack/networking-bagpipe master: [sqlalchemy-20] Remove subtransactions=True https://review.opendev.org/c/openstack/networking-bagpipe/+/879463 | 12:57 |
| opendevreview | yatin proposed openstack/neutron master: [WIP] Switch fullstack/functional fips jobs to 9-stream https://review.opendev.org/c/openstack/neutron/+/843245 | 12:59 |
| ralonsoh | slaweq, please check | 13:56 |
| ralonsoh | https://review.opendev.org/c/openstack/neutron/+/879330 | 13:56 |
| ralonsoh | this is the last patch to release xena | 13:56 |
| slaweq | Sure. Give me a minute and I will check it | 13:57 |
| ralonsoh | ping bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, sahid, slawek, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki | 14:00 |
| mtomaska | o/ | 14:00 |
| ykarel | o/ | 14:00 |
| slaweq | o/ | 14:01 |
| lajoskatona | o/ | 14:01 |
| sahid | o/ | 14:01 |
| ralonsoh | #startmeeting networking | 14:01 |
| opendevmeet | Meeting started Tue Apr 11 14:01:06 2023 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| opendevmeet | The meeting name has been set to 'networking' | 14:01 |
| mlavalle2 | o/ | 14:01 |
| ralonsoh | hi all | 14:01 |
| rubasov | o/ | 14:01 |
| ralonsoh | ok, let's start | 14:02 |
| ralonsoh | #topic announcements | 14:02 |
| ralonsoh | we have a new schedule | 14:02 |
| ralonsoh | #link https://releases.openstack.org/bobcat/schedule.html | 14:02 |
| elvira | o/ | 14:02 |
| frickler | \o | 14:03 |
| ralonsoh | so please check the dates and get used to this new cycle | 14:03 |
| ralonsoh | and welcome, of course | 14:03 |
| ralonsoh | also please remember the Vancouver etherpad | 14:03 |
| ralonsoh | #link https://etherpad.opendev.org/p/neutron-vancouver-2023 | 14:03 |
| ralonsoh | let me be honest: we need more topics and attendands | 14:04 |
| ralonsoh | I know during the vPTG we had a packed agenda | 14:04 |
| ralonsoh | and we discussed many topics | 14:04 |
| ralonsoh | but if the agenda of vancouver doesn't grow, I don't think I'll attend (I'll be able to) | 14:05 |
| ralonsoh | and if you missed that last wee | 14:05 |
| ralonsoh | week | 14:05 |
| ralonsoh | #link https://lists.openstack.org/pipermail/openstack-discuss/2023-April/033115.html | 14:06 |
| ralonsoh | something else? | 14:06 |
| ralonsoh | ok, let's jump to the funny topic | 14:06 |
| ralonsoh | #topic bugs | 14:06 |
| ralonsoh | we have two reports | 14:07 |
| ralonsoh | one from mlavalle2 | 14:07 |
| ralonsoh | https://lists.openstack.org/pipermail/openstack-discuss/2023-April/033184.html | 14:07 |
| ralonsoh | and the next one from rubasov | 14:07 |
| ralonsoh | https://lists.openstack.org/pipermail/openstack-discuss/2023-April/033279.html | 14:07 |
| ralonsoh | there are some pending/not assigned bugs | 14:07 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2013326 | 14:07 |
| ralonsoh | slaweq, ^^ is this one related to policies? | 14:07 |
| ralonsoh | srbac? | 14:08 |
| slaweq | yes | 14:08 |
| ralonsoh | ok perfect, will you assign it yo you? | 14:08 |
| ralonsoh | I'll do it, yes | 14:09 |
| slaweq | yes, thx | 14:09 |
| ralonsoh | thanks! | 14:09 |
| ralonsoh | next one | 14:09 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2012332 | 14:09 |
| ralonsoh | this is a RFE | 14:09 |
| ralonsoh | I've added it to the drivers agenda next friday | 14:09 |
| ralonsoh | but I hope Liu takes it, I'll ping him | 14:10 |
| ralonsoh | ok, next one | 14:10 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2015065 | 14:10 |
| ralonsoh | this one is not 100% happening but very very often | 14:10 |
| ralonsoh | and if I'm not wrong, is always failing in the same point | 14:12 |
| lajoskatona | only in grenade? | 14:12 |
| ralonsoh | during the SG creation | 14:12 |
| ralonsoh | yes | 14:12 |
| ralonsoh | only in this job | 14:12 |
| lajoskatona | interesting | 14:12 |
| rubasov | yes, I believe it's always failing the same way | 14:12 |
| lajoskatona | I can check it | 14:13 |
| ralonsoh | cool, thanks a lot (my agenda is full this week, sorry) | 14:13 |
| ralonsoh | next one | 14:13 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2015364 | 14:13 |
| ralonsoh | related to grenade too | 14:13 |
| ralonsoh | this time the -skip-tests, only in OVN | 14:14 |
| ralonsoh | these 4 jobs (actually 3 plus a class) are always failing | 14:14 |
| ralonsoh | are we installing a different version of OVN? I think so | 14:15 |
| ralonsoh | ok, I'll check them with ykarel if he has time | 14:16 |
| ykarel | sure i can check this issue | 14:16 |
| ralonsoh | or I'll ping infra folks to stop an env once failed | 14:16 |
| ralonsoh | I appreciate that, thanks! | 14:17 |
| ykarel | but yes looks like something wrong with ovn version | 14:17 |
| ralonsoh | that's what I think (but I can't support with facts what I'm saying) | 14:17 |
| ykarel | ack i will dig | 14:17 |
| ralonsoh | these are passing in OVS (and we are executing the same test set) | 14:17 |
| ralonsoh | ok, next one is | 14:18 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2015449 | 14:18 |
| ralonsoh | frickler, can you provide some update on this one? | 14:18 |
| frickler | well it sounds like intra-subnet traffic may be natted by ovn to the FIP attached to an instance | 14:19 |
| rubasov | I had no reproduction yet, but I was unsure about whether we consider the described behavior a bug or an unfortunate undocumented behavior | 14:19 |
| frickler | but somebody will need to try to reproduce that I guess | 14:19 |
| ralonsoh | that was my first question: ovs or ovn | 14:19 |
| ralonsoh | so OVN, I'll make a comment in the bug | 14:19 |
| rubasov | by the way I will follow up on the bugs in the "triage in progress" section in my report | 14:19 |
| rubasov | no need to take over from the next deputy | 14:20 |
| ralonsoh | thanks | 14:20 |
| frickler | oh, I was assuming ovn, but maybe not | 14:20 |
| ralonsoh | I'll ask that in the BZ | 14:20 |
| ralonsoh | and in case of OVS, what FW driver | 14:20 |
| ralonsoh | ok, once replied, I'll try to reproduce it | 14:21 |
| frickler | for me, as noted in the last comment, fw behavior seems correct, just natting shouldn't happen | 14:21 |
| ralonsoh | yeah, looks like | 14:21 |
| ralonsoh | ok, once we have the answer, I'll deploy an env and reproduce it | 14:22 |
| frickler | also ask for ovn/ovs versions | 14:22 |
| ralonsoh | sure | 14:22 |
| ralonsoh | ok, and the last one I have is | 14:23 |
| ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2015275 | 14:23 |
| ralonsoh | I added a comment today | 14:23 |
| ralonsoh | related to why the RPC is attended in just one worker | 14:23 |
| ralonsoh | this is a problem of how it was designed | 14:23 |
| ralonsoh | so it will require a proper refactor | 14:24 |
| ralonsoh | does anyone have time/energy/will to do it? | 14:24 |
| ralonsoh | ok, I'll assign it to myself | 14:25 |
| ralonsoh | ok, and that's all for today | 14:25 |
| sahid | ralonsoh: you can assign it to myself | 14:25 |
| ralonsoh | sahid, perfect, this is not a trivial refactor | 14:26 |
| ralonsoh | thanks for that | 14:26 |
| sahid | sure i think it will be interesting to look in that part of the code | 14:26 |
| ralonsoh | ok, this week I'm the bug deputy | 14:26 |
| ralonsoh | next week is lucasagomes | 14:27 |
| ralonsoh | btw, do we have new volunteers to be added to the deputy list? | 14:27 |
| ralonsoh | as commented during the PTG | 14:27 |
| ralonsoh | you can take your time and ping me in IRC at any time | 14:27 |
| ralonsoh | check https://wiki.openstack.org/wiki/Network/Meetings | 14:28 |
| ralonsoh | let's move on | 14:28 |
| sahid | ralonsoh: please add me on it | 14:28 |
| ralonsoh | I'll do it | 14:28 |
| ralonsoh | ok | 14:28 |
| ralonsoh | we don't have new specs | 14:28 |
| ralonsoh | nor os-ken issues | 14:28 |
| ralonsoh | so we can jump to the next topic | 14:29 |
| ralonsoh | #topic community_goals | 14:29 |
| ralonsoh | about sRBAC, I don't think slaweq has any new | 14:29 |
| slaweq | actually I have | 14:29 |
| ralonsoh | sorry! | 14:29 |
| slaweq | last week I started working on switch to new policies by default | 14:29 |
| slaweq | I sent patch: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/879828 | 14:30 |
| slaweq | and WIP https://review.opendev.org/c/openstack/neutron/+/879827 | 14:30 |
| slaweq | that last one is going to be a lot of work as there is still almost 2k of UT failing there :/ | 14:30 |
| slaweq | but I'm working on it | 14:30 |
| slaweq | during debugging of those failed UT I found out small issue in new policy for get_ports | 14:31 |
| slaweq | and I sent fix https://review.opendev.org/c/openstack/neutron/+/879891 | 14:31 |
| ralonsoh | "test_port_list_queries_constant" still failing | 14:32 |
| slaweq | and this is now puzzling me as 2 UT are failing there | 14:32 |
| slaweq | this failure is somehow related to that patch | 14:32 |
| slaweq | but I have no idea how | 14:32 |
| slaweq | and if I run only that one test locally, it is passing | 14:32 |
| slaweq | ralonsoh maybe we can talk about this failing test later offline? | 14:32 |
| ralonsoh | yeah, I'll check them today (or tomorrow morning) | 14:32 |
| slaweq | thx | 14:32 |
| slaweq | and that's my update about S-RBAC for this week | 14:33 |
| ralonsoh | thanks, I'll add these patches to the meeting agenda | 14:33 |
| ralonsoh | to track them | 14:33 |
| ralonsoh | next one is | 14:33 |
| ralonsoh | 2) Neutron client deprecation | 14:34 |
| ralonsoh | lajoskatona, any new topic? | 14:34 |
| lajoskatona | The usual etherpad: https://etherpad.opendev.org/p/python-neutronclient_deprecation | 14:34 |
| lajoskatona | not much | 14:34 |
| lajoskatona | designate seems to be finished, and octavia is slowly progressing (not me who works on it | 14:34 |
| ralonsoh | do you have any pending patch in SDK or OSC? | 14:35 |
| lajoskatona | and sahid started to check how nova can be changed to use sdk | 14:35 |
| lajoskatona | https://review.opendev.org/q/topic:bug/1999774+status:open | 14:35 |
| lajoskatona | these are for neutronclient, but to change the current cli code to use sdk only | 14:36 |
| ralonsoh | ok | 14:36 |
| slaweq | I have small update related to this one too. I spent today some time checking ralonsoh's patch https://review.opendev.org/c/openstack/python-neutronclient/+/871711 and I finally made it to be green in CI. So maybe we will be able to finally get rid of "neutron" CLI tool in this cycle | 14:36 |
| lajoskatona | slaweq: you mean to remove all code that is realted to core Neutron CLI? | 14:37 |
| ralonsoh | but ps7 is not removing the CLI code? | 14:37 |
| slaweq | lajoskatona not all code really | 14:37 |
| slaweq | but at least remove some of bits related to CLI tool and "neutron" command | 14:37 |
| slaweq | and to not provide this CLI tool, bash completion and other related things at all | 14:38 |
| ralonsoh | yeah, at least the shell class | 14:38 |
| slaweq | so users will not have "neutron" command available anymore | 14:38 |
| ralonsoh | we can't remove some nclient modules (still used by many other projects) | 14:38 |
| slaweq | parts from neutronclient/neutron/v2_0 needs to be still there as e.g. nova is using it | 14:38 |
| ralonsoh | but I'm ok removing the shell class | 14:38 |
| lajoskatona | I will check it, as I see it also removes some unit tests related to bgp for example but that code remains in neutronclient | 14:38 |
| slaweq | but shell.py and everything what depends on it can be removed probably | 14:39 |
| lajoskatona | yeah that can be removed (theoretically :P) | 14:39 |
| ralonsoh | and all FT/UT related | 14:39 |
| slaweq | lajoskatona yes, it removes most of the UT as those tests were importing shell.py module | 14:39 |
| slaweq | and those are "CLI" tests really | 14:39 |
| lajoskatona | ok, I will check it | 14:40 |
| slaweq | thx | 14:40 |
| ralonsoh | I need to check again if I sent the mail to make this public | 14:40 |
| ralonsoh | It was years ago but again as a heads-up | 14:41 |
| ralonsoh | ok, please check this patch | 14:41 |
| ralonsoh | and thanks slaweq | 14:41 |
| ralonsoh | and that's all in this topic | 14:41 |
| slaweq | ++ thx a lot | 14:41 |
| ralonsoh | next one | 14:42 |
| ralonsoh | #topic on_demand | 14:42 |
| ralonsoh | lajoskatona, you have a topic there | 14:42 |
| ralonsoh | 2 actually | 14:42 |
| lajoskatona | yes, I added here as reminder as we discussed the PTG to list some forum topic ideas | 14:42 |
| lajoskatona | that is the first one | 14:43 |
| lajoskatona | so if you have forum ideas which can be discussed during the Vancouver summit/PTG please .... | 14:43 |
| lajoskatona | I have one but perhaps that is not worth a whole forum: to discuss the deprecation of Neutronclient | 14:44 |
| lajoskatona | this whould not be interesting for users, but for deveopers of other projects it can be interesting | 14:44 |
| ralonsoh | I need to check with slaweq (I didn't have time) some suggestions he has | 14:45 |
| ralonsoh | in any case we still have time to add more topics | 14:45 |
| ralonsoh | the second one is related to Xena release | 14:46 |
| ralonsoh | https://review.opendev.org/c/openstack/releases/+/878874 | 14:46 |
| ralonsoh | I've updated (wrongly) the patch | 14:46 |
| ralonsoh | note: for a EM branch, it is needed a new release | 14:46 |
| ralonsoh | there is one missing patch for Neutron | 14:46 |
| lajoskatona | yeah just a headsup that Xena is planned to EMed soon | 14:46 |
| ralonsoh | that was +W by slaweq | 14:46 |
| ralonsoh | https://review.opendev.org/c/openstack/neutron/+/879330 | 14:46 |
| ralonsoh | so I think we'll be able to push a final releases patch tomorrow morning | 14:47 |
| ralonsoh | last day is 20th of April | 14:47 |
| ralonsoh | but as commented, tomorrow I'll push the patch that should be the one accepted | 14:48 |
| ralonsoh | and that's all for today | 14:48 |
| lajoskatona | cool, thanks | 14:48 |
| ralonsoh | remember the CI meeting is in 10 mins | 14:48 |
| mlavalle2 | video or irc? | 14:48 |
| ralonsoh | do you have any other topic? | 14:48 |
| slaweq | thx ralonsoh | 14:48 |
| slaweq | it's irc this week | 14:48 |
| ralonsoh | cool | 14:48 |
| mlavalle2 | ack | 14:48 |
| lajoskatona | ack | 14:48 |
| ralonsoh | so thank all | 14:49 |
| ralonsoh | #endmeeting | 14:49 |
| opendevmeet | Meeting ended Tue Apr 11 14:49:07 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:49 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2023/networking.2023-04-11-14.01.html | 14:49 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2023/networking.2023-04-11-14.01.txt | 14:49 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2023/networking.2023-04-11-14.01.log.html | 14:49 |
| lajoskatona | o/ | 14:49 |
| slaweq | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Apr 11 15:00:14 2023 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| ralonsoh | hello | 15:00 |
| slaweq | ping bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 15:00 |
| mtomaska | o/ | 15:00 |
| slaweq | CI meeting is starting :) | 15:00 |
| slaweq | o/ | 15:00 |
| slaweq | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:00 |
| slaweq | Please open now :) | 15:00 |
| mlavalle2 | o/ | 15:00 |
| lajoskatona | o/ | 15:01 |
| ykarel | o/ | 15:02 |
| slaweq | ok, lets start | 15:02 |
| slaweq | #topic Actions from previous meetings | 15:02 |
| slaweq | ralonsoh to move neutron.tests.functional.plugins.ml2.drivers.macvtap.agent.test_macvtap_neutron_agent.MacvtapAgentTestCase.test_get_all_devices to be run in "serial" stage | 15:02 |
| ralonsoh | and somethign else, I'll find the patches | 15:02 |
| ralonsoh | please, continue, I'll post them here | 15:03 |
| slaweq | ok | 15:03 |
| slaweq | so next one | 15:03 |
| slaweq | mtomaska to fix waiting for SB events in ovn metadata functional tests | 15:03 |
| mtomaska | yes, please see linked patch | 15:03 |
| mtomaska | https://review.opendev.org/c/openstack/neutron/+/878549 | 15:03 |
| slaweq | thx mtomaska I will review it soon | 15:04 |
| slaweq | and last one: | 15:04 |
| slaweq | slaweq to check dhcp issue in fullstack tests | 15:04 |
| slaweq | I didn't had time for it TBH | 15:04 |
| ralonsoh | slaweq, sorry | 15:05 |
| ralonsoh | --> https://review.opendev.org/c/openstack/neutron/+/879029 | 15:05 |
| ralonsoh | (merged) | 15:05 |
| slaweq | so I will assign it to myself for next week | 15:05 |
| slaweq | #action slaweq to check dhcp issue in fullstack tests | 15:05 |
| slaweq | next topic | 15:05 |
| slaweq | #topic Stable branches | 15:05 |
| slaweq | anything to discuss here? bcafarel is not available today but maybe someone else have any topics? | 15:05 |
| slaweq | (thx ralonsoh for the link) | 15:05 |
| ralonsoh | just the problems with grenade | 15:05 |
| ralonsoh | reported in two bugs | 15:05 |
| ralonsoh | (discussed before) | 15:05 |
| mlavalle2 | bcafarel is on pto | 15:06 |
| slaweq | yeah, this issue with grenade is I think most common issue currently in our gate | 15:06 |
| ykarel | https://review.opendev.org/q/topic:drop-master-jobs | 15:06 |
| ykarel | noticed master jobs were running in stable, pushed ^ to cleanup | 15:06 |
| ralonsoh | ^^ good ones | 15:06 |
| lajoskatona | +1 | 15:07 |
| slaweq | thx ykarel | 15:07 |
| slaweq | I just approved ovn-octavia-provider patch | 15:07 |
| ykarel | thx | 15:07 |
| slaweq | which was the only one not approved yet | 15:07 |
| slaweq | so, next topic | 15:08 |
| slaweq | #topic Stadium projects | 15:08 |
| slaweq | still sfc and dynamic-routing jobs with sqlalchemy master are failing | 15:08 |
| lajoskatona | I have a few patches | 15:08 |
| lajoskatona | https://review.opendev.org/q/topic:bug/2004265+status:open | 15:08 |
| slaweq | but this is under control IIRC | 15:08 |
| lajoskatona | https://review.opendev.org/q/topic:oslo_master_periodic+status:open | 15:09 |
| ralonsoh | lajoskatona, thanks! | 15:09 |
| lajoskatona | yes, currently bagpipe is the one which fails with sqlalchemy2 | 15:09 |
| lajoskatona | https://review.opendev.org/c/openstack/networking-bagpipe/+/879463 | 15:09 |
| slaweq | thx lajoskatona for those patches | 15:10 |
| slaweq | I will review them | 15:10 |
| lajoskatona | this patch is to remove subtransactions=True, but there are still some tests are failing | 15:10 |
| ralonsoh | btw, related to sqlalchemy | 15:10 |
| ralonsoh | there is an important patch merged recently | 15:10 |
| ralonsoh | for -master jobs | 15:10 |
| ralonsoh | https://review.opendev.org/c/openstack/oslo.db/+/875986 | 15:10 |
| ralonsoh | ^^ we need to add oslo.db to these jobs too | 15:10 |
| slaweq | don't we have oslo.db from master in those jobs already? | 15:11 |
| ykarel | +1 | 15:11 |
| ralonsoh | I don't know if in networking-* projects | 15:11 |
| ralonsoh | for sure in Neutron | 15:11 |
| slaweq | ahh, ok | 15:11 |
| slaweq | in stadium we may need to check it | 15:11 |
| ralonsoh | I'll check it today and I'll push the patches | 15:11 |
| slaweq | thx | 15:12 |
| slaweq | ralonsoh to check if oslo.db from master branch is used in stadium "sqlalchemy-master" CI jobs | 15:12 |
| lajoskatona | those patches are mostly to add it and neutron master an neutron-lib master | 15:12 |
| ralonsoh | perfect | 15:13 |
| lajoskatona | that's all for this topic from me | 15:13 |
| slaweq | thx | 15:13 |
| slaweq | I think we can move on | 15:13 |
| slaweq | #topic Grafana | 15:13 |
| slaweq | in grafana things looks good IMO in last few days | 15:14 |
| slaweq | so I don't really have anything else to say here | 15:14 |
| slaweq | do You have anything? | 15:14 |
| mlavalle2 | slow activity also | 15:14 |
| mlavalle2 | looks good, yes | 15:15 |
| slaweq | so, next topic (we are fast today :)) | 15:16 |
| slaweq | #topic Rechecks | 15:16 |
| slaweq | here numbers aren't that good: | 15:16 |
| slaweq | +---------+----------+... (full message at <https://matrix.org/_matrix/media/v3/download/matrix.org/stXolUNBHkNjTjoQoOCtwMZH>) | 15:16 |
| slaweq | we have a lot of rechecks in average | 15:16 |
| slaweq | but in many cases it was related to older rechecks, from e.g. 2-3 weeks ago | 15:16 |
| slaweq | or e.g. grenade issue which we discussed already | 15:17 |
| slaweq | I didn't get data about bare rechecks for this week | 15:17 |
| ralonsoh | right, most of them are related to the FTs issues (solved) and grenade | 15:17 |
| slaweq | so that's all from my side there | 15:17 |
| slaweq | ralonsoh exactly | 15:17 |
| slaweq | anything else to add here or can we move on? | 15:18 |
| slaweq | ok, lets move on then | 15:19 |
| slaweq | #topic fullstack/functional | 15:19 |
| slaweq | actually here I have only one thing related to fullstack tests | 15:19 |
| slaweq | ralonsoh added "to talk about fullstack timeouts, what I see in the logs is that in the failed jobs, the (passed) tests take much more time than in a healthy job. So we can just increase the timeout or reduce the number of tests." to the agenda | 15:19 |
| ralonsoh | yeah, this is about the gate queue | 15:20 |
| ralonsoh | where we execute more fullstack tests | 15:20 |
| ralonsoh | where the tests don't fail but last longer than the timeout | 15:20 |
| slaweq | https://zuul.opendev.org/t/openstack/builds?job_name=neutron-fullstack-with-uwsgi&branch=master&result=TIMED_OUT&skip=0 | 15:20 |
| slaweq | last timeout there is from 30.03 | 15:20 |
| slaweq | and last one in gate queue is 08.03 | 15:20 |
| slaweq | so is it still an issue? | 15:21 |
| ralonsoh | TBH, I added this topic a couple of weeks ago | 15:21 |
| slaweq | btw. we are executing the same number of tests in both check and gate queue in this job AFAIK | 15:21 |
| ralonsoh | so +2 to this magic solver | 15:21 |
| slaweq | or at least we should have the same tests running | 15:21 |
| ralonsoh | hmmm I need to check that, I think we execute more tests | 15:21 |
| slaweq | it's the same job in check: https://github.com/openstack/neutron/blob/master/zuul.d/project.yaml#L22 and gate https://github.com/openstack/neutron/blob/master/zuul.d/project.yaml#L72 | 15:22 |
| ralonsoh | dsvm-fullstack-gate is different to dsvm-fullstack | 15:22 |
| slaweq | ahh, right but it's not used in ci gate | 15:22 |
| ykarel | Pass 129 Skip 3 in both check and gate | 15:23 |
| slaweq | it should be more "dsvm-fullstack-ci" rather than "dsvm-fullstack-gate" | 15:23 |
| slaweq | the name may be missleading | 15:23 |
| ralonsoh | perfect | 15:23 |
| ralonsoh | understood | 15:23 |
| slaweq | but in ci job it's always the same tox env env used | 15:23 |
| slaweq | I don't have any new functional tests issues this week | 15:24 |
| slaweq | which is great news :) | 15:24 |
| mlavalle2 | +1 | 15:24 |
| slaweq | I had prepared one issue from grenade job, but it was already discussed | 15:24 |
| slaweq | and lajoskatona IIRC, You are going to check it, right? | 15:25 |
| lajoskatona | exactly | 15:25 |
| slaweq | thx | 15:25 |
| slaweq | #action lajoskatona to check neutron-ovs-grenade-dvr-multinode job's failures | 15:26 |
| slaweq | so lets now go to the last topic for today | 15:26 |
| slaweq | #topic Periodic | 15:26 |
| slaweq | here I have couple of issues noted | 15:26 |
| slaweq | but most of them are already fixed by ykarel :) | 15:27 |
| slaweq | first one: | 15:27 |
| slaweq | neutron-ovn-grenade-multinode-skip-level failing | 15:27 |
| slaweq | I reported https://bugs.launchpad.net/neutron/+bug/2015850 but it's dup of https://bugs.launchpad.net/bugs/2015364 | 15:27 |
| slaweq | and it's assigned to ykarel | 15:27 |
| ykarel | yes i will check it | 15:28 |
| slaweq | neutron-ovn-tempest-ovs-master-centos-9-stream and neutron-ovn-tempest-ipv6-only-ovs-masternext are failures in | 15:29 |
| slaweq | sorry | 15:29 |
| slaweq | next are failures in neutron-ovn-tempest-ovs-master-centos-9-stream and neutron-ovn-tempest-ipv6-only-ovs-master | 15:29 |
| slaweq | both caused by same issue, and ykarel already proposed fixes https://review.opendev.org/q/topic:bug%252F2015728 | 15:29 |
| slaweq | and last one on my list is | 15:29 |
| slaweq | neutron-functional-with-sqlalchemy-master | 15:29 |
| slaweq | bug reported https://bugs.launchpad.net/neutron/+bug/2015847 | 15:29 |
| slaweq | and this one seems like some miscounfiguration and problems with access to db | 15:29 |
| ralonsoh | ^^ fixed by new oslo.db release | 15:29 |
| ralonsoh | I'll take it and check | 15:29 |
| slaweq | ahh, great then | 15:30 |
| ykarel | may be worth to try alembic main version like https://review.opendev.org/c/openstack/oslo.db/+/879546 | 15:30 |
| slaweq | so we should be good with those periodic jobs then | 15:30 |
| ykarel | oslo.db master is used in those jobs, so current issues are not yet fixed | 15:30 |
| ralonsoh | ykarel, exactly | 15:30 |
| ralonsoh | I'll propose this patch too | 15:30 |
| slaweq | ok | 15:31 |
| ykarel | ack +1 | 15:31 |
| slaweq | and with that we got to the end of the agenda for today | 15:31 |
| slaweq | any other topics related to ci You want to discuss today? | 15:31 |
| slaweq | if not, I will give You back some time today | 15:32 |
| slaweq | thx for attending the meeting | 15:32 |
| slaweq | and have a great week :) | 15:32 |
| slaweq | o/ | 15:32 |
| slaweq | #endmeeting | 15:32 |
| opendevmeet | Meeting ended Tue Apr 11 15:32:39 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:32 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-04-11-15.00.html | 15:32 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-04-11-15.00.txt | 15:32 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-04-11-15.00.log.html | 15:32 |
| ralonsoh | bye | 15:32 |
| mlavalle2 | o/ | 15:32 |
| ykarel | bye | 15:32 |
| lajoskatona | o/ | 15:32 |
| mtomaska | o/ | 15:33 |
| noonedeadpunk | Folks, do you have any good idea why dhcp-agent (dnsmasq-dhcp) might ignore DHCPDISCOVER and log that, while MAC in topic is totally valid port? | 15:38 |
| noonedeadpunk | As eventually, both dhcp agents does ignore them | 15:40 |
| noonedeadpunk | so VM doesn't get lease at all | 15:41 |
| noonedeadpunk | eventually, there're just no leases for the network at all according to emtpy /var/lib/neutron/dhcp/<network-uuid>/leases | 15:43 |
| noonedeadpunk | I guess I'm wondering if there's any scenario when such behavior might be valid one or it just means dhcp-agent just stuck? | 15:45 |
| ralonsoh | noonedeadpunk, but did the dhcp agent received the RPC update of this port? did the DHCP configured this new port? what do you have in the network-uuid/hosts file? | 15:46 |
| opendevreview | yatin proposed openstack/neutron-tempest-plugin master: [DNM] non nested virt jammy nodes with workaround https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/879036 | 15:47 |
| noonedeadpunk | ralonsoh: network-uuid/host and network-uuid/addn_hosts are jsut empty | 15:49 |
| ralonsoh | noonedeadpunk, then the DHCP agent didn;'t configure the port | 15:49 |
| ralonsoh | it never received the port update | 15:49 |
| noonedeadpunk | also this is relatively new network in topic (like a week) | 15:50 |
| noonedeadpunk | what is confusing, is that agents claim to be alive in `openstack network agent list` | 15:50 |
| noonedeadpunk | which means they should be able to communicate via RPC | 15:50 |
| ralonsoh | and "openstack network agent list --network <uuid>" | 15:51 |
| ralonsoh | ? | 15:51 |
| noonedeadpunk | yup, also all alive/up | 15:54 |
| noonedeadpunk | https://paste.openstack.org/show/bYHUxCdlKdoUg7iTTHTJ/ | 15:58 |
| noonedeadpunk | I've already spotted dhcp agent being silently stuck, but I wonder how to really detect that | 15:59 |
| opendevreview | Merged openstack/ovn-octavia-provider stable/2023.1: [stable/2023.1 only] Drop -master jobs https://review.opendev.org/c/openstack/ovn-octavia-provider/+/880022 | 15:59 |
| ralonsoh | noonedeadpunk, but where exactly is stuck? | 16:00 |
| noonedeadpunk | well, I mean, how it missed port creation? | 16:00 |
| ralonsoh | did you see that in the logs? | 16:00 |
| ralonsoh | do you have it in debug mode, I guess | 16:00 |
| noonedeadpunk | nah, it's not in debug mode | 16:01 |
| noonedeadpunk | The only thing I see is `Apr 11 15:38:16 net03 dnsmasq-dhcp[3285338]: DHCPDISCOVER(tap13bb2919-cb) fa:16:3e:01:55:22 ignored` | 16:01 |
| noonedeadpunk | once I've restarted neutron-dhcp-agent, host file got populated | 16:01 |
| ralonsoh | so that means dnsmasq received the request but wasnt' configured | 16:02 |
| noonedeadpunk | yup, and there's nothing else in the logfiles for a while | 16:02 |
| noonedeadpunk | also on restart it got updated like ~80 ports | 16:04 |
| noonedeadpunk | biggest question is how to get aware that dhcp agent does not recieve port updates anymore while looking absolutely healthy | 16:05 |
| noonedeadpunk | As it's not the only network affected - eventually every new network that appears to land for these net nodes - don't get port updates, while namespace is still populated.... | 16:06 |
| ralonsoh | if heartbeat is working, the agent is considered alive | 16:06 |
| noonedeadpunk | well. it's weird | 16:07 |
| noonedeadpunk | It happens from time to time to be frank, and most annoyingly that there's nothing in logs that would indicate an issue | 16:11 |
| noonedeadpunk | while issue is quite consistent and only service restart does help | 16:12 |
| opendevreview | Merged openstack/neutron stable/2023.1: Fix concurrent port binding activate https://review.opendev.org/c/openstack/neutron/+/879327 | 16:14 |
| opendevreview | Merged openstack/neutron stable/zed: Fix concurrent port binding activate https://review.opendev.org/c/openstack/neutron/+/879328 | 16:14 |
| opendevreview | Merged openstack/neutron stable/yoga: Fix concurrent port binding activate https://review.opendev.org/c/openstack/neutron/+/879329 | 16:14 |
| opendevreview | Merged openstack/neutron stable/xena: Fix concurrent port binding activate https://review.opendev.org/c/openstack/neutron/+/879330 | 16:14 |
| opendevreview | Merged openstack/neutron stable/wallaby: Fix concurrent port binding activate https://review.opendev.org/c/openstack/neutron/+/879331 | 16:14 |
| opendevreview | Merged openstack/neutron master: Pin OVS_BRANCH to working commit https://review.opendev.org/c/openstack/neutron/+/879938 | 16:47 |
| mnaser | i've been banging my head on this for a while. | 22:54 |
| mnaser | has anyone seen ovn for some reason not set the correct qos on a FIP? | 22:54 |
| mnaser | `ovn-nbctl list qos` shows that there is a rule saying `rate=51200` but for some reason, i am seemingly capped at 10Mbps | 22:55 |
| mnaser | if i remove the qos, there's no limits | 22:55 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!