opendevreview | Miguel Lavalle proposed openstack/neutron-tempest-plugin master: Use OVN version 22.06 https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/848198 | 01:18 |
---|---|---|
*** dasm is now known as dasm|off | 01:44 | |
opendevreview | Miguel Lavalle proposed openstack/neutron master: [WIP][DNM][OVN] Change the default firewall policy https://review.opendev.org/c/openstack/neutron/+/839066 | 04:15 |
slaweq | ralonsoh lajoskatona hi, please check https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/872153 when You will have some time, thx in advance | 07:17 |
opendevreview | liuyulong proposed openstack/neutron master: Notify neutron-server ovs is restarted https://review.opendev.org/c/openstack/neutron/+/872265 | 08:19 |
opendevreview | Luis Tomas Bolivar proposed openstack/ovn-octavia-provider master: Remove LB from LS belonging to provider networks https://review.opendev.org/c/openstack/ovn-octavia-provider/+/871263 | 08:37 |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Accept HA chassis group commands in HAChassisGroupAdd* https://review.opendev.org/c/openstack/ovsdbapp/+/871836 | 09:06 |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Define "LbAddIpPortMappingCommand" with latin chars https://review.opendev.org/c/openstack/ovsdbapp/+/872200 | 09:06 |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Define "LbAddIpPortMappingCommand" with latin chars https://review.opendev.org/c/openstack/ovsdbapp/+/872200 | 09:10 |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: All ``AddCommand`` child classes return the new register UUID https://review.opendev.org/c/openstack/ovsdbapp/+/872187 | 09:47 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: Use SLQAlchemy ORM "relationship" instead of "relation" https://review.opendev.org/c/openstack/neutron/+/872271 | 10:42 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-lib master: [sqlalchemy-20] Use ``Session.get_transaction()`` https://review.opendev.org/c/openstack/neutron-lib/+/872272 | 10:47 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: Propose replacement of ORM from_self() https://review.opendev.org/c/openstack/neutron/+/744512 | 11:01 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: Add CI jobs using SQLAlchemy master branch https://review.opendev.org/c/openstack/neutron/+/872273 | 11:16 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: Removed duplicated job call in experimental queue https://review.opendev.org/c/openstack/neutron/+/872274 | 11:18 |
ralonsoh | slaweq, hi! | 11:20 |
slaweq | ralonsoh: hi | 11:20 |
ralonsoh | do you know where to add a new project? | 11:21 |
ralonsoh | --> https://review.opendev.org/c/openstack/neutron/+/872273 | 11:21 |
ralonsoh | Unknown projects: github.com/sqlalchemy/sqlalchemy | 11:21 |
ralonsoh | for example, github.com/svinota/pyroute2 is a known project | 11:21 |
opendevreview | Merged openstack/neutron-lib master: [sqlalchemy-20] Fix import of "ASSOCIATION_PROXY" https://review.opendev.org/c/openstack/neutron-lib/+/872198 | 11:22 |
slaweq | give me a sec, I will try to check | 11:22 |
ralonsoh | slaweq, ahhhh | 11:22 |
ralonsoh | I know | 11:22 |
ralonsoh | https://opendev.org/openstack/project-config/src/branch/master/zuul/main.yaml | 11:22 |
slaweq | yeah | 11:23 |
slaweq | ralonsoh++ | 11:23 |
ralonsoh | folks, please check https://review.opendev.org/c/openstack/project-config/+/872275 | 11:29 |
ralonsoh | related to https://review.opendev.org/c/openstack/neutron/+/872273 | 11:29 |
ralonsoh | I'll raise this topic during the meeting today | 11:29 |
*** arnau is now known as averdagu | 11:30 | |
*** tkajinam is now known as Guest3003 | 12:02 | |
opendevreview | Merged openstack/neutron master: Do not ignore attributes in bulk port create https://review.opendev.org/c/openstack/neutron/+/871294 | 13:39 |
lajoskatona | ralonsoh, slaweq: Hi, today I can only participate ~30 mins on the team meeting, and I have to skip the CI meeting, sorry for late mention | 13:58 |
ralonsoh | lajoskatona, no problem | 13:59 |
ralonsoh | thanks for the heads up | 13:59 |
ralonsoh | kindly reminder: bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, sahid, slawek, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu | 14:00 |
mlavalle | o/ | 14:00 |
lajoskatona | o/ | 14:00 |
ralonsoh | #startmeeting networking | 14:00 |
opendevmeet | Meeting started Tue Jan 31 14:00:35 2023 UTC and is due to finish in 60 minutes. The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
opendevmeet | The meeting name has been set to 'networking' | 14:00 |
mlavalle | o/ | 14:00 |
elvira | o/ | 14:00 |
obondarev | hi | 14:00 |
isabek | Hi | 14:00 |
ralonsoh | hello all | 14:00 |
averdagu | o/ | 14:00 |
slaweq | o/ | 14:01 |
bcafarel | o/ | 14:01 |
ralonsoh | let's start | 14:01 |
rubasov | o/ | 14:01 |
ralonsoh | #topic announcements | 14:01 |
ralonsoh | #link https://releases.openstack.org/antelope/schedule.html | 14:02 |
ralonsoh | This is R-7 week | 14:02 |
ralonsoh | and the election nomination process has began | 14:02 |
ralonsoh | #link https://releases.openstack.org/antelope/schedule.html#b-election-nominations | 14:02 |
ralonsoh | and this | 14:02 |
ralonsoh | #link https://governance.openstack.org/election/ | 14:02 |
ralonsoh | I still need to discuss in my company if I'm proposing myself again as PTL | 14:03 |
ralonsoh | in any case | 14:03 |
ralonsoh | anyone is welcome to propose his/her candidacy | 14:03 |
ralonsoh | and another reminder: in 2 weeks we have | 14:04 |
ralonsoh | 1) the feature freeze | 14:04 |
ralonsoh | 2) the final release for the client libraries. E.g.: n-lib, os-ken, ovsdbapp | 14:04 |
ralonsoh | so be aware please | 14:04 |
ralonsoh | 3) this is the A-3 milestone | 14:04 |
ralonsoh | and again, please check the openinfra presentations | 14:05 |
ralonsoh | the last one, done 1 week ago: "Large Scale Ops Deep Dive: Ubisoft" | 14:05 |
ralonsoh | #link https://openinfra.dev/live/#all-episodes | 14:05 |
mlavalle | thanks for the url ++ | 14:06 |
ralonsoh | ^^ thank you folks for those videos | 14:06 |
lajoskatona | really interesting topics for the first weeks of this year | 14:06 |
mlavalle | yeap | 14:06 |
ralonsoh | yes, indeed | 14:06 |
ralonsoh | something else missing here? | 14:06 |
slaweq | ralonsoh++ for continuing being PTL :) thx a lot | 14:07 |
mlavalle | ++ | 14:07 |
elvira | ++ indeed | 14:07 |
ralonsoh | hehehe let's see what happens during the next weeks | 14:07 |
lajoskatona | :-) yeah, thanks for the cycle and we are backing you | 14:07 |
ralonsoh | thank you folks | 14:07 |
ralonsoh | ok, let's jump to the next topic | 14:08 |
obondarev | thanks ralonsoh, keep going please! | 14:08 |
ralonsoh | hehehe | 14:08 |
ralonsoh | #topic bugs | 14:08 |
ralonsoh | busy week from obondarev | 14:08 |
ralonsoh | many news bugs (most of them from slaweq) | 14:08 |
ralonsoh | #link https://lists.openstack.org/pipermail/openstack-discuss/2023-January/031953.html | 14:08 |
slaweq | ups :) | 14:09 |
ralonsoh | we'll talk about RBAC in the next topic | 14:09 |
obondarev | not busy as slaweq usually triages bugs himself, so thanks slaweq!:) | 14:09 |
ralonsoh | right | 14:10 |
ralonsoh | there are 3 bugs not assigned or that need to be discussed | 14:10 |
slaweq | :) | 14:10 |
slaweq | I didn't assign myself to all of them but I will take them one by one | 14:10 |
slaweq | so don't worry about those related to RBAC | 14:10 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004041 | 14:10 |
ralonsoh | ok, this one is now assigned | 14:10 |
ralonsoh | (I did this list yesterday) | 14:10 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004004 | 14:11 |
sahid | slaweq: what is the one related to rbacs? | 14:11 |
ralonsoh | we'll talk about those bugs in the next topic | 14:11 |
sahid | i can perhaps help as i'm working on this area this days | 14:11 |
sahid | sorry | 14:11 |
ralonsoh | about https://bugs.launchpad.net/neutron/+bug/2004004 | 14:11 |
sahid | go ahead ralonsoh | 14:11 |
ralonsoh | according to the last comment, the problem is solved in Zed | 14:12 |
ralonsoh | because of https://review.opendev.org/c/openstack/neutron/+/771621 | 14:12 |
slaweq | @sahid, it's not one but 6 which are marked as "High" in the email https://lists.openstack.org/pipermail/openstack-discuss/2023-January/031953.html | 14:12 |
ralonsoh | I'll check if we need to backport this patch then | 14:12 |
sahid | slaweq: ack thank you | 14:13 |
ralonsoh | never mind, I'm checking the comments | 14:13 |
ralonsoh | and seems that the submitter of the bug was using a version that is not in upstream | 14:14 |
ralonsoh | so, IMO, the bug is not valid | 14:14 |
ralonsoh | can anyone double check that? | 14:14 |
lajoskatona | yes it seems to be Rocky or similar | 14:14 |
lajoskatona | if we speak about https://bugs.launchpad.net/neutron/+bug/2004004 | 14:15 |
ralonsoh | yes | 14:15 |
ralonsoh | but seems that he was not using the upstream version | 14:15 |
ralonsoh | Moreover, with respect to Florian's use case, there is already code upstream to handle such situations, as one can see in [4]. The that happened with Florian only exists because he is not using upstream Neutron version. | 14:15 |
ralonsoh | please, some else double check the bug | 14:15 |
ralonsoh | and close it if needed or propose a solution | 14:16 |
ralonsoh | the last one is | 14:17 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2003842 | 14:17 |
ralonsoh | I commented in c#1: with routed networks, OVN does not support routers | 14:17 |
ralonsoh | the router port won't have an IP assigned | 14:17 |
ralonsoh | and the routes won't be set on the LRP | 14:18 |
ralonsoh | again, some else please double check this one | 14:18 |
ralonsoh | This week isabek is the bug deputy, next week will be elvira. | 14:19 |
ralonsoh | ok? | 14:19 |
elvira | ok ralonsoh ! | 14:20 |
isabek | on it | 14:20 |
ralonsoh | thank you | 14:20 |
ralonsoh | ok, let's move to the next topic | 14:20 |
ralonsoh | #topic specs | 14:20 |
ralonsoh | one active review | 14:20 |
ralonsoh | #link https://review.opendev.org/c/openstack/neutron-specs/+/870030 | 14:20 |
ralonsoh | approved last drivers meeting | 14:21 |
ralonsoh | so please (including myselft), check this spec | 14:21 |
mlavalle | will do today | 14:21 |
ralonsoh | thank you | 14:21 |
ralonsoh | next topic | 14:21 |
ralonsoh | #topic community_goals | 14:22 |
ralonsoh | 1) Consistent and Secure Default RBAC | 14:22 |
ralonsoh | I'll post here all the bugs related opened by slaweq | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004017 | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004016 | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004015 | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004014 | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004013 | 14:22 |
ralonsoh | #link https://bugs.launchpad.net/neutron/+bug/2004012 | 14:23 |
ralonsoh | slaweq, something you want to add here? | 14:23 |
slaweq | no | 14:23 |
slaweq | stacktraces are in bug reports | 14:23 |
slaweq | it can be easily reproduced locally if someone wants to check and fix some | 14:24 |
ralonsoh | please, if you start working on one of these bugs, assign it first to yourself | 14:24 |
slaweq | if will be working on them and assigning myself to them one by one in next days/weeks | 14:24 |
slaweq | ralonsoh++ exactly - if LP will be assigned to someone, I will simply take another one | 14:24 |
slaweq | so please assign to Yourself to avoid work duplication | 14:24 |
ralonsoh | we should have them fixed ASAP, better before A-3 (2 weeks) | 14:25 |
sahid | ack | 14:25 |
ralonsoh | slaweq, thanks for taking care | 14:25 |
ralonsoh | next one is | 14:26 |
slaweq | yw | 14:26 |
ralonsoh | 2) Neutron client deprecation | 14:26 |
ralonsoh | the most urgent patch should be https://review.opendev.org/c/openstack/neutron-lib/+/870582 | 14:26 |
ralonsoh | that is in n-lib | 14:26 |
ralonsoh | sorry, not related | 14:27 |
mlavalle | you mean for review? | 14:27 |
lajoskatona | yeah it is not for me :-) | 14:27 |
lajoskatona | some news for the neutronclient things: | 14:27 |
lajoskatona | the SDK merged BGP and taas code, so in neutroncleint we can use that if it will be released | 14:27 |
lajoskatona | by the way SDK will be 1.0.0 with the new release (https://review.opendev.org/c/openstack/releases/+/872206 ) | 14:28 |
ralonsoh | nice! | 14:28 |
*** dasm|off is now known as dasm | 14:28 | |
lajoskatona | and python-neutronclient merged trunk code | 14:28 |
lajoskatona | so some progress with it | 14:28 |
lajoskatona | I think that's it now, I have to go back and prepare the next wave :-) | 14:29 |
ralonsoh | thanks a lot lajoskatona | 14:29 |
ralonsoh | ok, let's jump now to the next topic | 14:30 |
ralonsoh | #topic on_demand | 14:30 |
ralonsoh | 1st topic is from elvira | 14:30 |
ralonsoh | please, go on | 14:31 |
elvira | Yes, thanks. | 14:31 |
elvira | Basically, RDO team contacted me to see if we could make proactive bumps on the libraries that we need on the RDO neutron-distgit repository, so that we don't make the gates fail | 14:32 |
ralonsoh | do you have a manual for this? what should be done? | 14:32 |
elvira | They had this problem with the last pyroute2 bump | 14:32 |
ralonsoh | how was that? | 14:32 |
ralonsoh | this pyroute2 version was in fact used by Neutron already | 14:33 |
elvira | Yes, I asked them | 14:33 |
opendevreview | Slawek Kaplonski proposed openstack/neutron master: [Secure RBAC] Allow network owner to delete ports plugged to the network https://review.opendev.org/c/openstack/neutron/+/872280 | 14:33 |
elvira | "One way to manage that is to send a patch to neturon distgit setting the minimal required version to what you will need. The review will fail because we don't have it in rdo. The review would fail but that would warn us aboutupdating it on Fedora and follow the workflow" | 14:34 |
elvira | That's what they said. Which I assume is changing the minimum versions for the library in this file: https://github.com/rdo-packages/neutron-distgit/blob/rpm-master/openstack-neutron.spec | 14:34 |
elvira | That way they can proactively ask Fedora for an update on their packages | 14:35 |
ralonsoh | elvira, I would ask you to collect the information, provide some examples (some gerrit patches) and send an email to the mailing list (or give me this info and I'll send it) | 14:36 |
elvira | ok! I will do it and check with you before sending the email if that is ok o/ | 14:37 |
ralonsoh | perfect | 14:37 |
elvira | Just in case anyone is curious, this is their workflow for requirements: https://www.rdoproject.org/documentation/requirements/ | 14:38 |
ralonsoh | the next topic is SQLAlchemy 2.0 | 14:39 |
ralonsoh | (sorry for that!) | 14:39 |
ralonsoh | we are bumping the version in requirements | 14:39 |
ralonsoh | and everything is broken | 14:39 |
ralonsoh | I've opened some bugs | 14:39 |
ralonsoh | these are the patches | 14:40 |
ralonsoh | #link https://review.opendev.org/c/openstack/neutron/+/872271 | 14:40 |
ralonsoh | #link https://review.opendev.org/c/openstack/neutron-lib/+/872272 | 14:40 |
ralonsoh | #link https://review.opendev.org/c/openstack/neutron/+/744512 | 14:40 |
ralonsoh | and the last one is a proposal for adding a sqlalchemy master branch job | 14:40 |
ralonsoh | well, jobs | 14:40 |
ralonsoh | #link https://review.opendev.org/q/topic:bug%252F2004265 | 14:40 |
ralonsoh | I hope that with this ^^^ we won't have those surprises again | 14:41 |
ralonsoh | (please review these patches) | 14:41 |
ralonsoh | and that's all I have | 14:41 |
ralonsoh | do you have any other topic? | 14:42 |
ralonsoh | ok, folks, remember that we have the CI meeting in 17 mins | 14:43 |
ralonsoh | see you later | 14:43 |
ralonsoh | #endmeeting | 14:43 |
opendevmeet | Meeting ended Tue Jan 31 14:43:14 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:43 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2023/networking.2023-01-31-14.00.html | 14:43 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2023/networking.2023-01-31-14.00.txt | 14:43 |
opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2023/networking.2023-01-31-14.00.log.html | 14:43 |
mlavalle | o/ | 14:43 |
obondarev | o/ | 14:43 |
bcafarel | o/ | 14:43 |
elvira | o/ | 14:43 |
slaweq | o/ | 14:43 |
isabek | o/ | 14:43 |
mlavalle | slaweq: is today's meeting video or irc? | 14:43 |
rubasov | o/ | 14:43 |
slaweq | mlavalle irc | 14:49 |
slaweq | #startmeeting neutron_ci | 15:00 |
opendevmeet | Meeting started Tue Jan 31 15:00:12 2023 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
slaweq | ping bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva | 15:00 |
mlavalle | o/ | 15:00 |
bcafarel | o/ | 15:00 |
slaweq | o/ | 15:00 |
slaweq | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:01 |
mlavalle | thanks | 15:01 |
mtomaska | o/ | 15:01 |
* mlavalle opening grafana | 15:01 | |
ralonsoh | hi | 15:01 |
slaweq | ok, lets start | 15:02 |
slaweq | #topic Actions from previous meetings | 15:02 |
slaweq | first one is on lajoskatona but he's not here today | 15:03 |
slaweq | so I will assign it to him for next week to not forget | 15:03 |
slaweq | #action lajoskatona to check fullstack failure neutron.tests.fullstack.test_agent_bandwidth_report.TestPlacementBandwidthReport.test_configurations_are_synced_towards_placement(Open vSwitch agent) | 15:03 |
slaweq | next one | 15:03 |
slaweq | ralonsoh to check neutron.tests.functional.agent.test_ovs_flows.ARPSpoofTestCase.test_arp_spoof_doesnt_block_ipv6 https://404fa55dc27f44e0606d-9f131354b122204fb24a7b43973ed8e6.ssl.cf5.rackcdn.com/860639/22/check/neutron-functional-with-uwsgi/6a57e16/testr_results.html | 15:03 |
ralonsoh | yes | 15:03 |
ralonsoh | #link https://review.opendev.org/c/openstack/neutron/+/871101 | 15:03 |
ralonsoh | this is not solving the issue but improving the logs | 15:03 |
ralonsoh | (well, adding a retry on the ping) | 15:04 |
slaweq | ok | 15:04 |
slaweq | I didin't saw the same issue this week | 15:04 |
slaweq | next one is also on lajoskatona so I will assign it for next week | 15:05 |
slaweq | #action lajoskatona to check in https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ae9/870024/4/check/neutron-functional-with-uwsgi/ae93cab/testr_results.html if there are available additional logs there | 15:05 |
slaweq | next one | 15:05 |
slaweq | mlavalle to check failed neutron.tests.fullstack.test_l3_agent.TestHAL3Agent.test_ha_router - https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_dd2/867769/11/gate/neutron-fullstack-with-uwsgi/dd2aa74/testr_results.html | 15:05 |
mlavalle | I've been checking https://zuul.opendev.org/t/openstack/builds?job_name=neutron-fullstack-with-uwsgi&branch=master&skip=0 | 15:06 |
mlavalle | for the past two weeks | 15:06 |
mlavalle | The only instance of that test case failing was the one that slaweq reported here | 15:06 |
mlavalle | so I think it was a one of | 15:06 |
slaweq | ok, so lets forget about it for now | 15:06 |
mlavalle | yeap | 15:06 |
slaweq | also fullstack jobs seems to be pretty stable recently | 15:07 |
slaweq | thx mlavalle for taking care of it | 15:07 |
slaweq | next one | 15:07 |
slaweq | ralonsoh to check new occurence of the https://bugs.launchpad.net/neutron/+bug/1940425 | 15:07 |
ralonsoh | I commented on https://bugs.launchpad.net/neutron/+bug/1940425/comments/22 | 15:07 |
ralonsoh | in this case, Nova didn't update the port binding | 15:08 |
slaweq | ok, should we change status of this bug in Nova? | 15:09 |
slaweq | now it's set as "Invalid" | 15:09 |
slaweq | maybe it should be reopened on Nova's side now? | 15:09 |
ralonsoh | if that happens again, yes | 15:09 |
slaweq | ok | 15:09 |
slaweq | amd the last one | 15:10 |
slaweq | slaweq to check tempest-slow jobs failures | 15:10 |
slaweq | patches https://review.opendev.org/q/topic:bug%252F2003063 are all merged | 15:10 |
slaweq | and those jobs are fixed now | 15:10 |
slaweq | it was indeed due to update of Cirros image | 15:10 |
slaweq | so some patches to tempest were required | 15:10 |
opendevreview | Merged openstack/neutron stable/yoga: Use common wait_until_ha_router_has_state method everywhere https://review.opendev.org/c/openstack/neutron/+/872008 | 15:10 |
slaweq | with that I think we can move on to the next topic | 15:11 |
slaweq | #topic Stable branches | 15:11 |
slaweq | bcafarel any updates? | 15:11 |
bcafarel | overall it looks good from my checks today, yatin backported some functional fixes (and marking a test unstable) wallaby looked fine | 15:12 |
bcafarel | ussuri is broken from comment in https://review.opendev.org/c/openstack/neutron/+/871989 - grenade gate not passing from train paramiko issue | 15:12 |
slaweq | ussuri is EM already, right? | 15:13 |
bcafarel | yep this could be reduced (major changes to test from train to ussuri should be quite rare now!) | 15:14 |
bcafarel | I will check with Yatin (he is off today) if train is easily fixable for that - this issue may break a few jobs there | 15:14 |
slaweq | ++ | 15:15 |
slaweq | thx | 15:15 |
slaweq | #action bcafarel to check if we should maybe drop broken grenade jobs from Ussuri branch | 15:15 |
slaweq | anything else or can we move on? | 15:16 |
bcafarel | all good for the rest :) | 15:16 |
slaweq | thx | 15:16 |
slaweq | so lets move on | 15:16 |
slaweq | I will skip stadium projects are lajoskatona is not here | 15:16 |
slaweq | but all periodic jobs are green this week | 15:16 |
slaweq | #topic Grafana | 15:16 |
slaweq | #link https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 15:16 |
slaweq | all looks good for me in grafana | 15:17 |
slaweq | there is raise of the UT failures today, but I saw couple of patches where UT were failing due to proposed change | 15:17 |
slaweq | so nothing really critical for us here | 15:17 |
mlavalle | ++ | 15:18 |
slaweq | any other comments related to grafana? | 15:18 |
mlavalle | none from me | 15:18 |
slaweq | ok, so lets move on | 15:19 |
slaweq | #topic Rechecks | 15:19 |
slaweq | with rechecks we are back below 1 in average :) | 15:19 |
mlavalle | ++ | 15:19 |
slaweq | +---------+----------+... (full message at <https://matrix.org/_matrix/media/v3/download/matrix.org/uvudTgUGYRiOhUyICBCziORU>) | 15:20 |
slaweq | so it's better \o/ | 15:20 |
slaweq | actually, when I checked patches merged in last 7 days, all of them were merged without any failed build in last PS: | 15:20 |
slaweq | list is in the agenda document https://etherpad.opendev.org/p/neutron-ci-meetings#L74 | 15:21 |
slaweq | regarding bare rechecks it's also good: | 15:21 |
slaweq | +---------+---------------+--------------+-------------------+... (full message at <https://matrix.org/_matrix/media/v3/download/matrix.org/lEkkpDYqRefnrIyvOpseycic>) | 15:21 |
slaweq | just 1 out of 23 rechecks was "bare" in last 7 days | 15:21 |
bcafarel | good numbers :) | 15:21 |
slaweq | so thx a lot for that | 15:21 |
slaweq | bcafarel indeed :) | 15:21 |
slaweq | any questions/comments? | 15:22 |
slaweq | or are we moving on to the next topic(s)? | 15:22 |
slaweq | ok, so lets move on | 15:24 |
slaweq | #topic Unit tests | 15:24 |
slaweq | there is one issue for today | 15:24 |
slaweq | sqlite3.OperationalError: no such table: (seen once in tox-cover job and many occurrences in arm64 unit test jobs) | 15:24 |
slaweq | https://6203638836ab77538319-23561effe696d4d724b67bcb38a7b69d.ssl.cf5.rackcdn.com/871991/1/check/openstack-tox-cover/f9e8ceb/testr_results.html | 15:24 |
slaweq | I think that "no such table" is just effect of some issue, not a root cause of the failure | 15:25 |
ralonsoh | is that always happening? | 15:26 |
slaweq | it wasn't added by me to the agenda | 15:26 |
bcafarel | and quite a few tables missing | 15:26 |
slaweq | but according to the note there, it happens often in arm64 jobs | 15:26 |
slaweq | there is no many logs in the UT jobs :/ | 15:28 |
bcafarel | the tox-cover one was https://review.opendev.org/c/openstack/neutron/+/871991/ I see Yatin commenting on "recheck unit test sqlite failure" | 15:28 |
slaweq | ralonsoh can it be that sqlite3 was crashed/killed by oom/something like that during tests? | 15:29 |
ralonsoh | I don't think so in this case | 15:29 |
slaweq | maybe we should add journal log to the UT job logs? | 15:29 |
ralonsoh | the error is happening during the cleanup | 15:29 |
ralonsoh | so maybe (maybe), we have already deleted the table or the DB | 15:30 |
slaweq | cleanup? | 15:30 |
ralonsoh | check any error log in https://6203638836ab77538319-23561effe696d4d724b67bcb38a7b69d.ssl.cf5.rackcdn.com/871991/1/check/openstack-tox-cover/f9e8ceb/testr_results.html | 15:30 |
ralonsoh | File "/home/zuul/src/opendev.org/openstack/neutron/.tox/shared/lib/python3.8/site-packages/fixtures/fixture.py", line 125, in cleanUp | 15:30 |
ralonsoh | this is the first line | 15:31 |
slaweq | but it's not like that in all tests | 15:31 |
ralonsoh | yeah | 15:31 |
slaweq | I see it in setUp e.g. in neutron.tests.unit.services.trunk.test_rules.TrunkPortValidatorTestCase.test_can_be_trunked_or_untrunked_unbound_port test | 15:31 |
ralonsoh | and this is during the initialization... | 15:32 |
slaweq | but there is "traceback-2" in that test result and this is in cleanUp | 15:32 |
slaweq | so it seems that it fails in setUp and then it also causes issue in cleanUp phase | 15:33 |
ralonsoh | yes | 15:33 |
slaweq | but that's just result of previous issue | 15:33 |
slaweq | ok, I think that we need to: | 15:34 |
slaweq | 1. report bug for this | 15:34 |
slaweq | 2. start collecting journal log in UT jobs | 15:35 |
slaweq | *2 | 15:35 |
slaweq | and then maybe we will be able to know something more what happened there | 15:35 |
slaweq | wdyt? | 15:35 |
ralonsoh | agree | 15:35 |
bcafarel | +1 | 15:35 |
slaweq | anyone wants to do that? | 15:36 |
ralonsoh | I'll do it | 15:36 |
slaweq | thx ralonsoh | 15:36 |
slaweq | #action ralonsoh to report UT issue with missing tables in db and propose patch to collect journal log in UT jobs | 15:37 |
slaweq | next topic | 15:37 |
slaweq | #topic fullstack/functional | 15:37 |
slaweq | here I just have issues from previous week as this week I didn't found any new issues | 15:39 |
slaweq | so I think we can skip them, especially as this week functional and fullstack jobs are pretty stable | 15:39 |
slaweq | there is one issue mentioned by ykarel probably: | 15:39 |
slaweq | test_arp_correct_protection.neutron.tests.functional.agent.linux.test_linuxbridge_arp_protect.LinuxBridgeARPSpoofTestCase (seen once in victoria) | 15:39 |
slaweq | https://7b7e23438828cd69d6b5-4d3d00830dc84883c962194d8b2d6bed.ssl.cf2.rackcdn.com/871988/1/check/neutron-functional-with-uwsgi/0272bfd/testr_results.html | 15:39 |
slaweq | I wouldn't spend much time on it as it's related to Linuxbridge agent | 15:42 |
slaweq | and it was seen just once so far | 15:42 |
slaweq | thoughts? | 15:43 |
mlavalle | yes, let's niot waste time on it | 15:43 |
ralonsoh | agree with no spending time on this one | 15:43 |
slaweq | ok, next topic then | 15:44 |
slaweq | #topic Tempest/Scenario | 15:44 |
slaweq | here I wanted to ask about one issue | 15:44 |
slaweq | which I saw few times IIRC | 15:44 |
slaweq | devstack failed with error that there was no tenant network for allocation: https://zuul.opendev.org/t/openstack/build/b75030f968944508a3c3bbe6b4851584 | 15:44 |
slaweq | did You saw such issue already? | 15:44 |
mlavalle | The last time I built a devstack in my local system was 2 days ago | 15:45 |
mlavalle | it worked fine | 15:45 |
slaweq | ok, I think I know now | 15:46 |
slaweq | there are errors related to the DB connection in neutron log in that job https://b84531a976ef476331e1-baa8eceea3205baf832239057c78a658.ssl.cf1.rackcdn.com/869196/11/check/neutron-ovs-grenade-dvr-multinode/b75030f/controller/logs/screen-q-svc.txt | 15:46 |
slaweq | and it's during creation of the subnetpool | 15:46 |
bcafarel | you were faster than me :) yep there's oslo_db.exception.DBConnectionError just before that 503 | 15:47 |
slaweq | so maybe as subnetpool wasn't created, later network couldn't be created too as there wasn't any pool to use | 15:47 |
slaweq | so, it's not neutron issue then | 15:47 |
slaweq | with that we got to the last topic for today | 15:48 |
slaweq | #topic Periodic | 15:48 |
slaweq | generally all looks good there | 15:48 |
slaweq | but I saw that job neutron-ovn-tripleo-ci-centos-9-containers-multinode is failing pretty often | 15:48 |
slaweq | last two times which it failed and which I checked failed on the undercloud deploy | 15:49 |
slaweq | https://zuul.openstack.org/build/772a941b25bd4dbbb66ddbd6544a3b63 | 15:49 |
slaweq | I don't think it's neutron issue really but maybe someone will have some cycles to dig deeper into this and maybe try to find the root cause of it? | 15:49 |
ralonsoh | or wait for tripleo folks | 15:50 |
slaweq | ralonsoh yep, or ping them :) | 15:50 |
slaweq | ok, I will try to ask some tripleo folks for help with this | 15:51 |
slaweq | #action slaweq to check with tripleo experts failing neutron-ovn-tripleo-ci-centos-9-containers-multinode job | 15:52 |
slaweq | and with that we got to the end of agenda for today | 15:52 |
slaweq | anything else You want to discuss today? | 15:52 |
mlavalle | nothing from me | 15:52 |
ralonsoh | nothing, thanks | 15:52 |
bcafarel | nothing either | 15:52 |
slaweq | if nothing, then lets get back few minutes | 15:53 |
slaweq | thx for attending the meeting and have a great week | 15:53 |
slaweq | o/ | 15:53 |
slaweq | #endmeeting | 15:53 |
opendevmeet | Meeting ended Tue Jan 31 15:53:15 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:53 |
opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-01-31-15.00.html | 15:53 |
opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-01-31-15.00.txt | 15:53 |
opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-01-31-15.00.log.html | 15:53 |
ralonsoh | bye | 15:53 |
mtomaska | o/ | 15:53 |
mlavalle | o/ | 15:53 |
bcafarel | o/ | 15:57 |
opendevreview | Elvira GarcĂa Ruiz proposed openstack/neutron master: [OVN] Allow logging all traffic related to an ACL https://review.opendev.org/c/openstack/neutron/+/871096 | 17:58 |
*** elvira1 is now known as elvira | 18:01 | |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Accept HA chassis group commands in HAChassisGroupAdd* https://review.opendev.org/c/openstack/ovsdbapp/+/871836 | 18:01 |
opendevreview | Merged openstack/neutron stable/xena: Use common wait_until_ha_router_has_state method everywhere https://review.opendev.org/c/openstack/neutron/+/872009 | 18:10 |
opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Accept HA chassis group commands in HAChassisGroupAdd* https://review.opendev.org/c/openstack/ovsdbapp/+/871836 | 18:11 |
*** dasm is now known as dasm|off | 19:33 | |
opendevreview | Miguel Lavalle proposed openstack/neutron master: [WIP][DNM][OVN] Change the default firewall policy https://review.opendev.org/c/openstack/neutron/+/839066 | 23:13 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!