| opendevreview | Takashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files https://review.opendev.org/c/openstack/neutron/+/902013 | 00:46 |
|---|---|---|
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files https://review.opendev.org/c/openstack/neutron/+/902013 | 00:51 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Validate ip versions https://review.opendev.org/c/openstack/neutron/+/901894 | 00:51 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent config files https://review.opendev.org/c/openstack/neutron/+/902014 | 00:56 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent config file https://review.opendev.org/c/openstack/neutron/+/902014 | 01:06 |
| opendevreview | liuyulong proposed openstack/neutron master: Check subnet service_type for subnet_create https://review.opendev.org/c/openstack/neutron/+/901225 | 01:12 |
| opendevreview | Merged openstack/neutron stable/2023.2: docs: update default value of metadata workers for ml2/ovn https://review.opendev.org/c/openstack/neutron/+/901495 | 01:19 |
| opendevreview | Merged openstack/neutron stable/2023.1: docs: update default value of metadata workers for ml2/ovn https://review.opendev.org/c/openstack/neutron/+/901496 | 01:19 |
| opendevreview | Merged openstack/neutron stable/zed: docs: update default value of metadata workers for ml2/ovn https://review.opendev.org/c/openstack/neutron/+/901497 | 01:19 |
| opendevreview | Merged openstack/neutron stable/yoga: docs: update default value of metadata workers for ml2/ovn https://review.opendev.org/c/openstack/neutron/+/901498 | 01:19 |
| opendevreview | Merged openstack/neutron stable/wallaby: docs: update default value of metadata workers for ml2/ovn https://review.opendev.org/c/openstack/neutron/+/901500 | 01:19 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files https://review.opendev.org/c/openstack/neutron/+/902013 | 01:21 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Validate ip versions https://review.opendev.org/c/openstack/neutron/+/901894 | 01:21 |
| opendevreview | huanghailun proposed openstack/neutron master: Remove the restriction on empty cidr's update events https://review.opendev.org/c/openstack/neutron/+/901812 | 02:10 |
| opendevreview | Merged openstack/neutron stable/zed: Catch non-existent entry failures better in ip_lib https://review.opendev.org/c/openstack/neutron/+/901073 | 02:15 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 02:20 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 02:23 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 02:33 |
| opendevreview | Merged openstack/neutron stable/2023.2: Catch non-existent entry failures better in ip_lib https://review.opendev.org/c/openstack/neutron/+/901062 | 02:58 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 03:32 |
| opendevreview | liuyulong proposed openstack/neutron master: Check subnet service_type for subnet_create https://review.opendev.org/c/openstack/neutron/+/901225 | 06:57 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 07:01 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Replace network type names by constants https://review.opendev.org/c/openstack/neutron/+/902046 | 07:08 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901962 | 07:23 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901963 | 07:56 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove logic for old LBaaS(v2) https://review.opendev.org/c/openstack/neutron/+/902048 | 08:09 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: [OVN] Add baremetal support without Neutron DHCP agent for IPv6 https://review.opendev.org/c/openstack/neutron/+/890683 | 08:21 |
| opendevreview | huanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations https://review.opendev.org/c/openstack/neutron/+/901895 | 09:30 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/xena: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/901023 | 09:33 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/xena: [OVN] Try to bind ports only to the ovn-controller agents https://review.opendev.org/c/openstack/neutron/+/901024 | 09:33 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/wallaby: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/901025 | 09:34 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/wallaby: [OVN] Try to bind ports only to the ovn-controller agents https://review.opendev.org/c/openstack/neutron/+/901026 | 09:34 |
| sahid | o/ | 09:45 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901963 | 09:55 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901962 | 10:14 |
| opendevreview | Brian Haley proposed openstack/neutron master: Remove vnic_type_blacklist deprecated name https://review.opendev.org/c/openstack/neutron/+/901478 | 10:18 |
| fnordahl | I need to rebase the 2023-aa-l3-gw-multihoming series ( https://review.opendev.org/q/topic:%222023-aa-l3-gw-multihoming%22+status:open+project:openstack/neutron ) and I wondered if anyone had a moment to review the bottom 4 patches before I do, they are very small fixing issues in committed but not active code and has test coverage in the proposed tempest tests under the same topic. | 10:25 |
| fnordahl | There is already one +2 on them, and one procedural -1 from ralonsoh on the bottom one, and I think we have justified not needing a LP bug for these in our response, but it has been left unanswered since October | 10:26 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove logic for old LBaaS(v2) https://review.opendev.org/c/openstack/neutron/+/902048 | 11:27 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/xena: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/901023 | 11:54 |
| ykarel | bcafarel, lajoskatona when you get chance please check few backports | 12:53 |
| ykarel | https://review.opendev.org/q/Ie0ec43566fa2b3e13b4917493336ce1519c9b6bb | 12:53 |
| ykarel | https://review.opendev.org/q/Icd84685c37fffa20e4fc9c5522f77bc63e2565f2 | 12:53 |
| bcafarel | ykarel: sure, I will take a look later today | 12:57 |
| lajoskatona | haleyb: Hi, I added a topic for the on-demand agenda to discuss together the current OpenApi efforts for SDK, and gtema is so nice to join the meeting to help in the interpretation of this effort | 13:06 |
| lajoskatona | ykarel: sure will check them | 13:07 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/xena: [OVN] Try to bind ports only to the ovn-controller agents https://review.opendev.org/c/openstack/neutron/+/901024 | 13:09 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/wallaby: [ovn]Refusing to bind port to dead agent https://review.opendev.org/c/openstack/neutron/+/901025 | 13:09 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron stable/wallaby: [OVN] Try to bind ports only to the ovn-controller agents https://review.opendev.org/c/openstack/neutron/+/901026 | 13:10 |
| *** damian___921834 is now known as damian___92183 | 13:25 | |
| sahid | hello guys, on some of our compute we are expericing high cpu spike comming from vswitchd, any one have suffering some behavior? | 13:50 |
| sahid | looks like vswitched are flooding arp | 13:50 |
| sahid | that looks to comes from one specific tenant only | 13:51 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: DNM This is only test for the RDO testproject CI jobs https://review.opendev.org/c/openstack/neutron/+/902060 | 13:57 |
| opendevreview | Lucas Alvares Gomes proposed openstack/neutron master: Fix IGMP inconsistency across drivers https://review.opendev.org/c/openstack/neutron/+/901753 | 13:59 |
| haleyb | ping bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki | 14:00 |
| haleyb | #startmeeting networking | 14:00 |
| opendevmeet | Meeting started Tue Nov 28 14:00:09 2023 UTC and is due to finish in 60 minutes. The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:00 |
| opendevmeet | The meeting name has been set to 'networking' | 14:00 |
| elvira | o/ | 14:00 |
| obondarev | o/ | 14:00 |
| mlavalle | \o | 14:00 |
| ykarel | o/ | 14:01 |
| rubasov | o/ | 14:01 |
| haleyb | alright lets get started | 14:01 |
| haleyb | #topic announcements | 14:01 |
| haleyb | according to https://releases.openstack.org/caracal/schedule.html we are past the C-1 milestone | 14:02 |
| lajoskatona | o/ | 14:02 |
| haleyb | C-2 milestone is Jan 8-12 which will come up quickly | 14:02 |
| haleyb | Reminder: If you have a topic for the drivers meeting on Friday, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers | 14:03 |
| haleyb | there are currently no topics in the queue | 14:03 |
| haleyb | Review days - talked last week about setting aside 2-3 days at intervals to get some in-flight reviews merged | 14:04 |
| haleyb | #link https://doodle.com/meeting/organize/id/dN8opRDa | 14:04 |
| haleyb | 5 people added their availability, with December 1st and 8th working for everyone, are people OK splitting across a week? | 14:04 |
| haleyb | or if back-to-back is better i would propose December 7/8 | 14:05 |
| * haleyb taps microphone to see if people are awake :) | 14:05 | |
| lajoskatona | yes sir | 14:06 |
| frickler | I'm not directly involved, but splitting to allow authors to react sounds nice | 14:06 |
| lajoskatona | for me either can work | 14:06 |
| mlavalle | the split is fine | 14:06 |
| lajoskatona | good reasoning, than split it | 14:06 |
| haleyb | alright, i was thinking the same thing - so anyone that added their name, or anyone that needs reviews, try and set aside time this Friday and next for them | 14:07 |
| haleyb | time in-between to fix-up and rebase, etc | 14:08 |
| haleyb | #action haleyb to reply to ML thread with this info | 14:08 |
| frickler | fnordahl: ^^ that might be interesting for your series, too | 14:08 |
| haleyb | any other announcements? | 14:09 |
| haleyb | #topic bugs | 14:10 |
| haleyb | obondarev was deputy last week, isabek is this week, elvira next week | 14:10 |
| haleyb | #link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/W4JIPTXHVIN54T2FOPEYO6AGREF4JPCC/ | 14:10 |
| haleyb | 4/5 bugs were picked-up and have patches | 14:11 |
| isabek | o/ | 14:11 |
| haleyb | so thanks for picking them up | 14:11 |
| haleyb | isabek: are you ok being bug deputy this week? | 14:12 |
| isabek | sure | 14:12 |
| haleyb | ack, thanks! | 14:12 |
| elvira | there are some PH on Spain next week, I will be out from wednesday until end of week :( | 14:12 |
| bcafarel | late o/ | 14:13 |
| elvira | I don't mind taking a look mon-tue and then on Mondaywhen I get back. Whatever is best for you folks | 14:13 |
| haleyb | elvira: ack, i can watch for critical things the end of the week, unless someone wants to switch? | 14:14 |
| lajoskatona | I can switch | 14:15 |
| lajoskatona | my week would be the first of 24, and I am off that week | 14:15 |
| haleyb | elvira: does that work? i can update if so | 14:16 |
| elvira | I will also be off but I will have the laptop really nearby so no problem for me!! | 14:16 |
| elvira | It works better | 14:16 |
| elvira | :) | 14:16 |
| lajoskatona | thanks, than I will be deputy next week | 14:16 |
| haleyb | sold, will update | 14:17 |
| haleyb | so the one bug in question is | 14:17 |
| haleyb | #link https://bugs.launchpad.net/neutron/+bug/2044215 | 14:17 |
| haleyb | dns: Keyword is replaced by project_name instead of project_id | 14:17 |
| haleyb | i don't exactly understand it either, submitter asked for more information | 14:18 |
| haleyb | if it makes sense to anyone please feel free to add comments | 14:18 |
| haleyb | are there any other bugs someone wants to discuss? | 14:19 |
| gtema | https://bugs.launchpad.net/neutron/+bug/1975828 | 14:19 |
| gtema | sorry for jumping in: please check the last comment. Sadly bug expired, but I posted update recently | 14:19 |
| gtema | there is huge difference in API when listing ports (from project with 1500 ports) between admin and user call | 14:20 |
| gtema | and I ended up in thinking that it is policy evaluation engine | 14:20 |
| haleyb | gtema: thanks for bringing this up | 14:20 |
| haleyb | so when you say policy i'm assuming rbac? | 14:21 |
| gtema | yes | 14:21 |
| haleyb | we can un-expire it, is there anyone that has cycles to look into it? | 14:22 |
| haleyb | rodolfo is out for a while | 14:23 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901963 | 14:23 |
| fnordahl | frickler: (indeed, I will read up on the e-mail thread, and I'm available until Dec 15th so hopefully we can get some ground covered before then!) | 14:23 |
| opendevreview | Miguel Lavalle proposed openstack/neutron master: Router flavors and service type for OVN https://review.opendev.org/c/openstack/neutron/+/883988 | 14:23 |
| opendevreview | Merged openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901962 | 14:24 |
| haleyb | gtema: i will change the status just not sure if anyone can pick it up | 14:24 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent stable/2023.2: Ensure withdrawn events are only processed in relevant nodes https://review.opendev.org/c/openstack/ovn-bgp-agent/+/902065 | 14:25 |
| gtema | ok. I will try myself to play deeper with it. It looks like there is no caching when policies are being evaluated. Just wanted to know whether somebody knows something about it | 14:25 |
| haleyb | sorry i don't, first time i had seen it | 14:26 |
| haleyb | last thing on topic of bugs | 14:26 |
| gtema | ok, thks anyway | 14:27 |
| haleyb | Current bug count this week: 762, up 2 from last week - so good we really didn't increase | 14:27 |
| haleyb | #topic specs | 14:28 |
| haleyb | #link https://review.opendev.org/q/project:openstack%252Fneutron-specs+status:open | 14:28 |
| haleyb | i see racosta has uploaded a new version of the OVN-IC spec, i have not had time to review yet | 14:29 |
| haleyb | #link https://review.opendev.org/c/openstack/neutron-specs/+/891204 | 14:29 |
| haleyb | will review today | 14:29 |
| haleyb | and the other two (BGP related) also had updates | 14:30 |
| haleyb | hopefully people will get around to reviews :) | 14:30 |
| haleyb | moving on... | 14:31 |
| haleyb | #topic community_goals | 14:31 |
| haleyb | lajoskatona: think you're the only one with a goal on the list, neutronclient deprecation | 14:33 |
| haleyb | #link https://review.opendev.org/c/openstack/horizon/+/891205 | 14:33 |
| lajoskatona | yes, I am strugling with the one horizon patch | 14:33 |
| lajoskatona | to fix failing tests | 14:33 |
| lajoskatona | so slow progression | 14:33 |
| haleyb | thanks for taking on the work to begin with | 14:34 |
| haleyb | #topic on_demand | 14:34 |
| lajoskatona | I added a topic for OpenAPI | 14:35 |
| lajoskatona | the mail from gtema: https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/BU5JH7FJ5VPS75QWPW47IYSZOFDI5R2W/ | 14:35 |
| gtema | right, thanks | 14:35 |
| gtema | I can give some more infos on the topic, but few more links to be more preciese | 14:36 |
| haleyb | "Neutron is very special" | 14:36 |
| lajoskatona | :-) | 14:36 |
| haleyb | gtema: sure, go ahead | 14:36 |
| gtema | https://github.com/gtema/openstack-openapi/blob/main/specs/network/v2.yaml - this is a spec that I was able to generate from neutron sources | 14:37 |
| gtema | https://github.com/gtema/openstack-codegenerator/blob/main/codegenerator/generator/openapi/neutron.py - this is the code I generated it with | 14:37 |
| gtema | https://gtema.github.io/openstack-openapi/network.html - current draft for rendering spec in the OpenStack style | 14:37 |
| gtema | everything is a work in progress | 14:37 |
| gtema | but generally the question nr 1) is Neutron team interested in having openapi doc produced from sources so that api-ref can be actually deprecated as such | 14:38 |
| lajoskatona | is this for the API or for what we have in SDK? | 14:38 |
| gtema | and also all clients/sdks/etc can be generated by various tools | 14:38 |
| lajoskatona | ok so this is for the APi which we have in n-lib | 14:39 |
| gtema | well, this is currently not connected with SDK directly, but rather extracted from Neutron source and api-ref html | 14:39 |
| haleyb | #link https://docs.openstack.org/api-ref/network/v2/index.html | 14:39 |
| haleyb | should be similar to that i would guess | 14:39 |
| gtema | right, this is going to be rendered this style, but maybe more modern. This is not a point | 14:40 |
| slaweq | what about APIs provided by e.g. stadium projects? I don't see them in this example at all | 14:40 |
| gtema | right, at the moment I took pure "neutron" and messed with what I could find | 14:40 |
| gtema | vpnaas is also not there and that was a question towards you | 14:41 |
| gtema | https://github.com/gtema/openstack-codegenerator/blob/main/codegenerator/generator/openapi/neutron.py#L79 - this is how I setup the neutron to access api router and inspect everything what it knows about | 14:41 |
| slaweq | even for just neutron, APIs of running server may be different depending on enabled service plugins, mechanism drivers, etc. (as You already mentioned in the email) so will it be possible to somehow generate complete list of APIs always? | 14:41 |
| gtema | that is the point - I need help in getting the configuration that enables "everything" | 14:42 |
| lajoskatona | I dont think that is possible at least for all the stadiums in one setup | 14:43 |
| gtema | second question would be: is it possible to alter exposed routes to not to expose things which are not working | 14:43 |
| gtema | i.e. you see in the spec there is POST for /availability-zones or /auto-allocateted-topology | 14:44 |
| gtema | this is because in reality those are exposed but if you try invoking them you will get weird validation errors, but not 404 | 14:44 |
| gtema | also, I found way to "convert" api_definition into the json schema, but there are certain limitations there and not all resources are having it at all, so that requires hardcoding | 14:46 |
| gtema | lajoskatona - if it is not possible to have everything running at once (and this is why I stopped attempting that) we could try different approach of generating spec in few runs with different configs | 14:48 |
| haleyb | i'm not sure i'm the best one to help, but my very generic question is there something neutron can change to make this work easier? | 14:48 |
| lajoskatona | gtema: ack | 14:48 |
| opendevreview | Merged openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/901963 | 14:48 |
| gtema | haleyb: yes, there are certain things, but first I would like to know whether I have Neutron support generally in this initiative | 14:49 |
| opendevreview | Luis Tomas Bolivar proposed openstack/ovn-bgp-agent stable/2023.2: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/902067 | 14:50 |
| haleyb | gtema: i would support it, what do others think? and where do you think it falls on the scale of small/medium/large so we don't overcommit? | 14:51 |
| slaweq | generally I like that idea and I can try to help if I will have some cycles (but that may be hard currently) | 14:51 |
| slaweq | so gtema if You will need any help, please ping me - I will try to help when possible | 14:52 |
| lajoskatona | +1 from me, I can help also for the stadiums for example | 14:52 |
| gtema | perfect. Thanks a lot. | 14:52 |
| gtema | so from the gestimate: I think initially it is a small effort just to analyse and find ways for workarounds | 14:52 |
| gtema | once that is done in next steps those workarounds may be moved to neutron code so that generation is more reliable, that may be medium | 14:53 |
| gtema | but I really don't expect it to be a large stuff | 14:53 |
| gtema | ok, thanks on the topic | 14:54 |
| lajoskatona | thanks for working on this topic | 14:55 |
| haleyb | gtema: ack, thanks, sounds good to me | 14:55 |
| haleyb | any other topics for discussion? | 14:56 |
| mlavalle | Just remind the team that router flavors with L3 OVN is ready for reviews: https://review.opendev.org/c/openstack/neutron/+/883988 | 14:56 |
| haleyb | mlavalle: thanks! | 14:56 |
| mlavalle | I just rebased it | 14:56 |
| haleyb | ykarel: and we have CI meeting today? | 14:56 |
| ykarel | yes in 4 minutes over IRC | 14:57 |
| lajoskatona | ack | 14:57 |
| haleyb | ok, thanks for attending everyone | 14:57 |
| haleyb | #endmeeting | 14:57 |
| opendevmeet | Meeting ended Tue Nov 28 14:57:46 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:57 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.html | 14:57 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.txt | 14:57 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.log.html | 14:57 |
| lajoskatona | o/ | 14:58 |
| mlavalle | \o | 14:59 |
| ykarel | #startmeeting neutron_ci | 15:00 |
| opendevmeet | Meeting started Tue Nov 28 15:00:34 2023 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:00 |
| ykarel | ping bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 15:00 |
| ykarel | Grafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:00 |
| ykarel | Please open now :) | 15:00 |
| mtomaska | o/ | 15:01 |
| slaweq | o/ | 15:01 |
| bcafarel | I barely had time to go make a coffee :) | 15:01 |
| bcafarel | o/ | 15:01 |
| mlavalle | \o | 15:01 |
| lajoskatona | o/ | 15:01 |
| haleyb | o/ | 15:02 |
| ykarel | k let's start with the topics | 15:02 |
| ykarel | #topic Actions from previous meetings | 15:02 |
| ykarel | bhaley to refresh grafana dashboard for neutron-lib/neutron-tempest-plugin in project-config | 15:02 |
| haleyb | i have the neutron-lib one almost done, just working on the periodic section | 15:02 |
| haleyb | short week last week | 15:03 |
| ykarel | thx not a urgent one so should be fine | 15:03 |
| ykarel | #topic Stable branches | 15:03 |
| ykarel | bcafarel, anything to share for stable? | 15:03 |
| bcafarel | I just finished catching up on my reviews, all looks good on CI status on active branches | 15:04 |
| ykarel | k that's good | 15:04 |
| ykarel | #topic Stadium projects | 15:04 |
| ykarel | periodic lines are green here, and the ui issue related to job link also fixed | 15:04 |
| lajoskatona | projects are green, so no big problem | 15:05 |
| ykarel | k Thanks | 15:05 |
| ykarel | #topic Rechecks | 15:05 |
| lajoskatona | my usual request: if you have few mins pleasecchek the stadium reviews also :-) | 15:06 |
| ykarel | we are seeing some random failures across jobs and that leads to recheck on patches this week | 15:06 |
| ykarel | there were 2 bare rechecks too, we should try to avoid that | 15:07 |
| ykarel | Let's check the failures | 15:07 |
| ykarel | #topic fullstack/functional | 15:07 |
| ykarel | test_dvr_router_lifecycle_without_ha_without_snat_with_fips | 15:07 |
| ykarel | AssertionError: Device name: fg-863e72ab-79, expected MAC: fa:16:3e:80:8d:89 | 15:07 |
| ykarel | #link https://ef6fea84da73ed48af61-f850a1c88b63080f1e34c13fe4924008.ssl.cf2.rackcdn.com/901476/2/gate/neutron-functional-with-uwsgi/782e426/testr_results.html | 15:08 |
| ykarel | anyone recall this issue? | 15:09 |
| mlavalle | I don't | 15:09 |
| ykarel | i have seen this before but it's not a frequent one | 15:09 |
| haleyb | vaguely but don't remember the context | 15:09 |
| ykarel | may be https://bugs.launchpad.net/neutron/+bug/2000164 | 15:10 |
| haleyb | Co-Authored-By: Brian Haley <haleyb.dev@gmail.com> | 15:11 |
| slaweq | To confirm that you can check ovs logs to see if port was created, deleted and created again quickly | 15:12 |
| haleyb | ykarel: was this failure in all branches? | 15:12 |
| ykarel | seen once as of now in master | 15:12 |
| opendevreview | Merged openstack/ovn-bgp-agent stable/2023.2: Ensure withdrawn events are only processed in relevant nodes https://review.opendev.org/c/openstack/ovn-bgp-agent/+/902065 | 15:13 |
| ykarel | slaweq, ack will check the logs and confirm if it's same | 15:15 |
| ykarel | #action ykarel to check if functional failure is same as bug 2000164 | 15:15 |
| ykarel | Next one | 15:16 |
| ykarel | test_port_binding_chassis_create_event | 15:16 |
| ykarel | ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port_Binding with logical_port=1bbcd693-2b3b-4e72-8143-5a67359d56b2 | 15:16 |
| ykarel | https://3b2ee5c5f48b31d3cd88-77332c10a4b1568b93e2e5229e79a685.ssl.cf5.rackcdn.com/901507/2/gate/neutron-functional-with-uwsgi/ffae97d/testr_results.html | 15:16 |
| ykarel | seen this also one | 15:16 |
| ykarel | for this too need to dig logs, any volunteer to check this? | 15:17 |
| mlavalle | I can do it | 15:17 |
| ykarel | thx mlavalle | 15:17 |
| ykarel | #action mlavalle to check failure with test_port_binding_chassis_create_event | 15:17 |
| ykarel | For fullstack we still hitting TIMEOUTs sometimes even after dropping linuxbridge tests | 15:18 |
| ykarel | so need to check those, but for that we already have a known issue | 15:18 |
| ykarel | #topic Tempest/Scenario | 15:19 |
| ykarel | we have a infra specific problem where Sometimes job failing randomly with Unable to establish SSL connection to cloud-images.ubuntu.com | 15:20 |
| ykarel | you may have noticed it already | 15:20 |
| haleyb | yup | 15:21 |
| lajoskatona | yesterday there was some zuul issue also without logs | 15:21 |
| ykarel | yeap zuul bit is fixed now, for the cloud-images if it's some known bit or not | 15:21 |
| ykarel | me not sure, let's see if we still see this frequently, need to reach out to infra for this | 15:22 |
| ykarel | also in some ovs jobs we seeing failures like | 15:22 |
| ykarel | https://ca6bf2baf6d89f5ed910-37ccdaa5e24fdd183c62eb6fdd1f8a71.ssl.cf5.rackcdn.com/901827/1/gate/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/3e27967/testr_results.html | 15:22 |
| ykarel | https://4cd02d83e42f664c3d38-4289c2655d9b20a523cb41ee99eef7c9.ssl.cf5.rackcdn.com/901474/3/check/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/fb28885/testr_results.html | 15:22 |
| ykarel | where test fails to ssh guest vm | 15:22 |
| ykarel | in these examples, guest vms don't have ip assigned by dhcp | 15:23 |
| lajoskatona | the 2 examples test_qos is it happens for other tests also? | 15:24 |
| ykarel | i recall rodolfo was checking something similar before his PTOs | 15:25 |
| ykarel | i think it's not specific to that test/job | 15:25 |
| ykarel | i saw some more occurances in opensearch | 15:25 |
| slaweq | from quick look I see many ERRORs logged in the q-dhcp log file: https://4cd02d83e42f664c3d38-4289c2655d9b20a523cb41ee99eef7c9.ssl.cf5.rackcdn.com/901474/3/check/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/fb28885/controller/logs/screen-q-dhcp.txt | 15:26 |
| ykarel | looking for : probing for an IPv4LL address | 15:26 |
| slaweq | maybe one of those errors is related to the failed test | 15:26 |
| ykarel | in one of those i noticed there were no dhcprequest/dhcpack messages, and continuos dhcpoffer | 15:27 |
| ykarel | may be dhcpoffer not reaching vms for some reason? | 15:28 |
| ykarel | and in one i saw dhcp agent took time to configure the port(~ 1minute) and in that time client side configured ipv4ll address | 15:30 |
| ykarel | iirc in older cirros versions where udhcpc was used it used to try thrice every 60 second before giving up but that doesn't seems to be the case with recent cirros/dhcpcd version | 15:32 |
| ykarel | anyway we need to look into these failures | 15:32 |
| ykarel | any volunteer to log a bug for this? | 15:32 |
| ykarel | ok i will do log a bug for this and then we will see | 15:33 |
| ykarel | #action ykarel to log a bug for dhcp/metadata issue in ovs jobs | 15:33 |
| lajoskatona | +1 | 15:33 |
| ykarel | #topic Periodic | 15:33 |
| ykarel | master line is all good | 15:33 |
| ykarel | for stable we have some broken jobs | 15:34 |
| ykarel | #link https://zuul.openstack.org/builds?job_name=neutron-tempest-mariadb-full&project=openstack%2Fneutron&branch=stable%2Fussuri&skip=0 | 15:34 |
| ykarel | This Job runs on bionic and setup mariadb 10.3 repos which are no longer available | 15:34 |
| opendevreview | Merged openstack/ovn-bgp-agent stable/2023.2: Avoid race when deleting VM with FIP https://review.opendev.org/c/openstack/ovn-bgp-agent/+/902067 | 15:34 |
| ykarel | wdyt should we just drop that job from ussuri as its already extended maintenance? | 15:35 |
| slaweq | ++ | 15:35 |
| lajoskatona | +1 | 15:35 |
| haleyb | +1 | 15:35 |
| bcafarel | +1, and ussuri is also headed for EOL no? | 15:35 |
| bcafarel | so cleaning the job earlier will not hurt | 15:35 |
| ykarel | ok any volunteer to push the patch to drop? | 15:36 |
| bcafarel | I already ahve the zuul file open in vim :) | 15:37 |
| ykarel | ++ thx | 15:37 |
| ykarel | #action bcafarel to drop neutron-tempest-mariadb-full in ussuri | 15:37 |
| ykarel | #link https://zuul.openstack.org/builds?job_name=neutron-linuxbridge-tempest-plugin-scenario-nftables&job_name=neutron-ovs-tempest-plugin-scenario-iptables_hybrid-nftables&project=openstack%2Fneutron&branch=stable%2Fxena&skip=0 | 15:37 |
| ykarel | these failing with RETRY_LIMIT and no logs to check the reason so need to be digged | 15:38 |
| ykarel | and these are for xena | 15:38 |
| ykarel | any volunteer to check these? | 15:39 |
| ykarel | k i will check these and report bug | 15:40 |
| ykarel | #action ykarel to check issue with nftables xena periodic job | 15:40 |
| ykarel | #link https://zuul.openstack.org/builds?job_name=neutron-ovs-tempest-fips&job_name=neutron-ovn-tempest-ovs-release-fips&project=openstack%2Fneutron&branch=stable%2Fyoga&skip=0 | 15:40 |
| ykarel | this is specific to 9 stream fips jobs | 15:41 |
| ykarel | in stable/yoga | 15:41 |
| ykarel | in yoga we have pyroute 0.6.6 and due to it's hitting https://bugs.launchpad.net/tripleo/+bug/2023764 | 15:42 |
| lajoskatona | so this means pyroute req update on yoga? | 15:43 |
| ykarel | yes if we want to get that fixed or drop the jobs to run in yoga | 15:43 |
| ykarel | wdyt? should we just drop these two jobs | 15:45 |
| ykarel | bumping pyroute2 in stable might be trickier | 15:46 |
| lajoskatona | agree | 15:46 |
| slaweq | drop jobs IMO | 15:46 |
| opendevreview | Bernard Cafarelli proposed openstack/neutron stable/ussuri: [stable-only] Drop neutron-tempest-mariadb-full periodic job https://review.opendev.org/c/openstack/neutron/+/902090 | 15:47 |
| lajoskatona | perhaps the thing should be documented somewhere to help operators, bu tlet's drop the jobs | 15:47 |
| ykarel | Ok, in RDO side it's already patched | 15:47 |
| ykarel | any volunteer to drop these jobs in yoga? | 15:47 |
| ykarel | k i will send the patch to drop these | 15:49 |
| lajoskatona | thanks | 15:49 |
| ykarel | #action ykarel to send patch to drop ovs/ovn fips job in stable/yoga | 15:49 |
| ykarel | Last one | 15:49 |
| ykarel | #link https://zuul.openstack.org/builds?job_name=devstack-tobiko-neutron&project=openstack%2Fneutron&branch=stable%2Fxena&branch=stable%2Fyoga&branch=stable%2Fzed&skip=0 | 15:49 |
| ykarel | This job is Running on focal and running tests which shouldn't on focal as per https://review.opendev.org/c/openstack/neutron/+/871982 | 15:49 |
| ykarel | and this is included in antelope+ so for older branches need to skip those tests in some other way | 15:50 |
| ykarel | slaweq, eolivare may be you know ^ | 15:51 |
| ykarel | k i will report a bug for this and then will see | 15:52 |
| bcafarel | do we have something like tempest_exclude_regex for tobiko? | 15:52 |
| ykarel | #action ykarel to report bug for tobiko stable jobs | 15:52 |
| ykarel | me no idea | 15:52 |
| bcafarel | yes let's wait for tobiko experts here :) | 15:53 |
| slaweq | bcafarel no, there is nothing like that | 15:53 |
| ykarel | k last topic | 15:53 |
| ykarel | #topic Grafana | 15:53 |
| ykarel | https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=1 | 15:53 |
| slaweq | I will check that tobiko issue | 15:53 |
| ykarel | Thanks slaweq | 15:53 |
| ykarel | let's have a quick look on grafana too | 15:54 |
| ykarel | it looks overall good to me, there are some failures in check but those i think are patch specific | 15:55 |
| lajoskatona | or related to recent zuul issues | 15:56 |
| ykarel | yeap | 15:56 |
| ykarel | k let's move to on demand | 15:56 |
| ykarel | #topic On Demand | 15:56 |
| ykarel | anyone wants to bring something here? | 15:56 |
| lajoskatona | nothing from me | 15:57 |
| mlavalle | nothing from me either | 15:58 |
| ykarel | K Thanks everyone, it's stretched longer today :) | 15:58 |
| ykarel | #endmeeting | 15:58 |
| opendevmeet | Meeting ended Tue Nov 28 15:58:56 2023 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:58 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.html | 15:58 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.txt | 15:58 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.log.html | 15:58 |
| slaweq | o/ | 15:59 |
| lajoskatona | o/ | 15:59 |
| bcafarel | o/ | 15:59 |
| mlavalle | o/ | 16:00 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent https://review.opendev.org/c/openstack/neutron/+/902014 | 16:40 |
| opendevreview | Merged openstack/neutron stable/2023.1: get_hosts_mapped_with_segments add filter agt_type https://review.opendev.org/c/openstack/neutron/+/901789 | 16:53 |
| opendevreview | Merged openstack/neutron stable/2023.2: Don't set port capabilities for OVS HW offloading https://review.opendev.org/c/openstack/neutron/+/900320 | 16:53 |
| opendevreview | Merged openstack/neutron master: Add [metadata_rate_limiting] options to example config files https://review.opendev.org/c/openstack/neutron/+/902013 | 23:40 |
| opendevreview | Merged openstack/neutron master: Validate ip versions https://review.opendev.org/c/openstack/neutron/+/901894 | 23:42 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!