Tuesday, 2023-11-28

opendevreviewTakashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files  https://review.opendev.org/c/openstack/neutron/+/90201300:46
opendevreviewTakashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files  https://review.opendev.org/c/openstack/neutron/+/90201300:51
opendevreviewTakashi Kajinami proposed openstack/neutron master: Validate ip versions  https://review.opendev.org/c/openstack/neutron/+/90189400:51
opendevreviewTakashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent config files  https://review.opendev.org/c/openstack/neutron/+/90201400:56
opendevreviewTakashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent config file  https://review.opendev.org/c/openstack/neutron/+/90201401:06
opendevreviewliuyulong proposed openstack/neutron master: Check subnet service_type for subnet_create  https://review.opendev.org/c/openstack/neutron/+/90122501:12
opendevreviewMerged openstack/neutron stable/2023.2: docs: update default value of metadata workers for ml2/ovn  https://review.opendev.org/c/openstack/neutron/+/90149501:19
opendevreviewMerged openstack/neutron stable/2023.1: docs: update default value of metadata workers for ml2/ovn  https://review.opendev.org/c/openstack/neutron/+/90149601:19
opendevreviewMerged openstack/neutron stable/zed: docs: update default value of metadata workers for ml2/ovn  https://review.opendev.org/c/openstack/neutron/+/90149701:19
opendevreviewMerged openstack/neutron stable/yoga: docs: update default value of metadata workers for ml2/ovn  https://review.opendev.org/c/openstack/neutron/+/90149801:19
opendevreviewMerged openstack/neutron stable/wallaby: docs: update default value of metadata workers for ml2/ovn  https://review.opendev.org/c/openstack/neutron/+/90150001:19
opendevreviewTakashi Kajinami proposed openstack/neutron master: Add [metadata_rate_limiting] options to example config files  https://review.opendev.org/c/openstack/neutron/+/90201301:21
opendevreviewTakashi Kajinami proposed openstack/neutron master: Validate ip versions  https://review.opendev.org/c/openstack/neutron/+/90189401:21
opendevreviewhuanghailun proposed openstack/neutron master: Remove the restriction on empty cidr's update events  https://review.opendev.org/c/openstack/neutron/+/90181202:10
opendevreviewMerged openstack/neutron stable/zed: Catch non-existent entry failures better in ip_lib  https://review.opendev.org/c/openstack/neutron/+/90107302:15
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189502:20
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189502:23
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189502:33
opendevreviewMerged openstack/neutron stable/2023.2: Catch non-existent entry failures better in ip_lib  https://review.opendev.org/c/openstack/neutron/+/90106202:58
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189503:32
opendevreviewliuyulong proposed openstack/neutron master: Check subnet service_type for subnet_create  https://review.opendev.org/c/openstack/neutron/+/90122506:57
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189507:01
opendevreviewTakashi Kajinami proposed openstack/neutron master: Replace network type names by constants  https://review.opendev.org/c/openstack/neutron/+/90204607:08
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196207:23
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196307:56
opendevreviewTakashi Kajinami proposed openstack/neutron master: Remove logic for old LBaaS(v2)  https://review.opendev.org/c/openstack/neutron/+/90204808:09
opendevreviewSlawek Kaplonski proposed openstack/neutron master: [OVN] Add baremetal support without Neutron DHCP agent for IPv6  https://review.opendev.org/c/openstack/neutron/+/89068308:21
opendevreviewhuanghailun proposed openstack/neutron master: Add allowed_address_pairs add/remove atomic operations  https://review.opendev.org/c/openstack/neutron/+/90189509:30
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/xena: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/90102309:33
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/xena: [OVN] Try to bind ports only to the ovn-controller agents  https://review.opendev.org/c/openstack/neutron/+/90102409:33
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/wallaby: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/90102509:34
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/wallaby: [OVN] Try to bind ports only to the ovn-controller agents  https://review.opendev.org/c/openstack/neutron/+/90102609:34
sahido/09:45
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196309:55
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196210:14
opendevreviewBrian Haley proposed openstack/neutron master: Remove vnic_type_blacklist deprecated name  https://review.opendev.org/c/openstack/neutron/+/90147810:18
fnordahlI need to rebase the 2023-aa-l3-gw-multihoming series ( https://review.opendev.org/q/topic:%222023-aa-l3-gw-multihoming%22+status:open+project:openstack/neutron ) and I wondered if anyone had a moment to review the bottom 4 patches before I do, they are very small fixing issues in committed but not active code and has test coverage in the proposed tempest tests under the same topic.10:25
fnordahlThere is already one +2 on them, and one procedural -1 from ralonsoh on the bottom one, and I think we have justified not needing a LP bug for these in our response, but it has been left unanswered since October10:26
opendevreviewTakashi Kajinami proposed openstack/neutron master: Remove logic for old LBaaS(v2)  https://review.opendev.org/c/openstack/neutron/+/90204811:27
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/xena: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/90102311:54
ykarelbcafarel, lajoskatona when you get chance please check few backports12:53
ykarelhttps://review.opendev.org/q/Ie0ec43566fa2b3e13b4917493336ce1519c9b6bb12:53
ykarelhttps://review.opendev.org/q/Icd84685c37fffa20e4fc9c5522f77bc63e2565f212:53
bcafarelykarel: sure, I will take a look later today12:57
lajoskatonahaleyb: Hi, I added a topic for the on-demand agenda to discuss together the current OpenApi efforts for SDK, and gtema is so nice to join the meeting to help in the interpretation of this effort13:06
lajoskatonaykarel: sure will check them13:07
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/xena: [OVN] Try to bind ports only to the ovn-controller agents  https://review.opendev.org/c/openstack/neutron/+/90102413:09
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/wallaby: [ovn]Refusing to bind port to dead agent  https://review.opendev.org/c/openstack/neutron/+/90102513:09
opendevreviewSlawek Kaplonski proposed openstack/neutron stable/wallaby: [OVN] Try to bind ports only to the ovn-controller agents  https://review.opendev.org/c/openstack/neutron/+/90102613:10
*** damian___921834 is now known as damian___9218313:25
sahidhello guys, on some of our compute we are expericing high cpu spike comming from vswitchd, any one have suffering some behavior?13:50
sahidlooks like vswitched are flooding arp13:50
sahidthat looks to comes from one specific tenant only13:51
opendevreviewSlawek Kaplonski proposed openstack/neutron master: DNM This is only test for the RDO testproject CI jobs  https://review.opendev.org/c/openstack/neutron/+/90206013:57
opendevreviewLucas Alvares Gomes proposed openstack/neutron master: Fix IGMP inconsistency across drivers  https://review.opendev.org/c/openstack/neutron/+/90175313:59
haleybping bcafarel, elvira, frickler, mlavalle, mtomaska, obondarev, slaweq, tobias-urdin, ykarel, lajoskatona, jlibosva, averdagu, amotoki14:00
haleyb#startmeeting networking14:00
opendevmeetMeeting started Tue Nov 28 14:00:09 2023 UTC and is due to finish in 60 minutes.  The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
opendevmeetThe meeting name has been set to 'networking'14:00
elvirao/14:00
obondarevo/14:00
mlavalle\o14:00
ykarelo/14:01
rubasovo/14:01
haleybalright lets get started14:01
haleyb#topic announcements14:01
haleybaccording to https://releases.openstack.org/caracal/schedule.html we are past the C-1 milestone14:02
lajoskatonao/14:02
haleybC-2 milestone is Jan 8-12 which will come up quickly14:02
haleybReminder: If you have a topic for the drivers meeting on Friday, please add it to the wiki @ https://wiki.openstack.org/wiki/Meetings/NeutronDrivers14:03
haleybthere are currently no topics in the queue14:03
haleybReview days - talked last week about setting aside 2-3 days at intervals to get some in-flight reviews merged14:04
haleyb#link https://doodle.com/meeting/organize/id/dN8opRDa14:04
haleyb5 people added their availability, with December 1st and 8th working for everyone, are people OK splitting across a week?14:04
haleybor if back-to-back is better i would propose December 7/814:05
* haleyb taps microphone to see if people are awake :)14:05
lajoskatonayes sir14:06
fricklerI'm not directly involved, but splitting to allow authors to react sounds nice14:06
lajoskatonafor me either can work14:06
mlavallethe split is fine14:06
lajoskatonagood reasoning, than split it14:06
haleybalright, i was thinking the same thing - so anyone that added their name, or anyone that needs reviews, try and set aside time this Friday and next for them14:07
haleybtime in-between to fix-up and rebase, etc14:08
haleyb#action haleyb to reply to ML thread with this info14:08
fricklerfnordahl: ^^ that might be interesting for your series, too14:08
haleybany other announcements?14:09
haleyb#topic bugs14:10
haleybobondarev was deputy last week, isabek is this week, elvira next week14:10
haleyb#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/W4JIPTXHVIN54T2FOPEYO6AGREF4JPCC/14:10
haleyb4/5 bugs were picked-up and have patches14:11
isabeko/14:11
haleybso thanks for picking them up14:11
haleybisabek: are you ok being bug deputy this week?14:12
isabeksure14:12
haleyback, thanks!14:12
elvirathere are some PH on Spain next week, I will be out from wednesday until end of week :(14:12
bcafarellate o/14:13
elviraI don't mind taking a look mon-tue and then on Mondaywhen I get back. Whatever is best for you folks14:13
haleybelvira: ack, i can watch for critical things the end of the week, unless someone wants to switch?14:14
lajoskatonaI can switch14:15
lajoskatonamy week would be the first of 24, and I am off that week14:15
haleybelvira: does that work? i can update if so14:16
elviraI will also be off but I will have the laptop really nearby so no problem for me!!14:16
elviraIt works better14:16
elvira:) 14:16
lajoskatonathanks, than I will be deputy next week14:16
haleybsold, will update14:17
haleybso the one bug in question is14:17
haleyb#link https://bugs.launchpad.net/neutron/+bug/204421514:17
haleybdns: Keyword is replaced by project_name instead of project_id14:17
haleybi don't exactly understand it either, submitter asked for more information14:18
haleybif it makes sense to anyone please feel free to add comments14:18
haleybare there any other bugs someone wants to discuss?14:19
gtemahttps://bugs.launchpad.net/neutron/+bug/197582814:19
gtemasorry for jumping in: please check the last comment. Sadly bug expired, but I posted update recently14:19
gtemathere is huge difference in API when listing ports (from project with 1500 ports) between admin and user call14:20
gtemaand I ended up in thinking that it is policy evaluation engine14:20
haleybgtema: thanks for bringing this up14:20
haleybso when you say policy i'm assuming rbac?14:21
gtemayes14:21
haleybwe can un-expire it, is there anyone that has cycles to look into it?14:22
haleybrodolfo is out for a while14:23
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196314:23
fnordahlfrickler: (indeed, I will read up on the e-mail thread, and I'm available until Dec 15th so hopefully we can get some ground covered before then!)14:23
opendevreviewMiguel Lavalle proposed openstack/neutron master: Router flavors and service type for OVN  https://review.opendev.org/c/openstack/neutron/+/88398814:23
opendevreviewMerged openstack/ovn-bgp-agent master: Ensure withdrawn events are only processed in relevant nodes  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196214:24
haleybgtema: i will change the status just not sure if anyone can pick it up14:24
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent stable/2023.2: Ensure withdrawn events are only processed in relevant nodes  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90206514:25
gtemaok. I will try myself to play deeper with it. It looks like there is no caching when policies are being evaluated. Just wanted to know whether somebody knows something about it14:25
haleybsorry i don't, first time i had seen it14:26
haleyblast thing on topic of bugs14:26
gtemaok, thks anyway14:27
haleybCurrent bug count this week: 762, up 2 from last week - so good we really didn't increase14:27
haleyb#topic specs14:28
haleyb#link https://review.opendev.org/q/project:openstack%252Fneutron-specs+status:open14:28
haleybi see racosta has uploaded a new version of the OVN-IC spec, i have not had time to review yet14:29
haleyb#link https://review.opendev.org/c/openstack/neutron-specs/+/89120414:29
haleybwill review today14:29
haleyband the other two (BGP related) also had updates14:30
haleybhopefully people will get around to reviews :)14:30
haleybmoving on...14:31
haleyb#topic community_goals14:31
haleyblajoskatona: think you're the only one with a goal on the list, neutronclient deprecation14:33
haleyb#link https://review.opendev.org/c/openstack/horizon/+/89120514:33
lajoskatonayes, I am strugling with the one horizon patch14:33
lajoskatonato fix failing tests14:33
lajoskatonaso slow progression14:33
haleybthanks for taking on the work to begin with14:34
haleyb#topic on_demand14:34
lajoskatonaI added a topic for OpenAPI14:35
lajoskatonathe mail from gtema: https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/BU5JH7FJ5VPS75QWPW47IYSZOFDI5R2W/14:35
gtemaright, thanks14:35
gtemaI can give some more infos on the topic, but few more links to be more preciese14:36
haleyb"Neutron is very special"14:36
lajoskatona:-)14:36
haleybgtema: sure, go ahead14:36
gtemahttps://github.com/gtema/openstack-openapi/blob/main/specs/network/v2.yaml - this is a spec that I was able to generate from neutron sources14:37
gtemahttps://github.com/gtema/openstack-codegenerator/blob/main/codegenerator/generator/openapi/neutron.py - this is the code I generated it with14:37
gtemahttps://gtema.github.io/openstack-openapi/network.html - current draft for rendering spec in the OpenStack style14:37
gtemaeverything is a work in progress14:37
gtemabut generally the question nr 1) is Neutron team interested in having openapi doc produced from sources so that api-ref can be actually deprecated as such14:38
lajoskatonais this for the API or for what we have in SDK?14:38
gtemaand also all clients/sdks/etc can be generated by various tools14:38
lajoskatonaok so this is for the APi which we have in n-lib14:39
gtemawell, this is currently not connected with SDK directly, but rather extracted from Neutron source and api-ref html14:39
haleyb#link https://docs.openstack.org/api-ref/network/v2/index.html14:39
haleybshould be similar to that i would guess14:39
gtemaright, this is going to be rendered this style, but maybe more modern. This is not a point14:40
slaweqwhat about APIs provided by e.g. stadium projects? I don't see them in this example at all14:40
gtemaright, at the moment I took pure "neutron" and messed with what I could find14:40
gtemavpnaas is also not there and that was a question towards you14:41
gtemahttps://github.com/gtema/openstack-codegenerator/blob/main/codegenerator/generator/openapi/neutron.py#L79 - this is how I setup the neutron to access api router and inspect everything what it knows about14:41
slaweqeven for just neutron, APIs of running server may be different depending on enabled service plugins, mechanism drivers, etc. (as You already mentioned in the email) so will it be possible to somehow generate complete list of APIs always?14:41
gtemathat is the point - I need help in getting the configuration that enables "everything"14:42
lajoskatonaI dont think that is possible at least for all the stadiums in one setup14:43
gtemasecond question would be: is it possible to alter exposed routes to not to expose things which are not working14:43
gtemai.e. you see in the spec there is POST for /availability-zones or /auto-allocateted-topology14:44
gtemathis is because in reality those are exposed but if you try invoking them you will get weird validation errors, but not 40414:44
gtemaalso, I found way to "convert" api_definition into the json schema, but there are certain limitations there and not all resources are having it at all, so that requires hardcoding14:46
gtemalajoskatona - if it is not possible to have everything running at once (and this is why I stopped attempting that) we could try different approach of generating spec in few runs with different configs14:48
haleybi'm not sure i'm the best one to help, but my very generic question is there something neutron can change to make this work easier?14:48
lajoskatonagtema: ack14:48
opendevreviewMerged openstack/ovn-bgp-agent master: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90196314:48
gtemahaleyb: yes, there are certain things, but first I would like to know whether I have Neutron support generally in this initiative14:49
opendevreviewLuis Tomas Bolivar proposed openstack/ovn-bgp-agent stable/2023.2: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90206714:50
haleybgtema: i would support it, what do others think? and where do you think it falls on the scale of small/medium/large so we don't overcommit?14:51
slaweqgenerally I like that idea and I can try to help if I will have some cycles (but that may be hard currently)14:51
slaweqso gtema if You will need any help, please ping me - I will try to help when possible14:52
lajoskatona+1 from me, I can help also for the stadiums for example14:52
gtemaperfect. Thanks a lot.14:52
gtemaso from the gestimate: I think initially it is a small effort just to analyse and find ways for workarounds14:52
gtemaonce that is done in next steps those workarounds may be moved to neutron code so that generation is more reliable, that may be medium14:53
gtemabut I really don't expect it to be a large stuff14:53
gtemaok, thanks on the topic14:54
lajoskatonathanks for working on this topic14:55
haleybgtema: ack, thanks, sounds good to me14:55
haleybany other topics for discussion?14:56
mlavalleJust remind the team that router flavors with L3 OVN is ready for reviews: https://review.opendev.org/c/openstack/neutron/+/88398814:56
haleybmlavalle: thanks!14:56
mlavalleI just rebased it14:56
haleybykarel: and we have CI meeting today?14:56
ykarelyes in 4 minutes over IRC14:57
lajoskatonaack14:57
haleybok, thanks for attending everyone14:57
haleyb#endmeeting14:57
opendevmeetMeeting ended Tue Nov 28 14:57:46 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:57
opendevmeetMinutes:        https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.html14:57
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.txt14:57
opendevmeetLog:            https://meetings.opendev.org/meetings/networking/2023/networking.2023-11-28-14.00.log.html14:57
lajoskatonao/14:58
mlavalle\o14:59
ykarel#startmeeting neutron_ci15:00
opendevmeetMeeting started Tue Nov 28 15:00:34 2023 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
opendevmeetThe meeting name has been set to 'neutron_ci'15:00
ykarelping bcafarel, lajoskatona, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira15:00
ykarelGrafana dashboard: https://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=115:00
ykarelPlease open now :)15:00
mtomaskao/15:01
slaweqo/15:01
bcafarelI barely had time to go make a coffee :)15:01
bcafarelo/15:01
mlavalle\o15:01
lajoskatonao/15:01
haleybo/15:02
ykarelk let's start with the topics15:02
ykarel#topic Actions from previous meetings15:02
ykarelbhaley to refresh grafana dashboard for neutron-lib/neutron-tempest-plugin in project-config15:02
haleybi have the neutron-lib one almost done, just working on the periodic section15:02
haleybshort week last week15:03
ykarelthx not a urgent one so should be fine15:03
ykarel#topic Stable branches15:03
ykarelbcafarel, anything to share for stable?15:03
bcafarelI just finished catching up on my reviews, all looks good on CI status on active branches15:04
ykarelk that's good15:04
ykarel#topic Stadium projects15:04
ykarelperiodic lines are green here, and the ui issue related to job link also fixed15:04
lajoskatonaprojects are green, so no big problem15:05
ykarelk Thanks15:05
ykarel#topic Rechecks15:05
lajoskatonamy usual request: if you have few mins pleasecchek the stadium reviews also :-)15:06
ykarelwe are seeing some random failures across jobs and that leads to recheck on patches this week15:06
ykarelthere were 2 bare rechecks too, we should try to avoid that15:07
ykarelLet's check the failures15:07
ykarel#topic fullstack/functional15:07
ykareltest_dvr_router_lifecycle_without_ha_without_snat_with_fips15:07
ykarelAssertionError: Device name: fg-863e72ab-79, expected MAC: fa:16:3e:80:8d:8915:07
ykarel#link https://ef6fea84da73ed48af61-f850a1c88b63080f1e34c13fe4924008.ssl.cf2.rackcdn.com/901476/2/gate/neutron-functional-with-uwsgi/782e426/testr_results.html15:08
ykarelanyone recall this issue?15:09
mlavalleI don't15:09
ykareli have seen this before but it's not a frequent one15:09
haleybvaguely but don't remember the context15:09
ykarelmay be https://bugs.launchpad.net/neutron/+bug/200016415:10
haleybCo-Authored-By: Brian Haley <haleyb.dev@gmail.com>15:11
slaweqTo confirm that you can check ovs logs to see if port was created, deleted and created again quickly15:12
haleybykarel: was this failure in all branches?15:12
ykarelseen once as of now in master15:12
opendevreviewMerged openstack/ovn-bgp-agent stable/2023.2: Ensure withdrawn events are only processed in relevant nodes  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90206515:13
ykarelslaweq, ack will check the logs and confirm if it's same15:15
ykarel#action ykarel to check if functional failure is same as bug 200016415:15
ykarelNext one15:16
ykareltest_port_binding_chassis_create_event15:16
ykarelovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port_Binding with logical_port=1bbcd693-2b3b-4e72-8143-5a67359d56b215:16
ykarelhttps://3b2ee5c5f48b31d3cd88-77332c10a4b1568b93e2e5229e79a685.ssl.cf5.rackcdn.com/901507/2/gate/neutron-functional-with-uwsgi/ffae97d/testr_results.html15:16
ykarelseen this also one15:16
ykarelfor this too need to dig logs, any volunteer to check this?15:17
mlavalleI can do it15:17
ykarelthx mlavalle 15:17
ykarel#action mlavalle to check failure with test_port_binding_chassis_create_event15:17
ykarelFor fullstack we still hitting TIMEOUTs sometimes even after dropping linuxbridge tests15:18
ykarelso need to check those, but for that we already have a known issue15:18
ykarel#topic Tempest/Scenario15:19
ykarelwe have a infra specific problem where Sometimes job failing randomly with Unable to establish SSL connection to cloud-images.ubuntu.com15:20
ykarelyou may have noticed it already15:20
haleybyup15:21
lajoskatonayesterday there was some zuul issue also without logs15:21
ykarelyeap zuul bit is fixed now, for the cloud-images if it's some known bit or not15:21
ykarelme not sure, let's see if we still see this frequently, need to reach out to infra for this15:22
ykarelalso in some ovs jobs we seeing failures like15:22
ykarel    https://ca6bf2baf6d89f5ed910-37ccdaa5e24fdd183c62eb6fdd1f8a71.ssl.cf5.rackcdn.com/901827/1/gate/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/3e27967/testr_results.html15:22
ykarel    https://4cd02d83e42f664c3d38-4289c2655d9b20a523cb41ee99eef7c9.ssl.cf5.rackcdn.com/901474/3/check/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/fb28885/testr_results.html15:22
ykarelwhere test fails to ssh guest vm15:22
ykarelin these examples, guest vms don't have ip assigned by dhcp15:23
lajoskatonathe 2 examples test_qos is it happens for other tests also?15:24
ykareli recall rodolfo was checking something similar before his PTOs 15:25
ykareli think it's not specific to that test/job15:25
ykareli saw some more occurances in opensearch15:25
slaweqfrom quick look I see many ERRORs logged in the q-dhcp log file: https://4cd02d83e42f664c3d38-4289c2655d9b20a523cb41ee99eef7c9.ssl.cf5.rackcdn.com/901474/3/check/neutron-tempest-plugin-openvswitch-enforce-scope-old-defaults/fb28885/controller/logs/screen-q-dhcp.txt15:26
ykarellooking for : probing for an IPv4LL address15:26
slaweqmaybe one of those errors is related to the failed test15:26
ykarelin one of those i noticed there were no dhcprequest/dhcpack messages, and continuos dhcpoffer15:27
ykarelmay be dhcpoffer not reaching vms for some reason?15:28
ykareland in one i saw dhcp agent took time to configure the port(~ 1minute) and in that time client side configured ipv4ll address15:30
ykareliirc in older cirros versions where udhcpc was used it used to try thrice every 60 second before giving up but that doesn't seems to be the case with recent cirros/dhcpcd version15:32
ykarelanyway we need to look into these failures15:32
ykarelany volunteer to log a bug for this?15:32
ykarelok i will do log a bug for this and then we will see15:33
ykarel#action ykarel to log a bug for dhcp/metadata issue in ovs jobs15:33
lajoskatona+115:33
ykarel#topic Periodic15:33
ykarelmaster line is all good15:33
ykarelfor stable we have some broken jobs15:34
ykarel#link https://zuul.openstack.org/builds?job_name=neutron-tempest-mariadb-full&project=openstack%2Fneutron&branch=stable%2Fussuri&skip=015:34
ykarelThis Job runs on bionic and setup mariadb 10.3 repos which are no longer available15:34
opendevreviewMerged openstack/ovn-bgp-agent stable/2023.2: Avoid race when deleting VM with FIP  https://review.opendev.org/c/openstack/ovn-bgp-agent/+/90206715:34
ykarelwdyt should we just drop that job from ussuri as its already extended maintenance?15:35
slaweq++15:35
lajoskatona+115:35
haleyb+115:35
bcafarel+1, and ussuri is also headed for EOL no?15:35
bcafarelso cleaning the job earlier will not hurt15:35
ykarelok any volunteer to push the patch to drop?15:36
bcafarelI already ahve the zuul file open in vim :)15:37
ykarel++ thx15:37
ykarel#action bcafarel to drop neutron-tempest-mariadb-full in ussuri15:37
ykarel#link https://zuul.openstack.org/builds?job_name=neutron-linuxbridge-tempest-plugin-scenario-nftables&job_name=neutron-ovs-tempest-plugin-scenario-iptables_hybrid-nftables&project=openstack%2Fneutron&branch=stable%2Fxena&skip=015:37
ykarelthese failing with RETRY_LIMIT and no logs to check the reason so need to be digged15:38
ykareland these are for xena15:38
ykarelany volunteer to check these?15:39
ykarelk i will check these and report bug15:40
ykarel#action ykarel to check issue with nftables xena periodic job15:40
ykarel#link https://zuul.openstack.org/builds?job_name=neutron-ovs-tempest-fips&job_name=neutron-ovn-tempest-ovs-release-fips&project=openstack%2Fneutron&branch=stable%2Fyoga&skip=015:40
ykarelthis is specific to 9 stream fips jobs15:41
ykarelin stable/yoga15:41
ykarelin yoga we have pyroute 0.6.6 and due to it's hitting https://bugs.launchpad.net/tripleo/+bug/202376415:42
lajoskatonaso this means pyroute req update on yoga?15:43
ykarelyes if we want to get that fixed or drop the jobs to run in yoga15:43
ykarelwdyt? should we just drop these two jobs15:45
ykarelbumping pyroute2 in stable might be trickier15:46
lajoskatonaagree15:46
slaweqdrop jobs IMO15:46
opendevreviewBernard Cafarelli proposed openstack/neutron stable/ussuri: [stable-only] Drop neutron-tempest-mariadb-full periodic job  https://review.opendev.org/c/openstack/neutron/+/90209015:47
lajoskatonaperhaps the thing should be documented somewhere to help operators, bu tlet's drop the jobs15:47
ykarelOk, in RDO side it's already patched15:47
ykarelany volunteer to drop these jobs in yoga?15:47
ykarelk i will send the patch to drop these15:49
lajoskatonathanks15:49
ykarel#action ykarel to send patch to drop ovs/ovn fips job in stable/yoga15:49
ykarelLast one 15:49
ykarel#link https://zuul.openstack.org/builds?job_name=devstack-tobiko-neutron&project=openstack%2Fneutron&branch=stable%2Fxena&branch=stable%2Fyoga&branch=stable%2Fzed&skip=015:49
ykarelThis job is Running on focal and running tests which shouldn't on focal as per https://review.opendev.org/c/openstack/neutron/+/87198215:49
ykareland this is included in antelope+ so for older branches need to skip those tests in some other way15:50
ykarelslaweq, eolivare may be you know ^15:51
ykarelk i will report a bug for this and then will see15:52
bcafareldo we have something like tempest_exclude_regex for tobiko?15:52
ykarel#action ykarel to report bug for tobiko stable jobs15:52
ykarelme no idea15:52
bcafarelyes let's wait for tobiko experts here :)15:53
slaweqbcafarel no, there is nothing like that15:53
ykarelk last topic15:53
ykarel#topic Grafana15:53
ykarelhttps://grafana.opendev.org/d/f913631585/neutron-failure-rate?orgId=115:53
slaweqI will check that tobiko issue15:53
ykarelThanks slaweq 15:53
ykarellet's have a quick look on grafana too15:54
ykarelit looks overall good to me, there are some failures in check but those i think are patch specific15:55
lajoskatonaor related to recent zuul issues15:56
ykarelyeap15:56
ykarelk let's move to on demand15:56
ykarel#topic On Demand15:56
ykarelanyone wants to bring something here?15:56
lajoskatonanothing from me15:57
mlavallenothing from me either15:58
ykarelK Thanks everyone, it's stretched longer today :)15:58
ykarel#endmeeting15:58
opendevmeetMeeting ended Tue Nov 28 15:58:56 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:58
opendevmeetMinutes:        https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.html15:58
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.txt15:58
opendevmeetLog:            https://meetings.opendev.org/meetings/neutron_ci/2023/neutron_ci.2023-11-28-15.00.log.html15:58
slaweqo/15:59
lajoskatonao/15:59
bcafarelo/15:59
mlavalleo/16:00
opendevreviewTakashi Kajinami proposed openstack/neutron master: Remove unused options from ovs agent  https://review.opendev.org/c/openstack/neutron/+/90201416:40
opendevreviewMerged openstack/neutron stable/2023.1: get_hosts_mapped_with_segments add filter agt_type  https://review.opendev.org/c/openstack/neutron/+/90178916:53
opendevreviewMerged openstack/neutron stable/2023.2: Don't set port capabilities for OVS HW offloading  https://review.opendev.org/c/openstack/neutron/+/90032016:53
opendevreviewMerged openstack/neutron master: Add [metadata_rate_limiting] options to example config files  https://review.opendev.org/c/openstack/neutron/+/90201323:40
opendevreviewMerged openstack/neutron master: Validate ip versions  https://review.opendev.org/c/openstack/neutron/+/90189423:42

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!