| *** jph_ is now known as jph | 01:28 | |
| opendevreview | Rodolfo Alonso proposed openstack/neutron-lib master: Add extension "router-enable-snat" https://review.opendev.org/c/openstack/neutron-lib/+/961612 | 08:20 |
|---|---|---|
| ralonsoh | lajoskatona, slaweq ^ hello! if you have a couple on mins. Tomorrow I'll add a on-demand topic to explain a bit this. In a nutshell: the enable_snat flag is a router global variable (not a gateway variable). It makes sense then to expose it via API | 08:22 |
| ralonsoh | it is possible to define it during the router creation and when modifying a GW | 08:23 |
| ralonsoh | the API will expose it as read only for the router object | 08:23 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron master: [eventlet-removal] Don't use eventlet in the unit/functional tests https://review.opendev.org/c/openstack/neutron/+/952258 | 08:24 |
| lajoskatona | ralonsoh: checking | 08:32 |
| *** liuxie is now known as liushy | 11:51 | |
| slaweq | ralonsoh I added some comments there | 12:08 |
| opendevreview | Arnaud Morin proposed openstack/neutron master: Add a new option to skip loading Trunk extension https://review.opendev.org/c/openstack/neutron/+/913979 | 12:15 |
| ralonsoh | slaweq, thanks! | 12:44 |
| opendevreview | Lajos Katona proposed openstack/neutron-vpnaas master: pep8: Enable N535 eventlet checking hacking rule https://review.opendev.org/c/openstack/neutron-vpnaas/+/961981 | 13:46 |
| ykarel | #startmeeting neutron_ci | 14:01 |
| opendevmeet | Meeting started Mon Sep 22 14:01:10 2025 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 14:01 |
| ykarel | Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 14:01 |
| ralonsoh | hello | 14:01 |
| ykarel | it's IRC today \o/ | 14:01 |
| bcafarel | good, as there is the OVN community meeting in parallel :) | 14:01 |
| slaweq | o/ | 14:04 |
| lajoskatona | o/ | 14:05 |
| ykarel | Hello everyone, let's start with the topics | 14:05 |
| ykarel | We didn't had an action item last week, so moving on | 14:05 |
| ykarel | #topic Stable branches | 14:05 |
| ykarel | Not much activity and all good except 2024.1 rally which we discuss later | 14:05 |
| ykarel | bcafarel, anything to add ^? | 14:06 |
| bcafarel | +1 and also just usual heads-up now we have 2025.2 branch (in the backport chain) | 14:06 |
| bcafarel | rest is overall good indeed | 14:06 |
| ykarel | thx bcafarel for the udpates | 14:07 |
| ykarel | #topic Stadium projects | 14:07 |
| lajoskatona | All green this week :-) | 14:07 |
| ykarel | all green in weekly periodics | 14:07 |
| ykarel | anything else to add lajoskatona ? | 14:07 |
| lajoskatona | not much, some hanging patches in those repos if you have time please check them :-) | 14:07 |
| ykarel | ok thx | 14:09 |
| ykarel | #topic Rechecks | 14:09 |
| ykarel | we have some rechecks to known intermittent issues, will be discussed in failures section | 14:10 |
| ykarel | bare recheck wise we had 3/13 failures | 14:10 |
| ykarel | notified the contributor about this to avoid bare rechecks | 14:10 |
| ykarel | Now lets talk about the failures | 14:11 |
| ykarel | #topic fullstack/functional | 14:11 |
| ykarel | random functional job timeouts | 14:11 |
| ykarel | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_a02/openstack/a0219a0f15bd4213ad80c2e2afb62f5a/job-output.txt | 14:11 |
| ykarel | https://4012fe1b2f450bdd20fd-e30f275ad83ed88289c7399adb6c5ee6.ssl.cf2.rackcdn.com/openstack/770b8af756564f4491a4deebbc3e3864/job-output.txt | 14:11 |
| ykarel | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9ee/openstack/9ee33d8cfca64cbc98bb081bff101afb/job-output.txt | 14:11 |
| ykarel | Noticed atleast the db migrations taking much time in these | 14:11 |
| ykarel | Is this something you observed? or any recent change you can related this to? | 14:11 |
| ralonsoh | I saw this with the eventlet-removal changes | 14:12 |
| ralonsoh | but nothing yet merged | 14:12 |
| ykarel | yes seen those in periodic, gate jobs so not related to unmerged ones atleast | 14:12 |
| ykarel | ok will report an issue for this to track | 14:13 |
| ykarel | #action ykarel to report issue with functional job timeouts | 14:13 |
| ykarel | #topic Tempest/Scenario | 14:13 |
| ykarel | - multinode failure keystone timed out or No route to host | 14:13 |
| ykarel | - https://553968d56d5c3ae1c42d-c01956f0d2337f9ef2061ae614307798.ssl.cf5.rackcdn.com/openstack/47d38463db2648138a4b6280d4b10155/job-output.txt | 14:13 |
| ykarel | - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9e2/openstack/9e2896f8e7734a25a439c8d204bccb3b/job-output.txt | 14:13 |
| ykarel | - https://39d563aa6881906ba38a-c46c6711d422731404e9aacada362597.ssl.cf2.rackcdn.com/openstack/36407411f7b143f0bb60eb0011a5d886/job-output.txt | 14:13 |
| ykarel | - https://c615f6cb2e225c62edd6-7e310815a60a2b301b989273943a8e9b.ssl.cf5.rackcdn.com/openstack/c1b86a008f2c4038906a6d2a10b829ce/job-output.txt | 14:13 |
| ykarel | Asked in #openstack-infra, there are some recent changes in infra side for this, so will report a bug to track this | 14:14 |
| ykarel | #action ykarel to report bug to track fixes of multinode job issues | 14:14 |
| ykarel | #topic Rally jobs | 14:14 |
| ykarel | 2024.1 broken https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovs-rally-task&project=openstack%2Fneutron&branch=stable%2F2024.1&skip=0 | 14:14 |
| ykarel | context in https://review.opendev.org/c/openstack/neutron/+/961490/1#message-1636456da98534b3fa11f2429fa8c2ce38781693 | 14:14 |
| ykarel | tobiko is branchless, and recent patches there broke this job in stable/2024.1 | 14:15 |
| ralonsoh | only for this stable branch? | 14:16 |
| ykarel | considering 2024.1 about to go unmaintained we can remove these jobs or can fix for time being by pinning these jobs to working tobiko tag | 14:16 |
| ykarel | yes only 2024.1 | 14:16 |
| ralonsoh | we can do the second, pinning tobiko | 14:17 |
| ykarel | sorry not tobiko, but rally :) | 14:17 |
| ralonsoh | yeah rally heheheh | 14:17 |
| ykarel | ok | 14:17 |
| ykarel | then can push a change to pin for now | 14:18 |
| ralonsoh | I'll do it | 14:18 |
| ykarel | to https://opendev.org/openstack/rally/src/tag/4.1.0/ | 14:18 |
| ykarel | ok thx | 14:18 |
| ykarel | #action ralonsoh to pin rally in 2024.1 jobs | 14:19 |
| ykarel | thats it for failures | 14:19 |
| ykarel | #topic Grafana | 14:19 |
| ykarel | let's have quick look on dashboard too https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 14:20 |
| ykarel | ok we can see some failures in multinode ones as already discussed | 14:21 |
| ykarel | tempest-integrated gate one had failed with kernel panic in guest vm | 14:21 |
| ykarel | apart from these looks normal | 14:21 |
| ykarel | anything to add? | 14:21 |
| ralonsoh | not really | 14:22 |
| lajoskatona | nothing from me | 14:22 |
| ykarel | ok let's move | 14:22 |
| ykarel | #topic On Demand | 14:22 |
| ykarel | anything else you would like to raise? | 14:22 |
| ralonsoh | no | 14:23 |
| ykarel | ok in that case let's close early and have everyone almost 35 minutes back | 14:25 |
| ykarel | thx all for joining | 14:25 |
| ykarel | #endmeeting | 14:25 |
| opendevmeet | Meeting ended Mon Sep 22 14:25:34 2025 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:25 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-09-22-14.01.html | 14:25 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-09-22-14.01.txt | 14:25 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2025/neutron_ci.2025-09-22-14.01.log.html | 14:25 |
| ralonsoh | bye | 14:25 |
| lajoskatona | Bye | 14:25 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron-lib master: Add extension "router-enable-snat" https://review.opendev.org/c/openstack/neutron-lib/+/961612 | 14:50 |
| mnaser | Does anyone know about any issues around race conditions on the DHCP port when using OVN? | 18:09 |
| mnaser | `ovn-nbctl list Logical_Switch_Port f8dd9ad6-d88d-4b02-9148-8d1abcf54721 | egrep ^addresses` => `addresses : ["fa:16:3e:34:eb:a5 10.1.3.2 10.2.3.2"]` | 18:09 |
| mnaser | `openstack port show f8dd9ad6-d88d-4b02-9148-8d1abcf54721 -c fixed_ips` => `[{'subnet_id': 'cd362830-ce71-4be2-bcea-53dbf12bdf16', 'ip_address': '10.1.3.2'}, {'subnet_id': '328297f2-a1ee-4376-8d9c-c8938b3d0a97', 'ip_address': '10.100.3.2'}, {'subnet_id': '0e2abf5e-7d53-4a43-bc9b-640d8b05785a', 'ip_address': '10.2.3.2'}, {'subnet_id': 'e581d679-1860-4213-80f8-e5e8fe729644', 'ip_address': '10.3.3.2'}]` | 18:10 |
| mnaser | What's even more interesting (or scary?): `external_ids : {"neutron:cidrs"="10.1.3.2/24 10.2.3.2/24", "neutron:device_id"=ovnmeta-3ce5972d-4614-4034-98c5-c4334b2a7139, "neutron:device_owner"="network:distributed", "neutron:mtu"="1442", "neutron:network_name"=neutron-3ce5972d-4614-4034-98c5-c4334b2a7139, "neutron:port_capabilities"="", "neutron:port_name"="", "neutron:project_id"="8e3aa89a8aca4209b96c5b8be394ff7e", | 18:10 |
| mnaser | "neutron:revision_number"="5", "neutron:security_group_ids"="", "neutron:subnet_pool_addr_scope4"="", "neutron:subnet_pool_addr_scope6"="", "neutron:vnic_type"=normal}` | 18:10 |
| * mnaser `openstack port show f8dd9ad6-d88d-4b02-9148-8d1abcf54721 -c revision_number -f value` => `5` | 18:11 | |
| mnaser | so i'm wondering if the add subnet to metadata port is somehow not triggering a revision # update or something.. | 18:11 |
| mnaser | this happened ms apart an across several workers, so it really screams race condition | 18:14 |
| mnaser | https://usercontent.irccloud-cdn.com/file/OSWqedW0/image.png | 18:14 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: Introduce service plugin https://review.opendev.org/c/openstack/neutron/+/958100 | 20:37 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: Introduce Main router and chassis router commands https://review.opendev.org/c/openstack/neutron/+/959890 | 20:37 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: Introduce BGP chassis commands https://review.opendev.org/c/openstack/neutron/+/960422 | 20:37 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: OVN agent BGP extension https://review.opendev.org/c/openstack/neutron/+/960895 | 20:37 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: Add openflow configuration for BGP bridges https://review.opendev.org/c/openstack/neutron/+/961293 | 20:51 |
| opendevreview | Jakub Libosvar proposed openstack/neutron master: bgp: OVN agent BGP extension https://review.opendev.org/c/openstack/neutron/+/960895 | 21:22 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
