| tkajinam | haleyb, maybe we can try https://review.opendev.org/c/openstack/requirements/+/977591 ? | 05:10 |
|---|---|---|
| tkajinam | this does not work for stable branches, though | 05:10 |
| tkajinam | (see my reply to you mail in openstack-discuss ml | 05:10 |
| tkajinam | your mail * | 05:10 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: DNM: Try upper-constraints bump https://review.opendev.org/c/openstack/neutron/+/977592 | 05:18 |
| tkajinam | ^^^ haleyb frickler let's see how this goes ... | 05:19 |
| opendevreview | yatin proposed openstack/neutron stable/2025.1: [DNM] check fips job fix https://review.opendev.org/c/openstack/neutron/+/977593 | 05:48 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron stable/2024.2: Get rid of pkg_resources https://review.opendev.org/c/openstack/neutron/+/977072 | 07:09 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron stable/2024.2: Get rid of pkg_resources https://review.opendev.org/c/openstack/neutron/+/977072 | 08:29 |
| opendevreview | Marcin Wilk proposed openstack/neutron master: Use SB DB for checking if an OVN agent is alive https://review.opendev.org/c/openstack/neutron/+/977597 | 08:38 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron master: Bump neutron-lib to 3.24 https://review.opendev.org/c/openstack/neutron/+/977598 | 08:42 |
| opendevreview | Marcin Wilk proposed openstack/neutron master: Use SB DB for checking if an OVN agent is alive https://review.opendev.org/c/openstack/neutron/+/971876 | 08:42 |
| opendevreview | Merged openstack/os-ken master: Remove unused Makefile for doc https://review.opendev.org/c/openstack/os-ken/+/977522 | 09:14 |
| ralonsoh | Just a heads-up: FT job is blocked due to https://review.opendev.org/c/openstack/requirements/+/977591 | 09:22 |
| slaweq | lajoskatona hi, qq about neutronclient and fwaas osc plugin there | 10:09 |
| slaweq | lajoskatona I just opened small bug https://bugs.launchpad.net/python-neutronclient/+bug/2142458, I know that we are moving away from neutronclient to the osc directly but can we still fix such issue in neutronclient or should we first move code to osc and then fix it? It is nothing serious really just a bit bad UX with this issue being there | 10:11 |
| lajoskatona | slaweq: Hi, | 10:11 |
| lajoskatona | slaweq: I just checked, and as only taas client code was migrated to osc it think it is normal to fix things in neutronclient | 10:13 |
| slaweq | ok, I will propose fix then | 10:13 |
| slaweq | and I will plan for myself another task to start moving those bits to osc | 10:13 |
| lajoskatona | slaweq: cool, thanks :-) | 10:14 |
| slaweq | so you can consider "fwaas" parts as planned at least :) | 10:14 |
| opendevreview | Merged openstack/os-ken master: Remove MANIFEST.in https://review.opendev.org/c/openstack/os-ken/+/975997 | 10:33 |
| opendevreview | Merged openstack/neutron-vpnaas-dashboard master: Bump flake8-import-order https://review.opendev.org/c/openstack/neutron-vpnaas-dashboard/+/977455 | 10:53 |
| opendevreview | Merged openstack/python-neutronclient master: Bump flake8-import-order https://review.opendev.org/c/openstack/python-neutronclient/+/977452 | 11:10 |
| opendevreview | Arnau Verdaguer proposed x/whitebox-neutron-tempest-plugin master: [metadata-rate-limiting] Allow multiple paths https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/977322 | 11:40 |
| opendevreview | Maor Blaustein proposed x/whitebox-neutron-tempest-plugin master: Test traffic capture for HA failover from/to OCP/CRC nodes https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/977320 | 11:43 |
| opendevreview | Maor Blaustein proposed x/whitebox-neutron-tempest-plugin master: Test traffic capture for HA failover from/to OCP/CRC nodes https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/977320 | 11:54 |
| slaweq | haleyb hi, I saw your emails from last week about (yet another) bug related to the packaging package, is error like https://16e3f58c2e7d9ce780db-962d0b3c08b8cc7b352ed4e46de84aab.ssl.cf5.rackcdn.com/openstack/c54ebdd50ad14c1d887b43f936b7cdef/job-output.txt something what You are already aware of and working on or is it another new issue? | 13:12 |
| ykarel | slaweq, this is the same issue and all branches impacted | 13:15 |
| ykarel | caused by new tox | 13:15 |
| ralonsoh | I commented that this morning here | 13:26 |
| ralonsoh | there is a patch: | 13:26 |
| ralonsoh | https://review.opendev.org/c/openstack/requirements/+/965873 | 13:27 |
| ralonsoh | that should fix this problem | 13:27 |
| ykarel | ralonsoh yes for master, and that would also be backported? as stable also impacted cc @frickler @tkajinam | 13:29 |
| ykarel | only for packaging | 13:29 |
| ykarel | similar to https://review.opendev.org/c/openstack/requirements/+/977591 | 13:29 |
| slaweq | thx for confirmation ykarel and ralonsoh | 13:30 |
| frickler | yeah, for stable branches it's likely we'll need to pin/cap tox. once again. | 13:38 |
| opendevreview | Lajos Katona proposed openstack/networking-bagpipe master: CI: change networking-bagpipe-tempest job nodeset https://review.opendev.org/c/openstack/networking-bagpipe/+/977634 | 13:42 |
| ykarel | frickler, thx so this needs to be per project tox.ini or you pushing some global change? | 13:43 |
| frickler | ykarel: I haven't checked in detail yet. maybe updating templates in openstack-zuul-jobs could go a long way | 13:47 |
| opendevreview | Slawek Kaplonski proposed openstack/neutron-fwaas master: Don't validate port's project_id in the fwaas_plugin directly https://review.opendev.org/c/openstack/neutron-fwaas/+/977663 | 14:17 |
| ykarel | frickler, ack | 14:22 |
| haleyb | slaweq: yeah, looks like requirements change will fix it? i'm not sure about stable branches though, maybe they need a pin? | 14:23 |
| opendevreview | Lajos Katona proposed openstack/neutron-dynamic-routing master: Tests: Use change tenant_id to project_id https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/977670 | 14:25 |
| opendevreview | Merged openstack/neutron-vpnaas-dashboard master: Imported Translations from Zanata https://review.opendev.org/c/openstack/neutron-vpnaas-dashboard/+/975241 | 14:45 |
| ykarel | #startmeeting neutron_ci | 15:01 |
| opendevmeet | Meeting started Mon Feb 23 15:01:29 2026 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:01 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:01 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 15:01 |
| ykarel | Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 15:01 |
| ykarel | It's on IRC itself today | 15:01 |
| lajoskatona | o/ | 15:01 |
| bcafarel | o/ | 15:01 |
| lajoskatona | ykarel: cool, I just started to count on my hands to see which weeks we are in :-) | 15:02 |
| bcafarel | myself I gave up and just wait for the reminder to see if I need to start video :) | 15:03 |
| slaweq | o/ | 15:04 |
| ykarel | lajoskatona, i run date --utc +%U and accordingly post video or IRC :) | 15:04 |
| lajoskatona | ykarel: :D | 15:05 |
| ykarel | ok let's start with the topics | 15:05 |
| ykarel | ralonsoh to continue looking into the functional failure and push another fix | 15:05 |
| ykarel | seems not around will readd action for now | 15:07 |
| opendevreview | Rodolfo Alonso proposed openstack/ovsdbapp master: Add ``columns`` parameters to ``AddressSetAddCommand`` https://review.opendev.org/c/openstack/ovsdbapp/+/977091 | 15:07 |
| ralonsoh | hi (sorry) | 15:08 |
| ralonsoh | no, I didn't have time, I'll continue this week | 15:08 |
| ykarel | ok thx | 15:08 |
| ykarel | #action ralonsoh to continue looking into the functional failure and push another fix | 15:08 |
| ykarel | lajoskatona to check fwaas failure and report a launchpad bug | 15:08 |
| lajoskatona | I opened the bug, but after the 1st panic realized that haleyb already had a patch which fixed | 15:09 |
| ykarel | https://review.opendev.org/c/openstack/neutron-fwaas/+/975752 one? | 15:09 |
| lajoskatona | https://bugs.launchpad.net/neutron/+bug/2141942 | 15:09 |
| ykarel | #link https://bugs.launchpad.net/neutron/+bug/2141942 | 15:09 |
| lajoskatona | yes | 15:09 |
| ykarel | ok thx | 15:10 |
| haleyb | i didn't file a bug since i didn't think it was neutron-specific, but the fix(es) might be? | 15:10 |
| ykarel | yes job green this week | 15:10 |
| lajoskatona | exactly, thanks haleyb | 15:10 |
| ykarel | ykarel to check and report bug for ovs job failures | 15:11 |
| ykarel | i haven't concluded it so will continue this week | 15:11 |
| ykarel | #action ykarel to check and report bug for ovs job failures | 15:11 |
| ykarel | ykarel to check issue with fips jobs and report an issue | 15:12 |
| ykarel | pushed https://review.opendev.org/c/openstack/devstack/+/977325 and job green with this, still need to get merged | 15:12 |
| ykarel | #topic Stable branches | 15:12 |
| ykarel | mostly red due to packaging issue and pkg_resources issues | 15:13 |
| ykarel | bcafarel, anything else to add ? | 15:13 |
| bcafarel | no, that is the main one | 15:14 |
| ykarel | ok thanks | 15:14 |
| ykarel | #topic Stadium projects | 15:14 |
| ykarel | dynamic routing tox jobs failing https://zuul.openstack.org/buildset/b4821682f272486bb711fdbf92e802f9 | 15:14 |
| ykarel | with KeyError: 'tenant_id' | 15:14 |
| lajoskatona | yes and bagpipe also | 15:14 |
| lajoskatona | for n-d-r I pushed a patch: https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/977670 , but as I see in my env some other neutron changes are necessary | 15:15 |
| lajoskatona | but let's see if the zuul env will make it better than myself | 15:15 |
| ykarel | #link https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/977670 | 15:15 |
| ykarel | thx lajoskatona | 15:15 |
| ykarel | networking-bagpipe tempest job broken as still running on jammy https://zuul.openstack.org/build/34d966c6931e402880f4db6ccc671139 | 15:16 |
| ykarel | + ./stack.sh:main:235 : echo 'WARNING: this script has not been tested on jammy' since https://review.opendev.org/c/openstack/devstack/+/976893 | 15:16 |
| lajoskatona | yes that was my suprise also | 15:16 |
| lajoskatona | so I pushed a patch for it : | 15:16 |
| ykarel | #link https://review.opendev.org/c/openstack/networking-bagpipe/+/977634 | 15:16 |
| lajoskatona | https://review.opendev.org/c/openstack/networking-bagpipe/+/977634 to change to noble nodeset | 15:16 |
| lajoskatona | yes, thanks | 15:16 |
| ykarel | thx lajoskatona , yeap seems just got missed with previous move to noble | 15:17 |
| lajoskatona | oh, I see I negated the color scheme, tempest is green all other jobs are red :-) | 15:17 |
| ykarel | :D | 15:17 |
| slaweq | LOL | 15:18 |
| ykarel | ok https://review.opendev.org/c/openstack/requirements/+/965873/18/upper-constraints.txt triggered it | 15:18 |
| lajoskatona | but I hope those are not failing due to the nodeset change, but something else, have to doublecheck | 15:19 |
| ykarel | exabgp===5.0.1 | 15:19 |
| lajoskatona | uhhhh | 15:19 |
| ralonsoh | lajoskatona, the n-d-r issue seems to be still in Neutron, in "SubnetPoolReader" class (L268) | 15:19 |
| ralonsoh | https://github.com/openstack/neutron/blob/33f1c11bed4342211fdbe817885d28f911295f1d/neutron/ipam/subnet_alloc.py#L268 | 15:20 |
| ralonsoh | we can talk later | 15:20 |
| lajoskatona | ralonsoh: yes, as I remember that was where it failed locally also | 15:20 |
| ykarel | lajoskatona, will you also take care of this new issue with exabgp update ? | 15:20 |
| lajoskatona | yes, sounds interesting, I will check it | 15:21 |
| ykarel | ok thx | 15:21 |
| ykarel | #action lajoskatona to check new issue with bagpipe with exabgp update | 15:21 |
| ykarel | #topic Rechecks | 15:22 |
| ykarel | we still have rechecks for merges, better then last week | 15:22 |
| ykarel | bare recheck wise all good, 0/19 bare rechecks | 15:22 |
| ykarel | let's check failures now | 15:22 |
| ykarel | #topic Unit tests/pep8 | 15:22 |
| ykarel | random POST_FAILURE seen for jobs running on ubuntu jammy b/w 19th to 21 | 15:23 |
| ykarel | https://zuul.openstack.org/build/a718d37233bf4ba58db466f365b4a4b7 | 15:23 |
| ykarel | https://zuul.openstack.org/build/873d2020acbc4322927cea614917d6d9 | 15:23 |
| ykarel | https://zuul.openstack.org/build/9241d3382e884d84b3e4fb6798c89f17 | 15:23 |
| ykarel | not seen since 21st so not reported it, likely fixed | 15:23 |
| ykarel | #topic fullstack/functional | 15:23 |
| ykarel | test_bgp_extension_missing_bgp_peer_bridges | 15:23 |
| ykarel | https://7b3587430a01ef6cae0a-c12f4aae40769049862f771e2910b4ce.ssl.cf1.rackcdn.com/openstack/fc9053509312463aa863d1c76cddb8c9/testr_results.html | 15:24 |
| ykarel | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_057/openstack/0576c695b9a345dbbc2598b85e949c29/testr_results.html | 15:24 |
| ykarel | new test/feature added last month, 4 failures in last 10 days for this test | 15:24 |
| ykarel | not sure if jakub already aware about it | 15:24 |
| ralonsoh | he is on PTO | 15:24 |
| ykarel | ok | 15:24 |
| ralonsoh | in any case | 15:24 |
| ralonsoh | we can try moving this one to the concurrency 1 section | 15:25 |
| ralonsoh | because we don't have an isolated DB for OVS backend | 15:25 |
| ralonsoh | any other test can be deleting the bridges | 15:25 |
| ykarel | ok let's start with a bug to track it | 15:25 |
| ralonsoh | I'll create it | 15:25 |
| ykarel | thx | 15:25 |
| ykarel | #action ralonsoh to create bug for FT test_bgp_extension_missing_bgp_peer_bridges | 15:26 |
| ykarel | ModuleNotFoundError: No module named 'packaging.pylock' | 15:26 |
| ykarel | all branches including stable impacted, master handled with packaging update in https://review.opendev.org/c/openstack/requirements/+/965873 | 15:26 |
| ykarel | stable still needs to be handled | 15:26 |
| ykarel | we can consider something like https://review.opendev.org/c/openstack/neutron/+/977556 in stable | 15:27 |
| haleyb | was going to mention that one | 15:27 |
| ykarel | also iiuc frickler mentioned it can be some global change in openstack-zuul-jobs to pin | 15:27 |
| haleyb | or even devstack? i don't know | 15:29 |
| ykarel | but from what i see in job logs tox 3.28 is being installed but due to https://github.com/openstack/neutron/blob/stable/2025.2/tox.ini#L3 it get's bumped | 15:29 |
| ykarel | so we only need to pin in stable/2025.2 | 15:30 |
| haleyb | ensure_tox_version: '<4' | 15:30 |
| ykarel | other branches have issue specific to pkg_resources | 15:30 |
| haleyb | that can live in a vars section | 15:30 |
| haleyb | so i guess we can use that | 15:30 |
| ykarel | haleyb, that already set | 15:30 |
| ykarel | issue is with tox.ini in neutron where we set min_version | 15:30 |
| ykarel | so during runtime it updates to latest as we don't limit | 15:30 |
| ykarel | so patch similar to your master one i think is needed in stable/2025.2 | 15:31 |
| haleyb | ykarel: right, but if covering all projects can set that to <4.44.0 in jobs/templates? | 15:31 |
| haleyb | i'm trying to not update every neutron-* and networking-* repo potentially | 15:32 |
| ykarel | haleyb, not sure it will be work, also have to check what all projects impacted, as this specifically due to minversion set in tox.ini | 15:32 |
| ykarel | so if not many projects impacted seems fine to bump just tox.ini | 15:32 |
| ykarel | s/bump/pin | 15:33 |
| ykarel | as per opensearch looks only neutron stable/2025.2 impacted | 15:34 |
| haleyb | i guess we can do it in neutron repos for now | 15:34 |
| ykarel | +1 | 15:34 |
| ralonsoh | +1 | 15:34 |
| haleyb | requires = tox<4.44.0 | 15:34 |
| lajoskatona | +1 | 15:34 |
| ykarel | haleyb, will you push that patch? | 15:35 |
| ykarel | against stable/2025.2 | 15:35 |
| ykarel | stable only change | 15:35 |
| haleyb | ykarel: sure, only for neutron? guess we'll see if we need elsewhere as patches proposed | 15:35 |
| ykarel | yes only for neutron for now | 15:36 |
| tkajinam | instead of modifying tox.ini, you can add ensure_tox_version to job definitions | 15:36 |
| ykarel | as that's what opensearch says | 15:36 |
| tkajinam | following what we did for tox<4 pin | 15:36 |
| tkajinam | https://review.opendev.org/c/openstack/cinder/+/868446 | 15:36 |
| ykarel | tkajinam, ensure tox role already limiting it to tox 3.28.0 | 15:36 |
| tkajinam | this might be a better approach because tox is installed by that ensure-tox role | 15:36 |
| tkajinam | ah, ok | 15:36 |
| tkajinam | hmm though that's wired. the role itself is generic one in zuul and should not pin tox to any version | 15:37 |
| tkajinam | maybe there is something setting it... | 15:37 |
| ykarel | #action haleyb to limit tox version neutron stable 2025.2 | 15:38 |
| haleyb | ykarel: so i still see neutron-functional failures on master, like https://review.opendev.org/c/openstack/neutron/+/977348 or does that just need another recheck? | 15:38 |
| ykarel | we have #action haleyb to limit tox version neutron stable 2025.2 | 15:38 |
| haleyb | i.e. requirements still working through | 15:38 |
| ykarel | haleyb, yes master should be good, but let's confirm with recheck there | 15:39 |
| ykarel | yes it worked fine with current run | 15:39 |
| ykarel | a test failed https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_226/openstack/2263a2e9904e49f4b0eddb973f72916d/testr_results.html | 15:39 |
| ykarel | so we good in master for this | 15:40 |
| ykarel | ^ another bgp related failure | 15:40 |
| ykarel | tkajinam, for functional atleast we have https://opendev.org/openstack/neutron/src/branch/master/playbooks/configure_functional_job.yaml#L5 | 15:41 |
| ykarel | https://opendev.org/openstack/neutron/src/branch/master/playbooks/run_functional_job.yaml#L9 | 15:41 |
| ralonsoh | ykarel, I'll create another LP bug | 15:41 |
| ykarel | thx ralonsoh | 15:41 |
| tkajinam | ok | 15:42 |
| ykarel | #topic Periodic | 15:42 |
| ykarel | stable 2024.2 tox/fullstack/functional FAILURE https://zuul.openstack.org/build/b5d36853c70c43f787c31c1bd7f4fbcc | 15:42 |
| ykarel | being handled as part of https://review.opendev.org/c/openstack/neutron/+/977072 | 15:42 |
| ykarel | thx ralonsoh for handling ^ | 15:42 |
| ykarel | looks pep8 broken there | 15:42 |
| ralonsoh | I still need to check what is happening there | 15:42 |
| ykarel | AttributeError: 'Name' object has no attribute 'value | 15:43 |
| ykarel | ok | 15:43 |
| ykarel | #topic Grafana | 15:44 |
| ykarel | https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 15:44 |
| ykarel | let's have quick look here as well | 15:44 |
| ykarel | looks normal, some spikes but those related to what we already discussed, and some failures for known random issues | 15:46 |
| ykarel | anything to add? | 15:46 |
| ralonsoh | no thanks | 15:47 |
| ykarel | #topic On Demand | 15:47 |
| ykarel | anything else you would like to raise? | 15:47 |
| lajoskatona | nothing from me | 15:48 |
| ralonsoh | no | 15:48 |
| ykarel | thx everyone, in that case let's close 10 minute early :) | 15:49 |
| ykarel | #endmeeting | 15:49 |
| opendevmeet | Meeting ended Mon Feb 23 15:49:52 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:49 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-02-23-15.01.html | 15:49 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-02-23-15.01.txt | 15:49 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-02-23-15.01.log.html | 15:49 |
| ralonsoh | bye | 15:49 |
| slaweq | o/ | 15:50 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron stable/2024.2: Get rid of pkg_resources https://review.opendev.org/c/openstack/neutron/+/977072 | 15:50 |
| lajoskatona | o/ | 15:50 |
| opendevreview | Brian Haley proposed openstack/neutron stable/2025.2: [stable-only]: Pin tox to fix ModuleNotFoundError https://review.opendev.org/c/openstack/neutron/+/977689 | 15:56 |
| opendevreview | Slawek Kaplonski proposed openstack/python-neutronclient master: [FWaaS] Remove client side protocol validation https://review.opendev.org/c/openstack/python-neutronclient/+/977690 | 15:58 |
| opendevreview | Rodolfo Alonso proposed openstack/neutron stable/2024.2: Get rid of pkg_resources https://review.opendev.org/c/openstack/neutron/+/977072 | 16:03 |
| ralonsoh | haleyb, please check ^^ | 16:04 |
| ralonsoh | that should fix the pep8 error, that is solved in the latest flake8-import-order | 16:04 |
| haleyb | ralonsoh: ack, will just wait for zuul +1, and that's the last CI fix we'll need for the year? j/k | 16:08 |
| ralonsoh | I hope so! | 16:10 |
| haleyb | if we get gazpacho out without another i'm buying the first round of beers :) | 16:14 |
| opendevreview | Merged openstack/ovsdbapp master: Add ``columns`` parameters to ``AddressSetAddCommand`` https://review.opendev.org/c/openstack/ovsdbapp/+/977091 | 17:14 |
| opendevreview | Maor Blaustein proposed x/whitebox-neutron-tempest-plugin master: Test traffic capture for HA failover from/to OCP/CRC nodes https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/977320 | 17:35 |
| opendevreview | Elvira García Ruiz proposed openstack/neutron-specs master: Add spec for PVLAN semantics model support https://review.opendev.org/c/openstack/neutron-specs/+/975289 | 19:33 |
| *** Callum0270 is now known as Callum027 | 20:42 | |
| opendevreview | Merged openstack/neutron master: Add description for the ``PeriodicWorker`` instances https://review.opendev.org/c/openstack/neutron/+/977348 | 21:13 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!