| opendevreview | Dong Ma proposed openstack/neutron master: [OVN] Scope DB sync logging to port groups https://review.opendev.org/c/openstack/neutron/+/1007085 | 04:09 |
|---|---|---|
| opendevreview | yatin proposed openstack/neutron master: [DNM] Check FT timeout issue https://review.opendev.org/c/openstack/neutron/+/1007403 | 05:07 |
| ralonsoh | ykarel, I think the FT patch is working nice. I've rechecked it again. I think you can remove the node==raxflex part and propose it, keeping the open files monitoring (that doesn't hurt and is already implemented for future debugging processes) | 06:17 |
| ykarel | ralonsoh, jobs were in progress https://zuul.opendev.org/t/openstack/status?change=1007403 | 06:17 |
| ykarel | but yes it's working | 06:18 |
| ykarel | i was trying to understand why notify/stop not working, but yes that can be follow up | 06:18 |
| ykarel | ralonsoh, main thing that helps in stuck issue is:- ovs.poller.SelectPoll = select.poll | 06:20 |
| ykarel | once current run finishes will clean the patch and get it ready to unblock this issue, and rest fixes can follow up | 06:21 |
| ralonsoh | nice | 06:25 |
| rm_work | sean-k-mooney: my agent just flagged https://review.opendev.org/c/openstack/futurist/+/996569 and https://review.opendev.org/c/openstack/futurist/+/996570 for me as likely solves for the thread growth I am seeing, but looks like you haven't revisited them in a while and they're a bit out of date... do you think these are still something you're going to drive? i'm going to test them in a bit to see if they solve my issue, just curious, | 07:19 |
| rm_work | maybe I can rebase / fixup those if you aren't, though it looks a bit complex as they're in quite a large chain | 07:19 |
| rm_work | sorry I realize it may not be obvious why I chose this channel, but it makes sense in my head, as they're an issue for me specifically in my neutron-rpc-server process (but only with a custom RPC driver so likely no one else is running into it here) | 07:21 |
| opendevreview | yatin proposed openstack/neutron master: Fix OVN functional job hang from OVSDB IDL connection fd leaks https://review.opendev.org/c/openstack/neutron/+/1007403 | 07:49 |
| ykarel | ralonsoh, updated ^ | 07:50 |
| ralonsoh | ykarel, nice! | 07:51 |
| ralonsoh | ykarel, I'm reporting in LP `neutron.tests.functional.services.bgp.test_reconciler.TestBGPReconciler.test_full_sync` | 07:54 |
| ralonsoh | I've seen it 4 times in the last days | 07:55 |
| ykarel | ralonsoh, thx, yes i too noticed that during my ci check for the meeting | 07:58 |
| opendevreview | Merged openstack/neutron master: Update jobs according to tested runtimes for 2027.1 https://review.opendev.org/c/openstack/neutron/+/1007286 | 08:17 |
| ykarel | ralonsoh, i see that duplicate of https://bugs.launchpad.net/neutron/+bug/2168215 | 08:23 |
| ralonsoh | ykarel, thanks! | 08:31 |
| slaweq | hi lajoskatona ykarel: please check https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/995695/ when you will have a minute or two, thx in advance | 08:33 |
| opendevreview | Takashi Kajinami proposed openstack/neutron master: Remove unused job https://review.opendev.org/c/openstack/neutron/+/1007667 | 08:34 |
| kevko | Good morning folks. | 09:00 |
| ykarel | slaweq, done | 09:03 |
| slaweq | thx ykarel | 09:03 |
| kevko | I found a bugs in neutron while I was testing new deployment on 2026.1. I went ahead and added you slaweq and ralonsoh as reviewers. If you will have a time ..it's those two ... https://review.opendev.org/c/openstack/neutron/+/1007637 and https://review.opendev.org/c/openstack/neutron/+/1007638 ... Thank you | 09:03 |
| slaweq | sure kevko, looking | 09:06 |
| ralonsoh | kevko, let me check | 09:07 |
| tkajinam | ykarel, hi could you also review https://review.opendev.org/c/openstack/neutron-lib/+/1007331 to unblock https://review.opendev.org/c/openstack/neutron-lib/+/1007288 (ci update) | 09:10 |
| opendevreview | Thomas Bechtold proposed openstack/neutron-vpnaas stable/2026.1: Update libreswan driver compatibility https://review.opendev.org/c/openstack/neutron-vpnaas/+/1007675 | 09:10 |
| tkajinam | there are number of problems appearing in py315 job due to no py315 pre-built wheel binaries available in pypi ... | 09:10 |
| ykarel | tkajinam, ack | 09:12 |
| lajoskatona | tkajinam, ykarel: done, and thanks for checking. | 09:12 |
| tkajinam | oh lajoskatona already voted +A to it. | 09:12 |
| tkajinam | lajoskatona ykarel, thanks, both | 09:12 |
| ykarel | thx tkajinam lajoskatona | 09:16 |
| tkajinam | lajoskatona, by the way, I had a chat with Rabi recently about sdk migration in heat and he told me that some of his team members will check/test migration patches from neutronclient and sdk (I think you already saw their comments). | 09:16 |
| tkajinam | lajoskatona, I'll check their status in upcoming PTG but I'm hoping that that would ease the primary concern about test coverage. (to catch slightly different interfaces between neutronclient and sdk) | 09:16 |
| tkajinam | sorry for leaving these for so long | 09:16 |
| kevko | slaweq, ralonsoh it's kind easy fix ... Btw ..it's also working in reality ..I mean ..packets are normally going through | 09:23 |
| kevko | But in neutron it's inconsistencies ...I think the code is old and don't reflect situation where multiple paths are set on router ... | 09:24 |
| opendevreview | Merged openstack/neutron master: bgp: Wait in functional test for chassis https://review.opendev.org/c/openstack/neutron/+/1006971 | 09:27 |
| opendevreview | aarefiev proposed openstack/neutron master: Do not re-ACTIVE ports on DHCP ready without provisioning blocks https://review.opendev.org/c/openstack/neutron/+/1007683 | 10:12 |
| opendevreview | Merged openstack/neutron-tempest-plugin master: [FWaaS] Add basic scenario test for FW attached to L2 ports https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/995695 | 10:32 |
| opendevreview | yatin proposed openstack/neutron stable/2026.2: [CI][2026.2 only] Drop devstack fips CentOS 9-stream jobs https://review.opendev.org/c/openstack/neutron/+/1007696 | 11:06 |
| opendevreview | yatin proposed openstack/neutron stable/2026.2: [CI][2026.2 only] Drop devstack fips CentOS jobs https://review.opendev.org/c/openstack/neutron/+/1007696 | 11:16 |
| ralonsoh | folks, if you have a few mins, check Yatin's patch: https://review.opendev.org/c/openstack/neutron/+/1007403 | 11:19 |
| ralonsoh | that fixes the instability of the FT CI job | 11:20 |
| opendevreview | Merged openstack/neutron-lib master: Install packages to build wheel of lxml https://review.opendev.org/c/openstack/neutron-lib/+/1007331 | 11:22 |
| ralonsoh | bcafarel, hi! If you have 1 min: https://review.opendev.org/q/topic:%22bug/2166602%22 | 11:23 |
| ralonsoh | thanks! | 11:23 |
| ralonsoh | and https://review.opendev.org/q/topic:%22bug/2166654%22, if possible | 11:24 |
| opendevreview | yatin proposed openstack/neutron stable/2026.2: evpn: Use branch-26.03 OVN branch for the experimental job https://review.opendev.org/c/openstack/neutron/+/1007703 | 11:57 |
| opendevreview | Eduardo Olivares proposed x/whitebox-neutron-tempest-plugin master: Whitebox test which will allow inspecting state of chassis https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/1000366 | 12:39 |
| opendevreview | Eduardo Olivares proposed x/whitebox-neutron-tempest-plugin master: WIP - new test_evpn_vrrp_vip_failover test https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/1006753 | 12:39 |
| *** haleyb|out is now known as haleyb | 13:30 | |
| ykarel | #startmeeting neutron_ci | 14:02 |
| opendevmeet | Meeting started Mon Sep 28 14:02:00 2026 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:02 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:02 |
| opendevmeet | The meeting name has been set to 'neutron_ci' | 14:02 |
| ykarel | Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira | 14:02 |
| ykarel | This will be video meeting today: https://meetpad.opendev.org/neutron-ci-meetings | 14:02 |
| lajoskatona | o/ | 14:02 |
| ralonsoh | hello | 14:02 |
| ralonsoh | I hear nothing | 14:05 |
| ykarel | #topic Stable branches | 14:06 |
| ykarel | all good except periodic and known FT failures, couple of stable patches awaiting reviews | 14:06 |
| ykarel | bcafarel, anything to add here? | 14:07 |
| ykarel | #topic Stadium projects | 14:07 |
| bcafarel | in another meeting sorry - no extra comments on stable branches | 14:07 |
| ykarel | thx | 14:07 |
| ykarel | all good except vpnaas https://zuul.openstack.org/build/f43ed681efef46c98c47f947bd161feb | 14:07 |
| ykarel | vpnaas rally known one still in progress https://review.opendev.org/c/openstack/neutron-vpnaas/+/1000417 | 14:08 |
| ykarel | #topic Rechecks | 14:09 |
| ykarel | bare recheck 2/29 | 14:09 |
| ykarel | #topic Unit tests/pep8 | 14:09 |
| ykarel | check py314 | 14:09 |
| ykarel | - this is voting now in 2027.1 | 14:10 |
| ykarel | #topic fullstack/functional | 14:10 |
| ykarel | neutron.tests.functional.services.bgp.test_reconciler.TestBGPReconciler.test_full_sync | 14:10 |
| ykarel | - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_23a/openstack/23a67bafabb547929087503db7b2f6ed/testr_results.html | 14:10 |
| ykarel | - Being fixed as part of https://bugs.launchpad.net/neutron/+bug/2168215 | 14:10 |
| ralonsoh | sorry, I need to leave for 2 mins | 14:10 |
| ykarel | - functional job timeouts | 14:11 |
| ykarel | - Being fixed with https://review.opendev.org/c/openstack/neutron/+/1007403 | 14:11 |
| lajoskatona | Final rc patch: https://review.opendev.org/c/openstack/releases/+/1007691 | 14:11 |
| haleyb | https://bugs.launchpad.net/neutron/+bug/2167620 | 14:12 |
| ykarel | thx haleyb | 14:14 |
| ykarel | - functional job random failure with ValueError: Length too long | 14:14 |
| ykarel | - 6 failures since 22nd, 5 in periodic and once in check | 14:14 |
| ykarel | File "/home/zuul/src/opendev.org/openstack/neutron/.tox/dsvm-functional-gate/lib/python3.12/site-packages/ovs/db/idl.py", line 430, in run -> assert not self.txn | 14:15 |
| ykarel | - https://91d67542d057a70339a7-afdd1b8d1365a659d6bca493609e84c0.ssl.cf2.rackcdn.com/openstack/5a89755386d048fca4ed942fa2d47c07/job-output.txt | 14:15 |
| ykarel | - Seems triggered with https://review.opendev.org/c/openstack/neutron/+/1005805 | 14:15 |
| ykarel | #action ykarel to open bug for this and check with Terry | 14:15 |
| ykarel | #topic Tempest/Scenario | 14:16 |
| ykarel | - Random failure test_default_sec_grp_scenarios | 14:16 |
| ykarel | - https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_094/openstack/094b13bd62fd481abacca3457e2287bc/testr_results.html | 14:16 |
| ykarel | - Being tracked in https://bugs.launchpad.net/neutron/+bug/2167351 | 14:16 |
| ykarel | https://review.opendev.org/c/openstack/releases/+/1005721 | 14:17 |
| ykarel | to request os-vif release once ^ merges | 14:18 |
| ykarel | #topic Periodic | 14:18 |
| ykarel | - https://zuul.openstack.org/builds?job_name=neutron-ovn-tempest-ovs-release-fips&job_name=neutron-ovs-tempest-fips&project=openstack%2Fneutron&branch=stable%2F2026.2&skip= | 14:18 |
| ykarel | - Jobs being removed with https://review.opendev.org/c/openstack/neutron/+/1007696 | 14:18 |
| ykarel | please review this | 14:18 |
| ykarel | - https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovn-evpn-tempest-multinode&project=openstack%2Fneutron&branch=stable%2F2026.2&skip=0 | 14:18 |
| ykarel | - Proposed cherry pick https://review.opendev.org/c/openstack/neutron/+/1007703 | 14:18 |
| ykarel | review this as well | 14:19 |
| ykarel | #topic Grafana | 14:19 |
| ykarel | https://grafana.opendev.org/d/f913631585/neutron-failure-rate | 14:19 |
| ykarel | all good | 14:20 |
| ykarel | #topic On Demand | 14:20 |
| ykarel | #endmeeting | 14:21 |
| opendevmeet | Meeting ended Mon Sep 28 14:21:27 2026 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:21 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-09-28-14.02.html | 14:21 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-09-28-14.02.txt | 14:21 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/neutron_ci/2026/neutron_ci.2026-09-28-14.02.log.html | 14:21 |
| tkajinam | it seems functional tests are affected by unexpected downgrade of packaging (in case you see failures caused by missing packaging.pylock ) which I'm fixing by https://review.opendev.org/c/openstack/requirements/+/1007736 | 14:50 |
| haleyb | tkajinam: thanks for fixing that, had noticed in a few changes, will not recheck until that merges | 14:51 |
| opendevreview | Miro Tomaska proposed openstack/neutron master: svd: Make privileged SVD operations idempotent https://review.opendev.org/c/openstack/neutron/+/1005817 | 15:11 |
| opendevreview | Miro Tomaska proposed openstack/neutron master: Minor refactor of the EVPN FSM https://review.opendev.org/c/openstack/neutron/+/1006114 | 15:26 |
| opendevreview | Miro Tomaska proposed openstack/neutron master: Add Executor for EVPN provisioning https://review.opendev.org/c/openstack/neutron/+/1006431 | 15:28 |
| opendevreview | Merged x/whitebox-neutron-tempest-plugin master: Adjust security group logging tests for possible ping delay https://review.opendev.org/c/x/whitebox-neutron-tempest-plugin/+/1004787 | 15:36 |
| opendevreview | Merged openstack/neutron stable/2026.1: ovn: Add ip_substring_filtering API extension support https://review.opendev.org/c/openstack/neutron/+/1006549 | 15:39 |
| opendevreview | aarefiev proposed openstack/neutron master: Do not re-ACTIVE ports on DHCP ready without provisioning blocks https://review.opendev.org/c/openstack/neutron/+/1007683 | 15:57 |
| opendevreview | Juan Larriba proposed openstack/neutron master: Add OpenTelemetry tracing middleware for Neutron https://review.opendev.org/c/openstack/neutron/+/1007753 | 16:08 |
| opendevreview | Merged openstack/neutron stable/2025.1: ovn: Add ip_substring_filtering API extension support https://review.opendev.org/c/openstack/neutron/+/1006670 | 16:16 |
| opendevreview | Merged openstack/neutron stable/2026.1: qos: Handle missing port binding in resource request https://review.opendev.org/c/openstack/neutron/+/1005519 | 16:16 |
| opendevreview | Merged openstack/neutron master: Imported Translations from Zanata https://review.opendev.org/c/openstack/neutron/+/1007577 | 16:46 |
| opendevreview | Merged openstack/neutron stable/2025.1: qos: Handle missing port binding in resource request https://review.opendev.org/c/openstack/neutron/+/1005521 | 18:10 |
| opendevreview | Merged openstack/neutron stable/2026.2: [CI][2026.2 only] Drop devstack fips CentOS jobs https://review.opendev.org/c/openstack/neutron/+/1007696 | 18:37 |
| -opendevstatus- NOTICE: Zuul is reporting inconsistent results showing failures in Gerrit comments and in progress status in the Zuul UI. This is due to Zuul database issues that we are working to correct. | 19:03 | |
| opendevreview | Miro Tomaska proposed openstack/neutron master: Add Executor for EVPN provisioning https://review.opendev.org/c/openstack/neutron/+/1006431 | 20:15 |
| opendevreview | Henry Barreto proposed openstack/ovsdbapp master: Add tier support to OVN ACL operations https://review.opendev.org/c/openstack/ovsdbapp/+/1004434 | 21:40 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!