15:02:01 <ykarel> #startmeeting neutron_ci
15:02:01 <opendevmeet> Meeting started Mon Nov  3 15:02:01 2025 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:02:01 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:02:01 <opendevmeet> The meeting name has been set to 'neutron_ci'
15:02:06 <ykarel> Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira
15:02:11 <ykarel> Hi all, it's IRC today
15:02:15 <lajoskatona> o/
15:02:15 <ralonsoh> hello
15:02:15 <slaweq> o/
15:04:47 <ykarel> ok let's start with the topics
15:04:59 <ykarel> no action items from previous meeting
15:05:00 <ykarel> #topic Stable branches
15:05:28 <ykarel> Nothing much apart from peridoic failures which will check later, also not much activity on stable
15:05:38 <ykarel> bcafarel, anything else to add?
15:06:41 <mtomaska> o/
15:07:20 <ykarel> ok seems bernard not around, let's move
15:07:59 <ykarel> #topic Stadium projects
15:08:10 <ykarel> Multiple issues this week
15:08:11 <ykarel> dynamic-routing https://zuul.openstack.org/build/2f952e2936aa4981afaa6c43b2ff1bdb
15:08:11 <ykarel> - ImportError: cannot import name 'eventlet_utils' from 'neutron.common' (/opt/stack/neutron/neutron/common/__init__.py)
15:08:11 <ykarel> vpnaas https://zuul.openstack.org/buildset/466a4f1506284baab434f79bba4125bf
15:08:11 <ykarel> - 3 jobs timed out, eventlet specific?
15:08:14 <ykarel> fwaas https://zuul.openstack.org/buildset/f3cf4e3cee43439184a2f544bc5ee1c2
15:08:16 <ykarel> - astroid depends on wrapt<2 and >=1.14. The user requested (constraint) wrapt===2.0.0
15:08:17 <lajoskatona> lots of red things
15:08:40 <lajoskatona> yes wrapt hit other projects also, like ovsdbapp (https://review.opendev.org/c/openstack/ovsdbapp/+/965893 )
15:08:58 <ralonsoh> I'm checking the dynamic-routing thing
15:09:00 <lajoskatona> for vpnaas I am not sure
15:09:08 <lajoskatona> ralonsoh: thanks
15:09:22 <ralonsoh> If we can't migrate it easily to eventlet-free
15:09:26 <ykarel> yes wrapt one triggered by https://github.com/openstack/requirements/commit/6759ad0f43ed1cdd3e30e01c98ba756ac4589559
15:09:34 <lajoskatona> for wrapt: it was bumped last week, yes exactly
15:10:30 <lajoskatona> ralonsoh: I pushed a patch for it and it failed on tempest tests, but can be a good start point
15:10:42 <ralonsoh> I'll check it now
15:10:56 <lajoskatona> https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/956747
15:10:57 <ralonsoh> about fwaas, is this a limitation in this project?
15:11:53 <lajoskatona> you mean the requirements?
15:11:57 <ykarel> Let's have a bug for all these three projects to start with
15:12:04 <ralonsoh> ok
15:12:08 <lajoskatona> +1
15:12:47 <ykarel> ok will create these three tomorrow if no one beats me to it
15:13:19 <ralonsoh> I'll create the dynamic one
15:13:21 <ralonsoh> the first one
15:14:11 <ykarel> ralonsoh, ok thx, rest i can create
15:14:53 <ykarel> #topic Rechecks
15:15:00 <ykarel> we still have some rechecks
15:15:24 <ykarel> bare recheck wise we had 2/45 bare ones, both 2 on a testing patch
15:15:36 <ykarel> so let's keep avoiding bare rechecks
15:15:50 <ykarel> Now let's check the failures
15:15:51 <ykarel> #topic Unit tests/pep8
15:16:02 <ykarel> tox unit test job timing out randomly https://bugs.launchpad.net/neutron/+bug/2130416
15:16:09 <ralonsoh> I'm investigating it
15:16:11 <ykarel> this was originally report for tox-py310
15:16:18 <ralonsoh> I have 4 vagrants running on ubuntu 22
15:16:24 <ykarel> but can also be seen in tox-py311, py313 too
15:16:30 <ralonsoh> I've reduced the scope to neutron.tests.unit.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_ovsdb_monitor
15:16:34 <ralonsoh> I'm checking it now
15:16:46 <ralonsoh> in any case, py310 is the most affected
15:16:58 <ralonsoh> if we can't solve it fast, we should maybe mark as non-voting
15:17:07 <ralonsoh> this is 100% related to the eventlet removal patch
15:17:35 <ralonsoh> give me one day
15:17:55 <ykarel> ralonsoh, thx i assigned that bug to you
15:17:58 <ralonsoh> cool
15:18:32 <ykarel> #topic fullstack/functional
15:18:39 <ykarel> test_find_child_pids
15:18:49 <ykarel> https://0b7e0022f9f9c40dd7e3-ebffe97f8b5c0e4c161da97d302aa202.ssl.cf1.rackcdn.com/openstack/1b893b0010bc43efbf66509efae5307c/testr_results.html
15:18:49 <ykarel> https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9e1/openstack/9e17195872b14df88a5cd7b2673dbaf1/testr_results.html
15:19:10 <ykarel> https://bugs.launchpad.net/neutron/+bug/2130541
15:19:13 <ralonsoh> I'll check it
15:19:17 <ykarel> likely also caused by eventlet one too?
15:19:32 <ralonsoh> 100% sure
15:20:08 <ykarel> ok thx
15:20:16 <ykarel> test__cleanup_previous_tags
15:20:25 <ykarel> also know one     https://launchpad.net/bugs/2130340
15:20:38 <ykarel> also being looked by ralonsoh
15:20:39 <ralonsoh> --> https://review.opendev.org/c/openstack/neutron/+/965783
15:20:43 <ykarel> thx ralonsoh
15:21:03 <ykarel> #topic grenade
15:21:28 <ykarel> not specific to grenade here, but multinode mixed provider issue is seen again
15:21:36 <ykarel> so i am checking in #opendev for it
15:21:47 <ykarel> #topic Periodic
15:21:55 <ykarel> 2024.1 is unmaintained so change to periodic-weekly pipeline
15:22:07 <ykarel> for this, pushed https://review.opendev.org/c/openstack/neutron/+/965931
15:22:36 <ykarel> also stable/2024.1 branch still exists, require a manual cleanup by infra team. so avoid any merge in that branch
15:22:54 <ykarel> 2025.1, 2024.2 and 2024.1 fips centos 9-stream
15:23:08 <ykarel> for this reported https://bugs.launchpad.net/tempest/+bug/2130551 and pushed https://review.opendev.org/c/openstack/tempest/+/965903
15:23:23 <ykarel> and testproject passing so we should be good, will reach out to qa team to merge
15:25:37 <ykarel> #topic Grafana
15:25:42 <ykarel> https://grafana.opendev.org/d/f913631585/neutron-failure-rate
15:26:06 <ykarel> let's have quick look here too
15:27:58 <ykarel> ok looks mostly good, few of these are already known ones
15:28:17 <ykarel> and check failures either known intermittent issues or related to patch
15:28:21 <ykarel> anything to add?
15:29:15 <lajoskatona> not from me
15:29:45 <ykarel> ok let's move to final one then
15:29:52 <ykarel> #topic On Demand
15:29:58 <ykarel> anything else you would like to raise?
15:30:08 <ralonsoh> all good
15:30:43 <lajoskatona> nothing from me
15:34:22 <ykarel> Ok in that case let's close early and have everyone almost 26 minutes back
15:34:27 <ykarel> thx all for joining
15:34:31 <ykarel> #endmeeting