15:02:01 <ykarel> #startmeeting neutron_ci 15:02:01 <opendevmeet> Meeting started Mon Nov 3 15:02:01 2025 UTC and is due to finish in 60 minutes. The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:01 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:01 <opendevmeet> The meeting name has been set to 'neutron_ci' 15:02:06 <ykarel> Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira 15:02:11 <ykarel> Hi all, it's IRC today 15:02:15 <lajoskatona> o/ 15:02:15 <ralonsoh> hello 15:02:15 <slaweq> o/ 15:04:47 <ykarel> ok let's start with the topics 15:04:59 <ykarel> no action items from previous meeting 15:05:00 <ykarel> #topic Stable branches 15:05:28 <ykarel> Nothing much apart from peridoic failures which will check later, also not much activity on stable 15:05:38 <ykarel> bcafarel, anything else to add? 15:06:41 <mtomaska> o/ 15:07:20 <ykarel> ok seems bernard not around, let's move 15:07:59 <ykarel> #topic Stadium projects 15:08:10 <ykarel> Multiple issues this week 15:08:11 <ykarel> dynamic-routing https://zuul.openstack.org/build/2f952e2936aa4981afaa6c43b2ff1bdb 15:08:11 <ykarel> - ImportError: cannot import name 'eventlet_utils' from 'neutron.common' (/opt/stack/neutron/neutron/common/__init__.py) 15:08:11 <ykarel> vpnaas https://zuul.openstack.org/buildset/466a4f1506284baab434f79bba4125bf 15:08:11 <ykarel> - 3 jobs timed out, eventlet specific? 15:08:14 <ykarel> fwaas https://zuul.openstack.org/buildset/f3cf4e3cee43439184a2f544bc5ee1c2 15:08:16 <ykarel> - astroid depends on wrapt<2 and >=1.14. The user requested (constraint) wrapt===2.0.0 15:08:17 <lajoskatona> lots of red things 15:08:40 <lajoskatona> yes wrapt hit other projects also, like ovsdbapp (https://review.opendev.org/c/openstack/ovsdbapp/+/965893 ) 15:08:58 <ralonsoh> I'm checking the dynamic-routing thing 15:09:00 <lajoskatona> for vpnaas I am not sure 15:09:08 <lajoskatona> ralonsoh: thanks 15:09:22 <ralonsoh> If we can't migrate it easily to eventlet-free 15:09:26 <ykarel> yes wrapt one triggered by https://github.com/openstack/requirements/commit/6759ad0f43ed1cdd3e30e01c98ba756ac4589559 15:09:34 <lajoskatona> for wrapt: it was bumped last week, yes exactly 15:10:30 <lajoskatona> ralonsoh: I pushed a patch for it and it failed on tempest tests, but can be a good start point 15:10:42 <ralonsoh> I'll check it now 15:10:56 <lajoskatona> https://review.opendev.org/c/openstack/neutron-dynamic-routing/+/956747 15:10:57 <ralonsoh> about fwaas, is this a limitation in this project? 15:11:53 <lajoskatona> you mean the requirements? 15:11:57 <ykarel> Let's have a bug for all these three projects to start with 15:12:04 <ralonsoh> ok 15:12:08 <lajoskatona> +1 15:12:47 <ykarel> ok will create these three tomorrow if no one beats me to it 15:13:19 <ralonsoh> I'll create the dynamic one 15:13:21 <ralonsoh> the first one 15:14:11 <ykarel> ralonsoh, ok thx, rest i can create 15:14:53 <ykarel> #topic Rechecks 15:15:00 <ykarel> we still have some rechecks 15:15:24 <ykarel> bare recheck wise we had 2/45 bare ones, both 2 on a testing patch 15:15:36 <ykarel> so let's keep avoiding bare rechecks 15:15:50 <ykarel> Now let's check the failures 15:15:51 <ykarel> #topic Unit tests/pep8 15:16:02 <ykarel> tox unit test job timing out randomly https://bugs.launchpad.net/neutron/+bug/2130416 15:16:09 <ralonsoh> I'm investigating it 15:16:11 <ykarel> this was originally report for tox-py310 15:16:18 <ralonsoh> I have 4 vagrants running on ubuntu 22 15:16:24 <ykarel> but can also be seen in tox-py311, py313 too 15:16:30 <ralonsoh> I've reduced the scope to neutron.tests.unit.plugins.ml2.drivers.ovn.mech_driver.ovsdb.test_ovsdb_monitor 15:16:34 <ralonsoh> I'm checking it now 15:16:46 <ralonsoh> in any case, py310 is the most affected 15:16:58 <ralonsoh> if we can't solve it fast, we should maybe mark as non-voting 15:17:07 <ralonsoh> this is 100% related to the eventlet removal patch 15:17:35 <ralonsoh> give me one day 15:17:55 <ykarel> ralonsoh, thx i assigned that bug to you 15:17:58 <ralonsoh> cool 15:18:32 <ykarel> #topic fullstack/functional 15:18:39 <ykarel> test_find_child_pids 15:18:49 <ykarel> https://0b7e0022f9f9c40dd7e3-ebffe97f8b5c0e4c161da97d302aa202.ssl.cf1.rackcdn.com/openstack/1b893b0010bc43efbf66509efae5307c/testr_results.html 15:18:49 <ykarel> https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9e1/openstack/9e17195872b14df88a5cd7b2673dbaf1/testr_results.html 15:19:10 <ykarel> https://bugs.launchpad.net/neutron/+bug/2130541 15:19:13 <ralonsoh> I'll check it 15:19:17 <ykarel> likely also caused by eventlet one too? 15:19:32 <ralonsoh> 100% sure 15:20:08 <ykarel> ok thx 15:20:16 <ykarel> test__cleanup_previous_tags 15:20:25 <ykarel> also know one https://launchpad.net/bugs/2130340 15:20:38 <ykarel> also being looked by ralonsoh 15:20:39 <ralonsoh> --> https://review.opendev.org/c/openstack/neutron/+/965783 15:20:43 <ykarel> thx ralonsoh 15:21:03 <ykarel> #topic grenade 15:21:28 <ykarel> not specific to grenade here, but multinode mixed provider issue is seen again 15:21:36 <ykarel> so i am checking in #opendev for it 15:21:47 <ykarel> #topic Periodic 15:21:55 <ykarel> 2024.1 is unmaintained so change to periodic-weekly pipeline 15:22:07 <ykarel> for this, pushed https://review.opendev.org/c/openstack/neutron/+/965931 15:22:36 <ykarel> also stable/2024.1 branch still exists, require a manual cleanup by infra team. so avoid any merge in that branch 15:22:54 <ykarel> 2025.1, 2024.2 and 2024.1 fips centos 9-stream 15:23:08 <ykarel> for this reported https://bugs.launchpad.net/tempest/+bug/2130551 and pushed https://review.opendev.org/c/openstack/tempest/+/965903 15:23:23 <ykarel> and testproject passing so we should be good, will reach out to qa team to merge 15:25:37 <ykarel> #topic Grafana 15:25:42 <ykarel> https://grafana.opendev.org/d/f913631585/neutron-failure-rate 15:26:06 <ykarel> let's have quick look here too 15:27:58 <ykarel> ok looks mostly good, few of these are already known ones 15:28:17 <ykarel> and check failures either known intermittent issues or related to patch 15:28:21 <ykarel> anything to add? 15:29:15 <lajoskatona> not from me 15:29:45 <ykarel> ok let's move to final one then 15:29:52 <ykarel> #topic On Demand 15:29:58 <ykarel> anything else you would like to raise? 15:30:08 <ralonsoh> all good 15:30:43 <lajoskatona> nothing from me 15:34:22 <ykarel> Ok in that case let's close early and have everyone almost 26 minutes back 15:34:27 <ykarel> thx all for joining 15:34:31 <ykarel> #endmeeting