15:01:18 <ykarel> #startmeeting neutron_ci
15:01:18 <opendevmeet> Meeting started Mon Feb 10 15:01:18 2025 UTC and is due to finish in 60 minutes.  The chair is ykarel. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:01:18 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:01:18 <opendevmeet> The meeting name has been set to 'neutron_ci'
15:01:25 <ykarel> Ping list: bcafarel, lajoskatona, slawek, mlavalle, mtomaska, ralonsoh, ykarel, jlibosva, elvira
15:01:25 <mlavalle> \o
15:01:53 <mblue_> o/
15:02:17 <lajoskatona> o/
15:02:17 <bcafarel> o/
15:04:30 <ykarel> ok let's start with topics, i know slawek and rodolfo out today
15:05:00 <ykarel> #topic Actions from previous meetings
15:05:09 <ykarel> lajoskatona to check bgpvpn/bagpipe failures
15:06:57 <lajoskatona> yes it is realted to lb removal
15:07:14 <lajoskatona> https://review.opendev.org/c/openstack/networking-bagpipe/+/940765
15:07:42 <lajoskatona> a wip patch for it, but there's still code related to linuxbridge, so more work is necessary
15:07:56 <bcafarel> minus 4.6k lines, not bad already
15:08:12 <lajoskatona> :-)
15:08:37 <lajoskatona> I had a test patch from bgpvpn side to see tempest, and that is green strangly: https://review.opendev.org/c/openstack/networking-bgpvpn/+/940712
15:09:27 <lajoskatona> so I am working on it, I spend 1-2 more days to see if it can be done without cutting all the code from bagpipe :-)
15:10:32 <lajoskatona> that's it for this topic
15:11:52 <ykarel> ok thx
15:12:22 <ykarel> ralonsoh to check fips functional issue https://review.opendev.org/c/openstack/neutron/+/940128
15:12:34 <ykarel> #info Fixed with https://review.opendev.org/c/openstack/neutron/+/940687
15:12:42 <ykarel> ralonsoh push fix was test_floatin_ip to switch to mysql
15:12:58 <ykarel> #info Done with https://review.opendev.org/c/openstack/neutron/+/940959
15:13:05 <ykarel> ralonsoh to check https://bugs.launchpad.net/neutron/+bug/2097273
15:13:16 <ykarel> #info Fixed with https://review.opendev.org/c/openstack/neutron/+/940679
15:13:27 <ykarel> ykarel to check grenade failure
15:13:44 <ykarel> Checked logs but didn't found what's wrong, Also No new similar failures since then
15:13:52 <ykarel> ykarel to check https://bugs.launchpad.net/neutron/+bug/2097286
15:14:00 <ykarel> pushed https://review.opendev.org/c/x/devstack-plugin-tobiko/+/940694
15:14:15 <ykarel> #info Fixed with https://review.opendev.org/c/x/devstack-plugin-tobiko/+/940694
15:14:23 <ykarel> ykarel to check multinode failures related to nova instance boot
15:14:38 <ykarel> #info reported https://bugs.launchpad.net/nova/+bug/2097586 and https://bugs.launchpad.net/tempest/+bug/2097594
15:14:56 <ykarel> for tempest issue also proposed https://review.opendev.org/c/openstack/tempest/+/941077
15:16:52 <ykarel> #topic Stable branches
15:16:59 <ykarel> bcafarel, any update on this
15:17:17 <ykarel> from periodic run i see all good
15:17:19 <bcafarel> overall good from what I checked
15:17:34 <bcafarel> and unmaintained/zed in https://bugs.launchpad.net/neutron/+bug/2097286/ fixed, thanks :)
15:18:32 <ykarel> k thx for the updates
15:18:33 <ykarel> #topic Stadium projects
15:18:41 <ykarel> dynamic-routing, bgpvpn, bagpipe, tap-as-a-service failing
15:19:02 <lajoskatona> yes taas test passed but the job timeouted
15:19:21 <ykarel> bgpvpn, bagpipe one discussed above
15:19:25 <lajoskatona> interestingly I saw some devstack tool failures for statistics collection not just for taas
15:19:32 <ykarel> yes taas one seems slow node
15:19:34 <lajoskatona> yes, for n-d-r
15:19:43 <lajoskatona> https://paste.opendev.org/show/bdzJd9wtOe58YXqB4IZD/
15:20:29 <lajoskatona> the tempest test (at leastone I checked) failed ate remove router interface, and in the log I saved to this paste
15:20:52 <lajoskatona> Feb 08 09:12:38.300270 np0039799398 devstack@neutron-api.service[65850]: CRITICAL neutron [None req-03c6c81e-5c62-468f-8441-3fba2c5605d4 tempest-BgpSpeakerIpv4Test-2016291524 tempest-BgpSpeakerIpv4Test-2016291524-project-admin] Unhandled error: OSError: write error
15:20:52 <lajoskatona> Feb 08 09:12:38.300270 np0039799398 devstack@neutron-api.service[65850]: ERROR neutron OSError: write error
15:21:07 <ykarel> yes n-d-r hitting https://bugs.launchpad.net/neutron/+bug/2085421
15:21:29 <lajoskatona> ahh, ok so this one is still that bug
15:22:18 <lajoskatona> that's it for stadiums
15:22:37 <ykarel> ok thx for the updates, let's move
15:22:39 <ykarel> #topic Rechecks
15:23:07 <ykarel> we still have rechecks with known random issues, and some already fixed ones
15:23:26 <ykarel> bare recheck wise we had 5/47 , not that bad
15:23:41 <ykarel> let's check failures now
15:23:42 <ykarel> #topic fullstack/functional
15:23:45 <ykarel> test_dvr_ha_router_interface_mtu_update
15:23:50 <ykarel> https://a5e117db2bc627810aca-bfdf0aa5980ea9561e0ca2e62d8db60b.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/neutron/stable/2024.2/neutron-functional/0e99e9e/testr_results.html
15:24:02 <ykarel> For this pushed backports https://review.opendev.org/q/I5c6f7648d69e3a939445273f8d94241818538fc9
15:24:05 <ykarel> please check
15:24:18 <ykarel> #topic Periodic
15:24:32 <ykarel> dvr grenade broken https://zuul.openstack.org/builds?job_name=neutron-ovs-grenade-dvr-multinode&project=openstack%2Fneutron&branch=master&skip=0
15:24:44 <ykarel> For this pushed https://review.opendev.org/c/openstack/neutron/+/941092
15:25:12 <ykarel> job passed https://zuul.opendev.org/t/openstack/build/4e03c0bd4db94d67ae1451c3f7706e6f
15:25:16 <ykarel> so please check that too
15:25:36 <ykarel> #topic Grafana
15:25:43 <ykarel> https://grafana.opendev.org/d/f913631585/neutron-failure-rate
15:25:48 <ykarel> let's also have quick look here
15:26:49 <ykarel> some spike in functional gate, that already fixed
15:27:32 <ykarel> some spike in check too in ovn job, that also fixed related to metadata failure
15:27:47 <ykarel> apart from that looks fine
15:27:50 <ykarel> anything to add?
15:28:01 <mlavalle> not from me
15:28:05 <lajoskatona> nothing from me
15:28:35 <ykarel> k thx, let's move
15:28:41 <ykarel> #topic On Demand
15:28:52 <ykarel> i have a small one
15:28:53 <ykarel> Moving unmaintained/2023.1 jobs to periodic-weekly https://review.opendev.org/c/openstack/neutron/+/941101
15:29:01 <ykarel> anything else you would like to raise?
15:29:28 <lajoskatona> good idea, I already +2d it
15:29:50 <mlavalle> I'll review it today
15:29:57 <mlavalle> in my pile
15:31:21 <ykarel> if nothing else, let's close and have everyone 29 minutes back
15:31:25 <ykarel> thx everyone for joining
15:31:29 <ykarel> #endmeeting