15:00:05 <slaweq> #startmeeting neutron_ci
15:00:05 <opendevmeet> Meeting started Tue Sep 14 15:00:05 2021 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:05 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:00:05 <opendevmeet> The meeting name has been set to 'neutron_ci'
15:00:12 <slaweq> hi
15:00:17 <obondarev> hi
15:00:45 <lajoskatona> Hi
15:00:47 <slaweq> I think that attendance will not be high today as bcafarel and ralonsoh are off
15:00:53 <slaweq> so we can start probably
15:01:18 <slaweq> Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate
15:01:28 <slaweq> #topic Actions from previous meetings
15:01:34 <slaweq> slaweq to check if tests can be marked as they can't run in parallel
15:02:01 <slaweq> I was checking it but it seems that we will need some changes in tempest to run some "advanced" tests in serial
15:02:07 <slaweq> and others in parallel
15:02:25 <slaweq> but now gmann proposed https://review.opendev.org/c/openstack/tempest/+/807790 which should helps us with this
15:02:34 <slaweq> I will follow up on it with him
15:02:47 <slaweq> but this week I didn't saw any oom-killers in our jobs
15:03:26 <slaweq> ok, next one
15:03:29 <slaweq> slaweq to start eol'ing vpnaas stein and older branches
15:03:36 <slaweq> I sent email last week http://lists.openstack.org/pipermail/openstack-discuss/2021-September/024779.html
15:03:45 <slaweq> I didn't saw any replies so far
15:03:57 <slaweq> so at the end of this week we should be good to move on with this
15:04:07 <slaweq> lajoskatona: do You want to continue that process as new PTL?
15:04:12 <slaweq> or do You want me to do it?
15:04:14 <lajoskatona> sure
15:04:27 <lajoskatona> I have to propose patch to releases?
15:04:45 <lajoskatona> and no need for more mails about, am I right?
15:04:59 <slaweq> guide is at https://docs.openstack.org/project-team-guide/stable-branches.html
15:05:12 <lajoskatona> ack
15:05:21 <slaweq> now we need to remove any related zuul jobs from other repos (if there are any)
15:05:55 <slaweq> and propose patch similar to https://review.opendev.org/#/c/677478/ to create eol tag
15:06:18 <slaweq> finally we need to contact elodilles to delete old branches
15:06:32 <slaweq> if You will have any questions elodilles is the best guy to ask I think :)
15:06:53 <lajoskatona> slaweq: ok
15:06:58 <slaweq> ++
15:07:00 <slaweq> thx
15:08:13 <slaweq> ok, next one
15:08:19 <slaweq> ralonsoh to open bug about failing neutron-ovn-tempest-ovs-master-fedora periodic job
15:08:24 <slaweq> I know he checked it
15:08:28 <slaweq> and found 2 errors
15:08:33 <slaweq> First one, related to OVN metadata port. Patch: https://review.opendev.org/c/openstack/tempest/+/808081, testing patch: https://review.opendev.org/c/openstack/neutron/+/808110
15:08:38 <slaweq> Second one, related to tempest.scenario.test_server_basic_ops.TestServerBasicOps, still under investigation
15:08:47 <slaweq> that's update from ralonsoh :)
15:09:56 <slaweq> and that are all actions from last week
15:09:59 <slaweq> #topic Stadium projects
15:10:06 <slaweq> any updates about stadium ci today?
15:10:36 <lajoskatona> nothing interesting
15:10:50 <slaweq> that's good news :)
15:10:52 <lajoskatona> things are green as I checked last time
15:10:52 <slaweq> thx
15:11:17 <slaweq> so next topic
15:11:19 <slaweq> #topic Stable branches
15:11:28 <slaweq> bcafarel is not available today
15:11:49 <slaweq> but maybe You have something related to the stable branches' ci?
15:12:03 <slaweq> I don't think we have any major issues there but maybe I missed something
15:12:27 <lajoskatona> nothing from me
15:13:44 <slaweq> so let's move on
15:13:49 <slaweq> #topic Grafana
15:13:56 <slaweq> http://grafana.openstack.org/dashboard/db/neutron-failure-rate
15:14:28 <slaweq> seems that things are pretty ok recently
15:14:57 <slaweq> even functional/fullstack jobs looks better now :)
15:16:03 <slaweq> I think we can move on to the next topic
15:16:09 <slaweq> #topic fullstack/functional
15:16:19 <slaweq> here I have just one update from ralonsoh about fullstack
15:16:24 <slaweq> https://bugs.launchpad.net/neutron/+bug/1942190: I've tried to push https://review.opendev.org/c/openstack/neutron/+/807134 and other tests like https://review.opendev.org/c/openstack/neutron/+/808026 (to reduce the memory footprint), but I can't fix this problem. privsep daemons are still, sometimes, not being correctly spawn in the DHCP agent.
15:17:17 <slaweq> but I think we can get back to that when ralonsoh will be back
15:18:24 <slaweq> I didn't found any other new issues in those jobs last week
15:18:27 <slaweq> #topic Tempest/Scenario
15:18:40 <slaweq> here I found one, maybe interesting for us issue:
15:18:44 <slaweq> tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_migration_with_trunk
15:18:49 <slaweq> https://6f050c0b73606a153f16-9f552c22a38891cd59267376a7a41496.ssl.cf1.rackcdn.com/805849/9/check/neutron-ovs-tempest-multinode-full/de0bc9a/testr_results.html
15:18:56 <slaweq> did You saw something similar before?
15:19:07 <slaweq> maybe You are already aware of the problem?
15:19:55 <lajoskatona> perhaps there was a bug from gibi, but not sure
15:20:15 <gibi> yeah I reported that
15:20:40 <slaweq> gibi: do You have link?
15:20:45 <gibi> trying to find...
15:20:45 <lajoskatona> https://bugs.launchpad.net/neutron/+bug/1940425
15:20:55 <slaweq> thx lajoskatona and gibi
15:21:00 <lajoskatona> but fix for this was merged I think
15:21:27 <lajoskatona> at least somebody started to work on it, but prehasp I mess it up
15:21:44 <slaweq> so it's already reported
15:21:48 <gibi> slaweq: https://bugs.launchpad.net/neutron/+bug/1940425
15:22:00 <slaweq> and indeed it's not very frequent but we will need to check that
15:22:27 <gibi> aand this seems related https://bugs.launchpad.net/neutron/+bug/1874447
15:22:44 <gibi> lajoskatona: there was a fix, but it did not solve the issue fully
15:22:54 <lajoskatona> gibi: ok
15:23:08 <gibi> lajoskatona: this was the older bug that got a fix https://bugs.launchpad.net/tempest/+bug/1924258
15:23:14 <slaweq> gibi: second one is/was for ovn backend
15:23:20 <slaweq> so I don't think it's the same issue
15:23:32 <gibi> slaweq: yeah, sorry
15:23:37 <slaweq> no problem :)
15:24:05 <opendevreview> Terry Wilson proposed openstack/networking-ovn stable/train: Fix neutron_pg_drop-related startup issues  https://review.opendev.org/c/openstack/networking-ovn/+/808967
15:24:57 <slaweq> we will need someone to check that issue probably
15:25:07 <slaweq> if anyone have any cycles, please try to check it
15:26:20 <slaweq> and that's basically all what I have for today :)
15:26:29 <slaweq> do You have anything else related to our ci?
15:27:49 <slaweq> if not, I will give You about 30 minutes back today
15:28:50 <slaweq> ok, thx for attending the meeting today
15:28:55 <slaweq> and have a great week
15:28:57 <slaweq> o/
15:28:58 <obondarev> o/
15:28:59 <slaweq> #endmeeting