15:02:01 #startmeeting neutron_ci 15:02:01 Meeting started Tue May 25 15:02:01 2021 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:03 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:05 The meeting name has been set to 'neutron_ci' 15:02:07 welcome (again) :) 15:02:15 o/ again 15:02:26 hi 15:02:28 o/ 15:02:34 First of all Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate 15:02:41 please open and we can move on 15:02:44 hi 15:03:00 we don't have any action items from last week 15:03:05 so let's skip that topic today 15:03:08 #topic Stadium projects 15:03:15 lajoskatona: any updates about stadium ci? 15:03:34 not much, only the ovs changes 15:03:43 I mean the ones to use ovs explicitly 15:03:58 those should be approved quickly I hope 15:04:55 ok, so let's quickly move to the next topic than 15:05:00 #topic Stadium projects 15:05:08 bcafarel: any updates/issues with stable branches? 15:05:47 all good from what I checked :) 15:06:14 (beware I still have a few unread emails, but so far so good) 15:06:18 only good news so far :) 15:06:25 that's great meeting 15:06:28 thank You 15:06:46 so let's move on to the next topic 15:06:48 #topic Grafana 15:07:45 from graphs I think that neutron-tempest-dvr-ha-multinode-full job is not set to ovs explicitly 15:07:51 and is now running with ML2/ovn 15:08:11 as its failure rate is going up in exactly same way as neutron-tempest-plugin-api job :) 15:08:24 :D 15:08:43 parent: tempest-multinode-full-py3 sounds like it yes 15:08:45 obondarev: it's Your favorite job, can You check it? :) 15:09:06 slaweq, I will :) 15:09:10 thx a lot 15:09:21 sure 15:09:28 #action obondarev to check neutron-tempest-dvr-ha-multinode-full and switch it to ML2/OVS 15:09:48 also neutron-rally-task job is in same situation 15:10:12 but there is patch https://review.opendev.org/c/openstack/neutron/+/791365 for that already 15:10:39 but we will need neutron-tempest-plugin fix first 15:10:48 and functional tests fix from ralonsoh 15:11:57 that are all issues which I see on the grafana currently 15:12:10 anything else You want to highlight maybe? 15:13:31 ok, let's move on 15:13:37 #topic fullstack/functional 15:13:50 I found only one new issue related to functional jobs 15:13:55 https://bugs.launchpad.net/neutron/+bug/1929518 15:13:56 Launchpad bug 1929518 in neutron "Functional db migration tests broken" [Critical,Confirmed] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) 15:14:02 and ralonsoh already took care of it 15:14:06 thx ralonsoh 15:14:12 yw 15:15:10 but now I think that we will need to combine it with https://review.opendev.org/c/openstack/neutron/+/791365 15:15:19 otherwise it will never pass gate :/ 15:15:51 so we should: 15:16:17 1. merge fix for neutron-tempest-plugin-api job https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/791255 15:16:36 2. combine https://review.opendev.org/c/openstack/neutron/+/792945 and https://review.opendev.org/c/openstack/neutron/+/791365 into one patch 15:16:40 and then we should be good 15:16:48 or am I missing something here? 15:16:49 sounds right yes 15:17:03 I vote for 1 15:17:19 that should solve neutron ci too 15:17:21 ralonsoh: it's not two possibilities to choose 15:17:24 right? 15:17:37 I though that solved neutron CI too 15:17:38 it's like action items to do and order of them :) 15:17:39 my bad 15:18:21 np :) 15:18:31 obondarev: lajoskatona can You maybe check https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/791255 ? 15:18:36 and approve it hopefully 15:18:43 we can update https://review.opendev.org/c/openstack/neutron/+/791365 then 15:18:46 so that will be in the gate already 15:18:51 I'll abandon my patch 15:19:12 ralonsoh: as You want, You can also update Your patch and we can abandon mine :) 15:19:31 don't worry, I'll update yours in a couple of mins 15:19:43 thx a lot 15:20:13 slaweq, ralonsoh, is it correct that alternative to https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/791255 is to switch job API job to OVS? 15:20:24 yes 15:20:26 obondarev: yes 15:20:39 actually I even had such patch proposed but I abandoned it 15:20:40 there is an abandoned patch 15:20:42 right 15:20:50 as ralonsoh convinced me to go with his approach :) 15:20:51 so that could avoid test skip, right? 15:20:57 yes 15:21:16 but, to be honest, the scope of this test is reduced 15:21:17 so why not? :) 15:21:43 there is only one test skipped and it should be soon available on ovn backend too 15:21:52 because OVS is already tested, this feature is not frequently used and it will be integrated in OVN soon 15:22:21 ok let me check, can continue meanwhile 15:22:22 I prefer to check OVN. This feature has not received patches in a long time 15:23:10 So wait with https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/791255 ? 15:24:04 actually no, I just approved it 15:24:07 :) 15:24:14 :) 15:24:14 thx :) 15:24:32 ok 15:24:43 ok, next topic then 15:24:45 #topic Tempest/Scenario 15:24:56 I found one new (for me at least) issue recently 15:25:01 https://bugs.launchpad.net/neutron/+bug/1929523 15:25:02 Launchpad bug 1929523 in neutron "Test tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details is failing from time to time" [High,Confirmed] 15:25:09 and failure examples 15:25:11 https://fc42fc060b9d19761c9e-19b00ab3af46f59a1799d97d7ae09a21.ssl.cf2.rackcdn.com/783748/4/gate/neutron-ovn-tempest-slow/9dbdc07/testr_results.html 15:25:13 https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_567/785895/1/gate/neutron-tempest-slow-py3/567fc7f/testr_results.html 15:25:18 did You saw it already maybe? 15:26:24 or anyone have cycles to check that? 15:26:33 I think there is a patch from Candido 15:26:36 let me check 15:27:08 https://review.opendev.org/c/openstack/tempest/+/779756 15:27:32 so it didn't help :/ 15:27:37 as it was merged 2 weeks ago 15:27:46 and failures which I saw were from this week 15:28:16 I'll ping him again, but I remember testing with him this patch 15:28:25 and was quite solit 15:28:28 solid* 15:28:36 maybe it's a bit different issue? 15:29:01 I don't think so, what we test is the content of resolv.conf 15:29:11 in this case retrieved dns list is empty 15:29:20 testtools.matchers._impl.MismatchError: {'1.2.3.4'} != set(): Looking for servers: ['1.2.3.4']. Retrieved DNS nameservers: [] From host: 172.24.5.177. 15:29:45 hmmm maybe the host needs a bit of time 15:29:48 and in Candido's patch description the issue was that additinal server was included 15:30:43 ok, I'll ping him 15:30:50 thx a lot 15:31:23 #action ralonsoh to talk with ccamposr about issue https://bugs.launchpad.net/neutron/+bug/1929523 15:31:24 Launchpad bug 1929523 in neutron "Test tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_subnet_details is failing from time to time" [High,Confirmed] 15:32:07 and that was all what I had for today :) 15:32:14 periodic jobs are running fine 15:32:29 do You have anything else to discuss today? 15:32:41 or if not, I will give You 28 minutes back 15:33:09 nothing from me :) 15:33:16 no thanks 15:33:34 nope 15:34:25 ok, thx for attending the meeting today 15:34:32 see You all online :) 15:34:34 o/ 15:34:35 o/ 15:34:36 o/ 15:34:36 #endmeeting