15:02:54 #startmeeting neutron_dvr 15:02:55 Meeting started Wed Dec 14 15:02:54 2016 UTC and is due to finish in 60 minutes. The chair is Swami. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:56 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:58 The meeting name has been set to 'neutron_dvr' 15:03:18 #chair Swami haleyb 15:03:20 Current chairs: Swami haleyb 15:03:43 #topic Announcements 15:04:23 haleyb will join late today. 15:05:25 jschwarz: do you have anything to discuss before haleyb joins 15:06:00 Swami, only that I'm trying to reproduce https://bugs.launchpad.net/neutron/+bug/1648385 with no luck so far 15:06:01 Launchpad bug 1648385 in neutron "Router is limited by the number of tenant networks" [Undecided,Incomplete] 15:07:10 jschwarz: thanks for the link 15:08:34 #topic Bugs 15:09:54 #link https://bugs.launchpad.net/neutron/+bug/1644415 15:09:55 Launchpad bug 1644415 in neutron "dvr_edge_ha_router disassociates floatingip incompletely" [High,In progress] - Assigned to Zhixin Li (lizhixin) 15:10:12 jschwarz: any update on this bug 15:11:49 #link https://review.openstack.org/404571 - patch under review 15:12:34 jschwarz, no updates from me 15:12:57 jschwarz: ok thanks 15:13:43 There is one new bug that has been reported against DVR, which is the gate failure. 15:13:47 #link https://bugs.launchpad.net/neutron/+bug/1649867 15:13:48 Launchpad bug 1649867 in tempest "Gate tempest dsvm neutron dvr test fails" [Undecided,New] 15:15:07 * haleyb shows up late to his own meeting 15:15:13 the test failure does not provide any information on specific DVR failures. 15:15:25 wc haleyb 15:15:25 haleyb: no problem 15:15:34 Swami, aye, but it was on a dvr gate 15:15:45 * jschwarz has another meeting in 15 minutes :< 15:15:58 so do i 15:16:51 Swami: i don't think that's a dvr-specific gate failure, let me find the bug 15:17:00 jschwarz: yep but it seems that it is failing while trying to create the instance. 15:17:23 haleyb: yes that's what I thought. 15:17:32 it's a libvirtd crash 15:17:47 bug 1643911 15:17:49 bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] https://launchpad.net/bugs/1643911 15:18:27 i'll check the logs for it and mark as duplicate if it matches 15:18:47 haleyb: thanks that would help. 15:18:58 #link https://bugs.launchpad.net/neutron/+bug/1403455 15:18:59 Launchpad bug 1403455 in neutron "neutron-netns-cleanup doesn't clean up all L3 agent spawned processes" [High,In progress] - Assigned to Daniel Alvarez (dalvarezs) 15:19:58 #link https://review.openstack.org/#/c/402140/ - patch needs review 15:20:31 i'll look, i know it was being changed yesterday 15:20:46 haleyb: thanks 15:21:10 The next in the list is 15:21:13 #link https://bugs.launchpad.net/neutron/+bug/1506567 15:21:14 Launchpad bug 1506567 in neutron "No information from Neutron Metering agent" [High,In progress] - Assigned to Brian Haley (brian-haley) 15:21:56 #link https://review.openstack.org/#/c/377108/ - patch needs review 15:22:38 i'll re-review today, think it was good before i pushed last update 15:22:47 haleyb: yes 15:22:52 #link https://bugs.launchpad.net/neutron/+bug/1612804 15:22:53 Launchpad bug 1612804 in neutron "test_shelve_instance fails with sshtimeout" [High,Confirmed] 15:23:39 haleyb: Are we seeing these failures still in the gate. If not we should either close it or drop the priority. 15:24:35 I know i dropped it from critical to high, will check logstash 15:24:43 haleyb: ok 15:27:12 That's all I had for the bugs today. We don't have any new bugs other than the one that I mentioned here. 15:29:08 thanks Swami 15:29:44 #topic Gate failures 15:30:58 There are no dvr-specific failures from what i can see, just the bug that Swami mentioned that i need to triage 15:31:10 haleyb: that is good 15:31:23 libvirtd crashing on xenial seems to be 5-10% failure in neutron 15:31:55 haleyb: ok 15:32:24 #topic Stable backports 15:33:05 * haleyb is looking at backport bugs 15:33:16 So i don't see any active DVR backports :) 15:33:35 haleyb: I haven't paid attention to the backports in a while and also we have not merged anything in master yet 15:34:16 Swami: right, can't backport if we don't merge anything, the fip race condition would be the next candidate 15:34:32 As soon as that merged i'm clicking the cherry-pick button 15:34:50 my PC crashed, sorry if I missesd anything 15:34:50 #topic Open discussion 15:35:06 jschwarz: no worries, we just assigned you all the bugs :) 15:35:07 jschwarz: you are fine. 15:35:14 yay! :P 15:35:32 haleyb: https://review.openstack.org/#/c/385617/ we got a +2 from Oleg, but we need to hunt for another core for the second +2 15:36:22 haleyb: we discussed last week, that we can push in a patch to make the multinode job voting if it is stable enough. 15:36:43 Swami: i don't see garyk around, he's been following it, i'll keep an eye out for him, although nothing has changed, just the commit message 15:37:07 haleyb: ok thanks 15:37:25 Swami: yes, should get a patch up for dvr multinode 15:38:11 haleyb: yes if everything is good. 15:38:54 http://grafana.openstack.org/dashboard/db/neutron-failure-rate seems ok with it, let me look over the past month again 15:40:51 Swami: the gate queue seems ok, but the check queue doesn't, but that could also just show bad code :( i'll propose the patch 15:40:51 haleyb: thanks 15:41:14 haleyb: make sense. 15:41:30 i just need to verify what criteria (failures in past XX days) might apply, beena while 15:42:08 anything else? 15:42:30 haleyb: I don't have any 15:43:17 jschwarz: anything from you? HA in a happy place besides that bug? 15:43:28 haleyb, nope, I'm good :) 15:43:32 ah 15:43:39 I have a patch for review 15:44:05 https://review.openstack.org/#/c/407099/ is the patch, but I need to revisit it following Jakub's notes 15:44:07 that's it 15:45:06 jschwarz: ok, i'm on that one so will review when i see jenkins happy. See there's a pep8 failure now? 15:45:27 haleyb, didn't :< 15:45:27 s/See/Seems 15:45:59 unused time import in neutron/tests/unit/agent/common/test_utils.py 15:46:26 that and jakub's -1 15:47:35 I did have one other thing - meetings for rest of year 15:47:53 haleyb: yes 15:48:32 haleyb: Are we going to meet again in 2017. 15:49:03 Week of 26th is out obviously, but I am out next week, actually rest of year, so might be best to just cancel unless Swami and jschwarz want to meet :) 15:49:19 we don't have Christmas in Israel 15:49:21 :P 15:49:44 haleyb: I am ok, coming back on 2017 15:50:29 jschwarz: you might have some other festivities, that Hannukah thing, but guess that's not one single day 15:50:40 i did think redhat was shut-down, like HPE is 15:51:28 haleyb, it's a week 15:51:44 World redhat has a shutdown,, but Red Hat Israel don't 15:52:09 jschwarz: that's bad. 15:52:22 Swami, :) I had October off for Israeli holidays 15:52:27 it always comes around here 15:52:31 jschwarz: that makes sense. 15:53:23 So I guess we had 2 votes for no more meetings this year 15:54:30 I'll send an email to the list, although the three of us are the core of dvr so we already know :) 15:55:08 if nothing else i'll end it 15:55:44 haleyb: jschwarz: Happy Holidays and Happy New Year. 15:55:49 bye guys! :) 15:55:54 You too, adios 15:55:55 See you all in 2017. 15:56:00 #endmeeting