15:02:54 <Swami> #startmeeting neutron_dvr 15:02:55 <openstack> Meeting started Wed Dec 14 15:02:54 2016 UTC and is due to finish in 60 minutes. The chair is Swami. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:56 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:58 <openstack> The meeting name has been set to 'neutron_dvr' 15:03:18 <Swami> #chair Swami haleyb 15:03:20 <openstack> Current chairs: Swami haleyb 15:03:43 <Swami> #topic Announcements 15:04:23 <Swami> haleyb will join late today. 15:05:25 <Swami> jschwarz: do you have anything to discuss before haleyb joins 15:06:00 <jschwarz> Swami, only that I'm trying to reproduce https://bugs.launchpad.net/neutron/+bug/1648385 with no luck so far 15:06:01 <openstack> Launchpad bug 1648385 in neutron "Router is limited by the number of tenant networks" [Undecided,Incomplete] 15:07:10 <Swami> jschwarz: thanks for the link 15:08:34 <Swami> #topic Bugs 15:09:54 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1644415 15:09:55 <openstack> Launchpad bug 1644415 in neutron "dvr_edge_ha_router disassociates floatingip incompletely" [High,In progress] - Assigned to Zhixin Li (lizhixin) 15:10:12 <Swami> jschwarz: any update on this bug 15:11:49 <Swami> #link https://review.openstack.org/404571 - patch under review 15:12:34 <jschwarz> jschwarz, no updates from me 15:12:57 <Swami> jschwarz: ok thanks 15:13:43 <Swami> There is one new bug that has been reported against DVR, which is the gate failure. 15:13:47 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1649867 15:13:48 <openstack> Launchpad bug 1649867 in tempest "Gate tempest dsvm neutron dvr test fails" [Undecided,New] 15:15:07 * haleyb shows up late to his own meeting 15:15:13 <Swami> the test failure does not provide any information on specific DVR failures. 15:15:25 <jschwarz> wc haleyb 15:15:25 <Swami> haleyb: no problem 15:15:34 <jschwarz> Swami, aye, but it was on a dvr gate 15:15:45 * jschwarz has another meeting in 15 minutes :< 15:15:58 <haleyb> so do i 15:16:51 <haleyb> Swami: i don't think that's a dvr-specific gate failure, let me find the bug 15:17:00 <Swami> jschwarz: yep but it seems that it is failing while trying to create the instance. 15:17:23 <Swami> haleyb: yes that's what I thought. 15:17:32 <haleyb> it's a libvirtd crash 15:17:47 <haleyb> bug 1643911 15:17:49 <openstack> bug 1643911 in OpenStack Compute (nova) "libvirt randomly crashes on xenial nodes with "*** Error in `/usr/sbin/libvirtd': malloc(): memory corruption:"" [Medium,Confirmed] https://launchpad.net/bugs/1643911 15:18:27 <haleyb> i'll check the logs for it and mark as duplicate if it matches 15:18:47 <Swami> haleyb: thanks that would help. 15:18:58 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1403455 15:18:59 <openstack> Launchpad bug 1403455 in neutron "neutron-netns-cleanup doesn't clean up all L3 agent spawned processes" [High,In progress] - Assigned to Daniel Alvarez (dalvarezs) 15:19:58 <Swami> #link https://review.openstack.org/#/c/402140/ - patch needs review 15:20:31 <haleyb> i'll look, i know it was being changed yesterday 15:20:46 <Swami> haleyb: thanks 15:21:10 <Swami> The next in the list is 15:21:13 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1506567 15:21:14 <openstack> Launchpad bug 1506567 in neutron "No information from Neutron Metering agent" [High,In progress] - Assigned to Brian Haley (brian-haley) 15:21:56 <Swami> #link https://review.openstack.org/#/c/377108/ - patch needs review 15:22:38 <haleyb> i'll re-review today, think it was good before i pushed last update 15:22:47 <Swami> haleyb: yes 15:22:52 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1612804 15:22:53 <openstack> Launchpad bug 1612804 in neutron "test_shelve_instance fails with sshtimeout" [High,Confirmed] 15:23:39 <Swami> haleyb: Are we seeing these failures still in the gate. If not we should either close it or drop the priority. 15:24:35 <haleyb> I know i dropped it from critical to high, will check logstash 15:24:43 <Swami> haleyb: ok 15:27:12 <Swami> That's all I had for the bugs today. We don't have any new bugs other than the one that I mentioned here. 15:29:08 <haleyb> thanks Swami 15:29:44 <haleyb> #topic Gate failures 15:30:58 <haleyb> There are no dvr-specific failures from what i can see, just the bug that Swami mentioned that i need to triage 15:31:10 <Swami> haleyb: that is good 15:31:23 <haleyb> libvirtd crashing on xenial seems to be 5-10% failure in neutron 15:31:55 <Swami> haleyb: ok 15:32:24 <haleyb> #topic Stable backports 15:33:05 * haleyb is looking at backport bugs 15:33:16 <haleyb> So i don't see any active DVR backports :) 15:33:35 <Swami> haleyb: I haven't paid attention to the backports in a while and also we have not merged anything in master yet 15:34:16 <haleyb> Swami: right, can't backport if we don't merge anything, the fip race condition would be the next candidate 15:34:32 <haleyb> As soon as that merged i'm clicking the cherry-pick button 15:34:50 <jschwarz> my PC crashed, sorry if I missesd anything 15:34:50 <haleyb> #topic Open discussion 15:35:06 <haleyb> jschwarz: no worries, we just assigned you all the bugs :) 15:35:07 <Swami> jschwarz: you are fine. 15:35:14 <jschwarz> yay! :P 15:35:32 <Swami> haleyb: https://review.openstack.org/#/c/385617/ we got a +2 from Oleg, but we need to hunt for another core for the second +2 15:36:22 <Swami> haleyb: we discussed last week, that we can push in a patch to make the multinode job voting if it is stable enough. 15:36:43 <haleyb> Swami: i don't see garyk around, he's been following it, i'll keep an eye out for him, although nothing has changed, just the commit message 15:37:07 <Swami> haleyb: ok thanks 15:37:25 <haleyb> Swami: yes, should get a patch up for dvr multinode 15:38:11 <Swami> haleyb: yes if everything is good. 15:38:54 <haleyb> http://grafana.openstack.org/dashboard/db/neutron-failure-rate seems ok with it, let me look over the past month again 15:40:51 <haleyb> Swami: the gate queue seems ok, but the check queue doesn't, but that could also just show bad code :( i'll propose the patch 15:40:51 <Swami> haleyb: thanks 15:41:14 <Swami> haleyb: make sense. 15:41:30 <haleyb> i just need to verify what criteria (failures in past XX days) might apply, beena while 15:42:08 <haleyb> anything else? 15:42:30 <Swami> haleyb: I don't have any 15:43:17 <haleyb> jschwarz: anything from you? HA in a happy place besides that bug? 15:43:28 <jschwarz> haleyb, nope, I'm good :) 15:43:32 <jschwarz> ah 15:43:39 <jschwarz> I have a patch for review 15:44:05 <jschwarz> https://review.openstack.org/#/c/407099/ is the patch, but I need to revisit it following Jakub's notes 15:44:07 <jschwarz> that's it 15:45:06 <haleyb> jschwarz: ok, i'm on that one so will review when i see jenkins happy. See there's a pep8 failure now? 15:45:27 <jschwarz> haleyb, didn't :< 15:45:27 <haleyb> s/See/Seems 15:45:59 <haleyb> unused time import in neutron/tests/unit/agent/common/test_utils.py 15:46:26 <haleyb> that and jakub's -1 15:47:35 <haleyb> I did have one other thing - meetings for rest of year 15:47:53 <Swami> haleyb: yes 15:48:32 <Swami> haleyb: Are we going to meet again in 2017. 15:49:03 <haleyb> Week of 26th is out obviously, but I am out next week, actually rest of year, so might be best to just cancel unless Swami and jschwarz want to meet :) 15:49:19 <jschwarz> we don't have Christmas in Israel 15:49:21 <jschwarz> :P 15:49:44 <Swami> haleyb: I am ok, coming back on 2017 15:50:29 <haleyb> jschwarz: you might have some other festivities, that Hannukah thing, but guess that's not one single day 15:50:40 <haleyb> i did think redhat was shut-down, like HPE is 15:51:28 <jschwarz> haleyb, it's a week 15:51:44 <jschwarz> World redhat has a shutdown,, but Red Hat Israel don't 15:52:09 <Swami> jschwarz: that's bad. 15:52:22 <jschwarz> Swami, :) I had October off for Israeli holidays 15:52:27 <jschwarz> it always comes around here 15:52:31 <Swami> jschwarz: that makes sense. 15:53:23 <haleyb> So I guess we had 2 votes for no more meetings this year 15:54:30 <haleyb> I'll send an email to the list, although the three of us are the core of dvr so we already know :) 15:55:08 <haleyb> if nothing else i'll end it 15:55:44 <Swami> haleyb: jschwarz: Happy Holidays and Happy New Year. 15:55:49 <jschwarz> bye guys! :) 15:55:54 <haleyb> You too, adios 15:55:55 <Swami> See you all in 2017. 15:56:00 <haleyb> #endmeeting