15:00:37 <mlavalle> #startmeeting neutron_l3
15:00:38 <openstack> Meeting started Thu Jul 27 15:00:37 2017 UTC and is due to finish in 60 minutes.  The chair is mlavalle. Information about MeetBot at http://wiki.debian.org/MeetBot.
15:00:40 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
15:00:42 <openstack> The meeting name has been set to 'neutron_l3'
15:00:48 <Swami> hi
15:00:50 <haleyb> hi
15:01:06 <mlavalle> The 3 L3 Amigos
15:01:16 <mlavalle> how was vacation haleyb?
15:01:52 <mlavalle> #topic Announcements
15:01:54 <haleyb> mlavalle: very nice, thanks, did not do a bit of work :)
15:02:17 <Swami> haleyb: great..
15:02:27 <mlavalle> So this week is the end of Pike
15:02:32 <mlavalle> we hit Pike-3
15:03:10 <mlavalle> kevinbenton mentioned during Monday's meetings that exceptions to feture freeze will be made early next week
15:03:18 <mlavalle> in case you need one
15:03:28 <Swami> mlavalle: good to know
15:04:27 <mlavalle> We are a little more than a month away from the PTG in Denver, Sept 11 - 15
15:04:38 <mlavalle> #link https://www.openstack.org/ptg/
15:05:01 <mlavalle> I got my travel approval earlier this week. So looking forward to see you all there
15:05:17 <haleyb> I just got approval yesterday, just need to book flight
15:05:25 <mlavalle> ++
15:05:38 <Swami> haleyb: good
15:05:40 <mlavalle> #chair haleyb Swami
15:05:41 <openstack> Current chairs: Swami haleyb mlavalle
15:06:06 * mlavalle had a weird network disconnection earlier this morning. adding chairs just in case
15:06:28 <mlavalle> Any other annoucements?
15:06:52 <Swami> nothing else.
15:06:54 <mlavalle> ok, moving on
15:07:00 <mlavalle> #topic Bugs
15:07:13 <mlavalle> Swami stage is all yours
15:07:18 <Swami> mlavalle: thanks
15:07:32 <Swami> I have not seen any new bugs filed this week.
15:07:46 <Swami> But let us the discuss the bugs that are being worked on.
15:08:13 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1702790
15:08:13 <openstack> Launchpad bug 1702790 in neutron "DVR Router update task fails when agent restarts" [Undecided,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan)
15:08:20 <Swami> Patch is up for review.
15:08:36 <Swami> #link https://review.openstack.org/#/c/481321/
15:08:46 <Swami> Needs another +2.
15:08:56 <Swami> The next one in the list is.
15:09:17 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1702769
15:09:17 <openstack> Launchpad bug 1702769 in neutron "Binding info for DVR port not found error seen when notify_l2pop_port_wiring is called with DVR routers" [Undecided,In progress] - Assigned to Brian Haley (brian-haley)
15:09:23 <Swami> Patch is up for review.
15:09:24 <haleyb> Swami: i'll look at that review ^^
15:09:42 <Swami> #link https://review.openstack.org/#/c/481311/
15:09:53 <haleyb> and that review I just updated to move it along, fixes the problem in my environment
15:10:06 <Swami> haleyb: thanks for the review on this one
15:10:18 <Swami> Need another +2 on this patch.
15:10:45 * mlavalle will look at this one today
15:10:46 <Swami> The next is the RFE.
15:10:53 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1583694
15:10:53 <openstack> Launchpad bug 1583694 in neutron "[RFE] DVR support for Allowed_address_pair port that are bound to multiple ACTIVE VM ports" [Wishlist,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan)
15:11:07 <Swami> The server side patch has merged. thanks for the reviews.
15:11:10 <mlavalle> yes
15:11:14 <Swami> The agent side patch is still under review.
15:11:30 <Swami> #link https://review.openstack.org/#/c/437986/
15:11:39 <mlavalle> I think you were pushing yesterday for the agent side, right?
15:11:41 <Swami> I got some last comments from kevin and I addressed it.
15:11:49 <Swami> So probably it should be good to go.
15:11:53 <Swami> Please review it.
15:11:59 <Swami> mlavalle: yes
15:12:13 <haleyb> In my queue for today
15:12:27 <mlavalle> I've been keeping an eye on the agent side patch since last Friday
15:12:31 <mlavalle> I will also review it
15:12:41 <Swami> mlavalle, haleyb: thanks
15:12:46 <Swami> The next one is the
15:12:50 <Swami> #link https://bugs.launchpad.net/neutron/+bug/1667877
15:12:50 <openstack> Launchpad bug 1667877 in neutron "[RFE] Allow DVR for E/W while leaving N/S centralized" [Wishlist,In progress] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan)
15:13:01 <Swami> This RFE is almost done.
15:13:24 <Swami> #link https://review.openstack.org/#/c/485333/
15:13:53 <Swami> I addressed kevin's concern on this patch last night with respect to allowing fast path exit with dvr agent mode dvr_no_fip.
15:14:05 <Swami> So it would be purely no_fip.
15:14:24 <mlavalle> is the Jenkins failure related to the patchset?
15:14:38 <mlavalle> No, it is not
15:14:41 <Swami> This patch needs review as well and it is dependent on the other agent side patch.
15:14:54 <Swami> mlavalle: it is not related. I have issued a recheck on it.
15:15:05 <Swami> mlavalle: let us see how it goes.
15:15:10 <mlavalle> ok
15:15:52 <Swami> haleyb: mlavalle: There was one question I had with respect to the upstream jenkins functional tests.
15:16:22 <Swami> Regarding the agent restart failure with DVR, I am able to see failures in the local environment why in upstream jenkins it is not failing.
15:17:04 <haleyb> it's only the grenade jobs that do a restart, right?
15:17:12 <Swami> haleyb: yes
15:17:41 <haleyb> i don't think anything is different from ocata to pike in the setup, so it is strange
15:17:59 <haleyb> but i see it in my devstack when applying local patches, l3-agent just spins
15:18:31 <Swami> haleyb: yes I have not seen any failure in jenkins but I can see that there are 5 restart tests that fails in local environment with ProcessExecutionError.
15:19:06 <haleyb> Swami: the only question i had with that change is why isn't the rule matching?  on add it checks if it exists and doesn't find it.  i was going to add some debug to see why
15:19:09 <Swami> haleyb: Just a heads up that something might not be right in the test suite and not giving us the right info.
15:19:35 <mlavalle> that could be
15:19:43 <Swami> haleyb: I think it is failing when it is trying to add the same rule that is existing.
15:20:10 <Swami> with the table_index and table_priority.
15:20:39 <davidsha> This is a functional test is it? not a unit test?
15:20:40 <haleyb> Swami: right, but i though add() checked first.  i'm sure once i add a log statement it will be obvious
15:20:49 <Swami> davidsha: yes it is functional test.
15:21:34 <Swami> mlavalle: haleyb: that's all I had for bugs.
15:21:41 <haleyb> Swami: and i'm not saying the patch is wrong, i'm just curious about the rule not matching
15:21:49 <haleyb> mlavalle: i did have another dvr-related bug
15:21:58 <Swami> haleyb: I didn't mean that you mentioned the patch.
15:21:59 * haleyb is filing it now or would have a number
15:21:59 <mlavalle> fire away, please
15:22:49 <haleyb> Swami: no worries, i've tested the patch and like it, just am curious...
15:22:53 <Swami> haleyb: go and file it and will take a look at it.
15:23:14 <haleyb> so the other day it was noticed the gate-tempest-dsvm-neutron-dvr-ha-multinode-full-ubuntu-xenial-nv was failing miserably, over 90%
15:23:39 <haleyb> matt riedman did some analysis and it looks like the 3-node setup is part of the problem
15:23:43 <mlavalle> ahh, that's the conversation you had with Ihar and mriedem in irc
15:23:51 <haleyb> sometimes the third node is not discovered
15:24:14 <haleyb> yes
15:24:14 <Swami> Is the third node not coming up.
15:24:41 <haleyb> i'm opening a bug, but it's more likely to need a fix over in devstack-gate or some other repo
15:25:11 <mlavalle> yeah, that is what I thought from looking at the chat
15:25:12 <haleyb> Swami: it's coming up, but after discovery happens, the code needs to wait for all sub-nodes to appear
15:25:16 <Swami> haleyb: good to know.
15:25:52 <haleyb> there was a patch opened against grenade a while back we'll need to revisit
15:26:23 <haleyb> so don't panic at the 95% failure rate :(
15:26:34 <mlavalle> good to know
15:26:48 <haleyb> it can happen in the 2-node job as well, just that the odds are less
15:27:27 <haleyb> this has probably been an issue for a while, but some recent change exposed the race condition
15:27:41 <haleyb> that's all i had on that
15:27:49 <Swami> haleyb: true.
15:27:57 <Swami> mlavalle: back to you.
15:27:59 <mlavalle> haleyb: thanks for the heads up
15:28:41 <mlavalle> First in the list today is https://bugs.launchpad.net/neutron/+bug/1706750
15:28:41 <openstack> Launchpad bug 1706750 in neutron "FlushError for automatic IPAllocations when subnet create is retried" [High,In progress] - Assigned to Ihar Hrachyshka (ihar-hrachyshka)
15:29:06 <mlavalle> it was filed yesterday by ihrachys
15:29:43 <mlavalle> he already proposed a fix for it:
15:29:49 <mlavalle> #link https://review.openstack.org/#/c/485328/
15:30:41 <mlavalle> any comments?
15:31:23 <mlavalle> Next up is https://bugs.launchpad.net/neutron/+bug/1683227
15:31:23 <openstack> Launchpad bug 1683227 in neutron "test_legacy_router test cases sometimes fail with: Cannot find device "qg-*" when moving it into a namespace" [High,Confirmed] - Assigned to Miguel Lavalle (minsel)
15:31:42 <mlavalle> I've been following this one over the past 2 weeks
15:32:15 <mlavalle> Since I filed a bug with the OVS community, I haven't found a single hit again
15:32:42 <mlavalle> Did we change OVS version recently?
15:33:36 <haleyb> i don't know, it would be something in the base image used for testing
15:34:13 <mlavalle> yeah, maybe something changed, becuase we were seeing it about once a week
15:34:23 <mlavalle> oh well, I'll keep an eye on it
15:34:51 <mlavalle> Next one is https://bugs.launchpad.net/neutron/+bug/1694764
15:34:51 <openstack> Launchpad bug 1694764 in neutron "test_metadata_proxy_respawned failed to spawn metadata proxy" [High,Incomplete] - Assigned to Miguel Lavalle (minsel)
15:35:13 <mlavalle> IN this case I have also been watching it for a little more than two weeks
15:35:26 <mlavalle> I was never able to find a single hit
15:35:52 <mlavalle> the only know ocurrence is the one reported by ihrachys when he filed the bug
15:36:01 <mlavalle> so I closed it earlier today
15:36:57 <mlavalle> any other bugs from the team to discuss today?
15:37:39 <mlavalle> ok, moving on
15:37:46 <mlavalle> #topic DNS
15:38:30 <mlavalle> on this topic, I just want to mention that I have merged 3 of the 4 patchsets in the series
15:38:36 <mlavalle> the last one is:
15:38:46 <mlavalle> #link https://review.openstack.org/#/c/468697/
15:38:56 <mlavalle> I addressed kevinbenton's comment
15:39:04 <mlavalle> so review if you have some time
15:39:09 <Swami> mlavalle: sure
15:39:25 <mlavalle> #topic Routed Networks
15:39:57 <mlavalle> On this topic the update is that I had a con call last Friday with the GoDaddy team to talk about their requirements
15:40:30 <mlavalle> it went pretty well and I took what they said and what I already had in my mind and put it in black and white here:
15:40:51 <mlavalle> #link https://review.openstack.org/#/c/486450/
15:41:05 <mlavalle> This spec is still WIP
15:41:26 <mlavalle> I need some ideas / guidance as to how to do the address translation
15:41:51 <Swami> mlavalle: I did read the spec once.
15:42:10 <Swami> mlavalle: Let us discuss about the NAT today. Probably after noon.
15:42:25 <mlavalle> Swami: would tomorrow work for you?
15:42:36 <Swami> mlavalle: sure tomorrow will be good.
15:42:46 <mlavalle> any time in mind?
15:42:59 <Swami> I am open after 10a.m PST.
15:43:17 <haleyb> i would like to attend as well, just let me know when
15:43:27 <mlavalle> would 11:30PST work for you two?
15:43:46 <mlavalle> that would be 14:30 EST
15:43:53 <Swami> mlavalle: Yes it will work.
15:43:56 <haleyb> yes, that should work for me
15:44:15 <mlavalle> Swami, haleyb: I will send an invite with a con call bridge number
15:44:19 <mlavalle> later today
15:44:32 <Swami> mlavalle: sure thanks.
15:44:46 <haleyb> anyone else that's here is welcome to attend, just to be inclusive :)
15:44:53 <mlavalle> of course
15:45:08 <mlavalle> if anyone wants to atend, raise your hand, please
15:45:11 <davidsha> I may listen in ;)
15:45:44 <mlavalle> davidsha: ok, I will include you in the invite. It will have the toll free number you need to dial in Ireland
15:45:57 <davidsha> mlavalle: perfect, thanks!
15:46:15 <mlavalle> #Open Agenda
15:46:33 <mlavalle> Any other topics we should cover today?
15:46:47 <Swami> I don't have any.
15:47:32 <davidsha> Which functional test scenario was it specifically that you were talking about earlier
15:47:33 <davidsha> ?
15:48:02 <mlavalle> you mean Swami?
15:48:39 <davidsha> yes, sorry!
15:49:16 <Swami> davidsha: it is 'tox -e dsvm-functional neutron.tests.functional.agent.l3.test_dvr_router
15:50:07 <davidsha> Swami: perfect, I'll have a look at it this evening.
15:50:22 <mlavalle> davidsha: thanks for looking :-)
15:50:28 <mlavalle> any other topics?
15:50:50 <Swami> davidsha: Right now since the patch has not merged, you will see 5 restart test fail.
15:51:02 <Swami> davidsha: just for your info.
15:52:00 <Swami> nothing else from me
15:52:44 <mlavalle> THanks team for attending
15:52:47 <davidsha> Swami: That's what I'm interested in, if it was a unit test it sounds like it was something was missed in the mocking, so I'm interested in see what causes it in a functional test.
15:53:02 <mlavalle> #endmeeting