20:00:05 <johnsom> #startmeeting Octavia 20:00:05 <openstack> Meeting started Wed Aug 31 20:00:05 2016 UTC and is due to finish in 60 minutes. The chair is johnsom. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:00:06 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 20:00:08 <Frito> o/ 20:00:08 <sbalukoff> Howdy, folks! 20:00:08 <fnaval> o/ 20:00:09 <openstack> The meeting name has been set to 'octavia' 20:00:10 <nmagnezi> o/ 20:00:15 <johnsom> Hi everyone 20:00:20 <fnaval> hihi 20:00:25 <nmagnezi> hello 20:00:26 <pglass> o/ 20:00:41 <bana_k> hi 20:00:45 <chenli> hi 20:01:00 <johnsom> #topic Announcements 20:01:20 <TrevorV> o/ 20:01:26 <johnsom> I just want to remind folks that tomorrow is the last day to use your ATC codes for Barcelona without a fee. 20:01:29 <dougwig> o/ 20:01:41 <johnsom> So if you haven't already registered, do so now.... 20:01:57 <sbalukoff> Even if you think there's only a marginal chance you can attend. 20:01:59 <sbalukoff> Free is free, eh. 20:02:06 <TrevorV> I can't attend 20:02:12 <johnsom> We had a great mid-cycle last week, some notes are here: 20:02:18 <sbalukoff> Well, we didn't want *you* to go anyway. 20:02:19 <johnsom> #link https://etherpad.openstack.org/p/lbaas-octavia-newton-midcycle 20:02:20 <sbalukoff> ;) 20:02:25 <rm_mobile> o/ 20:02:39 <TrevorV> sbalukoff, don't make me cut you 20:02:44 <sbalukoff> Yes, the mid-cycle was awesome. Got a ton of stuff done. 20:02:47 <johnsom> It was a good kick off for the merge activities. 20:02:55 <johnsom> Any other announcements? 20:03:11 <sbalukoff> Active-active spec merged. 20:03:15 <dougwig> next week is newton FF. anything you want to merge MUST be in gerrit by wednesday. 20:03:33 <dougwig> err, wait, that's *TODAY*, isn't it? 20:03:37 <sbalukoff> dougwig: Does that include docs? 20:03:50 <sbalukoff> I thought I'd have another week or two on them... 20:03:51 <nmagnezi> dougwig, i think it's today 20:04:04 * nmagnezi checks 20:04:07 <sbalukoff> Ok, so feature freeze: If it ain't in today, it ain't in. 20:04:32 <dougwig> if it's in gerrit today, you can ask for an FFE. if it's not even in gerrit, you're SOL. 20:05:08 <johnsom> Yes, that is today. This is for "features". For Octavia I will not mind docs patches as they don't risk stability of the code. 20:05:09 <nmagnezi> https://releases.openstack.org/newton/schedule.html 20:05:45 <chenli> Can the stats patches goes in today ? I think they're ready. :) 20:05:51 <TrevorV> #link https://releases.openstack.org/newton/schedule.html 20:06:11 <johnsom> chenli link? 20:06:34 <chenli> https://review.openstack.org/#/c/354593/ 20:06:43 <TrevorV> #link https://review.openstack.org/#/c/354593/ 20:06:56 <chenli> #link https://review.openstack.org/#/c/355764/ 20:07:09 <chenli> #link https://review.openstack.org/#/c/356268/ 20:07:35 <chenli> and the neutron-lbaas side one : #link https://review.openstack.org/#/c/357653/ 20:07:46 <chenli> TrevorV: thanks 20:07:56 <TrevorV> np chenli :) 20:08:44 <johnsom> Ok, cores, let's have a look at this. 20:08:49 <sbalukoff> Ok 20:08:51 <TrevorV> chenli, I'll take a look through them as well. 20:09:14 <johnsom> I am a bit worried about it as I know some teams have done internal work against stats, so please make sure it doesn't break your stuff 20:09:50 <chenli> thanks all. We really hope stats can at least be 'working' in this release. 20:10:02 <sbalukoff> Indeed! 20:10:06 <johnsom> Any other announcements? 20:10:26 <johnsom> BTW, LBaaSv1 was removed from the code last week as well. That is worthy of an announcement. 20:10:30 <sbalukoff> Haha! 20:10:34 <sbalukoff> Yes, was just about to say that. 20:10:54 <nmagnezi> finally :) 20:11:04 <johnsom> Also, in other news, the normal LBaaS talk did not get accepted this year. 20:11:34 <johnsom> So, yeah, odd.... 20:11:37 <johnsom> Moving on... 20:11:47 <johnsom> #topic Brief progress reports / bugs needing review 20:12:02 <sbalukoff> Docs continue apace. 20:12:25 <fnaval> currently still working on the first scenario test migrating from neutron-lbaas to octavia; hope to complete this week 20:12:34 <johnsom> Yep, I finished up my review on the quick start yesterday 20:12:46 <sbalukoff> Also, Leslie (the Blue Box tech writer) got back yesterday from over a month of dealing with a family crisis; She's editing the two docs patches currently up for review now. 20:12:52 <TrevorV> Had a sick weekend, did an internal task, will be working on the quota review again shortly. 20:13:03 <chenli> #link https://review.openstack.org/#/c/358450/ 20:13:27 <Frito> Internal stuff. Will be transitioning away from Octavia to another internal RAX team soon. 20:13:32 <sbalukoff> I will also be snapping up other docs bugs over the next couple weeks which should hopefully encourage adoption for the Newton release. 20:13:35 <chenli> it is about the bug https://bugs.launchpad.net/octavia/+bug/1615471. 20:13:35 <openstack> Launchpad bug 1615471 in octavia "Failover fails when the amphora instance is stoped" [Undecided,In progress] - Assigned to li,chen (chen-li) 20:14:06 <johnsom> I am finishing up the routes patch and will be looking at the intermittent bug I saw:1614311 20:14:33 <sbalukoff> Sweet. 20:15:04 <johnsom> nmagnezi also added this bug to the agenda: 20:15:13 <johnsom> #link https://review.openstack.org/#/c/344658/ 20:15:27 <chenli> The git -C issue on Centos: #link https://review.openstack.org/#/c/353265/ 20:15:30 <johnsom> This one for lbaas 20:15:37 <johnsom> #link https://review.openstack.org/#/c/317862/ 20:16:13 <johnsom> Yeah, chenli I still don't think that is the right approach on the CentOS issue. I still need to do research on that 20:16:24 <nmagnezi> yup. this was already merged but got revered due to an issue that is now fixed. this is verified by the namespace scenario gate we fixed last week with the help of dougwig 20:16:49 <johnsom> He also raised the refactor patch: 20:16:55 <johnsom> #link https://review.openstack.org/#/c/346728/ 20:17:51 <sbalukoff> Lots of stuff to review, eh. 20:18:04 <dougwig> sbalukoff: like any FF. :) 20:18:06 <johnsom> Yeah. 20:18:12 <sbalukoff> Yep! 20:18:30 <nmagnezi> #link https://review.openstack.org/#/c/299998/ 20:18:31 <chenli> johnsom The git -C one ? why ? -C is change the patch before --git-dir, using --git-dir directly should not affect anything. 20:18:34 <johnsom> This one I'm not sure about: https://review.openstack.org/#/c/317862/ 20:18:40 <nmagnezi> this was also in the agenda johnsom :) 20:18:54 <dougwig> a patch to allow creation by net id instead of subnet id got submitted (similar to how nova does net id). if anyone is interested, to have any hope of newton, it needs some thrashing: https://review.openstack.org/#/c/363302/ 20:18:57 <johnsom> Do we want to mess with tempest plugin work for neutron-lbaas? Or just focus on the plugin for Octavia 20:19:43 <sbalukoff> johnsom: Focus on OCtavia. 20:19:52 <fnaval> Octavia focus fifrst 20:19:53 <fnaval> first 20:20:00 <sbalukoff> We're hoping to get things merged in the "O" cycle, right? ;) 20:20:06 <nmagnezi> the plugin for octavia is already merged, isn't it? 20:20:06 <johnsom> Yes 20:20:08 <fnaval> then once we have that good and working, perhaps apply that to neutron-lbaas afterwards 20:20:17 <chenli> Remove network from amphorae when delete a member #link https://review.openstack.org/#/c/347121/ 20:20:18 <sbalukoff> fnaval: +1 20:21:12 <johnsom> nmagnezi As we are merging neutron-lbaas into Octavia, we may just want to focus on building out the tests in Octavia and not migrate neutron-lbaas to tempest plugin 20:21:50 <dougwig> indeed, if that's done, and we swap to running octavia jobs in n-l, we can just stop running the n-l tests. 20:22:17 <fnaval> i also forsee that the tempest plugin dir structure that's needed in neutron-lbaas will not adhere, currently. though, I might be wrong as well. more resarch is needed 20:22:43 <nmagnezi> johnsom, perfectly understandable. but since it is not going to be completed in the upcoming release maybe it's worth considering 20:23:03 <sbalukoff> In Newton? 20:23:11 <johnsom> nmagnezi The plan is to complete it in Ocata 20:23:15 <sbalukoff> Oh, the tempest tests won't make it in there in any case. 20:23:32 <nmagnezi> sbalukoff, yes, Newton 20:24:11 <johnsom> For Newton, yeah, since the tests won't be converted for Newton, this should probably what to merge until Ocata is opened 20:25:00 <nmagnezi> johnsom, that was my intention, you phrased it better :) 20:25:21 <johnsom> Ah, ok 20:25:55 <johnsom> So, a bunch of stuff to review. The list is long and given the deadline, some will likely not make it. 20:26:44 <johnsom> If it doesn't, I'm sure it will land early in Ocata 20:27:03 <sbalukoff> Yep. 20:27:14 <johnsom> #topic Patches requiring discussion/consensus 20:27:27 <johnsom> Any other patch related discussion today? 20:27:29 <nmagnezi> i really hope to at least have https://review.openstack.org/#/c/299998/ and https://review.openstack.org/#/c/344658/ merged. as they give some sort of flexibility (HA wise) for those who still did not migrate to Octavia atm. 20:28:03 <nmagnezi> johnsom, not on my end. 20:28:06 <bana_k> need some input on this https://review.openstack.org/#/c/355115/ 20:28:09 <sbalukoff> Gotta remember how to run the namespace driver. It's been a loooooong time since I've done that. 20:28:13 <bana_k> about the test cases 20:28:28 <dougwig> sbalukoff: fire up a new devstack, is the easiest way. 20:28:31 <bana_k> as I mentioned in the last comment of the patch 20:28:36 <nmagnezi> sbalukoff, it's actually kinda simple, i can share my local.conf if it helps 20:28:54 <sbalukoff> nmagnezi: Sure. Send it to me. 20:29:23 <TrevorV> Guys, drop that "#link" before your links so it can be tracked easily in the notes. 20:29:25 <sbalukoff> (Not in this meeting, obviously.) 20:29:32 <TrevorV> #link https://review.openstack.org/#/c/299998/ 20:29:41 <TrevorV> #link https://review.openstack.org/#/c/344658/ 20:29:43 <johnsom> sbalukoff It looks like you have a -1 on bana_k's patch 20:29:56 <TrevorV> #link https://review.openstack.org/#/c/355115/ 20:30:23 <dougwig> to make trevorv happy: 20:30:25 <dougwig> #link https://review.openstack.org/#/c/363302/ 20:30:35 <sbalukoff> Huh. Ok. I'll have to have another look at it, then. 20:30:52 <chenli> Only me facing the bug: #link https://bugs.launchpad.net/octavia/+bug/1615471 ?? Can not believe that. :( 20:30:52 <openstack> Launchpad bug 1615471 in octavia "Failover fails when the amphora instance is stoped" [Undecided,In progress] - Assigned to li,chen (chen-li) 20:30:54 <bana_k> thanks johnsom sbalukoff 20:31:15 <nmagnezi> sbalukoff, how to run haproxy namespace driver #link https://bugs.launchpad.net/neutron/+bug/1613251/comments/1 20:31:15 <openstack> Launchpad bug 1613251 in neutron "HAproxy scenario tests cleanup fail with a StaleDataError (LBaaSv1 and LBaaSv2)" [High,Fix released] - Assigned to Nir Magnezi (nmagnezi) 20:31:21 <TrevorV> #link https://bugs.launchpad.net/octavia/+bug/1615471 20:31:41 <TrevorV> Bot commands have to be alone on their lines... sorry chenli 20:32:24 <chenli> TrevorV: O! 20:32:28 <johnsom> chenli I expect stopping amphora nova instances is a rare occurrence. I just want to make sure to test that heavily as the previous patch was 20:33:03 <chenli> johnsom, i believe all failover fails due to the same reason.... At least that happens in my tests 20:33:09 <johnsom> Once I get some test runs, that will be a quick merge 20:33:41 <johnsom> chenli, no, with the recent failover patch it went through a bunch of testing, like 30+ test grid 20:34:13 <chenli> johnsom, the bug is actually very easy to reproduce. Use a non-admin user to create a loadbalancer, and allow neutron-lbaas create the vip port (the default conifg in devstack) 20:34:28 <johnsom> So unless something changed in the last week or so that broke it, it was working really well 20:35:05 <chenli> johnsom: nova would check the project-id for port and nova instance, thus==> nova would complain the project id is not the same. 20:35:25 <chenli> johnsom I just re-produced it in a whole new set-up yesterday. 20:35:45 <chenli> johnsom and the new set-up is not installed by myself. 20:36:44 <johnsom> Hmm, I will have a look. The ports are plugged into the nova instance and all of them should be owned by the lbaas project 20:37:10 <johnsom> None of them should be owned by the tenant 20:37:17 <chenli> johnsom doesn't we only plug the vrrp port, and set the vip as the address_pair to the vrrp port ? 20:37:45 <johnsom> Yes, and neutron creates a port for the aap address 20:38:03 <chenli> johnsom: then no need to plug vip port to amphora directly 20:38:44 <johnsom> I agree on the surface, but previously we were only plugging the port your patch proposes to not plug, so I want to do more testing on this patch. 20:38:56 <chenli> I think when neutron-lbaas create the vip port, it use user's credential. 20:39:27 <chenli> I didn't change the plug for vrrp port, just remove the vip port plug. 20:39:54 <johnsom> As I said before, it needs more research and testing. 20:40:27 <chenli> sure! 20:40:32 <johnsom> #topic Open Discussion 20:40:39 <johnsom> Ok, other topics today? 20:40:59 * Frito observes the crickets 20:41:01 <sbalukoff> *crickets* 20:41:06 <sbalukoff> Jinx! 20:41:06 <nmagnezi> lol 20:41:08 <Frito> lol 20:41:30 <johnsom> Ok, so just a lot of patches to see if we can merge. 20:41:30 <nmagnezi> so what octavia related talks got accepted? 20:41:36 <sbalukoff> None. 20:41:43 <sbalukoff> No LBaaS talks either. 20:41:45 <dougwig> nmagnezi: none. no load balancing talks *at all*. 20:41:50 <johnsom> nmagnezi Sadly, no LBaaS related talks got accepted 20:41:51 <nmagnezi> that's very sad 20:41:52 <sbalukoff> And very few relevant Neutron talks. 20:42:02 <dougwig> the talks this year are heavily NFV, and don't represent the actual networking community much at all. 20:42:15 <dougwig> IMO 20:42:16 <sbalukoff> Yeah, it's pretty crap. 20:42:28 <johnsom> Yeah, given it was the #1 feature users were interested in from the last user survey I think it is very sad 20:42:38 <sbalukoff> So hey! Barcelona will probably feature me sitting in a hallway doing mid-cycle type stuff. Y'all are welcome to join me! 20:42:50 <dougwig> sbalukoff: i'm in 20:43:08 <nmagnezi> i actually learned a lot from your sessions in past summits. shame we won't have another one like this in the near summit. 20:43:13 <johnsom> Yeah, I want to have a LBaaS community discussion meeting and then find a table and work on merge activities personally 20:43:19 <diltram> unfortunately I'm not going so I will not join 20:43:24 <sbalukoff> nmagnezi: Come join us in the hall. :D 20:43:44 <nmagnezi> sbalukoff, sadly i can't travel this time. I hope next time I will join you :) 20:43:47 <johnsom> diltram you can join us in the virtual hall known as IRC.... grin 20:43:52 <sbalukoff> Yep! 20:43:56 * TrevorV isn't invited 20:43:57 <sbalukoff> So can you nmagnezi! 20:44:02 <diltram> johnsom: true :) 20:44:04 <sbalukoff> No, we don't want to see you TrevorV. 20:44:06 <diltram> this is my plan :) 20:44:06 <sbalukoff> ;) 20:44:26 <johnsom> Ok folks. Let's get busy with reviews. 20:44:32 <sbalukoff> Seriously though, I appreciate your work, TrevorV. 20:44:32 <nmagnezi> sbalukoff, where can i find details about this? (time, date, how to connect) 20:44:45 <sbalukoff> Even when it does break L7 in ways we didn't notice for months. XD 20:44:54 <diltram> hahahaha ;P 20:45:09 <sbalukoff> nmagnezi: Well, if you're not there in person, the place to be is the #openstack-lbaas channel on IRC. 20:45:27 <johnsom> nmagnezi Why don't you ping us when it gets a little closer. We should know where the neutron-ish rooms will be 20:45:52 <johnsom> Oh, yeah, remote, it will be IRC. Likely on Barcelona time 20:45:57 <sbalukoff> Yep. 20:46:23 <sbalukoff> We might be able to do some video stuff if we can find a place where we won't be disturbing others, and if the bandwidth doesn't suck. 20:46:27 <sbalukoff> But the surest bet is IRC. 20:46:35 <nmagnezi> sbalukoff, johnsom, ack. i hope I can make it (timezone diffs, it's almost midnight here) 20:46:36 <TrevorV> sbalukoff, that's you're fault too, I think you were a +2 on it 20:46:37 <TrevorV> o_0 20:46:43 <johnsom> Yeah, ummm, when has bandwidth not sucked at a summit???? 20:47:08 <johnsom> Ok, thanks folks! 20:47:12 <sbalukoff> TrevorV: Oh yes, I never said I wan't also culpable. ;) 20:47:16 <johnsom> #endmeeting