| *** elo has quit IRC | 00:01 | |
| *** derekh has joined #openstack-operators | 00:06 | |
| *** elo has joined #openstack-operators | 00:17 | |
| *** harshs has joined #openstack-operators | 00:21 | |
| *** 77CAATUOY has joined #openstack-operators | 00:22 | |
| *** 18VAAO48R has joined #openstack-operators | 00:22 | |
| *** SimonChung has quit IRC | 00:24 | |
| *** darrenc is now known as darrenc_afk | 00:37 | |
| *** markvoelker has joined #openstack-operators | 00:37 | |
| *** derekh has quit IRC | 00:38 | |
| *** david-lyle has quit IRC | 00:40 | |
| *** markvoelker has quit IRC | 00:42 | |
| *** david-lyle has joined #openstack-operators | 00:44 | |
| *** Piet has joined #openstack-operators | 00:45 | |
| *** markvoelker has joined #openstack-operators | 00:51 | |
| *** elo has quit IRC | 00:54 | |
| *** darrenc_afk is now known as darrenc | 01:00 | |
| *** 18VAAO48R has quit IRC | 01:03 | |
| *** 77CAATUOY has quit IRC | 01:03 | |
| *** k_stev has quit IRC | 01:22 | |
| *** zhangjn has joined #openstack-operators | 01:30 | |
| *** csoukup has joined #openstack-operators | 02:06 | |
| *** geoffarnold is now known as geoffarnoldX | 02:07 | |
| *** sdake_ has joined #openstack-operators | 02:10 | |
| *** sdake has quit IRC | 02:13 | |
| *** VW_ has joined #openstack-operators | 02:24 | |
| *** SimonChung has joined #openstack-operators | 02:34 | |
| *** SimonChung1 has joined #openstack-operators | 02:37 | |
| *** SimonChung has quit IRC | 02:40 | |
| *** esker has joined #openstack-operators | 02:44 | |
| *** mdorman has joined #openstack-operators | 02:47 | |
| *** deepthi has joined #openstack-operators | 02:56 | |
| VW_ | evening, folks. | 02:58 |
|---|---|---|
| VW_ | we'll kick off the LDT meting in a couple minutes | 02:58 |
| mdorman | o/ | 02:59 |
| *** harshs has quit IRC | 02:59 | |
| *** sorrison has joined #openstack-operators | 02:59 | |
| VW_ | #startmeeting Large Deployments Team September 2015 Meeting | 03:00 |
| openstack | Meeting started Fri Sep 18 03:00:25 2015 UTC and is due to finish in 60 minutes. The chair is VW_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 03:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 03:00 |
| openstack | The meeting name has been set to 'large_deployments_team_september_2015_meeting' | 03:00 |
| VW_ | alrighty, let's kick this thing off. Lose agenda still here - https://wiki.openstack.org/wiki/Meetings/LDT#Meeting_Times | 03:01 |
| *** markvoelker has quit IRC | 03:01 | |
| mdorman | who’s all here? | 03:01 |
| klindgren | o/ | 03:02 |
| VW_ | o/ | 03:02 |
| klindgren | sorrison, arrives just in time | 03:02 |
| mdorman | heh | 03:02 |
| sorrison | hey guys | 03:02 |
| mdorman | at least i am staying up late for a goo d reason then :) | 03:02 |
| VW_ | hee hee | 03:03 |
| mdorman | “late" | 03:03 |
| sorrison | was just at lunch!, curry Friday | 03:03 |
| mdorman | :) | 03:03 |
| sorrison | also fighting fires with our kilo upgrade and migrating our pre prod cloud to neutron.... | 03:03 |
| mdorman | so what were the business logic patches? i think i missed that part at the meetup | 03:04 |
| VW_ | #topic Business Logic Patches | 03:04 |
| mdorman | sorrison: just a day in the life, yeah? | 03:04 |
| VW_ | think it actually game from the meeting the following week, mdorman | 03:04 |
| * VW_ is looking back over the logs | 03:04 | |
| * VW_ was in a keynote at openstacksv at the same time as said meeting | 03:04 | |
| mdorman | ah ok | 03:05 |
| mdorman | yeah i missed that one too | 03:05 |
| klindgren | I htink business logic patches are patches that we are carrying to implement business logic | 03:06 |
| VW_ | 16:49:01 <klindgren> I plan on starting another etherpad of patches that we have for just business logic | 03:06 |
| mdorman | ok yeah, so just trying to gather a list. i get it. | 03:06 |
| klindgren | hopefully a session in Tokyo dedicated to it. So I still need to createa an ehter pad for that | 03:06 |
| klindgren | INclusive of all ops, try to see whats out there/overlap ect ect | 03:07 |
| mdorman | klindgren: had you dropped that in to the tokyo ops track ehterpad as a suggested session? | 03:07 |
| klindgren | and see if we can't get some traction on getting stuff into openstack | 03:07 |
| mdorman | i think this is a great idea… i’m sure we can find a lot of commonality there too | 03:07 |
| klindgren | or atleast hooks/extension points | 03:07 |
| klindgren | it is in the tokyo ehterpad | 03:07 |
| klindgren | and I asked for it to be a working group as well | 03:08 |
| klindgren | but we shall see | 03:08 |
| mdorman | cool | 03:08 |
| VW_ | be careful what you asked for klindgren | 03:09 |
| VW_ | :P | 03:09 |
| mdorman | you’re gonna end up moderating a ton of stuff :) | 03:09 |
| mdorman | so, an action for kris to set up an etherpad for that? | 03:09 |
| VW_ | you might be in charge of something before too long | 03:09 |
| VW_ | #action klindgren set up business logic etherpad | 03:09 |
| VW_ | it is now | 03:09 |
| mdorman | haha | 03:09 |
| klindgren | I will see if I can avoid that for now :-) | 03:09 |
| klindgren | hehehe | 03:09 |
| klindgren | Anyway - I plan on trying to get that up next week | 03:10 |
| klindgren | and send a mailing list out to ops to update with what they have | 03:10 |
| mdorman | cool | 03:11 |
| VW_ | sounds good to me | 03:11 |
| VW_ | moving on then, I suppose | 03:11 |
| klindgren | was going to say - I have nothing else on that | 03:12 |
| klindgren | unless fifieldt has some comments :-) | 03:12 |
| * fifieldt looks up | 03:12 | |
| mdorman | haha | 03:12 |
| VW_ | uh oh - didn't know he was lurking | 03:13 |
| VW_ | #topic Cells V1 | 03:13 |
| VW_ | so, I'll be the first to admit I'm behind on this one | 03:13 |
| klindgren | Yea - though I sent an email to ops today | 03:13 |
| fifieldt | re: TYO ops, etherpad should be become agenda very soon now :) | 03:14 |
| klindgren | outlining the stuff that was specifically broken in cells | 03:14 |
| mdorman | so there is https://review.openstack.org/#/c/215459/2 for some of the v1 pathes we’ve been carrying | 03:14 |
| mdorman | i kinda just threw it out there as best i could, and it is getting some reviews. folks are asking for more detailed unit tests, and i could use some help on that. | 03:14 |
| klindgren | that has a pretty good list of all the stuff that we are borrowing from nectar | 03:14 |
| klindgren | The unit test stuff is always a little frustrating to me | 03:15 |
| mdorman | hoping to maybe get mgagne or others to lend a hand with that. i barely understand how the code is working, much less how to build a good unit test | 03:15 |
| klindgren | especially on cells - its like you broke it and never tested it the first time around... | 03:15 |
| mdorman | yeah. i mean it’s not an unreasonable ask, imo | 03:15 |
| klindgren | but - getting good tests in place would be nice | 03:15 |
| VW_ | gotcha | 03:16 |
| VW_ | will take a look | 03:16 |
| klindgren | anyway - I was going to take my email and update the ether pad with the cells patches | 03:17 |
| klindgren | 99% comes from NeCTAR anyway | 03:17 |
| VW_ | yeah. Truth be told, I'd like to have a good hear to hear with Garbutt and Laski about cells v1 and what we can do in the next couple of cycles | 03:17 |
| VW_ | heart to heart even | 03:18 |
| * VW_ inspects his t key | 03:18 | |
| klindgren | If anything just having a list called out with links to code - could help people who need to move to cells and have stuff work | 03:19 |
| VW_ | yeah | 03:19 |
| mdorman | right. | 03:19 |
| mdorman | i think we’re going in a positive direction, though. this issue and the patches are at least getting some attention | 03:19 |
| sorrison | that interface attach patch is still under review right? | 03:19 |
| klindgren | becuase its like hey I am testing out cells and - surprise - you know a bunch of stuff that you use to do... yea - thats not fixed/working | 03:19 |
| *** esker has quit IRC | 03:19 | |
| klindgren | sorrison, yea - they want more unit tests | 03:20 |
| klindgren | I think is the main complaint that I saw | 03:20 |
| mdorman | sorrison: yup. https://review.openstack.org/#/c/215459/2 | 03:20 |
| VW_ | klindgren: will you link the etherpad again | 03:21 |
| mdorman | i have been meaning to make some trivial updates and post another patchset, but just have not had time. | 03:21 |
| VW_ | just in case folks don't read last months notes | 03:21 |
| mdorman | #link cells v1 interface attach patch: https://review.openstack.org/#/c/215459/2 could use some help in implementing better unit tests | 03:21 |
| klindgren | #link Cells patches etherpad https://etherpad.openstack.org/p/PAO-LDT-cells-patches | 03:22 |
| VW_ | so, I would suggest that in the ehterpad, we start making notes of what we need for each patch | 03:23 |
| VW_ | like "could use some help in implementing better unit tests" | 03:23 |
| serverascode | (o/ here but late) | 03:24 |
| VW_ | welcome serverascode | 03:24 |
| VW_ | we were just chatting about Cells V1 patches | 03:24 |
| VW_ | we are trying to get a good list of common ones that we can advocate for with the Nova folks | 03:25 |
| serverascode | cool thanks | 03:25 |
| VW_ | sounds like this may be a big topic of discussion in LDT session at Tokyo | 03:25 |
| *** fawadkhaliq has joined #openstack-operators | 03:26 | |
| VW_ | would you all agree? | 03:26 |
| klindgren | yea | 03:26 |
| klindgren | I think so | 03:26 |
| VW_ | cool | 03:26 |
| mdorman | +1 | 03:26 |
| VW_ | ok, well, on that note... | 03:27 |
| *** geoffarnoldX is now known as geoffarnold | 03:27 | |
| VW_ | #topic Tokyo | 03:27 |
| klindgren | Are we also going to try to meetup with carl/neutron people on the network segmentation stuff or? - I would really like to not see that slip away | 03:28 |
| VW_ | that would be really good | 03:28 |
| VW_ | I'm happy to devote time to i | 03:28 |
| VW_ | to it | 03:28 |
| VW_ | I don't know how much time fifieldt thinks he can give us yet | 03:29 |
| *** sdake has joined #openstack-operators | 03:29 | |
| gfa | +1 to the network segmentation stuff | 03:29 |
| fifieldt | LDT should get an 80min working group block I think | 03:29 |
| VW_ | hazzah! | 03:29 |
| mdorman | maybe we can try to schedule part of that time to meet with neutron folks, kind of like we did at the midcycle meetup | 03:29 |
| VW_ | yeah - I think that makes a lot of sense | 03:30 |
| VW_ | 1. Meet with Neutron | 03:30 |
| VW_ | 2. Solidify cells V1 patche list | 03:30 |
| mdorman | i know they are also working on finalizing thier own adgenda, so maybe it would make sense to put a plug in on that side and see if they’re willing to devote time to the topic too | 03:30 |
| VW_ | that is a good point | 03:30 |
| VW_ | Kyle is not re running as PTL either, so it might be tricky to figure out their schedule | 03:31 |
| VW_ | I have a core I can ping. | 03:31 |
| klindgren | Yea - I would be OK trying to go to a neutron meeting about network segmentation - but in the past those meetings kinda devolved into something else | 03:31 |
| klindgren | I think Carl is runnign for PTL as well | 03:31 |
| VW_ | klindgren - you want to reach out to carl | 03:32 |
| klindgren | I will | 03:32 |
| *** sdake_ has quit IRC | 03:32 | |
| sorrison | I am using a patch with helps with dhcp agent scheduling | 03:32 |
| VW_ | #action klindgren check with Carl on possible Neutron session on segmentation | 03:32 |
| klindgren | we have a talk accepted as an alternate on this very topic so I will reach out to him about that as well | 03:32 |
| VW_ | nice! | 03:33 |
| sorrison | https://review.openstack.org/#/c/205631/ works well | 03:33 |
| klindgren | Curious - in tokyo I think we have our hands full with stuff currently on the plate | 03:33 |
| klindgren | but I would also like to talk about glance | 03:33 |
| *** harshs has joined #openstack-operators | 03:33 | |
| VW_ | hrm | 03:34 |
| klindgren | and getting some useful (basic imho) into glance | 03:34 |
| klindgren | like quotas and hierarchical project support | 03:35 |
| VW_ | hey - so, we actually have a chance to meet before the summit | 03:35 |
| sorrison | +1 | 03:35 |
| mdorman | thre has been some ML discussion about Mitaka priorities for glance, but i haven’t been following it really | 03:35 |
| VW_ | if we can confirm a Neutron session, maybe we can spend our time on Cells and Glance | 03:35 |
| mdorman | seems like a good approach | 03:35 |
| VW_ | but I may also see if I can get some glance dev love in that meeting too | 03:37 |
| klindgren | I dont want to sound like debbie downer, but I was talking to someone about glance - and what I heard was glance might need a new PTL before some of those features get implemented | 03:37 |
| klindgren | but they are soooo very desperately needed | 03:37 |
| VW_ | #action VW_ see if a glance dev can join OCT ldt meeting | 03:37 |
| VW_ | I personally wich we could get glance out of path for data transfer | 03:38 |
| *** sdake_ has joined #openstack-operators | 03:38 | |
| klindgren | so have glance redirect nova to upload to swift or somethign directly | 03:38 |
| VW_ | use it to catalogue images and such, but not have to push bits through it | 03:38 |
| klindgren | ? | 03:38 |
| VW_ | yeah - something like that | 03:38 |
| klindgren | I heard an idea from someone a while back to run glance on every compute node | 03:39 |
| VW_ | Our friends at CERN have cooked up some pretty impressive caching stuff to work around/with those constraints | 03:39 |
| klindgren | without an image cache enabled | 03:39 |
| *** sdake_ has quit IRC | 03:39 | |
| klindgren | to effectively do that | 03:39 |
| klindgren | yea - that would be pretty nice as well. BUt I will set for jsut some admin basics | 03:40 |
| sorrison | I went to the ops glance session in vancouver, they would love ops input. I was pretty much the only op there | 03:40 |
| klindgren | like quotas, "cloud provided images", hierarchical projects | 03:40 |
| *** sdake_ has joined #openstack-operators | 03:40 | |
| *** sdake has quit IRC | 03:41 | |
| klindgren | so VW_ you would also like a glance data bypass option? | 03:41 |
| VW_ | I would personally becuase of the amount of hardware I have to throw at the damn service | 03:42 |
| klindgren | kk | 03:42 |
| VW_ | we were headed down that path, but stopped. I need to dive back into that with our devs, but I've had my hands full with some other things | 03:42 |
| klindgren | sorrison, thats good feedback | 03:43 |
| VW_ | well, at least we were looking at bypass for uploads | 03:43 |
| gfa | you can do that glance on every compute to bypass it for uploads | 03:43 |
| sorrison | I talked about bypass with them, took a while to explain to them with some crazy whiteboard drawings | 03:43 |
| gfa | not bypass the service, but the load on the glance farm | 03:43 |
| klindgren | yea - but I think VW_ also wans to avoid also running 20k+ instances of glance as well | 03:44 |
| VW_ | :) | 03:44 |
| gfa | hahah lol, right | 03:45 |
| klindgren | we can add that to the list | 03:45 |
| VW_ | for sure | 03:45 |
| klindgren | so we want to also try to tackle some asks around glance then at Tokyo as well? | 03:45 |
| VW_ | and I'll see if we can get some Glance folks in for the Oct meeting ahead of the summit | 03:45 |
| klindgren | kk | 03:45 |
| klindgren | ah right right | 03:46 |
| klindgren | Oct meeting | 03:46 |
| VW_ | ok, so before we run out of time, I have a bit of bad news | 03:46 |
| VW_ | and fifieldt is going to be mad at me | 03:46 |
| fifieldt | :D | 03:46 |
| VW_ | but I don't think I'm going to be able to come to Tokyo after all | 03:46 |
| VW_ | running a big cloud may have to win that week | 03:46 |
| * fifieldt asplode | 03:46 | |
| mdorman | wah wah | 03:46 |
| mdorman | bummer | 03:47 |
| VW_ | yeah - looks like I'll be heading the other way, actually and ending up in Lond that week for some DC migration stuff | 03:47 |
| VW_ | I chatted with klindgren a bit earlier. He's willing to help moderate the session (I think) | 03:48 |
| VW_ | ;) | 03:48 |
| sorrison | booo | 03:48 |
| klindgren | yea I volunteered mdorman to help too :-) | 03:48 |
| VW_ | cool | 03:48 |
| sorrison | happy to help out too | 03:48 |
| klindgren | on the plus side I do hava a hotel for tokyo and my openstack ticket - now just need to book flights | 03:48 |
| *** sdake_ is now known as sdake | 03:48 | |
| VW_ | and I'll have two of my engineers there - Joel that came to Palo Alto and Ben that was in YVR | 03:49 |
| VW_ | thanks guys - really sorry about this | 03:49 |
| mdorman | cool | 03:49 |
| VW_ | but it was a tough call I had to make | 03:49 |
| VW_ | if things change, I'll let you know in the Oct meeting | 03:49 |
| VW_ | and hopefully fifieldt will be speaking to me again by then | 03:50 |
| klindgren | #link https://etherpad.openstack.org/p/LDT-glance-asks | 03:50 |
| VW_ | sweet! | 03:50 |
| VW_ | but, that brings up one thing that I was going to ask you all in Tokyo about the working group and how we manage it. | 03:51 |
| VW_ | I'm happy to keep co-ordinating things, but I didn't know if that was a role we felt we should move different people in to | 03:51 |
| VW_ | was just going to get thoughts while we were gathered | 03:52 |
| klindgren | I think as long as it doesn't always fall on one person and people volunteer to leader/co-ordinate certain things it shouldn't be a huge issue | 03:53 |
| mdorman | i’m happywith the way things are now. but if it’s something where you’re feeling you don’t have the time to manage it, then it’s fair to ask someone else to step up. | 03:53 |
| klindgren | at least not right now | 03:53 |
| VW_ | I'm fine continuing to be the cat hearder if you guys see value in it | 03:54 |
| klindgren | I kinda hoped that we would have more people participate in LDT | 03:54 |
| VW_ | I just didn't want it to be all "my" thing - or appear to be | 03:54 |
| VW_ | me too | 03:54 |
| VW_ | we are gaining some momentum - all be it, slowly | 03:55 |
| mdorman | nah i don’t think it’s that at all. having someone run the meetings and kinda keep things moving is good. | 03:55 |
| klindgren | maybe we should call it the ADT :-) | 03:55 |
| klindgren | All deployment team | 03:55 |
| mdorman | haha | 03:55 |
| klindgren | though the security company may not like that | 03:55 |
| VW_ | lolz | 03:55 |
| serverascode | was there still going to be some time in tokyo for public clouds in the ldt stuff? | 03:55 |
| VW_ | yeah, trying to figure out how we cover it all in 80 minutes | 03:56 |
| VW_ | ideally we can be IN a Neutron discussion | 03:56 |
| serverascode | ah ok 80 min total | 03:57 |
| VW_ | so that frees one thing of the list for our session | 03:57 |
| klindgren | I am all for public cloud stuff in LDT | 03:57 |
| VW_ | so, let's do this then. We know that 4 things are on the ideal list for Tokyo | 03:58 |
| VW_ | 1. Neutron Segmentation | 03:58 |
| VW_ | 2. Cells v1 patches | 03:58 |
| VW_ | 3. Glance | 03:58 |
| VW_ | 4. Public Clouds | 03:58 |
| klindgren | serverascode, anything burning in public cloud space | 03:58 |
| klindgren | many ideas were brought up in the etherpad and at palo alto | 03:59 |
| VW_ | let's see what we can work out with the devs in the thre projects between now and the Oct meeting and then we can prioritize the 80 minutes in the next meeting | 03:59 |
| klindgren | sounds good to me | 03:59 |
| serverascode | I just know there are at least 13 public clouds based on openstack now, so I'd like to talk to those people somehow :) no major technical things right now | 04:00 |
| mdorman | +1 to taht plan VW_ | 04:00 |
| VW_ | fifieldt: LDT is happy to abosorb the public cloud stuff for now, but do you think it warrants a session of its own? | 04:00 |
| klindgren | serverascode, are you including Godaddy in that list? | 04:01 |
| fifieldt | personally, I think those public clouds should be working with LDT | 04:01 |
| fifieldt | might not be the exactly right label, but I think you all have a similar enough mindset :) | 04:01 |
| xavpaice | some public clouds aren't exactly 'large' though ;) | 04:01 |
| serverascode | just going off this list: https://github.com/openstack/os-client-config/tree/master/os_client_config/vendors | 04:01 |
| VW_ | is there sufficient quantities of whiskey to talk you into a triple lenght session like YVR :) | 04:01 |
| *** markvoelker has joined #openstack-operators | 04:02 | |
| fifieldt | indeed xavpaice, but are their issues not being covered by the LDT? :) | 04:02 |
| xavpaice | oh, didn't know about that - must add us on | 04:02 |
| xavpaice | fifieldt: more that not all the LDT issues are relevant for tiny clouds | 04:02 |
| klindgren | the problem is I have some other sessions that I want to go to as well | 04:02 |
| xavpaice | rather than the opposite | 04:02 |
| fifieldt | I'm just trying to work out whether there's a real issue here :) a gap, if you will :) | 04:03 |
| *** codebauss has joined #openstack-operators | 04:03 | |
| xavpaice | I'd be keen to be involved in LDT if that is also public clouds - and I'd be extremely happy to learn from bigger players that aren't operating public clouds | 04:03 |
| xavpaice | there's a lot of common ground | 04:04 |
| mdorman | i think tim bell said it well in paris, LDT is for you if you consider yourself a large deployer. which may or may not correspond to some number of cores, etc. | 04:04 |
| VW_ | I think so too, xavpaice. For example, a "small" cloud may still chose to do something like break up capacity into different cells based on hardware types to offer customers different products | 04:05 |
| VW_ | plus, I don't know that any service providers/public clouds with dreams of staying small ;) | 04:05 |
| VW_ | s/with/have | 04:05 |
| xavpaice | true enough | 04:05 |
| serverascode | that is true for sure | 04:05 |
| klindgren | ah - back in the days when we only had a few hundred vm's | 04:06 |
| mdorman | any other topics? | 04:06 |
| fifieldt | we can't let xavpaice go - he has too many cool stories about datacentre floods | 04:06 |
| VW_ | woah - it's settled then | 04:06 |
| *** markvoelker has quit IRC | 04:06 | |
| xavpaice | splishy splashy | 04:06 |
| mdorman | liquid water cooled, DC? nice! | 04:07 |
| xavpaice | someone thought it a good idea to put the generator and UPS batteries in the basement | 04:07 |
| klindgren | side question - dont hold the meeting open.... but did peoples kilo upgrades go smothly | 04:07 |
| sorrison | we are in the middle of ours | 04:07 |
| * xavpaice would love to hear war stories there | 04:08 | |
| xavpaice | about to do it | 04:08 |
| klindgren | I am hearing reports from a number of people of issues post update | 04:08 |
| sorrison | done nova and been ok | 04:08 |
| klindgren | like the ipset stuff in neutron | 04:08 |
| klindgren | we hit that like 4-5 times | 04:08 |
| VW_ | I think so - we on a trunk pull from last month at the moment | 04:08 |
| klindgren | then nohting for 2+ weeks | 04:08 |
| VW_ | working on another | 04:08 |
| sorrison | but seeing increased load on keystone (juno) which in tern is hitting ulimits in memcached | 04:08 |
| VW_ | anything else "official" before we tiptoe down upgrade lane? | 04:09 |
| mdorman | fernet tokens, sorrison ? | 04:09 |
| mdorman | VW_: not for me | 04:09 |
| sorrison | also default_ephemeral_filesystem config changed I think | 04:09 |
| klindgren | I dont have anything official | 04:09 |
| VW_ | I'll make sure the Oct meeting is all about piortiziing the tokyo schedule | 04:09 |
| klindgren | kk | 04:09 |
| sorrison | we had vms spinning up with fat filesystems for vdb... | 04:09 |
| xavpaice | is this the normal time for LDT meetings? | 04:09 |
| VW_ | sorrison: I'll try to get something to you ahead of the meeting | 04:09 |
| VW_ | every other month, xavpaice | 04:10 |
| sorrison | yeah looking into fernet, once we've got everything onto kilo, | 04:10 |
| xavpaice | right - I happened in here by accident today, will try to be more organised in future | 04:10 |
| sorrison | worried though as we use pki and so no verification on keystone server | 04:10 |
| VW_ | next month, it will be third thursday at 16:00 UTC | 04:10 |
| sorrison | load on keystone once we verify using fernet | 04:10 |
| xavpaice | that's 4am here in NZ - probably won't join | 04:10 |
| VW_ | we aren't the best record keepers, xavpaice, but https://wiki.openstack.org/wiki/Meetings/LDT#Meeting_Times | 04:10 |
| xavpaice | many thanks | 04:11 |
| VW_ | sure thig | 04:11 |
| sorrison | xavpaice where you based? | 04:11 |
| xavpaice | New Zealand | 04:11 |
| VW_ | #endmeeting | 04:11 |
| openstack | Meeting ended Fri Sep 18 04:11:31 2015 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 04:11 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/large_deployments_team_september_2015_meeting/2015/large_deployments_team_september_2015_meeting.2015-09-18-03.00.html | 04:11 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/large_deployments_team_september_2015_meeting/2015/large_deployments_team_september_2015_meeting.2015-09-18-03.00.txt | 04:11 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/large_deployments_team_september_2015_meeting/2015/large_deployments_team_september_2015_meeting.2015-09-18-03.00.log.html | 04:11 |
| sorrison | where in NZ? | 04:11 |
| sorrison | I'm from Dunedin :-) | 04:11 |
| xavpaice | Wellington - Catalyst IT | 04:11 |
| xavpaice | sweet! | 04:11 |
| VW_ | but we don't hold it against you, sorrison | 04:12 |
| sorrison | ah cool we're working with you guys at the moment (I'm from NeCTAR) | 04:12 |
| xavpaice | :) | 04:12 |
| xavpaice | you must be dealing with Evan? | 04:12 |
| sorrison | We can't all be cool rackers VW_ | 04:12 |
| VW_ | lol | 04:12 |
| sorrison | correct | 04:12 |
| VW_ | actually Tane is all amped up about the world cup | 04:12 |
| mdorman | hee | 04:12 |
| mdorman | *hehe | 04:12 |
| mdorman | xavpaice: do yo uwork with james dempsey then too? | 04:12 |
| xavpaice | sorrison: if you head north at all, stop by | 04:12 |
| VW_ | he was actually trolling a VP from South Africa with his Allblacks flag in a meeting today | 04:13 |
| xavpaice | eyah | 04:13 |
| xavpaice | yeah, he sits next to me | 04:13 |
| xavpaice | within slapping range | 04:13 |
| mdorman | cool | 04:13 |
| sorrison | VM_ jealous, wish I was in England. Say hi to Tane for me | 04:13 |
| mdorman | anyways, headed out. have a good one all. | 04:13 |
| xavpaice | g'night | 04:13 |
| sorrison | See ya | 04:13 |
| klindgren | yea me 2 | 04:13 |
| klindgren | nite | 04:13 |
| *** mdorman has quit IRC | 04:14 | |
| VW_ | will do | 04:14 |
| *** hybridpollo has left #openstack-operators | 04:15 | |
| VW_ | thanks again all - this was a great meeting | 04:15 |
| serverascode | thanks all | 04:15 |
| VW_ | getting better every time. xavpaice, serverascode - please let me know what I can do to help you guys feel more integrated to the group | 04:15 |
| VW_ | sorry we can't shake hands and grab a drink in Tokyo, but soon | 04:16 |
| VW_ | ... | 04:16 |
| xavpaice | a percentage of meetings at this time of day certainly helps | 04:16 |
| xavpaice | I'll be at the ops sessions, hope to catch up with some people there at least | 04:16 |
| VW_ | awesome | 04:17 |
| xavpaice | haven't been since Atlanta (staff/budget constraints) | 04:17 |
| *** harshs has quit IRC | 04:29 | |
| *** stanchan has joined #openstack-operators | 04:40 | |
| *** VW_ has quit IRC | 04:47 | |
| *** VW_ has joined #openstack-operators | 04:47 | |
| *** fawadkhaliq has quit IRC | 04:50 | |
| *** vsedelnik has joined #openstack-operators | 04:55 | |
| *** harshs has joined #openstack-operators | 04:55 | |
| *** csoukup has quit IRC | 05:01 | |
| *** geoffarnold is now known as geoffarnoldX | 05:03 | |
| *** vsedelnik has quit IRC | 05:05 | |
| *** fawadkhaliq has joined #openstack-operators | 05:17 | |
| *** harshs has quit IRC | 05:22 | |
| *** Marga_ has quit IRC | 05:30 | |
| *** openstackgerrit has quit IRC | 05:31 | |
| *** openstackgerrit has joined #openstack-operators | 05:32 | |
| *** VW_ has quit IRC | 05:32 | |
| *** VW_ has joined #openstack-operators | 05:33 | |
| *** vsedelnik has joined #openstack-operators | 05:35 | |
| *** VW_ has quit IRC | 05:37 | |
| *** klindgren has quit IRC | 05:45 | |
| *** klindgren has joined #openstack-operators | 05:45 | |
| *** Marga_ has joined #openstack-operators | 05:48 | |
| *** sdake has quit IRC | 05:49 | |
| *** Marga_ has quit IRC | 05:49 | |
| *** zhangjn has quit IRC | 05:52 | |
| *** vsedelnik has quit IRC | 05:56 | |
| *** klindgren has quit IRC | 06:02 | |
| *** markvoelker has joined #openstack-operators | 06:03 | |
| *** zhangjn has joined #openstack-operators | 06:07 | |
| *** klindgren has joined #openstack-operators | 06:07 | |
| *** markvoelker has quit IRC | 06:07 | |
| *** Marga_ has joined #openstack-operators | 06:10 | |
| *** Marga_ has quit IRC | 06:16 | |
| *** Marga_ has joined #openstack-operators | 06:17 | |
| *** znc| has quit IRC | 06:25 | |
| *** kencjohnston_ has joined #openstack-operators | 06:30 | |
| *** Marga_ has quit IRC | 06:59 | |
| *** Marga_ has joined #openstack-operators | 07:00 | |
| *** matrohon has joined #openstack-operators | 07:10 | |
| *** Marga_ has quit IRC | 07:14 | |
| *** HenryG has quit IRC | 07:21 | |
| *** esker has joined #openstack-operators | 07:27 | |
| *** esker has quit IRC | 07:28 | |
| *** esker has joined #openstack-operators | 07:28 | |
| *** fawadkhaliq has quit IRC | 07:30 | |
| *** Marga_ has joined #openstack-operators | 07:35 | |
| *** Marga_ has quit IRC | 07:35 | |
| *** Marga_ has joined #openstack-operators | 07:35 | |
| *** fawadkhaliq has joined #openstack-operators | 07:36 | |
| *** resker has joined #openstack-operators | 07:57 | |
| *** esker has quit IRC | 08:00 | |
| *** markvoelker has joined #openstack-operators | 08:04 | |
| *** markvoelker has quit IRC | 08:08 | |
| *** HenryG has joined #openstack-operators | 08:12 | |
| *** derekh has joined #openstack-operators | 08:15 | |
| *** HenryG has quit IRC | 08:16 | |
| *** vsedelnik has joined #openstack-operators | 08:28 | |
| *** HenryG has joined #openstack-operators | 08:30 | |
| *** chlong has quit IRC | 08:47 | |
| *** gfa is now known as gfa_ | 09:16 | |
| *** gfa_ is now known as gfa | 09:16 | |
| *** markvoelker has joined #openstack-operators | 10:04 | |
| *** markvoelker has quit IRC | 10:10 | |
| *** fawadkhaliq has quit IRC | 10:15 | |
| *** vsedelnik has quit IRC | 10:44 | |
| *** vsedelnik has joined #openstack-operators | 10:46 | |
| *** zhangjn has quit IRC | 10:49 | |
| *** flwang has quit IRC | 10:53 | |
| *** fawadkhaliq has joined #openstack-operators | 10:55 | |
| *** vsedelnik has quit IRC | 11:00 | |
| *** flwang has joined #openstack-operators | 11:10 | |
| *** vsedelnik has joined #openstack-operators | 11:12 | |
| *** vsedelnik has quit IRC | 11:20 | |
| *** markvoelker has joined #openstack-operators | 11:21 | |
| *** markvoelker has quit IRC | 11:26 | |
| *** jaypipes has joined #openstack-operators | 11:28 | |
| *** vsedelnik has joined #openstack-operators | 11:34 | |
| *** klindgren has quit IRC | 11:36 | |
| *** klindgren has joined #openstack-operators | 11:43 | |
| *** zhangjn has joined #openstack-operators | 11:46 | |
| *** cdelatte has joined #openstack-operators | 11:48 | |
| *** deepthi has quit IRC | 12:04 | |
| *** chlong has joined #openstack-operators | 12:06 | |
| *** chlong has quit IRC | 12:07 | |
| *** chlong has joined #openstack-operators | 12:07 | |
| *** markvoelker has joined #openstack-operators | 12:20 | |
| *** jaypipes is now known as leakypipes | 12:48 | |
| *** fawadkhaliq has quit IRC | 12:50 | |
| *** fawadkhaliq has joined #openstack-operators | 12:59 | |
| *** fifieldt has quit IRC | 13:00 | |
| *** VW_ has joined #openstack-operators | 13:04 | |
| *** VW_ has quit IRC | 13:10 | |
| *** VW_ has joined #openstack-operators | 13:11 | |
| *** vsedelnik has quit IRC | 13:24 | |
| *** harshs has joined #openstack-operators | 13:25 | |
| *** vsedelnik has joined #openstack-operators | 13:30 | |
| *** geoffarnoldX is now known as geoffarnold | 13:36 | |
| *** alaski is now known as lascii | 13:41 | |
| *** openstackgerrit has quit IRC | 13:46 | |
| *** openstackgerrit has joined #openstack-operators | 13:47 | |
| *** markvoelker has quit IRC | 13:57 | |
| *** markvoelker_ has joined #openstack-operators | 14:00 | |
| *** Piet has quit IRC | 14:03 | |
| *** vsedelnik has quit IRC | 14:08 | |
| *** vsedelnik has joined #openstack-operators | 14:08 | |
| *** fawadkhaliq has quit IRC | 14:15 | |
| *** k_stev has joined #openstack-operators | 14:23 | |
| *** k_stev has joined #openstack-operators | 14:23 | |
| *** sdake has joined #openstack-operators | 14:27 | |
| *** vsedelnik has quit IRC | 14:30 | |
| *** vsedelnik has joined #openstack-operators | 14:31 | |
| *** david-lyle has quit IRC | 14:31 | |
| *** Piet has joined #openstack-operators | 14:40 | |
| *** csoukup has joined #openstack-operators | 14:48 | |
| *** harshs has quit IRC | 14:54 | |
| *** geoffarnold is now known as geoffarnoldX | 14:55 | |
| *** harshs has joined #openstack-operators | 14:55 | |
| *** vsedelnik has quit IRC | 14:56 | |
| *** vsedelnik has joined #openstack-operators | 14:57 | |
| *** mdorman has joined #openstack-operators | 14:58 | |
| *** vsedelnik has quit IRC | 15:03 | |
| *** harshs has quit IRC | 15:03 | |
| *** vsedelnik has joined #openstack-operators | 15:03 | |
| *** geoffarnoldX is now known as geoffarnold | 15:07 | |
| *** resker has quit IRC | 15:14 | |
| *** esker has joined #openstack-operators | 15:14 | |
| *** fawadkhaliq has joined #openstack-operators | 15:16 | |
| *** fawadkhaliq has quit IRC | 15:20 | |
| *** SimonChung1 has quit IRC | 15:24 | |
| *** fawadkhaliq has joined #openstack-operators | 15:27 | |
| *** emagana has joined #openstack-operators | 15:32 | |
| *** gyee has joined #openstack-operators | 15:42 | |
| *** harshs has joined #openstack-operators | 15:44 | |
| *** Marga_ has quit IRC | 15:48 | |
| *** vsedelnik has quit IRC | 15:54 | |
| *** emagana has quit IRC | 15:57 | |
| *** emagana has joined #openstack-operators | 16:02 | |
| *** VW_ has quit IRC | 16:14 | |
| *** VW_ has joined #openstack-operators | 16:15 | |
| *** Marga_ has joined #openstack-operators | 16:17 | |
| *** alop has joined #openstack-operators | 16:19 | |
| *** VW_ has quit IRC | 16:19 | |
| *** SimonChung has joined #openstack-operators | 16:24 | |
| *** derekh has quit IRC | 16:28 | |
| *** fawadkhaliq has quit IRC | 16:28 | |
| *** Marga_ has quit IRC | 16:29 | |
| *** matrohon has quit IRC | 16:31 | |
| *** Marga_ has joined #openstack-operators | 16:36 | |
| *** VW_ has joined #openstack-operators | 16:38 | |
| *** esker has quit IRC | 16:51 | |
| *** regXboi has joined #openstack-operators | 16:55 | |
| *** fawadkhaliq has joined #openstack-operators | 16:56 | |
| *** bvandenh has joined #openstack-operators | 16:56 | |
| *** harshs_ has joined #openstack-operators | 16:58 | |
| *** harshs has quit IRC | 17:01 | |
| *** harshs_ is now known as harshs | 17:01 | |
| *** vsedelnik has joined #openstack-operators | 17:06 | |
| *** vsedelnik has quit IRC | 17:08 | |
| *** bvandenh has quit IRC | 17:08 | |
| *** mdavidson has quit IRC | 17:11 | |
| *** vsedelnik has joined #openstack-operators | 17:15 | |
| *** zhangjn has quit IRC | 17:19 | |
| *** VW_ has quit IRC | 17:27 | |
| *** VW_ has joined #openstack-operators | 17:28 | |
| *** VW_ has quit IRC | 17:32 | |
| *** fawadkhaliq has quit IRC | 17:33 | |
| *** fawadkhaliq has joined #openstack-operators | 17:33 | |
| *** c_soukup has joined #openstack-operators | 17:41 | |
| *** csoukup has quit IRC | 17:44 | |
| klindgren | medberry, who on your side was looking at the lbaas stuff with a10's? | 17:47 |
| klindgren | We did a poc - and I found a number of issues that they are working on fixing and/or features that we wanted/needed | 17:47 |
| *** vsedelnik has quit IRC | 17:56 | |
| *** harlowja has quit IRC | 17:58 | |
| *** harlowja has joined #openstack-operators | 17:58 | |
| *** fawadkhaliq has quit IRC | 18:04 | |
| *** vsedelnik has joined #openstack-operators | 18:10 | |
| *** vsedelnik has quit IRC | 18:15 | |
| *** Piet has quit IRC | 18:55 | |
| *** harshs has quit IRC | 18:56 | |
| *** VW_ has joined #openstack-operators | 19:04 | |
| *** leitan_ has joined #openstack-operators | 19:16 | |
| klindgren | VW_, Did the cells patches for both us and NeCTAR | 19:17 |
| klindgren | https://etherpad.openstack.org/p/PAO-LDT-cells-patches | 19:17 |
| klindgren | sorrison, ^^ | 19:17 |
| VW_ | sweet - thanks klindgren | 19:17 |
| klindgren | mgagne, if you want to add any patches you have locally for cells ^^ | 19:17 |
| VW_ | I'll get some folks here to help me add to it | 19:17 |
| mgagne | I'll see what I've got | 19:18 |
| klindgren | I see like 30+ patches so far | 19:18 |
| klindgren | :-/ | 19:18 |
| *** vinsh_ has joined #openstack-operators | 19:18 | |
| klindgren | I also see some new patches we should probably pull in from NeCTAR | 19:18 |
| klindgren | too | 19:18 |
| *** vinsh has quit IRC | 19:21 | |
| klindgren | ok actually like 24 | 19:21 |
| mgagne | All I have is this patch I've been forward porting forever: https://review.openstack.org/#/c/59101/ | 19:22 |
| mgagne | which is here https://github.com/NeCTAR-RC/nova/commit/df268f50975e8cb802d4a801b9a58c9de188d4d4 :P | 19:22 |
| mgagne | so yea, nothing on my side for now | 19:23 |
| *** leitan_ has quit IRC | 19:23 | |
| klindgren | I htink you also have: https://github.com/NeCTAR-RC/nova/commit/240099b5bd8e7fa1d10a6ab45a6b32dd4d8a77f4 mgagne | 19:24 |
| klindgren | atleast - it has your name specifically on it :-) | 19:24 |
| *** vinsh_ has quit IRC | 19:24 | |
| mgagne | klindgren: I dropped it, it just doesn't work, so much got broken | 19:24 |
| *** vinsh has joined #openstack-operators | 19:24 | |
| klindgren | ah | 19:24 |
| mgagne | klindgren: I can't build an instance | 19:25 |
| mgagne | klindgren: and I just abandoned any hope to me it work. I'll just ask our other team to update to kilo and call it a day. | 19:25 |
| klindgren | I assume thats where all the juno scheduler support fixes came in the nectar stuff | 19:25 |
| mgagne | I guess so | 19:26 |
| klindgren | see - already getting additional patches that would/could have helped you | 19:27 |
| mgagne | :P | 19:27 |
| klindgren | but we - bascially aren't currently trying to run api cell with child cell -1 | 19:27 |
| mgagne | that's what I was trying to do =) | 19:27 |
| klindgren | IE kilo api cell, juno child | 19:27 |
| mgagne | it used to work | 19:27 |
| klindgren | yea | 19:27 |
| klindgren | I htink it was all the object porting | 19:28 |
| mgagne | yea... | 19:28 |
| mgagne | "sorry about that, cells are experimental" and now I'm a sad panda =( | 19:28 |
| klindgren | if htey are experimental the threshold for accepting patches should be much lower... imho | 19:37 |
| klindgren | I think the general consensus is that we aren't trying to get cells v1 to non-expermintal - we just want to limit the number of patches we are caring and in general getting some things to be "less broken" | 19:39 |
| klindgren | since we are looking at 1+ years before we have supported multiple childs cells in v2 | 19:40 |
| *** fawadkhaliq has joined #openstack-operators | 19:43 | |
| *** Piet has joined #openstack-operators | 19:43 | |
| *** sdake has quit IRC | 19:46 | |
| *** sdake has joined #openstack-operators | 19:53 | |
| *** elo has joined #openstack-operators | 19:54 | |
| *** derekh has joined #openstack-operators | 20:04 | |
| *** stanchan has quit IRC | 20:06 | |
| *** derekh has quit IRC | 20:06 | |
| *** cdelatte has quit IRC | 20:11 | |
| *** emagana has quit IRC | 20:22 | |
| *** elo has quit IRC | 20:22 | |
| *** VW_ has quit IRC | 20:31 | |
| *** VW_ has joined #openstack-operators | 20:31 | |
| *** VW_ has quit IRC | 20:36 | |
| *** k_stev1 has joined #openstack-operators | 20:44 | |
| *** fawadkhaliq has quit IRC | 20:44 | |
| *** VW_ has joined #openstack-operators | 20:45 | |
| *** k_stev has quit IRC | 20:47 | |
| *** k_stev1 has quit IRC | 20:48 | |
| *** k_stev has joined #openstack-operators | 21:01 | |
| *** k_stev1 has joined #openstack-operators | 21:09 | |
| *** k_stev1 has quit IRC | 21:09 | |
| *** k_stev1 has joined #openstack-operators | 21:09 | |
| *** k_stev has quit IRC | 21:10 | |
| *** chlong has quit IRC | 21:14 | |
| *** harshs has joined #openstack-operators | 21:15 | |
| *** stanchan has joined #openstack-operators | 21:42 | |
| *** regXboi has quit IRC | 21:52 | |
| *** c_soukup has quit IRC | 22:00 | |
| *** VW__ has joined #openstack-operators | 22:07 | |
| *** VW_ has quit IRC | 22:10 | |
| *** VW__ has quit IRC | 22:13 | |
| klindgren | Getting started on the Ops patches.... | 22:35 |
| klindgren | https://etherpad.openstack.org/p/operator-local-patches | 22:35 |
| klindgren | I have added every patch that GoDaddy is currently carrying and why | 22:36 |
| klindgren | Please to add your local patches to the etherpad! | 22:36 |
| *** markvoelker_ has quit IRC | 22:36 | |
| *** sdake_ has joined #openstack-operators | 22:40 | |
| *** sdake has quit IRC | 22:43 | |
| *** geoffarnold has quit IRC | 22:46 | |
| *** openstackgerrit has quit IRC | 22:46 | |
| *** openstackgerrit has joined #openstack-operators | 22:47 | |
| *** sdake has joined #openstack-operators | 22:48 | |
| *** mdorman has quit IRC | 22:51 | |
| *** sdake_ has quit IRC | 22:51 | |
| *** alop has quit IRC | 22:54 | |
| *** elo has joined #openstack-operators | 23:10 | |
| *** esker has joined #openstack-operators | 23:15 | |
| *** leakypipes has quit IRC | 23:22 | |
| *** esker has quit IRC | 23:22 | |
| klindgren | mgagne, mfisch, jlk, sorrison if you get a chance: https://etherpad.openstack.org/p/operator-local-patches | 23:23 |
| klindgren | xavpaice, serverascode ^^ as well | 23:23 |
| *** elo has quit IRC | 23:24 | |
| * xavpaice will attempt to add, but is embarrassed at patches which should be upstream ;) | 23:27 | |
| klindgren | xavpaice, thats part of the point of this. I am pretty sure we could upstream some of our patches, but we use the "this is limited to us/our implementation" excuse on some of them | 23:29 |
| jlk | oh boy | 23:29 |
| klindgren | I think some of the other stuff is we might have patches that we tried to upstream, but some are stuck at needing unit tests. If thats the case if someone needs/has the same patches we might hopefully be able to get people to help write units tests | 23:32 |
| klindgren | we have a few patches in that state | 23:32 |
| xavpaice | +1, did you see what I just wrote on that etherpad? | 23:32 |
| klindgren | yep - thats why I said it :-) | 23:33 |
| klindgren | haha | 23:34 |
| klindgren | what custom pollsters do you have that aren't suiteable for upstream? | 23:34 |
| xavpaice | I don't understand the full details (E_NOTADEV) but it's pollsters for instance state and details iirc | 23:35 |
| xavpaice | all for billing | 23:35 |
| klindgren | someone may want that :-) | 23:35 |
| xavpaice | but when we discuss that upstream we are rightfully told that ceilometer isn't a billing tool | 23:35 |
| xavpaice | it's metering | 23:35 |
| xavpaice | and so far, with our tiny install, we're finding scalability of ceilometer to be severely limiting | 23:36 |
| klindgren | I know I would have liked to have a patch to set a new state of vm's that is its running, but its still doing provisioning tasks in the OS | 23:36 |
| klindgren | but that would require the VM to call out to nova somehow and say "I am really ready" | 23:36 |
| xavpaice | would be nice, but I'd still want to charge from startup rather than once provisioning is done | 23:36 |
| klindgren | we dropped ceilometer | 23:37 |
| xavpaice | depends, I guess, if you're selling VMs or the services that run on them | 23:37 |
| *** markvoelker has joined #openstack-operators | 23:37 | |
| xavpaice | what do you use instead? | 23:37 |
| klindgren | took minutes to list possible resource | 23:37 |
| klindgren | or whatever ceilometer called them | 23:37 |
| klindgren | we don't really have anything super great. We have looked at usign stacktack in the past | 23:38 |
| klindgren | but we are working on showback for the cloud vs's charge back | 23:38 |
| xavpaice | yeah, I put stacktach in a little while ago and thought it looked great, but I didn't have time to figure it out to make it useful | 23:38 |
| klindgren | our public cloud offering is using a totally different UI/API on top openstack and they are handing that logic there. | 23:39 |
| xavpaice | yeah, I suspect your business is quite differen to ours | 23:39 |
| xavpaice | I have to go do saturday morning family stuff, will take another look at that etherpad later on | 23:39 |
| *** esker has joined #openstack-operators | 23:41 | |
| *** markvoelker has quit IRC | 23:42 | |
| *** esker has quit IRC | 23:46 | |
| *** stanchan has quit IRC | 23:49 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!