16:00:01 #startmeeting Cinder 16:00:02 Meeting started Wed Jan 13 16:00:01 2016 UTC and is due to finish in 60 minutes. The chair is smcginnis. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:00:04 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:00:06 The meeting name has been set to 'cinder' 16:00:10 o/ 16:00:12 hi 16:00:13 Courtesy ping: dulek duncant eharney geguileo winston-d e0ne jungleboyj jgriffith thingee smcginnis hemna xyang tbarron scottda erlon rhedlind vincent_hou kmartin patrickeast sheel 16:00:16 hi 16:00:17 hi 16:00:17 o/ 16:00:20 hi 16:00:20 hi 16:00:22 hi 16:00:23 o/ 16:00:23 Hello 16:00:23 smcginnis: Thanks 16:00:25 Hi 16:00:26 hi 16:00:29 hi 16:00:32 geguileo: ;) 16:00:34 Hi 16:00:37 Hi everyone.. 16:00:44 o/ 16:00:45 Hello. 16:00:49 hi 16:00:50 Nice, looks like a good turnout today. :) 16:00:51 Hello :) 16:00:55 hi 16:00:57 #topic Announcements 16:01:09 hi 16:01:11 hi 16:01:13 At least a turnout. :-) 16:01:33 Reviewers, please take a look at the spec tracking/review priority etherpad. 16:01:39 #link Spec tracking https://etherpad.openstack.org/p/mitaka-cinder-spec-review-tracking 16:01:47 Some good progress there. 16:02:19 #info Bugstats: Cinder-462, cinderclient-36, os-brick-13 16:02:23 o/ 16:02:28 Would like to mention the cross-project spec liaison group is coming together. I'm assuming diablo_rojo would be representing cinder https://review.openstack.org/#/c/266072/ 16:02:33 Those numbers just seem to hold steady. 16:02:43 thingee: Correct 16:02:56 thingee: Thanks! Yep, she's volunteered. :) 16:03:33 Forward looking to the agenda, but please take a peek at the midcycle planning: 16:03:38 #link Midcycle planning https://etherpad.openstack.org/p/mitaka-cinder-midcycle 16:04:03 Add your info if you are going, and make sure to add any topics a little ways down the page. 16:04:30 We have a nova<>cinder time reserved Wednesday morning Raleigh time, Wednesday evening Bristol UK. 16:04:45 great 16:04:50 what time is that wed night in bristol? 16:05:00 scottda will have more to say about that shortly. 16:05:14 Exact time is not set yet 16:05:15 mriedem: I'm not sure if we locked down a specific time. 16:05:16 Mitaka 2 is jan 19-21 16:05:38 we'll get TheJulia from Ironic there too 16:05:39 I'll check with johnthetubaguy later, unless someone else beats me to it. 16:05:49 sure, just should be before 5pm :) 16:05:53 else we'll be pub crawling 16:05:58 #info M-2 coming up January 19 16:05:59 :) 16:06:12 mriedem: Fair point! :) 16:06:27 Make sure folks are aware of the deadline with M-2. 16:06:27 mriedem: Hmmm, Cinder isn't the only group that does that? ;-) 16:06:33 Jan 31 longer delays with gate ci testing 16:06:50 thingee: Very good point. Don't wait until the end!!! 16:07:00 Due to sunsetting of a public cloud that infra uses 16:07:15 all this and more on the dev digest http://www.openstack.org/blog/2016/01/openstack-developer-mailing-list-digest-20160108/ 16:07:31 thingee: Ah, right in the M-3 period… :( 16:07:31 #link Infra changes https://etherpad.openstack.org/p/mitaka-cinder-midcycle 16:07:35 thingee: Thanks! 16:07:58 diablo_rojo: Want to cover a little cross-project stuff? 16:08:06 mriedem: smcginnis: I hadn't picked the time yet, good point, when did you folks want to start? lets pick then? (+1 for before 5pm!) 16:08:10 smcginnis: Yeah sure. 16:08:17 #link The Women of OpenStack are looking for mentors. Technical and Career both. If you are interested, here is the link: https://docs.google.com/forms/d/1YQITea0ygvusZAeRdR6jL1VUfaNcZTCr2UqHTFSsxR4/viewform?c=0&w=1 16:08:18 diablo_rojo: OK, hold a sec. 16:08:26 diablo_rojo: Sorry. :) 16:08:31 smcginnis: No worries :0 16:08:32 hello 16:08:34 :) 16:08:38 johnthetubaguy: Looking up the time difference now. 16:08:46 5 hours 16:08:47 we could sort out that time thing after the meeting... 16:08:54 doens't take 500 people to sort that out 16:09:09 johnthetubaguy: I wanted to address the lack of items to discuss with NOva. This is on today's agenda. So let's wait a bit on setting time... 16:09:10 mriedem: Just a quick look, but yeah. 16:09:31 johnthetubaguy: Probably do something like 9 AM EST then. But we can sort that out later I guess. 16:09:34 it's 4pm in bristol at 11am in RTP 16:09:43 johnthetubaguy: Don't want to make you guys stay late. 16:09:45 yeah, so 9am RTP and 2 pm bristol 16:09:59 yeah, that works 16:10:02 lets do that 16:10:03 OK, tentative schedule 9am/2pm. 16:10:11 johnthetubaguy: Perfect. Thanks John. 16:10:16 ahem 16:10:34 diablo_rojo: OK, sorry. Please go ahead. 16:10:54 Cool. As I was saying :) The Women of OpenStack are looking to build up the community and help newcomers get more integrated. So if you are interested please fill out the google form. 16:11:10 #link Mentor sign up https://docs.google.com/forms/d/1YQITea0ygvusZAeRdR6jL1VUfaNcZTCr2UqHTFSsxR4/viewform?c=0&w=1 16:11:23 diablo_rojo: Day before the summit official starts? 16:11:40 anyone can mentor? 16:11:44 hemna: yes 16:11:52 hemna: Not you though. :P 16:11:54 jk 16:11:56 :) 16:12:04 lead by bad example! 16:12:09 hah 16:12:23 speaking of pub crawls.... 16:12:26 Other things from the cross project meeting, Cinder will need to choose an API liason 16:12:32 hemna: +2 16:12:41 other wise it will default to our fearless leader smcginnis :) 16:12:54 https://review.openstack.org/#/c/266072/ 16:13:05 I'm OK with it, but if someone is interested in doing it that would be great. 16:13:21 There has been a little bit of discussion in the ML about it 16:13:28 #link http://lists.openstack.org/pipermail/openstack-dev/2016-January/083927.html 16:13:28 #link Cross project spec team https://review.openstack.org/#/c/266072/ 16:14:11 diablo_rojo: Cool, anything else to cover? 16:14:16 Yes 16:14:18 sorry 16:14:23 lots of links 16:14:42 There are three notable specs that are out there right now that should get checked out: 16:14:50 https://review.openstack.org/#/c/243348/ https://review.openstack.org/#/c/236712/ https://review.openstack.org/#/c/226157/ 16:15:03 Thanks thingee for pointing them out :) 16:15:24 So if cores could go take a look at those at some point and review, that would be most helpful. 16:15:45 the first deprecates our cli in favor of openstack client 16:15:48 Yeah, all of those could use some feedback and at least broader awareness. 16:16:02 which is something that has been agreed on at previous summits I believe in cross-project sessions that is 16:16:25 oofa 16:16:32 OK, folks take a look. 16:16:35 I would say the last one more applies to people here, which is talking about our backwards compatibility for libraries 16:16:38 hemna: ^ 16:16:44 so that's cool, but that also means we are going to have to start working on 2 clients at the same time. 16:16:47 fwiw 16:16:59 Oy 16:17:01 features, fixes, etc 16:17:15 shouldn't do new features to the old cli 16:17:17 right 16:17:21 only python API fixes 16:17:30 I'm sure we could talk about these three the whole hour, so I'm going to move on. ;) 16:17:33 diablo_rojo: Anything else? 16:17:34 b/c nova still uses the cinderclient python api 16:17:38 smcginnis: yes please 16:17:41 One more thing :) 16:17:45 yah, we can't just stop working on cinderclient 16:17:48 that's not going to work 16:17:51 * thingee puts on top hat and tap dances off stage 16:17:56 :) 16:18:12 mriedem, horizon also 16:18:29 There are still more details to come, but there will be a Hackathon on Feb 29th and basically what is being asked is just that we compile a list of bugs for people to take a look at and then review things as quickly as possible. 16:18:40 Oh yeah! 16:18:45 I wanted to make sure to mention that. 16:18:57 smcginnis: And no we can't just give the whole list of bugs ;) 16:18:58 Kind of a global bug day. 16:19:06 diablo_rojo: Aww man 16:19:16 smcginnis: Right, it came out of the China Hackathon? 16:19:28 I believe so, led by Huawei. 16:19:37 smcginnis: Yes, that sounds right. 16:19:51 So if anyone is interested in doing some quick bug skimming... 16:19:51 I heard it was 2nd March ~ 4th March. 16:20:03 Any links or anything for it? 16:20:56 If anyone can scan through the bugs and start tagging ones that look like good candidates, that would be great. 16:20:56 No links yet, I can go back through the logs and see who was working on organizing it though. 16:20:56 winston-d: That sounds right. 16:20:56 patrickeast: Just more of a general heads up right now, but I will send you stuff when I find it :) 16:21:05 OK, we better get moving. 16:21:13 Okay, now I'm done :) 16:21:16 #topic Virtual Meeting with Nova during mid-cycle 16:21:22 We can maybe spend a little time at the mid-cycle organizing bugs for that? 16:21:24 Hi 16:21:24 scottda: Hey 16:21:31 jungleboyj: Good idea! 16:21:40 * jungleboyj adds it to the agenda 16:21:45 So, as mentioned above, we've a virtual meeting with Nova during the mid-cycle scheduled. 16:22:09 But, so far, there is nothing on our mid-cycle etherpad that merits a cross-service discussion. 16:22:23 nova has things 16:22:30 I'm thinking we should have some concrete items on the agenda that need to be discussed. 16:22:37 mriedem: OK. multi-attach? 16:22:38 * jungleboyj has an item to add 16:22:41 https://etherpad.openstack.org/p/mitaka-nova-midcycle 16:22:45 see the cinder section in there 16:22:54 mostly right now it's privsep in os-brick and multiattach 16:23:05 scottda: The few topics we do have on the etherpad are mostly nova related. 16:23:11 L47 16:23:17 Cool. I'm just trying to get folks to think about this and put them on the agenda 16:23:24 #link nova midcycle https://etherpad.openstack.org/p/mitaka-nova-midcycle 16:23:34 scottda: the DRBD transport touches both Cinder and Nova... Is that a point to discuss, or is that too small a detail? 16:23:34 #link cinder midcycle https://etherpad.openstack.org/p/mitaka-cinder-midcycle 16:24:06 It's worth discussing things that require agreement, or sharing of info, or are contentious 16:24:15 so I spoke with gus last week about privsep and he was blocked 16:24:35 I think I was able to help him move forward at least in theory with privsep -> os-brick 16:24:41 well, "agreement" as in +2, yeah ;) 16:25:06 So I'd like to firm up an agenda next week so we are prepared to use the time wisely 16:25:15 scottda: +1 16:25:18 but I still think it will be a miracle to get privsep full implemented for os-brick in M. 16:25:25 that's it. We can move on. 16:25:38 hemna: I will be very surprised if it does. :{ 16:25:41 scottda: Thanks! 16:25:43 hemna: please, ping me if you need any help on this 16:25:54 #topic Nested Quota enforcement issue 16:25:59 mc_nair: Hey 16:26:02 hey 16:26:11 while looking into https://bugs.launchpad.net/cinder/+bug/1531502, we noticed that we can't actually enforce child default quota values because we can't grab parent_project_id as part of something like the create volume flow (because user may not be an admin) 16:26:12 Launchpad bug 1531502 in Cinder "Child project's default quota not enforced" [High,New] - Assigned to Ryan McNair (rdmcnair) 16:26:26 I talked with raildo and we were thinking of listening for the keystone project create event notification and explicitly creating a cinder quota for the new project at that point 16:26:44 if anyone has feedback on the suggested approach / comments about the problem it’d be much appreciated 16:27:02 mc_nair: Do we have parent_project_id in the context? 16:27:03 hey :) 16:27:09 rm -rf quotas 16:27:13 dulek: no, we don't 16:27:15 :) 16:27:19 mc_nair: Too fragile - events can get lost 16:27:37 mc_nair: Shouldn't it be there? 16:27:39 DuncanT: that's what I was worried about, so that's good to know 16:27:43 mc_nair: This whole nested quotas thing has been a disaster, I'd honestly be tempted to say pull it and rethink 16:27:44 Yeah, seems like there's got to be a better way. 16:27:48 dulek: no, we have a token size issue, and for now, we can't add more information directly on the context. 16:28:05 yeah, the event notification idea doesn't sound like the right route 16:28:27 good to know 16:28:28 Event notification, even if it was reliable, is still racy. Nak 16:29:16 Anyone know a route mc_nair can look in to for this? 16:29:24 so then if we're not able to add parent_project_id to the token I guess we're stuck with busted child quota default vals until we rethink things? 16:29:34 Or should we add this as a topic to the midcycle to rethink nested quotas? 16:29:35 mc_nair: Isn't Nova implementing nested quotas in this release? 16:29:50 dulek: yea, but they're going to hit the same problem with their current approach 16:29:51 mc_nair: Have we verified that it isn't agreeable to add the parent_project_id to the token? 16:29:54 Or any other project? We probably share same problems. 16:30:01 dulek: we have some patches, very similar with the cinder implementation, it is in code review 16:30:02 mc_nair: So -1 the approach. ;) 16:30:38 jungleboyj: well raildo was saying there's a limit to the info you can add to the token and right now Keystone won't let anything else be added to it 16:30:46 dulek: will do :) 16:30:46 we can try talk with the keystone guys, to explain why we need the parent_id on the token, and maybe we can propose it 16:30:52 mc_nair: Boooo. 16:30:59 mc_nair: Ok, thanks for chasing that idea. 16:31:01 smcginnis: I think adding it to the midcycle agenda is worthwhile, it's currently a mess, and shouldn't, in hindsight, have been merged as is 16:31:23 DuncanT: It does sound like it could use some more discussion at least. 16:31:29 I'll add that. 16:31:41 mc_nair: Or just let a normal user get their parent project id from keystone, and we'll ask keystone when we need it 16:32:07 mc_nair: The status quo of needing admin is daft 16:32:14 DuncanT: +1 16:32:25 smcginnis: +2 Thanks. This is high priority for us to get addressed. 16:32:38 mc_nair: We do have the concept of a service user that could probably be used, but that feels ugly 16:33:07 DuncanT: ++ I think that use the service user would be easier to fix the problem 16:33:11 DuncanT: alright, yea will chase that as well. Letting non-admin retrieve parent would work assuming we could work that through keystone 16:33:36 mc_nair: Awesome. Enough to go on for now? 16:33:48 smcginnis: yes sir - thanks for the info everyone 16:33:52 mc_nair: Thanks! 16:33:54 mc_nair: Adding it to the token removes the need for an extra callout to keystone though, so would be very preferable 16:33:59 #topic Summary Messages to be displayed for success/failure in cinder operations 16:34:04 sheel: You're up. 16:34:13 smcginnis:yes 16:34:16 i am there 16:34:32 hi everyone 16:34:36 Its regarding https://blueprints.launchpad.net/cinder/+spec/summarymessage 16:34:48 where i am propsing to display error messages in details atleast to admin 16:35:04 When someone performs some operation like create volume, delete volume etc, if operation fails - user gets no specific information about why operation failed...just operation status is updated and shown as failed... One need to debug logs and other details to find the issue. 16:35:10 i feel like this needs to be tied into the async error reporting proposal that's been floating for a while now 16:35:27 eharney: ++ 16:35:30 the overall idea is right, but we've already looked into this a bit 16:35:34 eharney: ++ 16:35:35 eharney: Is there a spec out there for that, or has that just been talked about? 16:35:41 i think discussion about that is listed for the midcycle 16:35:45 smcginnis: there was a spec a while ago 16:35:50 not sure there has been an active one recently 16:36:11 but it's a feature i'm quite interested in getting, so maybe we'll figure out at the midcycle what needs to happen to get that rolling again 16:36:34 eharney: This seems like a cross project thing. 16:36:39 Not that cinder can't lead it. 16:36:44 ehh 16:36:53 smcginnis: That has been discussed in the cross project meetings before. 16:36:59 the discussion started going that way before, i think, and we ended up kinda fizzling out and not doing anything 16:37:05 IMO we need to just implement it and then see where it goes 16:37:16 eharney: Fair point. :) 16:37:29 because it's not something that couldn't be spread and adapted over time to other projects 16:37:38 Nova has "instance actions" to help report async errors, if that helps? 16:37:41 Might be good to get something in cinder, then use that as an example for other projects that need to do async error reporting. 16:37:52 but thats a REST API, rather than an async API 16:37:58 eharney: Yeah, we need to do something. :-) 16:38:01 johnthetubaguy: That just shows the last error though, doesn't it? 16:38:18 DuncanT: no, shows previous actions, and there previous errors, based on request-id, I believe 16:38:35 johnthetubaguy: Ah, ok, thanks, I'll go look 16:38:41 johnthetubaguy: Sounds like what we need. Thanks! 16:39:00 so it does have some issues we keep wanting to fix 16:39:09 it doesn't really tell the users when something is finished 16:39:10 http://developer.openstack.org/api-ref-compute-v2.1.html#os-instance-actions-v2.1 16:39:30 sheel: So something to look into ^^ 16:39:37 but, yeah, it might help with ideas 16:39:41 smcginnis : sure, i will follow up 16:39:47 i'll be sure it's listed for the midcycle, ameade was on the list to attend i think, so we can kick things off there 16:39:49 alaski is a good contact to chat with about that 16:40:10 https://etherpad.openstack.org/p/kilo-cinder-async-reporting this one? 16:40:14 johnthetubaguy: If we can all work on one pattern that would be good. 16:40:21 smcginnis, +1 16:40:27 o/ 16:40:28 lol 16:40:34 in the manila midcycle atm 16:40:36 mtanino: yes 16:40:52 smcginnis: +1 something for the API WG guidlines 16:41:21 #link Past discussion https://etherpad.openstack.org/p/kilo-cinder-async-reporting 16:41:21 ameade: where did it got? I mean why it didn't go further? 16:41:28 i can share my thoughts around async error reporting 16:41:34 #link Nova approach http://developer.openstack.org/api-ref-compute-v2.1.html#os-instance-actions-v2.1 16:41:40 erlon: nobody implemented it, I haven't had the bandwidth 16:41:49 ameade: hmm 16:41:53 i think it's the single most important feature of openstack atm 16:41:57 for* 16:42:09 sheel: :) 16:42:29 erlon: so I can take this BP ahead 16:42:51 smcginnis : right? 16:43:14 sheel: +1 16:43:23 sheel: That would be great! We could definitely use this. 16:43:34 sheel: Anything else at the moment? 16:43:36 i'll see what kind of bandwidth exists here to help on this, i'd like to if i can 16:43:42 lets talk about it at the midcycle, i will be there 16:43:47 ameade: +1 16:43:48 ameade: yes 16:43:51 would love for folks to commit to working on it 16:43:53 smcginnis : thank you, please approve BP 16:44:07 sheel: Will do. :) 16:44:15 eharney: sure, we will work together... 16:44:26 #topic Open Discussion 16:44:28 eharney : thanks for extended help and your interest 16:44:31 o/ 16:44:36 Vincent put an item on the agenda, but he's not here. 16:44:38 Just one thing I'd like to raise. We need some help to review this (Hitachi) driver, to make it ready for M2. 16:44:43 sheel: I'm interested in this too :) 16:44:45 I'll just say, congrats Vincent. 16:44:47 :) 16:44:50 https://review.openstack.org/#/c/255239/ 16:45:03 mtanino: sure 16:45:20 erlon: You want to talk about that one? 16:45:45 smcginnis: you gave a quick review, if you have a change and review it trougly 16:45:56 erlon: Will do. 16:45:58 * jungleboyj laughing 16:46:06 Hadn't seen that he put that on the agenda. 16:46:16 jungleboyj: Pretty funny. :) 16:46:24 Yeah, Vincent is now in RTP and is very excited to be in the US time zone and able to work in real time. 16:46:25 oh! congrat Vincent. 16:46:27 smcginnis: so, its a refactory, big, but need more core reviews 16:46:33 erlon: That blueprint was a little misleading that it doesn't really call out there is a new driver as part of that. 16:46:38 welcome to the area Vincent :) 16:46:46 congrats Vincent. :) 16:46:49 He will be at the midcycle and be able to get back on the Storwize patches. 16:46:56 hi. just a small request. If you could review the cinder windows drivers refactor with os-win patch, I'd greatly appreciate it. :) https://review.openstack.org/#/c/243565/10 16:47:10 erlon, the Hitachi HBSD2 CI is failing on it 16:47:17 claudiub: Tab opened... 16:47:22 it would be great if it could make it into M-2. :) 16:47:22 claudiub: i've had that one on my radar, will try to take a look soon 16:47:34 I would like to ask for a bit of review bandwidth for the DRBD transport - if the Cinder side was merged, I think it's easier to get the Nova side in. https://review.openstack.org/#/c/259973/9 16:47:35 oh, i have something to bring up 16:47:39 kmartin: yes, we are working on it, but folks can still review while we get that stable 16:47:41 great, thanks folks. :) 16:47:42 (Even if that is just a copy of an existing driver) 16:47:43 is there any interest in turning on the image cache for the cinder gate w/ lvm? 16:48:08 patrickeast: Seems like we should for coverage. 16:48:11 IMO 16:48:14 yea 16:48:19 patrickeast: probably good in some capacity, but i assume we'd need jobs with and without it? 16:48:32 patrickeast: Seems like a good idea. 16:48:33 i turned it on in the pure ci after it got broken from some object changes 16:48:39 eharney: yea probably 16:48:44 eharney: Before it's cached it will be without it, right? So we kind of get coverage for both? 16:49:04 smcginnis: true, but the code paths are a tiny bit different 16:49:11 patrickeast: True 16:49:16 smcginnis: i dunno, just thinking about rooting out issues related to glance interaction etc 16:49:24 imo its probably better with it turned on vs turned off as far as total coverage of code 16:49:24 eharney: Yeah, fair point. 16:49:26 but still a gap 16:49:35 * smcginnis tends to cut corners on testing 16:49:40 :} 16:49:54 smcginnis: Should strike that from the record. 16:50:09 we could do something like turn it on for the LIO/thin job and leave it on for the tgt/thick job, since that split already exists 16:50:10 jungleboyj: Yeah, I probably should have stated that. :D 16:50:12 not sure 16:50:33 Oh no, followed by a Freudian Slip! 16:50:39 * smcginnis tends to look for ways to safely cut corners on testing 16:50:50 jungleboyj: How's that> ^^ :) 16:50:52 leave it off* 16:51:13 so maybe for now i'll put something on my backlog to get the devstack changes or plugin pulled into the official repos so we could turn it on 16:51:18 eharney: That seems reasonable. 16:51:19 and once thats ready we can figure out where to enable it 16:51:31 patrickeast: That would be awesome. 16:51:41 patrickeast: sounds good 16:52:07 8 minutes 16:52:14 Any other topics to cover? 16:52:16 eharney: Sounds like a good plan. 16:52:31 patrickeast: Looks like nikhil is the primary contact for information thus far for the Hackathon. Looks like jroll and rockyg may also have info on it maybe. 16:52:44 diablo_rojo: cool, thanks! 16:52:51 patrickeast: No problem :) 16:52:59 Just FYI, I think we are looking at doing Thunderbirds for dinner on Thursday night. 16:53:14 Oh, some specs could use some reviews. Too late for many, but I think there are a few that could still make it in M. 16:53:28 jungleboyj: Should I add that to the etherpad? 16:53:41 diablo_rojo: Sure. That would be good. 16:54:32 Wednesday is still open for any companie that want to bribe^D^D^D^D^Dfeed us. 16:54:45 bwah ha ha! 16:54:53 Totally joking 16:55:11 smcginnis, technically I think I have to report you to the dell ethics committee. 16:55:13 can PTLs be impeached? 16:55:18 Hahah 16:55:27 smcginnis: careful with the mushroom food. 16:55:27 Too bad Dell just spent all their money... 16:55:29 I'm getting myself in all kinds of trouble today. :) 16:55:42 smcginnis: sorry to cut into 16:55:45 scottda: Hah! 16:55:47 scottda: +1 16:55:50 sheel: Please do. 16:55:53 smcginnis: could you please review https://review.openstack.org/#/c/265820/ 16:56:05 final +2 left for merge 16:56:16 sorry, I know you have already got too many requests :( 16:56:28 scottda, Dell spent ALL the money. 16:56:40 sheel: Will take a look. 16:56:44 sheel: i'll review that one, i started on it the other day 16:56:52 something about it looked odd to me, need to check it 16:56:55 OK, I think we past the point of any productivity a while back Thanks everyone. 16:56:58 eharney : thats great.. thank you very much 16:57:04 question. I have some changes to make to my driver still. what's the deadline to get them into gerrit? do we have that on a page somewhere? 16:57:11 smcginnis: thank you 16:57:18 Good meeting. Thanks everyone! 16:57:30 rhedlind: M-3 for changes. 16:57:33 #endmeeting