16:08:41 #startmeeting Cinder 16:08:41 Meeting started Wed Apr 13 16:08:41 2016 UTC and is due to finish in 60 minutes. The chair is smcginnis. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:08:43 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:08:45 The meeting name has been set to 'cinder' 16:08:51 ntpttr: Thanks! 16:08:52 meetbot cometh 16:08:55 #topic Announcements 16:08:55 ditto 16:09:02 #link http://lists.openstack.org/pipermail/openstack-dev/2016-April/092104.html Midcycle planning 16:09:13 Who knew a bot could be so exciting? 16:09:16 Am I supposed to say "hello" again now that it's start? :D 16:09:24 started* 16:09:30 I also have most of the schedule entered for the Summit: 16:09:37 #link https://www.openstack.org/summit/austin-2016/summit-schedule/global-search?t=Cinder%3A+ Summit Cinder Track 16:09:48 baumann: i think you just did, even if it's quoted 16:10:07 :) 16:10:15 #link https://etherpad.openstack.org/p/newton-cinder-summit-ideas Planning etherpad 16:10:23 oh baumann 16:10:26 Still add things to the etherpad if you think of additional topics. 16:10:43 We have Friday to work through any smaller topics. 16:10:53 smcginnis: Looks like we have one more working session left? 16:10:55 There is also a work session on Thursday that I've kept open so far. 16:10:56 The summit app hasn't been working for me. Has anyone else tried it yet? 16:11:00 dulek: Yep. 16:11:18 Thinking of designating that an unconference like Nova does if we don't have a big enough topic to allocate to that. 16:11:23 Last time we needed to vote which sessions go in, what happened this time? 16:11:25 I'm sure we'll fill the time on something. 16:11:35 I could just mark that as the "bikeshed" session. :) 16:11:46 smcginnis: That unconference thing works well 16:11:49 dulek: Oh, did we vote? 16:12:02 scottda: I do like the idea. 16:12:04 Lotsa stuff only takes 5-10 minutes to discuss 16:12:11 smcginnis: At least there were more sessions than slots, so we've pushed a lot for Friday. 16:12:27 dulek: Yeah, does seem like we had a lot more last time around. 16:12:39 Not sure if that's good or bad. :) 16:12:58 #topic NFS Snapshots Status 16:13:00 eharney: Hey 16:13:04 hey 16:13:12 just wanted to give a general update / request for help here 16:13:26 this feature is mostly there now, at least according to CI (which is now in "check experimental") 16:13:51 i suspect there are a few small things to hammer out still, and i don't have a ton of time budgeted for this 16:14:03 so now is a good time for interested parties to help try it out and see how solid it looks 16:14:19 eharney: It would be nice to get that working. 16:14:19 oh yeah: https://review.openstack.org/#/c/147186/ 16:14:30 #llink https://review.openstack.org/#/c/147186/ 16:14:37 #link https://review.openstack.org/#/c/147186/ 16:14:42 eharney: you still marked WIP 16:14:55 for background, my current worry is that libvirt on Ubuntu trusty is kind of old and maybe missing some of the ideal-case code this uses 16:14:58 xyang1: because of this ^ 16:15:03 WIP doesn't mean don't review it! 16:15:29 so i'm going to try to figure out what's going on with trusty, but general checking would be helpful 16:15:36 that's about it 16:15:42 eharney: Thanks! 16:15:51 #topic List manageable volumes and snapshots 16:15:56 avishay: Hi 16:16:00 Hey everyone 16:16:08 I'm working on a feature that lists volumes and snapshots available for the 'manage-existing' APIs. Basically the driver will query the backend and return metadata regarding which volumes are available to manage. 16:16:15 The spec is already merged and the code is up for review. 16:16:21 #link https://review.openstack.org/#/c/285296 16:16:29 There were two main issues brought up. The first, by Sean, is to move the manage-existing APIs from contrib to /v3. Thoughts? 16:16:54 avishay: We want to move all extensions to core, and soon 16:16:56 that sounds reasonable to me 16:17:03 avishay: +1 16:17:05 so that we can microversion changes... 16:17:13 and because many of them should be in core. 16:17:16 should we move it to core as a new microversion? 16:17:26 avishay: Thanks for working on that. A good add. 16:17:36 e0ne: I don't think it needs a new microvesion 16:17:38 Will there be no more extensions? 16:17:44 avishay: +1 on moving to core 16:17:54 scottda: It should be a microversion.... the API changed 16:18:02 scottda: According to "do we need a new microversion" adding a new endpoint requires a microversion. 16:18:11 DuncanT: +1 16:18:17 avishay: Nova have said no extensions at all. Their reasoning was fairly sound 16:18:20 DuncanT: +1 16:18:24 DuncanT: OK, I need to review it. 16:18:26 OK, sounds good 16:18:38 AFAIR, we add every new API as microversion 16:18:40 smcginnis: according to what you saw, no microversion is necessary? 16:18:43 So new APIs should go to core and not to contrib? 16:18:51 #link http://docs.openstack.org/developer/cinder/devref/api_microversion_dev.html#when-do-i-need-a-new-microversion 16:18:52 geguileo: Yes 16:19:00 geguileo: yes 16:19:00 avishay: I thought according to the "do I need to microversion" decision tree it did not. 16:19:06 But I could certainly be wrong. 16:19:14 we're gonig to migrate all extensions to microversions 16:19:16 avishay: Microversion is for moving the API into core 16:19:18 Still new enough I think we are figuring a little out as we go and learning. 16:19:21 * geguileo missed that announcement :-( 16:19:39 If we move the API to core, it would need a microversion 16:19:40 smcginnis: yep 16:20:03 OK I'll figure that all out and post a new version, thanks for that feedback all 16:20:24 avishay: Thanks, I do think it's a good addition. Appreciate you working on it. 16:20:26 The second issue, brought up by both DuncanT and smcginnis has to do with the amount of data returned. The API doesn't support paging because the data about volumes on the backend is supplied by the driver querying the backend, and not from the DB as is usual. 16:20:35 smcginnis: fo sho 16:20:47 The best solution I can think of is to pass the sorting/paging parameters to the driver. If the backend supports this, great. If not, the driver can call a generic function to sort/page the metadata. 16:20:47 avishay: The move to core should probably be a different patch to your addition 16:20:57 Kind of ugly, but it could work. Thoughts? 16:21:01 DuncanT: +1 16:21:08 DuncanT: Well this is new, so I think right to core. 16:21:18 avishay: bswartz posted up some links to manilla's move-extensions-to-core in a previous meeting 16:21:27 DuncanT: Or is there a reason to do an extension just to follow up and move it? 16:21:30 avishay: what if you handle that in manager? 16:21:37 smcginnis: this is a new action on an existing resource 16:21:46 Yes, I'd like to get started on the move-to-core work, but might not be until after Austin 16:21:48 avishay: I mean the manager does the paging no matter what the driver returns to it? 16:21:50 smcginnis: Move the whole manage/unmanage to core 16:22:01 yes I agree move it all to core. 16:22:09 DuncanT, avishay: Ah, yeah, I see what you're saying. 16:22:14 scottda: +1 16:22:28 erlon: because the driver may be able to ask for a subset of volumes from the backend, instead of asking for everything and having the manager throw part of it out 16:23:08 I'm not sure what kind of APIs backends have to list volumes, specifically if paging is supported, that's why I wanted feedback from you all 16:23:23 avishay: do you have an idia of how many drivers are able to do that? 16:23:25 No paging from mine. 16:23:33 erlon: no clue 16:23:47 I also don't know how often we will have so many volumes that it becomes an issue 16:24:16 But for the sake of robustness, we should think about this 16:24:17 is it possible to do pagination in a way that won't be racy in this case? 16:24:18 avishay: mhm. it looks to me that this wouldn't be an overhead 16:24:42 eharney: racy how? 16:24:55 avishay: contents on the backend changing between your calls for more pages 16:25:14 avishay: also the drivers could do filter and still pass the reduced list to manager, that could do the paging 16:25:24 eharney: good point 16:25:41 avishay: if the driver does not do any previous filtering it would pass the whole list 16:25:46 eharney: isn't it always racy in that way? if you do list volumes on cinder with pagination, they are separate calls with no guarantee of no change between them, no? 16:26:06 mine does no paging as well 16:26:08 avishay: i guess that's true 16:26:55 avishay: Cool, anything else for now? 16:27:10 OK, so does it make sense to everyone that I will add a generic function to sort/page that drivers can call if they don't support it natively? 16:27:23 DuncanT ? 16:27:36 Seems reasonable, yes. 16:27:39 avishay: +1 16:27:50 Not great performance, but it keeps the API consistent 16:27:50 OK cool, will work on those points - thanks all! 16:27:57 avishay: Thanks 16:28:03 #topic Cinderclient /v3 endpoint support 16:28:06 scottda: Hey 16:28:08 Hi 16:28:26 I wanted to talk about the direction I'm taking with /v3 endpoint before the Summit.. 16:28:33 in case of controversy. 16:28:36 #link https://review.openstack.org/#/c/300028 16:28:40 scottda: I've tested your patches on my env. nothing were broken 16:28:51 I'm moving cinderclient /v2 stuff to /v3 16:28:55 e0ne: Thanks! 16:29:04 but I still need review it more closer 16:29:08 And then we can make changes only in one place 16:29:13 scottda: I've been testing this today 16:29:16 scottda: So this is so the commonality between 2 and 3 is in one place, and both endpoints use the common code? 16:29:16 Even if the change is on /v2 and /v3 16:29:22 scottda: And I don't think it's a good idea to default to v3 16:29:29 smcginnis: Yes 16:29:31 geguileo: +1 16:29:33 scottda: +1 16:29:50 api_version.wraps() will toggle based on microversion (or major version) 16:30:05 geguileo: +2. I remember how was painful switching to v2 last year 16:30:08 #link https://review.openstack.org/#/c/301941/8/cinderclient/api_versions.py 16:30:18 so, this is how Nova and Manila do it. 16:30:28 scottda: Then that's not working ;-) 16:30:28 +1 for consistency 16:30:41 smcginnis: +1 16:30:43 geguileo: You're not seeing that? 16:30:48 scottda: At least not like it does on the server side... 16:30:53 geguileo: Do you mean my code defaults to v3? 16:30:59 e0ne: Horribly painful. 16:31:00 smcginnis: Maybe it's something specific to my patch... 16:31:12 scottda: I think so 16:31:32 geguileo: OK, I'm fine with default to v2, but the code only needs to live in one place. 16:31:37 scottda: Let me do another test and I'll confirm 16:31:41 scottda: for the record: nova's approach coul not be the best 16:31:46 geguileo: OK, thanks. 16:31:55 scottda: +1 to live only in 1 place 16:31:56 scottda: ++ 16:32:08 I think we need to have a plan going forward to getting to v3 though. 16:32:17 e0ne: Yes, and I'm open to any approach, I mainly want to figure out issues now, so we can discuss at Summit 16:32:23 jungleboyj: +1 16:32:40 IF we don't add v3 endpoint support to cinderclient, we dont' get microversions 16:32:59 And many things are queueing up behind this 16:33:09 scottda: I'm not saying that current approach is bad or no. I'm saying that we need to be careful coping nova's approach 16:33:17 It looks like a lot of controversy. Do we have "microversions and V3 API - forward plan" session proposed? 16:33:32 dulek: No, but we can 16:33:45 But what is the controversy? 16:33:50 We do have it as part of the "recap 16:33:52 just when we change the default? 16:33:54 session 16:34:00 To make sure everyone is aware of it. 16:34:09 scottda: Confirmed, goes to v3: cinder service-list --> Vary: OpenStack-API-Version Openstack-Api-Version: volume 3.0 16:34:13 smcginnis: I thought that geguileo proposed recap sessions as kind of tutorials for contributors. 16:34:15 I broke that into two sessions assuming some will require some detailed discussion. 16:34:20 cinderclient just needs support to use 'os-api-version 3' 16:34:28 or 'os-api-version 3.1' 16:34:28 dulek: Yes, but I'm sure it will cause more discussion. 16:34:36 smcginnis: Agreed. :) 16:34:57 I think getting a patch up that needs a switch to use v3 is a good start, let people test and get comfortable 16:35:03 scottda: Today, I've played around with it and made 5 patches that use microversions on top of your patches, and everything looks quite good 16:35:07 geguileo: OK, I'll have a look. Might be broken :) 16:35:24 DuncanT: That sounds reasonable. 16:35:25 geguileo: e0ne Thanks for the reviews and testing 16:35:42 scottda: thanks for working on it 16:35:47 DuncanT: https://review.openstack.org/#/c/303627/5/cinderclient/v3/services.py 16:36:00 #link https://review.openstack.org/#/c/303627/5/cinderclient/v3/shell.py 16:36:12 There's a patch that uses this 16:36:38 Related - ameade has this patch out there for devstack: https://review.openstack.org/#/c/300585/ 16:36:49 Today I uploaded 5 more that use microversions 16:37:14 #link https://review.openstack.org/#/c/300585/ 16:37:18 They are in the related changes of that patch 16:37:21 And NOva-cinder changes for multi-attach will need this. 16:37:32 * dulek cannot keep up with geguileo's flow of patches. ;) 16:37:59 So, some issues can come out during review (i.e. default should still be /v2) 16:38:19 But it'd be good for opinionated persons to have a quick look before the Summit 16:38:27 Else this will drag on. 16:38:28 +1 16:38:29 scottda: Yeah, I have a couple of things that have come up during my patches 16:38:36 scottda: Will comment on your patches 16:38:43 geguileo: Thank! 16:39:45 #topic Open Discussion 16:39:50 Open floor... 16:40:06 The summit app doesn't work for me, anyone else tried it yet? 16:40:15 I can't get signed in. 16:40:18 diablo_rojo: Seems to do the basics 16:40:25 who is ready for some two step at the summit? 16:40:25 diablo_rojo: I could not sign in either 16:40:29 * thingee looks at DuncanT 16:40:29 diablo_rojo: I'm certainly signed in 16:40:41 thingee: sure 16:40:42 diablo_rojo: yeah, it worked for me, but a friend of mine had an issue where they had their account settings to 'block forever' 16:40:58 scottda: What error did you get? 16:41:07 I guess when you sign in you can make some setting 'allow' or 'block' you when you try to sign in 16:41:16 diablo_rojo: Could be me and password issues, so not sure. I've a new phone, so lotsa issues compounding... 16:41:20 ntpttr: So there's a setting to change? 16:41:29 Oh, speaking of the summit, kmartin had suggested this for a Cinder get together: http://easytigeraustin.com/ 16:41:44 We should try to do another informal meetup to get everyone out. 16:41:47 scottda: it accepts my username and password, but then when it goes back to the app it dies 16:41:49 diablo_rojo: yes, but I can't remember where off the top of my head.. he ran into it when trying to change his password on the website 16:41:50 diablo_rojo: what does it say when you try to sign in? 16:42:04 diablo_rojo: ah sounds like a different issue, he couldn't sign in at all 16:42:07 diablo_rojo: You're on the blacklist. 16:42:23 easy tiger is great - I like that idea 16:42:23 smcginnis: Anything with a beer garden is a yes in my book 16:42:26 thingee: It says "There was a problem performing this operation" 16:42:33 mc_nair: You've been there? 16:42:35 thingee: With a red x in a circle 16:42:38 baumann: ;) 16:42:50 Hi guys, I have a patch please could somebody put their eyes on this and provide any suggestions: https://review.openstack.org/#/c/300708/.. Thanks! 16:42:54 mc_nair: Is our local Austin expert!! 16:42:55 smcginnis: Any idea for a date for informal meetup? Sunday like in Tokyo? 16:43:03 smcginnis: I propose a float trip. 16:43:10 :) 16:43:22 dulek: Sunday would work for me. I get in around 4:30. 16:43:23 dulek: I'll arrive in Monday morning:( 16:43:34 It is kind of nice doing it closer to the beginning. 16:43:36 I propose a sleepover at mc_nair's apartment 16:43:40 Hah! 16:43:41 smcginnis: yes - good beer, good sandwiches and ping pong 16:43:52 I've already got claim to mc_nair Balcony hammock 16:43:52 dulek, Sunday or Thursday or Friday? 16:43:53 House party at mc_nair's! 16:43:55 diablo_rojo: android? 16:44:00 Thursday 16:44:00 thingee: Correct 16:44:03 I have exactly one hammock and one couch but they are fair game 16:44:08 kmartin: Some people may be out Friday evening. 16:44:12 kmartin: When's the fancy schmancy HPE private party. We can make sure we do the same time again. :P 16:44:24 I have one more question regarding moving all APIs to core - I have a patch that adds a new API and right now it's in contrib, should I move the new file to the v3 directory or v2? https://review.openstack.org/#/c/301444/ 16:44:27 smcginnis: There is the Women of OpenStack event Sunday night. Is there anything MOnday night? 16:44:29 scottda: :) good decision 16:44:34 e0ne: Thursday works for me I think. :) 16:44:45 ntpttr: v3 16:44:53 geguileo: all right, thanks 16:44:54 smcginnis, Monday night(hpe only), Wednesday(core party) 16:45:01 jungleboyj: Monday night is the booth crawl happy hour thing 16:45:02 ntpttr: And it should add a new microversion 16:45:09 geguileo: yep its doing that already 16:45:12 kmartin: Monday it is then. hehe 16:45:18 ntpttr: ok 16:45:23 :) 16:45:32 sure, be that way 16:45:58 diablo_rojo: Yeah, but the booth crawl doesn't usually go very long. 16:45:59 kmartin: Hey, who do you want to hang out with? Coworkers or Cinder folks? 16:46:18 diablo_rojo: That's the pregame. 16:46:25 smcginnis: Got it. 16:46:26 kmartin: Is HPE party invite-only, or something? 16:46:29 cinder folks of course 16:46:32 smcginnis, kmartin: or we can go to hpe party... 16:46:48 kmartin: I can provide Cards against Humanity as an alternative to the HPE party. 16:46:56 kmartin: can we all crash the HPE party?:) 16:46:58 e0ne: Yeah, kmartin, can you get us some fake badges or something? 16:47:05 hpe employee only 16:47:06 xyang1: +1 16:47:21 dulek: The main one does require RSVP, but I think they are just doing that to get a head count. 16:47:24 diablo_rojo: He he 16:47:56 I killed you guys last time with Cards against Humanity, did you work on your game? :) 16:48:05 OK, we probably don't need this captured for prosperity. Thanks everyone! 16:48:08 kmARC: I have been practicing! 16:48:15 #endmeeting