00:00:30 #startmeeting nova-api 00:00:31 Meeting started Fri Mar 28 00:00:30 2014 UTC and is due to finish in 60 minutes. The chair is cyeoh. Information about MeetBot at http://wiki.debian.org/MeetBot. 00:00:32 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 00:00:34 The meeting name has been set to 'nova_api' 00:00:48 Hi - who do we have here today? 00:00:56 \o 00:01:00 o/ 00:01:18 hi 00:01:21 hi 00:01:43 ok, let's get started 00:01:52 hi 00:01:56 #topic v2 on v3 POC 00:02:12 #link https://etherpad.openstack.org/p/NovaV2OnV3POC 00:02:50 I went through most of the POC patches this week and added a couple of things I think we need to address that weren't on the list before 00:03:04 the first is header translation 00:03:25 Some parts of the API like images and I think servers return some links in headers 00:03:58 they probably have v2 or v3 urls in them which we may need to translate - that I think should be pretty straightforward 00:04:13 will need to a better audit though - images should not be an issue since we don't support that in v3 anyway 00:04:22 but the servers ones might be. 00:04:43 The other was extension listing which we sort of knew about already but wasn't on the list 00:05:08 will need to have a /extensions for v2.1 which looks like v2 but based on what v3 extensions are currently loaded 00:05:33 because some extensions have been collapsed into others in v3 we'll have less flexibility, but I think that will be ok 00:05:56 will need to check with the cloud providers, but they are all IIRC fairly straightforward stuff 00:06:24 we will also most likely need a slightly different "core" for v2.1 and probably a separate whitelist/blacklist for V2.1 00:06:32 I'm happy to work on those if no one else wants to 00:06:48 other than that I'm pretty happy with the state of the POC patches 00:07:07 ken1ohmichi: would you like to talk about what you've been looking at re: testing? 00:07:18 yes 00:07:42 now most Poc APIs are implemented. 00:07:52 and now we need to test it on tempest 00:08:13 but I dont have a good way with tempest 00:08:22 so are we going to need to port the images API in order to be able to test? 00:08:37 and maybe volumes? 00:08:44 yes, right and flavor also is necessary. 00:08:45 I should be able to do those pretty quickly if required 00:09:04 ok, so flavor just needs the conversion decorators? 00:09:30 yes, and need the other tlanslation ways 00:09:38 for flavors. 00:10:00 #action need images/volumes/flavors support for POC 00:10:02 now "list flavors" API works on v2.1 API 00:10:19 but "create a flavor" API does not work. I will dig it more later 00:10:54 ok I'll put images and volumes POC support on my todo list. Should have it done by end of monday 00:10:57 that is my today main work 00:11:11 cyeoh: thanks! 00:11:23 np 00:11:54 so is there anything else we need to talk about v2.1? 00:11:59 that's all from me 00:12:45 oh just one other thing I remembered. We'll eventually need separate sections in setup.cfg for loading the plugins for v2.1 and v3 00:13:09 but I think that should be pretty straightforward too 00:13:33 #topic api response validation in tempest 00:13:53 from what I've seen it looks pretty good there - lots of stuff has merged or is merging 00:14:05 ken1ohmichi: do you have an estimate of what sort of coverage we have so far? 00:14:31 cyeoh: yes, that is in a good progress 00:15:04 coverage is almost 10% for APIs 00:15:35 and a lot of patches still are in review:) https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/nova-api-attribute-test,n,z 00:15:43 #link https://review.openstack.org/#/q/status:open+project:openstack/tempest+branch:master+topic:bp/nova-api-attribute-test,n,z 00:16:02 thanks for much review effort, all 00:16:12 yes there is a lot of patches to be reviewed for those who are interested in doing tempest reviews. And they're pretty straightforward to review too :-) 00:17:06 and I hope some PoC target API patches will be merged soon. 00:17:10 so one question I had about the testing we are doing there is if we also need to check headers 00:17:33 because they do essentially form part of the API too 00:17:48 oh so re: POC target API patches - do you mean the Nova ones? 00:17:50 cyeoh: you mean "links" attribute? 00:18:28 cyeoh: no, tempest ones. 00:18:43 for example, https://review.openstack.org/#/c/81222/ 00:18:55 but it has been approved already:-) 00:19:06 ken1ohmichi: oh I see :-) 00:19:52 the other one is https://review.openstack.org/#/c/80923/ 00:19:55 if there are ones that you think need priority reviewing maybe you could list them on an etherpad somewhere? I'm just sort of looking at the api attribute ones from oldest at the moment 00:20:18 ok I'll have a look at that one today 00:20:20 that is a good idea, I will do it later. 00:20:26 ken1ohmichi: thx! 00:20:39 re: headers - I was thinking more of situations like where the servers create_image call 00:20:47 returns a Location header 00:21:14 which is a url to (I think) glance where it is created 00:21:47 eg. see nova/api/openstack/compute/servers.py:1473 00:22:08 The value can chance without an issues, but the header name has to stay the same 00:22:36 I really don't know why its returned in an header rather than in the body, but that's what we have to live with 00:23:03 oh, I see. 00:23:12 that is an important point. 00:23:44 I think it probably makes sense to add that as something that can be specified in the json schema? 00:24:15 yes, I feel we can do it in Tempest. 00:24:29 excellent :-) 00:24:47 I will consider it later:) 00:25:13 sounds great. Anyone have anything else they want to talk about on the tempest attribute testing? 00:25:57 #topic V3 API sdk port 00:26:07 mrda: would you like to talk about this? 00:26:13 cyeoh: sure 00:26:28 I've been looking at porting libcloud to support v3 00:26:45 libcloud is a cross-cloud library written in python 00:27:04 I've had a few issues getting it going with devstack, but that's resolved now. 00:27:31 It looks like adding in support for v3 won't be too hard. I'll be working on this as a priority over this next week. 00:27:48 cool - do you know how many backend clouds it supports? 00:28:04 quite a few - and most of the majors 00:28:37 I think there's some 20+ different clouds, and the api is generic 00:28:45 so should be a good test 00:29:09 yep, that sounds like a really good example 00:29:28 just checking - over 30 providers 00:30:02 that's a lot so presumably they've done a fair amount of work to keep the provider specific stuff well isolated... 00:30:31 yes, you can grab a list of providers, and query/spin up using a generic interface 00:30:45 so it won't cover all of v3 - only the bits that are generic across clouds 00:31:23 I'll put my fork up on github so anyone can see the changes I've had to make to get it working 00:31:45 yea that would be really good to be able to show everyone, especially at summit 00:32:00 no probs - any questions or suggestions most welcome :) 00:32:12 mrda: port all the SDKs :-) 00:32:26 that's not a suggestion 00:32:30 :) 00:32:33 :-) 00:32:57 ok anything else on SDKs? 00:33:13 not from me 00:33:32 #topic summit proposals 00:33:50 I've put in 3: 00:33:59 #link http://summit.openstack.org/cfp/details/147 00:34:07 #link http://summit.openstack.org/cfp/details/149 00:34:15 #link http://summit.openstack.org/cfp/details/148 00:34:28 cyeoh: great:) 00:34:28 basically a cross project API one, a V3 API one and a V2.1 on V3 one 00:34:52 cyeoh: +1 00:35:08 so if you think there is stuff missing from them that we need to talk about at summit, please comment one them 00:35:46 Is there anything else that anyone thinks would need a separate additional session? 00:36:31 ken1ohmichi: I wasn't sure if you wanted to do something around json schema in tempest? 00:36:48 given the discussion on the mailing list about json schema for negative testing 00:37:02 its sort of affects Nova too if we want Nova to produce the schema in the long term.. 00:37:04 cyeoh: uh, I don't have one item now. 00:37:37 cyeoh: yes, right. and I guess David also is interested in. 00:37:57 cyeoh, in v3, except nova-network, neutron-network is also need finish in Juno, it's need to talk about at summit? 00:38:31 alex_xu: so I've included the tasks api work in the v3 session too 00:38:38 as I think we want to nail down the API 00:38:58 I'd also like to discuss the criteria we will use for being able to release the V3 API. 00:39:11 so there is no confusion over what the community wants 00:39:24 cyeoh, ok, i got it 00:39:46 cyeoh: Agreed, I think getting some form of agreement on what constitutes v3 being releasable is extremely important. 00:40:20 yea I don't want to have another giant email discussion in J-3 ;-) 00:40:38 cyeoh: agree:-) 00:40:54 yeah :) 00:40:55 +1 00:41:20 cyeoh: all working items for v3 are on http://summit.openstack.org/cfp/details/149 ? 00:41:29 nova-network support 00:41:34 Tasks API 00:41:38 python novaclient v2/v3 stability 00:41:42 all ? 00:42:06 yea, that's all I could remember at the time I was writing it. If you think of any others please add them in the comments 00:42:25 looks like I can update the description 00:42:47 cyeoh: OK, I will see it carefully later. 00:43:06 nova-network is a big chunk of work, but other than that the V3 API is pretty much complete. 00:43:18 It might be worth doing a pass over the API during Juno just to look at some other consistency issues 00:43:34 dansmith brought up the issue of date/time stamps not being consistent across the API 00:43:43 and we should probably fix that while we have the opportunity 00:43:58 (some apparently use UTC others use localtime) 00:44:09 not just that 00:44:12 it's format too 00:44:14 cyeoh: yes, many issues has/will be fixed in v3. 00:44:29 isotime, str(datetime), str(datetime_with_tz), and some others 00:44:34 dansmith: ok yea we should definitely fix that too while we still can. 00:44:49 dansmith: heh whatever tool the programmer had handy in his head at the time ;-) 00:44:58 it's so inconsistent, 00:45:10 it looks like we were *trying* to come up with new ways :) 00:45:19 dansmith: +1 :) 00:45:21 dansmith: hahaha :-) 00:45:49 I think we should report everything in swatch time 00:46:14 #open discussion 00:46:23 #topic open discussion 00:46:46 ok was there anything else we should talk about? 00:46:51 cyeoh: yes 00:47:04 I've recently committed a fix and it got merged 00:47:18 it's my first fix, now i'm looking for something new to work on 00:47:31 can you suggest an area that I should look at and help out? 00:48:10 well perhaps you'd like to look at the use of date/time stamps in the V3 API? 00:48:35 I can do that, can you point out where I can locate details of this requirement? 00:48:38 to see what sort of variation we have, and can start doing patches to convert them all to use UTC instead? 00:48:53 ok 00:49:03 so I don't think its been written down, but basically the issue is that in various parts of the API 00:49:14 we have fields which return date/time stamps 00:49:34 and we just need to ensure that the format is consistent across the whole API and its in UTC rather than localtime of the server 00:50:02 I see, I can take a look at that. 00:50:27 changsimon: thanks! 00:50:33 :) 00:50:53 does anyone have anything else they'd like to talk about? 00:51:43 nothing from me, I have gotten many tasks already ;-) 00:51:48 ok. looks like that's it for today then. Thank you everyone for attending 00:51:52 ken1ohmichi: :-) 00:52:09 thanks 00:52:12 #endmeeting