12:00:09 #startmeeting nova api 12:00:10 Meeting started Tue Aug 11 12:00:09 2015 UTC and is due to finish in 60 minutes. The chair is alex_xu. Information about MeetBot at http://wiki.debian.org/MeetBot. 12:00:11 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 12:00:13 The meeting name has been set to 'nova_api' 12:00:25 anyone at here today? 12:00:35 as we have new meeting time for this meeting 12:00:46 o/ 12:00:52 claudiub: hi 12:01:01 hellou :) 12:01:39 waiting one more minutes to see if more people join 12:01:45 ofc 12:01:49 hello 12:01:54 hey all 12:02:01 hello! 12:02:46 #topic Actions from last meeting 12:03:11 one for johnthetubaguy, about catch with me about api work status, I think its done 12:03:26 roughly done, yes 12:03:32 another for sdague, we have new agenda! 12:03:37 #link https://wiki.openstack.org/wiki/Meetings/NovaAPI 12:03:43 yep, done - woot 12:03:43 +1 12:03:47 sdague: thanks for the new agenda! 12:04:04 let's moving on 12:04:11 so I feel like that's roughly the right standing agenda, but if people think other major sections should be there just speak up 12:04:12 #topic API infrastructure 12:04:43 sdague: yea, that help to track our work also 12:05:00 first one, 'v2.0 on v2.1' 12:05:16 any command for sub topic? 12:05:26 alex_xu: not really 12:05:33 you can change #topic 12:05:40 or not, depending on how you feel 12:05:45 #topic v2.0 on v2.1 12:06:06 for relax api validation, there only left one patch 12:06:08 #link https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/api-relax-validation,n,z 12:06:32 #info 3 of 4 patches merged for API validation relaxation needed for v2.0 on v2.1 12:06:42 sdague: thanks 12:06:57 alex_xu: ok, great, anything else needed, or do we think that with that final patch we're good? 12:07:22 I think the next step is reaching out for folks to test it out 12:07:26 sdague: no more, from my view, the final patch is good 12:07:36 do we have a tempest job set up for this configuration? 12:07:39 I think mikal had offered to help with that 12:07:40 even in experimental 12:07:45 sdague: good point, that too 12:08:29 so we create new job for this? 12:08:49 to test it out, I think we should 12:09:00 once thats green we could look at moving the existing jobs over 12:09:06 ok, I can take that one for next week 12:09:22 maybe neutron jobs all run v2.1 for v2, non-network stay on the old? 12:09:22 #action sdague to build experimental devstack/tempest job to test v2.0 on v2.1 12:09:25 sdague: would that work? 12:09:47 s/non-network/nova-network/ 12:09:52 sdague: thanks 12:10:10 johnthetubaguy: so, let's prove it works. We probably need to rethink the overall test plan for Nova about what's important and trim our jobs accordingly 12:10:16 but that's a different conversation 12:10:57 sdague: +1 to all that 12:11:05 ok, I think we can move on from this one. I'll review the patch once the meeting is over 12:11:07 I am getting ahed of my self 12:11:12 +1 12:11:20 cool 12:11:43 sdague: after the test job, then we can change the endpoint? 12:12:09 alex_xu: yeh, I think so, we just have to have a story on what existing installs will do 12:12:25 let me poke at it a bit and I'll let you know 12:12:38 sdague: ok, thanks 12:12:53 #topic policy.json updates to remove admin hard code at the db level 12:13:11 #link https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/nova-api-policy-final-part,n,z 12:13:16 just left three patches 12:13:27 are we done done after those 3 patches? 12:13:35 sdague: yes, we are done 12:13:37 because I feel like new patches always appear on this stop 12:13:40 topic 12:13:43 ok, awesome. 12:14:11 #info 3 patches left to merge before policy.json updates to remove admin hard code at the db level is done 12:14:19 that's a really nice place to be in 12:14:34 * sdague open another browser tab for reviewing code 12:14:57 there are a lot of elvated context in the code, but we can cleanup them in the future 12:15:21 * johnthetubaguy also opens those patches for review 12:15:35 heh...cool 12:15:38 #topic Test collapse of v2.0 and v2.1 12:15:39 alex_xu: ok, cool. Do you think those will be done this cycle or in Mitaka? 12:15:43 alex_xu: do we have a plan of when to do that,? 12:16:13 in the M I think, we can create a bug for low hanging fruits 12:16:30 good for new contributor in nova 12:16:37 I guess there is no reason to wait, maybe add it to the list next to log cleanups 12:16:56 #link https://etherpad.openstack.org/p/nova-low-hanging-fruit 12:16:59 its listed in here: 12:17:03 https://wiki.openstack.org/wiki/Nova/Mentoring 12:17:09 yeh, but it would be good to track as API infrastructure cleanup in Mitaka cycle 12:17:36 +1 for tracking it, we can create a blueprint like we have for objects 12:17:37 #info elevated_context cleanup will happen in Mitaka cycle 12:17:46 yeah, lets keep moving 12:17:52 yeh, even with low hanging fruit we should set a timeline 12:18:03 otherwise we get stuff like mox living forever 12:18:16 agreed, back on topic :) 12:18:28 ok, test collapse of v2.0 and v2.1 12:19:02 #action /me create bp for elevated context cleanup and update low-hanging fruit etherpad 12:19:21 #link https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:merge_sample_tests,n,z 12:19:40 is that list complete as well? or are there more patches to come? 12:19:44 looks like more pach come up 12:19:57 so I am tempted to pause this, after these patches 12:20:01 I'm not sure, we should check with gmann 12:20:07 it would be good to get some idea about how far along we are 12:20:12 even if just roughly 12:20:18 like are we 50% done now? 12:20:20 yeah, very true 12:20:21 80% done 12:20:28 and I think remove v3 depend on this 12:20:38 when we move api sample tests 12:20:52 well, we'll just move different files if this is done or not 12:20:53 alex_xu: it shouldn't have to, well I think remove v3 is way more important 12:20:58 sdague: +1 12:21:06 and I agree, removing v3 in the tree is way more important 12:21:15 it will definitely merge conflict with that 12:21:20 it would make it clearer if we have old_stuff and merged stuff in separate directories 12:21:25 ok, there should be a way skip that 12:21:32 yeah, I am thinking we stop the merge to make sure the rename can happen 12:21:50 but anyways, lets get info on how close that is 12:22:10 #info put merge of v2.0 / v2.1 tests on hold until v3 removal is complete 12:22:10 I am more worried about moving the API code rather than the tests, as silly as that sounds 12:22:19 johnthetubaguy: yeh, I think that's fair 12:22:47 and I think it's fair to put this on hold a bit, and focus on the v3 removal. We can merge test fixes / collapse after freeze as well, right? 12:22:59 I thought tests and docs were typically fair game during the rc period 12:23:15 yeah, thats true 12:23:21 although I would rather be merging bug fixes 12:23:28 sure 12:23:36 docs totally, not sure about the test clean ups 12:23:43 they sound like a distraction 12:23:51 although back port problems are good to avoid 12:24:12 maybe, I feel like they are typically not very hard to review, and make things easier later 12:24:48 anyway, we're agreed to pause on the test collapse for now? 12:24:53 if so, I think we can move on 12:25:05 sdague: or check with gmann first? 12:25:15 oh, I guess there is an action for gmann to get a status on how complete the whole effort is 12:25:20 I think we delay for now, and check with gmann 12:25:32 lets report back here next week 12:25:33 ok 12:25:47 #action get status from gmann on overall completeness of the v2.0 / v2.1 test collapse 12:26:01 its a soft freeze, I don't want to -2 them all, thats a waste of time, if they merge, they merge 12:26:13 yeh 12:26:37 ok, let's move on 12:26:39 though, honestly, kenichi and I are typically the only ones reviewing them, so I doubt they will merge without us actively pushing it 12:26:48 alex_xu: +1 12:27:10 sdague: exactly my thinking 12:27:14 sdague: yea, I help few review before and will continue 12:27:29 #topic Removal of v3 naming from source tree 12:27:31 alex_xu: right, sorry, I meant from a +2 perspective 12:27:50 sdague: yea 12:28:10 there are two patches for moving legacy v2 code is ready I think 12:28:12 #link https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bug/1462901,n,z 12:28:26 * edleafe didn't realize the meeting moved already 12:28:32 ok, great. I'll look hard at these right after the meeting 12:28:38 sdague: thanks 12:28:46 morning, alex_xu 12:28:53 saw your commits 12:28:56 edleafe: morning :) 12:28:57 edleafe: it was a little adhoc, alex_xu asked, and I wasn't going to be here on friday, so said go for it :) 12:29:03 have you started on step 3 yet? 12:29:13 not yet 12:29:17 sdague: cool. I'll adjust my calendar 12:29:30 step 3 will be moving v2.1 code to toplelve 12:29:33 alex_xu: I can do that, since your day is winding down now 12:29:44 edleafe: thanks 12:29:45 alex_xu: so we should start with - https://review.openstack.org/#/c/211356/ right? 12:30:00 there are 2 patch series listed under that bug 12:30:16 sdague: yes 12:30:35 edleafe: can you abandoned this one https://review.openstack.org/193725 12:30:55 alex_xu: yeah, I was planning on it 12:30:56 edleafe: and I think we can move json-schema separately 12:32:12 alex_xu: sounds reasonable. So I think that for these patches if we agree that changes are required, we should just respin among the team. I'd hate to delay these because folks are asleep. 12:32:17 edleafe: for moving v3, should we create resource directory in one step. 12:32:28 sdague: +1 12:32:48 I think this small steps approach is proving way easier to review, lets keep it going 12:33:01 lets kind of keep an active conversation going in #openstack-nova during the day until we get them merged 12:33:11 if we are worry about partial merges of the chain, I think we can sort that out later 12:33:25 ++ 12:33:26 sdague: I wonder if we want to block the first one till we have a good few lined up? 12:33:37 sdague: should we -W them until they are all ready? Then release them all at once to avoid multiple rebase hell? 12:33:49 johnthetubaguy: honestly, as long as we are committed to getting this in regardless, let's just grind on them 12:33:50 johnthetubaguy: jinx (sort of) 12:34:38 because procedural stuff just triggers various additional delays, we end up in a situation where something is wip, the author is asleep, and then we need to get 3 hrs of testing rerun to merge 12:34:41 alex_xu: not sure what you mean 12:34:41 alex_xu: about the resource directory 12:34:47 the v2 moving can waiting for v2.1 moving, I guess there isn't too much conflict for v2 moving 12:35:14 alex_xu: can we get an etherpad with what you think the various additional patches would be? 12:35:22 sdague: OK, that makes sense 12:35:25 then we can get details there as well about next steps 12:35:44 sdague: ok, will create one after the meeting 12:35:48 alex_xu: thank you 12:35:59 edleafe: let's talk about v3 step off the meeting 12:36:07 alex_xu: sure 12:36:21 let's move on 12:36:25 #topic API Documentation Improvement 12:36:36 sdague: ^ any idea? 12:36:52 a couple of things 12:37:21 I spoke with annegentle last week about how to get a new concept guide published to the API site. She's going to help with that infrastructure. 12:37:49 We need to write that concept guide. Honestly, I expect that will wait until we get these release critical patches merged. 12:38:13 once we do, I'll write up a documentation plan and start in on some of that content 12:38:18 and hopefully get others to participate 12:38:31 sdague: cool 12:38:48 that's it on that topic so far, I hope we'll get more focus on it in Mitaka 12:38:55 sdague: release critical patches means ? 12:39:10 the v3 remove 12:39:15 this is Mitake work item? 12:39:37 alex_xu: honestly, I hope we get some of it done before the release 12:39:38 s/Mitake/Mitaka.... 12:40:00 sdague: ok 12:40:00 documentation doesn't go into freeze the same way as the rest of the release 12:40:44 we can move on to the next couple of topics 12:40:59 #topic API futures - specs 12:41:16 nothing listed at here 12:41:25 so let move on? 12:41:36 there are some in the etherpad I guess 12:41:40 but fixes that needed specs 12:41:54 I think I have +2ed them, but need to get other drivers to approve them 12:42:04 sorry, I got distracted with the previous docs topic 12:42:07 so, the intent here is we should have a list of all specs with API changes in them that are up for review 12:42:29 I think we agreed docs was the most important thing for liberty, so I would love to see some progress there, however small it is 12:42:31 because, in reviewing some of the API changes in code, we had some late fixes needed 12:42:43 which has blocked a few of those for the release 12:42:54 yeah, there are a few of those, we should keep tracking them 12:43:03 johnthetubaguy: are all nova-specs with API changes getting tagged with APIImpact currently? 12:43:17 if not, could we ask for that 12:43:24 sdague: they should be, we usually add it if not 12:43:35 sdague: we do ask for it already, just no everyone does it 12:43:47 s/just no/just not/ 12:44:42 sdague: you want to go through all the apiimpact spec in this topic? 12:44:42 I've seen several reviews in the last cycle where reviewers asked to add APIImpact 12:44:44 ok, something isn't working with that query 12:45:09 #action sdague to find gerrit query to pull all API changed specs 12:46:05 I have link for dashboard 12:46:07 https://review.openstack.org/#/dashboard/?title=Nova+API+Spec+Dashboard&foreach=project:openstack/nova-specs&Reviewed+by+me=reviewer:xuhj+is:open+message:apiimpact&Recently+Closed+And+Reviewed+by+me=is:closed+limit:15+message:apiimpact&Recently+Closed=is:closed+reviewer:self+limit:30+message:apiimpact&Open=is:open+message:apiimpact 12:46:13 hope this helpful 12:46:35 oh, it has to be lower case 12:46:40 ok, good call 12:47:08 so once specs get approved for the cycle, we should then also be tracking all the patches that are relevant to those changes 12:47:14 which would be the next topic 12:47:36 that will probably require a query that we keep updated with the latest approved blueprints for that cycle 12:48:00 sdague: ok 12:48:22 from the priorit etherpad 12:48:37 I think there is one api bug fix is more important 12:48:39 #link https://review.openstack.org/#/c/198622/2 12:49:08 johnthetubaguy: ^^ 12:49:08 it's about we missing porting an API from v2 to v2.1 12:49:27 and we already get agreement on how to fix it 12:49:31 yeah, that ones important 12:49:33 johnthetubaguy: iirc the functional code for that is ready to go, it just needs procedural approval 12:49:36 I had +2ed it, it lost that vote 12:50:01 so I thought I reached out to some driver folks, but doesn't seem like any of them got to that 12:50:09 lets re-apply our +1s as a start 12:51:03 done 12:51:06 ok, no more on this topic, maybe next week 12:51:19 I think the last thing is the 'nmi' interface 12:51:28 just to round up where we stand on that 12:51:49 I -1ed that patch because it's weird semantics for our API 12:52:06 and I feel like it should have been "crashdump" in the API, and nmi is an implementation detail 12:52:11 #link https://review.openstack.org/#/c/202617/ 12:52:37 given timing, we probably need to revisit the interface in mitaka 12:52:50 johnthetubaguy: that your feeling as well? 12:53:58 * alex_xu need think about more 12:55:00 ok, well johnthetubaguy has -2ed it, so we'll revise next cycle 12:55:20 ok...let's move on 12:55:22 yeah, it feels like the deadline has passed for new features now 12:55:39 (sorry being bombarded in openstack-nova) 12:55:43 no prob 12:55:52 #topic API futures - patches for approved specs 12:56:03 anything for this? 12:56:06 alex_xu: well, we were kind of just on that topic :) 12:56:14 the nmi stuff feels like the cpu features 12:56:14 so let's just jump to open discussion 12:56:18 sdague: yea... 12:56:22 #topic open 12:56:25 too specific to an architecture 12:56:35 I forget to ask, what plan for removing extension? 12:56:57 I have one question. I'm going to write up the extensions deprecation document this week, so we can have some clarity 12:57:11 but my question is "where" should it be 12:57:12 alex_xu: aren't they supposed to be deprecated in Liberty? 12:57:14 we are pretty late for this. maybe just deprecate some config option for extension for this release? 12:57:33 because, this partially feels like a liberty spec, even though late 12:57:44 edleafe: we want to 12:57:47 it could be devref (but it feels like a spec) 12:58:07 and next week is propose freeze 12:58:13 if it's going away, probably not devref, right? 12:58:17 I don't want to make it a backlog or mitaka spec because we do really want to flag extensions as a deprecated topic before we're done 12:58:24 with liberty 12:58:34 johnthetubaguy: need some guidance here 12:58:57 so I think we need to deprecate those configs 12:58:57 I think let's check if we can do thing for user visible thing first 12:59:10 I am happy to just approve a blueprint for that, unless we feel it needs a spec? 12:59:50 johnthetubaguy: well I'm happy to write up the overall spec with items that get done for liberty in there 13:00:08 I feel like the whole of the transition to no extensions is probably spec worthy 13:00:28 there seems to be a lot of confusion at times, and there have been nova channel fights over it, so we should write down the whole path 13:00:40 is there stuff beyond deprecating the configs that we need to merge this cycle? 13:00:52 sdague: yeah, thats very, very true 13:01:10 johnthetubaguy: we should also merge some document that signals this is going away for real in a couple of cycles 13:01:17 +1 13:01:22 beyond just config deprecation 13:01:25 I think we could do that in devref in those patches 13:01:36 johnthetubaguy: ok, devref it is 13:01:37 we run out of time.... 13:01:39 yep 13:01:48 sdague: let me know the BP, and I can get that approved 13:01:54 sure 13:02:00 sdague: I think thats the best option this late in the cycle 13:02:10 (given how hard it was to merge the other specs at this point) 13:02:12 yep, thanks folks 13:02:26 yea, thanks all, let move to openstack-nova 13:02:30 johnthetubaguy: ok, I'll do a futures spec for the whole arc then 13:02:33 * johnthetubaguy feels happier about the progress reports now, thank you sdague! 13:02:35 #endmeeting