20:02:34 #startmeeting 20:02:34 Meeting started Thu Apr 12 20:02:34 2012 UTC. The chair is n0ano. Information about MeetBot at http://wiki.debian.org/MeetBot. 20:02:35 Useful Commands: #action #agreed #help #info #idea #link #topic. 20:02:54 #topic get ready for the session next week 20:03:21 So, sriramhere (since you did all the work) are we ready for the session next week? 20:03:24 looks like Ziad has some notes on SpiffWorkflow 20:04:23 i couldnt make much progress on SWF mock :( - pressure to deliver some work before i take a week off for the summit 20:04:41 maoy - any updates on ur side? 20:04:55 Ziad's notes: http://wiki.openstack.org/NovaOrchestration/WorkflowEngines/SpiffWorkflow 20:05:28 i'm preparing another session on concurrency 20:05:45 but i'd like to present a few slides during the session if possible 20:05:53 i mean the orchestration session 20:06:14 I would imagine that should be fine, sriramhere do you have slides you'll present? 20:06:45 what's the format of our session? 20:06:50 do we have an agenda? 20:06:57 i am putting some intro/ explaining current thought processes. WIll be done by tomorrow 20:07:09 will you put that in the blueprint 20:07:13 i would like to talk to you all about what we want to talk during the session 20:07:16 yes, i will 20:07:35 we had 3 topics considered/ wanted to be talked about during session 20:07:41 then I think we can use the BP as the guide to the agenda 20:07:46 stepping back - this is a brainstorming session 20:08:13 also, my first. can one of u tell me what to expect during the brainstorming session? 20:08:22 i am using the following link as guideline 20:08:31 agreed, but having a little structure to the discussion is always good. 20:08:39 https://www.youtube.com/watch?v=GmY4cK_6NKY 20:08:46 i only been to one summit before 20:09:18 i think if the session chair (leader?) is organized with an agenda, it works much better 20:09:25 me too but we're allowed to be fairly loose 20:09:35 i like to have an agenda 20:09:45 that also helps to keep focussed. 20:09:46 hence making sure the BP has the right outline then I think we'll be good 20:09:57 ok 20:09:58 what i am thinking now, ur suggestions d help me 20:10:39 is - to start with the need for orchestration. though most of us agree, this is to set the tone 20:11:15 then introduce some of the back ground work. this will include Ziad's and maoys., if any progress i can make on aws swf mock 20:11:34 * vishy jumps in 20:11:42 then incude the things we want to hash out - api design 20:11:50 have you guys considered where the orchestration code will go? 20:11:52 open up brainstorming 20:12:23 (I ask because with volume splitting out it might be nice to have some/all of the code in openstack-common 20:12:26 vishy, not sure we've gone there yet beyond thinking that it'll be part of nova 20:12:28 u mean branch? general consensus so far is to have a branch 20:13:03 in terms of project, under nova. a separate sevice 20:13:06 vishy, we did talk about the orchestration as a general service independent of nova-core 20:13:12 n0ano: it could go into nova branch initiially, but it would be great if it is useful for volume and/or network 20:13:15 nova-orchestration. 20:13:31 that it eventually moves into openstack-common 20:13:36 similar to how rpc code is moving now 20:14:03 just wanted to put that thought in your heads, didn't mean to derail the meeting. 20:14:06 :) 20:14:08 3 components: nova-orch (server side), nova-orch (client library), and modify existing nova code to utilize nova-orch client 20:14:15 vishy - i am hearing u suggest to keep this away from nova 20:14:18 I like the idea of in the nova branch to begin with, keeping in mind that we might want to split out if it is useful for other projects. 20:14:33 maoy: hmm maybe we are discussing different things 20:14:56 I'm referring to the state management part of the code 20:15:21 as in workflow engine defining the states for a vm for example 20:15:34 that part will probably have to be in nova or integrated somehow 20:15:43 but it also applies to volumes and networks 20:15:44 I thought that was where the spiff-workflow investigation applied 20:16:04 right, but nova-orch with a client library sounds like it is higher level orchestration 20:16:10 i think we are talking about the same thing.. 20:16:13 like using a bunch of services together 20:16:43 ah sorry i missed the last part of your sentence: modify existing nova code to utilize nova-orch client 20:16:54 so u like a nov-orch service, side by side with nova-volume, etc 20:17:00 that seems reasonable, as long as you keep it simple 20:17:15 my only concern is would that too heavy weight for what we need 20:17:18 I see two approaches 20:17:19 but would like to keep it in openstakc-common? 20:17:31 1) a totally separate service with a rest-api for state management 20:17:36 other servies use it 20:17:47 2) a set of python libraries for state management 20:17:52 other services use it 20:18:01 i personally would lean towards 2 20:18:10 you could always add 1 later 20:18:15 personally, I like 2, maybe think about 1 later if needed 20:18:35 if it is going to be 2, openstack-common could be a good place for it to ultimately end up. 20:18:39 in 2, other services would just include/ use this library? 20:18:46 sriramhere: correct 20:19:05 I think we're in violent agreement here 20:19:09 I feel 1) is a specific implementation of 2) 20:19:16 agreed 20:19:18 na0no - wait please 20:19:23 i am just typing 20:19:23 and it might be very cool long term 20:19:39 StateManagementaaS 20:19:51 or OrchestrationaaS 20:19:52 my only concern is orchestration layter may not sit on top if we need it to 20:20:23 if we are thinjking aaS, may be 1 is a better solution rt? 20:20:41 I think it's too early to do an aaS, walk before we run 20:20:59 n0ano: +1 20:21:13 i agree, was commenting to vishy's long term names 20:21:46 we should dive deeper in the summit, e.g. talk about the actual persistent storage layer for state we manage. e.g. mysql vs zookeeper 20:21:54 2 is simple to start with - i agree. i think all agree to that 20:22:16 but is 2 going to be the end? and if we wan tto go towards1, how difficult would that be ? 20:23:02 If we keep 1 in mind as an option then, hopefully, we won't make design decisions that make transitioning to that difficult 20:23:14 i like to have the ability to have orchestration running by itself 20:23:47 it's very hard to define 1 without having hands-on experience with 2 20:24:02 n0ano - agreed 20:24:04 comes back to maoy's point that 1 can be used as an implementation for 2 20:24:20 rather on top of 2? 20:25:10 I see it as there are python APIs we create, they either execute python code (option 2 for now) or call out to a service (option 1 for later) 20:25:11 ok - looks like the consensus is to start with 2, but keep in mind 1 as an option 20:26:19 i personally would still servicify it 20:26:53 it may not be complex, but would like other services consider orch as a service. not library 20:27:41 to me, you call an API and what that API does is arbitrary 20:27:50 to make it as a service, you need to decide which functions live on the server, which live on the client. 20:28:12 if just having APIs, you can defer that decision. change it without changing the APIs 20:28:29 and it is better to answer the question sooner than later. else, it might be very difficult to do later 20:28:54 giving us time to get some experience as to what is truly needed 20:29:13 ok - something the experienced can help here 20:29:23 sriramhere: rest service is nothing more than a specific way of remote API call semantics-wise 20:29:25 wat has been the experience so far - to rip out a library in to a service 20:30:20 maoy - i agree, and we can start with that. but this would force the other services not to consider this as a library, there by not making themselves too tied 20:30:59 i mean - just consider that as a rest end point. and it could be a light weight to begin with. 20:31:37 as long as other services keep thinkint it as a service, we are better off, rt? 20:31:53 I would hope that other services don't care, they want something done and the API does it, that's all that matters, not that it's a service 20:32:05 i don't think it matters.. 20:32:16 n0ano: agree 20:32:33 the drawback of API is that is language dependent 20:32:50 so you have to use Python. and upgrading is hard 20:33:04 not a problem in openstack now since every component is released together, all written in python 20:33:37 pausing for a moment - what is the difficulty tht i am missing on wrapping a rest end point on these apis? 20:34:38 no difficulty, comes back to I'd like to see something very light weight to begin with before we decide we need an extra service 20:36:04 ok - everybody else seems to like to stat with 2. i will also go with it then for now. 20:36:43 I think we'll have some good discussions at the session. 20:37:00 Back to the seesion, I see the brief outline of the agenda as: 20:37:06 1) Why orchestration is needed 20:37:06 2) Background 20:37:06 3) Current thoughts (3 topics) 20:37:13 so, this is another item to add for discussionduring summit 20:37:26 certainly it would be appropriate 20:37:51 sounds great 20:38:02 do we know which day the session is on? 20:38:21 I curious about that also 20:39:31 i guess it's still in flux then 20:39:31 i dont know tht e - as of yesterday night. 20:39:35 let me check quickly now 20:39:57 hopefully it won't conflict with my other sessionx 20:40:00 sessions 20:40:42 I guess that's it for today? 20:40:57 I'm excited 20:41:07 that's all I have, looking forward to the summit 20:41:28 action items? 20:41:51 #action sriramhere to finalize the BP 20:41:52 also , shall we ahve an offline sync by the week end just to make sure we have all ready for the summit? 20:42:07 #action everyone to attend the session 20:42:20 this will include a slide deck 20:42:38 sriramhere, we're all available via email, when you have the deck ready just send it out and we'll review 20:43:00 works 20:43:22 in that case, tnx everyone and we'll see you next week. 20:43:31 5 pm on tuesday is ours 20:43:31 thx. bye 20:43:47 excellent, now we know 20:43:48 who did you talk to to get that? 20:43:52 http://openstack.org/conference/san-francisco-2012/sessions/ 20:43:56 its updated 20:44:27 no conflicts that we know of now? 20:45:00 I'm certainly good 20:45:06 nice. didn't know that link. no conflict from my end 20:45:14 other sesison is resource rationing in glance 20:45:26 same time i meant 20:45:27 ok then. 20:45:40 thanks, cya all next week 20:45:50 later 20:45:57 #endmeeting