16:05:14 #startmeeting Solum Team Meeting 16:05:14 o/ 16:05:14 Meeting started Tue Apr 1 16:05:14 2014 UTC and is due to finish in 60 minutes. The chair is adrian_otto. Information about MeetBot at http://wiki.debian.org/MeetBot. 16:05:15 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 16:05:17 The meeting name has been set to 'solum_team_meeting' 16:05:21 Thanks! 16:05:26 #link https://wiki.openstack.org/wiki/Meetings/Solum Our Agenda 16:05:34 #topic Roll Call 16:05:35 o/ 16:05:41 murali 16:05:45 Pierre Padrixe 16:05:45 tom blankenship 16:05:45 Arati Mahimane 16:05:46 Adrain otto 16:05:51 Chris Alfonso 16:05:51 o/ Dmitry Mescheryakov 16:05:52 Georgy Okrokvertskhov 16:05:52 Julien Vey 16:05:52 Noorul Islam K M 16:05:53 Devdatta 16:06:32 Gilbert Pilz 16:07:00 Ed Cranford 16:07:33 Welcome everyone. Feel free to chime in at any time if you have not already to be recorded in attendance. 16:07:42 #topic Announcements 16:08:13 thanks for a great face-to-face meeting in Raleigh. I'd like to extend special thanks to our co-contributors at RedHat for hosting us. 16:08:52 any other announcements from other attendees today? 16:09:24 #topic Review Action Items 16:09:34 adrian_otto to locate Nova blueprints/reviews on libvirt driver support for Docker 16:10:05 I tracked down a lot of information on this. It appears that Docker's current focus is on the Heat Provider for Docker 16:10:37 the Nova driver is now in Stackforge, and may be re-introduced into Nova when it meets the testing expectations set for virtualization drivers. 16:10:53 we looked into the LXC driver, and found that it is not working out of the box 16:11:07 adrian_otto: does that mean the viewpoint of not putting it in nova has changed? 16:11:10 our current preferred approach is to use the Docker Nova Driver from Stackforge 16:11:23 funzo: good question. 16:11:39 I plan to publish a wiki page this week that illustrates why this is our preferred approach 16:11:54 it eliminates a lot of complexity with respect to handling Docker on the system side 16:12:00 I've heard two perspectives. One from russellb and dan smith that it shouldn't be in nova and then the other of putting in nova. not sure where it landed 16:12:22 long term I expect it will be in a dedicated containers service 16:12:32 either way, sounds like we have an option to move forward with the heat driver 16:12:41 in the mean time, we do have a functional Nova driver 16:13:05 and the Heat Provider is a short term alternative if we need features taht Nova is unable to surface because of virt API concerns 16:13:19 the bottom line is that nothing is set in stone, adn we have options 16:13:46 I learned that the deprecation of the Docker Nova Driver was not an issue about where it belonged 16:13:58 but an issue about Nova needing to pass test for the Icehouse release 16:14:07 correct 16:14:23 we had testing requirements set in place before the docker driver was merged, and the docker driver wasn't able to meet the requirements 16:14:33 this will be a topic of conversation in Atlanta where we can debate it constructively 16:14:34 so it's in a separate repo while the driver gets worked on, and testing put in place 16:14:45 we can consider merging it back in to nova in the future, potentially 16:14:46 right on, thanks for the info 16:14:57 russellb: are the only ones working on that Repo from Docker Inc? 16:15:17 requirements referred to: https://wiki.openstack.org/wiki/HypervisorSupportMatrix/DeprecationPlan 16:15:22 as I noticed that it's missing documentation as well 16:15:29 it's still brand new, so hard to say 16:15:35 #link https://wiki.openstack.org/wiki/HypervisorSupportMatrix/DeprecationPlan 16:15:42 russellb: thanks! 16:15:50 http://git.openstack.org/cgit/stackforge/nova-docker 16:16:02 any more thoughts on this before advancing to the next topic? 16:16:07 commits so far are just me and eric (from docker) 16:16:29 russellb: thanks 16:16:37 ok 16:16:41 #topic Mission Statement Review 16:16:49 #link https://etherpad.openstack.org/p/solum-mission Mission Statement 16:16:52 couple other contributors here: https://review.openstack.org/#/q/status:open+project:stackforge/nova-docker,n,z 16:16:57 we worked on this together in Raleigh 16:17:27 the current direction is to have a program mission statement that's centric to the OpenStack experience for Application Developers 16:17:53 and secondary mission statement(s) for projects an initiatives to support that theme of the program 16:18:05 that's where we landed after a few hours of discussion 16:19:18 I plan to take a pass through the etherpad, and select a few finalists for voting next week 16:19:38 does anyone have new ideas to share regarding the mission statement? 16:20:21 ok, next... 16:20:26 #topic Review Blueprints: https://launchpad.net/solum/+milestone/milestone-1 16:20:43 #link https://blueprints.launchpad.net/solum/+spec/api Solum API (aotto) 16:21:01 my understanding is that the APi is feature complete, with no outstanding defects. 16:21:18 does anyone have thoughts or concerns on this one? 16:22:00 any objections to marking this as complete? 16:22:53 ok, that is now marked as Implemented 16:23:03 #link https://blueprints.launchpad.net/solum/+spec/solum-minimal-cli Command Line Interface for Solum (devdatta-kulkarni) 16:23:18 This one also is complete. I will let muralia, stannie talk about it more 16:23:37 Yes, it is complete. We are able to create app and assembly 16:23:52 ok, that's marked as implemented. 16:23:56 there are no blockers on the CLI side for the initial workflow 16:24:01 By "app" you mean "plan"? 16:24:09 yes 16:24:15 yes, on the cli side its called app/ 16:24:23 Cool. 16:24:36 nothing more to add, CLI can be marked as implemented 16:24:43 #link https://blueprints.launchpad.net/solum/+spec/solum-git-pull Pull integration of Solum from an external Git repo (kraman) 16:24:57 This one is still being worked on. aratim has the latest.. 16:25:28 aratim.. any updates from your side on this? 16:25:39 just need to plug the trigger part to the worker part 16:25:40 it's in review, correct? 16:25:48 yes. it is in review. 16:26:09 is there any featurese that is not already submitted for review that is needed for M1? 16:26:10 julienvey: cool. thanks. 16:26:35 I don't see the review, do you have a link ? 16:26:36 no, everything is either merged or in review. 16:26:43 ok, I have marked that as In Review 16:26:47 all i'm working on is more thorough docs, no code at the moment 16:26:52 I think it's actually merged 16:27:06 yeah, looks like it is merged 16:27:14 hum 16:27:17 #link https://review.openstack.org/#/q/status:open+solum,n,z open reviews 16:27:31 ^ pin that tab if you use chrome 16:27:40 https://review.openstack.org/#/c/81923/ 16:27:44 my review got abandoned 16:27:51 working on the trigger workflow 16:28:04 https://review.openstack.org/#/c/81923/ 16:28:21 aratim and julienvey: do we need to revive that one? 16:28:44 adrian_otto: yes, it's a simple task 16:28:44 yes, I am planning to work on it 16:28:48 aratim: ok 16:28:53 It says git push workflow 16:29:37 it is trigger when you do a git push, but it is referenced in solum as the "git pull" workflow 16:29:41 It is the workflow which will be triggered when user pushes to git repo 16:29:43 git push is out of scope for M1, and pull is in scope 16:29:47 because solum will pull the git repo 16:30:07 so this review is in scope, correct julienvey? 16:30:22 yes, this is in scope 16:30:28 adrian_otto: yes 16:30:40 aratim: can you un-abandon it please? 16:31:02 sure 16:31:14 tx 16:31:17 next one... 16:31:20 #link https://blueprints.launchpad.net/solum/+spec/specify-lang-pack Specify the language pack to be used for app deploy (devdatta-kulkarni) 16:31:41 stannie, muralia made great progress on the remaining parts of this 16:31:59 stannie, muralia: could you update all on it :) 16:32:17 I just pushed a patch for language packs. 16:32:30 its currently a non-blocker, as w are using auto in the plan file. 16:32:50 https://review.openstack.org/67292 was merged, and that was the one for M1 scope 16:32:51 devkulkarni: julienvey added the missing method to POST, PUT, DELETE LP(s) 16:33:01 but once my patch gets merged, we'll be able to register new language packs. We need to test it. I think there is some plumbing that needs to be done on the api side 16:33:20 so I's it sensible to mark this as Implemented, or should we leave it as in-progress? 16:33:39 we can mark it implemented. 16:33:45 done 16:33:56 As we discussed at the end of the f2f meeting, I created a blueprint to store LP in glance, but this is out of scope for now 16:33:59 https://blueprints.launchpad.net/solum/+spec/store-language-packs-in-glance 16:34:09 julienvey: cool 16:34:14 julienvey: excellent! 16:34:29 ok, last blueprint for review today: 16:34:30 #link https://blueprints.launchpad.net/solum/+spec/deploy-workflow Workflow outlining deployment of a DU (asalkeld/devdatta-kulkarni) 16:34:38 datsun180b should have updates on this.. 16:34:57 well tbh julien's update covered the bases 16:34:58 datsun180b: floor is yours :) 16:35:07 stannie and I have a working version of the m1-run through deployment 16:35:16 we fixed the last remaining bugs 16:35:17 so have i! 16:35:17 julienvey, stannie: =1 16:35:20 +1 16:35:32 we only tested the nodejs-express plan 16:35:42 with yesterday's changes merged the 'fiddly bits' i mentioned yesterday seem to have been dissolved properly 16:36:22 so it it appropriate to mark this as implmented? 16:36:52 looking at that bp seems that's exactly what happens 16:37:02 datsun180b: yes 16:37:04 yes 16:37:25 ok, done 16:37:46 I will clean up the remainder of https://launchpad.net/solum/+milestone/milestone-1 today 16:38:10 https://review.openstack.org/#/c/84116/ 16:38:26 Isn't that required for m1 to be complete? 16:38:30 a moment of recognition for reaching this point. With some additional docs, we will complete this milestone. Well done everyone! 16:38:45 +1 16:38:59 yes, thanks everyone!! well done... 16:40:03 noorul: that is not in the critical path, no. We do want to fix that though, and should have a bug opened for it. 16:40:10 noorul: it can work without this fix, since in python code we already removes empty spaces, but it's better to remove empty space from the source sh 16:40:38 we managed to get M1 working without this fix with julienvey 16:40:39 adrian_otto: stannie ok 16:40:48 and just having an open review does not meet my expectations 16:40:58 as a review can expire, and we lose sigt of it 16:41:06 where a bug will persist until we address the issue 16:41:20 s/sigt/sight/ 16:41:31 but when you see the log when build-app sh is exectuted you see created_glance_id with an empty space which is weird. 16:41:44 #action adrian_otto to open a bug for https://review.openstack.org/84116 16:41:45 Ok, I am opening the bug adrian_otto 16:42:02 stannie, ok, great, thanks 16:42:16 next topic 16:42:26 #topic Review https://wiki.openstack.org/wiki/UnifiedGuestAgent for use in Solum 16:42:29 dmitryme: welcome 16:42:41 adrian_otto: thank you for introduction 16:42:49 #link https://wiki.openstack.org/wiki/UnifiedGuestAgent Unified Guest Agent 16:43:24 so, the agent is the designed to run on VM and execute commands coming from OpenStack Service 16:43:32 service like Solum 16:44:03 How secure is this? 16:44:15 the idea is that after you provisioned the app, you probably need to execute commands inside the app 16:44:29 noorul: security is one of the main concerns 16:44:43 Trove uses a guest agent model to do things like create databases 16:44:47 right now the agent is in the design/PoC state 16:45:14 datsun180b: right, we (Sahara) copied their design initially 16:45:35 dmitryme: Are signed payloads contemplated? 16:45:40 they communicate with the agent via queue: Rabbit or Qpid 16:45:59 I did not see any authorization and authentication design discussed 16:46:27 adrian_otto: regarding authorization, I think last thread covered that a little 16:46:37 basically it's a backdoor that can be used for any purpose, which really raises security concern 16:46:43 right now the main idea is to use Marconi for messaging 16:47:09 unlike other MQ solutions Marconi has multi-tenancy by design 16:47:26 multy-tenancy in terms of OpenStack 16:47:52 the key question at hand is: Does Solum have a need for a guest agent? 16:47:57 I have concerns about running an agent 16:48:09 adrian_otto: regarding backdoor, one of the ideas was to permit agent to issue only a limited set of commands 16:48:10 dmitryme: what do you need from Solum? specific use-cases? if so, what are the ways for solum folks to contribute these? add to the wiki page/send them to you? is there a working group that meets regularly on this? 16:48:19 adrian_otto: Not right now, I think we should rediscuss it when we need it 16:48:32 i think the need for an agent depends a lot upon what's running on the instance 16:48:38 it's a bit unusual for the 'application container' concept where you're running a single command in a container rather than a whole OS and its ecosystems 16:48:39 we have avoided that approach so far, preferring re-deployment of containers as an alternative to making changes within the guest. 16:48:42 I had a conversation with Angus yesterday 16:48:52 he spoke of one of the possible use cases 16:48:58 and so long as we're focused on stateless services chances i'm not sure about such a need 16:49:10 let me cite him 16:49:11 "it might make sense for and app developer to expose some operational commands via the guest, like backup/enable debug" 16:49:12 we might use a ceilometer guest to get operational metrics out. 16:50:13 right now I would like to hear from potential consumers, like Solum, if overall design of RPC over Marconi makes sense for you 16:50:19 dmitryme: that's true, that is a valid use case 16:51:09 my further thinking is to build that RPC on oslo.messaging by implementing Marconi driver for it 16:51:10 backup suggests stateful application, enable debug would be a change env_variable DEBUG=true, redeploy 16:51:16 dmitryme: do you have additional details about that design for us to consider? 16:51:55 paulczar: we may have containers that end up using cinder volumes for stateful apps 16:52:08 adrian_otto: probably it is a set of operations you would expect from the agent 16:52:16 that's not our fist wave of use cases, but we should get there 16:52:32 adrian_otto: I would suggest we use cinder tooling to provide backups for that use case 16:52:58 paulczar: I am not suggesting that an agent be offered by default 16:53:00 my preferred approach is that we avoid agent until we hit a use case that absolutely needs it 16:53:07 say, messaging provides 'cast' (fire and forget) and 'call' (these return result) operations 16:53:10 +1 16:53:16 paulczar: +1 16:53:22 paulczar: +1 16:53:27 but I can contemplate integration between components with operations that want to interact with a process int he container. 16:53:39 paulczar: makes sense to me as well 16:54:04 dmitryme: let's pause for a poll 16:54:21 who would like to revisit guest agents as an option for future consideration? 16:54:35 I will vote for that 16:54:36 +1 16:54:36 ++ future 16:54:38 adrian_otto: also if we use LXC or docker then we get opportunities to run things in the container using LXC commands to shell into the container 16:54:39 on need basis +1 16:54:45 +future. 16:54:51 +1 16:54:53 +future 16:54:55 +1 if needed revisit 16:54:56 yes, we can discuss it when we really need it 16:55:00 +1 future when we have clear use case(s) 16:55:05 +1 future 16:55:21 ok, any alternate viewpoints to consider prior to tabling the issue? 16:55:24 paulczar: did you consider to run Windows apps? It is my understanding that you can not do that with LXC 16:55:56 dmitryme: that's also a 'future' discussion 16:56:10 dmitryme: the guest agent is designed for Windows too? 16:56:15 the wiki did not mention that. 16:56:18 paulczar: right, I guess you guys are in the beginning 16:56:21 unless somebody has enough interest in windows to start working on windows integration 16:56:38 adrian_otto: if it is a python app, then why not? 16:56:56 it does not indicate taht it's a python app either 16:57:04 I assumed it would be a C++ thing 16:57:42 adrian_otto: the platform is not fixed 16:57:55 you can write oslo.messaging agent on any language 16:58:09 dmitryme: thanks for including us in the requirements gathering. We will think on this, and reach out to you if we have further guidance. 16:58:27 adrian_otto: sure, thank you for your attention 16:58:31 we can also talk about it in Atlanta 16:58:40 #topic Open Discussion 16:59:18 Any summary of outcome in Summit? 16:59:30 Angus opened a review for a new version of the API, more 'build-centric', it would be good to have others point of view https://review.openstack.org/#/c/84434/ 16:59:49 regarding Atlanta, I will am not going there, but I will ask my colleague Ruslan Kamaldinov to talk with people about design and use cases 17:00:11 dmitryme: ok 17:00:59 noorul: let's follow up in #solum 17:01:03 thanks ewveryone 17:01:07 everyone 17:01:10 thanks adrian 17:01:13 #endmeeting