Wednesday, 2013-08-07

*** dina_belova has joined #savanna00:09
*** dina_belova has quit IRC00:14
*** NikitaKonovalov has joined #savanna00:16
*** NikitaKonovalov has quit IRC00:20
*** dina_belova has joined #savanna01:10
*** crobertsrh has joined #savanna01:14
*** crobertsrh is now known as _crobertsrh01:15
*** dina_belova has quit IRC01:15
*** NikitaKonovalov has joined #savanna01:16
*** NikitaKonovalov has quit IRC01:20
*** sanek has quit IRC01:58
*** sanek has joined #savanna01:58
*** dina_belova has joined #savanna02:10
*** dina_belova has quit IRC02:15
*** NikitaKonovalov has joined #savanna02:16
*** NikitaKonovalov has quit IRC02:21
*** IlyaE has joined #savanna02:55
*** dina_belova has joined #savanna03:11
*** dina_belova has quit IRC03:16
*** NikitaKonovalov has joined #savanna03:17
*** NikitaKonovalov has quit IRC03:22
*** IlyaE has quit IRC03:32
*** SergeyLukjanov has joined #savanna03:59
*** dina_belova has joined #savanna04:11
*** dina_belova has quit IRC04:16
*** NikitaKonovalov has joined #savanna04:18
*** NikitaKonovalov has quit IRC04:22
*** dina_belova has joined #savanna04:33
*** dina_belova has quit IRC04:36
*** lastidiot has quit IRC04:41
*** IlyaE has joined #savanna04:55
*** Nadya has joined #savanna04:58
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040005:05
*** dina_belova has joined #savanna05:05
*** Nadya has quit IRC05:15
*** NikitaKonovalov has joined #savanna05:18
*** dina_belova has quit IRC05:22
*** NikitaKonovalov has quit IRC05:22
*** dina_belova has joined #savanna05:24
*** SergeyLukjanov has quit IRC05:48
*** akuznetsov has joined #savanna05:57
*** NikitaKonovalov has joined #savanna06:17
*** NikitaKonovalov has quit IRC06:21
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022706:31
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022706:34
*** NikitaKonovalov has joined #savanna06:51
*** Nadya has joined #savanna07:02
*** NikitaKonovalov has quit IRC07:05
*** ben_duyujie has joined #savanna07:26
*** NikitaKonovalov has joined #savanna07:29
*** SergeyLukjanov has joined #savanna07:30
*** dina_belova has joined #savanna07:40
*** Nadya has quit IRC07:43
*** IlyaE has quit IRC07:51
*** ben_duyujie has quit IRC07:54
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Migrate to pbr  https://review.openstack.org/3748008:02
openstackgerritSergey Lukjanov proposed a change to stackforge/savanna: Made Ambari RPM location configurable  https://review.openstack.org/4047908:03
*** dmitryme has joined #savanna08:13
*** nprivalova has joined #savanna08:23
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Tests module refactoring  https://review.openstack.org/4057208:25
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022708:33
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022708:35
*** ruhe has joined #savanna08:37
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022708:41
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Tests module refactoring  https://review.openstack.org/4057209:03
*** akuznetsov has quit IRC09:08
*** dina_belova has quit IRC09:12
*** ruhe has quit IRC09:15
*** ruhe has joined #savanna09:17
openstackgerritSergey Reshetnyak proposed a change to stackforge/savanna: Refactoring hdp plugin  https://review.openstack.org/3973309:23
*** dina_belova has joined #savanna09:42
*** dina_belova has quit IRC09:51
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040010:04
*** NikitaKonovalov has quit IRC10:21
*** ruhe has quit IRC10:25
*** nprivalova has quit IRC10:31
*** dina_belova has joined #savanna10:31
*** NikitaKonovalov has joined #savanna10:51
*** _crobertsrh is now known as crobertsrh10:53
*** NikitaKonovalov has quit IRC10:53
*** NikitaKonovalov has joined #savanna10:53
*** ruhe has joined #savanna10:55
*** nprivalova has joined #savanna10:55
*** akuznetsov has joined #savanna10:58
*** ruhe has quit IRC11:02
*** nprivalova has quit IRC11:14
openstackgerritAlexander Ignatov proposed a change to stackforge/savanna: Added basic helper for map-reduce actions  https://review.openstack.org/4059011:18
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040011:18
openstackgerritA change was merged to stackforge/savanna: Tests module refactoring  https://review.openstack.org/4057211:22
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added conductor API for DataSource object  https://review.openstack.org/4059111:22
*** dmitryme has quit IRC11:36
*** dmitryme has joined #savanna11:39
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: IT updating for "HDP" plugin  https://review.openstack.org/4036911:40
*** bogdando has quit IRC11:43
*** bogdando has joined #savanna11:45
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040011:45
*** nprivalova has joined #savanna11:50
openstackgerritYaroslav Lobankov proposed a change to stackforge/savanna: IT updating for "HDP" plugin  https://review.openstack.org/4036911:56
*** ruhe has joined #savanna11:58
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP  https://review.openstack.org/4022711:59
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added conductor API for DataSource object  https://review.openstack.org/4059111:59
*** akuznetsov has quit IRC12:03
*** NikitaKonovalov has quit IRC12:03
*** NikitaKonovalov has joined #savanna12:07
*** ranjan has joined #savanna12:18
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added conductor API for DataSource object  https://review.openstack.org/4059112:29
openstackgerritAlexander Kuznetsov proposed a change to stackforge/savanna: Added conductor API for DataSource object  https://review.openstack.org/4059112:32
ranjanHi, all, where can i find documentation on creating a CDH plugin for savanna?12:34
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040012:37
SergeyLukjanovranjan, hi12:37
ranjanSergeyLukjanov, hi,12:37
ranjanSergeyLukjanov, how are you :)12:37
SergeyLukjanovwe have two implemented plugins, you can use them as ref impl12:38
SergeyLukjanovadditionally we have docs here - http://savanna.rtfd.org12:38
SergeyLukjanovhttp://savanna.readthedocs.org/en/latest/devref/plugins.html http://savanna.readthedocs.org/en/latest/devref/plugin.spi.html12:38
SergeyLukjanovwe are now working on updating db access layer, so, code around db we be changed12:39
SergeyLukjanovthe new db code located in savanna/db_new module, I hope that will finish migration to it to the end of this week12:40
ranjanSergeyLukjanov, but other than vanilla hadoop which other plugin is there, and where is it available?12:42
SergeyLukjanovHDP plugin, https://github.com/stackforge/savanna/tree/master/savanna/plugins/hdp12:43
*** nprivalova has quit IRC12:43
ranjanSergeyLukjanov, okie.12:46
ranjanlet me check12:47
*** akuznetsov has joined #savanna12:47
SergeyLukjanovranjan, you're welcome12:47
SergeyLukjanovping us here or in mailing list if you'll have questions12:47
ranjanSergeyLukjanov, sure, thank you so much for the kind help and support.12:48
openstackgerritDmitry Mescheryakov proposed a change to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040012:57
*** nprivalova has joined #savanna12:57
*** _tstclair is now known as tstclair13:00
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Unit test for Conductor Manager improved  https://review.openstack.org/4061613:15
openstackgerritA change was merged to stackforge/savanna: A Resource implementation for Conductor  https://review.openstack.org/4040013:16
*** akuznetsov has quit IRC13:20
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Unit test for Conductor Manager improved  https://review.openstack.org/4061613:28
*** NikitaKonovalov has quit IRC13:28
*** dina_belova has quit IRC13:38
*** ruhe has quit IRC13:42
*** ruhe has joined #savanna13:44
*** ruhe has quit IRC13:45
*** dmitryme has quit IRC13:55
*** NikitaKonovalov has joined #savanna13:58
tmckayrhSergeyLukjanov, I have some general savanna execution path / db questions.  Are you available?13:59
* tmckayrh says, ah, the declarative_base, that's where the missing constructors went14:02
*** NikitaKonovalov has quit IRC14:03
*** dina_belova has joined #savanna14:05
nprivalovatmckayrh, hi!14:11
tmckayrhnprivalova, hello!14:12
nprivalovatmckayrh, do you know where JobOrigin in etherpad?  I can't find it14:12
tmckayrhyes. hold on... web history :)14:12
tmckayrhhttps://etherpad.openstack.org/savanna_API_draft_EDP_extensions14:13
nprivalovaoh… it called JobCodeStorage:14:13
tmckayrhnprivalova, are you looking for JobCodeStorage>14:14
tmckayrh?14:14
nprivalovaI thought that https://etherpad.openstack.org/edp_v3_components is up-to-date14:15
*** ruhe has joined #savanna14:15
tmckayrhnprivalova, yes, JobCodeStorage is here https://etherpad.openstack.org/edp_v3_components14:15
nprivalovabut it doesn't contain JobOrigin description14:16
tmckayrhBut I think that JobCodeStorage is a relic :)14:16
*** lastidiot has joined #savanna14:16
tmckayrhnprivalova, ack, we should maybe move/copy JobOrigin to edp components14:16
tmckayrhthis page ^^ is the object model, after all14:16
nprivalovayes. could you please do it? you are expert in JobOrigin :)14:17
tmckayrhnprivalova, looks like we have some duplication (on datasource object, too)14:17
tmckayrhhaha, expert, yes!14:17
tmckayrhnprivalova, okay, let's do this -> I'll update the api draft page to refer back to the components page for the object model, and put only api functions on that api page.14:18
tmckayrhall objects go on the components page under the object model section14:18
nprivalovagreat!14:19
tmckayrhnprivalova, I have a question about the execution path and organization in savanna.  Do you know much about the api -> database interactions?14:19
SergeyLukjanovtmckayrh, I'm here now :)14:20
SergeyLukjanovtmckayrh, what questions do you have?14:20
tmckayrhSergeyLukjanov, thanks!  still learning who does what in savanna :)  (both people and modules, haha)14:21
tmckayrhokay, here is my question14:21
*** NikitaKonovalov has joined #savanna14:21
tmckayrhfor cluster creation, the flow looks like it goes "rest api -> savanna service module -> database layer" when a cluster is defined14:21
tmckayrhAnd that includes spinning up the cluster in the service layer14:22
SergeyLukjanovyep, looks like this14:22
tmckayrhBut for something like adding a JobOrigin, there really is no service interaction to start up, I think.14:22
SergeyLukjanovbtw we are updating db layer now14:22
tmckayrhSo, how should the flow proceed?  "api -> db", where the api module references the db layer directly?  Or something in between?14:23
SergeyLukjanovI think that we'll call conductor directly from the api14:23
tmckayrhI don't want to break an abstraction, or introduce imports, etc, that are not wanted14:23
tmckayrhah, the conductor.  What is that exactly?14:23
SergeyLukjanovit's an abstraction around db ops14:23
SergeyLukjanovit'll be working locally for all services for now14:23
SergeyLukjanovbut in future we'll maybe transform it to separated service14:24
SergeyLukjanovif we'll need it14:24
tmckayrhokay, I'll take another look.  Thanks.14:24
SergeyLukjanovso conductor module could be used anywhere in the code14:24
SergeyLukjanovand db module we'll be used actually only in the conductor14:25
SergeyLukjanovhttps://wiki.openstack.org/wiki/Savanna/NextGenArchitecture14:25
SergeyLukjanov^^ here are some details about it14:25
SergeyLukjanovI hope that we'll move our current core code to use conductor till the end of week14:26
tmckayrhThanks, I'll re-read.  It may make more sense to me now.  Okay.  So, to create a JobOrigin, ultimately I need a validation (which means defining a json schema somewhere), and a db model for the type, and a template to render the json return result.  Is this right?14:26
*** dmitryme has joined #savanna14:28
*** IlyaE has joined #savanna14:29
*** lastidiot has quit IRC14:31
SergeyLukjanovtmckayrh, yes, validation isn't very important for the first time14:49
tmckayrhSergeyLukjanov, thanks, ack, just checking to make sure I've got the complete picture.14:50
*** dina_belova has quit IRC14:54
openstackgerritNikita Konovalov proposed a change to stackforge/savanna: Unit test for Conductor Manager improved  https://review.openstack.org/4061614:58
*** dina_belova has joined #savanna15:03
openstackgerritSergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils  https://review.openstack.org/3904315:07
*** key has joined #savanna15:07
*** dmitryme has quit IRC15:08
*** NikitaKonovalov has quit IRC15:10
*** lastidiot has joined #savanna15:11
*** NikitaKonovalov has joined #savanna15:14
*** rnirmal has joined #savanna15:18
*** dina_belova has quit IRC15:20
*** SergeyLukjanov has quit IRC15:20
*** NikitaKonovalov has quit IRC15:21
*** key4 has joined #savanna15:29
*** key has quit IRC15:32
*** gkleiman has joined #savanna15:38
*** ruhe has quit IRC15:41
*** NikitaKonovalov has joined #savanna15:52
*** NikitaKonovalov has quit IRC15:55
*** ruhe has joined #savanna15:59
*** tmckayrh is now known as _tmckayrh16:00
ruhetmckayrh, hi16:01
*** key has joined #savanna16:01
*** _tmckayrh is now known as tmckayrh16:02
tmckayrhruhe, hi16:02
tmckayrhruhe, what's up?  I was just going to grab some lunch.16:02
ruhei had a discussion with our field guys today. and they told me something, i need to apologise to you for. It turns out that many OS deployments don't have Swift installed16:03
*** key4 has quit IRC16:03
tmckayrh:) okay.16:03
ruhei've pushed for that approach recently. but now it seems like we need to pick something else16:03
ruheyesterday we discussed another option - store binaries in DB16:04
tmckayrhruhe, I was keeping an open mind.  nprivalova has been advocating job binary storage in hdfs at first, to avoid the complexities of copying from switf -> hdfs, or the issue of running from swift.16:04
tmckayrhruhe, yes.16:05
ruhetmckayrh, we need to keep binaries somewhere until the cluster starts. and HDFS will not be available until the cluster starts16:05
ruhethat's all i wanted to say. now you're free to go for lunch :)16:06
openstackgerritJonathan Maron proposed a change to stackforge/savanna: Made Ambari RPM location configurable  https://review.openstack.org/4047916:07
tmckayrhruhe, so that the collection of binaries can be established/maintained outside of savanna, is that the goal?  Populate it prior, or delete the cluster and create a new one, or populate hdfs on multiple clusters from the same external source?16:08
tmckayrhIt could be an external hdfs....  outside of savanna.  Ultimately we just need to be able to copy to the savanna cluster, right?16:09
tmckayrhruhe, but I have no problem with savanna db storage.  Just which one to pursure first.16:10
ruheright, we need some place to store binaries and we also need to be able to transfer those binaries into provisioned cluster16:10
*** dmitryme has joined #savanna16:10
nprivalovatmckayrh, we are considering the scenario that user uploads all binaries from his desktop. we need to place to store them16:10
tmckayrhruhe, okay.  I am still sneaking up on add/list/delete, "get" which implies copy to local hdfs will be last.  I think the first 3 are the same for any type....16:11
ruheright16:11
tmckayrhnprivalova, okay.16:11
tmckayrhruhe, nprivalova, thus far I don't think there is a "put binary" method in the proposed api.  Using the savanna db, we would need that.16:12
ruheyes16:12
tmckayrhruhe, nprivalova, should that be part of the JobOrigin api: "store to savanna db"16:13
nprivalovaI'm preparing a document with it16:13
tmckayrhI'm not sure we want to wrap upload functions for all storage types.... other things that already have an interface, like swift, don't need a savanna api to wrap it16:13
tmckayrhjust my thought16:14
openstackgerritIvan Berezovskiy proposed a change to stackforge/savanna-extra: Remove unnecessary variable 'WORKAROUND_BUG_1204824'  https://review.openstack.org/4066716:14
tmckayrhokay, thanks for the heads up.  Lunch, and then I will try to create something :)  I have been digging into sqlalchemy, I like to know how things work ;-)16:14
*** tmckayrh is now known as tmckayrh_lunch16:15
*** key has quit IRC16:42
*** key has joined #savanna16:42
*** dmitryme has quit IRC16:59
*** ruhe has quit IRC17:01
*** ranjan has quit IRC17:02
*** dmitryme has joined #savanna17:03
nprivalovaguys, please take a look on updated https://etherpad.openstack.org/edp_v3_components17:09
nprivalovayou are very welcome for comments17:10
*** dmitryme has quit IRC17:10
nprivalovaplease keep in mind that it is only a proposal but is is based on the latest discussions17:10
*** ruhe has joined #savanna17:11
*** IlyaE has quit IRC17:17
*** nprivalova has quit IRC17:22
*** lastidiot has quit IRC17:24
openstackgerritJonathan Maron proposed a change to stackforge/savanna: Made Ambari RPM location configurable  https://review.openstack.org/4047917:24
*** sacharya1 has joined #savanna17:24
*** sacharya1 has quit IRC17:24
*** ruhe has quit IRC17:30
*** mattf is now known as _mattf17:31
*** IlyaE has joined #savanna17:34
*** sa_ has joined #savanna17:35
*** _mattf is now known as mattf17:35
*** ruhe has joined #savanna17:39
*** ruhe has quit IRC17:46
*** tmckayrh_lunch is now known as tmckayrh17:49
*** sa_ has quit IRC17:54
*** sacharya has joined #savanna17:55
*** dina_belova has joined #savanna18:06
*** dina_belova has quit IRC18:14
*** dina_belova has joined #savanna18:28
tmckayrhcrobertsrh, I hit a problem similar to what I think you hit yesterday.  tox invocation complains about the version of python-keystoneclient.18:31
*** SergeyLukjanov has joined #savanna18:31
crobertsrhYeah18:31
tmckayrhdo  you know how to hack it?18:31
crobertsrhYour best bet is to blow away your .tox directory and to tools/install_venv again18:31
tmckayrhokay, thanks18:31
crobertsrhYou did a git pull, I assume18:32
tmckayrhyes, always want to be current :)18:32
SergeyLukjanovcrobertsrh, tmckayrh, hi18:34
SergeyLukjanovit should works ok now18:35
tmckayrhSergeyLukjanov, I recreated tox as crobertsrh suggested, it seems to be working.  Should I pull again?18:39
crobertsrhYeah, Sergey, I was able to get it working this morning again.18:39
crobertsrhI did have to blow away my .tox dir and recreate.   Just running tools/install_venv wasn't enough by itself for some reason.18:39
SergeyLukjanovtox caches envs and doesn't handle versions changes18:40
SergeyLukjanovit's sad :(18:43
tmckayrhSergeyLukjanov, simple question.  Would the savanna convention for URLs say "/job-origins" or "job_origins" ?  I see "/data-sources" in v11.py but on the etherpad it is "/data_sources".18:49
tmckayrhdash or underscore, basically18:49
SergeyLukjanovtmckayrh, dash in urls18:49
tmckayrhokey doke, dash it is18:50
SergeyLukjanovtmckayrh, for example, now we have cluster-templates, etc.18:50
*** Nadya has joined #savanna18:57
*** ruhe has joined #savanna18:58
*** NikitaKonovalov has joined #savanna19:02
*** Nadya_ has joined #savanna19:05
*** Nadya has quit IRC19:06
tmckayrhhmmm, my job origin api methods on https://etherpad.openstack.org/savanna_API_draft_EDP_extensions are ambiguous for "copy to destination"19:06
tmckayrhGET /v1.1/{tenant_id}/job-origins/{job_origin_id}                # Fetch details about job origin19:07
*** NikitaKonovalov has quit IRC19:07
tmckayrhGET /v1.1/tenant_id}/job-origins/{job_origin_id}                 # Copy a job from storage to a specified desination19:07
tmckayrhThat's not going to work19:07
tmckayrhSergeyLukjanov. ruhe, Nadya_, crobertsrh, how about this?19:08
* tmckayrh drumroll19:08
tmckayrhPOST /v1.1/tenant_id}/job-origins/{job_origin_id}                 # Takes dest url as json data, copy a job from storage to a specified desination19:09
Nadya_I need to read irc logs :)19:10
crobertsrhSo, this would be an action that could be performed on an already defined job_origin?19:10
crobertsrhOr is this something that would only be done as part of a job execution at execute time?19:10
tmckayrhYes.  It kind of implies that "update" is not supported.  "update" would have be delete and recreate19:10
tmckayrhWell, ultimately its point is execution.19:11
tmckayrhYou have to get the job binary from storage to hdfs where it can be run.19:11
tmckayrhBut I don't have a way yet to say "copy"19:11
tmckayrhI suppose it could be POST /v1.1/tenant_id}/job-origins/copy/{job_origin_id}19:12
crobertsrhI'm ok with the REST call.  I'm just wondering what, if anything in the UI winds-up using it.19:12
tmckayrhto be more explicit19:12
tmckayrhcrobertsrh, I'm not sure the UI needs it.19:12
tmckayrhIf someone really wants to suck job binaries out of storage via savanna, they can use http from the command line19:13
tmckayrhnot sure there is a UI use case for it19:13
crobertsrhRight....just making sure that I understood things correctly19:13
crobertsrhMaybe this could mirror the tagging of an image API19:13
tmckayrhas a web kind of guy, what do you think -- include the extra word to be more self documenting?19:13
crobertsrhimage/{image_id}/tag  where POST data is the tag19:14
tmckayrhbecause POST /v1.1/tenant_id}/job-origins/{job_origin_id} could someday legitimately be a mod to an existing record19:14
crobertsrhjob_origin/{job_origin_id}/copy POST is the URL19:14
tmckayrhie, change the credentials or the URI, etc19:14
tmckayrhcrobertsrh, +119:15
*** sacharya has quit IRC19:15
*** sacharya has joined #savanna19:16
tmckayrhcrobertsrh, okay, changed the pad to POST /v1.1/{tenant_id}/job-origins/{job_origin_id}/copy    # Copy a job from storage to a specified desination (url)19:16
* tmckayrh feels powerful because savanna is responding to my urls with canned strings :)19:18
crobertsrhcool :)19:19
tmckayrhwalk before we run, I always say ;-)19:19
Nadya_I have one concern about this. We need to create user-specific directory in hdfs for every job19:20
crobertsrhYeah, that's what I've been doing on the UI side.  I have ugly impls for jobs, job origins and data sources.19:20
tmckayrhNadya_, please elaborate19:21
Nadya_I do not have strong opinion about this, just to remind this :) not sure that tenant and job_origin_id is enough to determine user-specific directory19:22
Nadya_but maybe it isok for now...It means that if we use shared cluster (not specific for job) all users from tenant has access to jobs19:24
Nadya_is my point clear?19:24
tmckayrhah, so we do not have a way to scope the visibility of jobs to a particular user?19:25
Nadya_yes19:25
tmckayrhin other words, you can see all the job binaries that I define in the system, and I can see yours, as long as we each have a token for the same tenant19:25
tmckayrhhmmm19:26
tmckayrhNadya_, off the top of my head, it sounds like some kind of ACL or permissions associated with the job binary19:26
tmckayrhI wonder if openstack has a general solution to this?19:27
Nadya_unfortunately I dont know. we may discuss this on tomorrow meeting19:27
tmckayrhswift might have that, with the "account" concept19:27
tmckayrhsql storage probably does....19:27
tmckayrhI wonder what hdfs has...19:27
tmckayrhgood idea19:28
tmckayrhFor the moment I will assume we are all nice and like to share :)19:28
Nadya_I'm ok with it19:28
tmckayrhNadya_, btw, I looked at your proposal on the pad, it looks good to me.  I will look again more closely before tomorrow's meeting19:29
*** ruhe has quit IRC19:30
tmckayrhcrobertsrh, party tricks :) http://fpaste.org/30665/13759038/19:31
SergeyLukjanovbtw currently we have an OpenStack-style ACL19:32
SergeyLukjanovwith only tenant-specific objects19:32
SergeyLukjanovI think that we should add much more complex scoping especially for EDP needs19:33
tmckayrhSergeyLukjanov, so  the assumption is that if you are authorized for the tenant, it's okay that you can see all the jobs?19:33
tmckayrhah, I see.  now ====> future19:33
SergeyLukjanovtmckayrh, for now it's ok19:34
Nadya_yes, let it be per tenant19:34
tmckayrhbrb19:34
*** IlyaE has quit IRC19:36
SergeyLukjanovI have some thoughts about scoping and it looks like that we have 2 categories of permissions - read and write, I mean, that we need to be able to specify how can read data and how can write19:36
SergeyLukjanovso for both of them we can have several scopes - creator, creator's tenant and public19:37
Nadya_what component do you mean\?19:38
*** IlyaE has joined #savanna19:46
SergeyLukjanovNadya_, is it a question for me?^)19:51
Nadya_SergeyLukjanov,yes19:51
SergeyLukjanovI mean that all savanna objects could have such scoping options19:53
SergeyLukjanovwe need to discuss it, but theoretically it's possible :)19:54
*** IlyaE has quit IRC19:57
*** NikitaKonovalov has joined #savanna20:02
*** NikitaKonovalov has quit IRC20:07
*** gkleiman has quit IRC20:17
*** Nadya_ has quit IRC20:26
*** dina_belova has quit IRC20:34
*** IlyaE has joined #savanna20:39
*** IlyaE has quit IRC20:41
*** crobertsrh is now known as _crobertsrh20:52
*** NikitaKonovalov has joined #savanna21:03
*** NikitaKonovalov has quit IRC21:07
*** SergeyLukjanov has quit IRC21:11
*** mattf is now known as _mattf21:35
*** _mattf is now known as mattf21:43
*** dina_belova has joined #savanna21:44
*** tstclair is now known as _tstclair21:45
*** dina_belova has quit IRC21:47
*** NikitaKonovalov has joined #savanna22:03
*** NikitaKonovalov has quit IRC22:08
*** sacharya has quit IRC22:16
*** NikitaKonovalov has joined #savanna23:04
*** NikitaKonovalov has quit IRC23:09
*** sacharya has joined #savanna23:24
*** sacharya has quit IRC23:24
*** IlyaE has joined #savanna23:25
*** rnirmal has quit IRC23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!