*** lastidiot has joined #savanna | 00:02 | |
*** NikitaKonovalov has joined #savanna | 00:38 | |
*** NikitaKonovalov has quit IRC | 00:43 | |
*** lastidiot has quit IRC | 00:46 | |
*** NikitaKonovalov has joined #savanna | 01:39 | |
*** NikitaKonovalov has quit IRC | 01:43 | |
*** ben_duyujie has joined #savanna | 01:55 | |
*** lastidiot has joined #savanna | 02:05 | |
*** NikitaKonovalov has joined #savanna | 02:39 | |
*** NikitaKonovalov has quit IRC | 02:44 | |
*** IlyaE has quit IRC | 03:39 | |
*** SergeyLukjanov has joined #savanna | 03:39 | |
*** NikitaKonovalov has joined #savanna | 03:40 | |
*** NikitaKonovalov has quit IRC | 03:45 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Move path manipulations into function https://review.openstack.org/40148 | 03:54 |
---|---|---|
openstackgerrit | A change was merged to stackforge/savanna: Move path manipulations into function https://review.openstack.org/40148 | 04:06 |
*** ben_duyujie has quit IRC | 04:15 | |
*** NikitaKonovalov has joined #savanna | 04:41 | |
*** NikitaKonovalov has quit IRC | 04:45 | |
*** lastidiot has quit IRC | 04:47 | |
*** IlyaE has joined #savanna | 04:56 | |
*** dina_belova has joined #savanna | 05:22 | |
*** dina_belova has quit IRC | 05:25 | |
*** NikitaKonovalov has joined #savanna | 05:32 | |
*** NikitaKonovalov has quit IRC | 05:33 | |
*** SergeyLukjanov has quit IRC | 05:40 | |
*** ben_duyujie has joined #savanna | 06:14 | |
*** ben_duyujie has quit IRC | 06:55 | |
*** nprivalova has joined #savanna | 07:13 | |
*** IlyaE has quit IRC | 07:40 | |
*** ruhe has joined #savanna | 08:50 | |
*** leeuwenrjj has joined #savanna | 09:07 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring hdp plugin https://review.openstack.org/39733 | 09:09 |
leeuwenrjj | Hi, I am trying to setup Savanna on our test OpenStack environment and I run into a traceback related to getting the IP network: http://pastebin.com/dnC1fdGf | 09:12 |
ruhe | leeuwenrjj, hi | 09:13 |
leeuwenrjj | savanna/service/networks.py seems to give the name of the network and it looks like it is expecting a cidr instead | 09:13 |
ruhe | are you using quantum? | 09:13 |
leeuwenrjj | Yes | 09:13 |
ruhe | savanna doesn't support quantum/neutron yet. but it's in our plans: https://blueprints.launchpad.net/savanna/+spec/add-neutron-support | 09:14 |
leeuwenrjj | Okay, is it just here that it needs a modification or is it all over the place? | 09:15 |
ruhe | it's in networks.py mostly. but it requires some modifications to make it work with floating IPs assigned by neutron. | 09:16 |
leeuwenrjj | Thx, if we decide to work on the blueprint I'll let you know. Have to talk to some people first here. | 09:19 |
*** NikitaKonovalov has joined #savanna | 09:37 | |
*** dina_belova has joined #savanna | 09:37 | |
*** SergeyLukjanov has joined #savanna | 09:38 | |
*** NikitaKonovalov has quit IRC | 09:38 | |
*** NikitaKonovalov has joined #savanna | 09:38 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Fix foreign keys in new model https://review.openstack.org/40186 | 09:42 |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 09:49 |
*** NikitaKonovalov has quit IRC | 09:51 | |
*** NikitaKonovalov has joined #savanna | 10:04 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Fix foreign keys and table names in new model https://review.openstack.org/40186 | 10:04 |
*** dina_belova has quit IRC | 10:11 | |
*** ruhe has quit IRC | 10:15 | |
*** nprivalova has quit IRC | 10:16 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Fix foreign keys and table names in new model https://review.openstack.org/40186 | 10:20 |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Fix foreign keys and table names in new model https://review.openstack.org/40186 | 10:26 |
openstackgerrit | A change was merged to stackforge/savanna: Fix foreign keys and table names in new model https://review.openstack.org/40186 | 10:31 |
*** nprivalova has joined #savanna | 10:35 | |
*** key has joined #savanna | 10:38 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Docs build fixed https://review.openstack.org/40200 | 10:38 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Docs build fixed https://review.openstack.org/40200 | 10:40 |
*** dmitryme has joined #savanna | 10:40 | |
*** akuznetsov has joined #savanna | 10:40 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 10:42 |
*** ruhe has joined #savanna | 10:43 | |
openstackgerrit | A change was merged to stackforge/savanna: Docs build fixed https://review.openstack.org/40200 | 10:45 |
*** ben_duyujie has joined #savanna | 10:59 | |
*** dina_belova has joined #savanna | 11:02 | |
*** qwerty_nor has joined #savanna | 11:04 | |
*** NikitaKonovalov has quit IRC | 11:23 | |
*** NikitaKonovalov has joined #savanna | 11:26 | |
*** dina_belova has quit IRC | 11:59 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Conductor methods added https://review.openstack.org/39902 | 12:00 |
*** dina_belova has joined #savanna | 12:09 | |
openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 12:18 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Conductor methods added https://review.openstack.org/39902 | 12:24 |
openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 12:26 |
*** _crobertsrh is now known as crobertsrh | 12:26 | |
*** ruhe has quit IRC | 12:27 | |
*** ruhe has joined #savanna | 12:27 | |
*** akuznetsov has quit IRC | 12:59 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Created savanna-db-manage script for new DB https://review.openstack.org/40220 | 13:01 |
openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 13:02 |
*** dmitryme has quit IRC | 13:03 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Conductor methods added https://review.openstack.org/39902 | 13:06 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Conductor methods added https://review.openstack.org/39902 | 13:08 |
openstackgerrit | A change was merged to stackforge/savanna: Conductor methods added https://review.openstack.org/39902 | 13:12 |
*** NikitaKonovalov has quit IRC | 13:14 | |
openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 13:16 |
openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 13:17 |
*** ruhe has quit IRC | 13:18 | |
*** ben_duyujie has quit IRC | 13:20 | |
*** dina_belova has quit IRC | 13:20 | |
*** dina_belova has joined #savanna | 13:21 | |
*** ruhe has joined #savanna | 13:21 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 13:21 |
*** dina_belova has quit IRC | 13:25 | |
*** dina_belova has joined #savanna | 13:25 | |
*** _tstclair is now known as tstclair | 13:26 | |
*** NikitaKonovalov has joined #savanna | 13:28 | |
*** dina_belova has quit IRC | 13:30 | |
*** dmitryme has joined #savanna | 13:32 | |
*** ruhe has quit IRC | 13:35 | |
*** nprivalova has quit IRC | 13:41 | |
openstackgerrit | Jonathan Maron proposed a change to stackforge/savanna: Added validation checks to HDP plugin https://review.openstack.org/39973 | 13:41 |
*** ruhe has joined #savanna | 13:44 | |
*** tmckayrh has joined #savanna | 13:46 | |
*** nprivalova has joined #savanna | 13:47 | |
*** dina_belova has joined #savanna | 13:48 | |
*** NikitaKonovalov has quit IRC | 13:49 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP https://review.openstack.org/40227 | 13:56 |
tmckayrh | nprivalova, I have a question for you about the Job Origin api | 13:58 |
*** ruhe has quit IRC | 14:00 | |
tmckayrh | or SergeyLukjanov, or others :) | 14:00 |
*** nprivalova has quit IRC | 14:01 | |
*** dina_belova has quit IRC | 14:04 | |
*** dmitryme has quit IRC | 14:07 | |
*** nprivalova has joined #savanna | 14:13 | |
nprivalova | hi tmckayrh! | 14:13 |
tmckayrh | nprivalova, hi! Something is still a little fuzzy for me. This quote from the blueprints: | 14:14 |
tmckayrh | "* Get Job code, this code will be interact with plugin responsible for job source implementation" | 14:14 |
tmckayrh | from Job Origin (formerly Job Source) | 14:14 |
tmckayrh | nprivalova, do you know what "get" means precisely? Are we talking about copying to hdfs? | 14:15 |
tmckayrh | Or, maybe specify a destination for copy? | 14:15 |
tmckayrh | Or, do we actually return a script in a JSON object? (in the case of non-binaries) | 14:15 |
tmckayrh | Something else? | 14:15 |
tmckayrh | This is one of the Job Origin component's methods, btw | 14:16 |
*** akuznetsov has joined #savanna | 14:16 | |
*** rnirmal has joined #savanna | 14:17 | |
*** dina_belova has joined #savanna | 14:17 | |
tmckayrh | akuznetsov, oh, you're here too now :) Can you see the scrollback or should I repaste a question to nprivalova? | 14:17 |
*** dina_belova has quit IRC | 14:18 | |
*** NikitaKonovalov has joined #savanna | 14:19 | |
*** dina_belova has joined #savanna | 14:20 | |
*** lastidiot has joined #savanna | 14:20 | |
akuznetsov | tmckayrh get means that Job Origin component has ability to put job code to HDFS, so it will be available for Oozie | 14:22 |
*** NikitaKonovalov has quit IRC | 14:23 | |
*** NikitaKonovalov has joined #savanna | 14:23 | |
tmckayrh | akuznetsov, okay, thanks. Always hdfs? And, does the "get" call specify the destination, or does the result object tell the caller where the job went? | 14:23 |
akuznetsov | tmckayrh another option is to use a swift for storing job code | 14:25 |
akuznetsov | hdfs is better because in theory open stack cluster can work with swift | 14:26 |
akuznetsov | and the data for elastic processing can be stored for example in NoSQL database | 14:27 |
tmckayrh | akuznetsov, okay, so hdfs first maybe. But the idea is that the Job Origin component copies a job from storage (git, savanna db, another hdfs, etc) to hdfs (or swift someday) where it can be read directly for execution by hadoop. Correct? | 14:27 |
*** key4 has joined #savanna | 14:27 | |
*** ruhe has joined #savanna | 14:27 | |
*** key has quit IRC | 14:28 | |
akuznetsov | tmckayrh yes | 14:29 |
akuznetsov | tmckayrh for first it should be able copy job code from Swift to HDFS | 14:30 |
*** lastidiot has quit IRC | 14:30 | |
tmckayrh | akuznetsov, okay, thanks. My last question, then -- how much control does the caller of "get" have over where the file is copied to? Does the caller specify the whole destination path, or part of the path? | 14:31 |
akuznetsov | tmckayrh I think the caller should provide a path to hdfs dir where the job code will be stored | 14:32 |
tmckayrh | akuznetsov, okay, with the filename preserved. That makes sense. Thank you, this fills in some gaps in the blueprint/api/sequence. I'll see about adding extra detail in a few places. | 14:34 |
*** nprivalova has quit IRC | 14:46 | |
*** dmitryme has joined #savanna | 14:46 | |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 14:59 |
*** NikitaKonovalov has quit IRC | 15:03 | |
openstackgerrit | A change was merged to stackforge/savanna: Fix Ganglia service start failure https://review.openstack.org/39946 | 15:04 |
openstackgerrit | A change was merged to stackforge/savanna: Workflow creator https://review.openstack.org/39906 | 15:06 |
*** nprivalova has joined #savanna | 15:08 | |
*** rnirmal_ has joined #savanna | 15:12 | |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Created savanna-db-manage script for new DB https://review.openstack.org/40220 | 15:12 |
*** rnirmal has quit IRC | 15:13 | |
*** rnirmal_ is now known as rnirmal | 15:13 | |
*** lastidiot has joined #savanna | 15:19 | |
openstackgerrit | Alexander Kuznetsov proposed a change to stackforge/savanna: Added first version of model for EDP https://review.openstack.org/40227 | 15:20 |
*** nprivalova has quit IRC | 15:21 | |
*** NikitaKonovalov has joined #savanna | 15:21 | |
*** ruhe has quit IRC | 15:25 | |
*** ruhe has joined #savanna | 15:32 | |
*** tstclair has quit IRC | 15:34 | |
*** tstclair has joined #savanna | 15:47 | |
*** ruhe has quit IRC | 15:52 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Temporarily use sphinx 1.2b1 https://review.openstack.org/40242 | 15:53 |
*** dmitryme_ has joined #savanna | 15:54 | |
*** dmitryme has quit IRC | 15:55 | |
*** dmitryme_ is now known as dmitryme | 15:55 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Temporarily use sphinx 1.2b1 https://review.openstack.org/40242 | 15:56 |
openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/savanna: Refactoring remote utils https://review.openstack.org/39043 | 16:06 |
*** akuznetsov has quit IRC | 16:09 | |
*** SergeyLukjanov has quit IRC | 16:17 | |
*** NikitaKonovalov has quit IRC | 16:17 | |
*** dina_belova has quit IRC | 16:21 | |
*** dmitryme has quit IRC | 16:25 | |
*** ruhe has joined #savanna | 16:26 | |
tmckayrh | still honing in on the correct definitions for Job Origin Object on https://etherpad.openstack.org/savanna_API_draft_EDP_extensions | 16:33 |
tmckayrh | Is anybody here to discuss? | 16:33 |
tmckayrh | There still seems to be a mix in the Job Origin object example of values that 1) describe an endpoint, that is a storage depot and 2) a particular job | 16:35 |
tmckayrh | The example value ""URI": "swift://test/hello_word.q" names a specific job but I believe that should be ""URI": "swift://test/" | 16:35 |
tmckayrh | And "job_type" probably can be a list, because more than 1 type may be stored at a location | 16:36 |
tmckayrh | okay, modified https://etherpad.openstack.org/savanna_API_draft_EDP_extensions. Optimistically assuming I am correct :) | 16:45 |
*** IlyaE has joined #savanna | 16:51 | |
tmckayrh | ruhe, from our discussion on Thursday, we postulated a new component for storing uncompiled job source, and a build mechanism. Should these be the same component, and what do you think about a name? | 16:53 |
tmckayrh | ruhe, if they are the same, we could call it "Job Build Component". Trying to make a blueprint... | 16:54 |
tmckayrh | I'm not sure I want to reuse "Job Source Component" since it used to mean something else.... | 16:54 |
*** ruhe has quit IRC | 16:54 | |
tmckayrh | doh, something I said :) | 16:54 |
*** dina_belova has joined #savanna | 17:08 | |
*** NikitaKonovalov has joined #savanna | 17:18 | |
*** NikitaKo_ has joined #savanna | 17:22 | |
*** NikitaKonovalov has quit IRC | 17:22 | |
*** NikitaKo_ has quit IRC | 17:22 | |
*** SergeyLukjanov has joined #savanna | 17:22 | |
*** NikitaKonovalov has joined #savanna | 17:22 | |
*** NikitaKonovalov has quit IRC | 17:27 | |
*** ruhe has joined #savanna | 17:31 | |
ruhe | tmckayrh, hi | 17:33 |
ruhe | i think that JoSource should be a separate component from JobOrigin | 17:33 |
ruhe | and we need to find a new name for JobSource. new name should clearly indicate purpose of this component | 17:35 |
tmckayrh | ruhe, hi | 17:36 |
tmckayrh | I created a blueprint called "Job Build Component" but the question remains, should JobSource (uncompiled code management) and JobBuild be under one component or two? | 17:37 |
SergeyLukjanov | btw https://blueprints.launchpad.net/savanna/+spec/edp-job-build-component | 17:37 |
tmckayrh | thanks | 17:37 |
SergeyLukjanov | tmckayrh, hi! | 17:37 |
ruhe | tmckayrh, i guess we need pros and cons for two different approaches. if they're 2 separate component, there should be something above to manage them both | 17:39 |
tmckayrh | I could see it either way. In a two-component scenario, I suppose a Job Build Component would pull source code from a Job Source Component and then write the compiled output to the Job Origin Component. | 17:40 |
ruhe | if it's the same component, then it'll handle two different things: 1. Source code storages (git, svn, etc), 2. build systems: make, mvn, gradle, etc | 17:40 |
tmckayrh | agreed. | 17:40 |
*** dmitryme has joined #savanna | 17:40 | |
tmckayrh | I wonder if that's too much under one umbrella | 17:40 |
ruhe | i think - too much | 17:40 |
tmckayrh | It would make the Job Storage Component very simple -- the analog to Job Origin. Just register job source endpoints with location information. | 17:41 |
tmckayrh | oops, ^^ I meant "Job Source" | 17:41 |
ruhe | it should also have a plugin mechanism for different storages. right? | 17:41 |
tmckayrh | Whatever the new name is. | 17:42 |
tmckayrh | yes | 17:42 |
ruhe | it should be easier for native english speakers to find a proper name :) | 17:42 |
*** IlyaE has quit IRC | 17:42 | |
tmckayrh | I am almost wondering if "Job Source" and "Job Origin" have the same code base. The only difference is binary vs text in most cases | 17:42 |
tmckayrh | hehe | 17:42 |
tmckayrh | How about "Raw Storage Component" | 17:43 |
tmckayrh | or, rather boring, but "Uncompiled Source Component" | 17:43 |
ruhe | maybe "SourceCodeComponent" ? | 17:44 |
ruhe | ah | 17:44 |
ruhe | hmm | 17:44 |
tmckayrh | Okay, I like that. It's different enough from "Job Source" to not be confused with the past. | 17:44 |
ruhe | we can add JobSourceCodeComponent to make it more clear | 17:45 |
ruhe | *prepend Job | 17:45 |
tmckayrh | okay. So I should create a second blueprint and edit the description. | 17:46 |
ruhe | great | 17:46 |
tmckayrh | ruhe, what do you think about common code for JobSourceCodeCompnent and JobOrigin? It seems like add/list/delete/get would be almost if not completely the same, just the file type is different. | 17:47 |
tmckayrh | well, "get" for JO copies from storage to hdfs, for example. Not sure JobSourceCC has that function | 17:48 |
ruhe | hmm. i'm not sure about this. for SourceCode we have git, svn, etc. for JobOrigin - Swift, Gluster, HDFS, etc. API might be the same, but implementation is absolutely different | 17:48 |
tmckayrh | ruhe, I thought we also were considering git/svn/mercurial etc for JobOrigin. With a copy to a hadoop compatible file system for execution. | 17:49 |
ruhe | well, that might be useful in some scenarios. but who would store binaries in VCS? | 17:51 |
tmckayrh | from the blueprint... Maybe we have migrating ideas here :) | 17:51 |
SergeyLukjanov | maybe it'll be better to make build process transparent for end-user? | 17:51 |
tmckayrh | "We should provide a different way to get a job source code for execution. It can be stored in Git, Mercurial, Internal Savanna Database and etc. The support of different component is done via plugin mechanism. " | 17:51 |
tmckayrh | I wonder if the Job Source component started off meaning raw job source code, and then evolved into "binaries", and then we renamed it "origin", and now we are talking about source code again, hehe | 17:52 |
tmckayrh | ruhe, SergeyLukjanov, distributed development impact ^^. We need akuznetsov here to verify. | 17:54 |
ruhe | i'm not sure if he'll show up today. it's about 10PM here | 17:55 |
ruhe | good point to coordinate is etherpad | 17:55 |
tmckayrh | okay. I think we have some historical confusion on terms/components, but I think we are almost there. We might need to tweak the blueprints. | 17:56 |
*** dina_belova has quit IRC | 17:57 | |
ruhe | yes. we absolutely need to update all blueprints to reflect current understanding of components | 17:57 |
tmckayrh | Okay, I'll add something to the component etherpad | 17:57 |
*** IlyaE has joined #savanna | 17:57 | |
ruhe | thanks | 17:57 |
ruhe | i'll tell akuznetsov about our discussion | 17:58 |
tmckayrh | :) np. I like to put ducks in a row. | 17:58 |
*** ruhe has quit IRC | 18:05 | |
*** mattf is now known as _mattf | 18:07 | |
*** _mattf is now known as mattf | 18:12 | |
*** NikitaKonovalov has joined #savanna | 18:14 | |
*** dina_belova has joined #savanna | 18:20 | |
*** NikitaKonovalov has quit IRC | 18:32 | |
*** NikitaKonovalov has joined #savanna | 18:33 | |
openstackgerrit | A change was merged to stackforge/savanna: Added validation checks to HDP plugin https://review.openstack.org/39973 | 18:48 |
*** qwerty_nor has quit IRC | 18:50 | |
*** NikitaKonovalov has quit IRC | 18:50 | |
*** NikitaKonovalov has joined #savanna | 18:50 | |
*** NikitaKonovalov has quit IRC | 19:06 | |
*** NikitaKonovalov has joined #savanna | 19:07 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Improve coverage calculation https://review.openstack.org/40269 | 19:12 |
tmckayrh | SergeyLukjanov, ping | 19:13 |
SergeyLukjanov | tmckayrh, pong | 19:13 |
tmckayrh | SergeyLukjanov, still updating notes and things and thinking about how this works. Is there any reason that we want to be able to list job storage locations (like directories)? Or only the individual jobs? | 19:17 |
tmckayrh | SergeyLukjanov, somewhere along the line I got the idea that we wanted to manage directories (add/list/delete locations for storing jobs), but I think maybe that was a misunderstanding. | 19:18 |
SergeyLukjanov | hmm | 19:18 |
*** NikitaKonovalov has quit IRC | 19:18 | |
tmckayrh | I think maybe we just want the Job Origin Component to store binaries for individual jobs. | 19:19 |
*** NikitaKonovalov has joined #savanna | 19:19 | |
tmckayrh | This would explain some of the collisions in the etherpads, etc. | 19:19 |
SergeyLukjanov | affair we want to store jobs and then be able to run some job on some cluster | 19:19 |
tmckayrh | yes, ultimately | 19:20 |
tmckayrh | I'm not sure we care about being able to list storage locations (such as "I have an hdfs filesystem over here, and this type of stuff is stored there") | 19:21 |
SergeyLukjanov | I think that listing storage locations could be useful for end-user in UI | 19:27 |
tmckayrh | SergeyLukjanov, yes, just like a filesystem. Where might I find things? Where could I put things? I agree. | 19:30 |
*** NikitaKonovalov has quit IRC | 19:30 | |
*** NikitaKonovalov has joined #savanna | 19:30 | |
tmckayrh | So maybe there are 2 aspects to the UI: 1) store and retrieve specific job binaries by id and 2) find out about "filesystems" | 19:31 |
tmckayrh | I think I was mixing the two together, but I think the current api as outlined should be/is #1 ^^ | 19:31 |
tmckayrh | #2 maybe needs other functions | 19:31 |
*** ruhe has joined #savanna | 19:38 | |
tmckayrh | SergeyLukjanov (and ruhe) maybe the Job Origin api just needs to be a little richer... Maybe the list function for example could do path globbing, or specify "storage type" or "job type" as a search filter. that would narrow the results returned. | 19:40 |
*** ruhe has quit IRC | 19:41 | |
tmckayrh | It still might return too much information, though, if you were trying to find filesystems. | 19:42 |
*** dina_belova has quit IRC | 19:43 | |
openstackgerrit | A change was merged to stackforge/savanna: Improve coverage calculation https://review.openstack.org/40269 | 20:01 |
SergeyLukjanov | tmckayrh, I hope we'll added filter support for all list ops | 20:02 |
SergeyLukjanov | add* | 20:03 |
tmckayrh | agreed. I'm trying to imagine how one might request the list of all binaries from the job origin component and then filter it to learn about possible filesystems to use for binary storage. | 20:04 |
tmckayrh | Without putting specific records in the savanna db to describe storage systems. | 20:05 |
*** SergeyLukjanov has quit IRC | 20:07 | |
tmckayrh | I suppose it should be possible based on URI, but then there is the question of depth | 20:07 |
*** dmitryme has quit IRC | 20:08 | |
*** dmitryme has joined #savanna | 20:10 | |
*** NikitaKonovalov has quit IRC | 20:29 | |
*** NikitaKonovalov has joined #savanna | 20:30 | |
*** NikitaKonovalov has quit IRC | 20:35 | |
*** tstclair has quit IRC | 20:36 | |
*** tstclair has joined #savanna | 20:40 | |
*** dina_belova has joined #savanna | 20:44 | |
*** dina_belova has quit IRC | 20:48 | |
*** dina_belova has joined #savanna | 20:54 | |
*** key4 has quit IRC | 20:57 | |
*** key has joined #savanna | 20:57 | |
*** dina_belova has quit IRC | 20:58 | |
*** crobertsrh is now known as _crobertsrh | 21:08 | |
*** tmckayrh has quit IRC | 21:26 | |
*** dmitryme has quit IRC | 21:28 | |
*** NikitaKonovalov has joined #savanna | 21:35 | |
*** NikitaKonovalov has quit IRC | 21:39 | |
*** qwerty_nor has joined #savanna | 21:45 | |
*** rnirmal has quit IRC | 21:46 | |
*** dina_belova has joined #savanna | 21:54 | |
*** dina_belova has quit IRC | 21:59 | |
*** mattf is now known as _mattf | 22:18 | |
*** lastidiot has quit IRC | 22:23 | |
*** NikitaKonovalov has joined #savanna | 22:36 | |
*** IlyaE has quit IRC | 22:38 | |
*** NikitaKonovalov has quit IRC | 22:40 | |
*** IlyaE has joined #savanna | 22:43 | |
*** IlyaE has quit IRC | 22:46 | |
*** IlyaE has joined #savanna | 22:54 | |
*** dina_belova has joined #savanna | 22:55 | |
*** dina_belova has quit IRC | 22:59 | |
*** esmute has quit IRC | 23:03 | |
*** esmute has joined #savanna | 23:03 | |
*** jcooley has quit IRC | 23:03 | |
*** jcooley has joined #savanna | 23:06 | |
*** lastidiot has joined #savanna | 23:21 | |
*** NikitaKonovalov has joined #savanna | 23:35 | |
*** NikitaKonovalov has quit IRC | 23:40 | |
*** qwerty_nor has quit IRC | 23:52 | |
*** dina_belova has joined #savanna | 23:55 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!