| *** tmckayrh has quit IRC | 00:08 | |
| *** IlyaE has joined #savanna | 00:09 | |
| *** IlyaE has quit IRC | 00:21 | |
| *** sacharya has quit IRC | 00:42 | |
| *** IlyaE has joined #savanna | 00:44 | |
| *** IlyaE has quit IRC | 00:46 | |
| *** dina_belova has joined #savanna | 00:51 | |
| *** tmckayrh has joined #savanna | 00:52 | |
| *** dina_belova has quit IRC | 00:57 | |
| *** dina_belova has joined #savanna | 01:51 | |
| *** dina_belova has quit IRC | 01:56 | |
| *** dina_belova has joined #savanna | 02:52 | |
| *** dina_belova has quit IRC | 02:57 | |
| *** tmckayrh has quit IRC | 03:38 | |
| *** SergeyLukjanov has joined #savanna | 03:43 | |
| *** dina_belova has joined #savanna | 03:53 | |
| *** dina_belova has quit IRC | 03:58 | |
| *** dina_belova has joined #savanna | 04:53 | |
| *** bmahe has joined #savanna | 04:56 | |
| *** dina_belova has quit IRC | 04:58 | |
| *** akuznetsov has joined #savanna | 05:01 | |
| *** SergeyLukjanov has quit IRC | 05:55 | |
| *** SergeyLukjanov has joined #savanna | 05:56 | |
| *** SergeyLukjanov has quit IRC | 06:02 | |
| *** IlyaE has joined #savanna | 06:24 | |
| *** ruhe has joined #savanna | 06:33 | |
| *** IlyaE has quit IRC | 06:38 | |
| *** dina_belova has joined #savanna | 06:54 | |
| *** ruhe has quit IRC | 06:57 | |
| *** dina_belova has quit IRC | 06:58 | |
| *** dina_belova has joined #savanna | 06:58 | |
| *** dina_belova has quit IRC | 07:03 | |
| *** bmahe has quit IRC | 07:23 | |
| *** dina_belova has joined #savanna | 07:59 | |
| *** dina_belova has quit IRC | 08:03 | |
| *** SergeyLukjanov has joined #savanna | 08:04 | |
| *** akuznetsov has quit IRC | 08:09 | |
| *** dina_belova has joined #savanna | 08:09 | |
| *** dina_belova has quit IRC | 08:14 | |
| *** ruhe has joined #savanna | 08:29 | |
| *** nprivalova has joined #savanna | 08:33 | |
| *** SergeyLukjanov has quit IRC | 08:44 | |
| *** akuznetsov has joined #savanna | 08:48 | |
| *** SergeyLukjanov has joined #savanna | 08:49 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Oozie + MySQL configuration https://review.openstack.org/41652 | 08:54 |
|---|---|---|
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Oozie bug-fixing https://review.openstack.org/41432 | 08:54 |
| *** dmitryme has joined #savanna | 09:23 | |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Added conductor API for JobExecution Object https://review.openstack.org/41448 | 09:33 |
| openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Oozie bug-fixing https://review.openstack.org/41432 | 09:50 |
| openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Oozie bug-fixing https://review.openstack.org/41432 | 09:56 |
| openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Migration to Conductor https://review.openstack.org/40902 | 10:04 |
| *** akuznetsov has quit IRC | 10:08 | |
| *** dina_belova has joined #savanna | 10:10 | |
| *** dina_belova has quit IRC | 10:15 | |
| *** nprivalova has quit IRC | 10:19 | |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add hive DIB element https://review.openstack.org/41426 | 10:19 |
| *** akuznetsov has joined #savanna | 10:36 | |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Using 'selinux-permissive' element instead of command 'setenforce 0' https://review.openstack.org/40667 | 10:39 |
| *** nprivalova has joined #savanna | 10:45 | |
| *** dina_belova has joined #savanna | 10:55 | |
| *** ben_duyujie has joined #savanna | 10:58 | |
| *** ben_duyujie has quit IRC | 10:59 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Conductor code fixed and extended tests added https://review.openstack.org/41895 | 11:16 |
| openstackgerrit | A change was merged to stackforge/savanna: Made Ambari RPM location configurable https://review.openstack.org/40479 | 11:29 |
| openstackgerrit | A change was merged to stackforge/savanna: Add initial version of the REST api for the job origin component https://review.openstack.org/40936 | 11:47 |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna-extra: Fix Oozie element: * added symlinks to mysql-connector-java in oozie/libtools and oozie/oozie-server/lib https://review.openstack.org/41906 | 11:57 |
| openstackgerrit | A change was merged to stackforge/savanna: Conductor code fixed and extended tests added https://review.openstack.org/41895 | 12:07 |
| openstackgerrit | Nadya Privalova proposed a change to stackforge/savanna: Added conductor API for JobExecution Object https://review.openstack.org/41448 | 12:11 |
| *** SergeyLukjanov has quit IRC | 12:33 | |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna-extra: Fix Oozie element: * added symlinks to mysql-connector-java in oozie/libtools and oozie/oozie-server/lib https://review.openstack.org/41906 | 12:35 |
| *** tmckayrh has joined #savanna | 12:44 | |
| *** tmckayrh is now known as _tmckayrh | 12:45 | |
| _tmckayrh | be back soon | 12:45 |
| openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Oozie bug-fixing https://review.openstack.org/41432 | 12:49 |
| *** dina_belova has quit IRC | 12:51 | |
| *** dina_belova has joined #savanna | 12:54 | |
| *** SergeyLukjanov has joined #savanna | 12:59 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Fail tests if cluster in Error state https://review.openstack.org/41915 | 13:02 |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna-extra: Fix Oozie element https://review.openstack.org/41906 | 13:09 |
| openstackgerrit | Chad Roberts proposed a change to stackforge/savanna-dashboard: Adds EDP support in the UI https://review.openstack.org/41482 | 13:15 |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add hive DIB element https://review.openstack.org/41426 | 13:29 |
| *** rnirmal has joined #savanna | 13:29 | |
| *** dina_belova has quit IRC | 13:32 | |
| *** _tstclair is now known as tstclair | 13:34 | |
| *** _tmckayrh is now known as tmckayrh | 13:44 | |
| tmckayrh | nprivalova, ruhe, aignatov, what do you think of a "PUT" method in general to update objects? JobOrigin, for example, could use it. Otherwise, there is only delete/create to change description, url, credentials, etc etc | 13:46 |
| tmckayrh | I realized last night during code reviews that it was missing :) | 13:47 |
| openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Oozie + MySQL configuration https://review.openstack.org/41652 | 13:58 |
| akuznetsov | tmckayrh currently we have no method PUT for all object | 14:00 |
| akuznetsov | but in feature I think we will add this methods | 14:01 |
| *** dina_belova has joined #savanna | 14:01 | |
| tmckayrh | akuznetsov, should I go ahead and add a PUT for JobObjects now, or defer? | 14:02 |
| tmckayrh | I mean JobOrigin | 14:02 |
| akuznetsov | let concentrate on create and delate operation for now, copy is not trivial if for example current job origin is used in running job that is already scheduler but not in running state and waiting for cluster creation | 14:04 |
| tmckayrh | akuznetsov, ack, I was thinking about completeness in the api ("not yet implemented" maybe :) ). But you bring up a good point -- delete may also need extra checks when objects are referenced by running jobs. | 14:07 |
| aignatov | tmckayrh, I think you can add PUT method but with rising exception NotImplementedError | 14:07 |
| aignatov | Savanna have such behaviour for cluster and node group template obkjects | 14:08 |
| aignatov | *has | 14:08 |
| akuznetsov | for delete we have a foreign key constrain and it will raise exception in this case | 14:08 |
| *** aignatov has quit IRC | 14:10 | |
| tmckayrh | akuznetsov, good point. aignatov, okay -- I think it's a good note to the user/developer about future intentions. | 14:10 |
| *** aignatov has joined #savanna | 14:11 | |
| aignatov | here is example https://github.com/stackforge/savanna/blob/master/savanna/api/v10.py#L86-L89 | 14:13 |
| tmckayrh | bah, I hit the wrong button. I meant to publish comments and I published my draft CR. sigh. | 14:16 |
| *** ruhe has quit IRC | 14:16 | |
| tmckayrh | aignatov, thanks | 14:20 |
| mattf | SergeyLukjanov, have any input on the comment on https://bugzilla.redhat.com/show_bug.cgi?id=996720 - re runtime and re compatibility between 0.5.19 and 0.5.21 ? | 14:25 |
| SergeyLukjanov | mattf, hi | 14:25 |
| mattf | howdy | 14:26 |
| *** IlyaE has joined #savanna | 14:26 | |
| SergeyLukjanov | mattf, I hope that 0.5.19 will be enough in runtime for now | 14:26 |
| *** SergeyLukjanov has quit IRC | 14:28 | |
| mattf | afaik, we need 0.5.21 for building. if that's the case we need to either get 0.5.21 into f19 or wait ~5 months for f20 before savanna can be included | 14:28 |
| mattf | whoops | 14:28 |
| *** akuznetsov has quit IRC | 14:28 | |
| *** SergeyLukjanov has joined #savanna | 14:29 | |
| mattf | SergeyLukjanov, afaik, we need 0.5.21 for building. if that's the case we need to either get 0.5.21 into f19 or wait ~5 months for f20 before savanna can be included | 14:30 |
| SergeyLukjanov | the main problem is incorrect AUTHORS file generation | 14:30 |
| SergeyLukjanov | it has been fixed in 0.5.21 | 14:30 |
| mattf | brb, phone | 14:31 |
| *** nprivalova has quit IRC | 14:40 | |
| *** dina_belova has quit IRC | 14:52 | |
| *** dina_belova has joined #savanna | 14:58 | |
| *** SergeyLukjanov has quit IRC | 15:01 | |
| *** akuznetsov has joined #savanna | 15:02 | |
| *** SergeyLukjanov has joined #savanna | 15:03 | |
| *** nprivalova has joined #savanna | 15:03 | |
| *** sacharya has joined #savanna | 15:03 | |
| *** ruhe has joined #savanna | 15:03 | |
| openstackgerrit | Trevor McKay proposed a change to stackforge/savanna: Add a stub API method for updating a JobOrigin object https://review.openstack.org/41947 | 15:21 |
| openstackgerrit | Ivan Berezovskiy proposed a change to stackforge/savanna-extra: Add hive DIB element https://review.openstack.org/41426 | 15:25 |
| openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Added cluster states transition logging https://review.openstack.org/41952 | 15:41 |
| *** ruhe has quit IRC | 15:43 | |
| *** akuznetsov has quit IRC | 15:43 | |
| *** nprivalova has quit IRC | 15:44 | |
| openstackgerrit | A change was merged to stackforge/savanna: Fail tests if cluster in Error state https://review.openstack.org/41915 | 15:54 |
| openstackgerrit | Alexander Ignatov proposed a change to stackforge/savanna: Added cluster states transition logging https://review.openstack.org/41952 | 15:59 |
| openstackgerrit | A change was merged to stackforge/savanna: Oozie bug-fixing https://review.openstack.org/41432 | 16:01 |
| *** IlyaE has quit IRC | 16:11 | |
| openstackgerrit | John Speidel proposed a change to stackforge/savanna: Allow Ambari port to be specified in configuration https://review.openstack.org/41967 | 16:14 |
| *** dina_belova has quit IRC | 16:19 | |
| openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Improve exceptions handling in created threads https://review.openstack.org/41968 | 16:21 |
| *** dina_belova has joined #savanna | 16:22 | |
| *** SergeyLukjanov has quit IRC | 16:26 | |
| *** dina_belova has quit IRC | 16:26 | |
| *** akuznetsov has joined #savanna | 16:35 | |
| *** dmitryme has quit IRC | 16:39 | |
| *** dina_belova has joined #savanna | 16:53 | |
| *** SergeyLukjanov has joined #savanna | 16:58 | |
| *** dina_belova has quit IRC | 17:01 | |
| *** mattf is now known as _mattf | 17:15 | |
| *** IlyaE has joined #savanna | 17:15 | |
| *** shredder12 has joined #savanna | 17:20 | |
| *** shredder12 has quit IRC | 17:20 | |
| *** shredder12 has joined #savanna | 17:20 | |
| *** IlyaE has quit IRC | 17:26 | |
| openstackgerrit | Trevor McKay proposed a change to stackforge/savanna: Add a stub API method for updating a JobOrigin object https://review.openstack.org/41947 | 17:28 |
| *** sballe has joined #savanna | 17:39 | |
| *** _mattf is now known as mattf | 17:39 | |
| *** rnirmal has quit IRC | 17:40 | |
| *** shredder12 has quit IRC | 17:49 | |
| openstackgerrit | John Speidel proposed a change to stackforge/savanna: Allow Ambari port to be specified in configuration https://review.openstack.org/41967 | 17:53 |
| *** dina_belova has joined #savanna | 18:01 | |
| *** dina_belova has quit IRC | 18:02 | |
| *** dina_bel_ has joined #savanna | 18:02 | |
| *** dmitryme has joined #savanna | 18:07 | |
| *** akuznetsov has quit IRC | 18:15 | |
| *** akuznetsov has joined #savanna | 18:18 | |
| tmckayrh | general question about ConductorManagerTestCase. I see __init__() called with lambda functions that return sample objects, and teardown() appears to compare results with the objects generated by lambda,, but I don't see a case where any object is built into the result set from a test.... What am I missing? Is there a doc about this? | 18:33 |
| openstackgerrit | Trevor McKay proposed a change to stackforge/savanna: Add database support for the JobOrigin object https://review.openstack.org/41796 | 18:35 |
| dmitryme | there is no docs for that :-) The intention of that piece of code is to check that each test does not mangle samples | 18:36 |
| dmitryme | i.e. we check that each function do not change input parameter | 18:36 |
| tmckayrh | how would a test mangle the input parameter? | 18:37 |
| tmckayrh | ah, I see, maybe -- | 18:38 |
| tmckayrh | because the SAMPLE_CLUSTER, for instance, is a global? | 18:38 |
| dmitryme | yep | 18:38 |
| tmckayrh | very subtle :) | 18:38 |
| dmitryme | each test invokes API function like | 18:38 |
| dmitryme | self.api.cluster_create(ctx, SAMPLE_CLUSTER) | 18:38 |
| dmitryme | we need to check that API functions do not change parameter we pass in | 18:39 |
| tmckayrh | I understand now. The "self._results" threw me off, I thought maybe I should be writing result objects to self._results somehow. | 18:39 |
| tmckayrh | aignatov, about putting job binaries in the savanna db, I think I am ready to start looking at that. | 18:41 |
| dmitryme | no, you should not. Only if you create a new sample variable, add it to the check list | 18:41 |
| tmckayrh | dmitryme, ack, thanks | 18:41 |
| tmckayrh | aignatov, (and others) I have a question, though -- I wonder where the interface for "put it in the db" should be. I almost wonder if it should be a standalone python script, to manage binaries in the database, instead of an api function that takes a file path as an argument. What do you think? | 18:43 |
| tmckayrh | "instead of a REST api function" that is ^^ | 18:46 |
| SergeyLukjanov | tmckayrh, I think it'll be better to have a REST API call | 18:47 |
| tmckayrh | SergeyLukjanov, okay, so path will have to be an argument. Is it okay if I support only file:/// type URIs as a first pass? | 18:47 |
| akuznetsov | SergeyLukjanov rmckayrh possibly we should have two calls first for creation job origin and second for uploading files | 18:48 |
| akuznetsov | SergeyLukjanov tmckayrh possibly we should have two calls first for creation job origin and second for uploading files | 18:49 |
| tmckayrh | akuznetsov, we need a value for "storage_type" and/or the "url" in a JobOrigin object that indicates savanna db internal storage. | 18:50 |
| tmckayrh | akuznetsov, yes, I was imagining that the JobOrigin object could be created separately from the upload to the db. | 18:50 |
| tmckayrh | Either first, and don't force the binary to exist at that time | 18:51 |
| tmckayrh | Or, make reference to a non-existent binary an error and require the upload first | 18:51 |
| akuznetsov | tmckayrh possible we should rename url to location in JobOrigin, storage_type can internal_db and location will id or ids of the files | 18:51 |
| SergeyLukjanov | or it could be smth like db://uuid or swift://path/to/file | 18:52 |
| tmckayrh | (phone) good ideas | 18:54 |
| tmckayrh | SergeyLukjanov, akuznetsov, what do you think about checking existence in the database? Lazy, that is we do not require it on create of the JobOrigin? In that case it wouldn't be an error until it was referenced in an execution. | 18:56 |
| tmckayrh | That might be better, because someone might manipulate the database after JobOrigin is created anyway | 18:57 |
| tmckayrh | although, maybe a foreign key constraint solves that (as akuznetsov pointed out earlier today in a different situation) | 18:57 |
| *** sacharya1 has joined #savanna | 18:58 | |
| akuznetsov | tmckayrh I think for now it will be enough to have foreign key constrain | 18:59 |
| *** sacharya has quit IRC | 19:00 | |
| *** _crobertsrh has quit IRC | 19:05 | |
| *** crobertsrh has joined #savanna | 19:07 | |
| *** IlyaE has joined #savanna | 19:17 | |
| openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Migration to Conductor https://review.openstack.org/40902 | 19:19 |
| *** rnirmal has joined #savanna | 19:23 | |
| *** ruhe has joined #savanna | 19:24 | |
| *** ruhe has quit IRC | 19:39 | |
| *** akuznetsov has quit IRC | 19:48 | |
| *** IlyaE has quit IRC | 19:50 | |
| *** SergeyLukjanov has quit IRC | 19:58 | |
| *** sacharya1 has quit IRC | 19:58 | |
| *** tstclair has quit IRC | 20:01 | |
| *** sacharya has joined #savanna | 20:01 | |
| *** tstclair has joined #savanna | 20:07 | |
| openstackgerrit | Trevor McKay proposed a change to stackforge/savanna: Add database support for the JobOrigin object https://review.openstack.org/41796 | 20:09 |
| openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Migration to Conductor https://review.openstack.org/40902 | 20:10 |
| *** dmitryme has quit IRC | 20:10 | |
| openstackgerrit | Nirmal Ranganathan proposed a change to stackforge/savanna: Check for valid flavor on cluster create https://review.openstack.org/42005 | 20:25 |
| *** dina_bel_ has quit IRC | 20:39 | |
| *** tmckayrh has quit IRC | 20:41 | |
| openstackgerrit | Nirmal Ranganathan proposed a change to stackforge/savanna: Check for valid flavor on cluster create https://review.openstack.org/42005 | 20:43 |
| *** mattf is now known as _mattf | 20:54 | |
| *** _mattf is now known as mattf | 21:02 | |
| *** crobertsrh is now known as _crobertsrh | 21:02 | |
| *** tmckayrh has joined #savanna | 21:10 | |
| *** tmckayrh has quit IRC | 21:15 | |
| *** tstclair has quit IRC | 21:23 | |
| *** tstclair has joined #savanna | 21:25 | |
| *** IlyaE has joined #savanna | 21:37 | |
| *** dina_belova has joined #savanna | 21:40 | |
| *** dina_belova has quit IRC | 21:44 | |
| *** dina_belova has joined #savanna | 21:50 | |
| *** dina_belova has quit IRC | 21:55 | |
| *** rnirmal has quit IRC | 21:56 | |
| *** sacharya has quit IRC | 22:19 | |
| *** dina_belova has joined #savanna | 22:50 | |
| *** dina_belova has quit IRC | 22:55 | |
| *** sacharya has joined #savanna | 23:40 | |
| *** sacharya has quit IRC | 23:40 | |
| *** jmaron has left #savanna | 23:47 | |
| *** IlyaE has quit IRC | 23:49 | |
| *** dina_belova has joined #savanna | 23:50 | |
| *** dina_belova has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!