| *** IlyaE has joined #openstack-sahara | 00:02 | |
| *** witlessb has quit IRC | 00:35 | |
| *** IlyaE has quit IRC | 01:15 | |
| *** hdd has quit IRC | 01:43 | |
| *** guo has joined #openstack-sahara | 02:23 | |
| *** witlessb has joined #openstack-sahara | 02:56 | |
| *** witlessb has quit IRC | 03:01 | |
| *** Poornima has joined #openstack-sahara | 03:55 | |
| *** guo has quit IRC | 04:13 | |
| *** guo has joined #openstack-sahara | 04:15 | |
| *** IlyaE has joined #openstack-sahara | 04:17 | |
| *** IlyaE has quit IRC | 04:18 | |
| *** IlyaE has joined #openstack-sahara | 04:21 | |
| *** guo has quit IRC | 04:59 | |
| *** hdd has joined #openstack-sahara | 05:03 | |
| *** hdd has quit IRC | 05:31 | |
| *** IlyaE has quit IRC | 06:00 | |
| *** IlyaE_ has joined #openstack-sahara | 06:00 | |
| *** IlyaE_ has quit IRC | 06:32 | |
| *** IlyaE has joined #openstack-sahara | 06:47 | |
| *** tnovacik has joined #openstack-sahara | 06:56 | |
| *** pcaruana has joined #openstack-sahara | 07:19 | |
| *** tnovacik has quit IRC | 07:24 | |
| *** Longgeek has joined #openstack-sahara | 07:24 | |
| *** IlyaE has quit IRC | 07:56 | |
| *** IlyaE has joined #openstack-sahara | 08:27 | |
| *** Krast has joined #openstack-sahara | 08:42 | |
| *** witlessb has joined #openstack-sahara | 08:44 | |
| *** IlyaE has quit IRC | 08:47 | |
| *** k4n0 has joined #openstack-sahara | 08:47 | |
| *** IlyaE has joined #openstack-sahara | 08:48 | |
| *** Longgeek has quit IRC | 08:49 | |
| *** Longgeek has joined #openstack-sahara | 08:50 | |
| *** IlyaE has quit IRC | 08:51 | |
| *** skolekonov has joined #openstack-sahara | 09:01 | |
| *** stannie has joined #openstack-sahara | 09:18 | |
| *** witlessb has quit IRC | 09:24 | |
| *** witlessb has joined #openstack-sahara | 09:24 | |
| *** guo has joined #openstack-sahara | 09:27 | |
| *** guo has quit IRC | 09:59 | |
| *** ekarlso- has quit IRC | 10:07 | |
| *** ekarlso- has joined #openstack-sahara | 10:07 | |
| *** Poornima has quit IRC | 11:16 | |
| *** stannie has quit IRC | 12:34 | |
| *** tellesnobrega has quit IRC | 12:56 | |
| *** tellesnobrega has joined #openstack-sahara | 13:08 | |
| *** hdd has joined #openstack-sahara | 13:56 | |
| *** tmckay has joined #openstack-sahara | 14:05 | |
| *** _crobertsrh is now known as crobertsrh | 14:08 | |
| *** witlessb_ has joined #openstack-sahara | 14:22 | |
| *** venza has joined #openstack-sahara | 14:23 | |
| openstackgerrit | Alexander Ignatov proposed openstack/sahara: Add one more sample for pig job examples https://review.openstack.org/141782 | 14:30 |
|---|---|---|
| *** witlessb has quit IRC | 14:30 | |
| *** k4n0 has quit IRC | 14:30 | |
| *** uvirtbot has quit IRC | 14:30 | |
| *** venza_ has quit IRC | 14:30 | |
| *** juice has quit IRC | 14:30 | |
| *** witlessb_ is now known as witlessb | 14:30 | |
| *** juice has joined #openstack-sahara | 14:30 | |
| *** k4n0 has joined #openstack-sahara | 14:31 | |
| *** tellesnobrega has quit IRC | 14:40 | |
| *** tellesnobrega has joined #openstack-sahara | 14:40 | |
| *** tnovacik has joined #openstack-sahara | 14:42 | |
| *** uvirtbot has joined #openstack-sahara | 14:45 | |
| *** witlessb has quit IRC | 15:06 | |
| *** egafford has joined #openstack-sahara | 15:06 | |
| *** witlessb has joined #openstack-sahara | 15:07 | |
| *** hdd has quit IRC | 15:11 | |
| *** witlessb_ has joined #openstack-sahara | 15:11 | |
| *** tnovacik has quit IRC | 15:12 | |
| *** witlessb has quit IRC | 15:12 | |
| *** witlessb_ is now known as witlessb | 15:12 | |
| *** shakamunyi has joined #openstack-sahara | 15:16 | |
| *** shakamunyi has quit IRC | 15:16 | |
| *** k4n0 has quit IRC | 15:25 | |
| *** k4n0 has joined #openstack-sahara | 15:25 | |
| *** egafford has quit IRC | 15:25 | |
| *** egafford has joined #openstack-sahara | 15:25 | |
| *** IlyaE has joined #openstack-sahara | 15:30 | |
| *** IlyaE has quit IRC | 15:30 | |
| *** hdd has joined #openstack-sahara | 15:38 | |
| *** pcaruana has quit IRC | 15:42 | |
| *** guo has joined #openstack-sahara | 16:01 | |
| *** guo has quit IRC | 16:13 | |
| *** vrovachev has joined #openstack-sahara | 16:21 | |
| *** skolekonov has quit IRC | 16:28 | |
| *** crobertsrh has quit IRC | 17:20 | |
| *** k4n0 has quit IRC | 18:06 | |
| tellesnobrega | tmckay, hi | 18:10 |
| tmckay | hi | 18:10 |
| tellesnobrega | so, Storm EDP | 18:10 |
| tellesnobrega | the idea is to implement to possibility to deploy jobs from sahara ui? | 18:10 |
| tmckay | yes, or the CLI | 18:11 |
| tmckay | the 3 basic operations are run, status, cancel | 18:11 |
| tmckay | well, maybe not the exact names :) | 18:12 |
| tellesnobrega | ok | 18:12 |
| tmckay | the spark EDP engine is a good example of something that just uses ssh and commands. The oozie engine is one that uses a client | 18:12 |
| tellesnobrega | all right | 18:13 |
| tellesnobrega | so the next step is to create a spec for this | 18:13 |
| tellesnobrega | i will take a look on spark and oozie edp | 18:13 |
| tmckay | tellesnobrega, the general idea is that a job_execution refers to a job (which refers to binaries) and contains configs/params/arguments | 18:14 |
| tmckay | the edp engine uploads whatever binaries it needs to upload to the cluster, and launches the job with the given arguments | 18:14 |
| tmckay | configs/params/args can be a little confusing at first -- not all job types support all argument types :) | 18:15 |
| * tmckay looks for the page | 18:15 | |
| tellesnobrega | ok | 18:15 |
| tmckay | http://docs.openstack.org/developer/sahara/userdoc/edp.html | 18:16 |
| tmckay | that's a good overview | 18:16 |
| *** crobertsrh has joined #openstack-sahara | 18:16 | |
| tellesnobrega | awesome | 18:16 |
| tellesnobrega | i will take a look and start drafting a spec | 18:17 |
| tmckay | tellesnobrega, the java/spark job types are probably the most like storm jobs, I am guessing | 18:17 |
| tellesnobrega | i think so too | 18:17 |
| tmckay | maybe some config values to the job runner, and then an arg list | 18:17 |
| tellesnobrega | the whole storm plugin was based on spark | 18:17 |
| tellesnobrega | i guess edp will follow | 18:17 |
| tellesnobrega | :) | 18:17 |
| tmckay | okay. The spark edp engine is pretty simple, everything is done directly with spark-submit | 18:18 |
| tmckay | and general linux commands | 18:18 |
| crobertsrh | I had a UI patch up for Storm EDP awhile back...I suspect it will need some attention. | 18:19 |
| tmckay | ack | 18:20 |
| tellesnobrega | storm jobs are submitted fairly easily. All is needed is to call storm required options and jar file. I think i will need to request the user to upload this file and the parameter to it | 18:23 |
| tellesnobrega | i dont think it will be too complicated to submit | 18:23 |
| tellesnobrega | crobertsrh, i will look for it and get back to you | 18:24 |
| crobertsrh | Ok. I think I recall that the patch was fairly simple. | 18:24 |
| crobertsrh | https://review.openstack.org/#/c/112408/ | 18:24 |
| tellesnobrega | thanks | 18:24 |
| crobertsrh | ^^ That was it. | 18:24 |
| tellesnobrega | great | 18:28 |
| crobertsrh | Still looking for input on a couple of specs I have open. https://review.openstack.org/#/q/status:open+project:openstack/sahara-specs,n,z | 18:49 |
| elmiko | crobertsrh: i'll try to take a look today | 18:50 |
| crobertsrh | The template editing needs lots of love. I need to dig into the guts more to be able to write about how to change it. Definitely would like input from you and tmckay and whoever else. | 18:51 |
| crobertsrh | My expertise diminishes as I dig from the UI -> client library -> service | 18:52 |
| crobertsrh | I'm hoping to change that a bit this release | 18:52 |
| tmckay | crobertsrh, ack. Trying to get this arg thing committed today, then I'll hit reviews | 18:52 |
| elmiko | i think i missed the template editing one. the default templates one is marked wip, is that just to get comments? | 18:53 |
| crobertsrh | Ok. I think I'll start a blueprint for Horizon wizard stuff in the meantime | 18:53 |
| crobertsrh | Yes, WIP to get comments | 18:53 |
| crobertsrh | more than comments are welcome....suggest entire chunks. | 18:53 |
| elmiko | k, added it to the queue =) | 18:54 |
| crobertsrh | I'm hoping to be able to get to real coding at some point :) | 18:55 |
| elmiko | lol | 18:55 |
| elmiko | i know the feeling, this security doc is really taking it out of me... | 18:55 |
| elmiko | crobertsrh: btw, are you at the club now? | 18:58 |
| crobertsrh | ah....Indeed, I am. | 18:58 |
| elmiko | i should head over for a few | 18:58 |
| crobertsrh | I'll be here all afternoon :) | 18:58 |
| crobertsrh | The couches aren't too bad | 18:59 |
| elmiko | cool, at the least we could talk over the specs | 18:59 |
| crobertsrh | Absolutely | 18:59 |
| *** witlessb has quit IRC | 19:15 | |
| openstackgerrit | Merged openstack/sahara: Imported Translations from Transifex https://review.openstack.org/141542 | 19:15 |
| *** witlessb has joined #openstack-sahara | 19:18 | |
| *** hdd has quit IRC | 19:48 | |
| *** hdd has joined #openstack-sahara | 19:55 | |
| *** tellesnobrega has quit IRC | 21:15 | |
| *** tellesnobrega has joined #openstack-sahara | 21:17 | |
| SergeyLukjanov | folks, we're going to tag kilo-1 in ~ 12 hours | 21:46 |
| SergeyLukjanov | if any objections, please, ping me | 21:46 |
| *** Longgeek has quit IRC | 21:53 | |
| *** crobertsrh has quit IRC | 22:00 | |
| elmiko | yay for kilo-1 ! | 22:32 |
| openstackgerrit | Trevor McKay proposed openstack/sahara: Add options supporting DataSource identifiers in job_configs https://review.openstack.org/142248 | 22:46 |
| *** tmckay has left #openstack-sahara | 22:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!