*** IlyaE has joined #savanna | 00:18 | |
*** IlyaE has quit IRC | 00:23 | |
*** matsuhashi has joined #savanna | 00:28 | |
*** nosnos has joined #savanna | 00:45 | |
*** IlyaE has joined #savanna | 00:50 | |
*** IlyaE has quit IRC | 01:37 | |
*** sacharya has quit IRC | 05:13 | |
*** bmahe has joined #savanna | 05:39 | |
*** SergeyLukjanov has joined #savanna | 05:40 | |
*** IlyaE has joined #savanna | 05:51 | |
*** SergeyLukjanov has quit IRC | 05:54 | |
*** matsuhashi has quit IRC | 06:01 | |
*** nosnos has quit IRC | 06:08 | |
*** matsuhashi has joined #savanna | 06:24 | |
*** IlyaE has quit IRC | 06:32 | |
*** nosnos has joined #savanna | 06:54 | |
*** tvb has joined #savanna | 07:32 | |
*** aignatov has quit IRC | 08:27 | |
*** aignatov has joined #savanna | 08:28 | |
*** bmahe has quit IRC | 08:33 | |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna-extra: Implemented data locality for Swift https://review.openstack.org/47824 | 08:49 |
---|---|---|
*** SergeyLukjanov has joined #savanna | 09:20 | |
*** dmitryme has joined #savanna | 09:33 | |
*** akuznetsov has joined #savanna | 09:44 | |
*** _tmckay has quit IRC | 09:45 | |
*** tvb has quit IRC | 09:52 | |
*** tvb has joined #savanna | 09:53 | |
openstackgerrit | Ilya Tyaptin proposed a change to stackforge/savanna: Trusts for longrunning tasks https://review.openstack.org/44706 | 09:53 |
*** akuznetsov has quit IRC | 09:57 | |
*** NikitaKonovalov has joined #savanna | 10:06 | |
*** NikitaKonovalov has quit IRC | 10:10 | |
*** NikitaKonovalov has joined #savanna | 10:13 | |
*** SergeyLukjanov has quit IRC | 10:18 | |
*** SergeyLukjanov has joined #savanna | 10:19 | |
*** NikitaKonovalov has quit IRC | 10:23 | |
*** matsuhashi has quit IRC | 10:28 | |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna-dashboard: Job configs based on job type https://review.openstack.org/48290 | 10:51 |
*** nosnos has quit IRC | 11:32 | |
*** dmitryme has quit IRC | 12:02 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Starting Job Execution in separate thread https://review.openstack.org/49737 | 12:11 |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna: Starting Job Execution in separate thread https://review.openstack.org/49737 | 12:21 |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna: Added rack topology configuration for hadoop cluster https://review.openstack.org/49742 | 12:26 |
*** _crobertsrh has left #savanna | 12:38 | |
*** SergeyLukjanov has quit IRC | 12:48 | |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna: Added rack topology configuration for hadoop cluster https://review.openstack.org/49742 | 12:53 |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna: Added rack topology configuration for hadoop cluster https://review.openstack.org/49742 | 13:04 |
*** crobertsrh has joined #savanna | 13:07 | |
*** SergeyLukjanov has joined #savanna | 13:10 | |
crobertsrh | Ok...[hopefully] simple question. If I wanted to run one of the hadoop-example.jar jobs via savanna-api (and eventually the savanna UI) (pi, for example). What should my job params be set to? Or is that sort of job not currently supported? I'm just looking for a quick job that I can run each time I fire up a cluster for a quick sanity check. | 13:13 |
crobertsrh | Or...in other words. What is the absolute minimal path I can take to run a (even trivial) hadoop job on a cluster via savanna? Something like this might be useful in the docs. | 13:13 |
openstackgerrit | Nikolay Mahotkin proposed a change to stackforge/savanna: Fix Hive config properties for EDP https://review.openstack.org/49752 | 13:23 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Sync with global requirements https://review.openstack.org/49754 | 13:29 |
openstackgerrit | A change was merged to stackforge/savanna-extra: Implemented data locality for Swift https://review.openstack.org/47824 | 13:54 |
*** rnirmal has joined #savanna | 14:14 | |
aignatov | hi, crobertsrh, actually I didn't find a way how to submit simple PI Jar job via UI | 14:20 |
crobertsrh | me neither :P( | 14:20 |
aignatov | I was able to run jar job using oozie-examples | 14:20 |
aignatov | via EDP UI | 14:20 |
crobertsrh | care to paste me the api calls? | 14:21 |
crobertsrh | or ui sequence? | 14:21 |
aignatov | do you have cluater running with Oozie? | 14:21 |
aignatov | *cluster | 14:21 |
aignatov | ok, I will create simple etherpad doc with that | 14:22 |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna-extra: Added -source 1.5 to pom.xml https://review.openstack.org/49760 | 14:30 |
crobertsrh | I do | 14:30 |
crobertsrh | thanks | 14:30 |
*** IlyaE has joined #savanna | 14:33 | |
*** dmitryme has joined #savanna | 14:47 | |
aignatov | crobertsrh, https://etherpad.openstack.org/savanna-0.3-edp-running-jobs | 14:48 |
crobertsrh | Thanks! | 14:48 |
aignatov | rough way of executing jobs | 14:48 |
aignatov | trying to explain how to create Pig job using UI | 14:48 |
aignatov | it will be simplier than MR jar I think | 14:49 |
crobertsrh | aignatov: Question about the DataSources. What should those URLs wind-up looking like? | 14:49 |
aignatov | swift://<container>.savanna/<path_to_input> | 14:51 |
crobertsrh | Is the ".savanna" part required, or is that something specific to your install? | 14:51 |
aignatov | I think this is required | 14:53 |
aignatov | I've just realised that seeing this https://github.com/stackforge/savanna/blob/master/savanna/swift/resources/conf-template.xml#L30 | 14:54 |
aignatov | the savanna is included into all swift related confgis | 14:54 |
*** tvb has quit IRC | 14:55 | |
*** ivan1 has left #savanna | 14:58 | |
*** sacharya has joined #savanna | 14:59 | |
openstackgerrit | Nikita Konovalov proposed a change to stackforge/savanna-dashboard: Cluster Details page improved https://review.openstack.org/49766 | 15:03 |
aignatov | crobertsrh, I've updated doc. It seems that running pig job is more simplier than Jars | 15:16 |
openstackgerrit | A change was merged to stackforge/savanna: Trusts for longrunning tasks https://review.openstack.org/44706 | 15:16 |
crobertsrh | great. This is all good info. Both for current docs and for roadmap items going forward. | 15:17 |
openstackgerrit | Dmitry Mescheryakov proposed a change to stackforge/savanna: Increase timeout for decomission operation https://review.openstack.org/49773 | 15:23 |
crobertsrh | aignatov: Hmm, looks like the image I grabbed might be outdated...seems to be using oozie 3.3.2 instead of 4.0. Do you have a link to a newer image I can grab, or should I build my own? | 15:31 |
aignatov | just give me a sec | 15:32 |
aignatov | http://savanna-files.mirantis.com/savanna-0.3-vanilla-1.2.1-ubuntu-13.04.qcow2 ubuntu image | 15:33 |
aignatov | http://savanna-files.mirantis.com/savanna-0.3-vanilla-1.2.1-fedora-19.qcow2 Fedora image | 15:33 |
crobertsrh | Thanks. | 15:34 |
crobertsrh | darn, that (ubuntu) image is the same one I was using. | 15:42 |
openstackgerrit | A change was merged to stackforge/savanna-dashboard: Job configs based on job type https://review.openstack.org/48290 | 16:03 |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna-extra: Added -source 1.6 to pom.xml https://review.openstack.org/49760 | 16:13 |
*** SergeyLukjanov has quit IRC | 16:23 | |
*** dmitryme has quit IRC | 16:32 | |
*** tvb has joined #savanna | 16:35 | |
*** mattf is now known as _mattf | 16:46 | |
*** _mattf is now known as mattf | 16:54 | |
*** SergeyLukjanov has joined #savanna | 17:03 | |
*** dmitryme has joined #savanna | 17:08 | |
*** dmitryme has quit IRC | 17:20 | |
openstackgerrit | A change was merged to stackforge/savanna-dashboard: Cluster Details page improved https://review.openstack.org/49766 | 17:28 |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna: Added rack topology configuration for hadoop cluster https://review.openstack.org/49742 | 17:51 |
*** sacharya has quit IRC | 18:29 | |
*** sacharya has joined #savanna | 18:29 | |
*** sacharya1 has joined #savanna | 18:31 | |
*** sacharya has quit IRC | 18:34 | |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Bump cinder client version to 1.0.6 https://review.openstack.org/49811 | 19:20 |
crobertsrh | With both the ubuntu and fedora images (0.3...1.2.1) from savanna-files.mirantis.com, I'm seeing oozie fail to start. Here is what I'm seeing in my oozie's catalina.out http://fpaste.org/44409/09149081/ Any thoughts? | 19:29 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna: Bump savanna client version to 0.3-rc1 https://review.openstack.org/49813 | 19:30 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna-dashboard: Bump savanna client version to 0.3-rc1 https://review.openstack.org/49814 | 19:30 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/python-savannaclient: Sync with global requirements https://review.openstack.org/49817 | 19:33 |
openstackgerrit | Sergey Lukjanov proposed a change to stackforge/savanna-dashboard: Sync with global requirements https://review.openstack.org/49818 | 19:33 |
SergeyLukjanov | crobertsrh, I'm looking on it now | 19:33 |
SergeyLukjanov | crobertsrh, hmm, no ideas now | 19:35 |
*** SergeyLukjanov has quit IRC | 19:43 | |
openstackgerrit | Andrew Lazarev proposed a change to stackforge/savanna: Added rack topology configuration for hadoop cluster https://review.openstack.org/49742 | 20:27 |
*** tvb has quit IRC | 20:29 | |
*** mattf is now known as _mattf | 20:35 | |
*** dmitryme has joined #savanna | 20:54 | |
*** tvb has joined #savanna | 21:01 | |
*** crobertsrh is now known as _crobertsrh | 21:16 | |
*** rnirmal has quit IRC | 21:16 | |
*** akuznetsov has joined #savanna | 21:27 | |
openstackgerrit | DennyZhang proposed a change to stackforge/savanna: Need to empty /tmp/oozie-env.sh, before appending https://review.openstack.org/49841 | 21:34 |
*** akuznetsov has quit IRC | 21:42 | |
*** dmitryme has quit IRC | 22:33 | |
*** sacharya has joined #savanna | 22:48 | |
*** sacharya1 has quit IRC | 22:49 | |
openstackgerrit | DennyZhang proposed a change to stackforge/savanna: Need to empty /tmp/oozie-env.sh, before appending https://review.openstack.org/49841 | 23:33 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!