| *** witlessb has quit IRC | 00:02 | |
| *** IlyaE has quit IRC | 00:12 | |
| *** witlessb has joined #openstack-sahara | 01:56 | |
| *** witlessb has quit IRC | 02:00 | |
| *** miqui_ has quit IRC | 02:11 | |
| *** robsparker has quit IRC | 02:28 | |
| *** ViswaV has joined #openstack-sahara | 02:35 | |
| *** robsparker has joined #openstack-sahara | 02:41 | |
| *** ViswaV has quit IRC | 03:38 | |
| *** ViswaV has joined #openstack-sahara | 03:39 | |
| *** zhiyan_ is now known as zhiyan | 03:40 | |
| *** zhiyan is now known as zhiyan_ | 04:20 | |
| *** akuznetsov has quit IRC | 04:37 | |
| *** akuznetsov has joined #openstack-sahara | 04:39 | |
| *** IlyaE has joined #openstack-sahara | 05:37 | |
| *** Longgeek has joined #openstack-sahara | 05:45 | |
| *** akuznetsov has quit IRC | 06:04 | |
| *** akuznetsov has joined #openstack-sahara | 06:16 | |
| *** Ch00k has joined #openstack-sahara | 06:34 | |
| *** yanndegat has joined #openstack-sahara | 06:40 | |
| *** IlyaE has quit IRC | 06:41 | |
| *** Ch00k has quit IRC | 06:56 | |
| *** xianghui has joined #openstack-sahara | 06:56 | |
| *** IlyaE has joined #openstack-sahara | 07:03 | |
| *** xianghui has quit IRC | 07:16 | |
| *** witlessb has joined #openstack-sahara | 07:21 | |
| *** witlessb has quit IRC | 07:26 | |
| *** IlyaE has quit IRC | 07:46 | |
| *** sreshetn1ak has quit IRC | 07:51 | |
| *** jpich has joined #openstack-sahara | 08:01 | |
| *** xianghui has joined #openstack-sahara | 08:11 | |
| *** witlessb has joined #openstack-sahara | 08:17 | |
| *** zhiyan_ is now known as zhiyan | 08:30 | |
| *** sreshetnyak has joined #openstack-sahara | 08:50 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Add vanilla plugin with Hadoop 2.4.0 https://review.openstack.org/105099 | 09:08 |
|---|---|---|
| *** tosky has joined #openstack-sahara | 09:25 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara-image-elements: Add support building images for Hadoop 2.4.0 https://review.openstack.org/105107 | 10:07 |
| *** xianghui has quit IRC | 10:11 | |
| *** xianghui has joined #openstack-sahara | 10:13 | |
| openstackgerrit | Andrey Pavlov proposed a change to openstack/sahara: Added validation check for number of datanodes https://review.openstack.org/104917 | 10:16 |
| *** xianghui has quit IRC | 10:22 | |
| *** tosky has quit IRC | 10:45 | |
| *** tosky has joined #openstack-sahara | 10:46 | |
| *** xianghui has joined #openstack-sahara | 10:57 | |
| *** xianghui has quit IRC | 11:19 | |
| *** skolekonov has joined #openstack-sahara | 11:22 | |
| *** vrovachev has joined #openstack-sahara | 11:25 | |
| *** xianghui has joined #openstack-sahara | 12:21 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Fix formatting in readme on vanilla configs https://review.openstack.org/105151 | 12:43 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Fix formatting in readme for vanilla configs https://review.openstack.org/105151 | 12:54 |
| *** crobertsrh has joined #openstack-sahara | 12:59 | |
| *** miqui has joined #openstack-sahara | 13:17 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements https://review.openstack.org/105174 | 13:33 |
| *** xianghui has quit IRC | 13:36 | |
| *** zhiyan is now known as zhiyan_ | 13:37 | |
| *** elmiko has joined #openstack-sahara | 13:40 | |
| *** tmckay has joined #openstack-sahara | 13:54 | |
| *** xianghui has joined #openstack-sahara | 14:33 | |
| *** Longgeek has quit IRC | 14:34 | |
| *** Longgeek has joined #openstack-sahara | 14:36 | |
| openstackgerrit | Longgeek proposed a change to stackforge/sahara-guestagent: In .gitreview rename savanna to sahara. https://review.openstack.org/103608 | 14:44 |
| *** IlyaE has joined #openstack-sahara | 14:58 | |
| *** vrovachev has quit IRC | 15:00 | |
| openstackgerrit | Longgeek proposed a change to stackforge/sahara-guestagent: In .gitreview rename savanna to sahara. https://review.openstack.org/103608 | 15:15 |
| *** skolekonov has quit IRC | 15:27 | |
| *** ViswaV_ has joined #openstack-sahara | 15:30 | |
| *** xianghui has quit IRC | 15:31 | |
| *** xianghui has joined #openstack-sahara | 15:32 | |
| *** ViswaV has quit IRC | 15:32 | |
| *** Longgeek has quit IRC | 15:39 | |
| aignatov | crobertsrh: Congrats, 50th patch set https://review.openstack.org/#/c/89897/ :) Looks like a huge anniversary! | 15:43 |
| elmiko | nice | 15:43 |
| elmiko | i knew he was going for the record | 15:43 |
| *** IlyaE has quit IRC | 15:44 | |
| *** IlyaE has joined #openstack-sahara | 15:52 | |
| *** IlyaE has quit IRC | 16:03 | |
| tellesnobrega | hi, im starting to implement a storm plugin for sahara, and i have some question that you guys can help me out with | 16:30 |
| *** jpich has quit IRC | 16:30 | |
| tosky | tmckay: ^^ | 16:30 |
| tellesnobrega | storm doesnt use namenode, datanode it has only master and slave nodes and zookeeper | 16:31 |
| tellesnobrega | the get_instances method returns instances based on the node_groups | 16:31 |
| tellesnobrega | should storm use node_groups as well? The way I see the groups would only be about having a zookeeper in the instance or not | 16:34 |
| tellesnobrega | does that make sense? | 16:34 |
| crobertsrh | aignatov: Yes... a rather dubious anniversary. | 16:37 |
| *** IlyaE has joined #openstack-sahara | 16:41 | |
| aignatov | tellesnobrega: that’s make sense, also if you want to have mixed topologies (if it’s posible in storm architecture) you should describe your topology in terms of node_groups | 16:51 |
| aignatov | also how could you manage master and slaves placement without node gorups? | 16:52 |
| tellesnobrega | aignatov: huum. that makes sense. What do you mean by mixed topologies? | 16:54 |
| tellesnobrega | having the master and slave in the same instance? | 16:54 |
| aignatov | I mean, if you want to deploy master on some VM and using flovor A for it and 10 slaves which use flavor B for others VMs I only think about node_groups | 16:55 |
| tellesnobrega | aignatov: i see, that makes perfect sense. And yes, this is possible in storm | 16:57 |
| aignatov | so I must use node groups for master, slaves and zookeeper nodes :) | 16:57 |
| *** IlyaE has quit IRC | 16:58 | |
| tellesnobrega | great | 16:58 |
| tellesnobrega | that makes things easier since i can reuse what is already done | 16:58 |
| *** shakamunyi has joined #openstack-sahara | 17:03 | |
| *** xianghui has quit IRC | 17:05 | |
| *** IlyaE has joined #openstack-sahara | 17:13 | |
| *** bandarji has joined #openstack-sahara | 17:13 | |
| *** RobLevas has joined #openstack-sahara | 17:20 | |
| *** IlyaE has quit IRC | 17:27 | |
| *** IlyaE has joined #openstack-sahara | 17:37 | |
| *** miqui has quit IRC | 17:45 | |
| *** miqui has joined #openstack-sahara | 17:49 | |
| *** IlyaE has quit IRC | 17:56 | |
| *** IlyaE has joined #openstack-sahara | 18:20 | |
| *** skostiuchenko has joined #openstack-sahara | 18:24 | |
| *** ViswaV_ has quit IRC | 18:32 | |
| *** miqui has quit IRC | 18:32 | |
| *** ViswaV has joined #openstack-sahara | 18:33 | |
| *** miqui has joined #openstack-sahara | 18:41 | |
| *** IlyaE has quit IRC | 18:52 | |
| openstackgerrit | pritesh proposed a change to openstack/sahara: Update docs to reflect the changes in security group section in horizon https://review.openstack.org/104687 | 19:03 |
| *** ViswaV_ has joined #openstack-sahara | 19:04 | |
| *** ViswaV has quit IRC | 19:05 | |
| *** IlyaE has joined #openstack-sahara | 19:05 | |
| *** IlyaE has quit IRC | 19:31 | |
| *** tmckay has left #openstack-sahara | 19:50 | |
| *** shakamunyi has quit IRC | 20:16 | |
| *** shakamunyi has joined #openstack-sahara | 20:17 | |
| *** sballe__ has quit IRC | 20:28 | |
| tellesnobrega | i'm following spark's plugins implementation, but i'm a little confused with the config_helper part. Are those configurations needed for sahara or for the instances running Spark? | 20:34 |
| openstackgerrit | pritesh proposed a change to openstack/sahara: Update docs to reflect the changes in security group section in horizon https://review.openstack.org/104687 | 20:34 |
| tellesnobrega | or both? | 20:34 |
| elmiko | tellesnobrega: on a quick look, those look like instance configs. let me dig a little more | 20:38 |
| tellesnobrega | sure, thanks | 20:38 |
| elmiko | hmm, think it may be both | 20:39 |
| elmiko | those xml files look like files that live in sahara which get uploaded to the instances | 20:39 |
| tellesnobrega | hmm | 20:40 |
| elmiko | yea, my best guess is both. some of the stuff in config_helper.py looks like sahara config stuff | 20:40 |
| elmiko | mind you, i've only just looked at it. tmckay is the one to ask, when he gets back. | 20:40 |
| tellesnobrega | i will for sure | 20:40 |
| tellesnobrega | storm config is really simple, I just need to set up in /etc/hosts the machines that are part of the cluster and storm it self has one config file and the master has a list of slave nodes. I think that is all that is going to be needed to have it running | 20:42 |
| elmiko | looks like some of what config_helper does is interpolate config options to the xml files that need to be on the instances | 20:42 |
| elmiko | tellesnobrega: might be worthwhile to start simple, get the basic configs working, then expand to allowing more configurable behavior like what's going on in config_helper | 20:42 |
| tellesnobrega | that is what im thinking. Cleaning some of this stuff up and work my up to have it all | 20:43 |
| elmiko | +1 | 20:44 |
| *** miqui has quit IRC | 20:49 | |
| *** sballe has joined #openstack-sahara | 20:52 | |
| *** crobertsrh is now known as _crobertsrh | 21:03 | |
| *** IlyaE has joined #openstack-sahara | 21:14 | |
| *** tmckay has joined #openstack-sahara | 21:18 | |
| openstackgerrit | A change was merged to openstack/sahara: Fix tools/get_auth_token https://review.openstack.org/104932 | 21:22 |
| openstackgerrit | A change was merged to openstack/python-saharaclient: Fixes ambiguous cli output between "None" and NoneType https://review.openstack.org/102955 | 21:22 |
| sballe | elmiko, Hi, still me :-) I am now ready to run a test on my hadoop cluster. I took the pig example from sahara-extra/ edp-examples/pig-job. I defined two data sources input and output, I defined two binary jobs udf.jar and example.pig, I defined a job that which include example.pig as the main binary and udf.jar as the libs. | 21:26 |
| sballe | I get job successfully creater but when I launch the job I get Error: " None and Error "Could not luanch job". | 21:28 |
| sballe | Has anyone tested the example.pig in the sahara-extra repo? | 21:28 |
| sballe | RobLevas, Do yu have any advise? on ^^^ | 21:40 |
| RobLevas | sballe: I don't have any experience running the tests in sahara-extra... sorry. :( | 21:41 |
| sballe | Do you have experience running any other jobs with sahara? At this point I cannot get any further than setting up the cluster but I haven't been able to run any example codes | 21:42 |
| sballe | I volunteered to fix a bug that is super simepl to fix but I cannot test my fix because I cannot get a job to run :-( | 21:43 |
| sballe | RobLevas, If i remember correctly you were familiar with the HortonWorks plug-in. I will try to use that instead and maybe I can get soem guidance from you :) | 21:54 |
| RobLevas | sballe: I do have some experience witht he | 22:03 |
| RobLevas | sballe: ... with the HDP plugin. I added the ability to install Hue. | 22:04 |
| RobLevas | sballe: using Hue, you can run through a bunch of tutorials from http://hortonworks.com/tutorials/ | 22:05 |
| sballe | ok I would liek to start simple. What is the hello world type job I can run just to see it it works? | 22:05 |
| RobLevas | Hmm... I dont really know of I "hello world" like example. | 22:06 |
| sballe | it doesn'have to be hellow world but just somethign taht tells me that my cluster works end ot end | 22:07 |
| RobLevas | most of the examples in the tutorial requires you to upload a file or two and type in a pig script.... the NYSE stock tutorial isnt too bad to get going - http://hortonworks.com/hadoop-tutorial/hello-world-an-introduction-to-hadoop-hcatalog-hive-and-pig/ | 22:07 |
| sballe | ok that is the vele of complexity I am looking for. | 22:08 |
| sballe | s/level | 22:08 |
| RobLevas | :) | 22:08 |
| *** RobLevas is now known as _RobLevas | 22:22 | |
| *** IlyaE has quit IRC | 22:31 | |
| *** bandarji has quit IRC | 22:39 | |
| *** IlyaE has joined #openstack-sahara | 22:52 | |
| *** bandarji has joined #openstack-sahara | 22:57 | |
| *** IlyaE has quit IRC | 23:05 | |
| *** IlyaE has joined #openstack-sahara | 23:11 | |
| *** IlyaE has quit IRC | 23:20 | |
| *** bandarji has quit IRC | 23:27 | |
| *** witlessb has quit IRC | 23:35 | |
| *** _RobLevas has quit IRC | 23:42 | |
| *** tellesnobrega has quit IRC | 23:54 | |
| *** IlyaE has joined #openstack-sahara | 23:56 | |
| *** tellesnobrega has joined #openstack-sahara | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!