| *** ViswaV_ has quit IRC | 00:26 | |
| *** alazarev has quit IRC | 00:28 | |
| *** ViswaV has joined #openstack-sahara | 00:29 | |
| *** ViswaV has quit IRC | 00:31 | |
| *** ViswaV has joined #openstack-sahara | 00:33 | |
| *** alazarev has joined #openstack-sahara | 00:44 | |
| *** ViswaV has quit IRC | 01:00 | |
| *** Networkn3rd has joined #openstack-sahara | 01:39 | |
| *** alazarev has quit IRC | 01:44 | |
| *** Krast has joined #openstack-sahara | 02:00 | |
| *** Krast has quit IRC | 02:23 | |
| *** Krast has joined #openstack-sahara | 02:42 | |
| *** akuznetsov has joined #openstack-sahara | 03:39 | |
| *** clayb has quit IRC | 03:56 | |
| *** Networkn3rd has quit IRC | 04:05 | |
| *** Kuo_ has joined #openstack-sahara | 04:30 | |
| *** RockKuo_Home has quit IRC | 04:33 | |
| *** k4n0 has joined #openstack-sahara | 05:30 | |
| *** alazarev has joined #openstack-sahara | 05:32 | |
| *** tnovacik has joined #openstack-sahara | 05:33 | |
| *** akuznetsov has quit IRC | 05:54 | |
| *** akuznetsov has joined #openstack-sahara | 05:58 | |
| *** Longgeek has joined #openstack-sahara | 06:03 | |
| *** alazarev has quit IRC | 06:04 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Unit tests for CDH plugin https://review.openstack.org/113513 | 06:11 |
|---|---|---|
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Parallel testing EDP jobs https://review.openstack.org/110969 | 06:14 |
| *** akuznetsov has quit IRC | 06:20 | |
| *** akuznetsov has joined #openstack-sahara | 06:20 | |
| *** tnovacik has quit IRC | 06:24 | |
| *** tnovacik has joined #openstack-sahara | 07:18 | |
| *** akuznetsov has quit IRC | 07:26 | |
| *** sballe has joined #openstack-sahara | 07:29 | |
| *** mst89 has joined #openstack-sahara | 07:35 | |
| *** julienvey has joined #openstack-sahara | 07:36 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Parallel testing EDP jobs https://review.openstack.org/110969 | 07:40 |
| *** Longgeek has quit IRC | 07:46 | |
| *** Longgeek has joined #openstack-sahara | 07:46 | |
| *** Longgeek has quit IRC | 07:51 | |
| *** sballe has quit IRC | 07:51 | |
| *** Longgeek has joined #openstack-sahara | 07:54 | |
| *** ling-yun has joined #openstack-sahara | 07:57 | |
| *** skolekonov has joined #openstack-sahara | 08:00 | |
| *** Longgeek has quit IRC | 08:10 | |
| *** sballe has joined #openstack-sahara | 08:11 | |
| *** sballe has quit IRC | 08:32 | |
| *** witlessb has joined #openstack-sahara | 08:33 | |
| *** akuznetsov has joined #openstack-sahara | 08:45 | |
| *** Longgeek has joined #openstack-sahara | 08:50 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Setting variable 'HADOOP_VERSION' to lowercase and adding missed run 'check_openstack_host' https://review.openstack.org/113815 | 08:53 |
| *** sballe has joined #openstack-sahara | 09:10 | |
| *** Longgeek has quit IRC | 09:15 | |
| SergeyLukjanov | sudarshan, crobertsrh, it sounds like we should switch to data-processing in Juno | 09:15 |
| *** sballe has quit IRC | 09:20 | |
| *** sballe has joined #openstack-sahara | 09:22 | |
| *** witlessb has quit IRC | 09:23 | |
| *** sballe_ has joined #openstack-sahara | 09:24 | |
| *** sballe has quit IRC | 09:27 | |
| *** tosky has joined #openstack-sahara | 09:29 | |
| *** witlessb has joined #openstack-sahara | 09:31 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Fixing bugs after refactoring https://review.openstack.org/113815 | 09:31 |
| *** sballe__ has joined #openstack-sahara | 09:46 | |
| *** sballe_ has quit IRC | 09:50 | |
| *** Longgeek has joined #openstack-sahara | 09:52 | |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Fixing bugs after refactoring https://review.openstack.org/113815 | 09:58 |
| *** witlessb has quit IRC | 10:00 | |
| *** crobertsrh has quit IRC | 10:00 | |
| *** venza has quit IRC | 10:00 | |
| *** sballe has joined #openstack-sahara | 10:06 | |
| *** witlessb has joined #openstack-sahara | 10:07 | |
| *** crobertsrh has joined #openstack-sahara | 10:07 | |
| *** venza has joined #openstack-sahara | 10:07 | |
| *** sballe__ has quit IRC | 10:07 | |
| *** witlessb has quit IRC | 10:08 | |
| *** witlessb_ has joined #openstack-sahara | 10:08 | |
| *** DenisEgorenko has left #openstack-sahara | 10:10 | |
| *** DenisEgorenko has joined #openstack-sahara | 10:10 | |
| *** sballe_ has joined #openstack-sahara | 10:21 | |
| *** sballe has quit IRC | 10:21 | |
| *** crobertsrh has quit IRC | 10:23 | |
| *** venza has quit IRC | 10:23 | |
| *** sballe_ has quit IRC | 10:25 | |
| *** sballe has joined #openstack-sahara | 10:26 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Back 'HADOOP_VERSION' to uppercase for config for Vanilla 2.4 https://review.openstack.org/113838 | 10:27 |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Back 'HADOOP_VERSION' to uppercase for config for Vanilla 2.4 https://review.openstack.org/113838 | 10:28 |
| *** crobertsrh has joined #openstack-sahara | 10:30 | |
| *** venza has joined #openstack-sahara | 10:30 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add unit test for sender.notify https://review.openstack.org/113840 | 10:34 |
| *** sballe has quit IRC | 10:36 | |
| *** sballe has joined #openstack-sahara | 10:37 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add unit test for sender.notify https://review.openstack.org/113840 | 10:39 |
| *** Longgeek has quit IRC | 10:41 | |
| *** sballe_ has joined #openstack-sahara | 10:44 | |
| *** sballe has quit IRC | 10:44 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add docs with Sahara notifications configuration https://review.openstack.org/113234 | 10:48 |
| *** miqui has joined #openstack-sahara | 11:06 | |
| openstackgerrit | A change was merged to openstack/sahara-image-elements: Fix parameter AuthorizedKeysFile in ssh element https://review.openstack.org/112837 | 11:09 |
| *** witlessb_ has quit IRC | 11:10 | |
| *** witlessb has joined #openstack-sahara | 11:11 | |
| *** witlessb has quit IRC | 11:18 | |
| *** witlessb has joined #openstack-sahara | 11:19 | |
| *** sballe_ has quit IRC | 11:24 | |
| *** Longgeek has joined #openstack-sahara | 11:26 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add unit test for sender.notify https://review.openstack.org/113840 | 11:54 |
| *** witlessb_ has joined #openstack-sahara | 11:57 | |
| *** witlessb has quit IRC | 11:58 | |
| *** witlessb_ is now known as witlessb | 11:58 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/sahara-ci-config: Remove unused parameter SSH_USERNAME from configs https://review.openstack.org/113262 | 12:10 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Adding second job for CDH tests https://review.openstack.org/112886 | 12:11 |
| openstackgerrit | Sergey Reshetnyak proposed a change to stackforge/sahara-ci-config: Remove unused parameter SSH_USERNAME from configs https://review.openstack.org/113262 | 12:12 |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Adding second job for CDH tests https://review.openstack.org/112886 | 12:16 |
| *** _mattf is now known as mattf | 12:20 | |
| *** boris-42 has quit IRC | 12:21 | |
| *** boris-42 has joined #openstack-sahara | 12:32 | |
| *** sballe has joined #openstack-sahara | 12:34 | |
| *** sballe_ has joined #openstack-sahara | 12:41 | |
| *** sballe has quit IRC | 12:44 | |
| *** _elmiko is now known as elmiko | 13:03 | |
| SergeyLukjanov | elmiko, good morning | 13:06 |
| SergeyLukjanov | elmiko, I've just finished releasing 2014.1.2 | 13:07 |
| SergeyLukjanov | elmiko, AFAIK you've asked about it | 13:07 |
| elmiko | SergeyLukjanov: thanks, i just saw it on tarballs.os.org | 13:12 |
| SergeyLukjanov | elmiko, it's already on pypi.python.org too - https://pypi.python.org/pypi?%3Aaction=search&term=sahara&submit=search | 13:12 |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Parallel testing EDP jobs https://review.openstack.org/110969 | 13:13 |
| elmiko | SergeyLukjanov: awesome! | 13:14 |
| elmiko | SergeyLukjanov: thanks again, i'm going to be packaging this for the next RDO release | 13:14 |
| SergeyLukjanov | elmiko, I'm going to release client today too | 13:14 |
| SergeyLukjanov | elmiko, great! | 13:14 |
| elmiko | SergeyLukjanov: was there an update to the client? | 13:14 |
| SergeyLukjanov | elmiko, the last release was in the end of march ;) | 13:15 |
| elmiko | SergeyLukjanov: k, i'll probably have to see about releasing that for RDO as well | 13:15 |
| *** sballe_ has quit IRC | 13:24 | |
| *** tmckay has joined #openstack-sahara | 13:37 | |
| *** sballe has joined #openstack-sahara | 13:51 | |
| *** Networkn3rd has joined #openstack-sahara | 13:52 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Setting cdh-{os} job non-voting and fixing small bugs https://review.openstack.org/113894 | 13:52 |
| *** sballe has quit IRC | 13:53 | |
| *** sballe has joined #openstack-sahara | 13:56 | |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Setting cdh-{os} job non-voting and fixing small bugs https://review.openstack.org/113894 | 14:00 |
| *** sballe has quit IRC | 14:02 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/sahara: Create etc/edp-examples directory https://review.openstack.org/112614 | 14:11 |
| *** Krast has quit IRC | 14:13 | |
| *** Krast has joined #openstack-sahara | 14:14 | |
| *** openstackgerrit has quit IRC | 14:16 | |
| *** openstackgerrit has joined #openstack-sahara | 14:17 | |
| *** Krast has quit IRC | 14:28 | |
| *** Krast has joined #openstack-sahara | 14:28 | |
| *** Longgeek has quit IRC | 14:29 | |
| *** ViswaV has joined #openstack-sahara | 14:30 | |
| *** Longgeek has joined #openstack-sahara | 14:30 | |
| *** Krast has quit IRC | 14:31 | |
| *** Krast has joined #openstack-sahara | 14:31 | |
| openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Add unit test for sender.notify https://review.openstack.org/113840 | 14:34 |
| *** alazarev has joined #openstack-sahara | 14:48 | |
| *** sballe has joined #openstack-sahara | 14:49 | |
| *** julienvey has quit IRC | 14:58 | |
| *** julienvey has joined #openstack-sahara | 14:59 | |
| *** julienve_ has joined #openstack-sahara | 15:08 | |
| *** julienvey has quit IRC | 15:12 | |
| * tmckay discovers that oslo.config is the wrong version, because pip is the wrong version, because virtualenv is the wrong version | 15:13 | |
| tmckay | piece of cake | 15:13 |
| *** ViswaV has quit IRC | 15:16 | |
| *** alazarev has quit IRC | 15:34 | |
| *** alazarev has joined #openstack-sahara | 15:36 | |
| *** alazarev has quit IRC | 15:51 | |
| *** alazarev has joined #openstack-sahara | 15:52 | |
| *** k4n0 has quit IRC | 16:01 | |
| *** alazarev has quit IRC | 16:10 | |
| dmitryme | tmckay: wow :-) | 16:11 |
| *** Networkn3rd has quit IRC | 16:11 | |
| SergeyLukjanov | tmckay, because tox is the wrong version? | 16:12 |
| tmckay | SergeyLukjanov, dmitryme, heh, I don't know. I stopped at easy_install --upgrade virtualenv when things started working | 16:13 |
| tmckay | Someday I have to get to F20 ... maybe this week | 16:13 |
| SergeyLukjanov | tmckay, I recommend pip install -U tox | 16:13 |
| tmckay | probably a good idea. | 16:14 |
| tmckay | I've got tox 1.6.1 | 16:14 |
| *** alazarev has joined #openstack-sahara | 16:17 | |
| *** ling-yun-1 has joined #openstack-sahara | 16:17 | |
| *** ling-yun has quit IRC | 16:21 | |
| *** DenisEgorenko has left #openstack-sahara | 16:23 | |
| *** mst89 has joined #openstack-sahara | 16:24 | |
| *** skolekonov has quit IRC | 16:24 | |
| *** mst89 has quit IRC | 16:40 | |
| *** julienve_ has quit IRC | 16:41 | |
| *** bandarji has joined #openstack-sahara | 16:43 | |
| *** tmckay has left #openstack-sahara | 16:46 | |
| *** sballe has quit IRC | 16:50 | |
| *** Networkn3rd has joined #openstack-sahara | 16:53 | |
| *** tmckay has joined #openstack-sahara | 16:54 | |
| *** ling-yun-1 has quit IRC | 16:56 | |
| *** ling-yun-1 has joined #openstack-sahara | 16:56 | |
| *** Longgeek has quit IRC | 16:57 | |
| *** mattf is now known as _mattf | 16:58 | |
| *** mst89 has joined #openstack-sahara | 17:07 | |
| *** mst89 has quit IRC | 17:07 | |
| *** julienvey has joined #openstack-sahara | 17:11 | |
| *** julienvey has quit IRC | 17:13 | |
| *** julienvey has joined #openstack-sahara | 17:13 | |
| *** julienvey has quit IRC | 17:17 | |
| *** ViswaV has joined #openstack-sahara | 17:25 | |
| *** ViswaV has quit IRC | 17:26 | |
| *** ViswaV has joined #openstack-sahara | 17:26 | |
| *** ViswaV_ has joined #openstack-sahara | 17:28 | |
| *** ViswaV has quit IRC | 17:30 | |
| openstackgerrit | Artem Osadchiy proposed a change to openstack/sahara: MapR plugin implementation https://review.openstack.org/113391 | 17:40 |
| openstackgerrit | Artem Osadchiy proposed a change to openstack/sahara-specs: MapR plugin implementation https://review.openstack.org/113980 | 17:47 |
| openstackgerrit | Michael McCune proposed a change to openstack/sahara-specs: Updating EDP Swift trust authentication spec https://review.openstack.org/113591 | 17:50 |
| *** julienvey has joined #openstack-sahara | 18:14 | |
| *** mst89 has joined #openstack-sahara | 18:18 | |
| *** julienvey has quit IRC | 18:18 | |
| *** tosky has quit IRC | 18:20 | |
| *** Networkn3rd has quit IRC | 18:32 | |
| *** miqui_ has joined #openstack-sahara | 18:34 | |
| *** akuznets_ has joined #openstack-sahara | 18:35 | |
| elmiko | hey folks, does sahara allow scaling of a cluster once a job execution has started on that cluster? | 18:37 |
| elmiko | if so, what happens to the job execution(stop, restart, etc)? | 18:38 |
| *** alazarev has quit IRC | 18:38 | |
| *** akuznetsov has quit IRC | 18:41 | |
| *** tellesnobrega has quit IRC | 18:41 | |
| *** openstackgerrit has quit IRC | 18:41 | |
| *** miqui has quit IRC | 18:41 | |
| *** tellesnobrega has joined #openstack-sahara | 18:48 | |
| *** Networkn3rd has joined #openstack-sahara | 18:49 | |
| *** openstackgerrit has joined #openstack-sahara | 18:49 | |
| *** ViswaV_ has quit IRC | 18:51 | |
| *** alazarev has joined #openstack-sahara | 18:55 | |
| *** julienvey has joined #openstack-sahara | 19:15 | |
| *** mst89 has quit IRC | 19:15 | |
| *** julienvey has quit IRC | 19:19 | |
| *** Networkn3rd has quit IRC | 19:20 | |
| *** Networkn3rd has joined #openstack-sahara | 19:28 | |
| *** bandarji has left #openstack-sahara | 19:54 | |
| *** Networkn3rd has quit IRC | 20:00 | |
| *** julienvey has joined #openstack-sahara | 20:16 | |
| *** julienvey has quit IRC | 20:20 | |
| *** RockKuo_Home has joined #openstack-sahara | 20:23 | |
| *** Kuo_ has quit IRC | 20:26 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/sahara: Add Spark integration test https://review.openstack.org/112698 | 20:49 |
| openstackgerrit | A change was merged to openstack/sahara: Create etc/edp-examples directory https://review.openstack.org/112614 | 21:03 |
| *** bradd1 has quit IRC | 21:03 | |
| *** bradd1 has joined #openstack-sahara | 21:05 | |
| *** tnovacik has quit IRC | 21:05 | |
| *** miqui_ is now known as miqui | 21:06 | |
| *** ViswaV has joined #openstack-sahara | 21:14 | |
| *** julienvey has joined #openstack-sahara | 21:16 | |
| *** julienvey has quit IRC | 21:21 | |
| *** ViswaV_ has joined #openstack-sahara | 21:27 | |
| *** ViswaV has quit IRC | 21:30 | |
| *** bradd1 has quit IRC | 21:35 | |
| *** zengyunling__ has joined #openstack-sahara | 21:35 | |
| *** ling-yun-1 has quit IRC | 21:38 | |
| alazarev | elmiko: I think nothing happened with job excecution, it should successfully finish regardless scaling | 21:39 |
| tmckay | alazarev, what about decommissioning? Scale up might be okay, but what about scale down? | 21:39 |
| elmiko | alazarev: ok, so sahara doesn't redeploy the workflow to the cluster? | 21:39 |
| * tmckay asks a quick question and then leaves :) | 21:39 | |
| elmiko | tmckay: i'm actually less concerned about decomissioning. | 21:40 |
| alazarev | elmiko: yeap, doesn’t redeploy | 21:40 |
| alazarev | I think decomission shouldn’t influence jobs… in theory | 21:40 |
| elmiko | alazarev: thanks, i'm trying to figure out if we need to store the swift passwords in the database and i don't think we need to. once the job execution is deployed, the creds won't be needed any longer. | 21:41 |
| alazarev | tmckay: quick questions about hdfs access from EDP, it looks like hadoop1 and hadoop2 have different interfaces, what do you think about moving this part to plugins? | 21:42 |
| tmckay | elmiko, I'm going to start looking deeper into oozie secure config tomorrow, fyi | 21:42 |
| elmiko | tmckay: thanks, i appreciate it :) | 21:42 |
| tmckay | alazarev, hmmm, could be. Let's talk more tomorrow, I'm not familiar with the differences. | 21:42 |
| elmiko | tmckay: also, don't forget to look at this again https://review.openstack.org/#/c/113591/ | 21:42 |
| alazarev | tmckay: e.g. hadoop1 has just “-mkdir”, in haddop2 it is “-mkdir -p” | 21:43 |
| alazarev | hadoop1 creates “/user/<user>/-p” with -p | 21:43 |
| tmckay | ah, yes, I ran into that somewhere. Yes, we could wrap functions like that in the plugins. | 21:43 |
| tmckay | elmiko, is that your spec change? | 21:43 |
| alazarev | John made an ugly hack to handle that, and now we have https://bugs.launchpad.net/sahara/+bug/1355114 and https://bugs.launchpad.net/sahara/+bug/1356582 | 21:44 |
| elmiko | tmckay: yea | 21:44 |
| tmckay | yep it is :) elmiko, okay, on the docket | 21:44 |
| tmckay | alazarev, good point. I'll take a look tomorrow. | 21:45 |
| alazarev | moving this to plugins will solve that, but… plugin SPI is huge alreasy… adding hdfs to it will make SPI even more huge | 21:45 |
| * tmckay copies and pastes IRC and emails to self so he doesn't forget | 21:45 | |
| alazarev | other solution is to add “if” to EDP. “if hadoop2: … else …” | 21:46 |
| alazarev | but this could interfere with spark, mapr and other hadoops | 21:47 |
| *** tnovacik has joined #openstack-sahara | 21:47 | |
| alazarev | probably good idea to discuss tomorrow on meeting | 21:47 |
| *** tmckay has quit IRC | 21:47 | |
| alazarev | or we can use https://github.com/spotify/snakebite and forget about SSH | 21:49 |
| elmiko | looks interesting | 21:50 |
| *** ling-yun-1 has joined #openstack-sahara | 21:52 | |
| alazarev | will not work for the same reason :( | 21:53 |
| alazarev | Snakebite 2.x ONLY supports Hadoop 2.2.0 and up (protocol version 9) | 21:54 |
| alazarev | so, different clisent for different hadoops | 21:54 |
| *** zengyunling__ has quit IRC | 21:55 | |
| elmiko | too bad | 21:56 |
| *** tnovacik has quit IRC | 22:13 | |
| *** julienvey has joined #openstack-sahara | 22:17 | |
| *** julienvey has quit IRC | 22:22 | |
| *** elmiko is now known as _elmiko | 22:33 | |
| *** bradd1 has joined #openstack-sahara | 22:50 | |
| *** ViswaV_ has quit IRC | 22:50 | |
| *** bradd1 has quit IRC | 23:17 | |
| *** julienvey has joined #openstack-sahara | 23:18 | |
| *** julienvey has quit IRC | 23:23 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/114072 | 23:24 |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements https://review.openstack.org/114074 | 23:24 |
| *** RockKuo_Home has quit IRC | 23:38 | |
| openstackgerrit | A change was merged to openstack/sahara: Add translation support to plugin modules https://review.openstack.org/107718 | 23:41 |
| *** ViswaV has joined #openstack-sahara | 23:48 | |
| *** witlessb has quit IRC | 23:58 | |
| *** ViswaV has quit IRC | 23:58 | |
| *** ViswaV has joined #openstack-sahara | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!