| *** IlyaE has quit IRC | 00:07 | |
| *** rnirmal has quit IRC | 00:45 | |
| *** xuhanp_ has joined #savanna | 01:41 | |
| *** nosnos has joined #savanna | 01:59 | |
| *** IlyaE has joined #savanna | 03:02 | |
| *** IlyaE has quit IRC | 05:04 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 05:06 | |
| *** IlyaE has joined #savanna | 05:26 | |
| *** IlyaE has quit IRC | 05:32 | |
| *** aignatov_ has joined #savanna | 05:52 | |
| *** akuznetsov has quit IRC | 05:59 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 06:12 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 06:13 | |
| openstackgerrit | Jenkins proposed a change to openstack/savanna: Imported Translations from Transifex https://review.openstack.org/68025 | 06:17 |
|---|---|---|
| *** akuznetsov has joined #savanna | 06:26 | |
| *** akuznetsov has quit IRC | 06:37 | |
| *** akuznetsov has joined #savanna | 06:37 | |
| *** aignatov_ has quit IRC | 06:38 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 06:42 | |
| *** akuznets_ has joined #savanna | 07:05 | |
| *** akuznetsov has quit IRC | 07:08 | |
| *** aignatov_ has joined #savanna | 07:14 | |
| *** Ch00k has joined #savanna | 07:22 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 07:29 | |
| *** IlyaE has joined #savanna | 07:30 | |
| *** nadya__ has joined #savanna | 07:31 | |
| *** nadya__ has quit IRC | 07:31 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Add alembic migration tool to sqlalchemy https://review.openstack.org/64032 | 07:41 |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 07:45 | |
| *** Ch00k has quit IRC | 07:51 | |
| *** Ch00k has joined #savanna | 07:52 | |
| *** Ch00k has quit IRC | 07:52 | |
| *** Ch00k has joined #savanna | 07:56 | |
| *** Ch00k has quit IRC | 07:56 | |
| *** Ch00k has joined #savanna | 07:57 | |
| *** Ch00k has quit IRC | 07:58 | |
| *** Ch00k has joined #savanna | 07:59 | |
| *** aignatov_ has quit IRC | 08:01 | |
| *** IlyaE has quit IRC | 08:10 | |
| *** _ruhe is now known as ruhe | 08:11 | |
| *** Ch00k has quit IRC | 08:14 | |
| *** Ch00k has joined #savanna | 08:25 | |
| *** Ch00k has quit IRC | 08:27 | |
| *** Ch00k has joined #savanna | 08:28 | |
| *** Ch00k has quit IRC | 08:28 | |
| *** Ch00k has joined #savanna | 08:28 | |
| *** dmitryme has joined #savanna | 08:29 | |
| *** Jayunit100 has quit IRC | 08:32 | |
| *** Ch00k has quit IRC | 08:33 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 08:37 | |
| *** DinaBelova_ is now known as DinaBelova | 08:43 | |
| *** lg has joined #savanna | 08:51 | |
| *** aignatov_ has joined #savanna | 08:51 | |
| *** lg has quit IRC | 08:53 | |
| *** aignatov has joined #savanna | 09:03 | |
| *** aignatov_ has left #savanna | 09:03 | |
| SergeyLukjanov | test | 09:06 |
| dmitryme | test passed :-) | 09:06 |
| SergeyLukjanov | one more test :) | 09:06 |
| *** Ch00k has joined #savanna | 09:14 | |
| *** jp_ has joined #savanna | 09:15 | |
| jp_ | hi all | 09:15 |
| aignatov | jp_: hi | 09:17 |
| jp_ | I'm looking to implement savanna for some hadoop experts and they are a bit confused with the storage. For performance, they would like to have a direct access to the disks instead writing on cinder (ephemeral wouldn't work too due to it's nature). I've read a bit about bare metal deployments (apparently not stable enough for us) and bare drive support (mentionned here - slide 30 - http://www.slideshare.net/mirantis/savanna-hadoop-on-o | 09:25 |
| jp_ | penstack ). Are we missing a point ? Is cinder just the good option ? | 09:25 |
| *** Ch00k has quit IRC | 09:33 | |
| *** Ch00k has joined #savanna | 09:33 | |
| *** Ch00k has quit IRC | 09:51 | |
| dmitryme | jp_: the direct disk support was implemented in the blueprint https://blueprints.launchpad.net/cinder/+spec/block-device-driver and is available in Havana. As for performance, sorry, but we didn't make any tests or optimizations here. So I can't really tell which of ephemeral or cinder is better. Also it is obvious that Cinder performance greatly depend on the backend being used. | 09:52 |
| dmitryme | If you perform such tests, it would be great if you can share the results | 09:53 |
| openstackgerrit | A change was merged to openstack/savanna: Imported Translations from Transifex https://review.openstack.org/68025 | 10:28 |
| openstackgerrit | A change was merged to openstack/savanna: [IDH] Added config controlling hadoop-swift.jar URL https://review.openstack.org/65821 | 10:28 |
| *** aignatov is now known as aignatov_ | 10:29 | |
| *** xuhanp_ has quit IRC | 10:29 | |
| jp_ | ok I was using grizzly, I though it was the more recent version | 10:31 |
| jp_ | I'll probably have to do some benchmark for hdfs and savanna, if I can I will make this public | 10:33 |
| *** ruhe is now known as _ruhe | 10:39 | |
| *** _ruhe is now known as ruhe | 10:54 | |
| *** aignatov_ is now known as aignatov | 11:01 | |
| *** Ch00k has joined #savanna | 11:05 | |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 11:15 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 11:19 | |
| *** Ch00k has quit IRC | 11:19 | |
| *** Ch00k has joined #savanna | 11:26 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Add alembic migration tool to sqlalchemy https://review.openstack.org/64032 | 11:28 |
| *** dmitryme has quit IRC | 11:32 | |
| mattf | aignatov, have any thoughts on warning users when they send in json params that get ignored? | 11:32 |
| aignatov | mattf: what you mean? could you give some example? | 11:34 |
| mattf | https://review.openstack.org/#/c/67960/ | 11:34 |
| mattf | when you export w/ show --json you get tons of extra attributes, e.g. create_at. those can't be passed as args to create | 11:35 |
| mattf | so i just del them | 11:35 |
| aignatov | I'm abstaining about this :) both cases look good for me, It's initial implementation of savanna CLI, so it's ok, maybe some warns will more informative | 11:44 |
| mattf | i'm torn too. maybe a --verbose could be added (later?) | 11:46 |
| mattf | alazarev around to pressure me? | 11:46 |
| *** dmitryme has joined #savanna | 11:49 | |
| aignatov | alazarev did valuable note, so if you'll explain him why you did this he will agree with you | 11:49 |
| SergeyLukjanov | mattf, btw alazarev is living in CA | 11:50 |
| mattf | oh, i didn't know, thanks | 11:52 |
| mattf | pulling paramiko 1.10 into rdo - https://bugzilla.redhat.com/188740#c9 | 11:54 |
| *** ruhe is now known as _ruhe | 12:05 | |
| *** qwerty_nor has joined #savanna | 12:09 | |
| *** _ruhe is now known as ruhe | 12:11 | |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/python-savannaclient: Add node-group-template-create to CLI https://review.openstack.org/67960 | 12:12 |
| mattf | aignatov, ^^ | 12:14 |
| aignatov | mattf, lgtm, +2 | 12:18 |
| aignatov | mattf: https://review.openstack.org/#/c/64210/, ^^, ;) | 12:19 |
| SergeyLukjanov | mattf, could you, please, take a look on heat-related changes? | 12:20 |
| SergeyLukjanov | to merge them to be included into the i2 | 12:20 |
| mattf | SergeyLukjanov, aignatov, you guys sharing the computer now? | 12:23 |
| * mattf smiles | 12:23 | |
| SergeyLukjanov | mattf, nope | 12:23 |
| mattf | aignatov, i'll do it before my call in 15 min | 12:23 |
| SergeyLukjanov | but it's really funny - both of us are using MBAs ;) | 12:23 |
| * mattf notes that aignatov hasn't +2'd yet | 12:23 | |
| aignatov | what is MBA? | 12:23 |
| aignatov | matff, +2 on what? on my changes? :) | 12:24 |
| mattf | aignatov, SergeyLukjanov, one reason i've been putting that off is the commit covers half a dozen things | 12:24 |
| mattf | aignatov, yeah, why not | 12:24 |
| mattf | we won't consider it for +A, just extra +2 | 12:24 |
| SergeyLukjanov | aignatov, MBA == MacBook Air | 12:25 |
| mattf | scailing | 12:25 |
| mattf | aignatov, where's your support of your own code!? | 12:25 |
| aignatov | unit tests, savanna-ci's plus ones and +1/+2 from community - that's my support :) | 12:26 |
| * mattf wonders how this might change the json input to create/scale | 12:27 | |
| mattf | aignatov, well put! | 12:28 |
| * mattf notes all the deps are merged | 12:30 | |
| mattf | SergeyLukjanov, ok, now i'll look at your request | 12:30 |
| * mattf chuckles | 12:30 | |
| *** Ch00k has quit IRC | 12:35 | |
| *** Ch00k has joined #savanna | 12:35 | |
| *** DinaBelova is now known as DinaBelova_ | 12:37 | |
| *** Ch00k has quit IRC | 12:52 | |
| *** Ch00k has joined #savanna | 12:53 | |
| openstackgerrit | A change was merged to openstack/savanna: Ignore key/value pairs with empty keys in workflow generation https://review.openstack.org/67497 | 12:56 |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 13:02 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 13:03 | |
| *** DinaBelova_ is now known as DinaBelova | 13:07 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 13:09 | |
| openstackgerrit | A change was merged to openstack/savanna: [Vanilla] Updated docs to point to icehouse images https://review.openstack.org/67569 | 13:15 |
| openstackgerrit | A change was merged to openstack/savanna: Change configs["args"] to be a list for Pig jobs https://review.openstack.org/67588 | 13:17 |
| aignatov | mattf: also this https://review.openstack.org/#/c/66558/ and this https://review.openstack.org/#/c/66636/ | 13:18 |
| aignatov | please :) | 13:18 |
| *** nosnos has quit IRC | 13:30 | |
| mattf | aignatov, first should be 2 commits | 13:30 |
| *** nosnos has joined #savanna | 13:31 | |
| mattf | aignatov, have more? | 13:35 |
| aignatov | mattf: not yet, that's all atm :) | 13:35 |
| aignatov | thank you very much! | 13:35 |
| *** nosnos has quit IRC | 13:38 | |
| *** ruhe is now known as _ruhe | 13:42 | |
| *** _ruhe is now known as ruhe | 13:45 | |
| SergeyLukjanov | guys, please, take a look on EDP docs | 13:49 |
| SergeyLukjanov | https://review.openstack.org/#/c/66937/ | 13:49 |
| SergeyLukjanov | it'll be great to merge them in i2 | 13:49 |
| *** tmckay has joined #savanna | 13:53 | |
| *** _crobertsrh is now known as croberttsrh | 13:58 | |
| *** Ch00k has quit IRC | 14:05 | |
| *** Ch00k has joined #savanna | 14:05 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack/savanna: Update EDP doc https://review.openstack.org/66937 | 14:11 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/savanna: Fixed HDP plugin to support Heat engine https://review.openstack.org/65981 | 14:12 |
| SergeyLukjanov | tmckay, we already have a CR to upgrade savanna client - https://review.openstack.org/#/c/66723/ | 14:26 |
| tmckay | SergeyLukjanov, oops, didn't see the other CR. Should I abandon the new one? | 14:27 |
| SergeyLukjanov | tmckay, yep | 14:27 |
| tmckay | SergeyLukjanov, okay :) My integration test keeps complaining... | 14:27 |
| tmckay | thanks | 14:28 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added short doc about new Heat engine https://review.openstack.org/68127 | 14:30 |
| openstackgerrit | Yaroslav Lobankov proposed a change to openstack/savanna: Fixed HDP plugin to support Heat engine https://review.openstack.org/65981 | 14:38 |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 14:42 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 14:43 | |
| *** aignatov is now known as aignatov_ | 14:45 | |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 14:50 | |
| SergeyLukjanov | tmckay, you can upload new patches to your integration tests and look at savanna-ci results ;) | 14:51 |
| *** aignatov_ is now known as aignatov | 14:52 | |
| SergeyLukjanov | mattf, please, take a look on https://review.openstack.org/#/c/68127/1/doc/source/userdoc/features.rst asap, it'll be great to have it in the i2 | 14:52 |
| tmckay | SergeyLukjanov, yes, I know. Yesterday I was getting "Killed", which is from Oozie, but I couldn't get any logs, etc. So I hacked up the integration tests on my laptop and ran the EDP tests on a long-running cluster, and checked the Oozie log | 14:52 |
| tmckay | SergeyLukjanvo, which reminds me of a question | 14:52 |
| tmckay | SergeryLukjanov, even. What I really wanted yesterday (because my laptop can handle 1 master and 1 or 2 workers) was an option in the test .conf to run tests on an existing cluster and skip all of the cluster creation stuff. There are "SKIP_XXX" flags in the conf, but not enough... What about "skip all creation and run tests on THIS_CLUSTER_ID"? | 14:54 |
| tmckay | aignatov, ^^ | 14:54 |
| *** qwerty_nor has quit IRC | 14:54 | |
| tmckay | Do you think it's worth a blueprint? It really helped me. | 14:54 |
| SergeyLukjanov | tmckay, good idea | 14:54 |
| SergeyLukjanov | tmckay, if you understand how to do it, just push the patch | 14:55 |
| tmckay | my only probably currently with that integration test is the warning on the client version, I think everything else is fine. some non-voting thing is failing... I'll check | 14:55 |
| tmckay | SergeyLukjanov, okay, thanks | 14:55 |
| tmckay | "probably" => "problem" | 14:56 |
| *** IlyaE has joined #savanna | 14:57 | |
| *** qwerty_nor has joined #savanna | 14:58 | |
| croberttsrh | akuznets_: Have you seen my questions on https://review.openstack.org/#/c/47828/ ? | 14:58 |
| aignatov | croberttsrh: unfortunately, akuznets_ is not working on the savanna project :( | 15:01 |
| aignatov | not sure if he's able to answer | 15:01 |
| croberttsrh | Hmm, he is listed as a co-author on the CR I mentioned | 15:01 |
| aignatov | right, it was before the New Year | 15:02 |
| croberttsrh | ah, things have changed for him? I see. | 15:02 |
| croberttsrh | Who is the new expert on the HDFS as a data source change? | 15:02 |
| tmckay | crobertsrh, I may be able to help | 15:03 |
| tmckay | what's up? | 15:03 |
| aignatov | let's assume it's me :) | 15:03 |
| tmckay | or him ^^ | 15:03 |
| tmckay | ;-) | 15:03 |
| croberttsrh | My comments/issues are in my review notes on the CR | 15:04 |
| croberttsrh | In short. Either it's user error (my fault), or something just isn't quite working correctly. | 15:04 |
| croberttsrh | Hopefully someone can tell me which | 15:04 |
| tmckay | croberttsrh, you added a "t" in your username, how come? | 15:05 |
| aignatov | in order to justify I was checking patch before the new year and it worked | 15:05 |
| aignatov | I used only rest calls | 15:06 |
| tmckay | reminds me of Gollum.. precioussss | 15:06 |
| aignatov | tmckay: lol! | 15:06 |
| *** croberttsrh is now known as crobertsrh | 15:06 | |
| tmckay | crobertsrh, I can try a run too | 15:06 |
| crobertsrh | typing must not be my strong suit today | 15:06 |
| tmckay | I've become pretty familiar with things EDP | 15:06 |
| crobertsrh | excellent. Any help would be useful. I'm hoping for just plain old user error, which would make life much nicer. | 15:07 |
| tmckay | SergeyLukjanov, I need to update the REST api doc for Java actions, but an error on the hdfs stuff is probably worth verifying/disproving. Do I have til late tomorrow to get the doc change in? | 15:07 |
| SergeyLukjanov | tmckay, I hope that we'll add mp branch today | 15:08 |
| SergeyLukjanov | or early tomorrow | 15:08 |
| SergeyLukjanov | depends on queue length | 15:08 |
| *** IvanBerezovskiy has left #savanna | 15:08 | |
| tmckay | okay. I'll try for both | 15:08 |
| SergeyLukjanov | but I think that it's ok to backport docs update | 15:08 |
| tmckay | alright | 15:08 |
| SergeyLukjanov | but anyway, I think that it should be approved before Wed to be able to sleep for a day or two in zuul queue ;) | 15:09 |
| tmckay | agreed | 15:09 |
| openstackgerrit | Alexander Ignatov proposed a change to openstack/savanna: Added short doc about new Heat engine https://review.openstack.org/68127 | 15:11 |
| aignatov | crobertsrh, tmckay, I'll try to check this patch again as well | 15:11 |
| crobertsrh | great, thanks | 15:12 |
| SergeyLukjanov | I'll move all non-approved stuff to the i3 later today | 15:13 |
| SergeyLukjanov | in 3-5 hours | 15:14 |
| SergeyLukjanov | so, if you'd like anything to be included into the i2, please, be sure that it'll be approved | 15:14 |
| SergeyLukjanov | exceptions: docs updates, critical issues fixes | 15:14 |
| *** Jayunit100 has joined #savanna | 15:20 | |
| tmckay | crobertsrh, great, my devstack picks now to start acting up | 15:21 |
| crobertsrh | Of course. just rename it to murphy.sh | 15:22 |
| tmckay | heh | 15:22 |
| *** rnirmal has joined #savanna | 15:30 | |
| *** Ch00k has quit IRC | 15:34 | |
| *** Ch00k has joined #savanna | 15:35 | |
| *** Ch00k has quit IRC | 15:35 | |
| *** Ch00k has joined #savanna | 15:36 | |
| openstackgerrit | A change was merged to openstack/python-savannaclient: Add node-group-template-create to CLI https://review.openstack.org/67960 | 15:48 |
| *** Ch00k has quit IRC | 15:48 | |
| *** Ch00k has joined #savanna | 15:49 | |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 15:51 | |
| *** Ch00k has quit IRC | 15:53 | |
| *** Ch00k has joined #savanna | 15:54 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Read Swift credentials from input_data OR output_data https://review.openstack.org/67509 | 15:55 |
| *** SergeyLukjanov is now known as SergeyLukjanov_ | 15:57 | |
| *** DinaBelova is now known as DinaBelova_ | 16:02 | |
| tmckay | File "/opt/stack/keystone/keystone/cli.py", line 23, in <module> | 16:02 |
| tmckay | from oslo.config import cfg | 16:02 |
| tmckay | ImportError: No module named config | 16:02 |
| tmckay | but, I can see it. huh? | 16:02 |
| tmckay | oh, darn. It has dots in the name. I'm guessing that's a problem | 16:04 |
| * tmckay goes to email lists | 16:04 | |
| tmckay | apparently not a name problem, although I admit I have never seen a Python naming like that. Weird at best, I think. | 16:12 |
| tmckay | hoping it was old oslo in site-packages | 16:12 |
| *** jp_ has quit IRC | 16:15 | |
| * tmckay was on master, trying havana | 16:21 | |
| *** Ch00k has quit IRC | 16:25 | |
| *** aignatov is now known as aignatov_ | 16:30 | |
| *** DinaBelova_ is now known as DinaBelova | 16:33 | |
| *** DinaBelova is now known as DinaBelova_ | 16:58 | |
| openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Changed name field validation for savanna objects https://review.openstack.org/66745 | 17:00 |
| tmckay | okay. Somewhere, I had an old "oslo" in site packages which nothing (yum or pip) could seem to find. Don't know why it was there. | 17:01 |
| tmckay | This was confusing Python, which couldn't find the current "oslo.whatevers" | 17:01 |
| tmckay | crobertsrh, okay, so, still having trouble with hdfs? | 17:04 |
| tmckay | I'm back from my oslo nightmare | 17:05 |
| crobertsrh | Yes....same results today | 17:06 |
| crobertsrh | HDFS as input == fail | 17:06 |
| crobertsrh | HDFS as output (swift input) == SUCCESS according to savanna, but I don't see the output file anywhere and Oozie reports an error | 17:07 |
| tmckay | okay | 17:07 |
| crobertsrh | HDFS for both also fails | 17:07 |
| crobertsrh | but I may just be specifying something incorrectly | 17:08 |
| crobertsrh | If you get one to work, send me your data source definitions | 17:08 |
| tmckay | crobertsrh, aignatov_, okay, I'm going to postulate this is in UI or API because I have run numerous examples through Oozie from the cli on the worker with hdfs in/out and been fine | 17:08 |
| tmckay | crobertsrh, ack | 17:09 |
| Jayunit100 | aside what are your productivity tools for python (type checking, code completion… ) or do you just use grep. | 17:09 |
| tmckay | well, I have toyed with pylint very quickly in the past but have not mastered it in any way. Always too busy. I do find epydoc pretty awesome though for examining class hierarchies. | 17:10 |
| tmckay | and I use winpdb for a debugger, unless it's green threads like all of OpenStack ;-) where the debugger breaks. So I embed ipdb and use ipdb.set_trace() | 17:11 |
| tmckay | crobertsrh, quick question, are you trying to use "external" hdfs, or hdfs on the cluster you've started? The patch should support both. I have not done anything with an "external" hdfs | 17:13 |
| crobertsrh | Trying to use it on the cluster I've started. | 17:14 |
| crobertsrh | which is the same cluster that I'm trying to run the job on | 17:14 |
| tmckay | okay, that's where I'm headed | 17:14 |
| Jayunit100 | so, the java developers "i use eclipse" answer… no equivalent for python people i guess huh | 17:15 |
| tmckay | Jayunit100, croberts has been known to use eclipse. I use emacs with rgrep | 17:16 |
| tmckay | crobertsrh, that is | 17:16 |
| crobertsrh | I do use eclipse for python......PyDev plugin | 17:16 |
| tmckay | One of these days, I'll have to embrace Eclipse. Been meaning to do that for a while. | 17:17 |
| ruhe | Jayunit100: python developers use emacs,vim,Sublime,PyCharm,Eclipse. that's all editors i know from people around | 17:17 |
| dmitryme | Jayunit100: "I use PyCharm" is one of equivalents I guess | 17:17 |
| tmckay | heh, I use the interpreter :) Hard core. | 17:17 |
| ruhe | or just do "echo to file" and git commit | 17:18 |
| tmckay | that's how I found my oslo problem this morning | 17:18 |
| tmckay | ruhe, lol | 17:18 |
| *** SergeyLukjanov_ is now known as SergeyLukjanov | 17:22 | |
| *** Ch00k has joined #savanna | 17:44 | |
| *** DinaBelova_ is now known as DinaBelova | 17:45 | |
| *** dmitryme has quit IRC | 17:49 | |
| openstackgerrit | A change was merged to openstack/savanna: Add alembic migration tool to sqlalchemy https://review.openstack.org/64032 | 17:51 |
| SergeyLukjanov | yay! | 17:51 |
| SergeyLukjanov | it merged | 17:51 |
| openstackgerrit | A change was merged to openstack/savanna: Added anti-affinity feature to Heat engine https://review.openstack.org/64210 | 17:53 |
| *** ruhe is now known as _ruhe | 17:57 | |
| crobertsrh | tmckay: any luck? | 17:58 |
| tmckay | crobertsrh, just getting there now. lingering fallout from my devstack debacle | 17:59 |
| crobertsrh | ah, ok | 17:59 |
| openstackgerrit | A change was merged to openstack/savanna: Fixed wrong instance name with Heat engine https://review.openstack.org/66558 | 18:02 |
| tmckay | crobertsrh, okay, it worked | 18:08 |
| crobertsrh | Ok. What were your values for the datasource? | 18:09 |
| tmckay | This may be the key part | 18:09 |
| tmckay | <param>INPUT=hdfs://10.0.3.2:/user/hadoop/input</param> | 18:09 |
| tmckay | <param>OUTPUT=hdfs://10.0.3.2:/user/hadoop/output</param> | 18:09 |
| crobertsrh | Ah, I suspect my problem is the lack of pathnames | 18:09 |
| tmckay | I tried localhost first, and it failed | 18:09 |
| crobertsrh | User error | 18:09 |
| tmckay | 10.0.3.2:8020 is my namenode address | 18:09 |
| *** nadya__ has joined #savanna | 18:09 | |
| tmckay | crobertsrh, also not sure if the path names are required, I'll retry with that mod | 18:09 |
| crobertsrh | I'm guessing they are :) | 18:10 |
| tmckay | crobertsrh, could be. The "hadoop" commandline stuff assumes the user, though. Not out of the question that it would work that way | 18:10 |
| openstackgerrit | A change was merged to openstack/savanna: Enable heat engine to launch cluster without keypair https://review.openstack.org/66636 | 18:11 |
| tmckay | crobertrsh, yeah, this failed for me | 18:15 |
| crobertsrh | tmckay: for the " <param>INPUT=hdfs://10.0.3.2:/user/hadoop/input</param>", is the ":" required after the ip? | 18:15 |
| tmckay | <param>INPUT=hdfs://10.0.3.2:input</param> | 18:15 |
| tmckay | <param>OUTPUT=hdfs://10.0.3.2:output2</param> | 18:15 |
| tmckay | oh, duh | 18:16 |
| tmckay | should have been a slash | 18:16 |
| tmckay | hmm, not sure | 18:16 |
| tmckay | I'll try again | 18:16 |
| *** nadya__ has quit IRC | 18:18 | |
| *** aignatov_ is now known as aignatov | 18:19 | |
| tmckay | crobertsrh, okay, looks like ":" is not required. Also, I duplicated your results -- correct input path with bogus output path is marked success but the output is nowhere to be found | 18:22 |
| tmckay | That's not us, it's an Oozie or a Pig thing I think | 18:23 |
| crobertsrh | Ok. For sure a bug somewhere | 18:23 |
| tmckay | looks like no reduce task ran | 18:23 |
| crobertsrh | I'm hoping to succeed on my current run | 18:23 |
| *** aignatov is now known as aignatov_ | 18:23 | |
| crobertsrh | crap, still failing | 18:24 |
| tmckay | just worked for me with path and no colon on both | 18:25 |
| *** IlyaE has quit IRC | 18:40 | |
| *** crobertsrh has quit IRC | 18:42 | |
| *** jp_ has joined #savanna | 18:42 | |
| *** jp_ has quit IRC | 18:57 | |
| openstackgerrit | A change was merged to openstack/savanna: Enable check of Heat engine for Vanilla and HDP https://review.openstack.org/65911 | 18:57 |
| *** akuznets_ has quit IRC | 18:59 | |
| *** shiran has joined #savanna | 19:01 | |
| *** IlyaE has joined #savanna | 19:01 | |
| *** kbroughton has joined #savanna | 19:08 | |
| *** jp_ has joined #savanna | 19:12 | |
| SergeyLukjanov | crobertsrh, tmckay, ping | 19:14 |
| tmckay | hi | 19:14 |
| SergeyLukjanov | tmckay, Chad is offline now | 19:15 |
| SergeyLukjanov | tmckay, could you please confirm that external HDFS is ready to be merged? | 19:15 |
| SergeyLukjanov | Chad already +1'ed it | 19:15 |
| tmckay | looks like he will be back later | 19:15 |
| tmckay | SergeyLukjanov, yes, I tested too | 19:16 |
| tmckay | SergeyLukjanov, I've already got a +1 | 19:16 |
| SergeyLukjanov | tmckay, ok, thanks, I'll approve it right now to include into the i2 | 19:16 |
| mattf | SergeyLukjanov, want cluster-template & cluster create in the cli for i2? | 19:20 |
| *** jp_ has quit IRC | 19:23 | |
| *** kbroughton has quit IRC | 19:29 | |
| *** IlyaE has quit IRC | 19:29 | |
| *** kbroughton has joined #savanna | 19:30 | |
| *** dmitryme has joined #savanna | 19:30 | |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/python-savannaclient: Add cluster-template-create to CLI https://review.openstack.org/68211 | 19:31 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/python-savannaclient: Add cluster-create to CLI https://review.openstack.org/68212 | 19:31 |
| *** qwerty_nor has quit IRC | 19:31 | |
| mattf | SergeyLukjanov, aignatov_, ^^ rounding out the *-create calls in the CLI (for v1.0 anyway) | 19:31 |
| *** IlyaE has joined #savanna | 19:32 | |
| SergeyLukjanov | mattf, I'll take a look the | 19:32 |
| SergeyLukjanov | m | 19:32 |
| SergeyLukjanov | mattf, btw, I saw today one misconsistence | 19:33 |
| SergeyLukjanov | looks like commands for showing plugins versions should be | 19:33 |
| SergeyLukjanov | plugin_list | 19:33 |
| SergeyLukjanov | not pluginS_list | 19:33 |
| SergeyLukjanov | and service type should data_processing by default | 19:33 |
| mattf | SergeyLukjanov, the pluginS_list -> plugin_list merge is in master | 19:34 |
| mattf | where's the data_processing inconsistency? | 19:35 |
| *** jp_ has joined #savanna | 19:36 | |
| SergeyLukjanov | mattf, oops, I've checked the 0.4.1 version | 19:37 |
| SergeyLukjanov | mattf, in 0.4.1 in help string for --service-type flag | 19:37 |
| SergeyLukjanov | https://github.com/openstack/python-savannaclient/blob/master/savannaclient/shell.py#L325 | 19:38 |
| SergeyLukjanov | it's correct by default in code | 19:39 |
| SergeyLukjanov | https://github.com/openstack/python-savannaclient/blob/master/savannaclient/shell.py#L65 | 19:39 |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/python-savannaclient: Fix default service-type name in help https://review.openstack.org/68217 | 19:39 |
| mattf | not sure what you mean | 19:39 |
| SergeyLukjanov | but helpstring is incorrect | 19:39 |
| SergeyLukjanov | heh, you've already published fix for it :) | 19:39 |
| SergeyLukjanov | > https://review.openstack.org/#/c/68217/ | 19:39 |
| * mattf smiles | 19:39 | |
| *** aignatov_ is now known as aignatov | 19:45 | |
| SergeyLukjanov | <mattf> SergeyLukjanov, want cluster-template & cluster create in the cli for i2? | 19:46 |
| *** crobertsrh has joined #savanna | 19:46 | |
| SergeyLukjanov | mattf, client is releasing separately, so, I'd like to make 0.4.2 when we'll have basic cli ops for all stuff | 19:47 |
| mattf | SergeyLukjanov, so all the v1.0 ops are there now (last 2 in review) | 19:48 |
| SergeyLukjanov | mattf, pep8 in https://review.openstack.org/#/c/68217/ | 19:48 |
| * mattf groans | 19:48 | |
| openstackgerrit | Matthew Farrellee proposed a change to openstack/python-savannaclient: Fix default service-type name in help https://review.openstack.org/68217 | 19:49 |
| *** nadya__ has joined #savanna | 20:01 | |
| *** kbroughton_ has joined #savanna | 20:01 | |
| *** kbroughton has quit IRC | 20:01 | |
| *** kbroughton_ is now known as kbroughton | 20:01 | |
| *** DinaBelova is now known as DinaBelova_ | 20:08 | |
| openstackgerrit | Jonathan Maron proposed a change to openstack/savanna: Update Ambari Repo location and services refactoring https://review.openstack.org/67577 | 20:13 |
| *** nadya__ has quit IRC | 20:15 | |
| *** dmitryme has quit IRC | 20:19 | |
| aignatov | SergeyLukjanov, tmckay, crobertsrh: double-checked, EDP works with external HDFS, provision some cluster, with HDFS only put some data there, then started new cluster with Oozie and ran pig job through it using savanna | 20:20 |
| aignatov | SUCCEEDED | 20:20 |
| aignatov | here is my request list http://paste.openstack.org/show/61646/ | 20:21 |
| crobertsrh | Yes..I had a bit of user error and also ran into another bug that tmckay already has the fix for (HDFS input with Swift output). Thanks! | 20:21 |
| tmckay | be back soon, have to run out | 20:22 |
| *** NikitaKonovalov_ is now known as NikitaKonovalov | 20:24 | |
| aignatov | glad to see external HDFS patch merged :) it's the most long-lived patch set in gerrit - just noticed "Uploaded Sep 23, 2013 17:02", Updated Jan 21, 2014 23:17 | 20:24 |
| *** jp_ has quit IRC | 20:25 | |
| crobertsrh | Hopefully, it got better over time.....very fine wine! | 20:26 |
| openstackgerrit | Jenkins proposed a change to openstack/savanna: Updated from global requirements https://review.openstack.org/68250 | 20:29 |
| openstackgerrit | A change was merged to openstack/savanna: Update EDP doc https://review.openstack.org/66937 | 20:33 |
| tmckay | bah, gerrit is giving me fits, I presume because of a rename on top of a file create. I'll a CR with a dependent CR... | 21:09 |
| tmckay | I'll try, that is | 21:09 |
| crobertsrh | gerrit is a cruel mistress | 21:17 |
| *** NikitaKonovalov is now known as NikitaKonovalov_ | 21:32 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add integration test for Oozie java action https://review.openstack.org/66415 | 21:32 |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add integration test for Oozie java action https://review.openstack.org/66415 | 21:39 |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add integration test for Oozie java action https://review.openstack.org/66415 | 21:42 |
| *** shiran has quit IRC | 21:43 | |
| *** shiran has joined #savanna | 21:43 | |
| openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add integration test for Oozie java action https://review.openstack.org/66415 | 21:45 |
| *** shiran has quit IRC | 21:58 | |
| *** aignatov is now known as aignatov_ | 22:23 | |
| *** Ch00k has quit IRC | 22:31 | |
| *** IlyaE has quit IRC | 22:41 | |
| SergeyLukjanov | INFO: i2 branch cut around 7am MST tomorrow, tags expected toward the end of day | 22:45 |
| *** SergeyLukjanov is now known as SergeyLukjanov_a | 22:50 | |
| *** SergeyLukjanov_a is now known as SergeyLukjanov_ | 22:51 | |
| *** rnirmal has quit IRC | 23:04 | |
| *** kbroughton has quit IRC | 23:12 | |
| *** kbroughton has joined #savanna | 23:13 | |
| *** crobertsrh has quit IRC | 23:14 | |
| *** kbroughton has quit IRC | 23:16 | |
| *** kbroughton has joined #savanna | 23:16 | |
| *** Jayunit100 has quit IRC | 23:40 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!