Monday, 2014-01-06

*** nosnos has joined #savanna01:06
*** amrit has joined #savanna01:11
*** amrit has quit IRC01:19
*** amrit has joined #savanna01:20
*** amrit has quit IRC02:14
*** xuhanp has joined #savanna02:35
*** xuhanp has quit IRC02:36
*** xuhanp has joined #savanna02:37
*** _ruhe is now known as ruhe02:40
*** ruhe is now known as ruhe_away03:01
*** ruhe_away is now known as _ruhe03:20
*** nosnos_ has joined #savanna05:34
*** nosnos__ has joined #savanna05:36
*** nosnos_ has quit IRC05:37
*** nosnos has quit IRC05:38
*** nosnos__ has quit IRC07:06
*** nosnos has joined #savanna07:06
*** nadya_ has joined #savanna07:36
*** NikitaKonovalov has joined #savanna07:45
*** NikitaKonovalov has quit IRC07:45
*** nadya_ has quit IRC08:01
*** nadya_ has joined #savanna08:52
*** nadya_ has quit IRC09:38
*** xuhanp has quit IRC10:12
*** nadya_ has joined #savanna10:39
*** qwerty_nor has joined #savanna11:30
*** nadya_ has quit IRC11:34
*** qwerty_nor has quit IRC12:00
*** qwerty_nor has joined #savanna12:01
*** nadya_ has joined #savanna12:05
*** nadya_ has quit IRC12:12
*** nadya_ has joined #savanna12:12
*** nadya_ has quit IRC12:23
*** nosnos has quit IRC12:36
*** _crobertsrh is now known as crobertsrh13:55
*** tmckay has joined #savanna14:17
*** tmckay has quit IRC14:18
*** tmckay has joined #savanna14:18
*** openstack has joined #savanna14:33
-card.freenode.net- [freenode-info] channel trolls and no channel staff around to help? please check with freenode support: http://freenode.net/faq.shtml#gettinghelp14:33
*** crobertsrh has left #savanna14:50
*** crobertsrh has joined #savanna14:51
*** _ruhe has quit IRC15:09
*** _ruhe has joined #savanna15:10
*** rnirmal has joined #savanna16:09
*** jmaron has joined #savanna17:01
*** jmaron has quit IRC17:16
*** nadya_ has joined #savanna17:18
*** jmaron has joined #savanna17:24
*** nadya_ has quit IRC17:33
*** nadya_ has joined #savanna17:33
openstackgerritA change was merged to openstack/savanna: Fix typos in edp integration test utility method name  https://review.openstack.org/6490617:42
*** jmaron has quit IRC18:46
*** jmaron has joined #savanna18:53
*** nadya_ has quit IRC19:09
mattfjmaron, speidel around?19:16
jmaronnot sure...19:18
mattfcan you activate his shock collar?19:19
jmarondone ;)19:23
* mattf is glad he doesn't have one19:23
jmaron:)19:23
*** nadya_ has joined #savanna19:31
*** sballe has joined #savanna19:35
tmckaycrobertsrh, btw, if you're looking at java action stuff... To use java actions with swift input output, fs.swift.service.savanna.username  and fs.swift.service.savanna.password will have to be added in configs explicitly.  Trying this now :)  The reason is that in the case of other job types, the credentials are lifted automatically from the input data source (which doesn't exist for java actions)19:36
crobertsrhI saw a comment in your code about being unsure about the credentials for swift.19:36
tmckaycrobertsrh, I think the simple way to test this is for example is to use the wordcount.tgz I sent you and modify the workflow to contain the above settings ^^ with args set to swift paths.19:37
* tmckay crosses fingers19:37
crobertsrhYeah, that ought to work19:37
tmckayI'll let you know what I find19:37
*** jmaron has quit IRC19:38
tmckaynot sure there's any impact for the UI, more like a note in the user guide (if you use swift that requires credentials, make sure you add these)19:38
*** nadya_ has quit IRC20:01
*** amrit has joined #savanna20:02
*** amrit has quit IRC20:02
*** amrit has joined #savanna20:03
*** jmaron has joined #savanna20:08
*** jmaron has quit IRC20:13
*** amrit has quit IRC20:18
tmckayanyone have experience with this? org.apache.hadoop.fs.swift.exceptions.SwiftConfigurationException: Missing mandatory configuration option: fs.swift.service.savanna.username20:36
tmckayit's on an oozie java action, and I have fs.swift.service.savanna.username set in the workflow.xml and in job.properties both20:37
tmckay Launcher ERROR, reason: Main class [org.apache.hadoop.examples.WordCount], main() threw exception, Missing mandatory configuration option: fs.swift.service.savanna.username20:38
tmckayhmm, maybe I have to set it somewhere else...20:39
*** _ruhe is now known as ruhe20:42
*** ruhe is now known as ruhe_away20:58
*** ruhe_away is now known as ruhe20:59
*** jmaron has joined #savanna21:09
*** jmaron has quit IRC21:13
*** qwerty_nor has quit IRC21:24
crobertsrhtmckay:  Is config-hints not yet implemented for Java Action?21:36
tmckayI think not21:36
crobertsrhOk.  That saves me some debugging time :)21:37
crobertsrhThanks21:37
tmckayone of those things I forgot to go back to21:37
tmckaycrobertsrh, looks to me so far like the Wordcount example needs to be modified to take swift credentials as args.  It's written to create a new blank config in main()...21:38
crobertsrhAh, ok.  Makes sense, I suppose.  I was just getting around to hacking around with it now.21:39
tmckaySo the method of passing swift credentials for mapreduce/hive/pig doesn't work for java actions.  Those are all apparently run from a wrapper that constructs the config21:39
tmckaymore general == more power == less done for you :)21:39
tmckayplaying with modifying wordcount to take extra args now21:39
*** crobertsrh is now known as _crobertsrh22:01
*** jmaron has joined #savanna22:09
*** jmaron has quit IRC22:14
*** alazarev has joined #savanna22:28
*** ruhe is now known as _ruhe22:28
openstackgerritA change was merged to openstack/savanna: Eliminate extra newlines in generated workflow.xml  https://review.openstack.org/6485722:36
*** rnirmal_ has joined #savanna22:57
*** rnirmal_ has quit IRC22:57
*** rnirmal has quit IRC22:59
*** nadya_ has joined #savanna23:02
*** nadya_ has quit IRC23:07
*** rnirmal has joined #savanna23:07
*** jmaron has joined #savanna23:09
*** jmaron has quit IRC23:14
*** jmaron has joined #savanna23:27
*** alazarev has quit IRC23:39
*** alazarev has joined #savanna23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!