*** nosnos has joined #savanna | 01:06 | |
*** amrit has joined #savanna | 01:11 | |
*** amrit has quit IRC | 01:19 | |
*** amrit has joined #savanna | 01:20 | |
*** amrit has quit IRC | 02:14 | |
*** xuhanp has joined #savanna | 02:35 | |
*** xuhanp has quit IRC | 02:36 | |
*** xuhanp has joined #savanna | 02:37 | |
*** _ruhe is now known as ruhe | 02:40 | |
*** ruhe is now known as ruhe_away | 03:01 | |
*** ruhe_away is now known as _ruhe | 03:20 | |
*** nosnos_ has joined #savanna | 05:34 | |
*** nosnos__ has joined #savanna | 05:36 | |
*** nosnos_ has quit IRC | 05:37 | |
*** nosnos has quit IRC | 05:38 | |
*** nosnos__ has quit IRC | 07:06 | |
*** nosnos has joined #savanna | 07:06 | |
*** nadya_ has joined #savanna | 07:36 | |
*** NikitaKonovalov has joined #savanna | 07:45 | |
*** NikitaKonovalov has quit IRC | 07:45 | |
*** nadya_ has quit IRC | 08:01 | |
*** nadya_ has joined #savanna | 08:52 | |
*** nadya_ has quit IRC | 09:38 | |
*** xuhanp has quit IRC | 10:12 | |
*** nadya_ has joined #savanna | 10:39 | |
*** qwerty_nor has joined #savanna | 11:30 | |
*** nadya_ has quit IRC | 11:34 | |
*** qwerty_nor has quit IRC | 12:00 | |
*** qwerty_nor has joined #savanna | 12:01 | |
*** nadya_ has joined #savanna | 12:05 | |
*** nadya_ has quit IRC | 12:12 | |
*** nadya_ has joined #savanna | 12:12 | |
*** nadya_ has quit IRC | 12:23 | |
*** nosnos has quit IRC | 12:36 | |
*** _crobertsrh is now known as crobertsrh | 13:55 | |
*** tmckay has joined #savanna | 14:17 | |
*** tmckay has quit IRC | 14:18 | |
*** tmckay has joined #savanna | 14:18 | |
*** openstack has joined #savanna | 14:33 | |
-card.freenode.net- [freenode-info] channel trolls and no channel staff around to help? please check with freenode support: http://freenode.net/faq.shtml#gettinghelp | 14:33 | |
*** crobertsrh has left #savanna | 14:50 | |
*** crobertsrh has joined #savanna | 14:51 | |
*** _ruhe has quit IRC | 15:09 | |
*** _ruhe has joined #savanna | 15:10 | |
*** rnirmal has joined #savanna | 16:09 | |
*** jmaron has joined #savanna | 17:01 | |
*** jmaron has quit IRC | 17:16 | |
*** nadya_ has joined #savanna | 17:18 | |
*** jmaron has joined #savanna | 17:24 | |
*** nadya_ has quit IRC | 17:33 | |
*** nadya_ has joined #savanna | 17:33 | |
openstackgerrit | A change was merged to openstack/savanna: Fix typos in edp integration test utility method name https://review.openstack.org/64906 | 17:42 |
---|---|---|
*** jmaron has quit IRC | 18:46 | |
*** jmaron has joined #savanna | 18:53 | |
*** nadya_ has quit IRC | 19:09 | |
mattf | jmaron, speidel around? | 19:16 |
jmaron | not sure... | 19:18 |
mattf | can you activate his shock collar? | 19:19 |
jmaron | done ;) | 19:23 |
* mattf is glad he doesn't have one | 19:23 | |
jmaron | :) | 19:23 |
*** nadya_ has joined #savanna | 19:31 | |
*** sballe has joined #savanna | 19:35 | |
tmckay | crobertsrh, btw, if you're looking at java action stuff... To use java actions with swift input output, fs.swift.service.savanna.username and fs.swift.service.savanna.password will have to be added in configs explicitly. Trying this now :) The reason is that in the case of other job types, the credentials are lifted automatically from the input data source (which doesn't exist for java actions) | 19:36 |
crobertsrh | I saw a comment in your code about being unsure about the credentials for swift. | 19:36 |
tmckay | crobertsrh, I think the simple way to test this is for example is to use the wordcount.tgz I sent you and modify the workflow to contain the above settings ^^ with args set to swift paths. | 19:37 |
* tmckay crosses fingers | 19:37 | |
crobertsrh | Yeah, that ought to work | 19:37 |
tmckay | I'll let you know what I find | 19:37 |
*** jmaron has quit IRC | 19:38 | |
tmckay | not sure there's any impact for the UI, more like a note in the user guide (if you use swift that requires credentials, make sure you add these) | 19:38 |
*** nadya_ has quit IRC | 20:01 | |
*** amrit has joined #savanna | 20:02 | |
*** amrit has quit IRC | 20:02 | |
*** amrit has joined #savanna | 20:03 | |
*** jmaron has joined #savanna | 20:08 | |
*** jmaron has quit IRC | 20:13 | |
*** amrit has quit IRC | 20:18 | |
tmckay | anyone have experience with this? org.apache.hadoop.fs.swift.exceptions.SwiftConfigurationException: Missing mandatory configuration option: fs.swift.service.savanna.username | 20:36 |
tmckay | it's on an oozie java action, and I have fs.swift.service.savanna.username set in the workflow.xml and in job.properties both | 20:37 |
tmckay | Launcher ERROR, reason: Main class [org.apache.hadoop.examples.WordCount], main() threw exception, Missing mandatory configuration option: fs.swift.service.savanna.username | 20:38 |
tmckay | hmm, maybe I have to set it somewhere else... | 20:39 |
*** _ruhe is now known as ruhe | 20:42 | |
*** ruhe is now known as ruhe_away | 20:58 | |
*** ruhe_away is now known as ruhe | 20:59 | |
*** jmaron has joined #savanna | 21:09 | |
*** jmaron has quit IRC | 21:13 | |
*** qwerty_nor has quit IRC | 21:24 | |
crobertsrh | tmckay: Is config-hints not yet implemented for Java Action? | 21:36 |
tmckay | I think not | 21:36 |
crobertsrh | Ok. That saves me some debugging time :) | 21:37 |
crobertsrh | Thanks | 21:37 |
tmckay | one of those things I forgot to go back to | 21:37 |
tmckay | crobertsrh, looks to me so far like the Wordcount example needs to be modified to take swift credentials as args. It's written to create a new blank config in main()... | 21:38 |
crobertsrh | Ah, ok. Makes sense, I suppose. I was just getting around to hacking around with it now. | 21:39 |
tmckay | So the method of passing swift credentials for mapreduce/hive/pig doesn't work for java actions. Those are all apparently run from a wrapper that constructs the config | 21:39 |
tmckay | more general == more power == less done for you :) | 21:39 |
tmckay | playing with modifying wordcount to take extra args now | 21:39 |
*** crobertsrh is now known as _crobertsrh | 22:01 | |
*** jmaron has joined #savanna | 22:09 | |
*** jmaron has quit IRC | 22:14 | |
*** alazarev has joined #savanna | 22:28 | |
*** ruhe is now known as _ruhe | 22:28 | |
openstackgerrit | A change was merged to openstack/savanna: Eliminate extra newlines in generated workflow.xml https://review.openstack.org/64857 | 22:36 |
*** rnirmal_ has joined #savanna | 22:57 | |
*** rnirmal_ has quit IRC | 22:57 | |
*** rnirmal has quit IRC | 22:59 | |
*** nadya_ has joined #savanna | 23:02 | |
*** nadya_ has quit IRC | 23:07 | |
*** rnirmal has joined #savanna | 23:07 | |
*** jmaron has joined #savanna | 23:09 | |
*** jmaron has quit IRC | 23:14 | |
*** jmaron has joined #savanna | 23:27 | |
*** alazarev has quit IRC | 23:39 | |
*** alazarev has joined #savanna | 23:49 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!