*** matsuhashi has joined #savanna | 00:16 | |
*** akuznetsov has quit IRC | 00:25 | |
*** ylobankov has quit IRC | 00:25 | |
*** akuznets_ has joined #savanna | 00:28 | |
*** akuznetsov has joined #savanna | 00:28 | |
*** jcooley_ has joined #savanna | 00:29 | |
*** akuznets_ has quit IRC | 00:30 | |
*** SergeyLukjanov has joined #savanna | 00:31 | |
*** jcooley has quit IRC | 00:32 | |
*** jcooley_ is now known as jcooley | 00:32 | |
*** _mattf` has quit IRC | 00:32 | |
*** _crobertsrh has quit IRC | 00:32 | |
*** NikitaKonovalov_ has quit IRC | 00:32 | |
*** SergeyLukjanov_a has quit IRC | 00:32 | |
*** ylobankov1 has joined #savanna | 00:33 | |
*** ylobankov1 has quit IRC | 00:37 | |
*** matsuhashi has quit IRC | 00:38 | |
*** _mattf has joined #savanna | 00:39 | |
*** openstackgerrit has quit IRC | 00:41 | |
*** NikitaKonovalov_ has joined #savanna | 00:44 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 00:44 | |
*** akuznetsov has quit IRC | 00:56 | |
*** SergeyLukjanov has quit IRC | 00:56 | |
*** jcooley has quit IRC | 00:56 | |
*** ityaptin has quit IRC | 00:56 | |
*** bogdando has quit IRC | 00:56 | |
*** NikitaKonovalov has quit IRC | 00:56 | |
*** aignatov_ has quit IRC | 00:56 | |
*** DinaBelova_ has quit IRC | 00:56 | |
*** _mattf has quit IRC | 00:56 | |
*** venza has quit IRC | 00:56 | |
*** ChanServ has quit IRC | 00:56 | |
*** NikitaKonovalov has joined #savanna | 01:03 | |
*** SergeyLukjanov has joined #savanna | 01:03 | |
*** jcooley has joined #savanna | 01:03 | |
*** akuznetsov has joined #savanna | 01:03 | |
*** ityaptin has joined #savanna | 01:03 | |
*** bogdando has joined #savanna | 01:03 | |
*** aignatov_ has joined #savanna | 01:03 | |
*** DinaBelova_ has joined #savanna | 01:03 | |
*** venza has joined #savanna | 01:03 | |
*** ChanServ has joined #savanna | 01:03 | |
*** wolfe.freenode.net sets mode: +o ChanServ | 01:03 | |
*** NikitaKonovalov has quit IRC | 01:04 | |
*** aignatov_ has quit IRC | 01:04 | |
*** DinaBelova_ has quit IRC | 01:04 | |
*** matsuhashi has joined #savanna | 01:08 | |
*** ylobankov has joined #savanna | 01:12 | |
*** aignatov has joined #savanna | 01:12 | |
*** DinaBelo` has joined #savanna | 01:14 | |
*** DinaBelo` is now known as DinaBelova | 01:14 | |
*** aignatov has quit IRC | 01:14 | |
*** DinaBelova has quit IRC | 01:18 | |
*** matsuhashi is now known as 45PABAKC5 | 01:21 | |
*** matsuhashi has joined #savanna | 01:21 | |
*** _mattf` has joined #savanna | 01:21 | |
*** aignatov_ has joined #savanna | 01:23 | |
*** NikitaKonovalov_ has joined #savanna | 01:23 | |
*** NikitaKonovalov_ is now known as NikitaKonovalov | 01:24 | |
*** aignatov_ is now known as aignatov | 01:24 | |
*** ylobankov has quit IRC | 01:24 | |
*** 45PABAKC5 has quit IRC | 01:25 | |
*** ylobankov has joined #savanna | 01:30 | |
*** _mattf` has quit IRC | 01:32 | |
*** _mattf` has joined #savanna | 01:32 | |
*** crobertsrh has joined #savanna | 01:32 | |
*** crobertsrh has quit IRC | 01:43 | |
*** ylobankov has quit IRC | 01:43 | |
*** akuznetsov has quit IRC | 01:47 | |
*** nosnos has joined #savanna | 01:48 | |
*** DinaBelova has joined #savanna | 01:48 | |
*** akuznetsov has joined #savanna | 01:48 | |
*** ylobankov has joined #savanna | 01:50 | |
*** crobertsrh1 has joined #savanna | 01:53 | |
*** crobertsrh1 has quit IRC | 01:53 | |
*** nosnos has quit IRC | 01:53 | |
*** DinaBelova has quit IRC | 01:53 | |
*** akuznetsov has quit IRC | 01:53 | |
*** nosnos has joined #savanna | 01:54 | |
*** DinaBelova has joined #savanna | 01:54 | |
*** akuznetsov has joined #savanna | 01:54 | |
*** crobertsrh1 has joined #savanna | 01:55 | |
*** crobertsrh1 has quit IRC | 01:56 | |
*** ylobankov has quit IRC | 02:00 | |
*** DinaBelova has quit IRC | 02:05 | |
*** nosnos has quit IRC | 02:28 | |
*** akuznetsov has quit IRC | 02:28 | |
*** nosnos has joined #savanna | 02:34 | |
*** akuznetsov has joined #savanna | 02:34 | |
*** crobertsrh has joined #savanna | 02:41 | |
*** akuznetsov has quit IRC | 03:19 | |
*** aignatov has quit IRC | 04:09 | |
*** NikitaKonovalov has quit IRC | 04:09 | |
*** _mattf` has quit IRC | 04:17 | |
*** crobertsrh has quit IRC | 04:22 | |
*** crobertsrh has joined #savanna | 04:28 | |
*** ylobankov has joined #savanna | 04:28 | |
*** crobertsrh1 has joined #savanna | 04:34 | |
*** crobertsrh has quit IRC | 04:34 | |
*** nosnos has quit IRC | 04:42 | |
*** nosnos has joined #savanna | 04:43 | |
*** crobertsrh1 has quit IRC | 04:58 | |
*** matsuhashi has quit IRC | 05:29 | |
*** ylobankov has quit IRC | 05:29 | |
*** nosnos has quit IRC | 05:36 | |
*** nosnos_ has joined #savanna | 05:59 | |
*** ylobankov has joined #savanna | 05:59 | |
*** crobertsrh has joined #savanna | 05:59 | |
*** ylobankov1 has joined #savanna | 06:06 | |
*** matsuhas_ has joined #savanna | 06:09 | |
*** ylobankov has quit IRC | 06:09 | |
*** nosnos_ has quit IRC | 06:09 | |
*** nosnos has joined #savanna | 06:15 | |
*** ylobankov has joined #savanna | 06:16 | |
*** ylobankov1 has quit IRC | 06:24 | |
*** crobertsrh has quit IRC | 06:30 | |
*** crobertsrh has joined #savanna | 06:33 | |
*** matsuhashi has joined #savanna | 06:34 | |
*** matsuhas_ has quit IRC | 06:35 | |
*** matsuhashi has quit IRC | 06:43 | |
*** crobertsrh has quit IRC | 06:43 | |
*** crobertsrh1 has joined #savanna | 06:45 | |
*** nosnos has quit IRC | 06:50 | |
*** matsuhashi has joined #savanna | 06:50 | |
*** nosnos_ has joined #savanna | 06:51 | |
*** crobertsrh1 has quit IRC | 07:14 | |
*** crobertsrh has joined #savanna | 07:14 | |
*** crobertsrh has quit IRC | 07:33 | |
*** nosnos_ has quit IRC | 07:33 | |
*** matsuhashi has quit IRC | 07:33 | |
*** SergeyLukjanov has quit IRC | 08:03 | |
*** SergeyLukjanov has joined #savanna | 08:15 | |
*** crobertsrh has joined #savanna | 08:22 | |
*** nosnos_ has joined #savanna | 08:22 | |
*** matsuhashi has joined #savanna | 08:22 | |
*** ylobankov has quit IRC | 08:22 | |
*** SergeyLukjanov has quit IRC | 08:23 | |
*** ylobankov has joined #savanna | 08:30 | |
*** ylobankov has quit IRC | 08:31 | |
*** ylobankov has joined #savanna | 08:37 | |
*** ylobankov has quit IRC | 08:54 | |
*** ylobankov has joined #savanna | 08:56 | |
*** crobertsrh has quit IRC | 09:04 | |
*** nosnos_ has quit IRC | 09:04 | |
*** matsuhashi has quit IRC | 09:05 | |
*** matsuhas_ has joined #savanna | 09:05 | |
*** nosnos has joined #savanna | 09:06 | |
*** crobertsrh has joined #savanna | 09:06 | |
*** IvanBerezovskiy has joined #savanna | 09:20 | |
*** nosnos has quit IRC | 09:21 | |
*** crobertsrh has quit IRC | 09:21 | |
*** venza has quit IRC | 09:22 | |
*** crobertsrh has joined #savanna | 09:42 | |
*** _nadya_ has joined #savanna | 09:50 | |
*** venza has joined #savanna | 10:05 | |
*** venza has quit IRC | 10:05 | |
*** venza has joined #savanna | 10:05 | |
*** nosnos has joined #savanna | 10:05 | |
*** nosnos_ has joined #savanna | 10:07 | |
*** nosnos has quit IRC | 10:10 | |
*** openstack has joined #savanna | 13:16 | |
*** dmitryme has joined #savanna | 13:24 | |
aignatov | mattf, crobertsrh, tmckay hi, do not be scared when savanna-ci tells you nothing today! | 13:28 |
---|---|---|
aignatov | datacenter guys've started upgrade our ci with new SSD drives :) | 13:29 |
mattf | aignatov, i'm already scared! | 13:33 |
* mattf is also scarred | 13:33 | |
mattf | aignatov, i'd appreciate your input on the api - no ci needed there | 13:33 |
mattf | aignatov, i left out the contentious pieces. i provided what i think we can all agree on. | 13:33 |
mattf | i'd like to figure out the validations and config hints this week | 13:33 |
*** ylobankov has joined #savanna | 13:33 | |
aignatov | mattf, what validations checks do you mean? | 13:34 |
mattf | aignatov, the config validation -- can this input be converted | 13:35 |
aignatov | you mean input from cluster and node group templates? | 13:37 |
*** akuznetsov has joined #savanna | 13:38 | |
*** matsuhas_ has quit IRC | 13:39 | |
mattf | aignatov, i mean things like post_file('/plugins/<plugin_name>/<version>/convert-config/<name>') and get('/jobs/config-hints/<job_type>'). you had good suggestions on config-hints. i want us to codify them in the review | 13:49 |
mattf | or a subsequent review | 13:49 |
aignatov | gotcha! | 13:50 |
mattf | i'll chat w/ SergeyLukjanov later about his implementation roadblock in front of the api agreement | 13:52 |
mattf | he's getting to enjoy fosdem now tho, eh? lucky guy | 13:53 |
*** mattf is now known as _mattf | 14:00 | |
aignatov | actually he is coming back right now:) | 14:03 |
*** dmitryme has quit IRC | 14:04 | |
*** _mattf has quit IRC | 14:08 | |
*** _mattf has joined #savanna | 14:08 | |
*** nadya_ has joined #savanna | 14:12 | |
*** akuznetsov has quit IRC | 14:12 | |
*** akuznetsov has joined #savanna | 14:12 | |
*** nadya__ has joined #savanna | 14:17 | |
*** ylobankov1 has joined #savanna | 14:17 | |
*** akuznets_ has joined #savanna | 14:20 | |
*** nadya_ has quit IRC | 14:21 | |
*** akuznetsov has quit IRC | 14:21 | |
*** ylobankov has quit IRC | 14:21 | |
*** nadya__ has quit IRC | 14:39 | |
*** aignatov is now known as aignatov_ | 14:42 | |
*** DinaBelova is now known as DinaBelova_ | 14:44 | |
*** DinaBelova_ is now known as DinaBelova | 14:46 | |
*** _mattf has quit IRC | 14:52 | |
*** akuznets_ has quit IRC | 14:58 | |
*** aignatov_ is now known as aignatov | 14:59 | |
*** aignatov is now known as aignatov_ | 15:02 | |
*** nadya has joined #savanna | 15:05 | |
*** akuznetsov has joined #savanna | 15:06 | |
*** aignatov_ is now known as aignatov | 15:31 | |
*** aignatov is now known as aignatov_ | 15:37 | |
*** nadya has quit IRC | 15:40 | |
*** nadya has joined #savanna | 15:40 | |
*** akuznetsov has quit IRC | 15:40 | |
*** nadya has quit IRC | 15:41 | |
*** akuznetsov has joined #savanna | 15:51 | |
*** ChanServ has quit IRC | 15:57 | |
*** _mattf has joined #savanna | 15:59 | |
*** _mattf is now known as mattf | 15:59 | |
mattf | freenode melting down? | 16:00 |
*** ChanServ has joined #savanna | 16:21 | |
*** wolfe.freenode.net sets mode: +o ChanServ | 16:21 | |
*** aignatov_ is now known as aignatov | 16:30 | |
*** mattf has quit IRC | 16:36 | |
*** akuznetsov has quit IRC | 16:36 | |
*** aignatov is now known as aignatov_ | 16:43 | |
*** mattf has joined #savanna | 17:00 | |
*** akuznetsov has joined #savanna | 17:00 | |
*** IlyaE has joined #savanna | 17:17 | |
*** akuznetsov has quit IRC | 17:58 | |
*** akuznetsov has joined #savanna | 17:58 | |
*** akuznetsov has quit IRC | 17:58 | |
*** nadya has joined #savanna | 18:16 | |
*** tmckay has joined #savanna | 18:26 | |
*** nadya has quit IRC | 18:48 | |
*** mattf is now known as _mattf | 18:52 | |
*** _mattf is now known as mattf | 18:53 | |
*** ChanServ has quit IRC | 19:02 | |
*** ChanServ has joined #savanna | 19:05 | |
*** wolfe.freenode.net sets mode: +o ChanServ | 19:05 | |
*** IlyaE has quit IRC | 19:06 | |
*** IlyaE has joined #savanna | 19:30 | |
*** qwerty_nor has joined #savanna | 19:32 | |
*** openstackgerrit has joined #savanna | 19:43 | |
openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page https://review.openstack.org/70120 | 19:44 |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/savanna: Add configuration integration test for IDH plugin https://review.openstack.org/70819 | 19:51 |
openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Moving main_class and java_opts to configs https://review.openstack.org/70810 | 19:57 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add <streaming> tag generation to mapreduce workflow https://review.openstack.org/69477 | 20:03 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Extract configs beginning with "edp." from job_configs['configs'] https://review.openstack.org/69712 | 20:05 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Generate streaming tag in mapreduce job https://review.openstack.org/69727 | 20:06 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add validation check for streaming elements on MapReduce without libs https://review.openstack.org/69960 | 20:06 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Move 'main_class' and 'java_opts' into edp.java configs https://review.openstack.org/69982 | 20:06 |
openstackgerrit | Trevor McKay proposed a change to openstack/savanna: Add integration test for streaming mapreduce https://review.openstack.org/70829 | 20:18 |
openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page https://review.openstack.org/70120 | 20:38 |
*** tmckay has quit IRC | 20:47 | |
*** tmckay has joined #savanna | 20:54 | |
*** tmckay has quit IRC | 20:55 | |
*** tmckay has joined #savanna | 20:56 | |
openstackgerrit | Chad Roberts proposed a change to openstack/savanna-dashboard: Adding object names to job-execution details page https://review.openstack.org/70120 | 20:56 |
*** DinaBelova is now known as DinaBelova_ | 20:56 | |
*** tmckay has quit IRC | 21:16 | |
*** tmckay has joined #savanna | 21:22 | |
*** Jpeerindex has joined #savanna | 21:46 | |
Jpeerindex | tmckay: how come all of these hdfs putting of jar files into hdfs. I thought ooze could upload a jar into hdfs for you but maybe I'm mistaken | 21:50 |
tmckay | Jpeerindex, oozie has the <files> and <archives> tags, which can let you reference something already in hdfs on a long running cluster | 21:52 |
*** Jpeerindex is now known as jayunit100 | 21:52 | |
tmckay | (we don't support that yet) | 21:52 |
jayunit100 | okay fixed my nick | 21:53 |
jayunit100 | okay, but can you give ooze a path to a local jar? | 21:53 |
tmckay | jayunit100, but even when you run something from the oozie command line on a node, you have to put the stuff in hdfs first | 21:53 |
tmckay | not that I know of | 21:53 |
jayunit100 | and say : run this job --- it just seems like ooze should be smart enough to put stuff in HDFS for ITSELF. you know what i mean? | 21:53 |
jayunit100 | yeah, i didn't know that | 21:54 |
jayunit100 | that sucks. | 21:54 |
tmckay | yes, I know what you mean. I haven't seen an example of that | 21:54 |
jayunit100 | 'hadoop jar' does it for you :) | 21:54 |
tmckay | The tutorials have you putting stuff in hdfs first | 21:54 |
jayunit100 | yeah, sorry , my ooze is weak | 21:54 |
tmckay | lol, maybe we should have just wrapped remote hadoop commands | 21:54 |
tmckay | I can't say for absolute certain but I'm pretty sure you have to stage the files first. The Oozie distributes them *from* hdfs to the local nodes where they actually run. | 21:55 |
*** crobertsrh is now known as _crobertsrh | 21:59 | |
*** IlyaE has quit IRC | 22:04 | |
jayunit100 | thats lame | 22:12 |
jayunit100 | so people normally upload jars into hdfs in SHELL scripts and THEN run submit ooze xml files? | 22:13 |
jayunit100 | ugh | 22:13 |
tmckay | yes | 22:13 |
jayunit100 | maybe they should rename "ooze" to "poopy" ? tmckay | 22:14 |
tmckay | jayunit100, I'm finding some posts that say it's possible but custom | 22:14 |
tmckay | :) | 22:14 |
tmckay | there is apparently an oozie copy action... | 22:14 |
tmckay | not sure if that goes hdfs -> hdfs or something else.... looking. You've piqued my interest | 22:15 |
tmckay | sorry, FS action | 22:15 |
jayunit100 | gotcha | 22:21 |
jayunit100 | well, you'll find I'm good at distracting people to chase down some dumb idea that isn't relevant to the task at hand. | 22:21 |
*** tmckay has quit IRC | 22:24 | |
*** tmckay has joined #savanna | 22:25 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/savanna: Refactored unit tests structure https://review.openstack.org/70211 | 22:36 |
*** qwerty_nor has quit IRC | 23:21 | |
*** IlyaE has joined #savanna | 23:33 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!