| *** witlessb has quit IRC | 00:04 | |
| *** tiny-hands has joined #openstack-sahara | 00:31 | |
| *** hdd has quit IRC | 00:37 | |
| openstackgerrit | willy lin proposed openstack/sahara: Rename "interface" in job_execution_schema https://review.openstack.org/214911 | 00:38 |
|---|---|---|
| *** saneax has quit IRC | 00:42 | |
| *** melaks has quit IRC | 00:53 | |
| *** _crobertsrh has quit IRC | 01:04 | |
| *** macjack has quit IRC | 01:26 | |
| *** hdd has joined #openstack-sahara | 01:27 | |
| *** crobertsrh has joined #openstack-sahara | 01:28 | |
| *** saneax has joined #openstack-sahara | 01:32 | |
| *** egafford has joined #openstack-sahara | 01:50 | |
| *** saneax has quit IRC | 02:00 | |
| *** egafford has quit IRC | 02:27 | |
| *** tiny-hands has quit IRC | 02:29 | |
| *** tiny-hands has joined #openstack-sahara | 02:35 | |
| *** tiny-hands has quit IRC | 03:42 | |
| *** Nikolay_St has quit IRC | 04:21 | |
| openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation) https://review.openstack.org/201448 | 04:24 |
| openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution update api https://review.openstack.org/208001 | 04:33 |
| *** hdd has quit IRC | 04:36 | |
| *** sgotliv has joined #openstack-sahara | 04:43 | |
| *** sgotliv has quit IRC | 04:51 | |
| *** saneax has joined #openstack-sahara | 05:13 | |
| *** saneax has quit IRC | 05:39 | |
| *** Poornima has joined #openstack-sahara | 05:46 | |
| *** nkrinner has joined #openstack-sahara | 05:52 | |
| *** hdd has joined #openstack-sahara | 05:53 | |
| openstackgerrit | li,chen proposed openstack/sahara: Use "get_instances" method from sahara.plugins.utils https://review.openstack.org/214960 | 05:54 |
| *** hdd has quit IRC | 06:12 | |
| *** vgridnev has joined #openstack-sahara | 06:23 | |
| *** macjack has joined #openstack-sahara | 06:27 | |
| *** macjack has quit IRC | 06:32 | |
| *** macjack has joined #openstack-sahara | 06:33 | |
| *** macjack has quit IRC | 06:47 | |
| *** Nikolay_St has joined #openstack-sahara | 06:59 | |
| *** Nikolay_St has quit IRC | 07:16 | |
| *** nkrinner has quit IRC | 07:17 | |
| *** nkrinner has joined #openstack-sahara | 07:21 | |
| *** Nikolay_St has joined #openstack-sahara | 07:24 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding shared and protected resources support https://review.openstack.org/195568 | 07:25 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding is_public and is_protected fields support https://review.openstack.org/195065 | 07:25 |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding is_public and is_protected fields support https://review.openstack.org/195065 | 07:33 |
| *** sanjayu_ has joined #openstack-sahara | 07:33 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding shared and protected resources support Adding shared across tenants and protected from modifictaion resources support. Implemented for clusters, cluster templates, node group templates, data sources, job executions, jobs, job binaries and job binar https://review.openstack.org/195568 | 07:36 |
| *** sanjayu has quit IRC | 07:36 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding shared and protected resources support https://review.openstack.org/195568 | 07:37 |
| *** witlessb has joined #openstack-sahara | 07:48 | |
| *** sgotliv has joined #openstack-sahara | 08:08 | |
| *** DWfuturetec has joined #openstack-sahara | 08:14 | |
| *** macjack has joined #openstack-sahara | 08:33 | |
| *** DWfuturetec has quit IRC | 08:45 | |
| *** vgridnev has quit IRC | 08:45 | |
| *** vgridnev has joined #openstack-sahara | 09:31 | |
| *** tosky has joined #openstack-sahara | 09:34 | |
| *** degorenko has joined #openstack-sahara | 09:39 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates https://review.openstack.org/169338 | 09:49 |
| *** DWfuturetec has joined #openstack-sahara | 09:59 | |
| *** macjack has quit IRC | 10:00 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New version of HDP plugin https://review.openstack.org/184292 | 10:04 |
| *** tiny-hands has joined #openstack-sahara | 10:06 | |
| *** tiny-hands has quit IRC | 10:08 | |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Add base services support for HDP 2.2 / 2.3 https://review.openstack.org/185100 | 10:19 |
| *** DWfuturetec has quit IRC | 10:31 | |
| openstackgerrit | Merged openstack/python-saharaclient: Fix backward compat issue for job interfaces https://review.openstack.org/214388 | 10:42 |
| *** DWfuturetec has joined #openstack-sahara | 10:50 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/212278 | 11:25 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/215091 | 11:25 |
| openstackgerrit | Merged openstack/sahara-specs: Adding spec for integration of Sahara CLI with OpenstackClient https://review.openstack.org/206096 | 11:29 |
| openstackgerrit | Andrey Pavlov proposed openstack/python-saharaclient: Adding Data Sources support to CLI https://review.openstack.org/207496 | 11:31 |
| *** DWfuturetec has quit IRC | 11:31 | |
| openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Update plugin version for transient tests to vanilla 2.7.1 https://review.openstack.org/213622 | 11:45 |
| *** tmckay has joined #openstack-sahara | 12:12 | |
| tmckay | vgridnev, ping. Any progress on the spark-swift issue? I have an idea to narrow this down today, with a simple java app to run on spark 1 and spark 1.3.1 nodes to confirm where the problem is. | 12:13 |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Add debug option to updating image name https://review.openstack.org/215113 | 12:14 |
| tmckay | If I can confirm, I'll file a bug (if you haven't already). On 1.3.1, playing informally, I don't seem to be able to make addDefaultResource work | 12:14 |
| tmckay | vgridnev, I'll read back later -- have to go. biab | 12:14 |
| vgridnev | tmckay, I'm busy with some internal tasks right now, I will return to this issue a little bit later | 12:15 |
| tmckay | vgridnev, ok, np! I just did not want to duplicate effort | 12:15 |
| tmckay | I'll let you know what I find out | 12:15 |
| vgridnev | tmckay, ok | 12:16 |
| tmckay | I am hoping that spark/swift is not broken for Liberty ! :-( | 12:16 |
| tmckay | bye for now | 12:16 |
| *** tmckay has quit IRC | 12:20 | |
| *** flaviosr has joined #openstack-sahara | 12:38 | |
| *** chlong has joined #openstack-sahara | 12:45 | |
| *** witlessb has quit IRC | 12:50 | |
| *** tosky has quit IRC | 12:52 | |
| *** Poornima has quit IRC | 12:53 | |
| *** chlong has quit IRC | 13:00 | |
| *** witlessb has joined #openstack-sahara | 13:00 | |
| *** flaviosr has quit IRC | 13:03 | |
| *** chlong has joined #openstack-sahara | 13:03 | |
| *** tiny-hands has joined #openstack-sahara | 13:05 | |
| *** macjack has joined #openstack-sahara | 13:10 | |
| *** jamielennox is now known as jamielennox|away | 13:30 | |
| *** japplewhite has joined #openstack-sahara | 13:31 | |
| *** egafford has joined #openstack-sahara | 13:33 | |
| *** tmckay has joined #openstack-sahara | 13:41 | |
| *** tmckay has joined #openstack-sahara | 13:41 | |
| *** macjack has quit IRC | 13:44 | |
| *** ylobankov has quit IRC | 13:58 | |
| *** ylobankov has joined #openstack-sahara | 13:58 | |
| *** degorenko has quit IRC | 13:58 | |
| *** degorenko has joined #openstack-sahara | 13:59 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara https://review.openstack.org/193101 | 14:15 |
| *** tosky has joined #openstack-sahara | 14:15 | |
| *** saneax has joined #openstack-sahara | 14:25 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding Grenade support for Sahara https://review.openstack.org/193101 | 14:29 |
| elmiko | i need some opinions on https://bugs.launchpad.net/sahara/+bug/1431460 | 14:46 |
| openstack | Launchpad bug 1431460 in Sahara "Different naming pattern for Cluster template parameters in CDH plugin" [Undecided,Confirmed] | 14:46 |
| elmiko | should this be wishlist or like medium prio? | 14:46 |
| vgridnev | elmiko, I am not sure, I think it is Opinion | 14:48 |
| tosky | which is like CLOSED/WONTFIX :D | 14:49 |
| tosky | ok | 14:49 |
| elmiko | lol | 14:49 |
| elmiko | i think it's a feature proposal, i'm thinking more confirmed/wishlist | 14:49 |
| pino|work | evil tosky | 14:50 |
| vgridnev | elmiko, I don't see any actual problem in different naming pattern actually | 14:51 |
| tosky | really, feel free to close if you think it's not important (I will complain. Just a bit.) | 14:51 |
| tosky | vgridnev: Sahara is a common layer above different Hadoop distributions, so I think that an user would expect that at least the same components on different distributions use to the same name | 14:52 |
| elmiko | vgridnev: fair, i tend to agree with tosky on this one. given that sahara is providing an abstraction layer to the underlying technology. it would be a nice improvement to allow these standard config names to be, well, more standard. | 14:52 |
| elmiko | i'm makring as wishlist, we can come back to it. i'll add a comment about it being a nice feature though | 14:53 |
| tmckay | confirmed, exactly the same job passes on spark-1.0.0 images and fails on spark-1.3.1 | 14:54 |
| elmiko | =( | 14:54 |
| tmckay | now to write a tiny java app and figure out if it is hadoop that has broken it, or spark | 14:54 |
| vgridnev | elmiko, It's an actual bug. As I remember if I will configure configs from Cloudera manager I will have same names as Sahara have | 14:56 |
| vgridnev | it's not an actual bug, I meant | 14:56 |
| elmiko | vgridnev: i agree about that. that's why i marked it as wishlist | 14:56 |
| elmiko | i also added a note about creating a blueprint/spec if we decide to implement it | 14:57 |
| *** vgridnev has quit IRC | 15:06 | |
| elmiko | egafford: ok, marked prio on all the confirmed issue. we still have a few outstanding undecideds, but we are much better shape. | 15:07 |
| elmiko | SergeyLukjanov: ^ | 15:07 |
| egafford | elmiko: Nice! | 15:07 |
| egafford | I'll start sloughing now. | 15:07 |
| SergeyLukjanov | elmiko, we were discussing it | 15:08 |
| SergeyLukjanov | I mean the components names | 15:08 |
| SergeyLukjanov | we should find this ideas | 15:08 |
| SergeyLukjanov | ~ Hong Kong or Atlanta summit | 15:08 |
| SergeyLukjanov | there was an idea to add aliases and descriptions for the processes | 15:09 |
| SergeyLukjanov | to have common and native names | 15:09 |
| SergeyLukjanov | probably even roles | 15:09 |
| SergeyLukjanov | pre-defined | 15:09 |
| elmiko | SergeyLukjanov: ok, that sounds good. i marked the issue as wishlist | 15:11 |
| egafford | elmiko: Any sense of importance on https://bugs.launchpad.net/sahara/+bug/1419643? | 15:12 |
| openstack | Launchpad bug 1419643 in Sahara "saharaclient should check the input param when cluster-create" [Undecided,Confirmed] - Assigned to warewang (wangguangcai) | 15:12 |
| egafford | Never mind; that's for discussion today. | 15:12 |
| elmiko | egafford: i added that to the meeting agenda for today | 15:12 |
| *** nkrinner has quit IRC | 15:14 | |
| *** vgridnev has joined #openstack-sahara | 15:20 | |
| *** vgridnev has quit IRC | 15:21 | |
| openstackgerrit | Merged openstack/python-saharaclient: Add initial commit for integration with Openstackclient https://review.openstack.org/204540 | 15:21 |
| *** vgridnev has joined #openstack-sahara | 15:21 | |
| tmckay | vgridnev, bingo, found it | 15:22 |
| tmckay | in spark 1.3.1, apparently they changed how the driver classpath is produced | 15:23 |
| vgridnev | and? | 15:23 |
| tmckay | if we add 'pwd' to the beginning of the driver-classpath, it will find the spark.xml file with the properties in it | 15:23 |
| tmckay | With the Hadoop configuration class we are using, the file is only added as a default resource if it can be found on the classpath | 15:23 |
| tmckay | so, I think it's okay to fix it this way. the other option is to change the wrapper program -- I think there is a way to specify a default resource by path instead of name-in-classpath, have to check | 15:25 |
| vgridnev | so, does it mean that fix is too simple? | 15:25 |
| tmckay | vgridnev, so hadoop is behaving the same, but the spark-class command that builds the classpath for the java invocation has changed and does not include the current dir on the classpath | 15:25 |
| *** hdd has joined #openstack-sahara | 15:26 | |
| tmckay | vgridenv, I think the fix is simple. I *think* it means that we just change the command that sahara builds to include `pwd` in the driver-classpath argument | 15:26 |
| tmckay | not sure if there are any bad implications for that | 15:26 |
| * tmckay goes to test and make sure it doesn't break on spark 1.0.0 (even though it's deprecated) | 15:27 | |
| tmckay | vgridnev, I feel better :) | 15:27 |
| tmckay | brb | 15:27 |
| vgridnev | tmckay, I think that you can assign this bug on you | 15:29 |
| vgridnev | https://bugs.launchpad.net/sahara/+bug/1486544 | 15:29 |
| openstack | Launchpad bug 1486544 in Sahara "[Spark1.3] Spark jobs doesn't work with Swift" [Medium,Triaged] | 15:29 |
| *** vgridnev has quit IRC | 15:40 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: adding nova to session cache https://review.openstack.org/214205 | 15:44 |
| *** hogepodge has quit IRC | 15:53 | |
| *** AlexeyElagin has joined #openstack-sahara | 15:57 | |
| *** Nikolay_St has quit IRC | 16:05 | |
| *** DWfuturetec has joined #openstack-sahara | 16:05 | |
| egafford | elmiko: Are we thinking that we'll go through the old high and medium prios at least to kick of stale bugs? | 16:10 |
| egafford | Some of the medium prios especially are pretty irrelevant. | 16:11 |
| *** hogepodge has joined #openstack-sahara | 16:23 | |
| elmiko | egafford: +1 | 16:26 |
| elmiko | hadn't planned on it, but good idea | 16:27 |
| *** hdd has quit IRC | 16:34 | |
| tmckay | also appears that for spark 1.3 we can drop the jackson hack on the classpath -- apparently spark cleaned up their mess | 16:40 |
| tmckay | will confirm and handle separately | 16:40 |
| elmiko | nice | 16:40 |
| elmiko | gonna start calling you sparkie ;) | 16:40 |
| openstackgerrit | Merged openstack/puppet-sahara: Reflect provider change in puppet-openstacklib https://review.openstack.org/209877 | 16:41 |
| tmckay | heh | 16:41 |
| *** DWfuturetec has quit IRC | 16:46 | |
| *** vgridnev has joined #openstack-sahara | 16:47 | |
| *** melaks has joined #openstack-sahara | 16:50 | |
| *** IBerezovskiy has quit IRC | 16:53 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-saharaclient: Updated from global requirements https://review.openstack.org/212278 | 17:10 |
| *** Nikolay_St has joined #openstack-sahara | 17:12 | |
| *** DWfuturetec has joined #openstack-sahara | 17:12 | |
| openstackgerrit | Merged stackforge/sahara-ci-config: Add debug option to updating image name https://review.openstack.org/215113 | 17:17 |
| *** tosky has quit IRC | 17:25 | |
| *** sgotliv has quit IRC | 17:36 | |
| *** melaks has quit IRC | 17:38 | |
| *** DWfuturetec has quit IRC | 17:42 | |
| *** melaks has joined #openstack-sahara | 17:45 | |
| *** DWfuturetec has joined #openstack-sahara | 17:48 | |
| *** tosky has joined #openstack-sahara | 17:54 | |
| *** melaks has quit IRC | 17:55 | |
| *** apavlov has joined #openstack-sahara | 17:57 | |
| *** melaks has joined #openstack-sahara | 17:59 | |
| vgridnev | alt or 3? | 17:59 |
| elmiko | -alt | 18:00 |
| *** DWfuturetec has quit IRC | 18:03 | |
| *** bapalm has quit IRC | 18:11 | |
| *** bapalm has joined #openstack-sahara | 18:14 | |
| *** apavlov has quit IRC | 19:04 | |
| *** egafford has quit IRC | 19:16 | |
| *** egafford has joined #openstack-sahara | 19:17 | |
| egafford | elmiko, tmckay, SergeyLukjanov, tosky, et al.: you think https://bugs.launchpad.net/python-saharaclient/+bug/1419643 is a medium prio? I think it's a medium prio. Maybe low, even... | 19:27 |
| openstack | Launchpad bug 1419643 in Python client library for Sahara "saharaclient should check the input param when cluster-create" [Undecided,Confirmed] - Assigned to warewang (wangguangcai) | 19:27 |
| *** hdd has joined #openstack-sahara | 19:27 | |
| *** jamielennox|away has quit IRC | 19:27 | |
| *** DuncanT has quit IRC | 19:28 | |
| *** DuncanT has joined #openstack-sahara | 19:31 | |
| SergeyLukjanov | egafford, IMO it's low or wishlist ;) | 19:31 |
| egafford | SergeyLukjanov: I'll settle for low. | 19:32 |
| *** melaks has quit IRC | 19:47 | |
| *** jamielennox|away has joined #openstack-sahara | 19:47 | |
| *** jamielennox|away is now known as jamielennox | 19:47 | |
| tosky | egafford: I agree with low | 19:48 |
| egafford | tosky: Yeah; "Fix when convenient" sounds about right. | 19:49 |
| vgridnev | egafford, congratulations, again | 19:54 |
| egafford | vgridnev: Thanks very much Vitaly. It's a great team. | 19:54 |
| openstackgerrit | lu huichun proposed openstack/sahara: [EDP] Add suspend_job() for sahara edp engine(oozie implementation) https://review.openstack.org/201448 | 19:56 |
| *** tmckay has quit IRC | 20:04 | |
| openstackgerrit | lu huichun proposed openstack/python-saharaclient: Add job execution update api https://review.openstack.org/208001 | 20:13 |
| *** melaks has joined #openstack-sahara | 20:17 | |
| *** saneax has quit IRC | 20:18 | |
| elmiko | egafford: i'm ok with low | 20:19 |
| elmiko | it's a corner case at best, and is exhibiting the same behvaior as `cat`, so not that big a deal imo | 20:19 |
| openstackgerrit | Merged openstack/sahara: Added support of Hadoop 2.7.0 to MapR plugin https://review.openstack.org/208443 | 20:31 |
| *** japplewhite has quit IRC | 20:34 | |
| *** DWfuturetec has joined #openstack-sahara | 20:41 | |
| *** tosky has quit IRC | 20:46 | |
| *** tosky has joined #openstack-sahara | 20:47 | |
| *** egafford has quit IRC | 21:03 | |
| *** egafford has joined #openstack-sahara | 21:04 | |
| *** crobertsrh is now known as _crobertsrh | 21:10 | |
| *** hdd has quit IRC | 21:15 | |
| *** tiny-hands has left #openstack-sahara | 21:21 | |
| *** hdd has joined #openstack-sahara | 21:31 | |
| openstackgerrit | Merged openstack/sahara: Use "get_instances" method from sahara.plugins.utils https://review.openstack.org/214960 | 21:35 |
| openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/215091 | 21:35 |
| *** hdd has quit IRC | 21:45 | |
| *** bapalm has quit IRC | 21:49 | |
| *** bapalm has joined #openstack-sahara | 21:52 | |
| *** bapalm has quit IRC | 21:57 | |
| *** bapalm has joined #openstack-sahara | 22:03 | |
| *** vgridnev has quit IRC | 22:04 | |
| *** bapalm has quit IRC | 22:08 | |
| *** bapalm has joined #openstack-sahara | 22:14 | |
| *** bapalm has quit IRC | 22:19 | |
| *** chlong has quit IRC | 22:25 | |
| *** bapalm has joined #openstack-sahara | 22:29 | |
| *** bapalm has quit IRC | 22:34 | |
| *** bapalm has joined #openstack-sahara | 22:35 | |
| *** bapalm has quit IRC | 22:43 | |
| *** bapalm has joined #openstack-sahara | 22:43 | |
| *** bapalm has quit IRC | 22:48 | |
| *** saneax has joined #openstack-sahara | 22:49 | |
| *** bapalm has joined #openstack-sahara | 22:51 | |
| *** japplewhite has joined #openstack-sahara | 22:52 | |
| *** japplewhite has quit IRC | 23:03 | |
| *** melaks has quit IRC | 23:03 | |
| *** japplewhite has joined #openstack-sahara | 23:04 | |
| *** DWfuturetec has quit IRC | 23:07 | |
| *** tiny-hands has joined #openstack-sahara | 23:07 | |
| *** melaks has joined #openstack-sahara | 23:15 | |
| *** tosky has quit IRC | 23:23 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!