| *** chlong has joined #openstack-sahara | 01:06 | |
| *** saphi has joined #openstack-sahara | 01:24 | |
| *** IRCFrEAK has joined #openstack-sahara | 01:31 | |
| *** IRCFrEAK has left #openstack-sahara | 01:31 | |
| *** tuanluong has joined #openstack-sahara | 02:22 | |
| openstackgerrit | Anh Tran proposed openstack/sahara master: Remove unused logging import https://review.openstack.org/435843 | 03:55 |
|---|---|---|
| *** Jinxing has joined #openstack-sahara | 04:22 | |
| *** crazymozart has joined #openstack-sahara | 04:28 | |
| *** dave-mccowan has quit IRC | 04:29 | |
| *** crazymozart1 has quit IRC | 04:31 | |
| *** madgoat has joined #openstack-sahara | 04:37 | |
| *** madgoat has left #openstack-sahara | 04:37 | |
| *** sudipto has joined #openstack-sahara | 04:47 | |
| *** sudipto_ has joined #openstack-sahara | 04:47 | |
| *** Jinxing has quit IRC | 05:30 | |
| *** pgadiya has joined #openstack-sahara | 05:41 | |
| *** pgadiya has quit IRC | 06:15 | |
| *** pgadiya_ has joined #openstack-sahara | 06:15 | |
| *** pgadiya_ is now known as pgadiya | 06:20 | |
| openstackgerrit | kavitha h r proposed openstack/sahara master: Changed the article from "an" to "a". https://review.openstack.org/435862 | 06:39 |
| *** pgadiya has quit IRC | 06:39 | |
| *** saphi has quit IRC | 06:49 | |
| *** pgadiya has joined #openstack-sahara | 06:55 | |
| *** pgadiya has quit IRC | 07:01 | |
| *** pgadiya has joined #openstack-sahara | 07:13 | |
| *** tesseract has joined #openstack-sahara | 07:17 | |
| *** nkrinner_afk is now known as nkrinner | 07:27 | |
| *** pgadiya has quit IRC | 08:09 | |
| *** pgadiya has joined #openstack-sahara | 08:19 | |
| *** pcaruana has joined #openstack-sahara | 08:28 | |
| *** pgadiya has quit IRC | 08:54 | |
| *** anshul has joined #openstack-sahara | 09:03 | |
| *** nkrinner has quit IRC | 09:07 | |
| *** pgadiya has joined #openstack-sahara | 09:07 | |
| *** nkrinner has joined #openstack-sahara | 09:10 | |
| *** frippe75 has joined #openstack-sahara | 09:17 | |
| *** masber has joined #openstack-sahara | 09:21 | |
| *** tosky has joined #openstack-sahara | 10:26 | |
| *** hoonetorg has quit IRC | 10:37 | |
| *** hoonetorg has joined #openstack-sahara | 10:59 | |
| frippe75 | Any pointers on setting up node-group-templates for the using the hortonworks distro? | 11:02 |
| frippe75 | ambari plugin.. | 11:02 |
| tosky | frippe75: do you mean something like https://docs.openstack.org/developer/sahara/userdoc/ambari_plugin.html#cluster-validation ? | 11:05 |
| frippe75 | tosky, no, actually looked at that. More of how to define the different nodegroups and the bare-minimum node processes in a 1+2 cluster needed. | 11:07 |
| tosky | you can check what we use for the scenario tests: http://git.openstack.org/cgit/openstack/sahara-tests/tree/sahara_tests/scenario/defaults/ambari-2.4.yaml.mako | 11:09 |
| frippe75 | my lacking hadoop skills makes me not understand the mix of node processes to get up and running. Seen example where you select "ambari server" and "ambari client" for the different node types. But looking in the list is not that clear how to define a valid worker vs master node. | 11:09 |
| frippe75 | Realize the HDP dist could be setup in a more HA config and there requires problably more complex node group templates but I would like to start out with pref. 1 master and then x workers. | 11:10 |
| frippe75 | So each time I deploy a cluster in compains about me having the wrong node | 11:11 |
| frippe75 | Error: Cluster is missing a service: HBase Master, required by service: HBase RegionServer | 11:11 |
| frippe75 | So here quite obvious. "HBase Master" in my HDP-master node group template, and "HBase RegionServer" in the HDP-worker node group template. But for others not so obvious. | 11:12 |
| frippe75 | So a quickstart doc. to get a simple cluster fired up. | 11:13 |
| tosky | as I said: check the examples above | 11:13 |
| tosky | those works | 11:13 |
| *** sudipto_ has quit IRC | 11:13 | |
| *** sudipto has quit IRC | 11:13 | |
| frippe75 | tosky, I was so busy typing I missed that comment. Sorry! looking now and ... looks like what I needed. Thanks! | 11:14 |
| tosky | frippe75: you can probably use something even smaller (you can probaby have a unique master instead of master and master-edp, iirc), of course with bigger instances | 11:15 |
| frippe75 | tosky, will start out with the full scenario one to get something tested up and running and minimize from there. thanks again! | 11:17 |
| *** tuanluong has quit IRC | 11:26 | |
| *** Poornima has joined #openstack-sahara | 11:30 | |
| *** Poornima has quit IRC | 11:31 | |
| *** Poornima has joined #openstack-sahara | 11:32 | |
| *** Poornima has quit IRC | 11:33 | |
| *** nkrinner has quit IRC | 11:34 | |
| *** Poornima has joined #openstack-sahara | 11:38 | |
| *** nkrinner has joined #openstack-sahara | 11:38 | |
| *** sudipto has joined #openstack-sahara | 12:02 | |
| *** sudipto_ has joined #openstack-sahara | 12:02 | |
| frippe75 | tosky, took that example removed all mako placeholders. Changed flavors/images and so on to my settings. Did a openstack dataprocessing cluster template create --json <file> | 12:36 |
| frippe75 | create() got an unexpected keyword argument 'plugin_version' | 12:36 |
| frippe75 | Looking at the quickstart. https://docs.openstack.org/developer/sahara/devref/quickstart.html | 12:36 |
| frippe75 | there is no plugin_version only hadoop_version... Which does not sound very futureproof having other than hadoop for dataprocessing. So I guess the quickstart might be incorrect. Cannot get around this. | 12:37 |
| tosky | did you try hadoop_version instead? | 12:37 |
| * tosky rechecks | 12:38 | |
| frippe75 | :-) no.. .not yet. | 12:38 |
| frippe75 | Thought the Sahara nightly tests would have picked that up along time ago. But since there is not yaml import using the openstack client "you" might be doing something differently. | 12:39 |
| tosky | the yaml files in http://git.openstack.org/cgit/openstack/sahara-tests/tree/sahara_tests/scenario/defaults/ambari-2.4.yaml.mako | 12:39 |
| tosky | are not in the format used by `openstack dataprocessing ...` client | 12:39 |
| tosky | they are in their own custom format used by the scenario test runner | 12:40 |
| tosky | so you can be inspired by them but follow the quickstart guide, which uses hadoop_version | 12:40 |
| frippe75 | starting to understand that since I now get a new invalid argument. | 12:40 |
| tosky | probably if I recall correctly for historical reasons (and we are not going to change until API v2, under (slow) construction) | 12:41 |
| tosky | but anyway, please follow the structure of the quickstart guide | 12:41 |
| frippe75 | I will! thanks for be so responsive! | 12:41 |
| tosky | most of the people are going to the PTG this week | 12:42 |
| frippe75 | I see. Atlanta... | 12:42 |
| *** Poornima has quit IRC | 12:45 | |
| *** pgadiya has quit IRC | 13:04 | |
| *** dave-mccowan has joined #openstack-sahara | 13:14 | |
| *** nkrinner has quit IRC | 13:15 | |
| *** chlong has quit IRC | 13:16 | |
| openstackgerrit | kavitha h r proposed openstack/sahara master: Changed the article from "an" to "a". https://review.openstack.org/435862 | 13:20 |
| *** nkrinner has joined #openstack-sahara | 13:20 | |
| *** zemuvier has quit IRC | 13:35 | |
| *** tosky has quit IRC | 13:59 | |
| *** jamielennox|away is now known as jamielennox | 14:06 | |
| *** kk_ has joined #openstack-sahara | 14:07 | |
| *** anshul has quit IRC | 14:11 | |
| *** tosky has joined #openstack-sahara | 14:12 | |
| *** egafford has left #openstack-sahara | 14:13 | |
| *** shuyingya has joined #openstack-sahara | 14:18 | |
| *** shuyingya has quit IRC | 14:32 | |
| *** kk_ has quit IRC | 14:32 | |
| *** shuyingya has joined #openstack-sahara | 14:37 | |
| *** jperry has joined #openstack-sahara | 14:43 | |
| *** chlong has joined #openstack-sahara | 14:55 | |
| *** shuyingya has quit IRC | 15:03 | |
| *** shuyingya has joined #openstack-sahara | 15:17 | |
| *** abalutoiu has joined #openstack-sahara | 15:18 | |
| frippe75 | tosky, Sorry for bothering you. Looked at the provided templates for a hdp cluster. | 15:48 |
| frippe75 | Error: Hadoop cluster should contain 1 YARN Timeline Server component(s). | 15:48 |
| frippe75 | Understand I should put it master or secondary master but still. Alot of work getting it up and running. | 15:49 |
| tosky | yes, and it was defined in master | 15:49 |
| tosky | http://git.openstack.org/cgit/openstack/sahara-tests/tree/sahara_tests/scenario/defaults/ambari-2.4.yaml.mako#n17 | 15:50 |
| frippe75 | maybe I''m confusing the ambari plugin with hdp? | 15:50 |
| tosky | the ambari plugin deploys hdp >=2.4 | 15:50 |
| tosky | the old hdp plugin deployed up to 2.0.6 | 15:51 |
| tosky | deprecated and removed for a while | 15:51 |
| *** david-lyle has joined #openstack-sahara | 15:53 | |
| frippe75 | :-) | 15:54 |
| frippe75 | tusky, cluster is spawning. interesting! | 16:02 |
| tosky | \o/ | 16:05 |
| tosky | now let's see if the resources are enough | 16:05 |
| *** david-lyle has quit IRC | 16:18 | |
| *** shuyingya has quit IRC | 16:29 | |
| *** shuyingya has joined #openstack-sahara | 16:31 | |
| *** pcaruana has quit IRC | 16:54 | |
| *** abalutoiu has quit IRC | 16:56 | |
| *** shuyingya has quit IRC | 16:59 | |
| *** nkrinner is now known as nkrinner_afk | 16:59 | |
| *** anshul has joined #openstack-sahara | 17:04 | |
| *** jamielennox is now known as jamielennox|away | 17:09 | |
| *** mariannelm has joined #openstack-sahara | 17:18 | |
| openstackgerrit | Luigi Toscano proposed openstack/sahara-tests master: Default test templates: add missing, remove obsolete https://review.openstack.org/436116 | 17:18 |
| tosky | now I wonder if we should add a "default" value for the templates | 17:22 |
| *** tesseract has quit IRC | 17:40 | |
| *** jamielennox|away is now known as jamielennox | 17:58 | |
| *** chlong has quit IRC | 18:11 | |
| *** shuyingya has joined #openstack-sahara | 18:18 | |
| *** abalutoiu has joined #openstack-sahara | 18:19 | |
| *** sudipto_ has quit IRC | 18:21 | |
| *** sudipto has quit IRC | 18:21 | |
| *** shuyingya has quit IRC | 18:21 | |
| *** chlong has joined #openstack-sahara | 18:26 | |
| *** shuyingya has joined #openstack-sahara | 18:32 | |
| *** tosky has quit IRC | 18:32 | |
| *** david-lyle has joined #openstack-sahara | 18:47 | |
| *** brad[]` is now known as brad[] | 18:56 | |
| *** abalutoiu has quit IRC | 19:03 | |
| *** david-lyle has quit IRC | 19:15 | |
| *** david-lyle has joined #openstack-sahara | 19:27 | |
| *** david-lyle_ has joined #openstack-sahara | 19:50 | |
| *** david-lyle has quit IRC | 19:50 | |
| *** david-lyle_ has quit IRC | 19:59 | |
| *** shuyingya has quit IRC | 20:00 | |
| *** shuyingya_m has joined #openstack-sahara | 20:17 | |
| *** shuyingya_m has quit IRC | 20:18 | |
| *** shuyingya has joined #openstack-sahara | 20:20 | |
| *** jamielennox is now known as jamielennox|away | 20:23 | |
| *** david-lyle has joined #openstack-sahara | 20:43 | |
| *** david-lyle has quit IRC | 20:50 | |
| *** david-lyle has joined #openstack-sahara | 21:03 | |
| frippe75 | tusky, had some issue with available resource but deleted ALL stacks on my 32GB system (all-in-one-node). So after the resource issue was solved, "RemoteCommandException: Error during command execution: "rngd -r /dev/urandom -W 4096"". using sahara-ambari-latest-ubuntu | 21:38 |
| frippe75 | Downloading http://sahara-files.mirantis.com/images/upstream/newton/sahara-newton-ambari-2.2.1.0-ubuntu.qcow2 | 21:42 |
| frippe75 | to see if that solves that issue... | 21:42 |
| frippe75 | just realized.. this is the one I'm using. So wont matter downloading it again :-) | 21:49 |
| *** shuyingya has quit IRC | 21:50 | |
| *** alyonapy has joined #openstack-sahara | 21:54 | |
| *** david-lyle has quit IRC | 21:55 | |
| *** skp has joined #openstack-sahara | 21:57 | |
| *** alyonapy has quit IRC | 21:59 | |
| *** alyonapy has joined #openstack-sahara | 22:03 | |
| *** chlong has quit IRC | 22:04 | |
| *** dave-mccowan has quit IRC | 22:32 | |
| *** shuyingya has joined #openstack-sahara | 22:35 | |
| *** alyonapy has quit IRC | 22:44 | |
| *** alyonapy has joined #openstack-sahara | 22:46 | |
| *** alyonapy has quit IRC | 22:57 | |
| *** alyonapy has joined #openstack-sahara | 22:58 | |
| *** alyonapy has quit IRC | 22:58 | |
| *** alyonapy has joined #openstack-sahara | 22:59 | |
| *** alyonapy has quit IRC | 22:59 | |
| *** shuyingya has quit IRC | 23:06 | |
| *** jperry has quit IRC | 23:14 | |
| *** dave-mccowan has joined #openstack-sahara | 23:25 | |
| *** remix_tj has quit IRC | 23:29 | |
| *** remix_tj has joined #openstack-sahara | 23:31 | |
| *** sahithirv has joined #openstack-sahara | 23:44 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!