| *** hdd has joined #openstack-sahara | 00:04 | |
| *** hdd has quit IRC | 00:18 | |
| *** mahito has joined #openstack-sahara | 00:22 | |
| *** chlong has joined #openstack-sahara | 00:25 | |
| *** Longgeek has joined #openstack-sahara | 00:56 | |
| *** hdd has joined #openstack-sahara | 01:12 | |
| *** hdd has quit IRC | 01:24 | |
| *** stanchan has joined #openstack-sahara | 01:47 | |
| *** mahito_ has joined #openstack-sahara | 02:15 | |
| *** mahito has quit IRC | 02:17 | |
| openstackgerrit | lu huichun proposed openstack/sahara: Add CDH template for the scenario integration test https://review.openstack.org/171909 | 02:19 |
|---|---|---|
| openstackgerrit | lu huichun proposed openstack/sahara: Add CDH template for the scenario integration test https://review.openstack.org/171909 | 02:21 |
| openstackgerrit | Michael McCune proposed openstack/sahara: Updating the developer quickstart guide https://review.openstack.org/171801 | 02:39 |
| *** mahito has joined #openstack-sahara | 02:40 | |
| *** mahito_ has quit IRC | 02:43 | |
| *** Longgeek has quit IRC | 02:43 | |
| *** Longgeek has joined #openstack-sahara | 02:44 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: Updating edp json examples https://review.openstack.org/171825 | 02:53 |
| *** mahito has quit IRC | 02:54 | |
| *** mahito has joined #openstack-sahara | 03:19 | |
| *** Longgeek_ has joined #openstack-sahara | 03:29 | |
| *** Longgeek has quit IRC | 03:30 | |
| *** mahito has quit IRC | 03:58 | |
| *** coolsvap|afk is now known as coolsvap | 04:00 | |
| *** mahito has joined #openstack-sahara | 04:03 | |
| *** rodrigods has quit IRC | 04:08 | |
| *** rodrigods has joined #openstack-sahara | 04:12 | |
| *** mahito has quit IRC | 04:39 | |
| *** mahito has joined #openstack-sahara | 04:40 | |
| *** chlong has quit IRC | 05:09 | |
| *** mahito has quit IRC | 05:32 | |
| *** mahito has joined #openstack-sahara | 05:33 | |
| *** Poornima has joined #openstack-sahara | 06:02 | |
| *** mahito has quit IRC | 06:10 | |
| *** mahito has joined #openstack-sahara | 06:17 | |
| *** mahito has quit IRC | 06:22 | |
| *** tnovacik has joined #openstack-sahara | 06:24 | |
| *** mahito has joined #openstack-sahara | 06:26 | |
| *** esikachev has joined #openstack-sahara | 06:58 | |
| *** sgotliv has joined #openstack-sahara | 07:01 | |
| *** witlessb has joined #openstack-sahara | 07:12 | |
| *** mahito has quit IRC | 07:16 | |
| *** sreshetn2 has joined #openstack-sahara | 07:25 | |
| openstackgerrit | Merged openstack/sahara-image-elements: Switch to the extjs element https://review.openstack.org/171251 | 07:27 |
| SergeyLukjanov | elmiko, that's awesome, thx! | 07:38 |
| SergeyLukjanov | elmiko, https://bugs.launchpad.net/sahara/+bug/1442001 is the list of last CRs for RC1 and I've approved all of them | 07:38 |
| openstack | Launchpad bug 1442001 in Sahara "Cleanup developers documentation" [High,In progress] - Assigned to Sergey Lukjanov (slukjanov) | 07:39 |
| SergeyLukjanov | tmckay, elmiko thank you very much folks for awesome work ! | 07:39 |
| *** tnovacik has quit IRC | 07:41 | |
| *** sreshetn2 has quit IRC | 07:53 | |
| *** pino|work has joined #openstack-sahara | 07:55 | |
| *** jamielennox is now known as jamielennox|away | 08:01 | |
| *** sreshetn2 has joined #openstack-sahara | 08:11 | |
| openstackgerrit | Pino Toscano proposed openstack/sahara-image-elements: Start switching to declarative package-installs https://review.openstack.org/167150 | 08:16 |
| openstackgerrit | Merged openstack/sahara: Updates to the EDP doc https://review.openstack.org/171443 | 08:26 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/python-saharaclient: Provide user-agent in saharaclient https://review.openstack.org/171968 | 08:31 |
| openstackgerrit | Merged openstack/sahara: Updating the developer quickstart guide https://review.openstack.org/171801 | 08:41 |
| openstackgerrit | Merged openstack/sahara: Updating edp json examples https://review.openstack.org/171825 | 08:42 |
| openstackgerrit | Merged openstack/sahara: Updating edp-java readme https://review.openstack.org/171820 | 08:42 |
| openstackgerrit | Merged openstack/sahara: Updating sahara-ci readme https://review.openstack.org/171828 | 08:42 |
| openstackgerrit | Merged openstack/sahara: Updating wordcount readme https://review.openstack.org/171816 | 08:42 |
| *** Poornima has quit IRC | 08:45 | |
| *** esikachev has quit IRC | 08:47 | |
| openstackgerrit | Nikolay Starodubtsev proposed openstack/sahara: Add hacking checks related to logging guideliness https://review.openstack.org/170541 | 08:47 |
| *** esikachev has joined #openstack-sahara | 08:49 | |
| *** Poornima has joined #openstack-sahara | 08:58 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Adding cluster, instance, job_execution ids to logs https://review.openstack.org/143964 | 09:03 |
| *** tosky has joined #openstack-sahara | 09:14 | |
| *** pcaruana has joined #openstack-sahara | 09:17 | |
| *** coolsvap is now known as coolsvap|afk | 09:18 | |
| *** coolsvap|afk is now known as coolsvap | 09:24 | |
| *** sgotliv has quit IRC | 09:29 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication https://review.openstack.org/147504 | 09:32 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use service catalog for getting auth urls https://review.openstack.org/168684 | 09:46 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use service catalog for getting auth urls https://review.openstack.org/168684 | 09:49 |
| *** witlessb has quit IRC | 09:54 | |
| *** witlessb has joined #openstack-sahara | 09:54 | |
| *** coolsvap is now known as coolsvap|afk | 10:06 | |
| openstackgerrit | Merged openstack/sahara: Open Liberty development https://review.openstack.org/171155 | 10:17 |
| *** tnovacik has joined #openstack-sahara | 10:37 | |
| *** Abhi_ has joined #openstack-sahara | 10:38 | |
| *** Abhi_ has left #openstack-sahara | 10:38 | |
| *** jamielennox|away is now known as jamielennox | 10:42 | |
| *** sgotliv has joined #openstack-sahara | 10:50 | |
| *** Poornima has quit IRC | 10:54 | |
| openstackgerrit | Mikhail Ivanov proposed openstack/sahara-image-elements: [DO NOT MERGE] test commit https://review.openstack.org/172008 | 10:58 |
| *** hdd has joined #openstack-sahara | 11:04 | |
| *** Poornima has joined #openstack-sahara | 11:07 | |
| openstackgerrit | Andrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication https://review.openstack.org/147504 | 11:11 |
| tellesnobrega | elmiko, ping | 11:36 |
| pino|work | tellesnobrega: heya | 11:39 |
| tellesnobrega | pino|work, hi | 11:39 |
| tellesnobrega | pino|work, not sure who to contact at this time...guess its pretty early in the us | 11:40 |
| tellesnobrega | just needed to ask some question regarding a spec for storm scaling | 11:40 |
| pino|work | tellesnobrega: regarding https://review.openstack.org/171301, wouldn't be also better if you make use of the -v parameter of diskimage-create.sh (or add a new one), instead of hardcode the spark version? | 11:41 |
| pino|work | *storm version, i mean | 11:41 |
| tellesnobrega | could be... right now we are using only one version | 11:41 |
| tellesnobrega | so even if we use -v i think its best to set the default to 0.9.2 | 11:42 |
| pino|work | of course, a default could still be set | 11:42 |
| pino|work | but at least you (or other diskimage-create.sh users) can choose another version without editing the script itself | 11:42 |
| tellesnobrega | sure +1 | 11:46 |
| *** hogepodge has quit IRC | 11:47 | |
| tellesnobrega | you suggesting changing this same patch, or writing a new one with this change? | 11:47 |
| pino|work | a new one indeed | 11:47 |
| tellesnobrega | for organization i think a new one is better (keep things separated) | 11:47 |
| tellesnobrega | ok, i'm gonna write it up asap | 11:47 |
| pino|work | nothing high-priority of course, that was just a small suggestion that got into my mind | 11:47 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use service catalog for getting auth urls https://review.openstack.org/168684 | 11:50 |
| *** jamielennox is now known as jamielennox|away | 11:53 | |
| tellesnobrega | pino|work, sure | 11:57 |
| *** sreshetn2 has quit IRC | 12:02 | |
| *** hogepodge has joined #openstack-sahara | 12:04 | |
| *** rodrigods has quit IRC | 12:06 | |
| *** rodrigods has joined #openstack-sahara | 12:06 | |
| openstackgerrit | Telles Mota Vidal Nóbrega proposed openstack/sahara-specs: Spec detailing Storm Scaling https://review.openstack.org/170916 | 12:08 |
| tmckay | SergeyLukjanov, you are very welcome | 12:16 |
| *** sreshetn2 has joined #openstack-sahara | 12:17 | |
| SergeyLukjanov | master is now open for liberty | 12:23 |
| SergeyLukjanov | we have rc1 tag! | 12:23 |
| SergeyLukjanov | tmckay, elmiko ^^ | 12:23 |
| tmckay | yay! | 12:24 |
| openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: Use service catalog for getting auth urls https://review.openstack.org/168684 | 12:25 |
| tellesnobrega | tmckay, hey, i'm testing storm edp now, I listed job-types and storm is there (yay) but it's showing that its plugin is the fake plugin | 12:25 |
| tmckay | tellesnobrega, fake plugin supports all job types | 12:26 |
| tmckay | because it's fake :) | 12:26 |
| tmckay | so, my guess is that the storm plugin is not set up right for the job types endpoint | 12:26 |
| *** tnovacik has quit IRC | 12:27 | |
| tmckay | tellesnobrega, for instance look in the spark plugin, plugin.py. It defines get_edp_job_types() and get_edp_config_hints() | 12:28 |
| tmckay | Storm plugin needs those, too | 12:28 |
| tmckay | otherwise job types endpoint won't find it | 12:29 |
| tellesnobrega | tmckay, i put those in | 12:29 |
| tellesnobrega | gonna recheck | 12:29 |
| tmckay | hmm. Time for the debugger, I think :) | 12:29 |
| tmckay | tellesnobrega, I think it will only list for loaded plugins. Are you sure storm is loaded? (silly, but maybe) | 12:30 |
| *** hdd has quit IRC | 12:31 | |
| tellesnobrega | it is | 12:32 |
| tmckay | tellesnobrega, a good place for a breakpoint is service.edp.api.get_job_types(). It loops over the whole set | 12:32 |
| tellesnobrega | ok | 12:33 |
| tmckay | if you use a filter (?plugin=storm) on the REST call you can shorten the looping and see just what it is doing. | 12:33 |
| *** egafford has joined #openstack-sahara | 12:34 | |
| *** egafford has quit IRC | 12:34 | |
| *** egafford has joined #openstack-sahara | 12:35 | |
| tellesnobrega | tmckay, thanks, gonna look it up | 12:35 |
| tmckay | np. It's got to be something simple | 12:35 |
| *** sreshetn2 has quit IRC | 12:38 | |
| tellesnobrega | it always is | 12:39 |
| *** sgotliv has quit IRC | 12:47 | |
| *** tnovacik has joined #openstack-sahara | 12:55 | |
| elmiko | SergeyLukjanov: \o/ | 12:58 |
| elmiko | tellesnobrega: hey | 12:58 |
| tellesnobrega | elmiko, hey | 12:58 |
| tellesnobrega | just sent a new patch on the spec, if you want to check it out | 12:58 |
| elmiko | awesome, i'll check it out | 12:58 |
| elmiko | looks good, thanks for adding that | 12:59 |
| *** _crobertsrh is now known as crobertsrh | 13:03 | |
| *** egafford has quit IRC | 13:09 | |
| *** egafford1 has joined #openstack-sahara | 13:09 | |
| *** sreshetn2 has joined #openstack-sahara | 13:12 | |
| *** macjack1 has joined #openstack-sahara | 13:12 | |
| *** macjack1 has quit IRC | 13:12 | |
| *** _mattf is now known as mattf | 13:21 | |
| *** IBerezovskiy has joined #openstack-sahara | 13:22 | |
| *** tmckay has quit IRC | 13:29 | |
| *** tnovacik has quit IRC | 13:37 | |
| *** openstackgerrit has quit IRC | 13:53 | |
| *** openstackgerrit has joined #openstack-sahara | 13:53 | |
| *** Nikolay_St has joined #openstack-sahara | 13:55 | |
| SergeyLukjanov | meeting in a few mins in -3 channel | 13:56 |
| *** weiting has joined #openstack-sahara | 14:00 | |
| *** tmckay has joined #openstack-sahara | 14:03 | |
| *** sgotliv has joined #openstack-sahara | 14:05 | |
| *** pcaruana has quit IRC | 14:17 | |
| tellesnobrega | tmckay, found the problem... the code was ok, just wasn't on my repository, so the version being tested was missing the get_edp_job_type method | 14:20 |
| tmckay | tellesnobrega, cool | 14:20 |
| openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Use jsonutils from oslo.serialization https://review.openstack.org/172083 | 14:27 |
| openstackgerrit | Sergey Lukjanov proposed openstack/sahara-image-elements: Open Liberty development https://review.openstack.org/172084 | 14:28 |
| openstackgerrit | Sergey Lukjanov proposed openstack/sahara-extra: Open Liberty development https://review.openstack.org/172085 | 14:29 |
| *** sgotliv has quit IRC | 14:31 | |
| *** sgotliv has joined #openstack-sahara | 14:40 | |
| openstackgerrit | lu huichun proposed openstack/sahara: Add CDH template for the scenario integration test https://review.openstack.org/171909 | 14:43 |
| *** tnovacik has joined #openstack-sahara | 14:44 | |
| *** sgotliv has quit IRC | 14:45 | |
| *** egafford1 is now known as egafford | 14:45 | |
| openstackgerrit | Merged openstack/sahara-extra: Open Liberty development https://review.openstack.org/172085 | 14:57 |
| *** Nikolay_St has quit IRC | 14:57 | |
| *** weiting has quit IRC | 14:58 | |
| *** esikachev has quit IRC | 15:09 | |
| openstackgerrit | Merged openstack/sahara-image-elements: Open Liberty development https://review.openstack.org/172084 | 15:12 |
| *** tmckay has quit IRC | 15:13 | |
| *** sreshetn2 has quit IRC | 15:27 | |
| *** stanchan has quit IRC | 15:28 | |
| *** tnovacik has quit IRC | 15:29 | |
| *** tmckay has joined #openstack-sahara | 15:44 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Dib.sh scripts improvements https://review.openstack.org/166780 | 15:45 |
| *** tmckay has quit IRC | 16:02 | |
| *** tmckay has joined #openstack-sahara | 16:03 | |
| *** sreshetn2 has joined #openstack-sahara | 16:05 | |
| *** egafford has quit IRC | 16:27 | |
| *** egafford has joined #openstack-sahara | 16:28 | |
| *** stanchan has joined #openstack-sahara | 16:31 | |
| *** pino|work has quit IRC | 17:00 | |
| *** egafford has quit IRC | 17:13 | |
| *** openstack has quit IRC | 17:13 | |
| *** openstack has joined #openstack-sahara | 17:13 | |
| openstackgerrit | Denis Egorenko proposed stackforge/sahara-ci-config: Dib.sh scripts improvements https://review.openstack.org/166780 | 17:17 |
| *** IBerezovskiy has quit IRC | 17:21 | |
| *** victorfeitosa has joined #openstack-sahara | 17:54 | |
| elmiko | SergeyLukjanov: is there an eta on when 2014.2.3 tarball might be produced? | 18:00 |
| *** tosky has quit IRC | 18:15 | |
| *** kingbhanu has joined #openstack-sahara | 18:28 | |
| kingbhanu | hello | 18:29 |
| kingbhanu | I have installed openstack sahara using devstack on a single system consisting of 4 GB RAM and Intel i5 processor . I am following quickstart guide for sahara as provided in openstack official website. Now when i run the cluster .The Status remains waiting for many hours it does not change into active and my system also respond very slowly as i m running cluster of 3 nodes (1 master , 2 workers ) with sahara-ubuntu-vani | 18:30 |
| kingbhanu | sahara cluster-list +-----------+--------------------------------------+--------+------------+ | name | id | status | node_count | +-----------+--------------------------------------+--------+------------+ | cluster-1 | c5e755a2-b3f9-417b-948b-e99ed7fbf1e3 | Waiting| 3 | | 18:30 |
| kingbhanu | please help regarding the same | 18:31 |
| *** SergeyLukjanov has quit IRC | 18:31 | |
| *** SergeyLukjanov has joined #openstack-sahara | 18:32 | |
| elmiko | kingbhanu: probably not enough resources to start that cluster | 18:38 |
| elmiko | kingbhanu: most nodes require small flavor, which is 2GB ram (iirc) | 18:38 |
| elmiko | kingbhanu: probably the system is getting starved for resources | 18:38 |
| elmiko | kingbhanu: if you want to diagnose the problem further, i would turn on logging in your sahara.conf (debug=true) | 18:39 |
| elmiko | and dump to a log file | 18:40 |
| kingbhanu | i have made a flavour with 4 gb ram | 18:42 |
| kingbhanu | sorry | 18:42 |
| kingbhanu | i made a flavour with 256 mb ram | 18:42 |
| elmiko | that probably won't work | 18:42 |
| kingbhanu | i think sahara-ubuntu-vanilla should run with this much ram (256 mb ram) | 18:43 |
| kingbhanu | isn't it ? | 18:43 |
| elmiko | i've never been successful in getting a flavor with that little ram to run | 18:44 |
| elmiko | but, | 18:44 |
| kingbhanu | so sir what are your suggestions i have limited resources | 18:44 |
| elmiko | if you want to diagnose the issue you could try increasing the logging level and watching the output from sahara-all | 18:44 |
| elmiko | with the machine you mentioned (4GB ram, i5), i'm not sure if it's possible. it might be, but you will need to diagnose why the nodes are stuck in "waiting" | 18:45 |
| elmiko | usually that happens when they can't communicate with each other, or something is stuck during provisioning | 18:45 |
| kingbhanu | i have to run a small hadoop or map reduce program for my major project. Is there any other way i could run hadoop on openstack with 4 gb ram and intel i5 processor as i told before | 18:46 |
| kingbhanu | i have not senn logs | 18:46 |
| kingbhanu | because my system hang too much and respond very timely when i run the cluster | 18:47 |
| kingbhanu | so i have not been able to read any logs | 18:47 |
| crobertsrh | Whew, my horizon fix for Spark jobs merged :) https://review.openstack.org/171735 | 18:49 |
| elmiko | hm | 18:49 |
| elmiko | kingbhanu: that's going to be difficult | 18:50 |
| kingbhanu | so sir can u please suggest me any other way of running hadoop on openstack | 18:51 |
| crobertsrh | You can oversubscribe your openstack installation in nova.conf, but your speed might still suffer | 18:51 |
| elmiko | kingbhanu: 4gb is the minimum to run devstack, so i think getting the necessary resource to bring up all the instances is going to be difficult | 18:51 |
| elmiko | crobertsrh: this is on an i5 with 4gb ram | 18:51 |
| elmiko | how many cores is that i5? | 18:51 |
| kingbhanu | elmiko : 4 cores sir | 18:52 |
| crobertsrh | ah. You can do the same with cores, but you will still have rather poor performance. | 18:52 |
| elmiko | i'm not even sure that the cluster will become active though, it sounds like it just sits in waiting state for ever | 18:52 |
| crobertsrh | I've never really ran anything of substance being oversubscribed on both ram and cores, but I have started a cluster. | 18:52 |
| elmiko | kingbhanu: can you use the --log-file option to dump a log and then examine it later? | 18:53 |
| elmiko | crobertsrh: so how did you get the cluster active on that limited of resources? | 18:53 |
| crobertsrh | I didn't start that limited. Mine is i7 (8 cores), 8G ram. | 18:54 |
| elmiko | yea, that's what troubles me | 18:54 |
| crobertsrh | what sort of cluster are you running? Vanilla? HDP? | 18:54 |
| elmiko | kingbhanu: ^^ | 18:55 |
| kingbhanu | elmiko: okk sir can u please tell me one thing -: i m following this quickstart guide of sahara on offiicial site ( http://docs.openstack.org/developer/sahara/devref/quickstart.html) .In step 3 uploading of an image it shows ssh user@hostname . i dont know why this command is given as i running on the ingle machine | 18:55 |
| kingbhanu | crobertsrh: sir i am running vanillla | 18:56 |
| elmiko | kingbhanu: in that case you can skip the ssh, assuming your host has access to the glance service | 18:57 |
| crobertsrh | If you're already on the host you want to download the image to (and it sounds like you are), you can skip that step | 18:57 |
| crobertsrh | We could probably get that step off the quickstart guide | 18:57 |
| crobertsrh | I don't think it's likely to be useful by anyone. | 18:57 |
| elmiko | hehe, i just updated that page | 18:57 |
| kingbhanu | okk sir i have skipped that step thats why i thought the problem is there | 18:58 |
| elmiko | kingbhanu: it really sounds like your host machine is getting slowed down to the point that the nodes are failing to respond in a timely manner | 18:58 |
| elmiko | i've seen it happen on machines with low resources | 18:59 |
| crobertsrh | Can you start the same number of instances without a cluster being involved? | 18:59 |
| kingbhanu | yeah sir. i too think so . | 18:59 |
| elmiko | was just gonna ask that | 18:59 |
| elmiko | crobertsrh: is it possible to put all the processes on a single node and start that? | 18:59 |
| elmiko | that might be a way to get around this | 18:59 |
| crobertsrh | Maybe. I never tried that. | 19:00 |
| kingbhanu | no sir . not yet i have not started any machine | 19:00 |
| crobertsrh | I'll try to make that happen, I'll see what happens :) | 19:00 |
| elmiko | kingbhanu: you might try creating a single node template with all the processes, then creating a cluster with just 1 of those nodes | 19:00 |
| *** dmitryme has left #openstack-sahara | 19:00 | |
| kingbhanu | So sir is there no way to run hadoop on openstack on my system | 19:01 |
| elmiko | kingbhanu: well, maybe. if the single node cluster would work. | 19:01 |
| kingbhanu | yeah sir i tried that but it says or gives error that minimum 3 noides are required | 19:01 |
| elmiko | oh, yea it might not be possible to get it running on that machine | 19:02 |
| crobertsrh | I have an all-in-one instance attempt coming up | 19:03 |
| elmiko | kingbhanu: if you want to continue trying, i would try the log output to a file and see if you can diagnose where it is failing. | 19:03 |
| crobertsrh | It might work | 19:03 |
| elmiko | did you see what kingbhanu said though, he gets a failure with minimum 3 node required | 19:04 |
| kingbhanu | elmiko : sir can u suggest me i lightweighted os that can run with 256 mb ram | 19:04 |
| crobertsrh | Ah, I missed that | 19:05 |
| crobertsrh | I adjusted the replication config down to 1 | 19:05 |
| elmiko | ahh, that might work | 19:05 |
| elmiko | kingbhanu: you could try to bring up a single instance through the dashboard (not through cluster manager) and log in to the node to run hadoop manually from the cli? | 19:06 |
| elmiko | if you upload the vanilla1.2.1 image, you should be able to provision it through the dashboard in the "images" panel | 19:08 |
| elmiko | then login to the image using a keypair | 19:08 |
| elmiko | all the software will be present on the image, but you will need to configure/run it manually | 19:08 |
| elmiko | mind you, i've never tried this, just speculating ;) | 19:09 |
| elmiko | crobertsrh: did lowering the replication config allow you to create a cluster with a single node? | 19:10 |
| crobertsrh | Mine is still in the "starting" state | 19:10 |
| crobertsrh | peeking in on it now | 19:10 |
| kingbhanu | elmiko : sir can u please give me your email id or any other contact details so that i can contact u in future | 19:10 |
| *** sreshetn2 has quit IRC | 19:11 | |
| crobertsrh | Mine got to active | 19:11 |
| elmiko | kingbhanu: sounds like you should try what crobertsrh did | 19:12 |
| kingbhanu | crobertsrh : sir can u please tell me the whole installation process | 19:12 |
| crobertsrh | Sure | 19:12 |
| crobertsrh | I created a node group template that contained all the processes (I did not choose hiveserver, since I never use it anyway). | 19:12 |
| crobertsrh | Then I created a cluster template and added a single instance of the node group template that I just created. | 19:13 |
| crobertsrh | Under the HDFS tab on the cluster template form, I adjusted the replication value to 1. | 19:13 |
| crobertsrh | Then I launched it | 19:13 |
| kingbhanu | crobertsrh : sir what do u mean by "node group template that contained all the processes" which processes | 19:14 |
| *** victorfeitosa has quit IRC | 19:15 | |
| crobertsrh | Do you have the dashboard up? | 19:15 |
| kingbhanu | yeaahh | 19:15 |
| crobertsrh | If you go to Data Processing, then Node Group Templates | 19:15 |
| kingbhanu | yeaah | 19:15 |
| crobertsrh | create a new node group template | 19:15 |
| kingbhanu | then | 19:15 |
| crobertsrh | At the bottom of that form, choose all of the processes that you want to run. | 19:15 |
| kingbhanu | ohh okk | 19:16 |
| elmiko | might want to start small with the processes from the quickstart, (jobtracker, namenode, tasktracker, datanode) | 19:16 |
| openstackgerrit | Merged stackforge/sahara-ci-config: Dib.sh scripts improvements https://review.openstack.org/166780 | 19:17 |
| crobertsrh | I did a Vanilla 1.2.1 cluster. Are you using 1.x or 2.x? | 19:17 |
| kingbhanu | u mean namenode resourcemanager types | 19:17 |
| crobertsrh | Yes. | 19:17 |
| crobertsrh | sounds like you're using 2.x | 19:17 |
| crobertsrh | I *think* that should work too | 19:17 |
| kingbhanu | yes sir | 19:17 |
| kingbhanu | i m using 2.4.1 | 19:17 |
| crobertsrh | I don't have a 2.4.1 image handy, or I would try that too | 19:18 |
| elmiko | kingbhanu: is your image 2.4.1? | 19:18 |
| kingbhanu | so sir u have just created a single node and made a cluster of it and started that cluster ? | 19:19 |
| openstackgerrit | Merged stackforge/sahara-ci-config: Add devstack tweaks for glance, heat, keystone https://review.openstack.org/171203 | 19:19 |
| elmiko | yes | 19:19 |
| elmiko | this will hopefully get around the limited resources you have | 19:20 |
| crobertsrh | yep | 19:21 |
| kingbhanu | okk sir i will try that tommorow in my college lab . Thanks for helping me .. Sir (elmiko and crobertsh) can u please give me your email ids so that if i have further problems i can contact u | 19:21 |
| *** Longgeek_ has quit IRC | 19:22 | |
| elmiko | kingbhanu: sure, msm@redhat.com | 19:22 |
| crobertsrh | croberts@redhat.com | 19:23 |
| crobertsrh | Good luck | 19:23 |
| kingbhanu | thank u very much sir i appreciate your help . So i will contact on u ur email if i get furhter problems or need any other suggestions | 19:23 |
| elmiko | np, good luck! | 19:23 |
| kingbhanu | Thank u sir :) | 19:24 |
| *** sreshetn2 has joined #openstack-sahara | 19:50 | |
| *** tnovacik has joined #openstack-sahara | 20:04 | |
| *** hdd has joined #openstack-sahara | 20:38 | |
| *** hdd has quit IRC | 21:05 | |
| *** sreshetn2 has quit IRC | 21:09 | |
| *** kingbhanu has quit IRC | 21:14 | |
| *** crobertsrh is now known as _crobertsrh | 21:15 | |
| zigo | I get lots of unit tests errors with the rc1. Please see the logs here: https://kilo-jessie.pkgs.mirantis.com/job/sahara/8/consoleFull | 22:24 |
| zigo | Can someone help? | 22:24 |
| *** stanchan has quit IRC | 23:05 | |
| elmiko | zigo: did you try regenerating the tox environment (i know basic question) | 23:11 |
| zigo | elmiko: I'm building a Debian package, there's no tox involved here. | 23:11 |
| elmiko | how are you running the unit tests? | 23:12 |
| zigo | elmiko: ./run_tests.sh -N -P | 23:12 |
| zigo | elmiko: The Build-Depends: that I wrote are pulled automatically by sbuild, as you can see in the build log. | 23:13 |
| zigo | elmiko: Is there something that make you believe there's an issue with build dependencies? | 23:13 |
| elmiko | zigo: not immediately, just my first line of questioning =) | 23:14 |
| zigo | As much as I know, I've updated the build-depends correctly, and I checked with my script (ie: pkgos-reqsdiff) as usual ... | 23:14 |
| elmiko | when i have done fedora packaging for sahara i usually generated my build packages from the requirements.txt, whenever possible. i'm guessing you did something similar? | 23:15 |
| elmiko | these errors are odd though, wish it would show what file it's complaining about | 23:16 |
| elmiko | zigo: i wonder if something got missed in the MANIFEST.in ? | 23:16 |
| zigo | elmiko: I don't "generate" packages, I maintain them, but yeah, it's half-automated. | 23:17 |
| zigo | elmiko: This kinds of errors are often due to something wrong with the /dev/shm, but in this case, I checked, and it's there. | 23:17 |
| elmiko | well yea, generated was probably a poor choice of wording | 23:18 |
| zigo | elmiko: I don't think there's something with the MANIFEST.in, as the unit tests are run from within the source folder, so even if the MANIFEST.in is wrong, the unit tests would still run. | 23:18 |
| elmiko | good point | 23:18 |
| elmiko | i'm curious because the unit tests are just filled with "OSError: [Errno 2] No such file or directory" | 23:19 |
| elmiko | although it all seems to come through the keypair generation stuff | 23:19 |
| elmiko | zigo: i think there's gotta be some package missing from your test environment. i was able to run the tests in the same manner and all i did was create a new venv with the packages from the requirements files | 23:27 |
| zigo | elmiko: Which proves nothing. The requirements.txt may be just wrong, and Sahara needs a higher version of some modules than it declares, and pip just takes the latest version ... | 23:28 |
| zigo | This happens *very* often. | 23:28 |
| elmiko | yea, that's an excellent point. i could freeze the environment and see which packages are different than the reqs. | 23:29 |
| elmiko | are you pulling the requirements packages from pypi or debian repos? | 23:29 |
| elmiko | actually, silly question. i'm guessing you are getting them from deb repos | 23:30 |
| *** tnovacik has quit IRC | 23:37 | |
| elmiko | zigo: is it possible there is an error with the ssh-keygen coming out of the cypto module? | 23:48 |
| zigo | elmiko: Yes, could be. | 23:49 |
| zigo | elmiko: It's also possible that there's an SSLv3 issue. | 23:49 |
| zigo | Just like there was with Keystone. | 23:49 |
| elmiko | yea | 23:49 |
| zigo | elmiko: Is Sahara relying on Eventlet for its connection? | 23:49 |
| elmiko | i see an openssl version difference between my machine and your test setup | 23:50 |
| zigo | This shouldn't be an issue... | 23:50 |
| elmiko | i'm not sure on that one | 23:50 |
| zigo | There's no way to specify the protocol version in Eventlet, and it always goes for SSLv23, which is broken (we should always use TLSv1, IMO). | 23:51 |
| zigo | This already broke some stuff in Keystone... | 23:51 |
| zigo | (this was fixed in RC1) | 23:51 |
| elmiko | interesting | 23:51 |
| elmiko | i know we had an open issue about eventlet, but i think it had more to do with green threads not being released properly | 23:51 |
| elmiko | and yea, agreed about TLS | 23:52 |
| zigo | But IMO, that's not what we're seeing here. | 23:52 |
| elmiko | zigo: well, sorry i couldn't help more. good luck, i'm out for tonight | 23:56 |
| zigo | Me as well, bye ! | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!