*** rcernin has quit IRC | 00:42 | |
*** tuanluong has joined #openstack-sahara | 00:46 | |
masuberu | hi | 00:58 |
---|---|---|
masuberu | I have sahara installed and I am reading a little bit about it | 00:58 |
masuberu | as far as Iknow Sahara will deploy hadoop/spark/storm if a different flavours depending on the plugin and version we use | 00:59 |
masuberu | however what about tools lilke HBase and phoenix? should I deploy them manually or should I create a new image with those tools installed already? If I have to create a new image with HBase... is there a document explaining how to do it? | 01:00 |
*** shuyingya has joined #openstack-sahara | 01:12 | |
*** jamielennox is now known as jamielennox|away | 01:26 | |
*** shuyingya has quit IRC | 01:26 | |
*** shuyingya has joined #openstack-sahara | 01:26 | |
masuberu | sorry I just realized that HBase is already an option to install | 01:33 |
masuberu | but what about phoenix? | 01:33 |
*** brad[] has quit IRC | 01:40 | |
*** brad[] has joined #openstack-sahara | 01:42 | |
*** jamielennox|away is now known as jamielennox | 02:15 | |
*** Poornima has joined #openstack-sahara | 02:52 | |
*** links has joined #openstack-sahara | 04:13 | |
*** shuyingya has quit IRC | 04:42 | |
*** shuyingya has joined #openstack-sahara | 04:42 | |
*** shuyingya has quit IRC | 04:45 | |
*** shuyingya has joined #openstack-sahara | 04:46 | |
masuberu | hi | 04:54 |
masuberu | I am not sure why my hadoop cluster creation fails while spawning | 04:54 |
masuberu | this is what I can see on the error logs --> http://pastebin.com/raw/6EC5L1aA | 04:54 |
masuberu | I am using the web interface to create my cluster | 04:55 |
masuberu | any idea | 04:55 |
*** sudipto_ has joined #openstack-sahara | 05:15 | |
*** I has joined #openstack-sahara | 05:15 | |
*** I is now known as Guest35753 | 05:15 | |
*** Guest35753 has quit IRC | 05:18 | |
*** sudipto_ has quit IRC | 05:18 | |
shuyingya | can you give me sth detail about the sahara-engine log | 05:27 |
shuyingya | @masuberu | 05:27 |
masuberu | shuyingya, yes, on my way | 05:27 |
masuberu | http://pastebin.com/raw/6EC5L1aA | 05:27 |
shuyingya | ok hope I can help you | 05:27 |
masuberu | is that what you are after? | 05:28 |
shuyingya | can you paste here "http://paste.openstack.org/" | 05:28 |
shuyingya | I can't open it | 05:28 |
masuberu | sure | 05:28 |
masuberu | shuyingya, here it is --> http://paste.openstack.org/show/590607/ | 05:29 |
shuyingya | I am not familiar with this, but maybe you should check you heat component. | 05:33 |
masuberu | shuyingya, ok, thanks, I actually installed heat along with sahara | 05:41 |
shuyingya | you are welcome. You can wait others to give you some suggestion. | 05:42 |
masuberu | I hope so because I am pretty new here | 05:46 |
openstackgerrit | Shu Yingya proposed openstack/sahara-tests: Clean env before asserting file existence https://review.openstack.org/373602 | 05:56 |
openstackgerrit | Shu Yingya proposed openstack/sahara-tests: Clean env before asserting file existence https://review.openstack.org/373602 | 06:01 |
openstackgerrit | Shu Yingya proposed openstack/sahara-tests: Clean env before asserting file existence https://review.openstack.org/373602 | 06:03 |
*** I has joined #openstack-sahara | 06:57 | |
*** sudipto has joined #openstack-sahara | 06:57 | |
*** I is now known as Guest81242 | 06:57 | |
*** nkrinner_afk is now known as nkrinner | 06:59 | |
openstackgerrit | Shu Yingya proposed openstack/sahara-tests: Clean env before asserting file existence https://review.openstack.org/373602 | 07:00 |
*** exploreshaifali has joined #openstack-sahara | 07:06 | |
*** rcernin has joined #openstack-sahara | 07:44 | |
*** pcaruana has joined #openstack-sahara | 07:45 | |
*** pgadiya has joined #openstack-sahara | 07:56 | |
*** esikachev has joined #openstack-sahara | 08:01 | |
*** Masber has joined #openstack-sahara | 08:22 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: Added support of newton branch to scripts https://review.openstack.org/403551 | 08:31 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: [WIP] Added job for spark with python3 https://review.openstack.org/402588 | 08:54 |
*** pgadiya has quit IRC | 09:03 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: [WIP] Added job for spark with python3 https://review.openstack.org/402588 | 09:17 |
*** pgadiya has joined #openstack-sahara | 09:18 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: [WIP] Added job for spark with python3 https://review.openstack.org/402588 | 09:21 |
vgridnev | masuberu, seems like heat returned 403, that probably mean you / admin user don't have permissions to create heat stacks in your cloud. please ensure that you have all proper roles, for example | 09:36 |
vgridnev | regarding hbase, plugins like cdh and ambari already have ability to deploy Hbase for you | 09:37 |
vgridnev | and probably MapR, but I'm not so sure about that | 09:38 |
*** abehl has joined #openstack-sahara | 09:58 | |
shuyingya | Hi vgridnev. Have you reproduced scale up CDH cluster on master branch? Looking forward to your reply :) | 10:06 |
vgridnev | shuyingya, not tried yet | 10:06 |
vgridnev | I'll try to do that today | 10:06 |
shuyingya | got it. thanks | 10:06 |
*** exploreshaifali has quit IRC | 10:07 | |
shuyingya | anytime is ok :) | 10:07 |
*** shuyingya has quit IRC | 10:07 | |
*** shuyingya has joined #openstack-sahara | 10:08 | |
*** shuyingya has quit IRC | 10:14 | |
*** shuyingya has joined #openstack-sahara | 10:14 | |
*** shuyingya has quit IRC | 10:35 | |
*** shuyingya has joined #openstack-sahara | 10:35 | |
vgridnev | shuyingya, creating cdh 5.7.0 cluster now (newton code) | 10:36 |
vgridnev | spawning in progress | 10:37 |
shuyingya | nice, thx | 10:37 |
*** tosky has joined #openstack-sahara | 11:07 | |
vgridnev | shuyingya, so cdh 5.7 cluster successfully created and then scaled with 2 more additional slaves. seems like that issue is around cloudera manager itself, because I see 500 error in bug description. | 11:09 |
vgridnev | probably that was fixed in some release, 5.5 or 5.7, not sure | 11:10 |
shuyingya | aha, Good to know. Thanks | 11:11 |
vgridnev | shuyingya, saying about your fix, I think that would not be harmful to add some sleeps | 11:12 |
shuyingya | yes, I can use it as a transition before upgrade to newton. | 11:15 |
vgridnev | shuyingya, I mean, do you want to put that stuff to upstream? | 11:26 |
*** Guest81242 has quit IRC | 11:27 | |
*** sudipto has quit IRC | 11:27 | |
*** tuanluong has quit IRC | 11:29 | |
vgridnev | If no, then I will close this issue since it's not reproduced, otherwise I will downgrade priority of that issue to Medium and will let you to fix that : ) | 11:31 |
shuyingya | Ok, I will fix it. | 11:33 |
vgridnev | cool, shuyingya ! | 11:33 |
*** flaviodsr has joined #openstack-sahara | 11:38 | |
tellesnobrega | vgridnev, regarding bug https://bugs.launchpad.net/sahara/+bug/1584680 | 11:46 |
openstack | Launchpad bug 1584680 in Sahara "Unique resource name check misses the tenant filter" [High,In progress] - Assigned to Telles Mota Vidal Nóbrega (tellesmvn) | 11:46 |
tellesnobrega | I just tried to reproduce on our current code, using demo user on demo project and demo user on demo2 project, I'm able to create a test cluster on both projects | 11:47 |
tellesnobrega | also able to create a test cluster using different user on different project | 11:47 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: [WIP] Added job for spark with python3 https://review.openstack.org/402588 | 11:55 |
openstackgerrit | Merged openstack/sahara-ci-config: Move ci-slaves to ubuntu 16.04 https://review.openstack.org/400247 | 12:07 |
*** rodrigods has quit IRC | 12:17 | |
*** rodrigods has joined #openstack-sahara | 12:17 | |
*** dave-mccowan has joined #openstack-sahara | 12:19 | |
*** shuyingya has quit IRC | 12:33 | |
*** egafford has quit IRC | 12:44 | |
*** sudipto has joined #openstack-sahara | 12:44 | |
*** Guest81242 has joined #openstack-sahara | 12:44 | |
openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Add new negative cli tests for image and job binary https://review.openstack.org/397128 | 12:45 |
*** tosky has quit IRC | 12:53 | |
vgridnev | tellesnobrega, hm, interesting | 12:54 |
*** Guest81242 has quit IRC | 12:55 | |
*** sudipto has quit IRC | 12:55 | |
vgridnev | tellesnobrega, I will try to reproduce that again | 12:56 |
tellesnobrega | thanks, if you do let me know how to | 12:56 |
tellesnobrega | tried some scenarios but the problem didn't show | 12:57 |
vgridnev | It's possible that bug was fixed as a part of another issue | 12:57 |
vgridnev | probably | 12:57 |
tellesnobrega | I think so too | 12:57 |
tellesnobrega | looking the db query it has the where clause using the tenant_id | 12:58 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-ci-config: [WIP] Added job for spark with python3 https://review.openstack.org/402588 | 13:04 |
vgridnev | tellesnobrega, are still looking for a bug to fix? if so, there are good candidate to take a look https://bugs.launchpad.net/sahara/+bug/1565082 | 13:07 |
openstack | Launchpad bug 1565082 in Sahara "turning on SSL does not work with eventlet" [High,Triaged] | 13:07 |
tellesnobrega | I can take a look into that for sure | 13:07 |
*** exploreshaifali has joined #openstack-sahara | 13:08 | |
*** pgadiya has quit IRC | 13:12 | |
tellesnobrega | vgridnev, I might have to ask emilien for the logs, the links don't work | 13:16 |
vgridnev | tellesnobrega, you can try to uncomment something in puppet sahara, and then you can get some logs | 13:17 |
vgridnev | I think that they have something to cover this | 13:17 |
tellesnobrega | I see, do you know what type of deploy is this? | 13:18 |
vgridnev | 1. https://github.com/openstack/puppet-openstack-integration/blob/38c498dfebbdeddfb969259ddf888a62368e280c/manifests/sahara.pp#L25 | 13:20 |
vgridnev | https://review.openstack.org/#/c/299605/18 | 13:21 |
tellesnobrega | thanks | 13:30 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: testcommit: write python version to logs https://review.openstack.org/403697 | 13:33 |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara-tests: testcommit for python 3 job https://review.openstack.org/402610 | 13:34 |
openstackgerrit | Alina Nesterova proposed openstack/sahara-ci-config: Added killing of all python processes https://review.openstack.org/398993 | 13:36 |
*** Masber has quit IRC | 13:42 | |
*** Poornima has quit IRC | 13:43 | |
*** tosky has joined #openstack-sahara | 13:50 | |
vgridnev | tellesnobrega, so, about https://bugs.launchpad.net/sahara/+bug/1584680 | 13:52 |
openstack | Launchpad bug 1584680 in Sahara "Unique resource name check misses the tenant filter" [High,In progress] - Assigned to Telles Mota Vidal Nóbrega (tellesmvn) | 13:52 |
vgridnev | create spark ng template, name test, make that public | 13:52 |
vgridnev | switch to another project | 13:52 |
vgridnev | create template with same name | 13:52 |
vgridnev | Profit. | 13:52 |
vgridnev | NodeGroup template with name 'test' already exists | 13:53 |
openstackgerrit | Alina Nesterova proposed openstack/sahara-tests: Add new negative cli tests for image and job binary https://review.openstack.org/397128 | 13:53 |
*** zemuvier has quit IRC | 13:58 | |
tellesnobrega | vgridnev, so the issue happens when setting the | 13:58 |
tellesnobrega | cluster template to public | 13:58 |
tellesnobrega | probably setting the cluster to public will happen the same thing | 13:58 |
tellesnobrega | vgridnev, that is it, the problem happens when the cluster, cluster template or whatever is setted to public | 14:00 |
tellesnobrega | but doesn't that make sense? | 14:01 |
*** links has quit IRC | 14:04 | |
*** abehl has quit IRC | 14:06 | |
*** esikachev has quit IRC | 14:06 | |
*** egafford has joined #openstack-sahara | 14:07 | |
*** exploreshaifali has quit IRC | 14:12 | |
tellesnobrega | vgridnev, on the update you wrote on the bug, I think you missed the part to set the ng template to public | 14:23 |
vgridnev | why it doesn't have sense? I think that we can have several resources but created in separate tenant. Another case: you have cluster (creation in progress) and you are making that public, but this name already exists | 14:23 |
vgridnev | yes, you are right | 14:23 |
vgridnev | updated one more time | 14:24 |
tellesnobrega | sure | 14:24 |
tellesnobrega | I will try to fix it | 14:24 |
*** rcernin has quit IRC | 14:27 | |
*** openstackstatus has quit IRC | 14:28 | |
*** openstackstatus has joined #openstack-sahara | 14:30 | |
*** ChanServ sets mode: +v openstackstatus | 14:30 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: testcommit: write python version to logs https://review.openstack.org/403697 | 14:31 |
*** rcernin has joined #openstack-sahara | 14:36 | |
*** esikachev has joined #openstack-sahara | 14:54 | |
*** Guest81242 has joined #openstack-sahara | 15:06 | |
*** sudipto has joined #openstack-sahara | 15:06 | |
openstackgerrit | Merged openstack/sahara-extra: Adds the lazy seek https://review.openstack.org/381265 | 15:32 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Updating list of plugins in config sample https://review.openstack.org/398879 | 15:42 |
*** esikachev has quit IRC | 15:59 | |
*** david-lyle has quit IRC | 16:01 | |
*** zigo has quit IRC | 16:01 | |
*** zigo has joined #openstack-sahara | 16:01 | |
*** david-lyle has joined #openstack-sahara | 16:02 | |
*** nkrinner is now known as nkrinner_afk | 16:19 | |
*** esikachev has joined #openstack-sahara | 16:23 | |
*** rcernin has quit IRC | 16:27 | |
*** pcaruana has quit IRC | 17:19 | |
*** esikachev has quit IRC | 17:40 | |
*** esikachev has joined #openstack-sahara | 17:41 | |
*** esikachev has quit IRC | 17:58 | |
*** sudipto has quit IRC | 18:02 | |
*** Guest81242 has quit IRC | 18:02 | |
*** tosky has quit IRC | 18:25 | |
*** chlong has joined #openstack-sahara | 18:42 | |
*** esikachev has joined #openstack-sahara | 19:15 | |
*** Masber has joined #openstack-sahara | 19:49 | |
*** chlong has quit IRC | 20:02 | |
*** egafford has quit IRC | 20:08 | |
*** chlong has joined #openstack-sahara | 20:17 | |
*** egafford has joined #openstack-sahara | 20:23 | |
*** Masber has quit IRC | 20:38 | |
*** esikachev has quit IRC | 20:49 | |
*** chlong has quit IRC | 21:16 | |
*** chlong has joined #openstack-sahara | 21:29 | |
*** elmiko is now known as _elmiko | 21:34 | |
*** egafford has quit IRC | 21:50 | |
*** masuberu has quit IRC | 21:51 | |
*** egafford has joined #openstack-sahara | 22:02 | |
*** chlong has quit IRC | 22:09 | |
*** zigo has quit IRC | 22:29 | |
*** zigo has joined #openstack-sahara | 22:36 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!