| *** dave-mccowan has quit IRC | 04:28 | |
| *** Bhujay has joined #openstack-sahara | 04:50 | |
| *** rcernin has quit IRC | 04:54 | |
| *** rcernin has joined #openstack-sahara | 04:54 | |
| *** openstackgerrit has quit IRC | 05:18 | |
| *** links has joined #openstack-sahara | 05:30 | |
| *** pcaruana has joined #openstack-sahara | 05:59 | |
| *** pcaruana has quit IRC | 06:05 | |
| *** pcaruana has joined #openstack-sahara | 06:19 | |
| *** rcernin has quit IRC | 07:03 | |
| *** pcaruana has quit IRC | 07:43 | |
| *** pcaruana has joined #openstack-sahara | 07:57 | |
| *** tosky has joined #openstack-sahara | 09:59 | |
| *** tosky has quit IRC | 10:19 | |
| *** links has quit IRC | 10:44 | |
| *** links has joined #openstack-sahara | 10:49 | |
| *** links has quit IRC | 10:50 | |
| *** openstackgerrit has joined #openstack-sahara | 10:53 | |
| openstackgerrit | Merged openstack/sahara-dashboard stable/rocky: Imported Translations from Zanata https://review.openstack.org/591229 | 10:53 |
|---|---|---|
| openstackgerrit | Merged openstack/sahara-dashboard master: Imported Translations from Zanata https://review.openstack.org/591230 | 10:53 |
| openstackgerrit | wu.chunyang proposed openstack/openstack-ansible-os_sahara master: Add the project source code repository in README https://review.openstack.org/591364 | 11:37 |
| *** tosky has joined #openstack-sahara | 11:41 | |
| *** dave-mccowan has joined #openstack-sahara | 11:51 | |
| *** tosky has quit IRC | 12:35 | |
| openstackgerrit | bhujay kumar proposed openstack/sahara master: Correct edp-spark workflow dir permission https://review.openstack.org/591377 | 12:51 |
| openstackgerrit | Tobias Urdin proposed openstack/puppet-sahara master: Add Sahara API WSGI support https://review.openstack.org/590354 | 13:37 |
| Bhujay | tosky, tellesnobrega why sahar is not allowing more than 1 resource manager or hbase master? How to create HA otherwise ? | 13:43 |
| Bhujay | Here is the cluster i tired to create got errors http://paste.openstack.org/show/727888/ | 13:43 |
| tellesnobrega | probably our validation limits the amount of resource manager and hbase master | 13:43 |
| tellesnobrega | Bhujay, this is an ambari cluster? | 13:44 |
| Bhujay | yes tellesnobrega | 13:45 |
| Bhujay | sahara doc suggests a typical cluster with 2 nos resource mgr | 13:45 |
| Bhujay | and even the hdp doc suggests the same ( as gievn in the paste ) | 13:46 |
| tellesnobrega | Bhujay, I'm not sure why it is implemented this way, but if you look at https://github.com/openstack/sahara/blob/master/sahara/plugins/ambari/validation.py#L160-L171 | 13:46 |
| tellesnobrega | you can see the hbase implementation limiting it to 1 | 13:46 |
| tellesnobrega | Bhujay, here is the code for the resource manage | 13:47 |
| tellesnobrega | manager | 13:47 |
| tellesnobrega | https://github.com/openstack/sahara/blob/master/sahara/plugins/ambari/validation.py#L79-L106 | 13:47 |
| tellesnobrega | iiuc to have 2 RM you need to enable HA | 13:47 |
| Bhujay | humm .... it is a problem .. that limits sahara to create a production grade cluster, isn't it ? | 13:48 |
| tellesnobrega | otherwise it will fail | 13:48 |
| tellesnobrega | Bhujay, probably true | 13:48 |
| tellesnobrega | we need to revisit this validations | 13:48 |
| tellesnobrega | the validation allows 2 RM when using HA | 13:49 |
| tellesnobrega | I believe that makes sense | 13:49 |
| tellesnobrega | maybe the Hbase case should have a similar check to allow more hbase masters | 13:49 |
| Bhujay | ok at least RM is not a problem , i need to check this | 13:49 |
| tellesnobrega | about the errors, looks like the image you are using doesn't have java installed | 13:50 |
| tellesnobrega | did you use sahara-image-pack to generate the image | 13:50 |
| tellesnobrega | ? | 13:50 |
| Bhujay | falcon error ? no java is installed , it is little complex , lemme explain | 13:50 |
| Bhujay | yes it was through image-pack | 13:51 |
| Bhujay | java_home is set to /usr/lib/jvm/java-openjdk/jre where jar executable is not there and that is why it fails , whereas 'which jar' is /usr/lib/jvm/java-openjdk/bin/jar | 13:55 |
| Bhujay | that is why falcon start is failing | 13:55 |
| Bhujay | in the pase file there were two errors , one is for cluster validation of RM and HB and the second one is for falcon . the java problem is for falcon | 13:56 |
| tellesnobrega | got it | 13:56 |
| tellesnobrega | Bhujay, what are your plans now to test this out? trying RM with HA? | 13:59 |
| tellesnobrega | see if it properly works? and maybe revisit the hbase limitation ? | 13:59 |
| Bhujay | tellesnobrega , i look forward to see a production grade HDP cluster through Sahara in my organization, working hard but too many issues are coming up , let me know if any way we can speed up to solve these , that will help the community at large as well | 14:03 |
| tellesnobrega | by these you mean the validation issues? RM and hbase? | 14:04 |
| tellesnobrega | I'm not sure RM is an issue, only if HA is not set, which should when you want more than one RM | 14:04 |
| Bhujay | some more are there in the story | 14:04 |
| tellesnobrega | hbase might be, we may need to improve its validation checks | 14:05 |
| tellesnobrega | to allow more than one | 14:05 |
| tellesnobrega | if you can create a story on storyboard for it we very much appreciate | 14:05 |
| Bhujay | thanks for the RM info , I will check it by tomorrow | 14:05 |
| tellesnobrega | whatever else comes up, please let me know, we are very happy to have someone like you testing this out, and it should be amazing for sahara growth, we also want you to have a production grade cluster running on sahara | 14:06 |
| Bhujay | sure , I will create a story | 14:06 |
| tellesnobrega | thanks | 14:06 |
| Bhujay | tellesnobrega , the support i have got from you and tosky is amazing | 14:07 |
| tellesnobrega | :) | 14:07 |
| tellesnobrega | my goal as PTL is to come to a point where support won't be needed, but we are still a little further from that | 14:08 |
| tellesnobrega | hopefully with your help we can get a little better | 14:08 |
| Bhujay | Thanks a lot ... hopefully we able to solve the remaining issues fast with your help and then get more people from my organization to engage for improvement of sahara | 14:11 |
| tellesnobrega | that would be awesome :) | 14:11 |
| Bhujay | Thanks for the RM update , I will revert by tomorrow . bye for now | 14:13 |
| tellesnobrega | bye | 14:14 |
| *** Bhujay has quit IRC | 14:27 | |
| *** pcaruana has quit IRC | 15:37 | |
| *** pcaruana has joined #openstack-sahara | 16:40 | |
| *** openstackgerrit has quit IRC | 17:19 | |
| *** pcaruana has quit IRC | 17:59 | |
| *** wlmbasson_ has joined #openstack-sahara | 19:18 | |
| *** tellesnobrega has quit IRC | 19:25 | |
| *** wlmbasson has quit IRC | 19:25 | |
| *** wlmbasson_ is now known as wlmbasson | 19:25 | |
| *** rcernin has joined #openstack-sahara | 22:01 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!