Friday, 2015-12-04

*** ViswaV has joined #openstack-sahara00:02
*** agireud has quit IRC00:07
*** agireud has joined #openstack-sahara00:13
*** witlessb has quit IRC00:16
*** chlong has joined #openstack-sahara00:16
*** agireud has quit IRC00:18
*** agireud has joined #openstack-sahara00:21
*** poseidon1157 has quit IRC00:25
*** jinxing has joined #openstack-sahara00:30
openstackgerritMerged openstack/sahara: Remove version from setup.cfg  https://review.openstack.org/25289000:42
*** agireud has quit IRC00:42
*** jinxing has quit IRC00:56
*** jinxing has joined #openstack-sahara00:58
*** agireud has joined #openstack-sahara01:12
*** agireud has quit IRC01:14
*** agireud has joined #openstack-sahara01:30
*** hdd has quit IRC01:34
*** agireud has quit IRC01:34
*** agireud has joined #openstack-sahara01:48
*** agireud has quit IRC01:53
*** jinxing has quit IRC02:00
*** agireud has joined #openstack-sahara02:03
*** ViswaV has quit IRC02:05
*** agireud has quit IRC02:07
*** jinxing has joined #openstack-sahara02:10
*** ViswaV has joined #openstack-sahara02:12
*** poseidon1157 has joined #openstack-sahara02:18
*** poseidon1157 has joined #openstack-sahara02:18
*** poseidon1157 has quit IRC02:19
openstackgerritJaxon Wang proposed openstack/sahara: Refine the code for CDH PluginUtils class  https://review.openstack.org/25081002:21
openstackgerritJaxon Wang proposed openstack/sahara: Add unit test cases for cdh plugin utils  https://review.openstack.org/24806802:21
*** poseidon1157 has joined #openstack-sahara02:22
*** poseidon1157 has quit IRC02:23
*** poseidon1157 has joined #openstack-sahara02:29
*** ViswaV has quit IRC02:29
*** ViswaV has joined #openstack-sahara02:31
*** adelia has joined #openstack-sahara02:34
*** adelia has quit IRC02:39
*** adelia has joined #openstack-sahara02:40
*** jinxing has quit IRC02:42
*** adelia has quit IRC02:44
*** Poornima has joined #openstack-sahara02:48
*** adelia has joined #openstack-sahara02:53
*** adelia has quit IRC02:54
*** adelia has joined #openstack-sahara02:54
*** ViswaV has quit IRC02:57
*** adelia has quit IRC02:59
*** hdd has joined #openstack-sahara03:24
*** links has joined #openstack-sahara04:00
*** hdd has quit IRC04:08
*** links has quit IRC04:23
*** hdd has joined #openstack-sahara04:34
*** agireud has joined #openstack-sahara04:51
*** hdd has quit IRC04:56
openstackgerritChangBo Guo(gcb) proposed openstack/sahara: test: make enforce_type=True in CONF.set_override  https://review.openstack.org/24742705:03
*** links has joined #openstack-sahara05:09
*** agireud has quit IRC05:23
*** hdd has joined #openstack-sahara05:26
*** agireud has joined #openstack-sahara05:26
*** agireud has quit IRC05:35
*** adelia has joined #openstack-sahara05:37
*** adelia has quit IRC05:42
*** rcernin has joined #openstack-sahara06:12
*** hdd has quit IRC06:20
*** poseidon1157 has quit IRC06:35
*** agireud has joined #openstack-sahara06:50
*** agireud has quit IRC06:54
*** rcernin has quit IRC06:59
*** agireud has joined #openstack-sahara07:04
*** rcernin has joined #openstack-sahara07:07
*** agireud has quit IRC07:09
*** chlong has quit IRC07:19
*** sgotliv__ has quit IRC07:42
*** Poornima has quit IRC08:16
*** Poornima has joined #openstack-sahara08:26
*** Poornima has quit IRC08:32
*** Poornima has joined #openstack-sahara08:35
*** vgridnev has quit IRC08:40
*** witlessb has joined #openstack-sahara08:54
*** _degorenko|afk is now known as degorenko09:03
-openstackstatus- NOTICE: Tox tests are broken at the moment. From openstack-infra we are working to fix them. Please don't approve changes until we notify that tox tests work again.09:31
*** vgridnev has joined #openstack-sahara09:34
*** sgotliv__ has joined #openstack-sahara10:00
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: ACL support in Sahara UI  https://review.openstack.org/25341810:14
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: ACL support in Sahara UI  https://review.openstack.org/25341810:19
*** sgotliv__ has quit IRC10:22
*** agireud has joined #openstack-sahara10:29
openstackgerritShu Muto proposed openstack/python-saharaclient: Remove py26 support  https://review.openstack.org/25224610:31
*** openstackgerrit has quit IRC10:32
*** openstackgerrit has joined #openstack-sahara10:32
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: [Sahara] Move cluster configuration to separate tab  https://review.openstack.org/25342410:33
*** agireud has quit IRC10:34
*** Poornima has quit IRC10:38
*** tosky has joined #openstack-sahara10:52
*** vgridnev has quit IRC10:52
*** vgridnev has joined #openstack-sahara10:54
*** poseidon1157 has joined #openstack-sahara11:02
*** esikachev has joined #openstack-sahara11:27
*** esikachev has quit IRC11:31
*** adelia has joined #openstack-sahara11:42
*** chlong has joined #openstack-sahara11:44
*** adelia has quit IRC11:46
*** noqa_v_g1ovnie is now known as noqa_v_qoovnie11:58
openstackgerritVitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin  https://review.openstack.org/25183512:14
openstackgerritVitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin  https://review.openstack.org/25183512:16
openstackgerritVitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin  https://review.openstack.org/25183512:21
*** raildo-afk is now known as raildo12:21
*** raildo is now known as raildo-afk12:24
*** raildo-afk is now known as raildo12:24
*** sgotliv__ has joined #openstack-sahara12:31
*** adelia has joined #openstack-sahara12:43
*** adelia has quit IRC12:48
openstackgerritVitaly Gridnev proposed openstack/sahara: Add ability to get auth token from auth plugin  https://review.openstack.org/25183512:55
openstackgerritEvgeny Sikachev proposed openstack/sahara-specs: Move sahara tests to seperate repository  https://review.openstack.org/25041912:56
*** hdd has joined #openstack-sahara13:18
*** degorenko is now known as degorenko|afk13:26
*** sgotliv__ has quit IRC13:29
openstackgerritJaxon Wang proposed openstack/sahara: Add test cases for CDH plugin config_helper  https://review.openstack.org/25349413:32
*** poseidon1157 has quit IRC13:34
*** poseidon1157 has joined #openstack-sahara13:42
*** david-lyle has quit IRC13:43
*** adelia has joined #openstack-sahara13:45
openstackgerritMerged openstack/python-saharaclient: Remove py26 support  https://review.openstack.org/25224613:46
*** adelia has quit IRC13:50
*** nkrinner has quit IRC13:51
openstackgerritMerged openstack/python-saharaclient: Delete python bytecode before every test run  https://review.openstack.org/25217413:51
*** tellesnobrega is now known as tellesnobrega_af13:55
*** _crobertsrh is now known as crobertsrh13:58
*** raildo is now known as raildo-afk13:59
*** degorenko|afk is now known as degorenko13:59
*** tmckay has joined #openstack-sahara14:00
*** nkrinner has joined #openstack-sahara14:02
*** tmckay has left #openstack-sahara14:02
*** links has quit IRC14:02
*** nkrinner has quit IRC14:05
*** tellesnobrega_af is now known as tellesnobrega14:15
*** hdd has quit IRC14:19
openstackgerritJaxon Wang proposed openstack/sahara: Add test cases for CDH plugin config_helper  https://review.openstack.org/25349414:22
*** _mattf is now known as mattf14:23
*** akuznetsov has joined #openstack-sahara14:23
*** mattf has quit IRC14:24
*** mattf has joined #openstack-sahara14:24
*** tmckay has joined #openstack-sahara14:27
*** adelia has joined #openstack-sahara14:27
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Fix defaults for doc section  https://review.openstack.org/25352814:32
*** mattf is now known as _mattf14:45
*** crobertsrh has quit IRC14:47
openstackgerritMerged openstack/python-saharaclient: Adding indications of results after delete operations  https://review.openstack.org/24978414:48
*** crobertsrh has joined #openstack-sahara14:51
*** hdd has joined #openstack-sahara14:53
*** akuznetsov has quit IRC15:06
*** tellesnobrega is now known as tellesnobrega_af15:09
*** egafford has joined #openstack-sahara15:09
*** degorenko has quit IRC15:27
*** degorenko has joined #openstack-sahara15:31
*** vgridnev has quit IRC15:39
*** vgridnev has joined #openstack-sahara15:40
openstackgerritVitaly Gridnev proposed openstack/sahara: rewrite heat client calls  https://review.openstack.org/25148815:47
openstackgerritVitaly Gridnev proposed openstack/sahara: rewrite heat client calls  https://review.openstack.org/25148815:49
openstackgerritVitaly Gridnev proposed openstack/sahara: rewrite heat client calls  https://review.openstack.org/25148815:49
*** raildo-afk is now known as raildo16:10
*** raildo is now known as raildo-afk16:11
*** raildo-afk is now known as raildo16:12
*** _mattf is now known as mattf16:15
*** vgridnev has quit IRC16:18
*** degorenko is now known as _degorenko|afk16:44
*** david-lyle has joined #openstack-sahara16:49
*** rcernin has quit IRC16:52
-openstackstatus- NOTICE: The earlier JJB bug which disrupted tox-based job configurations has been reverted and applied; jobs seem to be running successfully for the past two hours.16:54
*** ViswaV has joined #openstack-sahara16:58
*** datainadequate has joined #openstack-sahara17:04
*** datainadequate has quit IRC17:05
*** datainadequate has joined #openstack-sahara17:06
*** vgridnev has joined #openstack-sahara17:08
openstackgerritDavid Lyle proposed openstack/sahara-dashboard: WIP: adding integration test support  https://review.openstack.org/25361417:09
*** david-lyle has quit IRC17:13
datainadequateIs this channel just for team discussions, or are general questions about Sahara appropriate here?17:13
elmikodatainadequate: general questions are appropriate =)17:15
elmikoreally, anything about the sahara project is fair17:15
datainadequateThanks elmiko17:15
datainadequateI was wondering what was happening about HDP support? I saw there was a spec to add a new plugin: http://specs.openstack.org/openstack/sahara-specs/specs/liberty/hdp-22-support.html17:16
datainadequateBut I couldn’t find any info about how this was progressing.17:17
elmikoafaik the updated plugin is being worked on by sreshetnyak17:17
elmikoi'm not sure on the current status though17:17
elmikoas i recall there was a good deal of work to refactor the plugin, but you are correct in that there hasn't been a status update since the end of liberty17:18
elmikowe do have a new ambari plugin that is under development, i imagine there might be an effort to get that in working order first. i'm not sure17:19
elmikovgridnev: are you still around, know anything about this ^^ (hdp 2.2)17:19
*** adelia has quit IRC17:19
*** shakamunyi has quit IRC17:21
vgridnevhi, folks. Yes it's reworked plugin, but it's not fully ready because some features not implemented yet. Also, there are some bugs. That is why it's enabled by default in sahara right now17:22
vgridnevit's not enabled, misprint17:22
elmikothanks vgridnev17:22
datainadequateAmbari plugin sounds most promising to me. New HDP versions appear regularly, they’re now up to 2.3.17:23
datainadequateThanks vgridnev.17:23
*** adelia has joined #openstack-sahara17:24
vgridnev2.3 is also supported by the plugin17:24
datainadequateHow about 2.1? <hopeful>17:24
vgridnevno17:24
datainadequateOh well :)17:24
datainadequateI have also been struggling getting CDH clusters running under Kilo. I suspect the answer is “move to Liberty”, amirite?17:33
*** adelia has quit IRC17:43
vgridnevdatainadequate, on Kilo cdh almost stable, I think17:46
datainadequateHmm. Thanks vgridnev. Wonder what is going wrong then.17:53
datainadequateThe nodes are getting created ok. But when Sahara tries to start the services something always fails. sahara-all.log doesn’t have a lot of info, and I don’t know where to start looking to dig deeper.17:55
*** adelia has joined #openstack-sahara17:57
vgridnevcould you please attach this logs?18:07
vgridnevsahara-all logs, I think18:07
*** hdd has quit IRC18:14
datainadequateSorry, I haven’t been keeping all the log data, but the error in the log was:18:23
datainadequate2015-12-03 14:41:24.318 30420 ERROR sahara.service.ops [-] Error during operating on cluster cdh530-default-test (reason: Failed to Provision Hadoop Cluster: Failed to Create Hive Metastore Database Tables.18:23
datainadequateThat was trying to create a cluster using Cloudera 5.3.0 plugin, using the default template provided.18:24
datainadequateMy own templates fail with the error:18:26
datainadequate2015-12-03 09:59:54.952 30420 ERROR sahara.service.ops [-] Error during operating on cluster byoh-cdh53-test-02b (reason: Failed to Provision Hadoop Cluster: Failed to start service.18:26
datainadequateError ID: 9b6ff3b7-31b5-41b9-84aa-a00eef5b4411)18:26
datainadequateOn my todo list: searching the Sahara source code to see if I can find a definition for that error code :)18:28
vgridnevdatainadequate, this code is just random uuid18:29
vgridnevwhich flavors you use?18:29
datainadequateFlavors?18:36
*** tosky has quit IRC18:37
vgridnevopenstack flavor of vms18:38
*** mattf is now known as _mattf18:44
*** ViswaV has quit IRC18:45
*** ViswaV has joined #openstack-sahara18:49
datainadequateThe base images I have to pick from are:18:55
datainadequatesahara-kilo-cloudera-5.3.0-ubuntu-12.04.qcow218:55
datainadequatesahara-kilo-cloudera-5.3.0-centos-6.6.qcow218:55
vgridnevno18:56
vgridnevI meant what is size of vms18:56
vgridnevram, cpu, disk18:56
datainadequateAh, ok. I was using a flavor called “hadoop”, but not sure how big that is.18:56
vgridnevI don't know such flavor. It's custom flavor of your environment18:57
elmikodatainadequate: basically, we need to know the number of CPUs, RAM, disk space. sometimes the hadoop nodes can be starved of resources which leads to errors when starting the cluster.19:01
datainadequateOk, makes sense. Let me take look.19:02
elmikoflavor is the terminology used by nova (compute service) to determine these stats for a VM19:03
datainadequateOur “hadoop” flavour has 4 VCPUs, 4GB RAM, 20GB disk. If I was to take a guess I would say that was way too little disk for Cloudera, cos Cloudera wants to install a lot of stuff.19:04
elmikoyea could be19:04
elmikoalso, iirc, the cloudera nodes need access to the internet for installations. do those nodes have internet access?19:05
datainadequateYes, pretty sure they do.19:06
elmikok19:06
*** david-ly_ has joined #openstack-sahara19:06
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: Backport changes from https://review.openstack.org/#/c/215127  https://review.openstack.org/25365319:11
openstackgerritTimur Sufiev proposed openstack/sahara-dashboard: [WIP] Fight non pluggable _go_to_methods in an evil hacky way  https://review.openstack.org/25365419:11
openstackgerritGrigoriy Rozhkov proposed openstack/sahara: Add MapR-FS support to sahara scenario framework  https://review.openstack.org/24169619:13
*** hdd has joined #openstack-sahara19:21
*** tellesnobrega_af is now known as tellesnobrega19:36
*** david-ly_ is now known as david-lyle19:39
*** datainadequate has quit IRC19:50
*** shakamunyi has joined #openstack-sahara20:12
openstackgerritMerged openstack/sahara: Adding ability disable anti_affinty check in plugin  https://review.openstack.org/24363820:40
*** poseidon1157 has quit IRC20:52
*** raildo is now known as raildo-afk20:54
*** adelia has quit IRC21:04
*** witlessb has quit IRC21:36
*** witlessb has joined #openstack-sahara21:37
*** crobertsrh is now known as _crobertsrh21:59
*** adelia has joined #openstack-sahara22:05
*** adelia has quit IRC22:10
*** david-ly_ has joined #openstack-sahara22:29
*** david-ly_ is now known as david-lyle_22:31
*** david-lyle has quit IRC22:32
*** poseidon1157 has joined #openstack-sahara22:49
*** hdd has quit IRC23:16
*** tellesnobrega is now known as tellesnobrega_af23:24
*** openstack has joined #openstack-sahara23:36

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!