*** alazarev has quit IRC | 00:00 | |
*** ViswaV has joined #openstack-sahara | 00:03 | |
*** julienvey has joined #openstack-sahara | 00:06 | |
*** RockKuo_Office has joined #openstack-sahara | 00:09 | |
*** julienvey has quit IRC | 00:11 | |
*** ViswaV has quit IRC | 00:17 | |
*** alazarev has joined #openstack-sahara | 00:19 | |
openstackgerrit | A change was merged to openstack/sahara: Install non deprecated DB for Cloudera Manager https://review.openstack.org/117501 | 01:07 |
---|---|---|
*** julienvey has joined #openstack-sahara | 01:07 | |
*** julienvey has quit IRC | 01:12 | |
*** shakamunyi has joined #openstack-sahara | 01:16 | |
*** shakamunyi has quit IRC | 01:24 | |
*** shakamunyi has joined #openstack-sahara | 01:31 | |
*** alazarev has quit IRC | 01:44 | |
*** bradd1 has joined #openstack-sahara | 01:50 | |
*** hochi has joined #openstack-sahara | 01:59 | |
*** ViswaV has joined #openstack-sahara | 02:04 | |
*** julienvey has joined #openstack-sahara | 02:08 | |
*** ViswaV_ has joined #openstack-sahara | 02:11 | |
*** julienvey has quit IRC | 02:12 | |
*** ViswaV has quit IRC | 02:14 | |
*** sunrenjie6 has joined #openstack-sahara | 02:26 | |
*** bradd1 has quit IRC | 02:37 | |
*** julienvey has joined #openstack-sahara | 03:08 | |
*** derekr has left #openstack-sahara | 03:10 | |
*** julienvey has quit IRC | 03:13 | |
*** shakamunyi has quit IRC | 03:22 | |
*** ViswaV_ has quit IRC | 03:24 | |
*** chandankumar has joined #openstack-sahara | 03:44 | |
*** chandankumar has quit IRC | 03:54 | |
*** alazarev has joined #openstack-sahara | 04:02 | |
*** julienvey has joined #openstack-sahara | 04:09 | |
*** julienvey has quit IRC | 04:13 | |
*** chandankumar has joined #openstack-sahara | 04:14 | |
*** alazarev has quit IRC | 04:24 | |
*** alazarev has joined #openstack-sahara | 04:38 | |
openstackgerrit | chandan kumar proposed a change to openstack/sahara: Default value of 'global/namenode_opt_maxnewsize' should be 200m https://review.openstack.org/120786 | 04:38 |
*** julienvey has joined #openstack-sahara | 04:38 | |
*** witlessb_ has joined #openstack-sahara | 04:39 | |
*** julienvey has quit IRC | 04:40 | |
*** julienvey has joined #openstack-sahara | 04:41 | |
*** witlessb has quit IRC | 04:42 | |
*** witlessb_ is now known as witlessb | 04:42 | |
*** alazarev has quit IRC | 04:49 | |
*** alazarev has joined #openstack-sahara | 04:50 | |
*** ViswaV has joined #openstack-sahara | 04:51 | |
*** julienvey has quit IRC | 04:51 | |
*** julienvey has joined #openstack-sahara | 04:52 | |
*** julienvey has quit IRC | 04:56 | |
*** julienvey has joined #openstack-sahara | 05:00 | |
*** julienvey has quit IRC | 05:05 | |
openstackgerrit | A change was merged to openstack/sahara: Added missed translation for service.edp.spark https://review.openstack.org/120090 | 05:28 |
*** hochi has quit IRC | 05:28 | |
*** akuznetsov has quit IRC | 05:29 | |
*** alazarev has quit IRC | 05:45 | |
*** chandankumar has quit IRC | 05:45 | |
*** akuznetsov has joined #openstack-sahara | 05:53 | |
*** hochi has joined #openstack-sahara | 05:59 | |
*** ViswaV has quit IRC | 06:00 | |
*** sunrenjie6 has quit IRC | 06:04 | |
*** RockKuo_Office has quit IRC | 06:09 | |
*** ViswaV has joined #openstack-sahara | 06:13 | |
*** ViswaV has quit IRC | 06:38 | |
*** k4n0 has joined #openstack-sahara | 06:45 | |
*** Longgeek has joined #openstack-sahara | 06:47 | |
*** tnovacik has joined #openstack-sahara | 06:58 | |
*** bradd1 has joined #openstack-sahara | 06:58 | |
*** RockKuo_Office has joined #openstack-sahara | 07:01 | |
*** akuznetsov has quit IRC | 07:05 | |
*** akuznetsov has joined #openstack-sahara | 07:07 | |
*** akuznetsov has quit IRC | 07:12 | |
*** tnovacik has quit IRC | 07:13 | |
*** akuznetsov has joined #openstack-sahara | 07:17 | |
*** akuznetsov has quit IRC | 07:19 | |
*** akuznetsov has joined #openstack-sahara | 07:20 | |
*** chandankumar has joined #openstack-sahara | 07:23 | |
*** akuznetsov has quit IRC | 07:23 | |
*** akuznetsov has joined #openstack-sahara | 07:35 | |
*** akuznetsov has quit IRC | 07:36 | |
*** akuznetsov has joined #openstack-sahara | 07:37 | |
*** akuznetsov has quit IRC | 08:03 | |
*** akuznetsov has joined #openstack-sahara | 08:04 | |
*** akuznetsov has quit IRC | 08:05 | |
*** tnovacik has joined #openstack-sahara | 08:09 | |
*** tnovacik has quit IRC | 08:10 | |
*** tnovacik has joined #openstack-sahara | 08:10 | |
*** akuznetsov has joined #openstack-sahara | 08:11 | |
*** bradd1 has quit IRC | 08:25 | |
*** Ch00k has joined #openstack-sahara | 09:02 | |
*** hochi_ has joined #openstack-sahara | 09:33 | |
*** hochi has quit IRC | 09:35 | |
*** Ch00k has quit IRC | 09:38 | |
openstackgerrit | Kazuki OIKAWA proposed a change to openstack/sahara-extra: Add checkstyle target https://review.openstack.org/121040 | 09:49 |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Fix using cinder volumes with nodemanager in HDP2 https://review.openstack.org/121042 | 09:49 |
*** akuznetsov has quit IRC | 09:55 | |
*** akuznetsov has joined #openstack-sahara | 10:00 | |
*** akuznetsov has quit IRC | 10:07 | |
*** hochi_ has quit IRC | 10:11 | |
openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Sahara-Dashboard docs updated https://review.openstack.org/120045 | 10:16 |
*** _mattf is now known as mattf | 10:53 | |
*** RockKuo_Office has quit IRC | 11:01 | |
openstackgerrit | Andrey Pavlov proposed a change to openstack/sahara: Fixed terminate_unneeded_clusters fail in distributed mode https://review.openstack.org/117750 | 11:17 |
*** Longgeek has quit IRC | 11:45 | |
*** Longgeek has joined #openstack-sahara | 11:46 | |
openstackgerrit | chandan kumar proposed a change to openstack/sahara: Fixed the localrc file for enabling swift services. https://review.openstack.org/121060 | 11:47 |
*** Longgeek has quit IRC | 11:48 | |
*** Longgeek has joined #openstack-sahara | 11:51 | |
*** Longgeek_ has joined #openstack-sahara | 11:53 | |
*** Longgeek has quit IRC | 11:56 | |
*** _crobertsrh is now known as crobertsrh | 12:05 | |
*** Ch00k has joined #openstack-sahara | 12:16 | |
*** Ch00k has quit IRC | 12:17 | |
*** Ch00k_ has joined #openstack-sahara | 12:17 | |
*** Ch00k has joined #openstack-sahara | 12:21 | |
*** Ch00k_ has quit IRC | 12:21 | |
openstackgerrit | A change was merged to openstack/sahara: Imported Translations from Transifex https://review.openstack.org/120702 | 12:30 |
*** Ch00k has quit IRC | 12:43 | |
*** Ch00k has joined #openstack-sahara | 12:45 | |
*** chandankumar has quit IRC | 12:47 | |
*** akuznetsov has joined #openstack-sahara | 12:52 | |
*** akuznetsov has quit IRC | 12:55 | |
*** akuznetsov has joined #openstack-sahara | 12:56 | |
openstackgerrit | Kazuki OIKAWA proposed a change to openstack/sahara-extra: Add checkstyle target https://review.openstack.org/121040 | 12:57 |
*** Ch00k has quit IRC | 12:58 | |
*** tmckay has quit IRC | 13:02 | |
*** akuznetsov has quit IRC | 13:03 | |
openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara-specs: Added specification for adding event log https://review.openstack.org/119052 | 13:08 |
openstackgerrit | Vitaly Gridnev proposed a change to openstack/sahara: Sahara-Dashboard docs updated https://review.openstack.org/120045 | 13:21 |
*** bradd1 has joined #openstack-sahara | 13:49 | |
*** Ch00k has joined #openstack-sahara | 13:52 | |
openstackgerrit | A change was merged to openstack/sahara: Migrate to oslo.serialization https://review.openstack.org/120079 | 13:57 |
*** tmckay has joined #openstack-sahara | 14:07 | |
*** Ch00k has quit IRC | 14:08 | |
*** akuznetsov has joined #openstack-sahara | 14:25 | |
*** alazarev has joined #openstack-sahara | 14:35 | |
*** Longgeek_ has quit IRC | 14:39 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Enabled check for non-critical issues in pylint https://review.openstack.org/120837 | 14:45 |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Enabled check for non-critical issues in pylint https://review.openstack.org/120837 | 14:45 |
openstackgerrit | A change was merged to openstack/sahara: Renamed missing 'savanna' tags to 'sahara' https://review.openstack.org/119960 | 14:46 |
*** bradd1 has left #openstack-sahara | 14:53 | |
*** ViswaV has joined #openstack-sahara | 14:53 | |
SergeyLukjanov | elmiko, tmckay, yay! trust-related stuff merged! | 14:59 |
elmiko | SergeyLukjanov: woot =D | 14:59 |
tmckay | yay! That was a long road | 14:59 |
elmiko | SergeyLukjanov: once we get the docs, ui, and hadoop-swift, we should consider closing the bug as well | 15:00 |
elmiko | at some point, i'd like to talk about setting up integration/gate tests for the proxy domains, but that will require some reconfiguration of those stacks. | 15:01 |
tmckay | SergeyLukjanov, alazarev, if we can get another +2 on https://review.openstack.org/#/c/119767/ (doc for proxy user) we can merge that too | 15:01 |
SergeyLukjanov | elmiko, we could re-configure one of the jobs on sahara-ci I think to check it | 15:02 |
alazarev | SergeyLukjanov: done | 15:02 |
elmiko | SergeyLukjanov: cool | 15:02 |
SergeyLukjanov | folks, I'll be in CA starting from the Sept 17, so, more time for a day time collaboration :) | 15:03 |
elmiko | nice | 15:03 |
tmckay | alazarev, thanks. I think that's all the "sahara" project trust CRs | 15:03 |
alazarev | tmckay: no changes in python client required for that, right? | 15:05 |
alazarev | SergeyLukjanov: could you please take another look at https://review.openstack.org/#/c/117029/ ? | 15:06 |
tmckay | elimiko, ^^, I don't think so | 15:06 |
SergeyLukjanov | tmckay, alazarev, I think we don't need any changes for client due to the option username/password | 15:06 |
elmiko | tmckay, alazarev, no changes to python client | 15:06 |
tmckay | yeah, username and password are just missing, and validation has been updated | 15:06 |
elmiko | correct | 15:07 |
elmiko | separate topic, are we going to update the client to accept v3 Keystone? | 15:07 |
tmckay | elmiko, oh, design summit -- we still need a method for credentials with spark/swift | 15:07 |
tmckay | I'll add something | 15:07 |
elmiko | tmckay: yea | 15:08 |
*** Longgeek has joined #openstack-sahara | 15:08 | |
elmiko | SergeyLukjanov, tmckay, alazarev, would it be appropriate for me to create a spec about updating saharaclient to use v3 Keystone, or is there a different process for this? | 15:09 |
alazarev | elmiko: I think spec is good | 15:10 |
elmiko | ok, cool. i wasn't sure if there was any special process for the client | 15:10 |
*** ViswaV has quit IRC | 15:13 | |
SergeyLukjanov | elmiko, spec is good - we have a dir in specs repo for client specs | 15:24 |
elmiko | SergeyLukjanov: ack, thanks | 15:24 |
*** Longgeek has quit IRC | 15:24 | |
openstackgerrit | A change was merged to openstack/sahara-extra: Adding /etc/ dir to location of edp-examples to reflect reality https://review.openstack.org/120869 | 15:34 |
*** alazarev has quit IRC | 15:56 | |
*** alazarev has joined #openstack-sahara | 16:02 | |
openstackgerrit | A change was merged to stackforge/sahara-ci-config: Use mirrors for CDH plugin https://review.openstack.org/120434 | 16:06 |
*** ViswaV has joined #openstack-sahara | 16:20 | |
*** ViswaV_ has joined #openstack-sahara | 16:21 | |
drss | I saw mention that there might have been a plan to add support for apache storm for Juno, is that the case, and if so is there any documentation available? | 16:23 |
elmiko | drss: yes, it has been worked on. i'll dig up the blueprint | 16:24 |
elmiko | drss: https://blueprints.launchpad.net/sahara/+spec/storm-integration | 16:24 |
drss | elmiko: great, thank you! | 16:24 |
elmiko | np =) | 16:24 |
*** ViswaV has quit IRC | 16:25 | |
*** Longgeek has joined #openstack-sahara | 16:25 | |
openstackgerrit | chandan kumar proposed a change to openstack/sahara: Fixed the localrc file for enabling swift services https://review.openstack.org/121060 | 16:27 |
*** Longgeek has quit IRC | 16:30 | |
*** k4n0 has quit IRC | 16:40 | |
*** mattf is now known as _mattf | 16:40 | |
*** ViswaV_ has quit IRC | 16:55 | |
*** ViswaV has joined #openstack-sahara | 17:01 | |
*** tmckay has left #openstack-sahara | 17:19 | |
*** shar has joined #openstack-sahara | 18:01 | |
*** alazarev has quit IRC | 18:02 | |
*** tmckay has joined #openstack-sahara | 18:14 | |
*** Longgeek has joined #openstack-sahara | 18:15 | |
*** Longgeek has quit IRC | 18:19 | |
*** tmckay has left #openstack-sahara | 18:28 | |
*** tmckay has joined #openstack-sahara | 18:33 | |
*** _mattf is now known as mattf | 18:45 | |
elmiko | tmckay, crobertsrh, if i want to see how a default-cluster.template is used, do i need to create the cluster and then get it's json representation to see those values? | 18:50 |
crobertsrh | Where is the default-cluster.template? | 18:50 |
crobertsrh | I suppose that's one way of seeing what it looks like. I've never dealt with a default-cluster-template | 18:51 |
elmiko | for example plugins/hdp/versions/version_1_3_2/resources/default-cluster.template | 18:51 |
elmiko | that's the template that get's filled in, but then i'm wondering how would i double check it? | 18:51 |
elmiko | do i just hit http://sahara/v1.1/tenant/cluster/id to see it? | 18:52 |
crobertsrh | I think that would work | 18:52 |
elmiko | here goes nothing =) | 18:53 |
*** tnovacik has quit IRC | 18:54 | |
*** balles has quit IRC | 19:21 | |
elmiko | oh well, that didn't quite work | 19:34 |
*** tmckay has quit IRC | 19:38 | |
*** shar has quit IRC | 19:39 | |
*** tmckay has joined #openstack-sahara | 19:39 | |
*** tmckay has left #openstack-sahara | 19:40 | |
*** tmckay has joined #openstack-sahara | 19:42 | |
dmitryme | hey elmiko, probably I can clarify, but I don’t quite understand your question :-) | 19:48 |
*** Ch00k has joined #openstack-sahara | 19:49 | |
elmiko | dmitryme: hey | 19:49 |
elmiko | well, i want to ensure that one of the configurations in the hdp default-cluster.template is getting filled in properly. how could i check that? | 19:50 |
dmitryme | that is what I don’t understand: the file you are refering to is a static resource file in Sahara | 19:51 |
elmiko | i'm working on https://bugs.launchpad.net/sahara/+bug/1260835 and i want to make sure that i fill in ZOOKEEPER_HOST correctly | 19:51 |
dmitryme | aha, I see | 19:51 |
elmiko | shouldn't those configuration options appear in cluster_configs if i hit the /clusters endpoint? | 19:52 |
dmitryme | I think you should get them if you access /plugins/hdp/<version> endpoint | 19:56 |
elmiko | ok, thanks, i'll give that a try | 19:57 |
elmiko | dmitryme: ok, that works for the default values. is there a way to check once the template has been filled in? | 20:01 |
dmitryme | elmiko: yep, just define a cluster template in UI. While filling in the template, edit the config you wish | 20:02 |
dmitryme | after that access the created template via /cluster_templates/<id> | 20:02 |
dmitryme | if you create cluster from that template, it will inherit the cluster_configs from the template | 20:03 |
elmiko | hmm, maybe i'm doing it wrong then. i tried that but cluster_configs is always coming up [] | 20:07 |
dmitryme | ok, can you explain what do you do? | 20:08 |
dmitryme | I mean, in details | 20:08 |
elmiko | ok, i start by making node group templates in horizon, then create a cluster template, then launch the cluster. | 20:08 |
elmiko | after it is active, i hit /clusters/id | 20:08 |
elmiko | if i'm reading the code correctly, it should fill in the ZOOKEEPER_HOST value with the ip of the zk node | 20:09 |
elmiko | dmitryme: i'm gonna try one more time, maybe i missed something | 20:11 |
dmitryme | elmiko: nope, it should not if I understand it correcly, the values in the file are just defaults. | 20:13 |
dmitryme | we don’t show them in cluster_configs, unless user explicitly defined them | 20:13 |
openstackgerrit | A change was merged to openstack/sahara: Add use of nova_kwargs for nova servers create to improve readability https://review.openstack.org/119051 | 20:13 |
elmiko | so it doesn't actually use the ZOOKEEPER_HOST ip? | 20:14 |
crobertsrh | Anyone seen this while trying to start a spark cluster? http://paste.openstack.org/show/110790/ | 20:14 |
crobertsrh | It's on a slightly slower machine than my main laptop, but I have no problems with hadoop clusters on it. | 20:15 |
elmiko | crobertsrh: haven't seen that one | 20:15 |
crobertsrh | It's with a freshly created image. I'll try it on my faster machine to hopefully avoid the timeout. | 20:15 |
crobertsrh | I suppose it could also be my networking....neutron on the "bad" machine vs nova on my main machine. | 20:17 |
elmiko | lol, always blaming it on neutron... | 20:17 |
*** Ch00k has quit IRC | 20:19 | |
*** tmckay has quit IRC | 20:38 | |
elmiko | dmitryme: think i see part of the problem, these values i want only get executed for webhcat and hbase. i need to figure out how to enable them. at the least though the tests pass lol. | 20:49 |
dmitryme | elmiko: sorry, I got distracted | 20:50 |
elmiko | dmitryme: no problem, i've just been working on the tests. i figure if they pass i'm close =) | 20:50 |
crobertsrh | Looks like the image works fine on my "fast" machine. I'll try to see if I can bump up whatever is timing out. | 20:51 |
*** tmckay has joined #openstack-sahara | 20:54 | |
dmitryme | elmiko: ok, it is my understanding that these configs do exists in the cluster, but they are not shown to the user | 20:54 |
dmitryme | I mean the one like ‘hbase.zookeeper.quorum’ | 20:54 |
elmiko | dmitryme: that makes sense | 20:54 |
*** mattf is now known as _mattf | 20:55 | |
dmitryme | if you grep ZOOKEEPER_HOST in sahara/plugins/hdp/versions/version_1_3_2/services.py , you will see places where it is substituted with the actual value | 20:56 |
elmiko | i did that, i'm basically just replacing the values and making sure the tests pass. | 20:56 |
elmiko | i was hoping to setup a cluster and confirm that the values are getting to the cluster, but maybe it's not necessary. | 20:56 |
dmitryme | my suggestion would be to deploy HDP with HBase and check that ‘hbase.zookeeper.quorum’ is set to the right value in hbase-site.xml | 20:57 |
elmiko | ok, thanks. i'll give that a try | 20:58 |
dmitryme | sure you will have to deploy that cluster with several zookeepers | 20:58 |
elmiko | yea | 20:58 |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Added information about sahara settings to cluster https://review.openstack.org/117029 | 21:03 |
*** crobertsrh is now known as _crobertsrh | 21:05 | |
openstackgerrit | Andrew Lazarev proposed a change to openstack/sahara: Added information about sahara settings to cluster https://review.openstack.org/117029 | 21:08 |
*** ViswaV has quit IRC | 21:24 | |
openstackgerrit | A change was merged to openstack/python-saharaclient: Sync oslo strutils module https://review.openstack.org/120751 | 21:34 |
*** sballe__ has joined #openstack-sahara | 21:37 | |
*** sballe_ has quit IRC | 21:43 | |
*** ViswaV has joined #openstack-sahara | 21:45 | |
*** tmckay has quit IRC | 21:49 | |
*** Longgeek has joined #openstack-sahara | 21:52 | |
openstackgerrit | A change was merged to openstack/sahara: CDH manager-node flavor change https://review.openstack.org/119373 | 21:52 |
*** Longgeek has quit IRC | 21:56 | |
*** akuznets_ has joined #openstack-sahara | 22:15 | |
*** ViswaV_ has joined #openstack-sahara | 22:15 | |
*** ylobankov_ has joined #openstack-sahara | 22:16 | |
*** akuznetsov has quit IRC | 22:18 | |
*** ylobankov has quit IRC | 22:18 | |
*** _mattf has quit IRC | 22:18 | |
*** drss_ has joined #openstack-sahara | 22:20 | |
*** boris-42_ has joined #openstack-sahara | 22:22 | |
*** openstack has joined #openstack-sahara | 23:36 | |
*** sendak.freenode.net sets mode: +ns | 23:36 | |
*** sendak.freenode.net sets mode: -o openstack | 23:42 | |
-sendak.freenode.net- *** Notice -- TS for #openstack-sahara changed from 1410565010 to 1394198314 | 23:42 | |
*** sendak.freenode.net sets mode: +ct-s | 23:42 | |
*** ekarlso- has joined #openstack-sahara | 23:42 | |
*** openstackgerrit has joined #openstack-sahara | 23:42 | |
*** drss has joined #openstack-sahara | 23:42 | |
*** ghenriks has joined #openstack-sahara | 23:42 | |
*** ylobankov has joined #openstack-sahara | 23:42 | |
*** witlessb has joined #openstack-sahara | 23:42 | |
*** boris-42 has joined #openstack-sahara | 23:42 | |
*** juice has joined #openstack-sahara | 23:42 | |
*** akuznets_ has joined #openstack-sahara | 23:42 | |
*** sballe__ has joined #openstack-sahara | 23:42 | |
*** elmiko has joined #openstack-sahara | 23:42 | |
*** miqui has joined #openstack-sahara | 23:42 | |
*** oikawa has joined #openstack-sahara | 23:42 | |
*** tellesnobrega has joined #openstack-sahara | 23:42 | |
*** _crobertsrh has joined #openstack-sahara | 23:42 | |
*** dmitryme has joined #openstack-sahara | 23:42 | |
*** zhiyan has joined #openstack-sahara | 23:42 | |
*** SergeyLukjanov has joined #openstack-sahara | 23:42 | |
*** mikehn has joined #openstack-sahara | 23:42 | |
*** NikitaKonovalov has joined #openstack-sahara | 23:42 | |
*** ruhe has joined #openstack-sahara | 23:42 | |
*** aignatov has joined #openstack-sahara | 23:42 | |
*** anteaya has joined #openstack-sahara | 23:42 | |
*** venza has joined #openstack-sahara | 23:42 | |
*** sendak.freenode.net changes topic to "launchpad openid is down. login to openstack services will fail until launchpad openid is happy again" | 23:42 | |
*** drss has quit IRC | 23:59 | |
*** drss has joined #openstack-sahara | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!