openstackgerrit | Andrew Lazarev proposed openstack/sahara: Implemented multi-worker solution for Sahara API https://review.openstack.org/146661 | 00:07 |
---|---|---|
SergeyLukjanov | elmiko, crobertsh, fix released == milestone released (kilo-1 or juno or juno-1 or juno-rc1) | 00:18 |
elmiko | SergeyLukjanov: ack | 00:33 |
*** hdd has joined #openstack-sahara | 01:03 | |
*** witlessb has quit IRC | 01:15 | |
elmiko | alazarev: ping | 01:23 |
*** macjack has joined #openstack-sahara | 01:23 | |
elmiko | alazarev: nvm, figured it out =) | 01:36 |
*** macjack is now known as macjack_awk | 01:36 | |
*** Poornima has joined #openstack-sahara | 02:06 | |
*** Networkn3rd has joined #openstack-sahara | 02:08 | |
*** huichun has quit IRC | 02:12 | |
*** Poornima has quit IRC | 02:51 | |
*** witlessb has joined #openstack-sahara | 02:56 | |
*** Longgeek has joined #openstack-sahara | 03:11 | |
*** Longgeek has quit IRC | 03:15 | |
*** Longgeek has joined #openstack-sahara | 03:15 | |
*** hdd has quit IRC | 03:43 | |
*** hdd has joined #openstack-sahara | 03:43 | |
*** Networkn3rd has quit IRC | 03:52 | |
*** Networkn3rd has joined #openstack-sahara | 03:56 | |
*** chlong has quit IRC | 04:19 | |
*** chlong has joined #openstack-sahara | 04:28 | |
*** hdd has quit IRC | 04:40 | |
*** Networkn3rd has quit IRC | 05:45 | |
*** hdd has joined #openstack-sahara | 05:50 | |
*** coolsvap|afk is now known as coolsvap | 05:57 | |
*** coolsvap is now known as coolsvap|afk | 06:31 | |
*** coolsvap|afk is now known as coolsvap | 06:43 | |
*** macjack_awk has quit IRC | 07:30 | |
*** coolsvap is now known as coolsvap|afk | 07:39 | |
*** chlong has quit IRC | 07:41 | |
*** coolsvap|afk is now known as coolsvap | 07:46 | |
*** hdd has quit IRC | 07:47 | |
*** miqui_ has quit IRC | 07:54 | |
*** sgotliv has quit IRC | 08:03 | |
*** Networkn3rd has joined #openstack-sahara | 08:46 | |
*** Networkn3rd has quit IRC | 08:51 | |
*** sgotliv has joined #openstack-sahara | 08:55 | |
*** DenisEgorenko has joined #openstack-sahara | 09:00 | |
*** sgotliv has quit IRC | 09:02 | |
*** witlessb has joined #openstack-sahara | 09:03 | |
*** coolsvap is now known as coolsvap|afk | 09:10 | |
*** coolsvap|afk is now known as coolsvap | 09:10 | |
*** sgotliv has joined #openstack-sahara | 09:15 | |
*** chlong has joined #openstack-sahara | 09:27 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 10:24 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add refactor to Vanilla 1.2.1 https://review.openstack.org/147448 | 10:45 |
openstackgerrit | Merged openstack/sahara: Remove useless packages from requirements https://review.openstack.org/148261 | 10:55 |
*** huichun__ has quit IRC | 11:02 | |
*** tosky has joined #openstack-sahara | 11:08 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add refactor to Vanilla 1.2.1 https://review.openstack.org/147448 | 11:24 |
*** macjack has joined #openstack-sahara | 11:33 | |
*** macjack has quit IRC | 11:42 | |
*** tellesnobrega_ has quit IRC | 11:42 | |
*** tellesnobrega_ has joined #openstack-sahara | 12:08 | |
*** pcaruana has joined #openstack-sahara | 12:17 | |
openstackgerrit | Evgeny Sikachev proposed openstack/sahara: Add integration test for Hive on vanilla2 https://review.openstack.org/143950 | 12:26 |
*** sgotliv has quit IRC | 12:31 | |
*** sgotliv has joined #openstack-sahara | 12:32 | |
DenisEgorenko | tosky: hi! :-) i've got reply from RedHat about new centos image. They want publish it 4th of Feb. | 12:32 |
tosky | DenisEgorenko: oh, good! | 12:32 |
openstackgerrit | Andrey Pavlov proposed openstack/sahara: Using oslo_* instead of oslo.* https://review.openstack.org/148530 | 12:43 |
*** tellesnobrega has quit IRC | 12:46 | |
*** tellesnobrega has joined #openstack-sahara | 12:52 | |
*** akuznetsov has joined #openstack-sahara | 13:00 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 13:07 |
*** Longgeek has quit IRC | 13:15 | |
*** Longgeek has joined #openstack-sahara | 13:16 | |
*** sgotliv_ has joined #openstack-sahara | 13:18 | |
*** sgotliv has quit IRC | 13:18 | |
*** _crobertsrh has quit IRC | 13:46 | |
*** crobertsrh has joined #openstack-sahara | 13:48 | |
*** Longgeek has quit IRC | 13:57 | |
*** Longgeek has joined #openstack-sahara | 14:04 | |
openstackgerrit | Merged openstack/sahara: Added endpoint and utils to work with events https://review.openstack.org/134504 | 14:05 |
openstackgerrit | Merged openstack/sahara: Add provisioning steps to Direct Engine https://review.openstack.org/143442 | 14:05 |
*** akuznetsov has quit IRC | 14:11 | |
*** tmckay has joined #openstack-sahara | 14:12 | |
*** Networkn3rd has joined #openstack-sahara | 14:45 | |
*** egafford has joined #openstack-sahara | 14:48 | |
openstackgerrit | Artem Osadchiy proposed openstack/sahara-specs: Refactor MapR plugin code https://review.openstack.org/148585 | 14:54 |
openstackgerrit | Merged openstack/sahara-specs: Support multi-worker Sahara API deployment https://review.openstack.org/145601 | 14:56 |
*** tellesnobrega_ has quit IRC | 15:00 | |
*** tosky has quit IRC | 15:00 | |
*** Networkn3rd has quit IRC | 15:00 | |
*** tosky has joined #openstack-sahara | 15:01 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 15:03 |
openstackgerrit | Merged openstack/sahara-specs: Add check service test in integration test https://review.openstack.org/147424 | 15:04 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 15:05 |
*** coolsvap is now known as coolsvap|afk | 15:16 | |
*** Networkn3rd has joined #openstack-sahara | 15:21 | |
openstackgerrit | Merged openstack/sahara-specs: Spark Temporary Job Data Retention and Cleanup https://review.openstack.org/144667 | 15:22 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 15:22 |
*** Longgeek has quit IRC | 15:25 | |
*** Longgeek has joined #openstack-sahara | 15:35 | |
*** Longgeek_ has joined #openstack-sahara | 15:37 | |
*** Longgeek has quit IRC | 15:40 | |
*** Longgeek_ has quit IRC | 15:44 | |
*** Longgeek has joined #openstack-sahara | 15:44 | |
*** Longgeek has quit IRC | 15:49 | |
*** Longgeek has joined #openstack-sahara | 15:50 | |
*** hdd has joined #openstack-sahara | 15:59 | |
*** Longgeek_ has joined #openstack-sahara | 16:13 | |
openstackgerrit | Merged openstack/sahara: Fixed context injection for RPC server https://review.openstack.org/148385 | 16:14 |
*** Longgeek has quit IRC | 16:14 | |
openstackgerrit | Merged openstack/sahara: Enable auto security group when Bug 1392738 is fixed https://review.openstack.org/148116 | 16:14 |
*** Longgeek has joined #openstack-sahara | 16:16 | |
*** Longgeek_ has quit IRC | 16:19 | |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 16:24 |
openstackgerrit | Artem Osadchiy proposed openstack/sahara-specs: Refactor MapR plugin code https://review.openstack.org/148585 | 16:25 |
*** tellesnobrega_ has joined #openstack-sahara | 16:29 | |
*** tellesnobrega_ has quit IRC | 16:39 | |
*** Networkn3rd has quit IRC | 16:51 | |
*** DenisEgorenko has left #openstack-sahara | 16:51 | |
tmckay | elmiko, have you run across a port list for Sahara? I believe I saw one, once upon a time | 16:57 |
elmiko | tmckay: for the controller? | 16:57 |
tmckay | trying to set up a new openstack host, complete with a real firewall | 16:57 |
tmckay | elmiko, yeah | 16:57 |
tmckay | there actually is one in the code, I think | 16:57 |
elmiko | i think you just need 8386 for sahara | 16:57 |
tmckay | sahara is running locally, devstack is on the other host | 16:58 |
tmckay | I had to add a few things -- mariadb (3306), keystone, etc | 16:58 |
tmckay | it's complaining about cinder now | 16:58 |
elmiko | now you're talking about communicating with the rest of the stack | 16:58 |
tmckay | yeah | 16:58 |
elmiko | i would look at `keystone endpoint-list` and take the ports from there | 16:59 |
elmiko | for a start | 16:59 |
tmckay | good call | 16:59 |
elmiko | that won't have things like mariadb or the message queue, but it's a start | 16:59 |
elmiko | you'll also need to configure the routing between the sahara controller and the instances it provisions. that could get messy | 17:00 |
tosky | all in one? | 17:01 |
tmckay | maybe running sahara there would work | 17:01 |
tmckay | tosky, yes, except that sahara is local | 17:01 |
tosky | oh, ok | 17:01 |
tmckay | laptop -> beefy server | 17:01 |
openstackgerrit | Artem Osadchiy proposed openstack/sahara-specs: Refactor MapR plugin code https://review.openstack.org/148585 | 17:03 |
openstackgerrit | Ethan Gafford proposed openstack/sahara-specs: Unified Map to Define Job Interface https://review.openstack.org/144802 | 17:03 |
openstackgerrit | Sergey Reshetnyak proposed openstack/sahara: New integration tests - part 1 https://review.openstack.org/148491 | 17:30 |
tmckay | croberts, elmiko, weird, I just had to do "mysqladmin create saharadb" before I could run the sahara-db-manage upgrade head stuff | 17:51 |
tmckay | first time I remember that | 17:51 |
elmiko | tmckay: yea, i've had to do the same | 17:51 |
*** tnovacik has joined #openstack-sahara | 17:53 | |
openstackgerrit | Merged openstack/sahara: Use pretty-tox for better test output https://review.openstack.org/147563 | 17:59 |
*** coolsvap|afk has quit IRC | 18:00 | |
*** pcaruana has quit IRC | 18:00 | |
*** tnovacik has quit IRC | 18:04 | |
*** chlong has quit IRC | 18:08 | |
*** amcrn has joined #openstack-sahara | 18:11 | |
*** sgotliv_ has quit IRC | 18:22 | |
*** Networkn3rd has joined #openstack-sahara | 18:24 | |
*** Longgeek has quit IRC | 18:26 | |
*** tellesnobrega_ has joined #openstack-sahara | 18:33 | |
*** crobertsrh has quit IRC | 18:41 | |
openstackgerrit | Andrew Lazarev proposed openstack/python-saharaclient: Added ability to pass image_id for node group https://review.openstack.org/148689 | 18:57 |
*** tosky_ has joined #openstack-sahara | 19:07 | |
*** tosky has quit IRC | 19:09 | |
*** akuznetsov has joined #openstack-sahara | 19:11 | |
*** sgotliv has joined #openstack-sahara | 19:17 | |
*** akuznetsov has quit IRC | 19:26 | |
*** tosky_ has quit IRC | 19:29 | |
*** tellesnobrega_ has quit IRC | 19:30 | |
*** akuznetsov has joined #openstack-sahara | 19:35 | |
*** crobertsrh has joined #openstack-sahara | 19:41 | |
*** openstackstatus has joined #openstack-sahara | 19:46 | |
*** ChanServ sets mode: +v openstackstatus | 19:46 | |
-openstackstatus- NOTICE: Gerrit restarted to address likely memory leak leading to server slowness. Sorry if you were caught in the restart | 19:54 | |
jodah | Is there any guidance around spreading hadoop clusters across AZs? I know that Sahara uses host level anti-affinity, but I'm curious why not just span AZs (in case a rack goes down)? | 19:56 |
jodah | I assume rack-level anti-affinity would be preferable to host-level, but in that case we could just span AZs? | 19:59 |
*** Networkn3rd has quit IRC | 20:05 | |
*** tellesnobrega_ has joined #openstack-sahara | 20:11 | |
*** hdd has quit IRC | 20:15 | |
jodah | another: does the HDFS/YARN rack awareness capability basically not work when deploying to openstack? | 20:25 |
*** tellesnobrega_ has quit IRC | 20:27 | |
*** akuznetsov has quit IRC | 20:31 | |
elmiko | jodah: you raise some good questions, i don't know the answers but i would recommend sending an email to the mailing list. | 20:40 |
jodah | to openstack-dev? | 20:40 |
elmiko | jodah: i know some of the mirantis guys know more about the affinity stuff | 20:40 |
elmiko | jodah: yea, openstack-dev and add [sahara] to your subject | 20:41 |
jodah | Thanks. I'm not sure on timezones - are the mirantis guys here at all during the day? | 20:41 |
elmiko | many of the mirantis folks are in russia, so their timezones will be different | 20:42 |
elmiko | but a few of them are in california | 20:42 |
*** tellesnobrega_ has joined #openstack-sahara | 21:22 | |
*** tellesnobrega_ has quit IRC | 21:32 | |
*** tellesnobrega_ has joined #openstack-sahara | 21:45 | |
elmiko | alazarev: in juno, the only options for SSL/TLS on the controller is to setup a proxy? | 21:46 |
alazarev | elmiko, you mean to run sahara on https port? | 21:47 |
alazarev | elmiko, for such case this is the only option | 21:48 |
elmiko | alazarev: yes, that's what i meant | 21:48 |
elmiko | alazarev: thanks | 21:48 |
*** crobertsrh has quit IRC | 22:33 | |
*** egafford has quit IRC | 22:43 | |
*** amcrn has quit IRC | 22:59 | |
jodah | Does sahara create a subnet for each cluster? | 22:59 |
*** hdd has joined #openstack-sahara | 23:04 | |
*** tmckay has left #openstack-sahara | 23:13 | |
elmiko | jodah: you supply the networks during cluster creation | 23:24 |
jodah | makes sense | 23:24 |
*** chlong has joined #openstack-sahara | 23:40 | |
*** chlong has quit IRC | 23:45 | |
*** chlong has joined #openstack-sahara | 23:46 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!