*** mahito has joined #openstack-sahara | 00:05 | |
*** egafford has joined #openstack-sahara | 00:24 | |
*** Longgeek has joined #openstack-sahara | 00:27 | |
*** Longgeek has quit IRC | 01:00 | |
*** jamielennox is now known as jamielennox|away | 01:16 | |
*** Longgeek has joined #openstack-sahara | 01:28 | |
*** Longgeek has quit IRC | 01:28 | |
*** Longgeek has joined #openstack-sahara | 01:30 | |
*** jamielennox|away is now known as jamielennox | 01:31 | |
*** hdd has quit IRC | 01:38 | |
*** egafford has quit IRC | 01:40 | |
*** jamielennox is now known as jamielennox|away | 01:41 | |
*** macjack_afk1 is now known as help | 01:48 | |
*** help is now known as macjack | 01:48 | |
*** Guest7772 has quit IRC | 01:57 | |
*** jamielennox|away is now known as jamielennox | 02:09 | |
*** macjack has quit IRC | 02:15 | |
*** macjack has joined #openstack-sahara | 02:39 | |
*** Poornima has joined #openstack-sahara | 03:37 | |
*** Longgeek has quit IRC | 04:04 | |
*** coolsvap_ is now known as coolsvap | 04:31 | |
*** hdd has joined #openstack-sahara | 04:50 | |
*** coolsvap is now known as coolsvap_ | 05:02 | |
*** coolsvap_ is now known as coolsvap | 05:09 | |
*** devlaps has quit IRC | 05:16 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Refactoring methods for terminating https://review.openstack.org/150778 | 05:23 |
---|---|---|
*** hdd has quit IRC | 05:44 | |
*** mahito has quit IRC | 05:45 | |
*** pcaruana has quit IRC | 05:47 | |
*** coolsvap is now known as coolsvap_ | 05:53 | |
*** coolsvap_ is now known as coolsvap | 06:00 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Imported Translations from Transifex https://review.openstack.org/156482 | 06:16 |
*** mahito has joined #openstack-sahara | 06:31 | |
*** mahito has quit IRC | 06:36 | |
*** mahito has joined #openstack-sahara | 06:49 | |
*** chlong has quit IRC | 08:11 | |
*** witlessb has joined #openstack-sahara | 08:25 | |
*** tmckay has quit IRC | 08:34 | |
*** macjack is now known as macjack_afk | 08:35 | |
*** IvanBerezovskiy has joined #openstack-sahara | 08:37 | |
*** tmckay has joined #openstack-sahara | 08:51 | |
fvollero | howdy :) | 09:11 |
*** skolekonov has joined #openstack-sahara | 09:25 | |
*** sgotliv has joined #openstack-sahara | 09:52 | |
*** tosky has joined #openstack-sahara | 09:54 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 10:01 |
fvollero | I have a question, how I can execute test for hadoop-swift component ? | 10:06 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 10:14 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 10:32 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 11:04 |
*** Poornima has quit IRC | 11:20 | |
*** mahito has quit IRC | 11:38 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 11:43 |
openstackgerrit | Sergey Kolekonov proposed stackforge/sahara-ci-config: Remove ccache during Nodepool snapshot building https://review.openstack.org/156349 | 11:46 |
*** _mattf is now known as mattf | 12:05 | |
openstackgerrit | Andrey Pavlov proposed stackforge/sahara-ci-config: Disabling hive job testing for vanilla 2.6 https://review.openstack.org/156170 | 12:17 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 12:28 |
*** sgotliv has quit IRC | 12:52 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 12:56 |
*** sgotliv has joined #openstack-sahara | 13:02 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 13:30 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 13:31 |
*** tmckay has quit IRC | 13:39 | |
*** hdd has joined #openstack-sahara | 13:42 | |
*** tmckay has joined #openstack-sahara | 13:45 | |
*** _crobertsrh is now known as crobertsrh | 13:47 | |
*** mattf is now known as _mattf | 13:48 | |
*** egafford has joined #openstack-sahara | 13:57 | |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix another event log issue https://review.openstack.org/156598 | 14:06 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Fix another event log issue https://review.openstack.org/156598 | 14:08 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add missing database updates for cluster events https://review.openstack.org/156598 | 14:24 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add missing database updates for cluster events https://review.openstack.org/156598 | 14:25 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log https://review.openstack.org/156528 | 14:46 |
*** hdd has quit IRC | 14:54 | |
*** sgotliv has quit IRC | 14:56 | |
openstackgerrit | Andrey Pavlov proposed openstack/sahara-specs: Spec for adding instance-locality usage https://review.openstack.org/156613 | 15:08 |
*** Networkn3rd has joined #openstack-sahara | 15:21 | |
*** hdd has joined #openstack-sahara | 15:37 | |
*** sgotliv has joined #openstack-sahara | 15:45 | |
*** skolekonov has quit IRC | 16:14 | |
*** hdd has quit IRC | 16:37 | |
*** sgotliv has quit IRC | 16:38 | |
*** coolsvap is now known as coolsvap_ | 16:51 | |
*** hdd has joined #openstack-sahara | 16:55 | |
*** IvanBerezovskiy has left #openstack-sahara | 17:15 | |
*** Networkn3rd has quit IRC | 17:26 | |
*** miqui has quit IRC | 17:37 | |
*** crobertsrh has quit IRC | 17:51 | |
openstackgerrit | Artem Osadchiy proposed openstack/sahara: Refactor MapR plugin for Sahara https://review.openstack.org/147872 | 17:58 |
*** sgotliv has joined #openstack-sahara | 18:21 | |
*** tosky has quit IRC | 18:30 | |
*** devlaps has joined #openstack-sahara | 18:40 | |
*** sgotliv has quit IRC | 18:42 | |
*** sgotliv has joined #openstack-sahara | 18:45 | |
*** devlaps has quit IRC | 18:49 | |
jhalterman | is the is swift HDFS implementation being used by anyone besides Sahara? | 18:51 |
*** crobertsrh has joined #openstack-sahara | 18:59 | |
elmiko | jhalterman: that's a good question | 19:03 |
elmiko | jhalterman: i want to say based on the sourcing of the hadoop-openstack jar, but i really don't know for sure | 19:04 |
jhalterman | alazarev described to me how Swift HDFS attempts to locate object replicas that are local to the same rack that some hadoop task is running on | 19:04 |
jhalterman | when talking to the Swift guys they mentioned that Swift and Nova would not be co-located | 19:05 |
elmiko | that sounds accurate given the data-locality features | 19:05 |
jhalterman | so data locality could not occur | 19:05 |
jhalterman | not sure why they couldn't be co-located, and of course it would depend on the deployment | 19:05 |
elmiko | from my understanding, and i haven't deployed anything with data locality. sahara can be configured to look at topology files which define the rack that swift or nova nodes live in | 19:07 |
elmiko | i'm not sure there is much more to it than that | 19:07 |
jhalterman | ideally swift would be on the same rack | 19:07 |
elmiko | http://docs.openstack.org/developer/sahara/userdoc/features.html is where we talk about the data locality feature in sahara, maybe it will shed more light | 19:08 |
jhalterman | i'm familiar with the stuff. i'm just wondering if what the swift guys say is true for deployments, if locality would ever even be exploited | 19:09 |
elmiko | i imagine it would depend on the deployment | 19:09 |
elmiko | i don't see why you couldn't put nova and swift nodes in the same rack | 19:09 |
elmiko | maybe they interpret co-locality to mean something different? | 19:10 |
*** tmckay has left #openstack-sahara | 19:14 | |
jhalterman | yea i dunno | 19:19 |
*** openstackgerrit has quit IRC | 19:20 | |
*** openstackgerrit has joined #openstack-sahara | 19:20 | |
elmiko | jhalterman: i really think it depends on the intent behind an openstack installation. i mean if the swift guys are saying that they wouldn't normally co-locate swift and nova nodes on the same rack, that's one thing. if they are saying you _can't_ co-locate that something different. | 19:23 |
elmiko | if i were deploying openstack with the intent of maximum data processing performance, then i would expect that i'd need to co-locate some of those resources. | 19:23 |
jhalterman | agree | 19:23 |
*** tmckay has joined #openstack-sahara | 19:32 | |
*** sgotliv has quit IRC | 19:46 | |
*** tmckay has quit IRC | 19:47 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Implemented multi-worker solution for Sahara API https://review.openstack.org/146661 | 19:47 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: New integration tests - base functional https://review.openstack.org/148491 | 19:54 |
openstackgerrit | Vitaly Gridnev proposed openstack/sahara: New integration tests - scaling https://review.openstack.org/148935 | 19:57 |
*** tmckay has joined #openstack-sahara | 20:03 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Allow placeholders in datasource URLs https://review.openstack.org/150640 | 20:05 |
*** sgotliv has joined #openstack-sahara | 20:05 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Added periodic clean up of old inactive clusters https://review.openstack.org/151833 | 20:09 |
*** crobertsrh has quit IRC | 20:09 | |
*** crobertsrh has joined #openstack-sahara | 20:10 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Minor - Added missing check for 'Deleting' state https://review.openstack.org/155861 | 20:18 |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Decompose cluster template for Heat https://review.openstack.org/155934 | 20:32 |
*** amcrn has joined #openstack-sahara | 20:32 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements https://review.openstack.org/156756 | 20:41 |
*** akuznetsov has joined #openstack-sahara | 20:49 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language https://review.openstack.org/155928 | 21:16 |
jhalterman | I just sent a pair of messages to openstack-dev to hopefully spark a conversation around improving Nova and Swift resource placement, particularly for Sahara. alazarev and others, feel free to chime in on those discussions as they (hopefully) develop. | 21:27 |
elmiko | jhalterman: very cool, thanks | 21:27 |
alazarev | jhalterman, thanks | 21:27 |
*** akuznetsov has quit IRC | 21:28 | |
*** jhalterman is now known as jodah | 21:30 | |
openstackgerrit | Merged openstack/sahara-specs: Implement timeouts for polling process https://review.openstack.org/155312 | 21:39 |
openstackgerrit | Trevor McKay proposed openstack/sahara-specs: [EDP] Add Oozie Shell Action job type https://review.openstack.org/156795 | 22:02 |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language https://review.openstack.org/155928 | 22:08 |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Minor - Added missing check for 'Deleting' state https://review.openstack.org/155861 | 22:09 |
*** crobertsrh has quit IRC | 22:10 | |
openstackgerrit | Trevor McKay proposed openstack/sahara-specs: [EDP] Add Oozie Shell Action job type https://review.openstack.org/156795 | 22:11 |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language https://review.openstack.org/155928 | 22:22 |
openstackgerrit | Merged openstack/sahara: Add missing database updates for cluster events https://review.openstack.org/156598 | 22:22 |
*** egafford has quit IRC | 22:25 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: Decompose cluster template for Heat https://review.openstack.org/155934 | 22:28 |
openstackgerrit | Merged openstack/sahara: Add option to disable event log https://review.openstack.org/156230 | 22:43 |
*** Networkn3rd has joined #openstack-sahara | 22:44 | |
*** egafford has joined #openstack-sahara | 23:00 | |
*** chlong has joined #openstack-sahara | 23:08 | |
*** Networkn3rd has quit IRC | 23:26 | |
*** Networkn3rd has joined #openstack-sahara | 23:28 | |
*** Networkn3rd has quit IRC | 23:32 | |
openstackgerrit | Andrew Lazarev proposed openstack/sahara: Reorganized heat template generation code https://review.openstack.org/156841 | 23:33 |
openstackgerrit | Merged openstack/sahara: Updated from global requirements https://review.openstack.org/156756 | 23:40 |
*** witlessb has quit IRC | 23:50 | |
*** amcrn has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!