Tuesday, 2015-02-17

*** mahito has joined #openstack-sahara00:05
*** egafford has joined #openstack-sahara00:24
*** Longgeek has joined #openstack-sahara00:27
*** Longgeek has quit IRC01:00
*** jamielennox is now known as jamielennox|away01:16
*** Longgeek has joined #openstack-sahara01:28
*** Longgeek has quit IRC01:28
*** Longgeek has joined #openstack-sahara01:30
*** jamielennox|away is now known as jamielennox01:31
*** hdd has quit IRC01:38
*** egafford has quit IRC01:40
*** jamielennox is now known as jamielennox|away01:41
*** macjack_afk1 is now known as help01:48
*** help is now known as macjack01:48
*** Guest7772 has quit IRC01:57
*** jamielennox|away is now known as jamielennox02:09
*** macjack has quit IRC02:15
*** macjack has joined #openstack-sahara02:39
*** Poornima has joined #openstack-sahara03:37
*** Longgeek has quit IRC04:04
*** coolsvap_ is now known as coolsvap04:31
*** hdd has joined #openstack-sahara04:50
*** coolsvap is now known as coolsvap_05:02
*** coolsvap_ is now known as coolsvap05:09
*** devlaps has quit IRC05:16
openstackgerritVitaly Gridnev proposed openstack/sahara: Refactoring methods for terminating  https://review.openstack.org/15077805:23
*** hdd has quit IRC05:44
*** mahito has quit IRC05:45
*** pcaruana has quit IRC05:47
*** coolsvap is now known as coolsvap_05:53
*** coolsvap_ is now known as coolsvap06:00
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/15648206:16
*** mahito has joined #openstack-sahara06:31
*** mahito has quit IRC06:36
*** mahito has joined #openstack-sahara06:49
*** chlong has quit IRC08:11
*** witlessb has joined #openstack-sahara08:25
*** tmckay has quit IRC08:34
*** macjack is now known as macjack_afk08:35
*** IvanBerezovskiy has joined #openstack-sahara08:37
*** tmckay has joined #openstack-sahara08:51
fvollerohowdy :)09:11
*** skolekonov has joined #openstack-sahara09:25
*** sgotliv has joined #openstack-sahara09:52
*** tosky has joined #openstack-sahara09:54
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652810:01
fvolleroI have a question, how I can execute test for hadoop-swift component ?10:06
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652810:14
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652810:32
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652811:04
*** Poornima has quit IRC11:20
*** mahito has quit IRC11:38
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652811:43
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Remove ccache during Nodepool snapshot building  https://review.openstack.org/15634911:46
*** _mattf is now known as mattf12:05
openstackgerritAndrey Pavlov proposed stackforge/sahara-ci-config: Disabling hive job testing for vanilla 2.6  https://review.openstack.org/15617012:17
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652812:28
*** sgotliv has quit IRC12:52
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652812:56
*** sgotliv has joined #openstack-sahara13:02
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652813:30
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652813:31
*** tmckay has quit IRC13:39
*** hdd has joined #openstack-sahara13:42
*** tmckay has joined #openstack-sahara13:45
*** _crobertsrh is now known as crobertsrh13:47
*** mattf is now known as _mattf13:48
*** egafford has joined #openstack-sahara13:57
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix another event log issue  https://review.openstack.org/15659814:06
openstackgerritVitaly Gridnev proposed openstack/sahara: Fix another event log issue  https://review.openstack.org/15659814:08
openstackgerritVitaly Gridnev proposed openstack/sahara: Add missing database updates for cluster events  https://review.openstack.org/15659814:24
openstackgerritVitaly Gridnev proposed openstack/sahara: Add missing database updates for cluster events  https://review.openstack.org/15659814:25
openstackgerritVitaly Gridnev proposed openstack/sahara: Add check to integration tests to check event-log  https://review.openstack.org/15652814:46
*** hdd has quit IRC14:54
*** sgotliv has quit IRC14:56
openstackgerritAndrey Pavlov proposed openstack/sahara-specs: Spec for adding instance-locality usage  https://review.openstack.org/15661315:08
*** Networkn3rd has joined #openstack-sahara15:21
*** hdd has joined #openstack-sahara15:37
*** sgotliv has joined #openstack-sahara15:45
*** skolekonov has quit IRC16:14
*** hdd has quit IRC16:37
*** sgotliv has quit IRC16:38
*** coolsvap is now known as coolsvap_16:51
*** hdd has joined #openstack-sahara16:55
*** IvanBerezovskiy has left #openstack-sahara17:15
*** Networkn3rd has quit IRC17:26
*** miqui has quit IRC17:37
*** crobertsrh has quit IRC17:51
openstackgerritArtem Osadchiy proposed openstack/sahara: Refactor MapR plugin for Sahara  https://review.openstack.org/14787217:58
*** sgotliv has joined #openstack-sahara18:21
*** tosky has quit IRC18:30
*** devlaps has joined #openstack-sahara18:40
*** sgotliv has quit IRC18:42
*** sgotliv has joined #openstack-sahara18:45
*** devlaps has quit IRC18:49
jhaltermanis the is swift HDFS implementation being used by anyone besides Sahara?18:51
*** crobertsrh has joined #openstack-sahara18:59
elmikojhalterman: that's a good question19:03
elmikojhalterman: i want to say based on the sourcing of the hadoop-openstack jar, but i really don't know for sure19:04
jhaltermanalazarev described to me how Swift HDFS attempts to locate object replicas that are local to the same rack that some hadoop task is running on19:04
jhaltermanwhen talking to the Swift guys they mentioned that Swift and Nova would not be co-located19:05
elmikothat sounds accurate given the data-locality features19:05
jhaltermanso data locality could not occur19:05
jhaltermannot sure why they couldn't be co-located, and of course it would depend on the deployment19:05
elmikofrom my understanding, and i haven't deployed anything with data locality. sahara can be configured to look at topology files which define the rack that swift or nova nodes live in19:07
elmikoi'm not sure there is much more to it than that19:07
jhaltermanideally swift would be on the same rack19:07
elmikohttp://docs.openstack.org/developer/sahara/userdoc/features.html is where we talk about the data locality feature in sahara, maybe it will shed more light19:08
jhaltermani'm familiar with the stuff. i'm just wondering if what the swift guys say is true for deployments, if locality would ever even be exploited19:09
elmikoi imagine it would depend on the deployment19:09
elmikoi don't see why you couldn't put nova and swift nodes in the same rack19:09
elmikomaybe they interpret co-locality to mean something different?19:10
*** tmckay has left #openstack-sahara19:14
jhaltermanyea i dunno19:19
*** openstackgerrit has quit IRC19:20
*** openstackgerrit has joined #openstack-sahara19:20
elmikojhalterman: i really think it depends on the intent behind an openstack installation. i mean if the swift guys are saying that they wouldn't normally co-locate swift and nova nodes on the same rack, that's one thing. if they are saying you _can't_ co-locate that something different.19:23
elmikoif i were deploying openstack with the intent of maximum data processing performance, then i would expect that i'd need to co-locate some of those resources.19:23
jhaltermanagree19:23
*** tmckay has joined #openstack-sahara19:32
*** sgotliv has quit IRC19:46
*** tmckay has quit IRC19:47
openstackgerritAndrew Lazarev proposed openstack/sahara: Implemented multi-worker solution for Sahara API  https://review.openstack.org/14666119:47
openstackgerritVitaly Gridnev proposed openstack/sahara: New integration tests - base functional  https://review.openstack.org/14849119:54
openstackgerritVitaly Gridnev proposed openstack/sahara: New integration tests - scaling  https://review.openstack.org/14893519:57
*** tmckay has joined #openstack-sahara20:03
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Allow placeholders in datasource URLs  https://review.openstack.org/15064020:05
*** sgotliv has joined #openstack-sahara20:05
openstackgerritAndrew Lazarev proposed openstack/sahara: Added periodic clean up of old inactive clusters  https://review.openstack.org/15183320:09
*** crobertsrh has quit IRC20:09
*** crobertsrh has joined #openstack-sahara20:10
openstackgerritAndrew Lazarev proposed openstack/sahara: Minor - Added missing check for 'Deleting' state  https://review.openstack.org/15586120:18
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Decompose cluster template for Heat  https://review.openstack.org/15593420:32
*** amcrn has joined #openstack-sahara20:32
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/15675620:41
*** akuznetsov has joined #openstack-sahara20:49
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language  https://review.openstack.org/15592821:16
jhaltermanI just sent a pair of messages to openstack-dev to hopefully spark a conversation around improving Nova and Swift resource placement, particularly for Sahara. alazarev and others, feel free to chime in on those discussions as they (hopefully) develop.21:27
elmikojhalterman: very cool, thanks21:27
alazarevjhalterman, thanks21:27
*** akuznetsov has quit IRC21:28
*** jhalterman is now known as jodah21:30
openstackgerritMerged openstack/sahara-specs: Implement timeouts for polling process  https://review.openstack.org/15531221:39
openstackgerritTrevor McKay proposed openstack/sahara-specs: [EDP] Add Oozie Shell Action job type  https://review.openstack.org/15679522:02
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language  https://review.openstack.org/15592822:08
openstackgerritAndrew Lazarev proposed openstack/sahara: Minor - Added missing check for 'Deleting' state  https://review.openstack.org/15586122:09
*** crobertsrh has quit IRC22:10
openstackgerritTrevor McKay proposed openstack/sahara-specs: [EDP] Add Oozie Shell Action job type  https://review.openstack.org/15679522:11
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Migrate to HEAT HOT language  https://review.openstack.org/15592822:22
openstackgerritMerged openstack/sahara: Add missing database updates for cluster events  https://review.openstack.org/15659822:22
*** egafford has quit IRC22:25
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Decompose cluster template for Heat  https://review.openstack.org/15593422:28
openstackgerritMerged openstack/sahara: Add option to disable event log  https://review.openstack.org/15623022:43
*** Networkn3rd has joined #openstack-sahara22:44
*** egafford has joined #openstack-sahara23:00
*** chlong has joined #openstack-sahara23:08
*** Networkn3rd has quit IRC23:26
*** Networkn3rd has joined #openstack-sahara23:28
*** Networkn3rd has quit IRC23:32
openstackgerritAndrew Lazarev proposed openstack/sahara: Reorganized heat template generation code  https://review.openstack.org/15684123:33
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/15675623:40
*** witlessb has quit IRC23:50
*** amcrn has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!