Tuesday, 2015-03-03

« Monday, 2015-03-02 Index Wednesday, 2015-03-04 »
*** hdd has quit IRC00:08
*** mahito has joined #openstack-sahara00:10
*** chlong has quit IRC00:15
*** witlessb has quit IRC00:20
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/16057400:22
*** hdd has joined #openstack-sahara00:53
*** Longgeek has joined #openstack-sahara01:57
*** malini1 has quit IRC02:18
*** hdd has quit IRC02:44
*** Longgeek has quit IRC03:02
*** Longgeek has joined #openstack-sahara03:15
*** hdd has joined #openstack-sahara04:05
*** Longgeek has quit IRC04:06
*** Longgeek has joined #openstack-sahara04:18
*** hdd has quit IRC04:34
*** coolsvap_ is now known as coolsvap04:37
*** Networkn3rd has quit IRC04:41
*** Networkn3rd has joined #openstack-sahara04:42
*** Networkn3rd has quit IRC04:46
*** hdd has joined #openstack-sahara05:02
*** hdd has quit IRC05:08
*** hdd has joined #openstack-sahara05:09
*** akuznetsov has joined #openstack-sahara05:19
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Rewrite log levels and messages  https://review.openstack.org/15403705:43
*** chandankumar has joined #openstack-sahara06:14
*** Poornima has joined #openstack-sahara06:15
*** hdd has quit IRC06:25
*** Poornima has quit IRC06:29
*** Poornima has joined #openstack-sahara06:32
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Rewrite log levels and messages  https://review.openstack.org/15403706:47
*** openstackgerrit has quit IRC07:22
*** openstackgerrit has joined #openstack-sahara07:22
*** akuznetsov has quit IRC07:38
*** sgotliv has quit IRC07:39
openstackgerritlu huichun proposed openstack/sahara: Add Sentry service test in cdh plugin integration test  https://review.openstack.org/15791507:41
openstackgerritweiting-chen proposed openstack/sahara: Add Impala service test in cdh plugin integration test  https://review.openstack.org/15193408:18
*** chandankumar has quit IRC08:26
*** akuznetsov has joined #openstack-sahara08:27
*** chandankumar has joined #openstack-sahara08:32
openstackgerritNikolay Starodubtsev proposed openstack/sahara-image-elements: Add update script for yum based images  https://review.openstack.org/15534708:38
openstackgerritMerged stackforge/sahara-ci-config: Migrate jobs to new integrations tests config  https://review.openstack.org/15530108:38
*** witlessb has joined #openstack-sahara08:49
*** skolekonov has joined #openstack-sahara08:50
*** akuznetsov has quit IRC09:05
openstackgerritMerged openstack/sahara: Add Impala support for MapR plugin  https://review.openstack.org/14811409:18
*** sgotliv has joined #openstack-sahara09:24
*** mahito has quit IRC09:40
*** mahito has joined #openstack-sahara09:49
*** coolsvap is now known as coolsvap_09:52
*** AndreyPavlov has quit IRC09:53
*** Longgeek has quit IRC10:01
openstackgerritVitaly Gridnev proposed openstack/sahara: Implement poll util and plugin poll util  https://review.openstack.org/15739210:06
*** chandankumar_ has joined #openstack-sahara10:30
*** chandankumar has quit IRC10:33
openstackgerritAndrey Pavlov proposed openstack/sahara: Added volume_local_to_instance field support  https://review.openstack.org/16073010:41
*** Longgeek has joined #openstack-sahara10:41
*** Longgeek has quit IRC10:43
*** Longgeek has joined #openstack-sahara10:44
openstackgerritEvgeny Sikachev proposed openstack/sahara: Refactoring methods for terminating  https://review.openstack.org/15077810:52
openstackgerritEvgeny Sikachev proposed openstack/sahara: Refactoring methods for terminating  https://review.openstack.org/15077810:54
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding cluster, instance, job_execution ids to logs  https://review.openstack.org/14396410:55
openstackgerritAndrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication  https://review.openstack.org/14750411:02
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/16057411:02
*** tosky has joined #openstack-sahara11:03
*** coolsvap_ is now known as coolsvap11:17
openstackgerritEvgeny Sikachev proposed openstack/sahara: Refactoring methods for terminating  https://review.openstack.org/15077811:19
*** tellesnobrega has quit IRC11:27
*** mahito has quit IRC11:30
*** tellesnobrega has joined #openstack-sahara11:33
*** Longgeek has quit IRC11:58
*** Poornima has quit IRC12:06
openstackgerritDenis Egorenko proposed stackforge/sahara-ci-config: Temporary workaround for cluster exceeds max limit 64 chars  https://review.openstack.org/16076612:22
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of plugin poll - part 1  https://review.openstack.org/16076912:30
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of plugin poll - part 1  https://review.openstack.org/16076912:39
*** Longgeek has joined #openstack-sahara12:43
*** AndreyPavlov has joined #openstack-sahara12:47
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of plugin poll - part 1  https://review.openstack.org/16076913:05
*** tnovacik has joined #openstack-sahara13:09
openstackgerritAndrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication  https://review.openstack.org/14750413:34
*** hdd has joined #openstack-sahara13:38
*** tmckay has joined #openstack-sahara13:44
openstackgerritAndrey Pavlov proposed openstack/python-saharaclient: Added support of instance locality  https://review.openstack.org/16079513:47
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Rewrite log levels and messages  https://review.openstack.org/15403713:55
*** tnovacik has quit IRC13:55
*** akuznetsov has joined #openstack-sahara13:55
*** tnovacik has joined #openstack-sahara13:56
*** sreshetnyak has joined #openstack-sahara14:00
openstackgerritAndrey Pavlov proposed openstack/sahara: Fixing log messages to avoid information duplication  https://review.openstack.org/14750414:02
*** hdd has quit IRC14:12
*** _crobertsrh is now known as crobertsrh14:17
*** chlong has joined #openstack-sahara14:27
openstackgerritTrevor McKay proposed openstack/sahara: Add validation for node group templates update  https://review.openstack.org/16081414:30
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of plugin poll - part 1  https://review.openstack.org/16081814:39
openstackgerritVitaly Gridnev proposed openstack/sahara: Add usages of plugin poll - part 2  https://review.openstack.org/16081814:41
*** coolsvap is now known as coolsvap_14:43
*** chandankumar_ has quit IRC14:43
*** hdd has joined #openstack-sahara14:54
openstackgerritMerged openstack/sahara: Adding ability to edit cluster templates  https://review.openstack.org/15746015:00
*** sgotliv has quit IRC15:00
*** egafford has joined #openstack-sahara15:10
crobertsrhtmckay:  Isn't oozie supposed to be required to start a cluster?15:12
crobertsrhHmm, maybe not, I guess.  Nevermind :)15:14
*** khuss has joined #openstack-sahara15:14
toskycrobertsrh: I thought it is for != vanilla15:14
crobertsrhRight...I just accidentally started up a vanilla cluster without oozie.15:14
*** Suprith has joined #openstack-sahara15:15
khusshello .. i'm not able to get the sahara cluster up when I use cinder for volume storage.. I'm using the latest sahara version on icehouse.15:15
crobertsrhI thought it was required, but looking at the code, I can see that it isn't.15:15
toskyyou can't probably execute jobs then15:16
crobertsrhtosky:  we shall see :)15:16
tosky(pending confirmation)15:16
crobertsrhwe'll see how smart the EDP stuff is :)15:16
khussI get following error in the sahara-api log file - ThreadException: An error occurred in thread 'attach-volumes-for-ng-vanilla-master': An error occurred in thread 'attach-volumes-for-instance-vanilla-cluster-one-vanilla-master-001': The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-fecccea6-c850-4b16-90c7-ff802edaefe4)15:18
toskycrobertsrh: for the record :P https://bugs.launchpad.net/sahara/+bug/129164915:19
openstackLaunchpad bug 1291649 in Sahara "[Validation] job_execute must check that cluster includes oozie process" [Medium,Fix released] - Assigned to Alexander Ignatov (aignatov)15:19
aignatovwow15:19
toskykhuss: is it the issue we discussed few days ago?15:19
aignatovlaunchpad poked me15:19
toskyaignatov: oh, sorry, it's a fixed bug15:19
aignatovtosky: no prob :)15:19
khusstosky: it is the same issue but I updated to the most recent version of sahara as you suggested15:20
khusstosky: but I still face the same problem15:20
toskyuh15:20
toskyI'm pretty sure I was able to run clusters with volumes attached (vanilla2 and hdp2)15:20
elmikodoes the latest sahara have full compatiblity with an icehouse stack?15:22
openstackgerritEthan Gafford proposed openstack/sahara: [EDP] Add Oozie Shell Job Type  https://review.openstack.org/15992015:23
toskyelmiko: I have no idea, I was wondering about it; what component/changes could have broken the compatibility?15:28
elmikotosky: yea, not sure. i remember there were some patches surrounding mounting/attaching cinder volumes, but i wasn't directly involved.15:29
elmikomakes me wonder if we had any bugs that were found in heat/cinder that might affect as well15:30
elmikokhuss: do you have debug logging enabled on sahara?15:30
khusselmiko: yes. I've the debug logging enabled15:31
egaffordcrobertsrh, tmckay: Hi guys. On the Shell Action review, Chad is suggesting (validly) that we add back the precondition about the cluster needing Oozie (because it's possible to field a cluster without Oozie.)15:31
egaffordTrevor earlier suggested (validly) that we remove it earlier (because that requirement isn't specific to Shell jobs within EDP Hadoop, and because we hope to implement shell actions on other engines.)15:31
egaffordI don't have a strong feeling here either way. Which way do we want to go?15:31
tmckaycrobertsrh, oops, my volume was turned down.  No, Oozie is required for certain plugin types if you want EDP15:31
khusselmiko: here is the full log: 2015-03-02 23:32:04.300 19863 WARNING sahara.service.engine [-] Can't start cluster 'vanilla-cluster-one' (reason: An error occurred in thread 'attach-volumes-for-ng-vanilla-master': An error occurred in thread 'attach-volumes-for-instance-vanilla-cluster-one-vanilla-master-001': The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-fecccea615:32
crobertsrhOk, I'm ok with it then.15:32
tmckayegafford, crobertsrh, hmmm.  Well we have two different cases15:32
tmckayFor instance, I can make the Spark EDP engine support Shell jobs15:32
khusselmiko: 2015-03-02 23:32:04.300 19863 WARNING sahara.service.engine [-] Can't start cluster 'vanilla-cluster-one' (reason: An error occurred in thread 'attach-volumes-for-ng-vanilla-master': An error occurred in thread 'attach-volumes-for-instance-vanilla-cluster-one-vanilla-master-001': The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-fecccea6-c850-4b16-90c7-ff802e15:32
tmckayno oozie required15:32
egaffordtmckay: Ack; definitely.15:32
khusselmiko: sorry it is not pasting the full log15:33
elmikokhuss: no worries, maybe use paste.openstack.org15:33
toskyelmiko: this seems to be the same error: https://bugs.launchpad.net/sahara/+bug/1326021 as I mentioned to khuss few days ago15:33
openstackLaunchpad bug 1326021 in Sahara "Failed to provision cluster with cinder volumes" [Medium,Fix released] - Assigned to Andrew Lazarev (alazarev)15:33
tmckaySo, the Spark plugin can support shell.  It's really a function of where the job will run, and whether the cluster has enough services to support the EDP engine allocated by the plugin15:33
khusselmiko: http://pastebin.com/j8em0PqK15:33
elmikokhuss: i'm curious if the exception trace got captured15:33
khusselmiko: please see the pastebin15:33
elmikokhuss: yup, looking15:34
elmikokhuss: is your sahara able to create cluster with ephemeral drives?15:35
khusselmiko: yes15:35
elmikokhuss: i wonder if the cinder logs show anything surrounding this transaction?15:36
khusselmiko: with cinder, I can see the volume getting attached correctly15:36
elmikohmm, highly odd15:36
khusselmiko: however, /dev/vdb is not getting mouted.. VM comes up on /dev/vda1 .. also there is a message on the console15:37
khusselmiko: vdb: invalid partition table15:37
elmikokhuss: is this an extra volume (non-root) that is getting attached?15:37
khusselmiko: is the VM supposed to come up on an ephemeral partition and then mount vdb15:37
khusselmiko: yes.. it is getting attached to the VM but not getting mounted15:37
elmikokhuss: i'm not exactly sure, it seems odd though15:37
elmikokhuss: what version of sahara, my sources are out of sync with that stack trace15:39
khusselmiko: latest stable version of icehouse15:40
elmikok15:41
elmikokhuss: i wonder if it's just timing out?15:43
khusselmiko: it is timeout in 5 minutes but I can see the VMs are already up15:44
elmikokhuss: i'm really not sure why that volume comes back with an invalid partition table either15:45
toskyare those some kind of special cinder volumes? I mean, is the cinder configuration something special or the out-of-the-box one?15:47
*** skolekonov has quit IRC15:49
openstackgerritMerged openstack/sahara-image-elements: Install openjdk-jdk instead openjdk-jre for Ubuntu  https://review.openstack.org/16033715:50
*** crobertsrh has quit IRC15:51
khusstosky: no they are normal cinder volumes15:55
openstackgerritTrevor McKay proposed openstack/sahara: Add validation for node group templates update  https://review.openstack.org/16081415:56
*** ekarlso has quit IRC16:03
*** ekarlso has joined #openstack-sahara16:08
jodahgeneral question - does sahara's HDFS require that sahara be deployed alongside swift proxy nodes? i think remember alazarev saying so, but i can't recall16:21
jodahor is it just Swift HDFS that gets deployed on the swift nodes?16:21
SergeyLukjanovjodah, there is no such requirement16:22
SergeyLukjanovjodah, Swift FS for Hadoop works ok with dedicated Swift as well16:22
SergeyLukjanovjodah, for Hadoop 1 Swift and Hadoop DataNodes could be collocated to use data locality feature, but it's only for Hadoop 116:23
jodahwhy only for hadoop 1?16:23
jodahSergeyLukjanov Since Swift HDFS uses the Swift middleware to access the /endpoints call, is there any deployment requirement?16:25
jodah...to be able to use the middleware16:25
SergeyLukjanovsreshetnyak, could add details about it16:25
jodahsreshetnyak Does Swift HDFs need to be deployed in a certain place in order to use the middleware?16:26
sreshetnyakhadoop-openstack library doesn't support data locality for swift16:33
sreshetnyakwe use hadoop-openstack library from hadoop distro for Hadoop 216:34
sreshetnyakfor Hadoop 1 we use hadoop-openstack library from sahara-extra16:35
sreshetnyaklibrary in sahara-extra supports data-locality for swift16:35
jodahwhat is missing from hadoop-openstack?16:36
jodahsreshetnyak16:36
sreshetnyakfor hadoop 2?16:36
*** sgotliv has joined #openstack-sahara16:46
*** tnovacik has quit IRC16:48
tmckaySergeyLukjanov, ping16:53
tellesnobregahey, does scale-cluster via python-saharaclient work?17:03
tellesnobregaim getting Failed to parse response17:04
tellesnobregaim not sure if it is sahara or catalog17:04
tmckaytellesnobrega, hmm, I think cluster scale may be missing as an operation in the client still17:04
tellesnobregatmckay, actually i'm trying to list cluster as well and i get the same exception17:06
tmckaytellesnobrega, hmm, not a known issue for me17:07
tellesnobregatmckay, did the data_processing to data-processing has already taken place? it could be a problem if part is already in and missing others17:08
tmckayI see one open for devstack and one open for tempest17:09
tellesnobregathe saharaclient is in17:10
tellesnobregaand also sahara17:10
tellesnobregasince i started a devstack it configures it to use data_processing17:11
tellesnobregaand client is looking for data-processing i guess17:11
*** Longgeek has quit IRC17:12
*** chlong has quit IRC17:17
*** Longgeek has joined #openstack-sahara17:18
*** Longgeek has quit IRC17:21
*** akuznetsov has quit IRC17:23
jodahsreshetnyak SergeyLukjanov Data locality assumes that Swift and Nova are deployed on the same rack, correct?17:31
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Use openjdk by default for java element  https://review.openstack.org/15947317:36
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Migrate to openjdk - part 2  https://review.openstack.org/14643417:36
*** IBerezovskiy has quit IRC17:37
*** tellesnobrega has quit IRC17:43
*** khuss has quit IRC17:43
*** crobertsrh has joined #openstack-sahara17:46
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/16057417:47
openstackgerritTrevor McKay proposed openstack/sahara: Add an is_default field to cluster templates and node group templates  https://review.openstack.org/16092017:56
*** chandankumar has joined #openstack-sahara17:58
*** crobertsrh has quit IRC18:03
*** chen12 has quit IRC18:04
*** tellesnobrega has joined #openstack-sahara18:04
openstackgerritNikolay Starodubtsev proposed openstack/sahara: Rewrite log levels and messages  https://review.openstack.org/15403718:04
*** tnovacik has joined #openstack-sahara18:05
sreshetnyakjodah, yes18:20
*** crobertsrh has joined #openstack-sahara18:35
*** tnovacik has quit IRC18:44
openstackgerritTrevor McKay proposed openstack/sahara: Add validation for cluster templates update  https://review.openstack.org/16093918:53
*** chandankumar has quit IRC19:23
egaffordIs there ever a valid case in which a cluster template is useful without nodegroups? It is currently permitted, and I can't imagine a case in which that's good, but it's possible my imagination is at fault.19:30
elmikogood question, off the top of my head i can't think of a reason. but that doesn't mean a reason doesn't exist ;)19:31
egaffordelmiko: Yeah, universal negatives are tough that way. :)19:32
elmikolol so true19:33
egaffordI'll wait a bit to see if anyone chimes in and then file a bug. Thanks elmiko.19:33
*** fvollero has quit IRC19:36
*** tosky_ has joined #openstack-sahara19:36
*** tosky has quit IRC19:37
*** fvollero has joined #openstack-sahara19:38
*** tosky__ has joined #openstack-sahara19:41
*** tosky__ has quit IRC19:41
*** tosky_ has quit IRC19:42
*** tnovacik has joined #openstack-sahara20:01
openstackgerritEthan Gafford proposed openstack/sahara-specs: [EDP] Add Spark Shell Action job type  https://review.openstack.org/16097220:44
openstackgerritMerged openstack/sahara: Provide ability to get events directly from cluster  https://review.openstack.org/15913121:25
egaffordelmiko: Note from earlier: https://bugs.launchpad.net/sahara/+bug/120219421:35
openstackLaunchpad bug 1202194 in Sahara "create cluster with empty node groups" [Low,Invalid] - Assigned to Nikita Konovalov (nkonovalov)21:35
egaffordelmiko: That issue (cluster creation w/o node groups) was reported and deemed invalid because ngs can be specified at cluster launch time.21:36
elmikoegafford: ok, cool. now we know =)21:37
*** tmckay has quit IRC22:01
*** crobertsrh has quit IRC22:02
*** egafford has quit IRC22:38
*** openstackgerrit has quit IRC22:51
*** openstackgerrit has joined #openstack-sahara22:51
*** tnovacik has quit IRC23:18
*** chlong has joined #openstack-sahara23:31
« Monday, 2015-03-02 Index Wednesday, 2015-03-04 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!