Tuesday, 2015-09-15

*** larainema has joined #openstack-sahara00:24
*** lvdongbing has joined #openstack-sahara00:29
*** hdd has joined #openstack-sahara01:30
*** dave-mccowan has quit IRC01:40
*** EinstCrazy has joined #openstack-sahara01:47
*** witlessb has joined #openstack-sahara01:56
*** witlessb has quit IRC02:01
*** dave-mccowan has joined #openstack-sahara02:13
*** dave-mccowan has quit IRC02:17
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/22193702:27
*** hdd has quit IRC02:30
*** dave-mccowan has joined #openstack-sahara03:14
*** dave-mccowan has quit IRC03:18
openstackgerritlvdongbing proposed openstack/sahara: Warn vanilla 2.6.0 instead of raising exception  https://review.openstack.org/22338603:30
*** hdd has joined #openstack-sahara03:44
*** ldb_ has joined #openstack-sahara03:47
*** lvdongbing has quit IRC03:49
*** david-lyle has joined #openstack-sahara03:50
*** hdd has quit IRC03:54
*** hdd has joined #openstack-sahara03:57
*** hdd has quit IRC04:06
*** dave-mccowan has joined #openstack-sahara04:15
*** hdd has joined #openstack-sahara04:15
*** dave-mccowan has quit IRC04:19
*** ldb__ has joined #openstack-sahara05:04
*** ldb_ has quit IRC05:04
*** coolsvap has joined #openstack-sahara05:16
*** dave-mccowan has joined #openstack-sahara05:16
*** hdd has quit IRC05:20
*** dave-mccowan has quit IRC05:20
*** ashishb has joined #openstack-sahara05:49
*** manas has joined #openstack-sahara05:52
openstackgerritlvdongbing proposed openstack/sahara: Warn vanilla 2.6.0 instead of raising exception  https://review.openstack.org/22338606:07
*** egafford has quit IRC06:11
*** macjack has joined #openstack-sahara06:12
*** coolsvap_ has joined #openstack-sahara06:24
*** htruta has quit IRC06:44
*** htruta has joined #openstack-sahara06:48
*** coolsvap_ has quit IRC06:49
*** sgotliv_ has joined #openstack-sahara07:11
*** sgotliv_ has quit IRC07:23
*** macjack has quit IRC07:23
*** witlessb has joined #openstack-sahara07:47
*** sgotliv_ has joined #openstack-sahara08:08
*** sgotliv_ has quit IRC08:16
*** tosky has joined #openstack-sahara09:00
*** vgridnev has joined #openstack-sahara09:06
openstackgerritEvgeny Sikachev proposed openstack/sahara: Fix working scenario tests with swiftclient  https://review.openstack.org/22325609:11
openstackgerritVitaly Gridnev proposed openstack/sahara: Resolve issue with operating heat stack outputs  https://review.openstack.org/22310909:21
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameters for Sahara  https://review.openstack.org/22009009:24
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameters for Sahara  https://review.openstack.org/22009009:26
*** esikachev has joined #openstack-sahara09:43
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table  https://review.openstack.org/19671309:46
*** ldb__ has quit IRC10:01
*** ashishb has quit IRC10:08
*** ashishb has joined #openstack-sahara10:08
*** chlong has quit IRC10:09
*** chlong has joined #openstack-sahara10:11
openstackgerritAndrey Pavlov proposed openstack/sahara: Improving node group templates validation  https://review.openstack.org/22259210:17
openstackgerritKazuki OIKAWA proposed openstack/sahara: Selects IPv4 preferentially for internal_ip  https://review.openstack.org/21766910:29
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix problem with installing saharaclient on client gate  https://review.openstack.org/22325310:31
*** IBerezovskiy has joined #openstack-sahara10:50
openstackgerritPino Toscano proposed openstack/sahara-image-elements: mysql: remove extra +x permissions from pkg-map file  https://review.openstack.org/22352110:54
*** vgridnev has quit IRC10:57
*** vgridnev has joined #openstack-sahara10:58
*** ealcaniz has joined #openstack-sahara10:59
*** ealcaniz has left #openstack-sahara10:59
*** EinstCrazy has quit IRC11:15
*** esikachev has quit IRC11:18
*** esikachev has joined #openstack-sahara11:20
openstackgerritMerged openstack/sahara: Include YARN 2.7.0 to service install priority list in MapR plugin  https://review.openstack.org/22173011:25
openstackgerritMerged openstack/sahara: Change version package imports to correct in MapR plugin  https://review.openstack.org/21709711:25
*** EinstCrazy has joined #openstack-sahara11:39
openstackgerritVitaly Gridnev proposed openstack/sahara: Resolve issue with operating heat stack outputs  https://review.openstack.org/22310911:40
openstackgerritVitaly Gridnev proposed openstack/sahara: Create ResourceGroup with volumes only if it is required  https://review.openstack.org/22053811:42
openstackgerritVitaly Gridnev proposed openstack/sahara: Use get_resource instead of Ref defenition  https://review.openstack.org/22255811:45
*** coolsvap_ has joined #openstack-sahara11:56
*** EinstCrazy has quit IRC12:13
*** ashishb has quit IRC12:19
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add API methods for call verifications, DB table  https://review.openstack.org/19671312:22
*** ashishb has joined #openstack-sahara12:25
*** raildo-afk is now known as raildo12:25
openstackgerritVitaly Gridnev proposed openstack/sahara: Resolve issue with operating heat stack outputs  https://review.openstack.org/22310913:05
*** larainema has quit IRC13:10
*** larainema has joined #openstack-sahara13:11
*** hdd has joined #openstack-sahara13:12
*** coolsvap_ has quit IRC13:19
*** larainema has quit IRC13:20
*** larainema has joined #openstack-sahara13:21
openstackgerritVitaly Gridnev proposed openstack/sahara: Update hdp plugin docs  https://review.openstack.org/22358213:21
*** hdd has quit IRC13:26
openstackgerritVitaly Gridnev proposed openstack/sahara: Updating vanilla imagebuilder docs  https://review.openstack.org/22096013:31
*** manas has quit IRC13:40
*** tmckay has joined #openstack-sahara13:48
*** vgridnev has quit IRC13:52
*** vgridnev has joined #openstack-sahara13:52
*** esikachev has quit IRC13:52
*** esikachev has joined #openstack-sahara13:55
*** egafford has joined #openstack-sahara13:56
*** hdd has joined #openstack-sahara13:58
*** esikachev has quit IRC14:04
*** esikachev has joined #openstack-sahara14:15
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/22193714:18
*** david-lyle has quit IRC14:20
vgridnevtellesnobrega, I have an question about the following: https://bugs.launchpad.net/horizon/+bug/149563414:29
openstackLaunchpad bug 1495634 in OpenStack Dashboard (Horizon) "[sahara] Cluster creation fails" [Undecided,In progress] - Assigned to Telles Mota Vidal Nóbrega (tellesmvn)14:29
tellesnobregavgridnev, sure14:29
vgridnevok, it's broken on some specific client, or on all clients?14:30
tellesnobregado you mean specific versions of saharaclient or any openstack client?14:31
vgridnevI meant specific versions of client14:31
tellesnobregait should break on all clients, since only the last one has the count parameter14:31
tellesnobregaif you try to create using the count parameter it will break on any client14:32
vgridnevso bad14:32
tellesnobregayes14:32
tellesnobregaa fix is on the way14:32
tellesnobregaalready got a +214:32
vgridnevi see14:32
vgridnevok, the last one, how you tested that your horizon change worked?14:33
tellesnobregaactually _crobertsrh tested it14:34
tellesnobregabut i suppose he had a devstack and put my code in14:34
tellesnobregavgridnev, anything else?14:35
vgridnevno14:35
vgridnevthanks14:35
vgridnevit looks like I need to have more attention during reviewing horizon changes to prevent such issues14:36
tellesnobregasorry about that, i think i tested and sent a previous non-working version14:37
tellesnobregai was having issues with my horizon code in my machine14:37
tellesnobregaso i was testing in a vm14:37
tellesnobregaand i probably forgot to update the code i sent to the working version14:37
tellesnobregavgridnev, there is actually one thing we can do to not break with other versions14:41
tellesnobregaif we add a check for the count value in horizon and it is 114:41
tellesnobregawe can call the client without the parameter14:41
tellesnobregathis way a single cluster creation call will never break with any version of any client14:42
tellesnobregawhat do you think, _crobertsrh ^14:42
vgridnevtellesnobrega, it looks nice, but is it really needed?14:43
tellesnobregaif a user has an older client version that doesn't have the count parameter it will break to create a single cluster14:43
tellesnobregait is a way to keep compatible14:44
tellesnobregai'm not sure how critical this is14:45
vgridnevtellesnobrega, but if you use liberty horizon, you should also you liberty client, doesn't it?14:45
*** ashishb has quit IRC14:45
tellesnobregayeah14:45
*** _crobertsrh is now known as crobertsrh14:46
tellesnobregavgridnev, i agree with you that it makes sense to leave as it is, i'm just saying that if it is critical to have backward compatibility with older client versions, we can add this check14:46
crobertsrhtellesnobrega....just got in...reading back now14:46
crobertsrhbah...backward compat.  I hadn't considered it.14:48
tellesnobregacrobertsrh, what's your take on that?14:55
tellesnobregaI can send another patch for that14:55
tellesnobregacrobertsrh, the good thing is, if I had done it with the compatibility we probably wouldn't have found this issue now14:56
tellesnobregabut if you think we should do it, i'm ok with that14:57
*** sgotliv_ has joined #openstack-sahara14:58
*** vgridnev has quit IRC15:00
*** japplewhite has joined #openstack-sahara15:04
*** esikachev has quit IRC15:06
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Introduce sahara::db class  https://review.openstack.org/22363815:07
crobertsrhtellesnobrega:  I don't know that compat is the biggest issue.  I think a lot of our stuff is probably not backwards compat.15:08
*** sgotliv_ has quit IRC15:10
*** david-lyle has joined #openstack-sahara15:13
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameter 'plugins' for Sahara  https://review.openstack.org/22009015:16
hdddoes anyone know if https://review.openstack.org/#/c/197551 is going to be merged in time for the Liberty release?15:16
SergeyLukjanovhdd, yup, it should be merged in time for the L release, FFE granted for it15:18
hddcool; thanks15:19
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameter 'plugins' for Sahara  https://review.openstack.org/22009015:21
*** vgridnev has joined #openstack-sahara15:21
*** esikachev has joined #openstack-sahara15:21
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameter 'plugins' for Sahara  https://review.openstack.org/22009015:22
*** japplewhite has quit IRC15:27
*** larainema has quit IRC15:27
*** larainema has joined #openstack-sahara15:28
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameter 'plugins' for Sahara  https://review.openstack.org/22009015:31
*** coolsvap has quit IRC15:31
*** esikachev has quit IRC15:46
*** vgridnev has quit IRC15:50
*** tosky has quit IRC15:54
*** tosky has joined #openstack-sahara15:55
tellesnobregacrobertsrh, ok, sounds good to me16:04
*** hdd has quit IRC16:12
openstackgerritAndrey Pavlov proposed openstack/sahara: Adding fake plugin usage in validation ut  https://review.openstack.org/22367016:12
*** IBerezovskiy has quit IRC16:14
*** hdd has joined #openstack-sahara16:20
openstackgerritTimur Nurlygayanov proposed openstack/puppet-sahara: Fixed issue with rabbit_ha_queues parameter  https://review.openstack.org/19702316:32
*** vgridnev has joined #openstack-sahara16:33
*** larainema has quit IRC16:36
*** larainema has joined #openstack-sahara16:37
openstackgerritSergey Reshetnyak proposed openstack/sahara: HA for NameNode and ResourceManager in HDP 2.2  https://review.openstack.org/19755116:44
tellesnobregahey, when creating clusters (devstack or not) do you guys recommend using auto security groups or default or it doesn't matter?16:46
elmikotellesnobrega: i usually have wide-open sec rules, so no need for auto groups.16:47
elmikoif you need to keep the sec. groups tighter though, then use the auto groups16:47
tellesnobregathat's pretty much what i do as well when using devstack, but for a production cloud i was wondering what was best16:47
elmikofor production, definitely use auto groups16:48
elmikokeep the sec group rules tight and allow the cluster to only open the ports that are necessary16:48
tellesnobregagreat16:58
tellesnobregathanks16:58
tellesnobregacrobertsrh, after I change something in horizon on devstack, what do i need to do for the change to take place16:59
tellesnobregaran ./manage.py collectstatic  && ./manage.py compress but still got the same problem16:59
crobertsrhIf you're just using the devstack horizon instance.  You will need to restart apache (httpd)16:59
tellesnobregacrobertsrh, worked, thanks17:01
crobertsrhno problem17:01
*** japplewhite has joined #openstack-sahara17:04
*** hdd has quit IRC17:06
*** japplewhite has quit IRC17:09
*** ashishb has joined #openstack-sahara17:26
*** degorenko has quit IRC17:37
*** tosky has quit IRC17:37
*** ashishb has quit IRC18:19
*** vgridnev has quit IRC18:23
tellesnobregahas anyone seen this error http://paste.openstack.org/show/463361/ ?18:34
tellesnobregai'm trying to create a storm cluster18:34
tellesnobregasomething with direct_engine.py18:36
crobertsrhHmm, I haven't used direct_engine in awhile.18:37
elmikoyea same, direct is deprecated , i've been using heat18:39
*** vgridnev has joined #openstack-sahara18:40
*** egafford has quit IRC18:58
*** hdd has joined #openstack-sahara19:00
crobertsrhtellesnobrega:  If you're still having troubles, let me know.  I can try to spin up my own storm cluster (I'd have to build an image first though).19:01
*** egafford has joined #openstack-sahara19:03
*** sgotliv_ has joined #openstack-sahara19:12
tellesnobregahow can i change to use heat instead of direct_engine?19:22
tellesnobregacrobertsrh, elmiko ^19:24
crobertsrhIn sahara.conf19:24
elmikoyea, what he said =)19:24
crobertsrhlet me find the exact config19:24
crobertsrhinfrastructure_engine=heat19:24
crobertsrhinstead of direct19:24
crobertsrhOf course, if "The Storm Guy" himself can't start a Storm cluster, I say it can't be done.19:25
elmikolol19:26
tellesnobregalol19:26
tellesnobregaguess i have to figure it out19:27
*** hdd has quit IRC19:27
*** hdd has joined #openstack-sahara19:33
tellesnobregaone other thing, we have a test cloud set up and we were having problems when sahara was trying to access cinder, the problem was due to too many connections from sahara to cinder, do you guys know what can the problem be?19:37
elmikohmm, i feel like i've seen the too many connections issue before, but i don't remember if it was with cinder.19:40
*** hdd has quit IRC19:40
tellesnobregawhat information sahara needs from cinder? volumes quotas?19:43
*** hdd has joined #openstack-sahara19:43
elmikoyea, i imagine so19:45
crobertsrhI don't think I've seen that problem before.19:45
*** sgotliv_ has quit IRC19:48
tellesnobregaweird, we had to increase the maximum number of connectinos19:49
elmikothat makes sense19:49
*** devlaps has joined #openstack-sahara19:51
*** vgridnev has quit IRC19:52
*** sgotliv_ has joined #openstack-sahara19:53
*** vgridnev has joined #openstack-sahara19:58
tellesnobregaelmiko, do you have any idea why this would happen?20:10
elmikotellesnobrega: not really, i vaguely remember this came up before. let me see if i can find the bug20:11
tellesnobregathanks20:11
elmikotellesnobrega: are you using devstack?20:12
tellesnobreganot for this cinder problem20:12
elmikok20:12
*** hdd has quit IRC20:15
*** sgotliv_ has quit IRC20:16
*** hdd has joined #openstack-sahara20:17
tellesnobregahas heat migrated to be added as plugin in devstack or is the old enabled_services20:17
tellesnobrega?20:17
elmikotellesnobrega: i use enabled_services20:17
tellesnobregacoll20:17
tellesnobregacool20:17
elmikoenable_service h-eng h-api h-api-cfn h-api-cw20:17
elmikoalso, i am not having luck finding this old bug report. sorry =(20:18
tellesnobregano problem20:18
tellesnobregadon't worry about it20:18
*** egafford has quit IRC20:31
*** vgridnev has quit IRC20:35
*** vgridnev has joined #openstack-sahara20:36
*** vgridnev has quit IRC20:36
*** raildo is now known as raildo-afk21:03
*** egafford has joined #openstack-sahara21:11
*** crobertsrh is now known as _crobertsrh21:23
tmckayanybody seeing errors from the heat client saying HTTPForbidden: ERROR: You are not authorized to use index22:03
*** egafford has quit IRC22:10
elmikotmckay: have not seen that one22:14
tmckayI added the demo user as a heat_stack_user, but it doesn't matter22:15
elmikoweird22:15
tmckayI can do heat stack-list as admin, but not as demo22:15
tmckaymaybe I can find the check in heat and disable it22:15
elmikomaybe check the heat policy.json to see what role is required for index?22:15
tmckayyeah, looks like a bunch of stuff is set to deny_stack_user22:18
tmckaythere used to be a heat_stack_owner role22:18
tmckayelmiko, you da man22:20
elmikoo.O22:20
tmckayI take the rule out for stack:index and restarted heat api, at least from the cli I can hit it now22:20
elmikoyea, you could totally make everything permissable ;)22:21
tmckayso, what will break next ... all I'm doing is trying to launch a spark cluster22:21
tmckaydirect engine failed repeatedly trying to write /etc/hosts22:21
tmckayso I thought I would try heat22:21
tmckayelmiko, what happens if you just remove the file?22:22
elmikoprobably get a warning from heat as it tries to startup22:22
elmikosahara will fail without some sort of policy22:23
elmikothis is so weird, my job never proceeds to the reduce phase22:25
*** witlessb has quit IRC22:39
*** openstackgerrit has quit IRC23:16
*** openstackgerrit has joined #openstack-sahara23:16
*** david-lyle has quit IRC23:17
*** tmckay has left #openstack-sahara23:43

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!