Wednesday, 2015-09-16

*** devlaps has quit IRC00:18
*** bapalm_ has joined #openstack-sahara00:20
*** bapalm has quit IRC00:21
*** kgalanov_ has joined #openstack-sahara00:29
*** htruta` has joined #openstack-sahara00:33
*** htruta has quit IRC00:36
*** kgalanov has quit IRC00:36
*** lvdongbing has joined #openstack-sahara00:37
*** hdd has quit IRC00:38
openstackgerritlvdongbing proposed openstack/sahara: Warn vanilla 2.6.0 instead of raising exception  https://review.openstack.org/22338601:32
*** htruta` is now known as htruta01:53
*** macjack has joined #openstack-sahara02:38
*** hdd has joined #openstack-sahara02:57
*** david-lyle has joined #openstack-sahara03:41
*** sgotliv_ has joined #openstack-sahara04:06
*** coolsvap has joined #openstack-sahara04:29
*** david-lyle has quit IRC04:42
*** david-lyle has joined #openstack-sahara04:45
*** larainema has quit IRC04:46
*** larainema has joined #openstack-sahara04:46
*** hdd has quit IRC05:43
*** vgridnev has joined #openstack-sahara05:45
*** EinstCrazy has joined #openstack-sahara06:06
*** ashishb has joined #openstack-sahara06:10
*** sgotliv_ has quit IRC06:26
*** vgridnev has quit IRC06:57
*** vgridnev has joined #openstack-sahara07:11
*** EinstCrazy has quit IRC07:27
*** sgotliv_ has joined #openstack-sahara07:46
*** vgridnev has quit IRC07:58
openstackgerritAndrey Pavlov proposed openstack/sahara: Improving node group templates validation  https://review.openstack.org/22259208:04
*** witlessb has joined #openstack-sahara08:06
*** degorenko has joined #openstack-sahara09:01
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Introduce sahara::db class  https://review.openstack.org/22363809:10
openstackgerritVitaly Gridnev proposed openstack/sahara: Generate random heat stack name for cluster  https://review.openstack.org/22397909:19
*** vgridnev has joined #openstack-sahara09:39
*** esikachev has joined #openstack-sahara09:42
*** tosky has joined #openstack-sahara09:45
*** lvdongbing has quit IRC09:53
*** IBerezovskiy has joined #openstack-sahara10:11
openstackgerritVitaly Gridnev proposed openstack/sahara: Generate random heat stack name for cluster  https://review.openstack.org/22397910:17
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Revert "Fixed /etc/sahara handling"  https://review.openstack.org/22214210:39
*** larainema has quit IRC10:39
*** larainema has joined #openstack-sahara10:40
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Revert "Fix Sahara installation for Ubuntu"  https://review.openstack.org/22214411:10
*** vgridnev has quit IRC11:30
*** larainema has quit IRC11:30
*** larainema has joined #openstack-sahara11:31
*** larainema has quit IRC11:32
*** larainema has joined #openstack-sahara11:32
*** larainema has quit IRC11:32
*** vgridnev has joined #openstack-sahara11:37
*** larainema has joined #openstack-sahara11:41
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding check of indirect access  https://review.openstack.org/22308711:47
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding check of indirect access  https://review.openstack.org/22308711:48
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix problem with create cluster w/o internet  https://review.openstack.org/22404811:55
tellesnobregahello, has anyone seen this error with heat  http://paste.openstack.org/show/464557/11:59
*** ashishb has quit IRC12:00
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix problem with create cluster w/o internet  https://review.openstack.org/22404812:00
*** raildo-afk is now known as raildo12:02
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding check of indirect access  https://review.openstack.org/22308712:03
*** larainema has quit IRC12:09
*** larainema has joined #openstack-sahara12:10
*** larainema has quit IRC12:16
*** larainema has joined #openstack-sahara12:16
*** EinstCrazy has joined #openstack-sahara12:23
*** macjack has quit IRC12:25
openstackgerritVitaly Gridnev proposed openstack/sahara: Heat stack creation with tags  https://review.openstack.org/22405612:27
*** manas has joined #openstack-sahara12:28
tellesnobregavgridnev, can you take a look at the link i sent, i'm having trouble to create a storm cluster with heat and with direct engine12:29
tellesnobregathe log above is related to heat12:29
*** larainema has quit IRC12:29
tellesnobregacan you checkout and see if you have seen something like that12:29
vgridnevtellesnobrega, with link?12:29
tellesnobregahttp://paste.openstack.org/show/464557/12:29
tellesnobrega^12:29
vgridnevwhich*12:29
*** larainema has joined #openstack-sahara12:30
*** tmckay has joined #openstack-sahara12:30
vgridnevtellesnobrega, looks strange12:31
vgridnevI'll take a look12:31
vgridnevbut, how to reproduce that?12:31
vgridnevhow you create cluster?12:32
*** larainema has quit IRC12:34
vgridnevI need also information about environment, it is fresh devstack, isn't it?12:34
*** larainema has joined #openstack-sahara12:35
vgridnevtellesnobrega, ^^12:36
*** EinstCrazy has quit IRC12:40
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding check of indirect access  https://review.openstack.org/22308712:44
tellesnobregavgridnev, sorry, i was in a meeting12:45
*** raildo is now known as raildo-afk12:45
tellesnobregaso i'm using a fresh devstack in a ubuntu12:45
tellesnobregai'm creating a storm cluster, one node-group for slave, one for master and one for zookeeper12:46
tellesnobregausing only private address12:46
tellesnobregaprivate network12:46
vgridnevcan you post your node group templates?12:49
vgridnevand cluster templates12:49
vgridnevtellesnobrega, ^^12:49
tellesnobregavgridnev, i was using horizon to create it, just a second and i will write a json for it12:50
tellesnobregai just lost my vm that devstack was on it (cloud problems)12:51
vgridnevokay, can you give description of that?12:52
vgridnevDo you use volumes?12:52
vgridnevit looks like you don't use floating tips, right?12:53
tellesnobregahttp://paste.openstack.org/show/464622/12:57
tellesnobregathese are the node_groups12:57
tellesnobregahaven't tested them, but they may work12:57
tellesnobreganot using floating_ips12:58
tellesnobregahere is the cluster_template13:00
tellesnobregahttp://paste.openstack.org/show/464623/13:00
vgridnevok, thanks, I will check that in near future13:00
tellesnobregathanks13:05
*** raildo-afk is now known as raildo13:08
vgridnevtellesnobrega, final question: neutron or nova-network?13:09
*** _crobertsrh is now known as crobertsrh13:12
*** hdd has joined #openstack-sahara13:13
*** tosky has quit IRC13:13
tellesnobreganeutron13:19
*** hdd has quit IRC13:33
*** sgotliv_ has quit IRC13:35
*** larainema has quit IRC13:45
*** larainema has joined #openstack-sahara13:46
*** sgotliv_ has joined #openstack-sahara13:49
*** tellesnobrega is now known as tellesnobrega_af13:57
*** larainema has quit IRC14:01
*** larainema has joined #openstack-sahara14:01
openstackgerritVitaly Gridnev proposed openstack/sahara: Heat stack creation with tags  https://review.openstack.org/22405614:03
*** hdd has joined #openstack-sahara14:07
*** lvdongbing has joined #openstack-sahara14:09
*** egafford has joined #openstack-sahara14:09
openstackgerritVitaly Gridnev proposed openstack/sahara: Replace option type with correct type  https://review.openstack.org/22410114:12
*** tellesnobrega_af is now known as tellesnobrega14:17
tellesnobregavgridnev, nevermind, i spawned a new vm and the cluster is creating14:22
vgridnevtellesnobrega, ok, actually I did not reproduced that14:23
openstackgerritVitaly Gridnev proposed openstack/sahara: Replace option type with correct type  https://review.openstack.org/22410114:24
*** AndreyPavlov has quit IRC14:25
openstackgerritEmilien Macchi proposed openstack/puppet-sahara: DNM - CI test  https://review.openstack.org/22411914:26
*** tellesnobrega is now known as tellesnobrega_af14:30
*** openstackgerrit has quit IRC14:31
*** openstackgerrit has joined #openstack-sahara14:31
*** tellesnobrega_af is now known as tellesnobrega14:31
*** tellesnobrega is now known as tellesnobrega_af14:32
*** AndreyPavlov has joined #openstack-sahara14:34
*** japplewhite has joined #openstack-sahara14:37
*** david-lyle has quit IRC14:37
*** tellesnobrega_af is now known as tellesnobrega14:38
openstackgerritVitaly Gridnev proposed openstack/sahara: Resolve issue with operating heat stack outputs  https://review.openstack.org/22310914:39
openstackgerritEvgeny Sikachev proposed openstack/sahara: Adding check of indirect access  https://review.openstack.org/22308714:40
*** raildo is now known as raildo-afk14:41
*** raildo-afk is now known as raildo14:41
*** lvdongbing has quit IRC14:42
*** lvdongbing has joined #openstack-sahara14:42
tellesnobregais there a way to force sahara to use only ipv4?14:43
vgridnevtellesnobrega, probably this: https://review.openstack.org/#/c/217669/514:45
elmikoi don't think i've seen it use ipv6, but i'm not sure about forcing ipv414:45
tellesnobregathanks vgridnev. elmiko i'm trying the storm cluster and it gets both, ipv6 and ipv14:47
tellesnobregaipv414:47
elmikoweird14:47
tellesnobregabut for some instances it chooses ipv4 as internal and management and for others ipv614:47
elmikomaybe turn off ipv6 on the hosts?14:47
tellesnobregastorm-master-0fd8c:fcc8:4d09:0:f816:3eff:fef5:1362 fd8c:fcc8:4d09:0:f816:3eff:fef5:136214:48
*** esikachev has quit IRC14:49
*** esikachev has joined #openstack-sahara14:53
*** openstackgerrit has quit IRC15:01
*** openstackgerrit has joined #openstack-sahara15:01
*** esikachev has quit IRC15:05
*** lvdongbing has quit IRC15:13
*** lvdongbing has joined #openstack-sahara15:20
*** esikachev has joined #openstack-sahara15:21
*** manas has quit IRC15:23
openstackgerritVitaly Gridnev proposed openstack/sahara: Heat stack creation with tags  https://review.openstack.org/22405615:26
*** nkrinner is now known as nkrinner_afk15:26
elmikoare the cdh 5.4 images really 3.1G ?15:29
pino|workelmiko: their size? yes15:29
elmikoooph15:29
pino|workduring the build, at least 2.5/3G of packages from the cloudera repos are downloaded15:29
pino|workyou are looking at https://review.openstack.org/#/c/223017/ by chance?15:30
elmikoi wasn't, but i will now ;)15:30
* pino|work patpats elmiko15:31
elmikoi'm just having weird issues getting *any* job to complete on a vanilla 2.7.1 image15:31
*** vgridnev has quit IRC15:31
*** esikachev has quit IRC15:33
pino|worklogs?15:33
elmikothat's just it, there are no errors. the jobs just stay in running state15:34
*** david-ly_ has joined #openstack-sahara15:35
pino|workah, not during the image generation15:37
elmikono, this is usage related stuff15:39
pino|workright15:41
* pino|work goes back to his cave15:41
*** david-ly_ is now known as david-lyle15:41
*** hdd has quit IRC15:43
*** hdd has joined #openstack-sahara15:50
*** devlaps has joined #openstack-sahara15:54
*** japplewhite has quit IRC15:55
*** EinstCrazy has joined #openstack-sahara16:04
*** EinstCrazy has quit IRC16:06
*** EinstCrazy has joined #openstack-sahara16:08
*** EinstCrazy has quit IRC16:08
*** EinstCrazy has joined #openstack-sahara16:09
*** EinstCrazy has quit IRC16:22
*** lvdongbing has quit IRC16:23
openstackgerritMerged openstack/puppet-sahara: Introduce sahara::db class  https://review.openstack.org/22363816:23
*** esikachev has joined #openstack-sahara16:27
*** tosky has joined #openstack-sahara16:29
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: Add new parameter 'plugins' for Sahara  https://review.openstack.org/22009016:31
*** vgridnev has joined #openstack-sahara16:41
*** esikachev has quit IRC16:53
openstackgerritDenis Egorenko proposed openstack/puppet-sahara: TEST  https://review.openstack.org/22420017:04
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates  https://review.openstack.org/16933817:18
*** sgotliv_ has quit IRC17:23
egaffordcrobertsrh: Anything we can do to encourage any Horizon eyes on https://review.openstack.org/#/c/209683/ ?17:25
egaffordI know they are a scarce resource; it may be that nothing can be done. Still, worth asking.17:26
david-lyleegafford: I just need to run it17:26
david-lylecode looks reasonable17:26
david-lylewill try now17:26
egafforddavid-lyle: Ah, excellent. Thanks!17:26
egafforddavid-lyle: I was really happy with the .js/HTML separation change, in the end, and can absolutely see the utility of it.17:27
openstackgerritMerged openstack/sahara: Use get_resource instead of Ref defenition  https://review.openstack.org/22255817:27
crobertsrhegafford:  Usually mentioning "horizon" spawns an intance of david.  Handy trick.17:27
egaffordIt's like Bloody Mary, but you only say it one time and instead of killing you it reviews your patches.17:28
david-lyleLOL17:28
crobertsrhOf course...the reviews could be killer17:28
egaffordWorst movie trailer tagline ever.17:28
*** tosky has quit IRC17:36
openstackgerritArtem Osadchiy proposed openstack/sahara: Fixed service restart in MapR plugin  https://review.openstack.org/22420817:39
openstackgerritMerged openstack/sahara: Create ResourceGroup with volumes only if it is required  https://review.openstack.org/22053817:51
openstackgerritMerged openstack/sahara: [sahara doc fix] guest requirements doc  https://review.openstack.org/22077817:52
*** tosky has joined #openstack-sahara17:57
tellesnobregavgridnev, the patch for choosing ipv4 works17:59
vgridnevgreat18:01
*** openstackgerrit has quit IRC18:16
*** openstackgerrit has joined #openstack-sahara18:16
*** david-lyle has quit IRC18:30
*** vgridnev has quit IRC18:38
*** vgridnev has joined #openstack-sahara19:01
*** japplewhite has joined #openstack-sahara19:39
openstackgerritMichael McCune proposed openstack/sahara: [WIP] Initial key manager and proxy passwords impl  https://review.openstack.org/22068019:41
openstackgerritMichael McCune proposed openstack/sahara: Fix incorrect function name in swift client  https://review.openstack.org/22267319:41
*** hdd has quit IRC19:55
*** japplewhite has quit IRC19:56
*** hdd has joined #openstack-sahara19:57
*** openstackstatus has quit IRC20:02
*** openstackstatus has joined #openstack-sahara20:04
*** ChanServ sets mode: +v openstackstatus20:04
*** hdd has quit IRC20:09
*** sgotliv_ has joined #openstack-sahara20:10
*** hdd has joined #openstack-sahara20:29
*** sgotliv_ has quit IRC20:36
*** sgotliv has joined #openstack-sahara20:53
*** crobertsrh is now known as _crobertsrh21:07
*** raildo is now known as raildo-afk21:10
*** vgridnev has quit IRC21:13
*** tmckay has left #openstack-sahara21:28
*** sgotliv has quit IRC21:45
*** david-lyle has joined #openstack-sahara21:56
egafforddavid-lyle: Thanks for review, WF on https://review.openstack.org/#/c/209683/!22:04
egaffordMuch appreciated.22:04
david-lyleegafford: np22:05
elmikoegafford: huzzah!22:13
egaffordelmiko: Quite!22:13
egaffordelmiko: As I almost posted and thought better of it: elmiko: Ehmagerd https://review.openstack.org/#/c/209683/ WF+1 \o/!22:14
elmikolol, haha22:14
elmikoegafford: have you ever seen inter-node connection timeouts on hadoop?22:16
egaffordNice to have everything in one release, certainly. Also means I won't be standing in Tokyo in a month saying, "this is pretty great, and you cannot use it; lol."22:16
egaffordelmiko: Hm, that sounds not great.22:16
elmikolol22:16
elmikonodes can ping, but its weird22:16
egaffordHow's your name resolution doing?22:16
elmikoshouldn't need it, this is just ip addresses it looks like22:17
egaffordMeh...22:17
egaffordSec group issues?22:17
egaffordCan you telnet?22:17
egaffordDo you know what specific thing they're trying to interconnect to?22:18
egaffordWill Ethan keep asking questions if elmiko doesn't respond?22:19
elmikoi think they are trying to talk with the hadoop master node22:19
egaffordOkay, cool; if you find the hadoop master node UI link, can you open it and bop around?22:19
elmikothey can definitely talk to each other22:19
egaffordNot that that's diagnostic if it fails, but if it succeeds, hey, at least your have a real master node.22:20
elmikoyup, bopping around as we speak22:20
elmikonot sure why these connections keep failing though, its just odd22:20
elmikothe *really* weird thing is that earlier today, i did something that caused the jobs to write output but i never saw a successful job run22:21
elmikostill trying to figure that out22:21
egaffordK. So you're timing out on your master node API port, and you don't know why, because the master node is up and running, the datanodes are attempting to connect to it by ip, the master node port is open, and the data nodes can ping the masternode. That about the drill>22:21
egafford?22:21
elmikoyea, more or less22:22
egaffordOkay, yeah, I think that's a new scenario for me.22:22
elmikosadly, the last set of logs got blown away somehow22:22
egafford:/22:22
elmikodouble sadly, probably gonna have to push secret store into M =(22:22
egafford:\22:23
elmikoi just can't test this stuff thoroughly enough22:23
egafford:|22:23
egaffordSecret store is a pretty major feature.22:23
elmikoit will be someday22:23
egaffordFor what it's worth, it seems prudent to me to give it a full test period to soak (that is, not to FFE it if there's any doubt).22:24
elmikoyea i agree, i'll bring this up at the meeting tomorrow. i probably need to retract the ffe22:24
egaffordRespectable.22:24
egaffordMuch, much better that than pushing it through if you think it might be Hubris.22:25
elmikoagreed22:26
elmikoplus, i know barbican is still gaining traction, so it won't be a huge loss to not have it now.22:27
egaffordThe only thing more awesome than a potential sec hole is a rushed sec feature to patch the potential sec hole. :) Yeah, I don't think just about anyone's distributing it just yet.22:27
egaffordNot to say that non-productized services aren't people too; they absolutely are.22:27
elmikoheh, yeah that would be bad mmmk22:27
egaffordSeems like it has a lot of promise though. Barbican that is.22:28
elmikoyea, it's a cool project22:28
egaffordI do like the proliferation of little utility services that are super good at one cross-cutting thing.22:29
*** david-lyle has quit IRC22:29
elmikoagreed, i think it could be the heart of a healthy openstack community22:29
egaffordYeah, they pose a real maintenance challenge, but on balance it seems like sane and good decomposition, and almost necessary as we move forward.22:29
egaffordAnd more projects for more people to become invested in and lead in is good.22:30
elmikogood point, it's a tough balancing act for sure22:30
elmikoi'm kinda wondering if i'm seeing some weird routing issue between my vm nodes and the swift endpoint22:33
egaffordelmiko: It's a good question: totally possible they're calling into the namenode, it's calling out to [x] where [x] might be swift, and that call is hanging.22:34
elmikoyea, time to rebuild the cluster and start diagnosing22:35
*** witlessb has quit IRC22:55
*** egafford has quit IRC23:07
*** chlong has quit IRC23:41
*** tosky has quit IRC23:52

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!