Friday, 2016-02-19

« Thursday, 2016-02-18 Index Saturday, 2016-02-20 »
*** egafford has joined #openstack-sahara00:02
*** jamielennox|away is now known as jamielennox00:33
openstackgerritMerged openstack/sahara: Fixes to make bandit integration tests work with sahara  https://review.openstack.org/28194000:56
*** tellesnobrega is now known as tellesnobrega_af01:06
*** chlong_ has joined #openstack-sahara01:55
*** jamielennox is now known as jamielennox|away02:02
*** david-lyle_ has joined #openstack-sahara02:04
*** david-lyle_ is now known as david-lyle02:05
openstackgerritJaxon Wang proposed openstack/sahara: CDH plugin config helper refactoring  https://review.openstack.org/25582502:08
openstackgerritJaxon Wang proposed openstack/sahara: Update CDH user doc for CDH 5.5.0  https://review.openstack.org/28167002:08
openstackgerritJaxon Wang proposed openstack/sahara: CDH plugin edp engine code refactoring  https://review.openstack.org/25730902:08
openstackgerritJaxon Wang proposed openstack/sahara: Add CDH 5.5 support  https://review.openstack.org/27996402:08
*** jamielennox|away is now known as jamielennox02:12
*** egafford has quit IRC02:20
*** jamielennox is now known as jamielennox|away02:24
*** jamielennox|away is now known as jamielennox02:25
*** jamielennox is now known as jamielennox|away02:26
*** jamielennox|away is now known as jamielennox02:33
*** jamielennox is now known as jamielennox|away02:34
*** jamielennox|away is now known as jamielennox02:35
*** jamielennox is now known as jamielennox|away02:36
*** jamielennox|away is now known as jamielennox02:51
*** krotscheck_dr is now known as krotscheck_afk03:18
*** links has joined #openstack-sahara03:30
*** david-lyle_ has joined #openstack-sahara03:42
*** david-lyle has quit IRC03:45
*** david-lyle has joined #openstack-sahara04:00
*** david-lyle_ has quit IRC04:03
*** david_lyle__ has joined #openstack-sahara04:03
*** david-lyle has quit IRC04:04
*** david_lyle__ has quit IRC04:08
openstackgerritMerged openstack/puppet-sahara: Add the capability to configure api-paste.ini with config.pp  https://review.openstack.org/28175604:22
*** Poornima has joined #openstack-sahara05:05
*** dave-mccowan has quit IRC05:28
*** sgotliv has joined #openstack-sahara05:36
*** rcernin has joined #openstack-sahara05:37
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-dashboard: Imported Translations from Zanata  https://review.openstack.org/28220006:30
*** nkrinner has joined #openstack-sahara06:43
*** vgridnev has joined #openstack-sahara06:54
*** vgridnev has quit IRC06:55
openstackgerritMerged openstack/sahara-dashboard: Imported Translations from Zanata  https://review.openstack.org/28220006:56
*** vgridnev has joined #openstack-sahara06:57
openstackgerritEvgeny Sikachev proposed openstack/sahara-tests: Add Hive jobs for CDH and Ambari job  https://review.openstack.org/28070106:59
*** vgridnev has quit IRC07:09
*** sgotliv has quit IRC07:20
*** esikachev_afk is now known as esikachev07:30
*** chlong_ has quit IRC07:41
* esikachev is now away: Away from keyboard07:43
*** esikachev is now known as esikachev_afk07:43
*** pcaruana has joined #openstack-sahara07:45
openstackgerritMerged openstack/sahara: Check that main-class value is not null in job execution validator  https://review.openstack.org/28205008:01
*** javeme has joined #openstack-sahara08:12
openstackgerritMichael Ionkin proposed openstack/sahara: Added scaling support for HDP 2.2 / 2.3  https://review.openstack.org/19308108:19
*** pino|work_ is now known as pino|work08:45
*** witlessb has joined #openstack-sahara09:14
*** pino|work has quit IRC09:21
*** pino|work has joined #openstack-sahara09:32
*** vgridnev has joined #openstack-sahara09:34
*** esikachev_afk is now known as esikachev09:49
*** sgotliv has joined #openstack-sahara10:02
openstackgerritGrigoriy Rozhkov proposed openstack/sahara-tests: Add MapR-FS support to sahara scenario framework  https://review.openstack.org/28196310:05
openstackgerritEvgeny Sikachev proposed openstack/sahara-tests: [DO NOT REVIEW]Test depends-on  https://review.openstack.org/28225710:06
*** _degorenko|afk is now known as degorenko10:07
openstackgerritEvgeny Sikachev proposed openstack/sahara: Testcommit  https://review.openstack.org/27900810:08
openstackgerritVitaly Gridnev proposed openstack/sahara: base cluster verifications implementation  https://review.openstack.org/27358710:20
openstackgerritGrigoriy Rozhkov proposed openstack/sahara-tests: Add MapR-FS support to sahara scenario framework  https://review.openstack.org/28196310:28
*** tellesnobrega_af is now known as tellesnobrega10:32
openstackgerritMichael Ionkin proposed openstack/sahara: Added scaling support for HDP 2.2 / 2.3  https://review.openstack.org/19308111:06
*** tellesnobrega is now known as tellesnobrega_af11:10
openstackgerritVitaly Gridnev proposed openstack/sahara: cloudera health checks implementation  https://review.openstack.org/27900711:29
openstackgerritVitaly Gridnev proposed openstack/sahara: implement sending health notifications  https://review.openstack.org/28119411:29
openstackgerritVitaly Gridnev proposed openstack/sahara: ambari health check implementation  https://review.openstack.org/28020311:29
*** Poornima has quit IRC11:31
openstackgerritEvgeny Sikachev proposed openstack/sahara: [do not review]test depends-on  https://review.openstack.org/28229111:33
*** sgotliv has quit IRC11:43
*** tellesnobrega_af is now known as tellesnobrega11:46
openstackgerritEvgeny Sikachev proposed openstack/sahara-tests: [DO NOT REVIEW]Test depends-on  https://review.openstack.org/28225711:47
openstackgerritEvgeny Sikachev proposed openstack/sahara: Testcommit  https://review.openstack.org/27900811:49
*** dave-mccowan has joined #openstack-sahara11:49
openstackgerritGrigoriy Rozhkov proposed openstack/sahara: Add property 'MapR-FS heap size percent' to cluster template  https://review.openstack.org/27565411:55
openstackgerritGrigoriy Rozhkov proposed openstack/sahara-tests: Add MapR-FS support to sahara scenario framework  https://review.openstack.org/28196312:05
*** chlong_ has joined #openstack-sahara12:11
* esikachev is now away: Away from keyboard12:15
*** esikachev is now known as esikachev_afk12:15
*** witlessb has quit IRC12:28
*** raildo-afk is now known as raildo12:35
*** raildo is now known as raildo-afk12:38
*** witlessb has joined #openstack-sahara12:38
*** raildo-afk is now known as raildo12:39
*** vgridnev has quit IRC12:40
*** vgridnev has joined #openstack-sahara12:54
*** krotscheck_afk is now known as krotscheck13:05
*** akuznetsov has joined #openstack-sahara13:06
openstackgerritGrigoriy Rozhkov proposed openstack/sahara: Add Hue 3.9.0 to MapR plugin  https://review.openstack.org/27521713:06
*** vgridnev_ has joined #openstack-sahara13:21
*** vgridnev has quit IRC13:24
*** vgridnev_ has quit IRC13:24
*** vgridnev has joined #openstack-sahara13:24
openstackgerritJulian proposed openstack/sahara: Add package installation methods to ssh_remote util  https://review.openstack.org/28205813:36
*** tellesnobrega is now known as tellesnobrega_af13:39
*** _crobertsrh is now known as crobertsrh13:45
*** vgridnev has quit IRC13:46
openstackgerritChad Roberts proposed openstack/sahara-dashboard: Fixing up integration tests after UI reorganization  https://review.openstack.org/28200913:53
*** tellesnobrega_af is now known as tellesnobrega13:54
*** vgridnev has joined #openstack-sahara14:02
*** esikachev_afk is now known as esikachev14:02
vgridnevcrobertsrh, just tried your patches, it's looks good, actually, waiting for integration tests fix14:04
crobertsrhThanks.  I'm currently working on a final patch to get the integration tests working14:04
crobertsrhI'm hopeful that my current try will get them going.14:05
*** javeme has quit IRC14:05
*** akuznetsov has quit IRC14:07
crobertsrhvgridnev:  Looks like my latest attempt did work  https://review.openstack.org/#/c/282009/  I made it an add-on patch since integration tests are non-voting atm and I didn't want to force people to re-review the mountain of code.14:15
*** vgridnev has quit IRC14:19
*** vgridnev has joined #openstack-sahara14:21
*** vgridnev has quit IRC14:22
openstackgerritEvgeny Sikachev proposed openstack/sahara-tests: Add autoregistering of image  https://review.openstack.org/28131514:24
*** vgridnev has joined #openstack-sahara14:27
*** links has quit IRC14:27
vgridnevcrobertsrh, let's start approve party14:29
crobertsrhHeh.  I'll blow up some balloons.14:29
vgridnevneed one more in here: https://review.openstack.org/#/c/282009/214:30
vgridnev+214:30
crobertsrhelmiko? ^^14:31
openstackgerritMerged openstack/sahara-dashboard: Reorganizing cluster panels into tabs  https://review.openstack.org/26656614:31
openstackgerritMerged openstack/sahara-dashboard: Reorganizing job-related panels into tabs  https://review.openstack.org/26977814:32
openstackgerritMerged openstack/sahara-dashboard: Reorganizing job and cluster guide pages  https://review.openstack.org/27047814:32
crobertsrhWow, I feel like I've already done a days worth of work today.  Maybe I should take the rest of the day off.14:34
elmikocrobertsrh: ack, taking a look14:39
*** openstackgerrit_ has quit IRC14:43
vgridnevI would be also happy if someone will approve some basic changes for health checks :)14:43
*** tmckay has joined #openstack-sahara14:43
crobertsrhyes...review on my list for today14:45
tmckayelmiko, crobertsrh, you want to review https://review.openstack.org/#/c/279275/ and we'll push it through with broken CI? It's passed enough. last one in the set to close that bug14:51
crobertsrhI'll give it a look.  Is the ci not supposed to be fixed anytime soon?14:51
elmikosure thing14:51
openstackgerritMerged openstack/sahara-dashboard: Fixing up integration tests after UI reorganization  https://review.openstack.org/28200914:52
*** openstackgerrit_ has joined #openstack-sahara15:00
*** Erming_ has quit IRC15:00
*** Erming_ has joined #openstack-sahara15:01
elmikotmckay: i know you are calling this a regex search, is it truly regex? like could i pass "my-job-[1-5]" and have it match "my-job-4", for example?15:01
tmckayyes15:01
tmckayas supported by SQL15:02
elmikothanks, just trying to understand better15:02
elmikook, so whatever regex sql supports basically?15:02
*** Erming_ has quit IRC15:05
tmckayyeah, it's a passthrough to the database layer, uses the REGEX op for SQL and MySQL I think, and ~ for postgres15:05
*** Erming_ has joined #openstack-sahara15:05
tmckaythe tilde for postgres I guess is regex. You can read the SQL docs to see what's supported15:06
tmckayI need to pull that patch and verify one more time that the job.name and cluster.name parts work, since they are slightly funky15:06
tmckaywe can hold off Workflow til I do that.15:06
elmikotmckay: are you saying hold off on +W for https://review.openstack.org/#/c/279275 ?15:08
elmikocuz, it lgtm and we have good support on it15:09
tmckayelmiko, yeah, for a few minutes anyway. I just want to double check the special fields (job.name, cluster.name)15:09
elmikok15:09
tmckaychecking now ...15:09
elmikonp15:09
tmckaythanks for looking15:09
*** al_indigo has quit IRC15:11
*** dave-mccowan has quit IRC15:11
*** nkrinner has quit IRC15:12
*** links has joined #openstack-sahara15:13
tmckayelmiko, okay, looks good. status actually does not work for multi-word value "Done with Error" but that is not part of this fix ... separate bug, I'll work on it15:14
*** dhellmann has quit IRC15:16
elmikook, workflowing...15:17
*** dhellmann has joined #openstack-sahara15:19
*** tellesnobrega is now known as tellesnobrega_af15:20
* esikachev is now away: Away from keyboard15:24
*** esikachev is now known as esikachev_afk15:24
*** dave-mccowan has joined #openstack-sahara15:25
*** vgridnev has quit IRC15:34
rickflareso guys15:35
rickflaretmckay I got a success build15:35
rickflareall I had to do is not specify a swift output file15:35
*** vgridnev has joined #openstack-sahara15:36
*** akuznetsov has joined #openstack-sahara15:36
tmckayrickflare, yeah, that would do it. read from swift, write to hdfs?15:38
rickflarei just didnt specify any output file15:38
rickflareso i assume it went into hdfs15:38
rickflarei didnt check15:38
rickflareto see where it went15:38
rickflarejust saw it passed15:38
tmckayshould be in hdfs under the std user (ubuntu or hadoop, I think)15:40
rickflarek15:40
rickflareyea15:40
rickflareits there15:40
*** vgridnev has quit IRC15:41
*** vgridnev has joined #openstack-sahara15:42
*** sgotliv has joined #openstack-sahara15:44
*** vgridnev has quit IRC15:46
*** akuznetsov has quit IRC15:50
*** vgridnev has joined #openstack-sahara15:54
*** vgridnev has quit IRC15:57
*** vgridnev has joined #openstack-sahara15:58
*** coolsvap|away has quit IRC16:03
*** sgotliv has quit IRC16:03
*** coolsvap|away has joined #openstack-sahara16:09
*** pcaruana has quit IRC16:10
*** vgridnev has quit IRC16:12
*** vgridnev has joined #openstack-sahara16:18
openstackgerritMerged openstack/sahara: Add regex matching for job_executions_list()  https://review.openstack.org/27927516:20
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: implement health checks in sahara-dashboard  https://review.openstack.org/27606716:23
*** vgridnev has quit IRC16:29
*** vgridnev has joined #openstack-sahara16:44
*** AJaeger has joined #openstack-sahara16:47
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: implement health checks in sahara-dashboard  https://review.openstack.org/27606716:47
openstackgerritAndreas Jaeger proposed openstack/sahara-dashboard: Unbreak "setup.py install"  https://review.openstack.org/28242216:50
AJaegersahara dashboard cores, could you approve 282422, please?16:50
AJaegerCurrently the tcomplete requiremetns repo is blocked due to the symlink16:51
crobertsrhI will take a look16:53
crobertsrhvgridnev: ^^16:53
*** links has quit IRC16:53
AJaegercrobertsrh: thanks16:53
AJaegerExample failure: https://jenkins04.openstack.org/job/gate-requirements-integration-dsvm/790/console16:55
vgridnevAJaeger, approved16:56
elmikoheh, vgridnev beat me to it ;)16:56
AJaegerthanks to all of you for the quick fix. I wrote akahiro an email and hope he can work with you on fixing the locale setup properly16:57
elmikonp, thanks for bringing it up AJaeger16:57
crobertsrhNo problem.  Thanks for providing the fix.16:57
AJaegerright now the missing locale link shouldn't cause any harm - but before mitaka you need this fixed16:57
openstackgerritVitaly Gridnev proposed openstack/sahara-dashboard: implement health checks in sahara-dashboard  https://review.openstack.org/27606716:58
*** rcernin has quit IRC16:58
*** AJaeger has left #openstack-sahara16:59
*** degorenko is now known as _degorenko|afk16:59
*** vgridnev has quit IRC17:00
*** vgridnev has joined #openstack-sahara17:00
*** vgridnev has quit IRC17:01
tmckaycrobertsrh, ping17:06
crobertsrhyes?17:06
tmckayhey, just looking at the cluster reorg (using it). I haven't updated for a few days, but the image registry tab is labeled "Data Image Registry"17:07
tmckaythat17:07
tmckaythat's kind of a weird name, isn't it?17:07
crobertsrhYes17:08
tmckayWhat's a data image?17:08
crobertsrhIt came from when we moved into horizon.17:08
tmckayah. are we changing it?17:08
crobertsrhWe can probably just remove the "data" part17:08
tmckay++, I would17:08
tmckayI mean, I knew what it was ... but17:08
rickflarehowdie guys17:09
tmckayIf anything it's a "node image registry" or something17:09
crobertsrhI agree, kinda awkward.17:09
tmckayhi rickflare17:09
crobertsrhhello rickflare17:09
rickflarestarting to look at hotels17:09
rickflareand flights17:09
rickflaregetting from DC to Austin is going to suck17:10
tmckay:) yeah, not great for me either17:10
crobertsrhCan't be that bad17:10
rickflareare you guys going to be there the entire week?17:10
crobertsrhI will be there the whole week17:10
rickflareim debating if I need to be there for the whole week17:10
tmckayrickflare, if you use the summit hotel links, just make sure you check the rate rules and get something cancelable if you think you might end up bailing17:10
tmckayrickflare, yeah, end of the week is design summit stuff17:11
rickflareright17:11
tmckayStay through at least Weds afternoon17:11
tmckayThurs and Fri will be all devs17:11
rickflareyea17:11
tmckayrickflare, if you have a manifesto for Sahara, though, you should stay and deliver it17:11
rickflareok17:11
rickflareim thinking the entire week17:11
crobertsrhYeah, we have had users drop by our sessions in the past.17:12
rickflarebecause I need to address some buisness isuses17:12
tmckayFriday afternoon will taper off, usually everyone has brain fry by about 3pm on Frid17:12
rickflareand the first days seem to be buisness17:12
tmckayyep, for sure17:12
tmckayall the business interests for the most part go home on Weds17:12
rickflareyea17:15
rickflareso I need both17:15
rickflareim going to be fried17:15
rickflarehave you guys had a summit in DC?17:15
elmikodon't think so17:15
rickflareok17:16
rickflareI am not sure I am going to be able to send my entire team17:16
rickflarewhich sucks17:16
rickflarebut i should def be there17:16
elmikounderstandable though, it's an expensive event17:16
rickflareyea17:18
rickflarei mean even if I can get in free17:18
rickflarethe hotel and flight is going to be a grand17:18
elmikowow, you got a good deal17:18
elmikoi think my flight+hotel for the week is closer to 2k17:18
rickflarereally17:19
elmikoyea17:19
rickflareim thinking of going the super cheap route17:19
rickflarelol17:19
rickflarebut17:19
rickflarewe shall see17:19
rickflareim on this silly diet17:19
rickflarei gained so much weight since grad school17:19
rickflaresitting all day does not help17:19
elmikoyea, it happens...17:20
rickflareim trying to get back17:20
rickflareand boy oh boy17:20
tmckayI packed a blender for Tokyo :)17:20
rickflareremoving sugar from my diet sucks17:20
tmckayfruit smoothies in the hotel17:20
rickflareI used to be a ripped running back17:21
elmikotmckay: seriously?17:21
tmckayyep17:21
elmikonice!17:21
tmckaymagic bullet17:21
rickflarethats smart17:21
elmikoawesome17:21
rickflareso easy to eat crap17:21
rickflareits not even funny17:21
tmckayI found almond milk and fruit in the grocery store at the train station17:21
elmikoi had too much fun trying out all the japanese food i love XD17:22
tmckaywondered if TSA was going to care that there was a blender in my suitcase17:22
elmikoyea really17:22
tmckayelmiko, I did that too17:22
elmikohaha!17:22
tmckaybut I tried to skip a meal here or there :)17:22
elmikobut, you also had nice smoothies whenever you wanted ;)17:22
elmikoprobably wise17:22
rickflareI hope to be down at least 2017:23
rickflareby the event17:23
tmckayrickflare, if you get a hotel reall far from the convention center, you will probably save $$ and you can lose weight walking back and forth17:23
crobertsrhDon't get too ripped rickflare, the sahara dev squad is not ready for a Royal Rumble.17:23
openstackgerritMerged openstack/sahara-dashboard: Unbreak "setup.py install"  https://review.openstack.org/28242217:23
tmckay2-3 miles ought to do it17:23
elmikocrobertsrh: +117:24
*** Akanksha08 has joined #openstack-sahara17:24
rickflareLOL17:24
rickflaredude17:24
rickflareso far from that17:24
rickflareI still have been known to DDT random people17:24
crobertsrhIt happens17:24
elmikoi think i could do a fair hacksaw jim duggins impression, if needed17:25
crobertsrhI'm a little surprised you choose DDT over the figure 417:25
tmckayoh man, hacksaw17:25
tmckayI forgot17:25
elmikoi just need to know if i should pack the 2x417:25
crobertsrhelmiko: ++17:25
tmckayRemember Hilbilly Jim?17:25
elmikotmckay: oh yea!17:25
elmikowhat was his brother/tag-team partners name?17:25
tmckaydon't recall17:26
elmikothey were both giant hillybilly types17:26
tmckayyeah, vague memory17:26
* crobertsrh can't keep up with your breadth and depth of wrestling knowledge17:26
rickflarelol17:26
tmckayAnd Randy Savage, of course. The macho man ruled.17:26
elmikowow... he tag teamed with Hulk and Andre. serious respect17:27
rickflareremember Junk Yard Dog?17:27
tmckayyep17:27
elmikoi'm from detroit, ofc i remember the Dog!17:27
rickflareim built like him17:27
rickflarereally!17:27
elmikoDick the Bruser too17:27
elmikoer Bruiser17:27
rickflareIm orginally from Cleveland17:27
tmckayGeorge the Animal Steele17:27
elmikoyea, him too!17:28
tmckaynobody ate a turnbuckle like that guy17:28
elmiko+117:28
elmikoalso from detroit, iirc17:28
elmikohe was a high school football coach17:28
rickflareRazor Raymone17:29
rickflarehttp://www.accelerator3359.com/Wrestling/pictures/hacksaw2.jpg17:29
rickflarehoooooooooooooooo17:29
*** rcernin has joined #openstack-sahara17:30
* tmckay lunch17:31
*** vgridnev has joined #openstack-sahara17:40
*** tellesnobrega_af is now known as tellesnobrega17:49
tmckayhey, what do you know. both spark 131 and spark 160 work without the jackson jar specified in the driver classpath. that was a hack to fix a discrepancy in the spark assembly jar in 1.0. Maybe we can remove that arg ...18:10
* tmckay tests some more18:10
*** vgridnev has quit IRC18:11
*** vgridnev has joined #openstack-sahara18:12
*** vgridnev has quit IRC18:13
*** vgridnev has joined #openstack-sahara18:14
*** vgridnev has quit IRC18:14
*** vgridnev has joined #openstack-sahara18:15
*** chlong_ has quit IRC18:18
crobertsrhtmckay:  cool re: jackson18:23
tmckayyeah, get rid of potential future damage and present confusion18:24
crobertsrhdefinitely18:25
tmckaylooks like a win, gonna erase it from sahara and launch fresh 131 and 160 (but modifying existing worked)18:25
*** krotscheck has quit IRC18:25
*** ruhe has quit IRC18:25
tmckaycould hold for cdh as well, etc18:25
*** krotscheck has joined #openstack-sahara18:25
*** ruhe has joined #openstack-sahara18:26
*** _degorenko|afk has quit IRC18:27
*** rickflare has quit IRC18:27
*** david-lyle has joined #openstack-sahara18:27
*** rickflare has joined #openstack-sahara18:28
*** _degorenko|afk has joined #openstack-sahara18:28
openstackgerritJulian proposed openstack/sahara: Add package installation methods to ssh_remote util  https://review.openstack.org/28205818:34
rickflareso guys18:35
rickflaredoes sahara have a methond for load balancing jobs18:35
rickflarekind of like what apache mesos does18:35
tmckayonly whatever is available from the framework itself, I believe. so if hadoop or spark does it, can be configured to do it, then it would be available18:37
rickflareok18:37
tmckaywe thought a little about having some kind of mesos deployment plugin18:38
tmckaymaybe we should revisit it18:38
rickflarethat would be hawt!18:38
tmckayrickflare, now, the individual distros might provide something. Meaning, if launch an hdp or cdh cluster, those vendors may have some kind of load balancing built in18:39
tmckayyou'd have to read up on the distros from Hortonworks or Cloudera (or ask someone here who knows them in more detail)18:40
rickflareim very familar with cloudera18:40
rickflareand they dont18:40
rickflareunless you use cloudera manager18:40
rickflareand im sure horton works is along the same lines18:41
tmckayright, I think we use the clouder manager api under the hood, though. Not sure if that's a subset18:41
rickflarereally18:42
tmckayvgridnev, do you or someone you know have answers for these questions?  ^^18:42
rickflarethat would be shocking18:42
tmckayI know there is some cm_api python file in there, I forget the details18:42
rickflareI would assume its the cloudera rpms only18:42
rickflareahh18:42
tmckayrickflare, http://docs.openstack.org/developer/sahara/userdoc/cdh_plugin.html18:46
tmckay"The Cloudera plugin is a Sahara plugin which allows the user to deploy and operate a cluster with Cloudera Manager."18:46
rickflareso if that is the case18:47
rickflarerestarting services has to be simple18:47
tmckayso the question is whether or not the stuff you're looking for is in the images18:47
rickflarei had no idea its really using cloudera manager18:47
rickflarethats huge18:47
rickflareI wonder if the cloudera manager guy18:47
rickflaregui is running18:48
tmckayI think it is -- if you spin up a cluster, I think you can link to the cloudera gui. Should be available from cluster details18:48
rickflareim about to18:48
tmckay(click on the cluster name hyperlink, scroll down)18:48
rickflarethe last time I did this which was some time ago18:48
rickflareI didnt see it18:49
* rickflare building images like a mad man18:49
tmckayrickflare, by the same token, the hdp stuff uses ambari18:49
tmckayand the ambari gui is also there18:49
rickflaredamnn18:49
rickflareyou guys dont eff around18:50
tmckayand the truth is, you can get to the apache hadoop guis too18:50
rickflarewhen did ambari get in there18:50
tmckaybeen there since the beginning of the hdp plugin. It was always the provisioning mechanism for hdp18:50
tmckaythe spark standalone plugin is much lighter weight18:51
rickflareinteresting18:52
* rickflare has used puppet for its deployment for years18:52
rickflarenot all the way up on ambari18:52
*** rcernin has quit IRC18:56
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/28249818:56
openstackgerritAkanksha Agrawal proposed openstack/sahara: Improves anti-affinity behavior in sahara  https://review.openstack.org/28250619:00
openstackgerritAkanksha Agrawal proposed openstack/sahara: Improves anti-affinity behavior in sahara  https://review.openstack.org/28250619:02
rickflareguys19:11
rickflareanyone know why I am getting this in the sahara image elements build19:11
rickflarehttp://pastebin.com/6xbjCaRS19:12
elmikohmm19:13
elmikofeel like i've seen that one before19:13
crobertsrhI think that's normal to see that19:13
crobertsrhoh wait19:13
crobertsrhthe FAILED part is not normal :)19:13
rickflarelol19:13
crobertsrhwhat's the command that you ran?19:14
rickflaregot another build running19:14
rickflareat the moment19:14
rickflarebasicall tox19:14
rickflarefedora19:14
rickflarechd 5.419:14
rickflarejava-oracle19:15
*** rcernin has joined #openstack-sahara19:23
openstackgerritAkanksha Agrawal proposed openstack/sahara: Improves anti-affinity behavior in sahara  https://review.openstack.org/28250619:24
crobertsrhrickflare:  I'll give your command a try whenever you have it.  Could be a bug, I suppose.19:26
rickflareim ready19:26
crobertsrhok19:27
rickflare?19:34
crobertsrhI was waiting to see you exact command that you ran19:38
rickflareoh19:41
rickflaresorry19:41
rickflaretox -e venv -- sahara-image-create -i fedora -p cloudera -v 5.4 -j oracle-java19:41
crobertsrhInteresting.  I get.  'fedora' image type is not supported by 'cloudera'19:42
crobertsrhI suppose that is from the latest sahara-image-elements (master) though19:43
rickflaresory19:43
rickflarei used centos19:43
crobertsrhso instead of -i fedora, you went with -i centos?  Got it.19:43
rickflareyea19:44
*** rcernin has quit IRC19:45
crobertsrhbeen awhile since I've built a cdh image, I forgot how long it takes :)19:55
rickflareyea19:56
openstackgerritAkanksha Agrawal proposed openstack/sahara-specs: Spec about improving anti-affinity behavior in sahara  https://review.openstack.org/26920219:56
rickflareive got a gbit link19:57
rickflareand its still slow19:57
crobertsrhIf it makes you feel any better, I just got the same failure that you did.  ip6tables: Saving firewall rules to /etc/sysconfig/ip6table[FAILED]19:58
crobertsrhSounds like a bug19:58
rickflareawww man19:58
rickflareim finding bugs like crazy19:58
* rickflare feels like he is helping now19:59
crobertsrhI wonder if it's in any way related to:  https://bugs.launchpad.net/sahara/+bug/150053019:59
openstackLaunchpad bug 1500530 in Sahara "Sahara-Image-Elements Fails to generate a Centos image that will boot" [High,Triaged]19:59
crobertsrhdifferent symptoms, but still a problem with Centos image19:59
rickflarethat is my bug19:59
rickflareas well19:59
rickflarei submitted that one19:59
crobertsrhah :)19:59
rickflareshould I open a new one20:00
rickflareor piggy on that one?20:00
crobertsrhI would say new bug20:00
crobertsrhI'm looking to see if it may have already been discovered, but no dice so far20:00
rickflarehttps://bugs.launchpad.net/sahara/+bug/154765320:04
openstackLaunchpad bug 1547653 in Sahara "Sahara Image Elements Fails to build Centos or Fedora images using Cloudera CDH 5.4" [Undecided,New]20:04
crobertsrhthanks rickflare.  I have triaged it.20:06
rickflarenp20:07
crobertsrhHopefully, someone really smart like pino|work will look at it soon.20:07
tmckayhey, do you guys know how to search for completed blueprints?20:08
tmckayI can never find them20:08
rickflaredude my blueprint is going to be epic20:08
rickflareits going to be like Jay-z The Blue Print20:08
rickflareRickflare - The Blue Print20:08
crobertsrhtmckay:  I think you can list all with:  https://blueprints.launchpad.net/sahara/+specs?show=all20:08
crobertsrhrickflare:  You're going to have us all excited to read it.20:09
tmckayI'm looking for deprecate-spark-100 which was completed -- time to remove, supposed to be gone for mitaka release20:09
tmckayand it affects my drop of jackson arg20:10
tmckayI suppose the deprecation and actual removal are different ....20:10
crobertsrhhttps://blueprints.launchpad.net/sahara/+spec/deprecate-spark-10020:10
tmckayhow did you do that?20:10
tmckayjust built the path by hand?20:11
tmckaysearch skips them20:11
crobertsrhNo, found the link by paging through the show=all link20:11
crobertsrhit was only on like page 220:11
tmckaycrazy, I thought I did too20:11
rickflareguys are you allowed to post youtube links here?20:11
tmckayoh well, fine I'll reference the same one. thanks20:11
crobertsrhrickflare, sure20:12
rickflarehttps://www.youtube.com/watch?v=xpOiGkF7i-Y&index=3&list=PLQw3xggCuGQVKiKvd-y4vXS3EW0_lLxz620:12
tmckaygoverned by openstack :)20:12
rickflarewhen I submit my blueprint20:12
rickflareimagine this playing20:12
crobertsrhwas that your inspiration?20:12
rickflarewhen i walk into the austin summit20:12
rickflarelol20:13
tmckayshould be "urls, urls, urls"20:13
rickflarelol20:13
rickflareurls20:13
rickflareROFL20:13
crobertsrhAfter all the wooooooos, I'm pretty sure I'll be hearing:  https://www.youtube.com/watch?v=VH7LT7emjMU instead20:13
rickflareWHOOOOOOOOOOOOOOOO20:14
* rickflare thinks he might buy a blond wig20:14
elmikolol20:15
* crobertsrh is disappointed that it'll be a wig20:15
rickflarelol20:16
rickflareyea my hair is not blond by any strech20:17
rickflarelol20:17
tmckaythe nature boy, I forgot about that part20:21
rickflareoh ya20:29
*** tellesnobrega is now known as tellesnobrega_af20:35
openstackgerritTrevor McKay proposed openstack/sahara: Remove support for spark 1.0.0  https://review.openstack.org/28252820:41
openstackgerritTrevor McKay proposed openstack/sahara: No longer necessary to specify jackson-core-asl in spark classpath  https://review.openstack.org/28252920:49
*** tellesnobrega_af is now known as tellesnobrega20:53
openstackgerritTrevor McKay proposed openstack/sahara: Add default templates for spark plugin, version 1.6.0  https://review.openstack.org/28253020:59
openstackgerritMatt Riedemann proposed openstack/sahara: Fix gate pep8  https://review.openstack.org/28253321:09
*** Akanksha08 has quit IRC21:14
*** vgridnev has quit IRC21:35
*** dave-mccowan has quit IRC21:44
*** crobertsrh is now known as _crobertsrh21:48
*** akuznetsov has joined #openstack-sahara21:53
*** dave-mccowan has joined #openstack-sahara21:57
openstackgerritMatt Riedemann proposed openstack/sahara: Fix gate pep8  https://review.openstack.org/28253321:57
openstackgerritSergey Reshetnyak proposed openstack/sahara: [test] Revert "Fix gate pep8"  https://review.openstack.org/28254621:58
*** akuznetsov has quit IRC22:05
*** tmckay has left #openstack-sahara22:10
*** francois has quit IRC22:29
openstackgerritSergey Reshetnyak proposed openstack/sahara: Revert "Fix gate pep8"  https://review.openstack.org/28254622:45
*** david-lyle has quit IRC22:50
*** david-lyle has joined #openstack-sahara22:51
*** david-lyle has quit IRC22:54
*** david-lyle has joined #openstack-sahara22:54
*** sgotliv has joined #openstack-sahara22:56
*** sgotliv has quit IRC23:13
*** david-lyle_ has joined #openstack-sahara23:29
*** david-lyle has quit IRC23:30
« Thursday, 2016-02-18 Index Saturday, 2016-02-20 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!