Tuesday, 2015-09-01

« Monday, 2015-08-31 Index Wednesday, 2015-09-02 »
*** hdd has joined #openstack-sahara00:04
*** hdd has quit IRC00:30
*** hdd has joined #openstack-sahara00:33
*** hdd has quit IRC00:54
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/21907900:55
*** chlong has joined #openstack-sahara01:02
*** larainema has joined #openstack-sahara01:41
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/21907901:47
*** larainema has quit IRC01:47
*** larainema has joined #openstack-sahara01:47
*** madong_ has joined #openstack-sahara01:57
*** larainema has quit IRC02:01
*** larainema has joined #openstack-sahara02:04
*** madong_ has quit IRC02:04
*** tmckay has joined #openstack-sahara02:55
*** larainema has quit IRC02:55
*** tmckay has quit IRC03:05
*** larainema has joined #openstack-sahara03:07
*** chlong has quit IRC03:12
*** larainema has quit IRC03:21
*** larainema has joined #openstack-sahara03:21
*** chlong has joined #openstack-sahara03:38
*** larainema has quit IRC03:42
*** larainema has joined #openstack-sahara03:43
*** links has joined #openstack-sahara03:46
*** ashishb has joined #openstack-sahara03:51
openstackgerritlu huichun proposed openstack/sahara: [sahara doc fix] update the statuses.rst in userdoc  https://review.openstack.org/21892503:52
*** chlong_ has joined #openstack-sahara04:04
*** chlong has quit IRC04:04
*** ashishb has quit IRC04:05
*** ashishb has joined #openstack-sahara04:06
*** ashishb has quit IRC04:11
*** saneax has joined #openstack-sahara04:15
*** ashishb has joined #openstack-sahara05:26
*** larainema has quit IRC05:35
*** Poornima has joined #openstack-sahara05:35
*** larainema has joined #openstack-sahara05:36
*** larainema has quit IRC05:41
*** larainema has joined #openstack-sahara05:41
*** nkrinner has joined #openstack-sahara05:51
*** hdd has joined #openstack-sahara05:58
*** Poornima has quit IRC06:00
*** Nikolay_St has quit IRC06:11
*** Poornima has joined #openstack-sahara06:20
*** hdd has quit IRC06:44
*** Nikolay_St has joined #openstack-sahara06:58
*** witlessb has joined #openstack-sahara07:12
*** chlong_ has quit IRC07:24
*** sgotliv has joined #openstack-sahara07:54
*** ashishb has quit IRC08:06
openstackgerritKen Chen proposed openstack/sahara: Enable anti_affinity feature in scenario test  https://review.openstack.org/21917008:06
*** pino|work has joined #openstack-sahara08:38
*** tosky has joined #openstack-sahara09:02
openstackgerritNikita Konovalov proposed openstack/sahara: [doc-day] Updated development environment guide  https://review.openstack.org/21919509:07
*** degorenko has joined #openstack-sahara09:22
openstackgerritEvgeny Sikachev proposed openstack/sahara: Add missing ssl_verify for swift in scenario tests  https://review.openstack.org/21775509:26
*** esikachev has joined #openstack-sahara09:38
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add wait condition for heat templates  https://review.openstack.org/16933809:41
*** ashishb has joined #openstack-sahara09:45
*** coolsvap has quit IRC10:01
*** coolsvap has joined #openstack-sahara10:02
openstackgerritDong Ma proposed openstack/sahara: Added CORS middleware to Sahara  https://review.openstack.org/21921910:19
*** h00327910__ has quit IRC10:43
openstackgerritKazuki OIKAWA proposed openstack/sahara: Adds IPv6 support to auto security group  https://review.openstack.org/21758111:09
*** chlong_ has joined #openstack-sahara12:09
*** Poornima has quit IRC12:11
*** tmckay has joined #openstack-sahara12:22
*** raildo is now known as raildo-afk12:40
*** _crobertsrh is now known as crobertsrh12:41
*** vgridnev has joined #openstack-sahara12:50
*** vgridnev has quit IRC12:51
openstackgerritKazuki OIKAWA proposed openstack/sahara: Selects IPv4 preferentially for internal_ip  https://review.openstack.org/21766912:53
*** sgotliv has quit IRC13:38
*** saneax has quit IRC13:42
*** egafford has joined #openstack-sahara13:44
*** sgotliv has joined #openstack-sahara13:52
*** esikachev has quit IRC14:16
*** esikachev has joined #openstack-sahara14:17
*** links has quit IRC14:23
*** ashishb has quit IRC14:26
openstackgerritMichael McCune proposed openstack/sahara: Updating userdoc overview  https://review.openstack.org/21905614:34
*** Nikolay_St has quit IRC14:41
*** hdd has joined #openstack-sahara14:47
*** nkrinner has quit IRC14:53
*** links has joined #openstack-sahara14:57
*** links has quit IRC15:16
*** esikachev has quit IRC15:25
openstackgerritMichael McCune proposed openstack/sahara: updating plugins doc  https://review.openstack.org/21931415:32
openstackgerritMichael McCune proposed openstack/sahara: updating index doc  https://review.openstack.org/21931515:36
openstackgerritMerged openstack/sahara-image-elements: [HDP2] Add ambari element  https://review.openstack.org/18173215:37
*** esikachev has joined #openstack-sahara15:44
egaffordelmiko, tmckay, SergeyLukjanov, Everyone interested in Zaqar guest agent stuff: talking with some folks from the Trove team, and I should note that they're actually considering moving back from a guest agent model to ssh tunnels. :p Largely r/t security problems around tenant-to-control-plane communication (which they have via Rabbit.)15:52
egaffordClearly not precisely the issues we'd run into as part of that epic, but it might be worth talking to them about guest agent concerns before running too far in that direction.15:53
egaffordelmiko: Is there any architectural prescription from the security group about how post-launch communication between the control and tenant planes in a public cloud *should* be done?15:53
elmikoegafford: i don't think so, but i'm hoping to talk about it this week15:56
egaffordelmiko: +1.16:02
elmikoalso, grab more docs!16:02
egaffordelmiko: Just got out of some RH-internal Stuff (packaging.) Grabbing docs now!16:03
elmikothanks =)16:03
egaffords/out/done/16:03
*** esikachev has quit IRC16:08
openstackgerritMerged openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/21891716:19
*** sgotliv has quit IRC16:21
egaffordelmiko: OpenStack Block Storage (cinder) should be OpenStack Block storage (cinder), right? (Only one capitalized letter in the service type description?)16:21
elmikono, looks like its Block Storage16:22
elmikohttps://wiki.openstack.org/wiki/Documentation/Conventions#OpenStack.2C_not_Openstack_or_openstack16:22
egaffordHuh, neat.16:22
toskyelmiko, egafford: wasn't it changed recently?16:22
egaffordAh, so there's no actual logic for that, just canon in each case.16:23
elmikolet me see if i can find the governance page about this16:23
egaffordelmiko: No acute need.16:23
elmikook16:24
elmikotosky: changed from Block Storage?16:24
toskyelmiko: I remember some changes to the naming, mainly involving capitalization16:24
elmikohuh...16:25
*** Nikolay_St has joined #openstack-sahara16:25
elmikostill caps here too, http://governance.openstack.org/reference/projects/cinder.html16:25
elmikobut that may be old or something16:25
elmikostill caps here too https://github.com/openstack/governance/blob/master/reference/projects.yaml16:26
toskybah, I can't find the email16:29
toskyI probably dreamt of it16:35
elmikolol16:35
elmikojust like i dreamt about sahara going from Data processing to Data Processing ;)16:36
*** david-ly_ has joined #openstack-sahara16:49
*** david-lyle has quit IRC16:49
openstackgerritEthan Gafford proposed openstack/sahara: Documentation for Manila integration  https://review.openstack.org/21936117:04
elmikoegafford: my only issue with that patch is that we shouldn't be capitalizing manila17:06
elmikoi'm not really sure how we should handle the consistency of caps across these docs17:06
egaffordelmiko: Respect. I followed suit with the current doc, and have that as a doc that I'm addressing.17:06
egaffordI wanted to get the doc in, in keeping with the current regime in those docs, then ransack them as part of the doc week push.17:07
elmikoegafford: cool, i guess i'm ok with letting some of these through. i just think we will need to seriously do some cleanup during M17:07
*** david-ly_ has quit IRC17:07
elmikocool17:07
egaffordI'm writing the interface argument doc now, and then I'm going to hit features and edp like a 125 pound freight train.17:07
elmikoawesome =)17:07
egaffordWhich is to say, not very much like a freight train at all, but.17:07
elmikolol17:07
*** ashishb has joined #openstack-sahara17:16
openstackgerritMichael Krotscheck proposed openstack/sahara: Added CORS middleware to Sahara  https://review.openstack.org/21921917:40
*** david-lyle has joined #openstack-sahara17:54
openstackgerritEthan Gafford proposed openstack/sahara: Documenting interface map  https://review.openstack.org/21938117:58
*** krotscheck has joined #openstack-sahara17:58
krotscheckAnyone know "Vitaly"'s irc nick? I did a thing that I think addressed his question on a review, but his comment assumed too much context and I'd like more details.18:00
elmikokrotscheck: vgridnev18:00
krotscheckelmiko: Thanks. Not online. Doh.18:01
elmikoyea, he is in UTC+3 i think, so probably sleeping18:01
openstackgerritMichael Krotscheck proposed openstack/sahara: Added CORS middleware to Sahara  https://review.openstack.org/21921918:01
*** david-lyle has quit IRC18:01
egaffordHi krotscheck. I think you might not have hit the heart of what Vitaly is saying. If you look at our tox config, you'll see that we have a "genconfig" configuration that introspects through the project and generates the config.18:04
egaffordkrotscheck: If you run tox -e genconfig, and you don't see the config settings your're trying to create in the generated sahara.conf.sample file, then there may be more work to do.18:05
krotscheckegafford: So adding the namespace to tools/config/config-generator.sahara.conf is not the right thing to do?18:05
*** vgridnev has joined #openstack-sahara18:05
egaffordkrotscheck: Oh, I'm sorry!18:05
egaffordI was looking at patchset 2 somehow.18:06
krotscheckNo worries :)18:06
krotscheckwhew18:06
krotscheckI was worried I'd have to do another thing18:06
egaffordIf you've run tox -e genconfig and you see your namespace, then yes, I earnestly believe you've done what Vitaly asked.18:06
egafford:)18:06
krotscheckwoot18:08
elmikolgtm to me krotscheck18:08
krotscheckelmiko: danke :)18:09
vgridnevyep, that is correct18:09
egaffordvgridnev: Out of curiosity, do you sleep?18:09
vgridnevyes18:10
egaffordNice. Good call.18:10
vgridnevbut why are you asking?18:10
egaffordIt's just fairly late for you, isn't it?18:10
vgridnevactually no18:11
egaffordOh, cool.18:11
vgridnevit's 9 p.m18:11
egaffordYeah, that's not that bad. Okay, I think my sense of time zones is off.18:11
*** vgridnev has quit IRC18:13
elmikohis computer is sleepy ;)18:15
*** david-lyle has joined #openstack-sahara18:19
openstackgerritMerged openstack/sahara: Updating the dev environment guide for the Sahara UI  https://review.openstack.org/21898918:22
*** stanchan has joined #openstack-sahara18:33
*** vgridnev has joined #openstack-sahara18:46
egaffordtellesnobrega: ping18:48
tellesnobregaegafford, pong18:49
*** ashishb has quit IRC18:49
egaffordtellesnobrega: on https://review.openstack.org/#/c/219361/1/doc/source/userdoc/edp.rst, I'm keeping consistency within the doc for this change in terms of capitalization, and I'm working on a patch now to correct that throughout the whole doc.18:49
tellesnobregaegafford, huum, sounds great18:50
tellesnobregachanging my review18:50
egaffordAlso, I actually like "in the [], in [], or in []"; because one of them needs the definite article, it gets a little awkward to say "in the sahara internal database, swift, or manila." Kind of makes it uncertain whether we're saying "the swift" and "the manila."18:51
egaffordtellesnobrega: Cool; I totally agree with your comment about caps, though. Just trying to keep that change consistent and limited.18:52
*** vgridnev has quit IRC18:52
tellesnobregaegafford, sure, that was just a suggestion, the thing that got me was the capitalization18:52
tellesnobregasince its on the way on a different patch i'm ok with that18:52
egaffordtellesnobrega: Totally.18:52
*** raildo-afk is now known as raildo18:53
elmikoegafford, tellesnobrega, i added a small question to https://review.openstack.org/#/c/219314/119:12
elmikojust curious on your thoughts19:12
tellesnobregaelmiko, responded you there, i agree with you, the more generic the best19:16
elmikotellesnobrega: cool, thank you19:16
openstackgerritMichael McCune proposed openstack/sahara: updating plugins doc  https://review.openstack.org/21931419:18
openstackgerritMichael McCune proposed openstack/sahara: updating index doc  https://review.openstack.org/21931519:21
tellesnobregaelmiko, im not sure if the "...or distribution..." sounds good.19:22
tellesnobregamaybe something like: sahara to deploy a specific data processing framework distribution(for example,Hadoop)19:22
elmikotellesnobrega: good point, i was trying to mention the CDH/MapR/HDP stuff19:23
tellesnobregaor am i missing something on the sentence?19:23
egaffordelmiko: Totally agreed, and yeah, I thought about suggesting to remove distribution, but I think it's best to leave it.19:23
tellesnobregaegafford, elmiko ok19:23
egafford(To distinguish between different engines as such and different corporations' packagings / extensions of those engines.)19:24
elmikoi guess technically it would be "data processing framework(such as Hadoop) or distribution (such as Cloudera)" but that's awkward19:24
elmikoegafford: yea19:24
egaffordelmiko: Yeah, but specifying a single example distro gets awkward.19:26
elmikoegafford: agreed19:31
*** goodygum has quit IRC19:34
*** whydidyoustealmy has quit IRC19:34
*** goodygum has joined #openstack-sahara19:35
*** whydidyoustealmy has joined #openstack-sahara19:35
*** whydidyoustealmy has quit IRC19:35
*** whydidyoustealmy has joined #openstack-sahara19:35
*** vgridnev has joined #openstack-sahara19:36
*** vgridnev has quit IRC19:38
egaffordAnyone remember off the top of their heads which CDH versions support Namenode HA?19:39
egaffordI think it's just 5.4.0.19:39
*** vgridnev has joined #openstack-sahara19:45
*** goodygum has quit IRC19:47
egaffordtmckay: Is Swift integration supported in the Spark plugin?19:49
tmckayyes19:52
*** goodygum has joined #openstack-sahara19:52
tmckayegafford, that is where it was originally supported19:52
*** sgotliv has joined #openstack-sahara19:54
*** vgridnev has quit IRC19:54
*** vgridnev has joined #openstack-sahara19:56
egaffordtmckay: Curious; it's down as N/A in the feature matrix.20:00
egaffordIs there a reason for that that you can imagine?20:00
elmikocrobertsrh: so, about adding barbican and manila to the overview. manila for sure, but should we mention barbican?20:02
crobertsrhIt is sorta supported, right?20:02
elmikokinda sorta, it's definitely on the way but not integrated yet20:03
crobertsrhOk.  I'm ok with leaving it out if it's really just kinda sorta.20:03
elmikoi have a patch to put up that will start the integration, but i don't want to add something that just breaks unittests20:03
elmikoyea, i agree, we can always patch the docs when it gets in20:03
tmckayegafford, not sure why it's listed as N/A, maybe just out of date20:06
crobertsrhSounds good20:06
tmckaySpark/Swift for the spark plugin was definitely the plan20:07
openstackgerritEthan Gafford proposed openstack/sahara: Minor updates and fixes to features doc  https://review.openstack.org/21943520:07
egaffordtmckay: Which CDH versions support the Spark job type at the moment?20:12
*** Erming_ has joined #openstack-sahara20:12
egaffordAt the moment, our EDP doc doesn't think CDH does Spark at all.20:12
egaffordtmckay: Looks to me like 5.3 and 5.4.20:14
elmikocrobertsrh, egafford, tmckay, what is the official service name for manila?20:24
crobertsrhshare or shares...lemme check20:24
crobertsrhoh...type is "share".  name is manila20:25
elmikoso, it's the OpenStack Share service?20:27
tmckayegafford, yes, 5.3 and 5.420:28
crobertsrhOh, I thought you were talking about name and type with respect to Keystone :)20:29
crobertsrhI think I've seen it called the Manila File Share Service.20:29
elmikomaybe its the OpenStack File Share service then?20:30
crobertsrhThat seems like a reasonable thing to call it20:30
*** Nikolay_St has quit IRC20:31
openstackgerritMerged openstack/sahara: New version of HDP plugin  https://review.openstack.org/18429220:31
egaffordelmiko: I assume we're not changing the doc object names for Job and Job Templates until v2?20:32
*** sgotliv has quit IRC20:35
crobertsrhegafford, correct20:38
openstackgerritMerged openstack/sahara: Add base services support for HDP 2.2 / 2.3  https://review.openstack.org/18510020:42
openstackgerritMerged openstack/sahara: Add EDP services to new HDP plugin  https://review.openstack.org/19458020:42
*** ashishb has joined #openstack-sahara20:45
*** ashishb has quit IRC20:49
openstackgerritMerged openstack/sahara: Add additional HDP services  https://review.openstack.org/19572620:50
elmikoegafford: correct20:53
*** tmckay has quit IRC20:57
elmikocrobertsrh: found it, the OpenStack Shared file systems service20:58
elmikothat's a mouthful20:58
crobertsrhWhere is the definitive source?20:58
elmikoi looked here, http://governance.openstack.org/reference/projects/manila.html20:59
elmikoi figure if governance doesn't know, who does...20:59
crobertsrhfantastic20:59
elmikocan manila also be used for job storage?21:01
*** raildo is now known as raildo-afk21:02
elmikoegafford ^21:03
crobertsrhelmiko, you mean as a data source?21:05
crobertsrhlike for job I/O?21:06
crobertsrhIt can store the binaries for a job as well as the I/O.21:06
elmikoyea, job binaries is what i meant.21:06
crobertsrhYep, they can live on a manila share ftw.21:08
*** crobertsrh is now known as _crobertsrh21:08
elmikocool21:08
*** Erming_ has quit IRC21:11
*** vgridnev has quit IRC21:22
*** vgridnev has joined #openstack-sahara21:22
*** vgridnev has quit IRC21:24
openstackgerritMichael McCune proposed openstack/sahara: Updating overview document  https://review.openstack.org/21897921:24
openstackgerritEthan Gafford proposed openstack/sahara: Minor updates to edp documentation  https://review.openstack.org/21945921:26
egaffordelmiko: Yeah, Manila can pretty much do what Swift can do at this point (though with much less topology awareness.)21:26
elmikocool, thanks egafford21:27
egafford(And only with NFS shares.)21:27
egaffordDo we have guidelines on line length in our docs?21:28
elmikoi think it's in doc conventions, 1sec21:28
elmikohmm, maybe not. i've seen it somewhere, can't find it now. imo it's better for us to conform to 79 char to make it easy on reviews and whatnot.21:29
*** vgridnev has joined #openstack-sahara21:30
*** vgridnev has quit IRC21:31
openstackgerritEthan Gafford proposed openstack/sahara: Minor updates to edp documentation  https://review.openstack.org/21945921:34
*** egafford has quit IRC21:35
*** hdd has quit IRC22:02
*** adelia has joined #openstack-sahara22:07
*** adelia has quit IRC22:08
*** adelia has joined #openstack-sahara22:08
*** adelia is now known as amwong22:10
*** amwong_ has joined #openstack-sahara22:19
*** amwong has quit IRC22:23
*** amwong_ has quit IRC22:24
*** pino|work has quit IRC22:35
*** tosky has quit IRC23:05
*** chlong_ is now known as chlong23:18
*** witlessb has quit IRC23:27
*** egafford has joined #openstack-sahara23:41
*** egafford has quit IRC23:41
*** stanchan has quit IRC23:54
« Monday, 2015-08-31 Index Wednesday, 2015-09-02 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!