| *** tellesnobrega has quit IRC | 00:05 | |
| *** witlessb has quit IRC | 00:21 | |
| *** tellesnobrega has joined #openstack-sahara | 00:45 | |
| *** Longgeek has joined #openstack-sahara | 01:13 | |
| *** Longgeek has quit IRC | 01:17 | |
| *** tellesnobrega has quit IRC | 02:34 | |
| *** tellesnobrega has joined #openstack-sahara | 02:40 | |
| *** tellesnobrega has quit IRC | 02:45 | |
| *** tellesnobrega has joined #openstack-sahara | 02:54 | |
| *** tellesnobrega_ has joined #openstack-sahara | 03:05 | |
| *** tellesnobrega has quit IRC | 03:06 | |
| *** Longgeek has joined #openstack-sahara | 03:21 | |
| *** Longgeek has quit IRC | 03:26 | |
| *** miqui has quit IRC | 03:38 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements https://review.openstack.org/130331 | 03:39 |
|---|---|---|
| *** tellesnobrega_ has quit IRC | 03:47 | |
| *** tellesnobrega has joined #openstack-sahara | 03:52 | |
| *** tellesnobrega has quit IRC | 04:15 | |
| *** tellesnobrega has joined #openstack-sahara | 04:34 | |
| *** Longgeek has joined #openstack-sahara | 05:39 | |
| *** chandankumar has joined #openstack-sahara | 05:48 | |
| *** tellesnobrega has quit IRC | 06:44 | |
| *** k4n0 has joined #openstack-sahara | 06:57 | |
| *** witlessb has joined #openstack-sahara | 08:21 | |
| *** witlessb has quit IRC | 08:26 | |
| *** Longgeek has quit IRC | 08:54 | |
| *** Longgeek has joined #openstack-sahara | 08:54 | |
| *** witlessb has joined #openstack-sahara | 09:04 | |
| *** stannie1 has joined #openstack-sahara | 09:07 | |
| *** IvanBerezovskiy has joined #openstack-sahara | 09:34 | |
| *** Longgeek has quit IRC | 09:51 | |
| openstackgerrit | A change was merged to stackforge/sahara-ci-config: Revert "Fix broken pep8-trunk job" https://review.openstack.org/130979 | 10:04 |
| *** Longgeek has joined #openstack-sahara | 10:04 | |
| *** tellesnobrega has joined #openstack-sahara | 10:16 | |
| *** tellesnobrega has quit IRC | 10:24 | |
| *** tellesnobrega has joined #openstack-sahara | 10:36 | |
| *** cchalla_ has joined #openstack-sahara | 10:39 | |
| *** tellesnobrega has quit IRC | 10:43 | |
| *** tellesnobrega has joined #openstack-sahara | 10:47 | |
| *** tellesnobrega has quit IRC | 10:51 | |
| *** tellesnobrega has joined #openstack-sahara | 10:55 | |
| *** tellesnobrega has quit IRC | 10:59 | |
| *** cchalla_ has quit IRC | 11:23 | |
| openstackgerrit | A change was merged to openstack/sahara: Fix bugs on doc registering an image https://review.openstack.org/131261 | 11:29 |
| openstackgerrit | A change was merged to openstack/sahara: Fix bugs on Sahara overview https://review.openstack.org/131260 | 11:30 |
| openstackgerrit | A change was merged to openstack/sahara: Fix bug on features.rst doc https://review.openstack.org/131254 | 11:38 |
| openstackgerrit | A change was merged to openstack/sahara: Fix bug on diskimagebuilder.rst https://review.openstack.org/131251 | 11:38 |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements https://review.openstack.org/130331 | 11:52 |
| openstackgerrit | A change was merged to openstack/sahara: Add scaling opportunity for fake plugin https://review.openstack.org/130502 | 11:53 |
| openstackgerrit | A change was merged to openstack/sahara: Add checks in fake plugin https://review.openstack.org/130810 | 11:53 |
| *** tellesnobrega has joined #openstack-sahara | 11:58 | |
| *** stannie1 has quit IRC | 12:03 | |
| *** Timotey has joined #openstack-sahara | 12:06 | |
| *** _mattf is now known as mattf | 12:19 | |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add distributed Sahara to CI https://review.openstack.org/130556 | 12:26 |
| *** miqui has joined #openstack-sahara | 12:36 | |
| *** k4n0 has quit IRC | 12:46 | |
| *** tmckay has joined #openstack-sahara | 13:00 | |
| *** crobertsrh has joined #openstack-sahara | 13:04 | |
| openstackgerrit | Sergey Reshetnyak proposed a change to openstack/sahara: Fix Cloudera plugin with CDH packages < 5.2.0 https://review.openstack.org/131421 | 13:06 |
| openstackgerrit | Andrey Pavlov proposed a change to openstack/sahara: Added ability to launch jobs on fake plugin https://review.openstack.org/130804 | 13:19 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add Sahara CI pypi mirror https://review.openstack.org/131426 | 13:28 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add Sahara CI pypi mirror https://review.openstack.org/131426 | 13:29 |
| openstackgerrit | Denis Egorenko proposed a change to stackforge/sahara-ci-config: Add Sahara CI pypi mirror https://review.openstack.org/131426 | 13:31 |
| *** mattf is now known as _mattf | 13:37 | |
| *** chandankumar has quit IRC | 14:07 | |
| *** miqui has quit IRC | 14:25 | |
| *** miqui has joined #openstack-sahara | 14:37 | |
| *** chandankumar has joined #openstack-sahara | 14:43 | |
| openstackgerrit | Corey Bryant proposed a change to openstack/sahara: Fix vanilla test_get_configs() for i386 https://review.openstack.org/131458 | 14:53 |
| openstackgerrit | Corey Bryant proposed a change to openstack/sahara: Fix vanilla test_get_configs() for i386 https://review.openstack.org/131458 | 15:10 |
| SergeyLukjanov | tmckay, crobertsrh, could you help me to write good titles and descriptions for design summit sessions? | 15:40 |
| crobertsrh | Sure. Do we have a pad to work on? | 15:40 |
| SergeyLukjanov | crobertsrh, still the same one - https://etherpad.openstack.org/p/kilo-sahara-summit-topics | 15:41 |
| crobertsrh | ack | 15:41 |
| elmiko | SergeyLukjanov: i updated the summary text on the security session, i tried to make it more usable for general purpose | 15:42 |
| tmckay | SergeyLukjanov, sure | 15:43 |
| SergeyLukjanov | thanks folks, so, please update the descriptions for sessions | 15:43 |
| SergeyLukjanov | and I'll push them to the sched today | 15:44 |
| SergeyLukjanov | to make folks able to plan their summit | 15:44 |
| tmckay | SergeyLukjanov, hmm, I think we need more words for HA and Production clusters | 15:49 |
| crobertsrh | Yes, I think that's what we're for tmckay :) | 15:50 |
| crobertsrh | Find a way to say what is there, but with several more words :) | 15:50 |
| tmckay | crobertsrh, but we're committing aignatov and dmitryme to what we say :) | 15:50 |
| elmiko | lol | 15:50 |
| tmckay | ok | 15:50 |
| tmckay | I can do that. "Lawyer up", in other words | 15:51 |
| crobertsrh | Kind of like ventriliquism | 15:51 |
| * tmckay mis-applies that phrase but you get what I mean | 15:51 | |
| *** Timotey has quit IRC | 15:52 | |
| crobertsrh | Yes, I totally get it :) | 15:54 |
| tmckay | SergeyLukjanov, okay, I made up stuff for Production clusters. Is it right? :) | 15:57 |
| tmckay | is that what we meant? | 15:58 |
| tmckay | croberts, we're overlapping | 15:58 |
| tmckay | one is I think how to make long-running robust, and one is what would you do with a long-running cluster .... ?? | 15:58 |
| tmckay | crobertsrh ^^ | 15:59 |
| *** miqui has quit IRC | 15:59 | |
| *** miqui_ has joined #openstack-sahara | 15:59 | |
| tmckay | I'm unsure of the intention (SergeyLukjanov, aignatov) | 15:59 |
| crobertsrh | You might be right there | 15:59 |
| tmckay | you and I said the same thing in different ways | 15:59 |
| crobertsrh | Maybe Prod use cases is more about which sorts of jobs we intend to run (Storm, etc)? | 16:00 |
| crobertsrh | We really nailed one of the descriptions though :) | 16:00 |
| elmiko | hmm, those 2 topics are pretty close in terms of their titles | 16:00 |
| tmckay | yeah. I'm not sure when aignatov had "HA" under use cases if he meant that you'd use Sahara for some sort of HA, or that it needs HA | 16:01 |
| tmckay | elmiko, yeah, we need help | 16:01 |
| tmckay | unless it's 2 sessions on the same thing because it's so big | 16:01 |
| elmiko | well, maybe the "clusters | 16:01 |
| elmiko | ahem.. | 16:01 |
| elmiko | maybe the "clusters" specific topic is more about the plugins, feature gaps, etc | 16:02 |
| elmiko | whereas the "use cases" is a more top down approach to everything about sahara in prod? | 16:02 |
| dmitryme | hey guys, just checked the descriptions. Look good to me, except we should swap topic for me and aignatov | 16:03 |
| dmitryme | ok, just did it | 16:03 |
| tmckay | dmitryme, we're concerned that we're describing the same thing in both topics | 16:03 |
| tmckay | both talk about making long-running robust | 16:03 |
| aignatov | ah, I have a meetings after a meeting today, will look at summit sessions later :) | 16:04 |
| dmitryme | tmckay: actually they are really close | 16:04 |
| aignatov | long-running for me I guess | 16:04 |
| tmckay | dmitryme, how do we make them distinct? | 16:04 |
| dmitryme | tmckay: good question | 16:05 |
| tmckay | lol. dmitryme, to me, "use case" sounds like "what do I use a long-running cluster for, versus a transient cluster?" | 16:06 |
| tmckay | and the other topic is "how do we make long-running clusters reliable and robust in Sahara?" For instance, spark loads lots of stuff to /tmp | 16:06 |
| tmckay | For long running, we definitely need to clean that stuff up | 16:06 |
| tmckay | For transient, who cares? | 16:06 |
| tmckay | So one is "what do I do with this, why do I want it?" and the other is "how do we as engineers make it work well?" | 16:07 |
| tmckay | Is that what we wanted? ^^ | 16:07 |
| tmckay | or maybe we are looking for ideas from the community about features to add to make long-running clusters more usable? | 16:08 |
| aignatov | tmckay: exactly | 16:09 |
| tmckay | aignatov, which exactly? :) Please quote | 16:09 |
| aignatov | I mean latest your question :) | 16:11 |
| aignatov | how to make long-living clusters more usable | 16:11 |
| tmckay | aignatov, okay | 16:12 |
| aignatov | more reliable. scalable and so on | 16:12 |
| aignatov | for example: we have cluster with 100 nodes, 10 of them died | 16:12 |
| aignatov | right now Sahara could not detected this | 16:12 |
| aignatov | could not do anything with that :) | 16:13 |
| crobertsrh | So, under "use cases". Are we looking at discussion new frameworks/job types to support? | 16:14 |
| crobertsrh | Additional data source types? | 16:15 |
| tmckay | so "Production Sahara clusters" deals with possible design flaws, and "Production Sahara use cases" deals with feature gap? | 16:15 |
| *** miqui_ has quit IRC | 16:26 | |
| * tmckay grabs lunch | 16:26 | |
| aignatov | tmckay: we are discussing with dmitryme face to face about this | 16:27 |
| tmckay | aignatov, okay, thanks, let us know :) We will be ghostwriters | 16:27 |
| aignatov | will back wwith ideas soon | 16:28 |
| crobertsrh | I have to run away for a few min....I will be back soon. Feel free to tweak or comment on what I have so far. | 16:28 |
| aignatov | I remember that my topic should contain message not only about long-living clusters | 16:39 |
| aignatov | but for large clusters as well | 16:39 |
| aignatov | SergeyLukjanov: please confirm | 16:39 |
| *** Longgeek has quit IRC | 16:47 | |
| aignatov | renamed it | 16:49 |
| aignatov | Large and long-living clusters in Sahara looks more better for me | 16:49 |
| elmiko | aignatov: +1 , makes it easier to tell the difference between the two | 16:50 |
| aignatov | I think there will no objectios from PTL ;) | 16:51 |
| *** tmckay has quit IRC | 17:04 | |
| *** IvanBerezovskiy has left #openstack-sahara | 17:13 | |
| openstackgerrit | A change was merged to openstack/sahara: typo found on Sahara Cluster Statuses Overview https://review.openstack.org/131263 | 17:26 |
| *** tmckay has joined #openstack-sahara | 17:27 | |
| tmckay | aignatov, so does "large" include both transient and long-living? | 17:30 |
| tmckay | or do we mean "a large, long-living cluster" | 17:30 |
| tmckay | so I can change the blue part correctly :) | 17:31 |
| aignatov | tmckay: sure | 17:34 |
| aignatov | this topic is about large clusters mostly | 17:34 |
| aignatov | as you can see I’ve added sevral topcis to discuss | 17:34 |
| *** ylobankov has quit IRC | 17:34 | |
| tmckay | okay | 17:35 |
| tmckay | I'll modify, and you can take a look | 17:35 |
| aignatov | tmckay: I’m looking for your ghostwriter option to wrapp these options with good description for session :) | 17:35 |
| tmckay | :) alright. Have to kill IRC, back in a minute ... | 17:35 |
| *** tmckay has quit IRC | 17:35 | |
| *** tmckay has joined #openstack-sahara | 17:36 | |
| tmckay | that's better | 17:36 |
| dmitryme | tmckay: also composed the list of topics I want to discuss in my section | 17:42 |
| crobertsrh | dmitryme: I updated my description for the "production" session. | 17:47 |
| dmitryme | crobertsrh: looks good to me | 17:48 |
| tmckay | okay, here I go | 17:48 |
| * tmckay puts on editor hat | 17:48 | |
| *** chandankumar has quit IRC | 17:59 | |
| elmiko | dmitryme: do we have any documentation about what the behavior of this bug is supposed to do? https://bugs.launchpad.net/sahara/+bug/1306505 | 18:11 |
| uvirtbot | Launchpad bug 1306505 in sahara "EDP does not accept Swift container as collection of job binaries" [Medium,Triaged] | 18:11 |
| elmiko | dmitryme: i ask because this could have wide ranging implications if we change it. | 18:11 |
| * SergeyLukjanov returned back | 18:25 | |
| SergeyLukjanov | reading the pad | 18:25 |
| dmitryme | elmiko: do you mean, what Sahara is supposed to do if this bug is fixed | 18:26 |
| dmitryme | ? | 18:26 |
| elmiko | dmitryme: kinda, yea. currently everything expects those get_binary style functions to return a single object. but i think this will need to be changed so that everything is a dict or something, to allow multiple file return. | 18:27 |
| *** abonilla has quit IRC | 18:34 | |
| elmiko | dmitryme: did that make sense? | 18:34 |
| dmitryme | elmiko: I am thinking about it | 18:35 |
| elmiko | dmitryme: ok | 18:36 |
| elmiko | dmitryme: i'm kinda thinking that the get_raw_data function should just change to always return a dict of {filename:data,...}, but it will impact many places. | 18:38 |
| tmckay | aignatov, dmitryme, elmiko, crobertsrh, okay, I gave it my best shot under "Large and long-living clusters in Sahara". What do you think? | 18:38 |
| crobertsrh | looking now | 18:39 |
| tmckay | oops, #3 is not a complete sentence | 18:40 |
| elmiko | tmckay: the sub-sections are the topics that will be discussed? | 18:40 |
| tmckay | some of them, not necessarily an exhaustive list. | 18:41 |
| tmckay | going from aignatov's notes | 18:41 |
| crobertsrh | sorry...looking now...was derailed by fresh cinnamon rolls | 18:41 |
| elmiko | tmckay: looks good to me | 18:42 |
| crobertsrh | Nice...makes me want to attend that session :) | 18:42 |
| elmiko | lol | 18:42 |
| tmckay | I don't have a lot of words for performance | 18:43 |
| tmckay | not sure what else to say | 18:43 |
| crobertsrh | I don't think these need to be particularly verbose | 18:43 |
| tmckay | I have in mind that performance is more important for large clusters, because in general you would assume that large clusters mean bigger problems being solved | 18:43 |
| elmiko | yea, we gotta leave something to talk about! | 18:43 |
| tmckay | heh, okay :) | 18:44 |
| tmckay | done, then, unless aignatov vetos ;-) | 18:44 |
| elmiko | tmckay: i think what you have about performance is a good brief | 18:44 |
| tmckay | is the other stuff too wordy? | 18:44 |
| elmiko | hmm | 18:44 |
| tmckay | Feel free to cut | 18:44 |
| elmiko | it's a lot to read, but you've covered most of the main topics that will be discussed. | 18:45 |
| crobertsrh | This is the text that will be in the schedule. I'll look at others to see what they're doing. | 18:45 |
| elmiko | good idea | 18:45 |
| tmckay | oh, it might be too long then | 18:45 |
| tmckay | I thought maybe just the title would be in the schedule | 18:45 |
| elmiko | tmckay: maybe cut down the itemized list to a second paragraph? | 18:45 |
| elmiko | just mention the topics that will be discussed | 18:46 |
| crobertsrh | Yeah, we totally win the "description" game | 18:46 |
| crobertsrh | We might fill our room just based on our flashy descriptions. | 18:47 |
| tmckay | well, there is nothing that says SergeyLukjanov cannot just submit the opening paragraph, and we can keep other stuff here in the pad for notes or for people to link to. | 18:47 |
| elmiko | i like the "What would *you* like to be able to do with Sahara?" | 18:47 |
| elmiko | that's gonna draw some folks =) | 18:47 |
| elmiko | tmckay: agreed, we should definitely keep those paras to have for the actual session | 18:48 |
| SergeyLukjanov | I'd like to submit the opening paragraph for each sessions | 18:48 |
| SergeyLukjanov | and them we'll have an etherpad for each session for more details | 18:48 |
| tmckay | k, I'll see if I can add a few example issues to the first paragraph | 18:48 |
| dmitryme | crobertsrh: your correctios of aignatov’s topic look good to me | 18:49 |
| crobertsrh | tmckay gets paid by the word :) | 18:49 |
| elmiko | lol | 18:49 |
| tmckay | okay, what about the new awesome opening paragraph for large and long? | 18:51 |
| tmckay | "Large and long". That's what it should be called. | 18:51 |
| elmiko | tmckay: +1 to the paragraph, -1 to the name | 18:51 |
| tmckay | lol | 18:51 |
| crobertsrh | Seems good to me | 18:51 |
| elmiko | tmckay: gotta keep this family friendly and G-rated | 18:52 |
| tmckay | I don't know what you're talking about | 18:52 |
| elmiko | lol | 18:52 |
| elmiko | i'm talking about not getting hauled into a sensitivity training session with you! ;) | 18:52 |
| crobertsrh | elmiko: It's a good thing you'll have a keeper in Paris...not sure it's a good idea to unleash your dirty mind on the city of light. | 18:53 |
| elmiko | LOL | 18:53 |
| tmckay | okay, have to run out for a bit, be back soon | 18:55 |
| dmitryme | elmiko: re bug I’ve checked the | 18:57 |
| dmitryme | sorry | 18:57 |
| dmitryme | so re bug #1306505. I | 18:57 |
| uvirtbot | Launchpad bug 1306505 in sahara "EDP does not accept Swift container as collection of job binaries" [Medium,Triaged] https://launchpad.net/bugs/1306505 | 18:57 |
| dmitryme | oh | 18:57 |
| dmitryme | my | 18:57 |
| dmitryme | I hit the enter too early for the second time | 18:57 |
| dmitryme | so, I’ve checked the code. It seems like there are three places which use get_raw_data(): 1. the v1.1 api which returns job binary. 2. oozie engine 3. spark engine | 18:59 |
| elmiko | dmitryme: right, those use it directly. other place use get_raw_binary(i think mapr does that) | 19:00 |
| elmiko | there are some indirect usages | 19:00 |
| dmitryme | right, I didn’t notice mapr because I’ve searched through juno code | 19:03 |
| elmiko | what do you think about changing get_raw_data to always return a dictionary? | 19:03 |
| dmitryme | after some thinking, my main concern is with API change | 19:04 |
| elmiko | agreed | 19:04 |
| dmitryme | we’ll have to change semantic of GET /v1.1/{tenant_id}/job-binaries/<job_binary_id> | 19:04 |
| dmitryme | * semantics | 19:04 |
| dmitryme | which is not good | 19:04 |
| elmiko | i would think /v1.1/{tenant_id}/job-binaries/<job_binary_id> | 19:04 |
| elmiko | oops | 19:05 |
| dmitryme | yea, that is the same :-) | 19:05 |
| elmiko | /v1.1/{tenant_id}/job-binaries/<job_binary_id>/data as well | 19:05 |
| elmiko | i meant /data | 19:05 |
| elmiko | i think it would be easier to restrict using whole containers. | 19:06 |
| dmitryme | elmiko: I agree we have to do that for v1.1 | 19:06 |
| dmitryme | it would be a good point to change that in v2.0 | 19:06 |
| elmiko | yea | 19:06 |
| elmiko | ok, so i'll fix it by rejecting whole containers and only accepting object targets in swift, does that sound good? | 19:07 |
| dmitryme | yep, sounds absolutely reasonable to me | 19:08 |
| elmiko | awesome, thanks | 19:08 |
| dmitryme | also IMHO it is worthy to formulate refactor of this v2.0 API. Can you do this? I think I am not in a good shape right now for that :-) | 19:11 |
| elmiko | dmitryme: i'd love to get into the v2 api, but probably we should discuss at summit | 19:11 |
| elmiko | we talked about it in atlanta, but it kinda fell off the table | 19:12 |
| elmiko | also, the api working group is starting to form opinions and i think it would be advantageous to engage with them as we craft the new api | 19:12 |
| SergeyLukjanov | tmckay, crobertsrh, NikitaKonovalov, aignatov, dmitryme, elmiko, here is the schedule - http://kilodesignsummit.sched.org/overview/type/sahara#.VE_qnoenBSp | 19:13 |
| SergeyLukjanov | I've added etherpads to each session, so, please, start filling them :) | 19:14 |
| crobertsrh | ack. Thanks | 19:14 |
| dmitryme | elmiko: in my opinion the point is not to produce v2 right now. It is rather to accumulate experience and changes we want to see in v2. If we hurry, we will produce api which will not be much different from v1.1, but still we will have to support both. | 19:14 |
| elmiko | dmitryme: +1 | 19:14 |
| dmitryme | that is why I think it is worthy to make notes right now | 19:14 |
| dmitryme | while we still remeber the details | 19:15 |
| elmiko | absolutely | 19:15 |
| elmiko | i'll start something | 19:15 |
| dmitryme | elmiko: great, thanks | 19:15 |
| dmitryme | actually, mattf already made a number of blueprints for v2 with some description | 19:16 |
| elmiko | ooh, nice | 19:16 |
| dmitryme | here is the one for v2 API https://blueprints.launchpad.net/sahara/+spec/v2-api | 19:16 |
| dmitryme | so you can add your thoughts hare | 19:17 |
| dmitryme | * here | 19:17 |
| elmiko | dmitryme: thanks | 19:18 |
| dmitryme | elmiko: thanks to you as well for bringing this up | 19:18 |
| *** tmckay has quit IRC | 19:25 | |
| elmiko | SergeyLukjanov, _mattf, would it acceptable for me to turn this https://blueprints.launchpad.net/sahara/+spec/v2-api into a spec , to make it easier to ammend? | 19:25 |
| elmiko | *would it be* | 19:29 |
| SergeyLukjanov | elmiko, yup, it need to be turned to the spec | 19:30 |
| elmiko | SergeyLukjanov: ok, i'll start the spec but make sure we mark it as WIP for now | 19:33 |
| SergeyLukjanov | elmiko, ack, thx | 19:36 |
| *** tmckay has joined #openstack-sahara | 19:49 | |
| tmckay | sorry, computer keeps going to sleep | 19:50 |
| tmckay | did I miss anything> | 19:50 |
| tmckay | ? | 19:50 |
| *** tmckay has quit IRC | 19:50 | |
| *** tmckay has joined #openstack-sahara | 19:51 | |
| tmckay | again | 19:51 |
| tmckay | here for good this time | 19:51 |
| elmiko | tmckay: did you see that SergeyLukjanov has updated the session descriptions? | 19:52 |
| elmiko | http://kilodesignsummit.sched.org/overview/type/sahara#.VE_qnoenBSp | 19:52 |
| elmiko | also, ehterpads are setup for each session and we should start filling them in | 19:52 |
| tmckay | okay, great, I'll work on it | 19:53 |
| elmiko | tmckay: aside from that it was mainly me and dmitryme talking about v2 api | 19:53 |
| tmckay | k, I think I saw most of that | 19:53 |
| elmiko | then, no, you didn't miss anything =) | 19:53 |
| tmckay | I moved the laptop, but the other end of the power cord came undone so it keep entering sleep mode when idle for a little bit | 19:57 |
| elmiko | oh man... | 19:57 |
| tmckay | I need to sign up for attendees on a bunch of things | 20:01 |
| elmiko | nice, i started filling out my sched over the weekend | 20:04 |
| elmiko | i also uploaded a profile pic, not sure if that was wise | 20:05 |
| tmckay | tellesnobrega, ping | 20:08 |
| tellesnobrega | tmckay, pong | 20:09 |
| tmckay | hi! the storm plugin isn't merged yet? I just looked in my plugin dir ... | 20:09 |
| tmckay | tellesnobrega, I thought it was already there. I am working on the EDP design summit notes, any ideas of things to add? Have you done EDP for storm? | 20:11 |
| tellesnobrega | im still working on making it work properly | 20:12 |
| tellesnobrega | haven't implemented EDP, i'm not sure how it will work with storm and if it will | 20:12 |
| tellesnobrega | hopefully i will have a patch in the next days | 20:12 |
| tellesnobrega | to review, i know it wont get much attention now, but i will try to submit it | 20:13 |
| tmckay | okay, that's fine. I was wondering if you had input based on working with the current EDP refactoring | 20:13 |
| tmckay | tellesnobrega, sure, we still did a fair number of reviews in Atlanta I believe | 20:17 |
| tellesnobrega | great | 20:17 |
| *** witlessb has quit IRC | 20:25 | |
| *** witlessb has joined #openstack-sahara | 20:33 | |
| SergeyLukjanov | tellesnobrega, I think that you could propose the minimal version of storm plugin - like create / delete cluster | 20:51 |
| SergeyLukjanov | tellesnobrega, and the implement other features step by step - scaling, edp | 20:51 |
| tellesnobrega | that is my idea | 20:57 |
| tellesnobrega | i have the minimal version almost done | 20:57 |
| tellesnobrega | just need some tunning and testing | 20:57 |
| *** crobertsrh is now known as _crobertsrh | 21:02 | |
| *** tellesnobrega_ has joined #openstack-sahara | 21:45 | |
| *** svetmy has joined #openstack-sahara | 21:48 | |
| svetmy | hi, i'm evaluating sahara for my company and have a few questions: does sahara integrates with mapr-fs? is anyone using sahara in production? | 21:49 |
| *** tellesnobrega_ has quit IRC | 21:50 | |
| svetmy | was sahara released with Juno? | 21:50 |
| elmiko | svetmy: it emerged from incubation for juno | 21:51 |
| svetmy | elmiko: does it mean it's part of core openstack? | 21:51 |
| elmiko | svetmy: it is fully released if that's what you are asking | 21:52 |
| elmiko | i'm not sure if that qualifies as "core openstack" | 21:52 |
| svetmy | elmiko: thanks, are you aware of any companies supporting sahara i.e. who can run hadoop cluster on sahara and manage it for us? | 21:53 |
| tmckay | svetmy, there is a mapr plugin in Sahara which is relatively new | 21:53 |
| tmckay | I think it uses mapr-fs | 21:53 |
| elmiko | svetmy: i think mirantis is doing this, maybe ask SergeyLukjanov | 21:53 |
| SergeyLukjanov | svetmy, Sahara is now an integrated OpenStack project and has been released as part of OpenStack Juno release | 21:54 |
| tmckay | https://www.openstack.org/summit/openstack-summit-atlanta-2014/session-videos/presentation/the-state-of-openstack-data-processing-sahara-now-and-in-juno | 21:54 |
| svetmy | tmckay: thanks, do you have a link? how can i install it? | 21:54 |
| SergeyLukjanov | svetmy, Mirantis has Sahara as part of Mirantis OpenStack distribution | 21:55 |
| tmckay | SergeyLukjanov, mapr plugin is not in the Juno releases, right? | 21:55 |
| SergeyLukjanov | tmckay, nope, it'll be only in Kilo release | 21:55 |
| svetmy | Sergey, which hadoop distro do you support? | 21:56 |
| tmckay | svetmy, RDO should also have Sahara, since it is the Juno release | 21:56 |
| tmckay | https://openstack.redhat.com/Quickstart | 21:56 |
| elmiko | RDO does has sahara in the icehouse and juno releases | 21:56 |
| *** tellesnobrega_ has joined #openstack-sahara | 21:56 | |
| tmckay | svetmy, so the only way to play with the mapr plugin currently is from the Sahara source tree. Very possible, but not in a release | 21:57 |
| SergeyLukjanov | svetmy, we're not providing support for hadoop itself | 21:57 |
| svetmy | elmiko: not in RDO Icehouse, i have to install it separately | 21:57 |
| elmiko | svetmy: hmm, that's odd | 21:58 |
| svetmy | Sergey: do you have any customers who run hadoop on openstack in production? | 21:59 |
| elmiko | svetmy: it is in RDO for rhel6/7 and f20, see https://repos.fedorapeople.org/repos/openstack/openstack-icehouse/ | 21:59 |
| svetmy | elmiko: what i mean is packstack for icehouse answer file does not have option for enabling SAHARA | 22:02 |
| elmiko | svetmy: oh yea, that's correct | 22:02 |
| *** tellesnobrega_ has quit IRC | 22:02 | |
| svetmy | SergeyLukjanov: do you have any customers who run hadoop on openstack in production? | 22:03 |
| *** tmckay has quit IRC | 22:11 | |
| *** tmckay has joined #openstack-sahara | 22:11 | |
| tmckay | bye folks | 22:13 |
| *** tmckay has left #openstack-sahara | 22:13 | |
| svetmy | what choice of hadoop distros do i have in Juno release: HDP and Intel. Is this correct? Are they both stable? | 22:18 |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements https://review.openstack.org/130331 | 22:33 |
| *** tmckay has joined #openstack-sahara | 23:02 | |
| tmckay | hmm, does launchpad openid affect IRC? Really quiet here now | 23:08 |
| tmckay | someone has to be awake somewhere | 23:08 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!