18:01:55 <alazarev> #startmeeting sahara
18:01:56 <openstack> Meeting started Thu Jun 11 18:01:55 2015 UTC and is due to finish in 60 minutes.  The chair is alazarev. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:01:57 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
18:01:59 <openstack> The meeting name has been set to 'sahara'
18:02:13 <alazarev> #topic sahara@horizon status (crobertsrh, NikitaKonovalov)
18:02:15 <egafford> \o
18:03:11 <weiting> alazarev, so Sahara has a meeting at this time, right?
18:03:34 <NikitaKonovalov> ok, Sergey told me that there are some changes in reviewing policy
18:03:46 <alazarev> weiting, yes, 1 week - this time, 1 week - yearly
18:04:20 <NikitaKonovalov> our panels, as well as trove's and heat's will be moved to contrib folder
18:04:38 <NikitaKonovalov> and there our non-core +1 count
18:05:07 <NikitaKonovalov> if that happens, we'll get things moving faster I think
18:05:29 <egafford> NikitaKonovalov: That sounds amazing.
18:05:34 <NikitaKonovalov> I've got no more updates on horizon actually ))
18:05:52 <alazarev> #topic News / updates
18:06:36 <NikitaKonovalov> I've started working towards splitting sahara and sahara-plugins repos
18:06:39 <huichun_> working on scheduler EDP job , need for review for spec https://review.openstack.org/#/c/175719/
18:07:35 <weiting> We are also working on to bring Manila into Sahara EDP.
18:08:14 <weiting> We had a hdfs driver that has already implemented in Manila.
18:08:26 <alazarev> weiting, sound great!
18:08:56 <crobertsrh> hello/
18:09:03 <tmckay> hi folks
18:09:16 <egafford> Job interface main patch is review-worthy; working on client changes now (then scenario tests, then smaller feature upgrades, then Horizon changes, then profit.)
18:09:44 <SergeyLukjanov> hey folks :)
18:09:46 <tosky> weiting: so another type of data source?
18:09:51 <SergeyLukjanov> just arrived to home, completely forget about meeting :(
18:09:53 <crobertsrh> I have patches up for the service and client library parts of job binary and data source editing.  Still need both specs to be approved and the job binaries part may need a few more tweaks.
18:10:06 <egafford> Excited for new Horizon review policy for those Horizon changes, as https://review.openstack.org/#/c/160510/ is still in review from Kilo. :p
18:10:36 <huichun> tmckay:  hi Trevor ,need your review for scheduler edp spec
18:10:37 <weiting> tosky, yes, this is what we would like to do. But currently Manila community is asking for a CI for hdfs driver.
18:11:10 <tmckay> huichuin, okay.  I've been fighting with neutron on a test cluster :) Takes lots of attention
18:11:20 <weiting> But we don't have the experience about CI. So we are asking for help to handle this.
18:11:58 <weiting> If there is no CI for this driver, it may be removed in Manila.
18:12:00 <tmckay> weiting, we're thinking about Manila integration, too.  We think it can also potentially work with NFS shares (because Hadoop can write to local filesystem)
18:12:34 <weiting> tmckay, yes I agree.
18:12:44 <tmckay> 2 applications, we think.  1) data, of course 2) code -- so that binaries can live in the cluster and not be copied
18:12:49 <SergeyLukjanov> weiting, are you exposing already installed HDFS through Manila or Manila could install HDFS?
18:13:06 <tmckay> weiting, we should make sure we collaborate :)
18:13:40 <weiting> tmckay, ok, we haven't propose the bp. Because we are struggling in Manila CI.
18:13:40 <SergeyLukjanov> weiting, re CI you could chat with degorenko, he's now sahara-ci maintaine
18:14:03 <weiting> SergeyLukjanov, yes, we have already finish HDFS driver in Manila.
18:14:20 <tmckay> weiting, understood.  We are at the POC point -- what is possible?  What makes sense from a high-level view in Sahara?
18:14:37 <SergeyLukjanov> weiting, I mean - how it's working? it's exposing HDFS through Manila or it installs HDFS?
18:15:13 <tmckay> weiting, are thinking is maybe list available shares in a tenant and have a Sahara button to mount the share on the cluster nodes (from the UI)
18:15:54 <weiting> SergeyLukjanov, I think it is installs HDFS.
18:16:11 <SergeyLukjanov> weiting, hm
18:16:44 <SergeyLukjanov> tmckay, we could deploy a separated HDFS-only cluster for it as an option
18:17:31 <tmckay> SergeyLukjanov, yes, that's another possibility
18:18:36 <tmckay> anyway, we should have some ideas over the next few weeks.  Just starting.
18:18:58 <SergeyLukjanov> https://review.openstack.org/#/c/151523/13/manila/share/drivers/hdfs/hdfs_native.py,cm here is an impl
18:19:14 <SergeyLukjanov> looks like it just creates dirs in HDFS as a shares
18:19:38 <SergeyLukjanov> and sets proper (not sure) ACLs for them
18:19:48 <SergeyLukjanov> so, the HDFS itself seems to be installed manually
18:20:38 <weiting> SergeyLukjanov, oh I got your point.
18:21:06 <alazarev> #chair SergeyLukjanov
18:21:07 <openstack> Current chairs: SergeyLukjanov alazarev
18:22:51 <SergeyLukjanov> any other updates?
18:23:31 <tmckay> SergeyLukjanov, https://review.openstack.org/#/c/190656/ looks like it will pass but jenkins is complaining (wrongly) I think
18:23:36 <SergeyLukjanov> btw there is now eavesdrop site reworked - http://eavesdrop.openstack.org
18:23:51 <NikitaKonovalov> Since we are going to have separate plugins repo I think should drop some old or deprecated plugins
18:24:25 <NikitaKonovalov> both vanilla and hdp now have hadoop v1 support which is not popular at all
18:24:26 <SergeyLukjanov> tmckay, yup, rechecked
18:24:43 <SergeyLukjanov> NikitaKonovalov, please write a spec to drop them
18:25:07 <SergeyLukjanov> and I should publish first draft of the plugins specs early next week
18:25:15 <NikitaKonovalov> ok, I'll add that point to this one https://review.openstack.org/#/c/190613/
18:25:47 <SergeyLukjanov> NikitaKonovalov, no, please, create a separate spec for Hadoop 1 drop
18:26:02 <NikitaKonovalov> @SergeyLukjanov: ok
18:26:05 <SergeyLukjanov> and 190613 now missing ~ 100 details, so, we'll need to work on it
18:26:52 <SergeyLukjanov> #topic Open discussion
18:27:13 <SergeyLukjanov> I have a question to you folks to think about
18:27:20 <SergeyLukjanov> do we need to have a virtual sprint?
18:28:04 <SergeyLukjanov> in fact it's few dedicate days when we're all will chat in irc channel on the prepared topics trying to solve real issues
18:28:19 <SergeyLukjanov> like the friday day on summit but using IRC
18:28:26 <SergeyLukjanov> some projects doing it
18:28:30 <SergeyLukjanov> so, folks, what do you think about it?
18:28:37 <egafford> SergeyLukjanov: For design issues or impl?
18:29:13 <SergeyLukjanov> egafford, for anything that could be solved by the whole team presence
18:29:28 <crobertsrh> We could probably give it a try at least once
18:30:03 <SergeyLukjanov> probably we should try to collect list of topics to discuss
18:30:19 <SergeyLukjanov> and if we'll have some reasonable list - make a try
18:30:31 <SergeyLukjanov> any other thoughts? :)
18:30:33 <tmckay> It would be good I think to try to have some blueprints and specs ready for topics
18:30:56 <tmckay> SergeyLukjanov, I wonder if bluejeans would work instead of IRC
18:31:01 <SergeyLukjanov> here is a wiki page about it with a links to the past virtual sprints - https://wiki.openstack.org/wiki/VirtualSprints
18:31:42 <tmckay> I think talking is faster than typing
18:32:10 <tmckay> but maybe connection speed is an issue
18:33:29 <egafford> tmckay: BJ would work really well for untangling particularly tricky issues among subteams working on one part of a problem, but the whole team in BJ sounds tough to manage.
18:33:49 <egafford> tmckay: Maybe IRC and break into ad-hoc BJ sessions as needed would be the ideal?
18:34:18 <tmckay> maybe
18:34:32 <crobertsrh> Have we ever considered a midcycle meetup?
18:34:40 <egafford> We'd lose some centralization of the record, which is a downside.
18:34:54 <tmckay> mini-Summit
18:35:12 <tosky> egafford: unless someone types the minutes on an etherpad
18:36:07 <SergeyLukjanov> what is the BJ?
18:36:21 <huichun_> BeiJing?
18:36:39 <egafford> SergeyLukjanov: It's like Skype. Video, voice, chat, screen sharing.
18:36:47 <egafford> All the communication. :)
18:36:50 <SergeyLukjanov> egafford, nice
18:37:08 <SergeyLukjanov> as an option we could use openstack's audio conference
18:37:22 <SergeyLukjanov> it supports callins either phone and ip
18:37:42 <tmckay> BJ is bluejeans
18:37:49 <huichun_> google hangouts?
18:37:54 <crobertsrh> openstack audio conf would be very "openstacky" of us
18:38:05 <tmckay> that could work too (hangouts)
18:38:54 <tmckay> I envision audio like our Friday sessions at Summit.  We have a lot of people, but it's manageable I think
18:39:41 <crobertsrh> Our Friday session this time around was certainly not "a lot" of people
18:40:04 <tmckay> well, 10 maybe?  at least before lunch ;-)
18:40:09 <crobertsrh> Fortunately for me, that means that not many people got to see me try to draw something on the whiteboard.
18:40:11 <tmckay> then someone told me it was over
18:40:41 <SergeyLukjanov> crobertsrh, :)
18:41:18 <SergeyLukjanov> so, we could evaluate for some more time pros and cons for running virtual sprint
18:44:22 <egafford> SergeyLukjanov: I don't really see that there are a ton of cons to the idea of running it. It would certainly pull focus to one issue, but that can be good. It'd need to be focused on issues broad enough to use the whole team, which is fine. It'd bring the whole team together to work, which is great.
18:45:00 <egafford> SergeyLukjanov: Only downside I can see is that it might be hard to schedule around any standing responsibilities folks have, but that's just the nature of things.
18:45:26 <SergeyLukjanov> agree
18:45:40 <egafford> SergeyLukjanov: It might not work for us, but experimentation is good.
18:48:04 <SergeyLukjanov> yeah, it could make us able to actively (and hopefully effectiely) discuss some complex things
18:48:58 <egafford> SergeyLukjanov: I guess the other downside is that if it's not prepped well enough, folks might not have the relevant knowledge on tap to start in quickly, but that can be addressed with planning.
18:48:59 <SergeyLukjanov> anything else to chat about today?
18:49:28 <egafford> SergeyLukjanov: On this topic, do you have any ideas for virtual sprints for us?
18:49:48 <SergeyLukjanov> egafford, yeah, it's the common downside for any events like that
18:50:09 <SergeyLukjanov> egafford, I'm thinking about discussing specs like extracting plugins, etc.
18:50:26 <SergeyLukjanov> some complex stuff with many issues
18:50:56 <SergeyLukjanov> and on the other side we could probably chat about some on-going things and make some things done like small improvements and etc.
18:51:02 <SergeyLukjanov> no good concrete proposals
18:51:18 <egafford> Yeah, that's a huge one, and makes a lot of sense. Taskflow from Summit springs to mind for me, too. Cool; thanks.
18:51:27 <crobertsrh> One thing that is needed is better tests for each panel in Horizon.  I added a blueprint to cover adding additional tests.  Anyone is free to help out on that effort as you have time.
18:51:38 <crobertsrh> Current panel tests in Horizon are rather skeletal.
18:51:39 <SergeyLukjanov> I've just looking on how other projects doing the virtual sprints and decided to share thoughts on it to see what are folks thinking about it
18:52:26 <SergeyLukjanov> crobertsrh, sounds like you're requesting a few weeks long hackaton :)
18:52:43 <crobertsrh> Well, in case anyone was bored and wanted to poke at Hoirzon :)
18:52:53 <crobertsrh> It's not like the patches will ever get merged anyways :)
18:53:02 <huichun_> hi guys~~ need your review comments for scheduler edp job   https://review.openstack.org/#/c/175719/
18:53:20 <SergeyLukjanov> probably the new review policy will help us and both crobertsrh and NikitaKonovalov will be happy
18:53:36 <crobertsrh> hopefully
18:54:15 <SergeyLukjanov> / 5 mins left
18:57:04 <SergeyLukjanov> okay, looks like time to sleep
18:57:12 <SergeyLukjanov> I mean to continue working :)
18:57:17 <SergeyLukjanov> thank you folks!
18:57:28 <SergeyLukjanov> (please keep thinking about virtual sprint options)
18:57:36 <huichun_> bye
18:57:37 <weitingc> Yes, we are going to sleep in China.
18:57:40 <SergeyLukjanov> have a good rest of day
18:57:45 <SergeyLukjanov> #endmeeting