18:01:17 <SergeyLukjanov> #startmeeting sahara
18:01:18 <openstack> Meeting started Thu Oct 23 18:01:17 2014 UTC and is due to finish in 60 minutes.  The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:01:19 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
18:01:21 <openstack> The meeting name has been set to 'sahara'
18:01:24 <crobertsrh> hello/
18:01:26 <SergeyLukjanov> sahara folks, ping
18:01:26 <tosky> hi
18:01:30 <elmiko> o/
18:01:43 <sreshetnyak> hello
18:01:46 <alazarev> o/
18:02:27 <aignatov> o/
18:02:29 <NikitaKonovalov_> o/
18:02:32 <dmitryme> o/
18:03:21 <SergeyLukjanov> #link https://wiki.openstack.org/wiki/Meetings/SaharaAgenda
18:03:36 <SergeyLukjanov> #topic sahara@horizon status (crobertsrh, NikitaKonovalov)
18:03:40 <SergeyLukjanov> crobertsrh, NikitaKonovalov, please
18:03:53 <crobertsrh> It seems like the sahara-dashboard tests have been hosed down a bit this week
18:04:01 <crobertsrh> I need to circle back and see their state
18:04:21 <crobertsrh> There are a few fixes up for review on the horizon side, hopefully on their way to approval
18:04:23 <SergeyLukjanov> yeah, horizon folks has been shocked  :)
18:04:33 <SergeyLukjanov> crobertsrh, great
18:04:34 <NikitaKonovalov_> There is only one bug fix from me on the review, and it's a minor one
18:04:44 <SergeyLukjanov> I hope to stabilize our ui tests and enable them for horizon
18:04:56 <crobertsrh> I'm going to start an etherpad for the UI talk that NikitaKonovalov and I will be leading @ summit.
18:05:34 <SergeyLukjanov> crobertsrh, great!
18:05:38 <NikitaKonovalov_> crobertsrh: please share it, I've got some thoughts to add there
18:05:48 <crobertsrh> will do
18:06:20 <crobertsrh> #link https://etherpad.openstack.org/p/kilo-sahara-ui-discussion
18:06:23 <crobertsrh> No content yet :)
18:06:45 <NikitaKonovalov_> As for now, I'm going to add a few changes so that our panels wokr correctly in multi-region OpenStack
18:06:49 <SergeyLukjanov> cool, work started :)
18:07:06 <NikitaKonovalov_> the API can handle that already
18:07:49 <SergeyLukjanov> #topic News / updates
18:07:51 <SergeyLukjanov> folks, please
18:08:48 <SergeyLukjanov> I've been mostly occupied by the release and internal things last week
18:08:48 <dmitryme> I’ve spent some time discussing kilo features and roadmap with folks
18:08:49 <tmckay> I've been poking at test errors. crobertsrh, I think we're done with the fake CR, correct?
18:09:03 <elmiko> i've been working on 3 areas, 1. researching API working group and improvements that we might make towards an api-ref, 2. digging into bug#1306505, which i have questions about, and 3. gathering topics for the security discussion at summit.
18:09:08 <crobertsrh> tmckay, yes
18:09:09 <SergeyLukjanov> we've already have several internal sessions to prepare to the design summit
18:09:31 <elmiko> #link https://etherpad.openstack.org/p/kilo-summit-sahara-security-session
18:09:35 <SergeyLukjanov> #1306505
18:09:41 <crobertsrh> There was some interest in the channel today from a guy looking to create a SUSE image to use with Sahara.  Sounds like they don't plan on using DIB, but using their own tooling instead.
18:09:41 <elmiko> if anyone has thoughts about the security discussion ^^
18:10:01 <alazarev> I've created proposals for indirect VM access and auth policies
18:10:03 <sreshetnyak> I'm working on Spark and Hue support for Cloudera plugin
18:10:20 <SergeyLukjanov> crobertsrh, yeah, I've just read the logs
18:10:23 <tmckay> also, I just finally tracked down why we have an intermittent unit test error in sahara related to os_region_name.  It's because the recent mapr tests set os_region_name = None explicitly.  Breaks the __getattr__ in oslo, and if that test runs in the same worker as swift_config tests or test_url_for regions and runs first they will fail
18:10:31 <SergeyLukjanov> crobertsrh, sounds like dib should suport suse eventually
18:10:51 <crobertsrh> Yeah, if there is demand for it, for sure
18:11:04 <tmckay> I'll add a bug and fix it
18:11:16 * tmckay hates intermittent test failures more than anything
18:11:20 <SergeyLukjanov> tmckay, oh... gold star achieved!
18:11:28 <tmckay> :)  hurray!
18:11:36 <alazarev> elmiko, added auth policies to the list
18:11:59 <alazarev> elmiko, I mean into etherpad
18:12:00 <SergeyLukjanov> elmiko, alazarev, yeah, policy.json is a good topic to talk about
18:12:24 <elmiko> alazarev: +1 thanks
18:12:35 <alazarev> My https://review.openstack.org/#/c/130385/ covers only possibility to add policy
18:12:38 <aignatov> Minimum settings to register image?
18:12:54 <elmiko> aignatov: i've had it reject my account on image register
18:12:55 <alazarev> have no idea about right content
18:13:33 <tmckay> I want to start looking at swift configs for spark, maybe try some things before Summit so we can talk about how to support it
18:14:00 <tmckay> the trick is getting the swift auth stuff into the hadoop context for Spark, might have to be through a base class or something
18:14:17 <SergeyLukjanov> tmckay, sounds nice
18:14:56 <tmckay> oozie does this for us, by the way (excecpt for Java jobs.  similar problem, but at least oozie distributes a config file to read)
18:14:59 <SergeyLukjanov> okay, let's move on to the design summit discussion
18:15:13 <SergeyLukjanov> #topic Design Summit @ Paris
18:15:19 <SergeyLukjanov> #link https://etherpad.openstack.org/p/kilo-sahara-summit-topics
18:16:29 <SergeyLukjanov> so, I've used the feedback for etherpad and prev. experiense of our design summits
18:16:43 <SergeyLukjanov> and I'm proposing the following sessions on sumit itself
18:16:44 <SergeyLukjanov> EDP discussions (new features, plans, direction review)
18:16:44 <SergeyLukjanov> UX discussion
18:16:45 <SergeyLukjanov> Production, long living, large Sahara clusters
18:16:45 <SergeyLukjanov> Sahara HA, production use cases
18:16:45 <SergeyLukjanov> Sahara's OpenStack integration and Security
18:17:01 <SergeyLukjanov> we already have chairs for them
18:17:08 <SergeyLukjanov> crobertsrh and NikitaKonovalov for UI stuff
18:17:12 <SergeyLukjanov> tmckay for EDP
18:17:40 <SergeyLukjanov> aignatov and dmitryme for #3 and #4 (prod ofr both Sahara and it's clusters)
18:17:58 <SergeyLukjanov> SergeyLukjanov for OpenStack integration
18:18:02 <SergeyLukjanov> and elmiko for security
18:18:12 <tmckay> +2, great plan
18:18:16 <SergeyLukjanov> so, please, share you thoughts
18:18:18 <tmckay> let's go with it :)
18:18:33 <elmiko> SergeyLukjanov: we have those 5 and then a 1/2 day meetup as well?
18:18:49 <SergeyLukjanov> if there is no objections - I'll push the preliminary plan to the http://kilodesignsummit.sched.org
18:18:50 <tmckay> elmiko, plus the parties.  Don't forget the parties.
18:18:56 <SergeyLukjanov> elmiko, yup
18:19:02 <SergeyLukjanov> and plus pod for the whole summit
18:19:03 <tmckay> we can do a lot of work there
18:19:15 <elmiko> is dancing considered work?
18:19:17 <aignatov> +2 for the plan above
18:19:19 <SergeyLukjanov> so, we'll need a list of topics for 1/2 day meetup too
18:19:25 <elmiko> SergeyLukjanov: +1 to the plan
18:19:28 <tmckay> if you design something while you're doing it, yes
18:19:34 <elmiko> lol
18:19:41 <SergeyLukjanov> dancing design approach
18:19:48 <elmiko> and can remember it the next day... ;)
18:19:49 <aignatov> also I think it would be great to have a miniplan for 1/2 meetaup
18:19:50 <SergeyLukjanov> like TDD but DDD
18:19:53 <tmckay> better blood flow, better ideas
18:20:00 <elmiko> lol @ DDD
18:20:09 <tmckay> aignatov, +1 good iead
18:20:11 <elmiko> aignatov: +1
18:20:12 <tmckay> idea even
18:20:17 <SergeyLukjanov> aignatov, yeah, we need to have list of topics for it
18:20:20 <mattf> 1/2 day should include talks from peer projects
18:20:28 <aignatov> not a plan actually but  a  list of hot topics don’t to forget
18:20:36 <SergeyLukjanov> aignatov, and it'll be great to have some schedule to make other folks able to attend interested topics
18:21:17 <SergeyLukjanov> mattf, all projects will have their own meetups at this time, so, I'm not sure that it'll be easy to organize peers from other projects
18:21:53 <mattf> that's too bad
18:22:17 <SergeyLukjanov> additionally, I'd like to ask someone w/ native english to help me writing good description for design summit sessions
18:22:22 <mattf> having them all at once means they're not a good opportunity for project collab
18:22:36 <mattf> instead we can do a tech readout to the community
18:22:58 <SergeyLukjanov> mattf, yeah, but we'll be in one big room with some other projects (I think Heat for ex.), so, we'll be able to collaborate
18:23:04 <elmiko> SergeyLukjanov: i can help with descriptions
18:23:07 <crobertsrh> I can help
18:23:10 <SergeyLukjanov> elmiko, thanks!
18:23:20 <crobertsrh> darn, you're too fast elmiko :)
18:23:31 <elmiko> i can help get crobertsrh setup to help =)
18:23:38 <tmckay> jinx, someone buy someone a soda
18:23:41 <SergeyLukjanov> crobertsrh, thx too, I'll ping both of you :)
18:23:41 <crobertsrh> heh
18:24:03 <SergeyLukjanov> the Paris summit venue will be much smaller than Atlanta ones
18:24:10 <elmiko> yea, more eyes are definitely better
18:24:13 <SergeyLukjanov> that's why we have not so many sessions
18:24:50 <SergeyLukjanov> probably the Vankuver venue will be significantly bigger
18:25:28 <mattf> the schedule and topics proposed in the pad look good
18:25:52 <SergeyLukjanov> mattf, great
18:26:40 <SergeyLukjanov> #agreed design summit sessions: EDP, UX, OpenStack integration + Security, Prod Sahara, Prod Sahara clusters
18:27:16 <SergeyLukjanov> #topic Open discussion
18:27:41 <mattf> team outing in paris?
18:27:46 <crobertsrh> +1
18:27:49 <elmiko> +1
18:28:07 <tmckay> +1
18:28:20 <crobertsrh> Heh....nobody else wants to hang out with us
18:28:24 <elmiko> =(
18:28:28 <tmckay> museum? Eiffel Tower?
18:28:35 <mattf> yeah, wow
18:28:35 * SergeyLukjanov googling the phrase translation
18:28:53 <SergeyLukjanov> oh
18:28:55 <SergeyLukjanov> +1
18:28:56 <SergeyLukjanov> :)
18:28:58 * mattf grins
18:29:05 <crobertsrh> billiards lounge tmckay?
18:29:10 <mattf> egad!
18:29:14 <dmitryme> +!
18:29:14 <aignatov> +1
18:29:17 <NikitaKonovalov_> +1
18:29:20 <mattf> which evening is open?
18:29:28 * SergeyLukjanov and DinaBelova find some nice places in paris this summer
18:29:43 <SergeyLukjanov> mattf, we'll know about it only next week, not all invites sent
18:29:52 <elmiko> mattf: thursday has no official parties
18:30:01 <tmckay> billiards, I'll have to practice
18:30:07 <mattf> tmckay, ha!
18:30:23 <SergeyLukjanov> folks, when you're arriving/departing?
18:30:45 <crobertsrh> In Sunday morning @ 8:00;  Out:  Saturday morning early
18:30:46 <mattf> i fly out fri afternoon (attending a wedding on sat am)
18:30:48 <tmckay> 11am Nov 1, 2pm (?) Nov 8
18:30:54 <elmiko> arrive nov2, leave nov8
18:31:07 <elmiko> mattf: oooph
18:31:14 <mattf> i'm gonna be tired
18:31:20 <tmckay> Oops, arrive Nov 2
18:31:21 <dmitryme> me, aignatov and ruhe arriving at midday Nov 2 and leaving at morning Nov 9
18:31:45 <mattf> let's tentatively assume thur 6th for a team event
18:32:02 <aignatov> dmitryme: not midday, evening
18:32:15 <dmitryme> mattf: still, I am not sure 6th will be avialable for me
18:32:17 * SergeyLukjanov and DinaBelova and NikitaKonovalov_ arriving 2pm Nov 2 and departing 18pm Nov 17
18:32:45 <mattf> dmitryme, hmmm
18:32:53 <mattf> 17th, nice
18:33:12 <aignatov> I’m not sure as well for 6th
18:33:17 * dmitryme checked the tickets and agreed with aignatov: we arrive at the eventing
18:33:50 <tmckay> I was thinking of taking a train to London Friday night, then back for the plane on Sat :)  Probably not.
18:33:51 <SergeyLukjanov> in fact, for Mirantis folks, there is some internal event at 6th evening, I'm not sure what is it
18:34:02 <SergeyLukjanov> will see on summit :)
18:34:08 <mattf> ahh
18:34:26 <mattf> ok, let's see when the full schedule gets posted
18:34:50 <SergeyLukjanov> tmckay, for Russians, we need to obtain a diffrent VISA to go to London
18:35:17 <elmiko> i have a couple questions about, https://bugs.launchpad.net/sahara/+bug/1306505
18:35:18 <uvirtbot> Launchpad bug 1306505 in sahara "EDP does not accept Swift container as collection of job binaries" [Medium,Triaged]
18:35:48 <aignatov> SergeyLukjanov: really? I didn’t know about that
18:35:55 <tmckay> elmiko, what questions?
18:35:57 <elmiko> how should we handle sub-containers(e.g. pseudo-directories) and what about fliename globbing?
18:36:18 <elmiko> tmckay: you had a suggestion about the globbing in the comments
18:36:20 <tmckay> elmiko, I would use the swift client download as a guide
18:36:29 <tmckay> I believe it splits on / and makes dirs out of them
18:36:33 <aignatov> Also I hope I will have a time to visit this event http://www.uefa.com/uefachampionsleague/season=2015/matches/round=2000548/match=2014357/prematch/player-lists/index.html
18:36:35 <aignatov> :)
18:36:42 <tmckay> hmm, I forget what I wrote :)
18:36:44 * tmckay reads
18:36:53 <elmiko> aignatov: lol, nice!
18:37:01 <SergeyLukjanov> aignatov, ask Sergey Brook :)
18:38:10 <elmiko> tmckay: my main question is, if you pass the head of a container (e.g. swift://bin/), and it contains a subdir, how should we handle the subdir?
18:38:52 <elmiko> like, if you have a container named "bin" with entries "foo.jar" and "bar/baz.jar", i'm thinking we should skip the subdir
18:39:03 <SergeyLukjanov> oh, I have one more thing to discuss, we need to have a documentation liaison
18:39:05 <SergeyLukjanov> https://wiki.openstack.org/wiki/CrossProjectLiaisons#Documentation
18:39:06 <elmiko> but i'm not sure what the proper thing to do is
18:39:11 <tmckay> off the cuff, I would expect "bin" to be uploaded to hdfs, with subdirs defined by /
18:39:17 <SergeyLukjanov> anybody want to volunteer?
18:39:44 <crobertsrh> I can give it a go
18:39:50 <tmckay> doh, beat me
18:40:00 <tmckay> we can have 2 :) ?
18:40:06 <SergeyLukjanov> we need to have one
18:40:12 <SergeyLukjanov> that'll be responsible for it
18:40:18 <tmckay> k, crobertsrh
18:40:27 * crobertsrh is very responsible...sometimes
18:40:27 <SergeyLukjanov> the man who I could ask and Doc team could ask too
18:40:32 <SergeyLukjanov> :)
18:40:46 <SergeyLukjanov> crobertsrh, thx, I'm going to write your name to the wiki page
18:40:55 <crobertsrh> Great
18:40:57 <SergeyLukjanov> crobertsrh, will you be able to attend meetings?
18:41:08 <crobertsrh> Yep
18:41:13 <SergeyLukjanov> crobertsrh, awesome!
18:41:14 <SergeyLukjanov> thx
18:41:14 <crobertsrh> Looks like it's a good time for me
18:41:53 <SergeyLukjanov> in fact we need to have a liaison for qa too
18:42:03 <SergeyLukjanov> but it's a bit unclear who should do it :)
18:42:29 * mattf nudges tosky
18:42:44 <SergeyLukjanov> mattf, lol :)
18:42:55 <elmiko> i didn't wanna say it, but since mattf did ;)
18:43:08 <tmckay> +1, tosky tosky
18:43:25 <aignatov> SergeyLukjanov: just write his name :)
18:43:32 <SergeyLukjanov> I'll figure out the details and than we could return to this q.
18:43:40 <SergeyLukjanov> aignatov, I have his name in my list :)
18:43:44 <elmiko> aignatov: lol
18:44:14 <tmckay> he didn't speak up, so he must be happy with it
18:44:31 <aignatov> tmckay: lol
18:44:36 <tosky> ehm
18:44:47 <tmckay> oh, hi :)
18:44:59 <tosky> is it a matter of... attending meetings and checking logs?
18:45:26 <SergeyLukjanov> tosky, sounds like this... and helping doing everything related to sahara
18:45:52 <SergeyLukjanov> so, the liaisons idea is to help in cross-projects coordination, especially for horizontal projects
18:47:07 <tosky> ok, is there a list of duties/page to subscribe/etc?
18:47:48 <SergeyLukjanov> tosky, not yet, all info is on the wiki page
18:48:10 <SergeyLukjanov> elmiko, I've added you to the https://launchpad.net/~sahara-bugs you now have an ability to triage and target bugs
18:48:24 <elmiko> SergeyLukjanov: awesome! thanks
18:49:09 <SergeyLukjanov> and to https://launchpad.net/~sahara-coresec this group is used to contact sahara folks about OSSG stuff
18:49:19 <elmiko> cool
18:49:53 <tosky> SergeyLukjanov: oh, the same as documentation, I see
18:50:02 <SergeyLukjanov> tosky, yup
18:50:08 <tosky> SergeyLukjanov: but I'm not a core reviewer
18:50:31 <SergeyLukjanov> I'm not sure that it's an issue
18:50:55 <SergeyLukjanov> it's more relevant for the huge projects
18:52:10 <tosky> SergeyLukjanov: if you think it's not a problem, I can add my name; is there a way to check?
18:52:41 <SergeyLukjanov> tosky, I'll talk with qa guys about it
18:52:53 <SergeyLukjanov> I think we'll talk about it on summit too
18:52:57 <tosky> oki
18:53:16 <SergeyLukjanov> tosky, I'm keeping you in mind for this job :)
18:54:39 <tosky> oki :)
18:54:47 <SergeyLukjanov> 5 mins left
18:56:26 <crobertsrh> just enough time to #endmeeting? :)
18:57:16 <SergeyLukjanov> yeah ^)
18:57:22 <mattf> +1
18:57:28 <SergeyLukjanov> so, sounds like there is no more topics to talk about
18:57:32 <SergeyLukjanov> thank you all folks!
18:57:39 <SergeyLukjanov> 2 mins to have an extra coffee
18:57:42 <SergeyLukjanov> #endmeeting