18:01:26 <SergeyLukjanov> #startmeeting sahara
18:01:27 <openstack> Meeting started Thu Jun 25 18:01:26 2015 UTC and is due to finish in 60 minutes.  The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot.
18:01:28 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
18:01:31 <openstack> The meeting name has been set to 'sahara'
18:01:35 <tosky> hi
18:01:36 <NikitaKonovalov> hi
18:01:51 <SergeyLukjanov> #link https://wiki.openstack.org/wiki/Meetings/SaharaAgenda
18:02:31 <SergeyLukjanov> #topic sahara@horizon status (crobertsrh, NikitaKonovalov)
18:02:38 <SergeyLukjanov> #link https://etherpad.openstack.org/p/sahara-reviews-in-horizon
18:03:13 <SergeyLukjanov> any updates?
18:03:15 <NikitaKonovalov> no updates from me here as I've been busy with non-ui stuff
18:03:32 <SergeyLukjanov> and Chad is not here
18:03:53 <SergeyLukjanov> so, let's move on and return back to this topic if he'll join us later
18:03:55 <SergeyLukjanov> #topic News / updates
18:04:28 <SergeyLukjanov> the L1 successfully released! yay!
18:05:04 <NikitaKonovalov> I've been working on HDP plugin: scaling support for non-ha clusters. Now, I'm working on HA support
18:05:14 <SergeyLukjanov> #info L1 released, note that it's a 3.0.0.0b1 tag in sahara, sahara-image-elements and sahara-extra repositories
18:06:45 <fletcher_> hello tmcpeak :)
18:07:03 <SergeyLukjanov> hm, let's wait for a few mins, sounds like not many folks joined :(
18:08:21 <SergeyLukjanov> vgridnev, any news? :)
18:08:29 <SergeyLukjanov> tosky, ?
18:09:04 <vgridnev> I already finished auto-tune configs and asking you guys for review
18:09:17 <tosky> SergeyLukjanov: nothing too much, I'm working internally at the moment
18:09:35 <SergeyLukjanov> okay, sounds it'll be very short meeting today :)
18:09:43 <SergeyLukjanov> #topic Open discussion
18:09:48 <tosky> waiting for the "split the tests" specs, and looking at the patches for scenario tests :)
18:10:02 <SergeyLukjanov> anyone wants to discuss something?
18:10:32 <SergeyLukjanov> I'm finishing internal tasks and will return back to specs early next week, hopefully push all of them in a first half of the week
18:10:36 <SergeyLukjanov> tosky, ^^
18:10:39 <SergeyLukjanov> sorry about the delay
18:10:55 <tosky> sure, sue
18:11:02 <SergeyLukjanov> tosky, have you seen custom checks?
18:11:44 <tosky> SergeyLukjanov: yep, even if they are "the" checks, so the "custom" part of the name could be dropped imho, but not something I would spend too much time
18:12:09 <SergeyLukjanov> tosky, yeah, the custom word isn't so meaningful :)
18:13:16 <SergeyLukjanov> heh
18:13:16 <huichun> we are also confusing by "custom" in scenario test
18:14:04 <SergeyLukjanov> I think that we need probably to correct a bit spec for this checks
18:14:06 <tellesnobrega> i'm writing the spec for multiple clusters in client at most next week and i may need some help to implement the horizon part
18:14:26 <SergeyLukjanov> IMO they should be running automagically when corresponding service enabled (I mean re checks for HBase, Impala, etc.
18:14:32 <SergeyLukjanov> tosky, huichun ^^
18:14:59 <SergeyLukjanov> tellesnobrega, I think NikitaKonovalov could help with it, it should be very simple patch
18:15:15 <SergeyLukjanov> tellesnobrega, so, you finally decided to do it in the python client?
18:15:17 <tosky> SergeyLukjanov: does this mean adding a detection mechanism in the test code, based on the configured servers from yaml, right?
18:15:32 <SergeyLukjanov> tosky, probably yes
18:15:42 <tellesnobrega> SergeyLukjanov, just implementing the new parameter --count in the create call to create multiple
18:15:51 <tellesnobrega> the code is on the server with a new api entry
18:16:02 <SergeyLukjanov> tellesnobrega, ack
18:16:16 <tosky> automatic check based on the available server makes sense, I guess
18:16:16 <tellesnobrega> in the horizon we will have a box with a number selector
18:16:18 <tellesnobrega> thats about it
18:16:48 <NikitaKonovalov> tellesnobrega: ping me if you have any questions about our horizon panels
18:17:13 <NikitaKonovalov> adding one parameter is not a hard thing to do
18:17:24 <NikitaKonovalov> (getting it merged is another thing)
18:17:33 <SergeyLukjanov> NikitaKonovalov, :)
18:17:38 <SergeyLukjanov> crobertsrh, hey!
18:17:46 <crobertsrh> hi...sorry I'm a bit late.
18:17:53 <SergeyLukjanov> NikitaKonovalov, do you probably know anything about moving sahara to the contrib/ dir?
18:17:55 <SergeyLukjanov> crobertsrh, ^^
18:18:01 <SergeyLukjanov> crobertsrh, any news?
18:18:10 <NikitaKonovalov> SergeyLukjanov: no news on that
18:18:31 <crobertsrh> Not much progress.  I have another patch queued-up for editing data sources, but not much progress on anything else, including reviews.
18:19:08 <crobertsrh> I suspect that the contrib/ move is still going to happen, but I have not heard the timeframe (I missed yesterday's horizon meeting though).
18:19:23 <david-lyle> SergeyLukjanov: I'm working on the move, testing transition is proving to be the sticking point at the moment
18:19:47 <SergeyLukjanov> david-lyle, great, thx!
18:20:04 <SergeyLukjanov> david-lyle, if you'll need help on infra side - please, ping, I'll be glad to +2 ;)
18:20:28 <david-lyle> more around having separable test config in horizon
18:20:37 <david-lyle> hopefully will be resolved soon
18:21:09 <tosky> david-lyle: will the move also affect the integration tests, or is this about unit tests?
18:21:28 <david-lyle> tosky: both
18:21:46 <david-lyle> double the fun
18:21:57 <tellesnobrega> NikitaKonovalov, sure, thanks
18:22:25 <tosky> david-lyle: ah! Is there some guideline or instruction to follow to fix stuff, or a draft of the process to understand where things could break?
18:22:57 <david-lyle> tosky: that's part of what I'm working on, Sahara happens to be the guinea pig
18:23:23 <tosky> >.<
18:23:25 <tosky> ok, let's see
18:25:14 <SergeyLukjanov> :)
18:25:55 <SergeyLukjanov> we should remember about need to update the way how horizon packaged - to include sahara from contrib/
18:25:56 <SergeyLukjanov> :)
18:26:25 <SergeyLukjanov> david-lyle, from the users point of view, nothing will be changed, am I right? like Sahara will be under Projects in Horizon?
18:26:50 <david-lyle> yes, same for users
18:27:24 <david-lyle> discovery is all from service catalog
18:27:39 <david-lyle> but the user experience won't change
18:29:04 <SergeyLukjanov> okay, great, thanks for the confirm david-lyle
18:29:11 <SergeyLukjanov> anyone wants to discuss something?
18:29:51 <crobertsrh> Nothing from me.
18:30:04 <weiting> SergeyLukjanov, do you have any experience about swiftfs?
18:30:18 <weiting> We got one issue when we are running Hibench
18:31:04 <SergeyLukjanov> weiting, it was written initially by our folks, personally I've not contributed in it at all
18:31:11 <SergeyLukjanov> weiting, could you share your issue?
18:31:16 <weiting> And it looks like swift may have too many request to handle and raise some client connect time out.
18:31:50 <weiting> The issue comes from prepare phase in Hibench and it related with the data input size.
18:32:39 <SergeyLukjanov> what size?
18:32:54 <weiting> We can success in 20GB, but if the data input size is 100GB, it will fail to write the file in swift
18:33:59 <weiting> It may be related with our swift server capability, in our case we only build up 4 node swift cluster
18:34:28 <SergeyLukjanov> I will ping folks who knows more about swift fs, probably some known issues
18:35:12 <weiting> Ok, thanks. We would like to know if you have already did some testing in swiftfs.
18:38:11 <SergeyLukjanov> weiting, for the last time Kazuki was doing a lot on SwiftFS improvements https://github.com/openstack/sahara-extra/commits/master/hadoop-swiftfs
18:40:02 <weiting> SergeyLukjanov, got it, I will check and make sure we use the latest swiftfs in our environment.
18:40:28 <SergeyLukjanov> anything else to chat about today?
18:42:05 <SergeyLukjanov> okay, let's finish meeting :)
18:42:12 <SergeyLukjanov> have a good rest of day folks!
18:44:25 <SergeyLukjanov> #endmeeting