19:00:38 <notmyname> #startmeeting swift 19:00:39 <openstack> Meeting started Wed Feb 18 19:00:38 2015 UTC and is due to finish in 60 minutes. The chair is notmyname. Information about MeetBot at http://wiki.debian.org/MeetBot. 19:00:40 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 19:00:42 <openstack> The meeting name has been set to 'swift' 19:00:47 <notmyname> who's here for the swift meeting? 19:00:49 <mattoliverau> o/ 19:00:53 <peluse> me :) 19:01:00 <mahatic> me too 19:01:00 <cutforth> hola 19:01:17 <torgomatic> 👈 19:01:26 <jrichli> here 19:02:13 <notmyname> welcome everyone 19:02:24 <notmyname> #topic hackathon report 19:02:33 <notmyname> last week was great! 19:02:40 <mattoliverau> +1 19:02:49 <notmyname> thanks for coming 19:02:52 <notmyname> #link https://swiftstack.com/blog/2015/02/13/openstack-swift-hackathon/ 19:02:56 <notmyname> #link https://thiagodasilvablog.wordpress.com/2015/02/16/openstack-swift-mid-cycle-report/ 19:03:05 <acoles> hello 19:03:05 <notmyname> tdasilva: ^^ had a really great writeup 19:03:27 <notmyname> I hope everyone made it back ok. for you on the US east coast, the weekend after you left it was about 70-75 here 19:03:36 <tdasilva> :P 19:03:45 <notmyname> tdasilva: that's _above_ zero 19:03:48 <notmyname> ;-) 19:03:54 <mattoliverau> lol 19:04:00 <peluse> 80+ here 19:04:19 <tdasilva> we are at 27 today! that's balmy 19:04:33 <tdasilva> no wind, feels great 19:04:58 <notmyname> so a lot of great stuff done. a lot of patches landed. a lot of great conversations continued and started about new stuff 19:05:05 <cutforth> maybe CA will trade you some warmth for some water 19:05:56 <notmyname> anyway, just wanted to say thanks for coming and participating. and if you weren't there, you were missed 19:06:13 <notmyname> I want to cover one big thing this week: EC 19:06:18 <notmyname> #topic erasure codes 19:06:27 <notmyname> we're getting close to the openstack kilo release 19:06:39 <notmyname> it's about 7-8 weeks away (until we need an RC for it) 19:06:46 <notmyname> ie early/mid may 19:06:55 <notmyname> err, sorry 19:06:59 <notmyname> ie early/mid april 19:07:03 <peluse> damn it 19:07:16 <mattoliverau> peluse: no rest for you! :P 19:07:26 <notmyname> so, here's what I'm thinking 19:08:07 <notmyname> first, at a high level, push to release an EC beta in the kilo release. this is something that works, at least from a functional and probe test sense, and would be ok in a lab environment 19:08:41 <peluse> and has great value for performance characterization 19:08:46 <notmyname> of course 19:08:57 <notmyname> so what's needed to get there. first let's look at timelines 19:09:08 <clayg> whoa, nice work tdasilva 19:09:17 <notmyname> if we allow 2 weeks for a merge to master, that pushes us back to march 27 19:09:21 <notmyname> that's 5 weeks from now 19:09:41 <notmyname> so in those 5 weeks, there's a few major things to get done 19:09:50 <notmyname> PUT path with the .durable files 19:09:53 <notmyname> GET path 19:10:07 <notmyname> some refactoring on those to make them supportable in a code sense 19:10:09 <tdasilva> clayg: thx 19:10:14 <peluse> how about I add a new column to trello (or color on remaining items, something to make them stand out) as "must haves" for beta? 19:10:17 <notmyname> (eg separate ECObjectControllers) 19:10:23 <notmyname> peluse: ya, that's good 19:10:33 <notmyname> then there's the reconstructor 19:10:43 <peluse> oh yeah, that 19:11:13 <notmyname> if we have functional tests passing against an EC policy and probe tests passing against the reconstructor, I think we'll be in really good shape 19:11:28 <clayg> tdasilva: s/week point/oppertunity to improve/ 19:11:46 <notmyname> it's a bunch of work, but I think it's possible to get done 19:12:08 <notmyname> I've redone the priority reviews page to add EC up at the top 19:12:09 <notmyname> #link https://wiki.openstack.org/wiki/Swift/PriorityReviews 19:12:14 <peluse> agree, I'd like to schedule some online meeting times for reviews as well to make sure the cirical ones stay moving if that's OK 19:12:24 <notmyname> peluse: ok 19:12:33 <peluse> also, note, I updated the EC section this morning so its current 19:12:36 <notmyname> thanks 19:12:52 <peluse> I'll announce the dates/times in the channel and on trello, probably Fridays mid morning 19:13:14 <notmyname> peluse: are you thinking in IRC or phone? 19:13:20 <peluse> phone 19:13:32 <notmyname> ok. yes please announce that in IRC 19:13:56 <peluse> also looking for a small face to face in Santa Clara in Mar for at least those working directly on the required elements for beta 19:14:07 <peluse> probably just 1 day 19:14:27 <notmyname> I tink the next 2 weeks are critical. if we have good momentum, then we have a good chance of getting EC done(ish) by kilo. if we don't make good progress, then it will be nearly impossible 19:14:50 <notmyname> so I expect to be able to make a call (as a group) in 2 weeks on an EC beta in kilo 19:14:54 <peluse> I tink so too :) 19:15:04 <notmyname> which is really important to all of the non-devs involved in it as soon as it's released 19:15:14 <notmyname> so.... 19:15:20 <notmyname> what questions do you have? what concerns? 19:16:29 <peluse> I'm all in. 19:16:33 <notmyname> (this is where you start talking and not me ;-) 19:16:45 <mattoliverau> I think its a sane way to move forward, lets try and get as far as we can in the next 2 weeks 19:17:09 <clayg> mattoliverau: I think we have like 5 weeks to get proposed to master, 2 weeks to get merged, and then rc 19:17:33 <notmyname> yes 19:17:42 <acoles> notmyname: will the propose to master be a chain, like with SP, or one big patch? 19:18:09 <peluse> and everyone is good with a 'beta' tag where we are rock solid on the repl code paths that are touched by EC changes and clearly label EC policies as beta right? 19:18:19 <notmyname> acoles: we can do whatever is needed. but I was thinking a chain like last time 19:18:29 <torgomatic> my big hope is that we get the on-disk data format right 19:18:33 <clayg> acoles: tbd, but I think overall the chain idea "worked" but really only from a conceptual level - most people just reviewed the last patch and everything merged at once 19:18:36 <torgomatic> we can always fix the code later 19:19:10 <notmyname> one important part, for people writing and reviewing, is that anything we write down for EC needs to be versioned 19:19:10 <clayg> acoles: one thing well do different is put the doc patch at the end so people can just push up grammer fixes without worrying about making the rest of the change need a rebase 19:19:13 <mattoliverau> clayg: yeah, but 2 weeks we make the call 19:19:21 <peluse> wrt chain vs one big patch, it may very well be just 2-3 patches (small chain) so I wouldn't worry about that too much 19:19:23 <clayg> mattoliverau: oh god 19:19:27 <notmyname> eg new hashes.pkl? version it. new MIME doc/trailers? version it 19:19:44 <peluse> version it 19:20:03 <acoles> clayg: yeah! the rebasing up the chain a pain to keep track of what had changed where 19:20:04 <clayg> there's bound to be a meme for "stick a XXX on it" 19:20:25 <notmyname> acoles: ya, we'll take the lesson from last time and put the docs at the end of the chain! 19:20:26 <torgomatic> you could use birds for version designators, I suppose 19:20:38 <torgomatic> version 'swallow', version 'kestrel', version 'albatross' 19:20:49 <notmyname> torgomatic: swift, crow release with the bluebird protocol? 19:20:54 <peluse> heh 19:21:14 * torgomatic is especially fond of "albatross" for things that change the on-disk data format 19:21:14 <notmyname> torgomatic: also, that sounds like an amusing and terrible idea ;-) 19:21:16 <acoles> the eagle has landed 19:21:31 <notmyname> acoles: in the openstack liberty release?! 'MURICA! 19:21:35 <clayg> ... and ... next topic :P 19:21:40 <notmyname> ya :-) 19:21:59 <notmyname> #topic service tokens 19:22:08 <notmyname> acoles: you just added this to the agenda (after the meeting started! 19:22:19 <notmyname> #link https://review.openstack.org/#/c/137086/ 19:22:21 <clayg> acoles is sneaky 19:22:24 <notmyname> acoles: ready for review? 19:22:27 <acoles> ok, i just wanted to flag up that imho its ready for review 19:22:29 <torgomatic> the agenda is eventually consistent 19:22:34 <notmyname> great 19:22:36 <acoles> notmyname: took words out my mouth 19:22:43 <notmyname> review EC first. then service tokens ;-) 19:22:50 <clayg> lol 19:23:10 <acoles> but as usual with stuff that relates to keystone there's some keystone setup to do to run the func tests 19:23:11 <notmyname> acoles: thanks for working on that. it's a cool feature. and tell donagh thanks too 19:23:20 <mattoliverau> acoles: thanks for providing a script, that'll help heaps for us non keystone guys :) 19:23:23 <acoles> so i have put copiou notes on a gist 19:23:30 <acoles> copious 19:23:43 <notmyname> acoles: nice. we need to find all those keystone notes you have and get them on the wiki 19:23:45 * peluse needs to stwp away or just a few minutes... 19:23:54 <acoles> and if anyone is up for reviewing but needs help then ping me 19:24:15 <notmyname> I slightly updated https://wiki.openstack.org/wiki/Swift so it auto links to any other page on the wiki that starts with "Swift" 19:24:25 * acoles realises he is up against EC for review-time ;) 19:24:53 * acoles should say "donagh he is up against EC for review-time ;)" 19:24:55 <notmyname> acoles: anything else on service tokens for today? 19:25:25 <acoles> notmyname: no, just flagging it up - can i add it to priority review or is that presumptious ;) 19:25:32 <notmyname> ok, thanks 19:25:37 <clayg> acoles: do it! 19:25:39 <notmyname> acoles: ya, under the EC section 19:25:47 <clayg> also... it is presumptious - but I like that 19:25:52 <notmyname> +1 19:26:03 <acoles> notmyname: under EC? 19:26:12 <notmyname> below, I mean 19:26:18 <notmyname> in the "swift general" section 19:26:26 <acoles> notmyname: ah, that makes sense 19:26:43 <acoles> i'm not so presumptious as to put it *above* :D 19:26:47 <notmyname> I don't think we'll likely have a release between now and kilo, so as we get closer, I'll start a section for the next release 19:27:17 <notmyname> #topic opther 19:27:20 <notmyname> #topic other 19:27:32 <notmyname> nothing else was added to the meeting agenda 19:27:38 <notmyname> do you have anything else to bring up this week? 19:27:58 <torgomatic> one thing... let me grab the link 19:28:05 <notmyname> ok 19:28:34 <torgomatic> as noted in #openstack-swift earlier, https://www.openstack.org/vote-vancouver/Presentation/openstack-is-doomed-and-it-is-your-fault is a potential presentation 19:28:50 <torgomatic> go vote appropriately (I voted 3) 19:28:51 <notmyname> :-) 19:28:53 <torgomatic> that's all I have 19:29:07 <torgomatic> (no, I have no affiliation with the author of that presentation) 19:29:12 <torgomatic> (it just looks fun) 19:29:18 <notmyname> and I think redbo will also really like it 19:29:28 <clayg> notmyname: is "won't fix" the correct status for "not really a bug" -> https://bugs.launchpad.net/swift/+bug/1133069 19:29:29 <openstack> Launchpad bug 1133069 in OpenStack Object Storage (swift) "Concurrent uploads to same object" [Wishlist,Won't fix] 19:30:00 <clayg> in that case cschwede (correctly) noted that 'this can't be "fixed" in the general sense' 19:30:26 <notmyname> ya 19:30:29 <clayg> but redbo had previously marked it as "meh, doesn't seem so unreasonable for the object server to do this best effort, but it's not a big priority" 19:31:05 <notmyname> clayg: there's also "invalid" as a status 19:31:23 <clayg> and I agree that while *I'm* not planning on working on it, if someone wanted to figure out how to make hashdir cleanup return a boolean or something so the server can respond with 4xx if a more new timestamp slipped in while uploading to /tmp - it'd *review* it? 19:31:27 <notmyname> but won't fix is probably better IMO. "invalid" almost seems like it's not a thing 19:32:15 <clayg> hrmm.... i hate "won't fix" it's like the most asinine wording - like gerrit used to be "do not merge this" 19:32:27 <notmyname> clayg: that sounds like a great patch for after EC ;-) 19:32:39 <peluse> hell, throw it in the EC bucket :) 19:32:48 <notmyname> lol 19:32:59 <notmyname> peluse: no! cut scope for a beta! 19:33:13 <notmyname> anything else to bring up? 19:33:21 <clayg> lol, it's not a priority to me at all - but mattoliverau was talking about cleaning up the bug list and christian was griping he never knows what's the right status - so I was wonder if there was a same page for us to get on? 19:33:37 <clayg> notmyname: I don't want the spec's repo to be an "ideas board" -> https://review.openstack.org/#/c/151335/ 19:33:41 <notmyname> as torgomatic the summit session voting is ongoing. there's some cool swift stuff 19:33:55 <notmyname> clayg: ya I agree with that 19:34:13 <clayg> i don't care for the new interface, i keep loosing my place when I'm trying to work my way down a list of topics from a search term 19:34:23 <notmyname> as discussed last week, we need to be better about bug triage. I'm working on that 19:34:29 <notmyname> clayg: new tabs are the only answer 19:34:44 <notmyname> and we'll get to the cleanup and status stuff 19:36:32 <notmyname> if there's anything else, please mention it soon. otherwise I'm closing the meeting in about 30 seconds 19:37:06 <torgomatic> short meetings are best meetings 19:37:38 <notmyname> thanks everyone for coming. thanks for working on swift 19:37:40 <peluse> ya 19:37:42 <notmyname> #endmeeting