mattoliverau | lol | 00:00 |
---|---|---|
notmyname | I'm headed home. | 00:07 |
*** matsuhashi has joined #openstack-swift | 00:28 | |
*** dmorita has joined #openstack-swift | 00:28 | |
*** dmsimard_away is now known as dmsimard | 00:37 | |
*** shri has quit IRC | 00:39 | |
*** dmsimard is now known as dmsimard_away | 00:42 | |
*** diegows has quit IRC | 00:51 | |
*** gyee has quit IRC | 01:08 | |
openstackgerrit | Yuan Zhou proposed a change to openstack/swift: modify test_sleeper() to reduce variations https://review.openstack.org/96651 | 01:12 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/python-swiftclient: Updated from global requirements https://review.openstack.org/89250 | 01:37 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 01:38 |
*** nosnos has joined #openstack-swift | 01:46 | |
*** miqui has joined #openstack-swift | 01:48 | |
*** dmsimard_away is now known as dmsimard | 02:04 | |
*** dmsimard is now known as dmsimard_away | 02:12 | |
*** nsquare has quit IRC | 03:03 | |
*** haomaiwang has joined #openstack-swift | 03:28 | |
*** haomai___ has joined #openstack-swift | 03:30 | |
*** haomai___ has quit IRC | 03:32 | |
*** haomaiwang has quit IRC | 03:32 | |
*** haomaiwang has joined #openstack-swift | 03:33 | |
*** nosnos has quit IRC | 03:33 | |
*** fifieldt has joined #openstack-swift | 04:15 | |
*** nosnos has joined #openstack-swift | 04:15 | |
*** matsuhashi has quit IRC | 04:19 | |
*** matsuhashi has joined #openstack-swift | 04:19 | |
*** matsuhashi has quit IRC | 04:23 | |
*** matsuhashi has joined #openstack-swift | 04:27 | |
*** haomaiwang has quit IRC | 04:34 | |
*** haomaiwang has joined #openstack-swift | 04:34 | |
*** kashyapk has joined #openstack-swift | 04:37 | |
*** kashyapk_ has joined #openstack-swift | 04:37 | |
*** fifieldt has quit IRC | 04:41 | |
*** kashyapk has quit IRC | 04:41 | |
*** nsquare has joined #openstack-swift | 05:10 | |
*** psharma has joined #openstack-swift | 05:28 | |
*** nshaikh has joined #openstack-swift | 05:42 | |
*** ppai has joined #openstack-swift | 05:54 | |
*** bkopilov_ has joined #openstack-swift | 06:03 | |
*** zaitcev has quit IRC | 06:07 | |
*** bkopilov has quit IRC | 06:09 | |
mattoliverau | Night all, I'm heading off for the day. Cya all in the morning. | 06:30 |
*** jamie_h has joined #openstack-swift | 06:37 | |
*** zhiyan_ is now known as zhiyan | 06:37 | |
*** jamie_h has quit IRC | 06:39 | |
*** jamie_h has joined #openstack-swift | 06:39 | |
*** matsuhashi has quit IRC | 06:42 | |
*** matsuhashi has joined #openstack-swift | 06:43 | |
*** fbo is now known as fbo_away | 06:47 | |
*** matsuhashi has quit IRC | 06:47 | |
*** matsuhashi has joined #openstack-swift | 06:50 | |
*** jamie_h_ has joined #openstack-swift | 06:50 | |
*** jamie_h has quit IRC | 06:51 | |
*** leews has joined #openstack-swift | 06:55 | |
*** jamie_h_ has quit IRC | 06:55 | |
*** jamie_h has joined #openstack-swift | 06:56 | |
*** jamie_h is now known as jamiehannaford | 06:56 | |
*** kashyapk has joined #openstack-swift | 06:56 | |
*** kashyapk_ has quit IRC | 06:58 | |
*** kashyapk_ has joined #openstack-swift | 06:59 | |
*** kashyap__ has joined #openstack-swift | 07:01 | |
*** kashyapk has quit IRC | 07:02 | |
*** matsuhashi has quit IRC | 07:02 | |
*** matsuhashi has joined #openstack-swift | 07:03 | |
*** matsuhashi has quit IRC | 07:04 | |
*** matsuhashi has joined #openstack-swift | 07:04 | |
*** kashyapk_ has quit IRC | 07:05 | |
*** kashyap__ has quit IRC | 07:12 | |
*** kashyapk has joined #openstack-swift | 07:13 | |
*** kashyapk has quit IRC | 07:17 | |
*** kashyapk has joined #openstack-swift | 07:18 | |
*** kashyapk has quit IRC | 07:22 | |
*** kashyapk has joined #openstack-swift | 07:48 | |
*** haomaiwang has quit IRC | 07:50 | |
*** haomaiwang has joined #openstack-swift | 07:51 | |
*** mmcardle has joined #openstack-swift | 07:58 | |
*** kashyapk_ has joined #openstack-swift | 08:14 | |
*** jokke__ is now known as jokke_ | 08:16 | |
*** kashyapk has quit IRC | 08:18 | |
*** nsquare has quit IRC | 08:25 | |
*** fbo_away is now known as fbo | 08:26 | |
*** kashyapk_ has quit IRC | 08:44 | |
*** kashyapk has joined #openstack-swift | 08:45 | |
*** kashyapk has quit IRC | 08:49 | |
*** kashyapk has joined #openstack-swift | 08:50 | |
*** matsuhashi has quit IRC | 09:00 | |
*** matsuhashi has joined #openstack-swift | 09:01 | |
*** mmcardle has quit IRC | 09:03 | |
*** mmcardle has joined #openstack-swift | 09:09 | |
*** thurloat has quit IRC | 09:19 | |
*** swat30 has quit IRC | 09:19 | |
*** Longgeek_ has joined #openstack-swift | 09:25 | |
*** ppai has quit IRC | 09:26 | |
*** jamie_h has joined #openstack-swift | 09:26 | |
*** mmcardle1 has joined #openstack-swift | 09:27 | |
*** jamie_h has quit IRC | 09:28 | |
*** mmcardle has quit IRC | 09:28 | |
*** jamie_h has joined #openstack-swift | 09:28 | |
*** jamiehannaford has quit IRC | 09:29 | |
*** jamie_h has quit IRC | 09:29 | |
*** jamiehannaford has joined #openstack-swift | 09:30 | |
*** madhuri has quit IRC | 09:39 | |
*** ppai has joined #openstack-swift | 09:44 | |
*** kashyapk has quit IRC | 09:45 | |
*** kashyapk has joined #openstack-swift | 09:45 | |
*** kashyapk has quit IRC | 09:50 | |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Fixes probe tests with non-zero default storage policy https://review.openstack.org/96353 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support https://review.openstack.org/96027 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Documentation https://review.openstack.org/96026 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Containers https://review.openstack.org/96029 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Update FakeRing and FakeLogger https://review.openstack.org/96028 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Object Updates https://review.openstack.org/96031 | 09:50 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy support to Object Server https://review.openstack.org/96030 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Fix object-expirer for missing objects https://review.openstack.org/98511 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add functional tests for Storage Policy https://review.openstack.org/96042 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Update bin scripts to be storage policy aware https://review.openstack.org/96043 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Merge container storage_policy_index https://review.openstack.org/96040 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Accounts https://review.openstack.org/96041 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to list_endpoints https://review.openstack.org/96046 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Container Sync https://review.openstack.org/96047 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Enqueue misplaced objects during container replication https://review.openstack.org/96044 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add LRUCache to common.utils https://review.openstack.org/96045 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to ssync https://review.openstack.org/96034 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Put X-Backend-Timestamp in object 404 responses https://review.openstack.org/96035 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to the Auditor https://review.openstack.org/96032 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add storage policy support for the Replicator https://review.openstack.org/96033 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add container-reconciler daemon https://review.openstack.org/96038 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add reconciler probetest outline https://review.openstack.org/96039 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Extend interface on InternalClient https://review.openstack.org/96036 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Extend direct_client https://review.openstack.org/96037 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy support to the Account Reaper https://review.openstack.org/96049 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Recon Middleware https://review.openstack.org/96048 | 09:51 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add two vector timestamps https://review.openstack.org/99315 | 09:51 |
*** thurloat has joined #openstack-swift | 09:54 | |
*** zhiyan is now known as zhiyan_ | 10:00 | |
*** swat30 has joined #openstack-swift | 10:02 | |
*** zhiyan_ is now known as zhiyan | 10:03 | |
*** matsuhashi has quit IRC | 10:05 | |
*** matsuhashi has joined #openstack-swift | 10:06 | |
*** matsuhashi has quit IRC | 10:06 | |
*** matsuhashi has joined #openstack-swift | 10:06 | |
*** zhiyan is now known as zhiyan_ | 10:28 | |
*** Longgeek_ has quit IRC | 10:30 | |
*** ppai has quit IRC | 10:30 | |
d0ugal | Am I correct in thinking there isn't a way to get the version ID of the "latest" object? | 10:31 |
d0ugal | i.e. I want to point to a version and then when its updated it doesn't change. Currently if i'm pointing at "latest" it will then change to a new object | 10:31 |
*** nshaikh has quit IRC | 10:36 | |
*** ppai has joined #openstack-swift | 10:43 | |
*** matsuhashi has quit IRC | 10:45 | |
*** kashyapk has joined #openstack-swift | 10:48 | |
*** ppai has quit IRC | 11:00 | |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Fixes probe tests with non-zero default storage policy https://review.openstack.org/96353 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Update bin scripts to be storage policy aware https://review.openstack.org/96043 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add two vector timestamps https://review.openstack.org/99315 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to list_endpoints https://review.openstack.org/96046 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Container Sync https://review.openstack.org/96047 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Enqueue misplaced objects during container replication https://review.openstack.org/96044 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add LRUCache to common.utils https://review.openstack.org/96045 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy support to the Account Reaper https://review.openstack.org/96049 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Fix object-expirer for missing objects https://review.openstack.org/98511 | 11:03 |
openstackgerrit | Clay Gerrard proposed a change to openstack/swift: Add Storage Policy Support to Recon Middleware https://review.openstack.org/96048 | 11:03 |
*** ujjain has quit IRC | 11:14 | |
*** ujjain has joined #openstack-swift | 11:14 | |
clayg | d0ugal: that's a great usecase - no i don't think that's possible | 11:16 |
*** DisneyRicky has quit IRC | 11:18 | |
clayg | d0ugal: once the object is changed old version is copied to a new name - and even if you had that name, if the current version is deleted that new name will go away when it's popped off the stack and copied back into place | 11:18 |
*** leews has quit IRC | 11:18 | |
*** ppai has joined #openstack-swift | 11:19 | |
clayg | acoles: that's weird - I think i may have only missed that one about removing the headers_out update from container_updater and letting async_update do it... maybe I squashed it into the wrong place, but I didn't remember resolving any conflicts there... very strange | 11:19 |
*** leews has joined #openstack-swift | 11:19 | |
clayg | acoles: anyway if you notice anymore i missed just let me know - there was a sp fix that I noticed I didn't even attempt/mark done - so I caught that one, but I probably won't push again tonight (I don't think) | 11:20 |
*** jokke_ has quit IRC | 11:20 | |
acoles | clayg: no probs, your eyes must be tired | 11:21 |
acoles | clayg: i hope my nits aren't stretching your patience ;) | 11:21 |
acoles | clayg: i'm pressing on up the chain today... | 11:22 |
*** DisneyRicky has joined #openstack-swift | 11:23 | |
*** jokke_ has joined #openstack-swift | 11:23 | |
clayg | acoles: no worries, you gotta call 'em when you see 'em | 11:23 |
*** jokke__ has joined #openstack-swift | 11:27 | |
*** jokke_ has quit IRC | 11:27 | |
*** dmorita has quit IRC | 11:29 | |
*** ppai has quit IRC | 11:37 | |
*** mkollaro has joined #openstack-swift | 11:37 | |
*** dmsimard_away is now known as dmsimard | 11:37 | |
*** diegows has joined #openstack-swift | 11:41 | |
*** jokke__ is now known as jokke_ | 11:42 | |
d0ugal | clayg: Glad I understood correctly :) It's something we (TripleO) need and its preventing us using Swift. Do you know if it would be a welcome change if we were to propose it? Would this be best brought up at the next meeting? | 11:44 |
*** fbo is now known as fbo_away | 11:48 | |
*** tdasilva has quit IRC | 11:54 | |
*** fbo_away is now known as fbo | 11:56 | |
*** mmcardle1 has quit IRC | 11:57 | |
*** toolslive has joined #openstack-swift | 12:00 | |
*** NM has joined #openstack-swift | 12:13 | |
*** diegows has quit IRC | 12:13 | |
*** erlon has joined #openstack-swift | 12:14 | |
*** jamiehannaford has quit IRC | 12:18 | |
*** jamiehannaford has joined #openstack-swift | 12:19 | |
*** jamiehan_ has joined #openstack-swift | 12:22 | |
*** jamiehannaford has quit IRC | 12:24 | |
*** kashyapk has quit IRC | 12:28 | |
*** kashyapk has joined #openstack-swift | 12:28 | |
*** kashyapk has quit IRC | 12:33 | |
*** nosnos has quit IRC | 12:36 | |
*** psharma has quit IRC | 12:37 | |
*** nosnos has joined #openstack-swift | 12:43 | |
*** Alex_Gaynor has quit IRC | 12:46 | |
*** mmcardle has joined #openstack-swift | 12:46 | |
*** nosnos has quit IRC | 12:47 | |
*** sandywalsh has joined #openstack-swift | 12:48 | |
*** hurricanerix has quit IRC | 12:51 | |
*** hurricanerix has joined #openstack-swift | 12:51 | |
*** Alex_Gaynor has joined #openstack-swift | 12:51 | |
*** toolslive has quit IRC | 12:52 | |
*** toolslive has joined #openstack-swift | 12:54 | |
*** erlon has quit IRC | 13:00 | |
*** zhiyan_ is now known as zhiyan | 13:00 | |
*** mmcardle has quit IRC | 13:01 | |
*** toolslive has quit IRC | 13:01 | |
*** erlon has joined #openstack-swift | 13:01 | |
*** toolslive has joined #openstack-swift | 13:02 | |
*** Alex_Gaynor has quit IRC | 13:05 | |
*** mmcardle has joined #openstack-swift | 13:06 | |
*** Alex_Gaynor has joined #openstack-swift | 13:06 | |
*** tdasilva has joined #openstack-swift | 13:06 | |
*** ujjain has quit IRC | 13:07 | |
*** ujjain has joined #openstack-swift | 13:10 | |
*** kashyapk has joined #openstack-swift | 13:12 | |
*** shakayumi has joined #openstack-swift | 13:28 | |
*** toolslive has quit IRC | 13:40 | |
*** toolslive has joined #openstack-swift | 13:41 | |
*** zaitcev has joined #openstack-swift | 14:03 | |
*** ChanServ sets mode: +v zaitcev | 14:03 | |
*** thebloggu has joined #openstack-swift | 14:09 | |
*** zhiyan is now known as zhiyan_ | 14:26 | |
*** jamiehan_ has quit IRC | 14:28 | |
*** jamiehannaford has joined #openstack-swift | 14:28 | |
*** shakayumi has quit IRC | 14:55 | |
*** kashyapk has quit IRC | 14:55 | |
*** thebloggu has left #openstack-swift | 15:04 | |
*** kevinc_ has joined #openstack-swift | 15:11 | |
*** haomaiwang has quit IRC | 15:32 | |
*** haomaiwang has joined #openstack-swift | 15:33 | |
*** gyee has joined #openstack-swift | 15:35 | |
*** kevinc_ has quit IRC | 15:36 | |
*** kevinc_ has joined #openstack-swift | 15:57 | |
* portante steps out for a bit | 16:06 | |
*** NM has quit IRC | 16:07 | |
*** mkollaro has quit IRC | 16:07 | |
*** haomaiwang has quit IRC | 16:14 | |
*** haomaiwang has joined #openstack-swift | 16:14 | |
*** mwstorer has joined #openstack-swift | 16:15 | |
*** fbo is now known as fbo_away | 16:20 | |
*** donagh has quit IRC | 16:21 | |
*** marcusvrn has joined #openstack-swift | 16:27 | |
notmyname | d0ugal: can you tell me more about what you're looking for? | 16:32 |
d0ugal | notmyname: Sure | 16:32 |
*** erlon is now known as sombrafam | 16:32 | |
notmyname | d0ugal: I think you can get what you're looking for today in swift | 16:32 |
d0ugal | notmyname: cool! So, we want to store something in swift and use the version to manage what we run in a deployment. | 16:33 |
d0ugal | notmyname: So, say, we add a heat template, we want to stick to that one until we say "update to version X" | 16:33 |
d0ugal | but at the moment, it looks like if its the latest we have no way to continue to refer to that object | 16:33 |
d0ugal | I hope that makes some sense. | 16:34 |
notmyname | d0ugal: first, you need to ask yourself if you really need swift's versioned writes. ie why not just point to an object and then always point to that one? | 16:34 |
d0ugal | notmyname: hmm, good point. So rather than use versions just create new objects? | 16:35 |
notmyname | eg upload template_00001. then template_00002. etc | 16:35 |
notmyname | right | 16:35 |
d0ugal | That would work, the pain comes from when we want to list all the versions of a specific object | 16:36 |
peluse_ | or do you even need to retain prev versions, just use the name name over and over | 16:36 |
d0ugal | but with a bit of manual work and a naming convention we could manage that. | 16:36 |
notmyname | peluse_: good point | 16:36 |
d0ugal | peluse_: yeah, for a roll back. | 16:36 |
d0ugal | We may have production on one version, dev on a newer version and then when we have tested it enough we bump production up | 16:37 |
peluse_ | d0ugal: cool, just checking | 16:37 |
notmyname | d0ugal: ya, that sounds like a naming convention solution | 16:37 |
peluse_ | d0ugal: what about using different containers for a limited number of versions and use the name name in each (ir prod container, dev container, n-1 container) | 16:38 |
d0ugal | peluse_: Oh, that could work too. | 16:38 |
d0ugal | ha, I should have asked earlier. | 16:38 |
peluse_ | then its super easy to keep things organized and list, etc. | 16:38 |
d0ugal | The version system seemed like it would be a natural fit and when it didn't quite match we stopped looking. | 16:39 |
peluse_ | plus with storage policies you could even do reduced replciation count on maybe the n-1 container or something to save some space :) | 16:39 |
notmyname | wheee | 16:39 |
d0ugal | I'm going to have to give this some thought | 16:40 |
*** toolslive has quit IRC | 16:40 | |
notmyname | d0ugal: great. feel free to jump in and ask if something else comes up | 16:41 |
d0ugal | peluse_, notmyname - thanks for the suggestions, its the end of the day here, so I'm going to go and ponder this | 16:41 |
d0ugal | but yeah, I might take you up on that and come back with a follow up :) | 16:41 |
peluse_ | cool, welcome! | 16:42 |
*** pberis has quit IRC | 16:42 | |
notmyname | clayg: looks like https://review.openstack.org/#/c/99315/ is the last SP patch now (2 more added last night) | 16:42 |
*** pberis has joined #openstack-swift | 16:43 | |
notmyname | clayg: is that correct? | 16:43 |
*** toolslive has joined #openstack-swift | 16:53 | |
*** shri has joined #openstack-swift | 16:55 | |
notmyname | swift team meeting in 2 hours in #openstack-meeting. we'll discuss the state of the storage policy patches and look at the other that are ready to land | 16:59 |
clayg | notmyname: TWO!? more?! | 16:59 |
clayg | yeah i stuck two vector time on the end | 16:59 |
clayg | what's the other one? | 16:59 |
notmyname | 8312660bfcbdd00f6776349aa1391779620a5f0d obj expirer for missing objects | 17:00 |
notmyname | patchbot: p 98511 | 17:00 |
patchbot | notmyname: https://review.openstack.org/#/c/98511/ | 17:00 |
*** kashyapk has joined #openstack-swift | 17:01 | |
clayg | i thougth i already added that one | 17:05 |
clayg | notmyname: if you're lucky i may even stop adding new patches | 17:05 |
notmyname | ok. either you didn't or I missed it (prob the latter). either way, the current last patch is 99315 | 17:06 |
notmyname | lol | 17:06 |
*** ChanServ changes topic to "Storage Policies have been proposed to master. Soft freeze in effect until these patches land | First SP patch: https://review.openstack.org/#/c/96026/ | Last SP patch: https://review.openstack.org/#/c/99315" | 17:06 | |
zaitcev | aye aye captain, git review -d 99315 | 17:07 |
notmyname | clayg: IIRC, that's the last set of functionality right? the bin scripts and the 2D time for the reconciler | 17:07 |
*** kashyapk has quit IRC | 17:07 | |
clayg | notmyname: yup | 17:08 |
notmyname | yay! | 17:08 |
clayg | notmyname: i made a comment about wanting to add some targeted probetests to the two vector time, so i'll probably do that - oh and there's another probetests (that I wrote) that seems to fail most of the time for me now | 17:09 |
clayg | notmyname: so it's hardly the last change set - but yeah with any luck you smart people will still having good ideas and you'll just let this in with out making me make it all "good" or w/e | 17:10 |
clayg | s/still having good/stop having good/ | 17:10 |
*** NM has joined #openstack-swift | 17:15 | |
*** toolslive has quit IRC | 17:17 | |
*** nsquare has joined #openstack-swift | 17:24 | |
*** mmcardle has quit IRC | 17:42 | |
*** mwstorer has quit IRC | 17:44 | |
clayg | do we have a meeting starting in like 5 mins? | 17:55 |
torgomatic | 65 minutes? | 17:55 |
clayg | oh nice, i'll bbiab | 17:55 |
*** jamiehannaford has quit IRC | 18:00 | |
acoles | clayg: nice work on the timestamp stuff | 18:09 |
peluse_ | no shit, just going through it now. rock on clayg | 18:30 |
*** kevinc_ has quit IRC | 18:31 | |
*** kevinc_ has joined #openstack-swift | 18:31 | |
*** Midnightmyth has joined #openstack-swift | 18:37 | |
*** torgomatic has quit IRC | 18:39 | |
*** StevenK has quit IRC | 18:40 | |
*** StevenK has joined #openstack-swift | 18:40 | |
*** gvernik has joined #openstack-swift | 18:41 | |
*** torgomatic has joined #openstack-swift | 18:41 | |
*** ChanServ sets mode: +v torgomatic | 18:41 | |
*** jamiehannaford has joined #openstack-swift | 18:41 | |
*** jamiehannaford has quit IRC | 18:43 | |
*** jamiehannaford has joined #openstack-swift | 18:44 | |
*** mwstorer has joined #openstack-swift | 18:44 | |
notmyname | since I am having surgery tomorrow morning, I have temporarily added clayg and torgomatic to the swift-ptl group in gerrit. should anything happen | 18:50 |
*** Midnightmyth has quit IRC | 18:50 | |
gvernik | notmyname: this surgery related that bike accident you had couple of weeks ago? | 18:51 |
notmyname | gvernik: yes. lining up my broken collar bone and screwing a metal plate into it | 18:52 |
gvernik | notmyname: ohh...feel good! | 18:53 |
notmyname | thanks | 18:53 |
notmyname | ah, cool. briancline perfectly updated the meeting agenda page :-) | 18:55 |
shri | good luck notmyname. Hope you recover "swift"ly :-) | 18:56 |
*** mjseger has joined #openstack-swift | 18:56 | |
notmyname | lol | 18:58 |
mjseger | creiht: swifterdarrell: and others, I wanted to share what I've been up to with statsd and get some feedback on the potential (I think) usefulness | 19:00 |
mjseger | the best place to start might be here - http://paste.openstack.org/show/83687/ | 19:00 |
notmyname | swift team meeting time in #openstack-meeting | 19:00 |
mjseger | ooohhhhhh | 19:00 |
mjseger | sorry | 19:00 |
*** cutforth has joined #openstack-swift | 19:01 | |
clayg | acoles: meh | 19:05 |
clayg | acoles: getting it passing func and probe was easy | 19:05 |
clayg | acoles: getting all the unittests to pass wasn't so bad either, but it took a bunch of extra work to convince myself that the internalized form is really ok | 19:05 |
*** nsquare has quit IRC | 19:16 | |
portante | when I hear ack I think of: http://henrystrongingoldberg.blogspot.com/bill_the_cat.gif | 19:35 |
notmyname | :-) | 19:36 |
*** fbo_away is now known as fbo | 19:39 | |
clayg | briancline: sieral per container server, yes - I don't think there's a *single* point of contention for the system - i'm not sure it's clear how to best solve the scaling issue, gholt seems to think getting the object servers involved in the push (maybe new COPY verb in obj.server) could reduce the network bottleneck at the container servers | 19:48 |
*** gvernik has quit IRC | 19:51 | |
briancline | yeah, I know some folks run container servers on separate boxes too (I'm guessing in smaller numbers than physical object servers) - seems like it could be a bit perilous without enough container servers | 19:52 |
briancline | with enough usage | 19:52 |
*** jamiehannaford has quit IRC | 19:52 | |
briancline | clayg: is there any reason a sync server couldn't use multiple workers to do a sync, say for instance if it gathers up info on everything it knows it's responsible for syncing, then distributing that amongst N worker threads? (possible network contention aside) | 19:58 |
*** mjseger has quit IRC | 20:01 | |
clayg | briancline: yeah i think the network contention is all that get's you | 20:08 |
clayg | briancline: it's mostly a network shuffler so coro's are pretty good | 20:08 |
clayg | briancline: yeah I think you stick container_sync_row in a greenthread but you'd have to keep track of your last successful sync point more better maybe... | 20:10 |
briancline | if people would just store smaller copies of their cat photos this would be way easier | 20:14 |
*** mwstorer has quit IRC | 20:21 | |
*** nsquare has joined #openstack-swift | 20:29 | |
*** NM has quit IRC | 20:30 | |
*** cutforth has quit IRC | 20:31 | |
*** cutforth has joined #openstack-swift | 20:32 | |
*** CaioBrentano1 has quit IRC | 20:37 | |
*** portante has quit IRC | 20:39 | |
*** dosaboy has quit IRC | 20:39 | |
*** JoshNang has quit IRC | 20:39 | |
*** fbo has quit IRC | 20:39 | |
*** ryao has quit IRC | 20:39 | |
*** bobby_ has quit IRC | 20:39 | |
*** patchbot has quit IRC | 20:39 | |
*** mlanner has quit IRC | 20:39 | |
*** j_king has quit IRC | 20:39 | |
*** jd__ has quit IRC | 20:39 | |
*** dosaboy has joined #openstack-swift | 20:40 | |
*** ryao has joined #openstack-swift | 20:40 | |
*** j_king has joined #openstack-swift | 20:40 | |
*** portante has joined #openstack-swift | 20:40 | |
*** ChanServ sets mode: +v portante | 20:40 | |
*** portante has quit IRC | 20:40 | |
*** portante has joined #openstack-swift | 20:40 | |
*** morgan.freenode.net sets mode: +v portante | 20:40 | |
*** JoshNang has joined #openstack-swift | 20:40 | |
*** minnear has joined #openstack-swift | 20:40 | |
*** jd__ has joined #openstack-swift | 20:40 | |
notmyname | briancline: lol | 20:40 |
*** fbo has joined #openstack-swift | 20:41 | |
*** mlanner has joined #openstack-swift | 20:41 | |
*** patchbot has joined #openstack-swift | 20:42 | |
zaitcev | Does anyone think EC is going to land in Juno? | 20:44 |
notmyname | zaitcev: how much have I had to drink before I answer that? | 20:45 |
notmyname | ok, all the stuff with 2 existing +2s has been triggered to merge to master. let the games begin! | 20:47 |
Alex_Gaynor | notmyname: cool, maybe in 16 hours it'll start to land ;-) | 20:47 |
notmyname | :-( | 20:48 |
*** minnear is now known as bobby_ | 20:48 | |
* clayg remembers Alex_Gaynor before he was a jaded longtime openstack contributer | 20:49 | |
Alex_Gaynor | Yeah, like a whole 6 months ago. | 20:49 |
peluse_ | zaitcev: I think a lot of folks working on it want to, whether it does or not... I'm thinking about telling my people the plan is the K release and if we get it done by Juno that'd be great | 20:50 |
zaitcev | I see. | 20:56 |
*** fbo is now known as fbo_away | 20:56 | |
*** scotticus has quit IRC | 20:56 | |
*** hurricanerix has quit IRC | 20:56 | |
peluse_ | so IOW I think its possible but I wouldn't run around telling everything that its going to happen :) | 20:58 |
peluse_ | everyone that is | 20:58 |
*** scotticus has joined #openstack-swift | 21:00 | |
*** hurricanerix has joined #openstack-swift | 21:00 | |
*** tdasilva has quit IRC | 21:00 | |
*** omame has quit IRC | 21:10 | |
*** omame has joined #openstack-swift | 21:11 | |
*** annegentle has quit IRC | 21:18 | |
*** hugokuo has quit IRC | 21:23 | |
*** hugokuo_ has joined #openstack-swift | 21:23 | |
*** hugokuo_ is now known as hugokuo | 21:23 | |
*** mwstorer has joined #openstack-swift | 21:28 | |
*** annegentle has joined #openstack-swift | 21:29 | |
torgomatic | redbo: I wrote a thing based on your sendfile stuff that you might find interesting: https://github.com/smerritt/swift/tree/ksplice | 21:37 |
portante | torgomatic: cool | 21:42 |
*** jergerber has joined #openstack-swift | 21:45 | |
peluse_ | torgomatic: any perf numbers to share? | 21:46 |
portante | I am curious how this affect small vs large objects, and the impact that this has on concurrent reads and writes (does the offloaded GET traffic give more room for PUT traffic)? | 21:48 |
portante | torgomatic: and can we use ksplice for writes? | 21:48 |
goodes | clayg: do you have any plans to allow specifying the number of replicas for each policy STORAGE_POLICIES to be specified in vagrant-swift-all-in-one localrc rather then all using the single variable | 21:53 |
torgomatic | portante: yes. patches welcome. ;) | 22:02 |
portante | torgomatic: oh good, that sounds like fun | 22:03 |
torgomatic | peluse_: nope, no perf numbers. Just be glad it works at all. ;) | 22:03 |
peluse_ | torgomatic: you're not running a Burger King, is that what you're saying? | 22:05 |
torgomatic | peluse_: exactly. :) | 22:05 |
torgomatic | After we get all the storage-policy stuff landed, I'll see about getting some perf numbers from one of SwiftStack's real-hardware clusters. | 22:06 |
torgomatic | Right now, it's just in a state of "works on my machine". | 22:06 |
*** kevinc_ has quit IRC | 22:10 | |
peluse_ | cool, that's something some of our guys would be interested in running some BM tests on also... will pass it on | 22:11 |
portante | peluse_: just commented on the documentation, if you think it is worth the time, I'd be happy to propose updated patches with some of the changes, otherwise I'll just +2 when I am done reveiwing the overview policies page | 22:11 |
peluse_ | portante: cool, thanks. right now the whole chain is in clayg's hands - don't want to propose anything directly or it can mess up his process. I'll go look at the comments now... | 22:13 |
portante | ah, right, okay | 22:13 |
portante | I can also do something post landing ... | 22:13 |
notmyname | portante: if it's something wrong, we should get it in. if it's something that is polishing but the current docs are relatively clear and relatively correct, then it should wait. | 22:14 |
notmyname | the advantage of the docs is that every commit rebuilds the docs and publishes them to swift.openstack.org | 22:14 |
portante | definitely polish, nothing wrong that I can see | 22:15 |
portante | given the rebase that is gonna happen, I thought it might be nice to do, but no problem ... | 22:16 |
* portante gone | 22:16 | |
*** nsquare has quit IRC | 22:16 | |
*** kevinc_ has joined #openstack-swift | 22:17 | |
peluse_ | portante: some nice polish though - thanks for the suggestions! | 22:21 |
clayg | weird, so the probetest I was having problems with only show up with ssync | 22:25 |
notmyname | FWIW all the unit/func/probe tests pass on my saio | 22:26 |
peluse_ | clayg: SP or master? | 22:28 |
clayg | notmyname: then you're not running ssync ;) | 22:28 |
notmyname | how crazy do you think I am? ;-) | 22:29 |
clayg | or you got the 1 of 3 copies that had it's metadata intact | 22:29 |
clayg | peluse_: i'm not 100% sure if the issue exists on master... I think I could try something real quick like tho | 22:29 |
*** jergerber has quit IRC | 22:31 | |
peluse_ | clayg: I'll see if I can repro also.. | 22:33 |
*** nsquare has joined #openstack-swift | 22:33 | |
*** kevinc_ has quit IRC | 22:42 | |
clayg | peluse_: seems to exist on master, for whatever reason "X-Static-Large-Object: True" doesn't make it's way onto the new node | 22:43 |
clayg | er... the replication target... whatever - they node in the jobs dict ;) | 22:43 |
clayg | it's something about the for header_key in X-Backend-Replication-Headers line - like maybe that's upposed to split on a , or something? | 22:44 |
*** kevinc_ has joined #openstack-swift | 22:45 | |
clayg | seems to work better on master anyway -> https://gist.github.com/clayg/3f9511cef50077d991b6 | 22:49 |
mattoliverau | Morning all | 22:50 |
notmyname | mattoliverau: hello | 22:51 |
peluse_ | clayg: hmmm | 22:52 |
clayg | peluse_: wat? | 22:56 |
*** dmsimard is now known as dmsimard_away | 22:57 | |
peluse_ | clayg: trying to undestand the functional difference between what you did and what's on master but have to call into a meeting here in a sec so will be semi-online for a bit. Its not jumping out at me | 22:58 |
clayg | it's the split, the iteration was like per character or something - very strange | 22:58 |
goodes | good morning all | 23:00 |
goodes | just wanted to say hi, I’m new to openstack and swift | 23:00 |
notmyname | goodes: welcome! | 23:00 |
notmyname | goodes: what brings you this way? | 23:01 |
goodes | just wanted to say hi, I’m new to openstack and swift | 23:01 |
goodes | still getting set up and with launchpad etc | 23:03 |
notmyname | goodes: what's your interest in Swift? | 23:04 |
goodes | still getting launchpad etc setup but I was wondering where do I find out about meetings, hackathons etc - beyond openstack-dev are #openstack-swift are there any other places I should be looking? | 23:05 |
notmyname | goodes: we have a weekly team meeting in IRC in #openstack-meetings on wednesdays at 1900UTC | 23:06 |
torgomatic | basically notmyname says "did you finish that thing yet?" and we all take turns going "no :(" | 23:08 |
clayg | goodes: launchpad bugs are fun, we can always use help with reviews, ask.openstack.org might give you some ideas of things that might be useful to look into or learn about | 23:08 |
goodes | would love to help/contribute - bugs, developmen etc | 23:08 |
mattoliverau | notmyname: morning, miss anything exciting while I slept? | 23:08 |
notmyname | mattoliverau: http://eavesdrop.openstack.org/meetings/swift/2014/swift.2014-06-11-19.01.log.html | 23:09 |
*** kashyapk has joined #openstack-swift | 23:10 | |
*** marcusvrn has quit IRC | 23:11 | |
mattoliverau | notmyname: Ahh the meeting, cheers! Maybe one of these days I'll have to set an alarm :) | 23:12 |
notmyname | mattoliverau: when I was at LCA I got up at 3am for the meeting. just do that! ;-) | 23:12 |
notmyname | (just kidding) | 23:12 |
notmyname | about you doing. I actually did | 23:12 |
*** wer has quit IRC | 23:14 | |
notmyname | mattoliverau: important things in this week's meeting is about the upcoming release with storage policies | 23:14 |
*** kashyapk has quit IRC | 23:15 | |
*** goodes has left #openstack-swift | 23:19 | |
*** goodes has joined #openstack-swift | 23:20 | |
mattoliverau | notmyname: lol, yeah, not a really Australian friendly time, but it's only once a week and I work from home, so I don't really have an excuse... except for a wife who doesn't like getting woken up :P Either way, I'll try and attend one every now and then. Looking at the minutes, its where all the good stuff happens :) | 23:20 |
mattoliverau | notmyname: I remember your LCA talks these last 2 years, I was in the audience :) | 23:20 |
peluse_ | Australia? hey, sounds like a great place for a hackathon :) | 23:21 |
notmyname | yup! bring sunscreen | 23:21 |
notmyname | actually the LCA CFP just opened. next January it's in Aukland, NZ | 23:21 |
mattoliverau | peluse_: sure, your welcome here anytime! | 23:21 |
notmyname | I think anyone in this channel would think it's a pretty cool conference | 23:21 |
*** dmsimard_away is now known as dmsimard | 23:21 | |
pandemicsyn | ahale: ^ this is your chance | 23:22 |
mattoliverau | totally agree, I've been to the last 6 or so. So much fun, and you get to visit Auztralia (or NZ) | 23:22 |
*** mwstorer has quit IRC | 23:23 | |
notmyname | http://linux.conf.au | 23:23 |
ahale | oh yeah pandemicsyn I've been thinking of planning trip down there around some conferences | 23:23 |
notmyname | ahale: this one is very nice. zero "expo hall", so it's very tech-focused and not sponsor-focused. all about a broad range of stuff, but focused probably 60-40 on ops vs devs | 23:24 |
mattoliverau | There will also probably be an openstack mini conf as well. | 23:25 |
pandemicsyn | not sure ahale can actually go on vacation since he keeps the RAX Swift clusters stumbling along while the US sleeps | 23:25 |
notmyname | also, generally pretty good keynotes | 23:25 |
notmyname | pandemicsyn: solution: no sleep for the us-based ops ;-) | 23:25 |
mattoliverau | lol | 23:25 |
peluse_ | marking that one down on the calendar for sure! | 23:26 |
mattoliverau | Well it's totally worth it, and for anyone here who makes it to LCA, I'll buy them a beer (or non-alcholic substitue) ;) | 23:27 |
clayg | mattoliverau: I think on the plane is where I'd need the booze | 23:27 |
pandemicsyn | +1 | 23:27 |
clayg | notmyname: i leave you to fly around the globe - i'm tired of travel | 23:28 |
notmyname | :-) | 23:29 |
*** sombrafam has quit IRC | 23:29 | |
mattoliverau | clayg: lol, it is a long flight. I had to fly to Atlanta and not long before the San Antonio so I know the pain.. just stay down under for as long as you can, you wont regret it, NZ is gorgeous and Australia is the best country on earth (not that I'm showing favouritism or anything) :P | 23:31 |
ahale | ah cool I just found the page, will have a read up tomorrow | 23:35 |
ahale | the last conference they let me go to was europython, that was really nice too | 23:35 |
peluse_ | mattoliverau: I used to live in the Marshall Islands, not too far from there and it was awesome. Never made it over to NZ though... | 23:46 |
*** kevinc_ has quit IRC | 23:48 | |
goodes | being from Australia also I second having a hackathon there | 23:48 |
notmyname | actually, if y'all are interested in doing something in the Sydney area, you should talk to Tristan Goode at Aptira. He's on the OpenStack board of directors, and he does a lot of community stuff in AU | 23:50 |
ahale | sweet, arranged staying at my brothers in auckland and a trip round south island next january - needed a good reason to get back there | 23:51 |
ahale | pandemicsyn: you'll have to manage :) | 23:51 |
notmyname | lol | 23:52 |
notmyname | ahale: speaking of no sleep....what are you still doing up on London? ;-) | 23:52 |
ahale | hehe.. troubleshooting stuff in sydney :) | 23:52 |
notmyname | heh | 23:52 |
ahale | well, now winding down - I got excited about a trip back to NZ though :) | 23:53 |
mattoliverau | notmyname: I'd be keen, and rackspace even has an office in Sydney, so should be even easier :) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!