*** arch-nemesis has quit IRC | 00:03 | |
*** diogogmt has joined #openstack-swift | 00:43 | |
*** Jeffrey4l has joined #openstack-swift | 00:46 | |
*** m_kazuhiro has joined #openstack-swift | 00:51 | |
kota_ | good morning | 01:09 |
---|---|---|
timburke | good morning kota_ | 01:12 |
mattoliverau | kota_: morning | 01:15 |
kota_ | timburke, mattoliverau: hello :-D | 01:15 |
kota_ | timburke: thanks for reviewing for some my patches, will take a look to respond the comments | 01:16 |
* kota_ is wondering if patchbot is back? | 01:17 | |
kota_ | patch 219165 | 01:17 |
patchbot | https://review.openstack.org/#/c/219165/ - swift - EC Fragment Duplication - Foundational Global EC C... | 01:17 |
kota_ | hello patchbot. thanks for working | 01:18 |
kota_ | ok, patchbot is now working | 01:18 |
timburke | huh. so http://paste.openstack.org/show/565924/ seems like a totally reasonable change, right? but it makes .unittests spew a whole lot of "Exception AttributeError: AttributeError("'NoneType' object has no attribute 'replace'",) in <generator object _get_response_parts_iter at 0x7f5a79c7c500> ignored" warnings :( | 01:33 |
timburke | eh, i'll look into it more tomorrow | 01:33 |
*** gyee has quit IRC | 01:47 | |
kota_ | timburke: it looks like swift3 + Swift master thing? | 01:49 |
*** nadeem has joined #openstack-swift | 01:49 | |
openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: Fix api reference of object GET request with Range parameter https://review.openstack.org/364104 | 01:55 |
openstackgerrit | Kazuhiro MIYAHARA proposed openstack/swift: Fix api reference of object GET request with Range parameter https://review.openstack.org/364104 | 01:59 |
*** chlong has joined #openstack-swift | 02:05 | |
*** nadeem has quit IRC | 02:14 | |
*** tqtran has quit IRC | 02:15 | |
*** dmorita has quit IRC | 02:26 | |
*** nadeem has joined #openstack-swift | 02:29 | |
*** asettle has joined #openstack-swift | 03:05 | |
*** dmorita has joined #openstack-swift | 03:06 | |
*** dmorita_ has joined #openstack-swift | 03:08 | |
*** dmorita has quit IRC | 03:08 | |
*** asettle has quit IRC | 03:10 | |
*** dmorita_ has quit IRC | 03:13 | |
*** m_kazuhi_ has joined #openstack-swift | 03:22 | |
*** m_kazuhiro has quit IRC | 03:23 | |
*** jith_ has quit IRC | 03:34 | |
*** diogogmt has quit IRC | 03:41 | |
*** links has joined #openstack-swift | 03:46 | |
*** jith_ has joined #openstack-swift | 03:47 | |
*** chlong has quit IRC | 04:01 | |
mahatic | zaitcev: hello, are you here? | 04:03 |
*** jith_ has quit IRC | 04:04 | |
zaitcev | mahatic: Yes | 04:04 |
zaitcev | Did you think about checking the relcaim time before trashing the hash? | 04:05 |
mahatic | yes, was fetching a link | 04:06 |
mahatic | zaitcev: https://github.com/openstack/swift/blob/master/swift/obj/diskfile.py#L853 | 04:06 |
mahatic | get_hashes calls this, which checks for reclaimable age | 04:06 |
mahatic | and only then marks it obsolete | 04:07 |
zaitcev | Let me see, I may be missing something. | 04:07 |
mahatic | sure np | 04:08 |
*** dmorita has joined #openstack-swift | 04:10 | |
zaitcev | So, how is it invoked? I don't see a path to it from get_hashes, which is what is executed on the context of the auditor. | 04:11 |
mahatic | zaitcev: https://github.com/openstack/swift/blob/master/swift/obj/diskfile.py#L1038 | 04:12 |
mahatic | which invokes https://github.com/openstack/swift/blob/master/swift/obj/diskfile.py#L2512 | 04:12 |
mahatic | and in turn calls https://github.com/openstack/swift/blob/master/swift/obj/diskfile.py#L915 | 04:13 |
*** dmorita has quit IRC | 04:14 | |
*** chlong has joined #openstack-swift | 04:18 | |
zaitcev | This looks worse than I thought. | 04:23 |
zaitcev | So we get PathNotDir and the key is dropped from the hash, and then we call ourselves. | 04:23 |
zaitcev | But do you know why is it that hash is missing for the deleted objects? | 04:24 |
zaitcev | e.g. why does this fire https://github.com/openstack/swift/blob/master/swift/obj/diskfile.py#L1035 | 04:24 |
zaitcev | oh, wait | 04:26 |
zaitcev | (suffix, None), right | 04:26 |
mahatic | right | 04:28 |
zaitcev | mahatic: I think I see now how this is supposed to work, but I'm not comfortable with the performance impact. We need someone like clayg on this. He has guinea pigs. | 04:29 |
*** psachin has joined #openstack-swift | 04:32 | |
mahatic | zaitcev: I agree. Well, there was a performance impact issue with a previous way of implementation too (remove .ts or invalidate hashes) but kota_ and I thought this was better | 04:33 |
mahatic | clayg: your insights please | 04:34 |
*** sanchitmalhotra1 has joined #openstack-swift | 04:35 | |
*** csmart has quit IRC | 04:35 | |
zaitcev | mahatic: What jumped on me is, DiskFileDeleted already has the metadata, which one can use to make the determination if reclaim time is reached. But in this patch we discard this knowledge unconditionally and, on _every auditor pass, for every tombstone_ dive right into _get_hashes and supply the 1-element revalidate list. | 04:35 |
zaitcev | sorry, recalculate= list | 04:36 |
*** sanchitmalhotra has quit IRC | 04:36 | |
*** sanchitmalhotra1 is now known as sanchitmalhotra | 04:36 | |
*** ppai has joined #openstack-swift | 04:41 | |
mahatic | zaitcev: hmm yeah we could call get_hashes conditionally i.e. depending on reclaim_age. But I need to think if there was a reason this was missed in the previous patch :) | 04:41 |
mahatic | other than oversight | 04:42 |
zaitcev | So, the question is: how loaded are auditors, and is it common that they can't keep up? And in addition, how common are tombstones, is it enough to make a marginal auditor to boggle down and not keep up anymore. It's possiby I'm concerned over nothing, just my overactive imagination. | 04:42 |
*** nadeem has quit IRC | 04:54 | |
*** nadeem has joined #openstack-swift | 04:55 | |
mahatic | I'm not too inclined on the "auditor not keeping up" part. Would be helpful if someone with real prod environments could assert that | 04:56 |
zaitcev | yeah | 05:00 |
*** ChubYann has quit IRC | 05:00 | |
zaitcev | Of course we could just approve this patch, and when people get auditors bogged down, add one little if to it. | 05:01 |
zaitcev | Not sure how responsible this course of action is... | 05:01 |
mahatic | :) adding a little if now, doesn't seem a problem | 05:02 |
*** hosanai has quit IRC | 05:04 | |
-openstackstatus- NOTICE: The logs volume is full causing jobs to fail with POST_FAILURE. This is being worked on, please do not recheck until notified. | 05:11 | |
*** ChanServ changes topic to "The logs volume is full causing jobs to fail with POST_FAILURE. This is being worked on, please do not recheck until notified." | 05:11 | |
*** philipw has quit IRC | 05:12 | |
*** chlong has quit IRC | 05:27 | |
*** ChanServ changes topic to "Topic: Let's talk. We're nice. | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift" | 05:37 | |
-openstackstatus- NOTICE: Space has been freed up on the log server. If you have POST_FAILURE results it is now safe to issue a 'recheck' | 05:37 | |
*** philipw has joined #openstack-swift | 05:42 | |
*** chlong has joined #openstack-swift | 05:47 | |
*** csmart_ has joined #openstack-swift | 06:00 | |
*** csmart_ is now known as csmart | 06:02 | |
*** ttrumm has joined #openstack-swift | 06:02 | |
openstackgerrit | Mahati Chamarthy proposed openstack/swift: Delete old tombstones https://review.openstack.org/346865 | 06:18 |
openstackgerrit | Christian Schwede proposed openstack/swift: Deprecate swift-temp-url https://review.openstack.org/348173 | 06:20 |
*** _JZ_ has quit IRC | 06:23 | |
*** nadeem has quit IRC | 06:23 | |
*** sanchitmalhotra has quit IRC | 06:31 | |
*** sanchitmalhotra has joined #openstack-swift | 06:32 | |
*** hosanai has joined #openstack-swift | 06:36 | |
*** ChanServ sets mode: +v hosanai | 06:36 | |
*** SkyRocknRoll has joined #openstack-swift | 06:39 | |
* mattoliverau is calling it a day.. its friday and I started early. Have a great weekend all. | 06:40 | |
*** rcernin has joined #openstack-swift | 06:40 | |
clayg | redbo: glange: can you guys teach nadeem and dfg how use a bouncer or irssi or something? | 06:40 |
clayg | nadeem: dfg: can i get some help reviewing patch 346865 to free me up to look at patch 362200 and patch 364075 | 06:42 |
openstackgerrit | Merged openstack/swift: Remove meaningless lines in reconciler unit test https://review.openstack.org/364269 | 06:42 |
patchbot | https://review.openstack.org/#/c/346865/ - swift - Delete old tombstones | 06:42 |
patchbot | https://review.openstack.org/#/c/362200/ - swift - don't wait on remote container updates with write ... | 06:42 |
patchbot | https://review.openstack.org/#/c/364075/ - swift (feature/hummingbird) - go: move REPCONN and REPLICATE call from object se... | 06:42 |
*** geaaru has joined #openstack-swift | 06:44 | |
*** hosanai has quit IRC | 06:44 | |
clayg | why does no one believe me that it's totally reasonable to just delete old tombstone hashdirs and not invalidate the suffix in the process? | 06:44 |
clayg | like is it just cause right now the code that cleans tombstones older than reclaim age is mixed in with the code that invalidates the suffix? or like are we worried we're going to break replication? | 06:44 |
mahatic | clayg: "like is it just cause right now the code that cleans tombstones older than reclaim age is mixed in with the code that invalidates the suffix?" | 06:45 |
mahatic | that's the one | 06:45 |
clayg | not that there would be anything to "replicate" except possibly some other jerk off that had managed to reap his reclaimable tombstone? | 06:45 |
clayg | acphacphacpcahcpah - but but but | 06:46 |
clayg | ;) | 06:46 |
openstackgerrit | Merged openstack/swift: Remove unnecessary variable https://review.openstack.org/356402 | 06:46 |
ahale_ | "are we worried we're going to break replication?" | 06:47 |
ahale_ | hehehe | 06:47 |
clayg | why is all this code merging? did mattoliverau go a review bender? | 06:47 |
clayg | ahale_: hey! repconn still uses hash suffixes! it's not that *that* funny ;) | 06:47 |
clayg | (it's kinda funny) | 06:47 |
ahale_ | oh hah yeah no i meant the thought that replicatioin might not already be broken ! | 06:47 |
* clayg snickers | 06:48 | |
*** pcaruana has joined #openstack-swift | 06:48 | |
clayg | ahale_: you watch man mahatic's gunna get all those old tombstones cleaned up - you're gunna have so many free inodes - your filesystems are gunna purr like kittens | 06:48 |
*** chlong has quit IRC | 06:49 | |
ahale_ | :D thats gonna be awesome | 06:49 |
mahatic | clayg: one more +2 and that's what gonna happen ;) | 06:49 |
mattoliverau | clayg: lol, I got tired of looking at container replication and sharding so decided to do something else :) | 06:49 |
clayg | ahale_: you ever counted how many reclaimable tombstones you have laying around? Maybe most of your suffixes are dense enough these days it's not a big issue for you (stead traffic turns them over frequently enough) | 06:49 |
ahale_ | i spent a lot of yesterday looking at "really weird partitions" , what i found so far im just gonna blame on XFS under stress I think | 06:49 |
clayg | ... but IME it's an annoying problem | 06:49 |
ahale_ | nope - never looked at that | 06:50 |
ahale_ | but - that bug you posted yesterday with asyncs older than reclaim ... thats an annoying problem we have seen | 06:50 |
clayg | oh yeah totally :'( | 06:50 |
clayg | charz and hugokuo have some ideas - if you've given it any serious thought you might write down something as well | 06:51 |
ahale_ | i really really hope this is xfs - but i was looking at parts like this - (finding out why out of place ones werent being removed after replication) | 06:51 |
ahale_ | srv/node/c2u13/objects/131123/e02/20033514532f470b528fc344dc943e02/1435610792.18848.data/1407180761.27739.ts | 06:51 |
ahale_ | srv/node/c2u22/objects/756094/dee/b897e90553c9eaf8eaf9a9d5841d8dee/05283a1835164a67bd1400a7ed65418b/1435414158.76132.data | 06:51 |
clayg | charz: what's the plan again? do something with 507 to async responses that was for sure - was there something else? with... once a async PUT get's old enough it might reclaim? | 06:52 |
clayg | ahale_: those paths are *epic* - new to me - how does the auditor not quarantine that shit?! | 06:52 |
charz | clayg: maybe updater needs to check handoff place if there is a container DB, it should update it. | 06:52 |
clayg | oh... me crosses fingers its a hummingbird only bug and dreams of the day we're all pulling in the same direction again | 06:53 |
clayg | charz: yeah that's he business +2 | 06:53 |
clayg | we have so many loops where were iter nodes + handoffs and break after 3 non 507 responses - the updater should totally do that | 06:54 |
ahale_ | i think its a really full disk , xfs breaks down, rather than hbird repli - not totes sure tho | 06:54 |
charz | And maybe updater should show some alert when the async_pending timestamp is too old, but idk how to get container reclaim age. | 06:54 |
clayg | charz: yes I think definately updater needs to be skeptical putting something in a container that's been failing for a reclaim age - esp if it's alreay got it into the other containers | 06:55 |
charz | clayg: And I'm investigating why the same object's async_pending will distribute to different nodes. | 06:56 |
*** tesseract- has joined #openstack-swift | 07:02 | |
clayg | zaitcev: thank you so much for catching the if branch on the reclaim tombstone hash invalidation ;) | 07:05 |
kota_ | back for a short time | 07:07 |
charz | clayg: or maybe log the time the device was unmounted in somewhere? recon cache? and container replicator can check the time to extended the real reclaim age when the drive are mounted again. not sure is it a good idea. | 07:07 |
kota_ | looking at the log, clayg, zeitcev, mahatic got the answer for reclaim ts? | 07:07 |
openstackgerrit | Merged openstack/swift: Fix api reference of object GET request with Range parameter https://review.openstack.org/364104 | 07:08 |
charz | clayg: Maybe force updater to check handoff place should able to solve this issue, because you won't see the same async_pending job in next run. | 07:11 |
mahatic | kota_: please take a look at the updated patch | 07:11 |
mahatic | I'm off to lunch and then a meeting, be back in an hour | 07:11 |
kota_ | mahatic: ok, thanks | 07:14 |
clayg | charz: I think that's the key - we should make async pending never get to be as old as half a reclaim age without massive warning bells | 07:15 |
clayg | charz: putting the async into the container layer (on a handoff node when a device is 507'd) is a good way to avoid stupid fire drills | 07:15 |
clayg | kota_: i've been reviewing everyone's knows - I think everyone is doing great - it's a tricky problem | 07:16 |
kota_ | clayg: yeah, it's absolutely tricky. during the reviewing, tbh, I've been feeling I'd like to refactor around there because maybe we could make DiskFile/AuditLocation more familer with current mahatic's solution | 07:20 |
kota_ | but I've hold that on just in myself until mahatic's work completed. | 07:21 |
clayg | acoles_: what is the axiom for orphaned .meta files laying on a .ts? | 07:21 |
*** jmccarthy has quit IRC | 07:21 | |
clayg | like once the .ts gets to be reclaimable we have to assume some poor sucker just had a stale .data and accidently accepted the POST? | 07:22 |
*** jmccarthy has joined #openstack-swift | 07:22 | |
clayg | kota_: FYI some internal intrest building on EC fragment duplication | 07:23 |
zaitcev | I thought that function deletes all of them... it even tries to remove the directory | 07:23 |
zaitcev | clean_object_files or what is it | 07:24 |
clayg | it's still "future" for us - but - well luckily for us we know someone that's been living in the future for years! | 07:24 |
clayg | zaitcev: nom nom nom | 07:24 |
clayg | is acoles_ still on vacation? | 07:24 |
kota_ | clayg: i think so | 07:25 |
clayg | i was eating some british candy today - it was called "a crunchie" - how adorable is that!? "a crunchie" - it's even more fun with an accent | 07:25 |
kota_ | clayg: what's quesiton on EC frag duplication? | 07:26 |
clayg | zaitcev: so the bottom line is that doing a hash recalculation for the entire part - and *forcing* for it for the entire suffix - just because we want to reap an old tombstone is not great | 07:26 |
zaitcev | clayg: Yes. That was my last objection. But the latest version seems to work, at the cost of an extra time comparison check.... | 07:28 |
*** urth has quit IRC | 07:28 | |
zaitcev | I don't mean the CPU cost of course, just that the same comparison is made in two unrelated places | 07:28 |
clayg | well... yeah but I mean... the first time this run when you discover a bunch of these - you're going to turning over file system cache like mad? | 07:29 |
zaitcev | well that's true | 07:30 |
zaitcev | even so, all those listdirs and the like, they aren't entirely free even if they hit cache | 07:30 |
zaitcev | I think | 07:31 |
clayg | and moving forward - there *has* to be some oppertunity where you'd have two reclaimable suffixes in the same part! probably sometimes even in the same suffix! | 07:31 |
clayg | ... but we're going to do all that file system work - recalc the whole partiiont (!?) for each one | 07:31 |
kota_ | clayg: yes!!! | 07:31 |
clayg | i mean REPLICATE verbs be flying - if we just invalidate it ... I think that'd be better than doing the recalc optomistically | 07:32 |
kota_ | clayg: I was thinking we could cache the suffixes in the part and just run get_hashes only once | 07:32 |
*** urth has joined #openstack-swift | 07:32 | |
clayg | kota_: see kota_ gets it | 07:32 |
kota_ | not for each time when we find the reclaimable ts | 07:32 |
kota_ | but i think it requires some cleanups for loop i thought | 07:33 |
kota_ | think twice :/ | 07:33 |
clayg | kota_: even if it only helps on the first run when we release the code I think it's worth it to write it - but honestly - well i don't really have a good way to say the "rate" at which reclaimable tombstones "build up" | 07:33 |
clayg | so I don't know how likely I'm going to see multiple reclaimable tombstones in the same part or maybe even same suffix in the period of a auditor zbf scan | 07:33 |
clayg | hell - my zbf scans would probably be a shit ton quicker if I didn't have all these stable tombstones! | 07:34 |
clayg | i swear to god I think we should just unlink the file and see if it doesn't get way better :D | 07:34 |
kota_ | oh, true, | 07:34 |
clayg | well - i mean i guess I want it to invalidate the hash sort of... eventually... really i just want the hashdir gone :\ | 07:35 |
clayg | i'd be ok with unlink the ts and invalidate the hash - pretty sure | 07:35 |
clayg | aside from the scary upfront sweep cleaning up the hole - i think it'd be pretty good going forward - maybe ideal | 07:36 |
*** dmorita has joined #openstack-swift | 07:36 | |
clayg | as long as the remote replicator doesn't ship stale tombstones :\ | 07:37 |
clayg | that was what the 1.1 was for yeah? | 07:37 |
clayg | mahatic: ok you got me - i'm checking it out :P | 07:38 |
*** dmorita has quit IRC | 07:40 | |
kota_ | clayg: fyi, you still have interest on ec duplicated fragment, hopefully we works on Optimistic Get toghether to land first | 07:46 |
clayg | i keep forgetting you can't make a tombstone older than reclaim age with a DELETE request | 07:46 |
clayg | kota_: oh right! yes that would be wonderful to land! | 07:46 |
kota_ | clayg: i'm now reviewing that locally, my plan, land it in 2 weeks and then my EC frag duplication land in the next 2 weeks and then Newton :P | 07:47 |
kota_ | hopefully | 07:48 |
clayg | yeah let's do it! | 07:48 |
kota_ | if you could help me to do that | 07:48 |
clayg | i'd love to see that happen! | 07:48 |
* kota_ hug clayg | 07:49 | |
*** SkyRocknRoll has quit IRC | 07:50 | |
openstackgerrit | Christian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases https://review.openstack.org/344693 | 07:54 |
*** ttrumm has quit IRC | 07:54 | |
*** ttrumm has joined #openstack-swift | 07:55 | |
*** ttrumm has quit IRC | 08:04 | |
*** ttrumm has joined #openstack-swift | 08:04 | |
*** asettle has joined #openstack-swift | 08:07 | |
clayg | ^ it's the most annoying thing I never noticed - I had it that I can't do like swift-get-nodes unless i'm in the cluster | 08:11 |
mahatic | I'm back | 08:13 |
* mahatic is reading the log | 08:13 | |
mahatic | clayg: cool, did you check it out yet? | 08:13 |
clayg | yeah i'm kicking the cobwebs off my tool for poking at the hash suffix api -> https://gist.github.com/clayg/035dc3b722b7f89cce66520dde285c9a | 08:16 |
clayg | i have a reclaimable tombstone hiding behind a valid hash | 08:16 |
clayg | considering options on how i'm going to poke it | 08:17 |
mahatic | nice | 08:21 |
clayg | ... one more option | 08:22 |
clayg | ok, so if one node has a clean hash for the suffix (like the tombstone was reclaimed and the part we rehashed including a recalculate for that suffix) ... | 08:24 |
clayg | ... when another node who has a hashed suffix shadowing a reclaimable tombstone goes to *replicate* to clean node ... | 08:24 |
clayg | both end up clean - which is tons better than it successfully pushing over it's tombstone | 08:25 |
clayg | but I'm not so sure that it didn't acctually just do that - like I sorta believe it might have rsync'd the zero-byte tombstone - then everyone recalculates the synced suffixes - which finally triggers the clean_ondisk_file for the hashdirs and drops the now empty suffix | 08:26 |
mahatic | the current patch change is for auditor | 08:28 |
mahatic | clayg: did you try the replicate part after reclaim_age | 08:28 |
clayg | aphcaphcv? but it's gunna effect replication | 08:28 |
clayg | this is where i'm at currently -> https://gist.github.com/clayg/e16199868b3fc75e27c87b6d828a6c38 | 08:29 |
mahatic | okay yeah you said that above | 08:29 |
clayg | the tombstone is older than reclaim age - it was on 1 & 3 - but I audited 1 and then replicated 3 | 08:30 |
clayg | i'm sorta surpised a) 3 cleaned it self up just cause 1 was clean and b) that 3 replicating with 4 didn't clean up 4 | 08:30 |
clayg | yeah... it's stable like this? i'm guessing 4 would clean himself up now - but 1 or 3 pushing to him don't make him recalculate | 08:31 |
mahatic | hmm 4 would cleanup only when you do an audit i think | 08:32 |
openstackgerrit | Christian Schwede proposed openstack/python-swiftclient: Make options arguments truely optional https://review.openstack.org/357063 | 08:34 |
clayg | mahatic: nope - so it seems that as soon as one node clears the suffix everyone else will follow suit when they talk to him! | 08:34 |
*** jmccarthy has quit IRC | 08:34 | |
clayg | it's weird tho - because him talking to *them* doesn't appear to do anyhting :D | 08:34 |
clayg | now for code | 08:34 |
clayg | love it! https://github.com/openstack/swift/blob/7ff1055ff3cf3b532ebdc3aed65db31a23b8e801/swift/obj/replicator.py#L454 | 08:36 |
clayg | oh nice, then at 466 after it recalculates the suffixes that are different ('mystalehash' != None) it goes again to filter out only the suffixes that are *still* different (after recalc None == None) before calling into rsync | 08:38 |
clayg | oh oh oh - and the reason me pushing to you can't clean you is because I only look at suffixes in my local_hash that are differnt from yours | 08:40 |
mahatic | yes line 454 thing | 08:40 |
clayg | so when I talk to you having been audited and you respond with 'yourstalehash' it's just not relevent to me because I don't even have that hash - hrmm.. | 08:40 |
clayg | that would be different behavior if there were multiple objects in the same suffix | 08:41 |
clayg | i think I have a script for that | 08:41 |
clayg | good 'ol find_names_with_same_part_suffix.py -> https://gist.github.com/clayg/590caf4c5b650af950add2aab3943e36 | 08:51 |
clayg | https://gist.github.com/clayg/e89dce252fcec82cd6a6853910fb3e57, oh it's gunna be *exciting* -> (86400 * 7) - (time.time() - 1472201951.39000) = 7.928305149078369 | 08:59 |
*** dmorita has joined #openstack-swift | 09:01 | |
*** ouchkernel has quit IRC | 09:02 | |
mahatic | clayg: how do you put two objects in the same suffix? how are you testing that part I mean | 09:03 |
clayg | ok, i updated the gist - which direction is going to be more interesting - the guy that did the reclaim pushing to the guys with the stale suffix? probably the guy with the stale suffix pushing to the recalimed guy | 09:05 |
clayg | mahatic: so that'd be https://gist.github.com/clayg/590caf4c5b650af950add2aab3943e36 - i just keep cookiing up names until i find two objects (same account container) that just so happen to hash to the same part and suffix! | 09:06 |
*** dmorita has quit IRC | 09:06 | |
clayg | hrmm... again he just cleaned him self up - the other fool with the stale hashes don't care (?) | 09:06 |
clayg | hrmm... no i gotta do it again | 09:07 |
clayg | this is also my new favorite "create an old tombstone" -> ''' curl -XDELETE http://saio:8090/v1/AUTH_test/test/obj481 -H "x-timestamp: $(python -c 'import time; print time.time() - 7 * 86400 + 300')" ''' | 09:09 |
*** ouchkernel has joined #openstack-swift | 09:09 | |
clayg | the trick is of course the noauth server on 8090 with shunt x-timestamp turned off | 09:09 |
mahatic | clayg: that's a nice script | 09:13 |
*** hseipp has joined #openstack-swift | 09:13 | |
*** ppai has quit IRC | 09:13 | |
*** dmorita has joined #openstack-swift | 09:14 | |
clayg | oic, so it's just non deterministic because of ordering | 09:15 |
clayg | if a stale guy talks to an audited guy he cleans himself up | 09:15 |
clayg | if he talks to another stale guy first then he won't clean him up - if he talks to the audited guy first - now he's a clean guy! and clean guys always clean up stale guys | 09:16 |
openstackgerrit | Christian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases https://review.openstack.org/344693 | 09:16 |
clayg | so the multiple objects in the same suffix is significantly more interesting | 09:16 |
clayg | BUT - i like that we're not shipping around old tombstones! | 09:16 |
clayg | i think it's all just a matter on how much rehashing we do | 09:17 |
clayg | k... this is good | 09:17 |
* clayg ponders | 09:17 | |
*** dmorita has quit IRC | 09:19 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 09:34 |
*** admin6_ has joined #openstack-swift | 09:35 | |
*** m_kazuhi_ has quit IRC | 09:37 | |
clayg | kota_: i like what you were saying about maybe having get_diskfile_from_audit_location (or really from_hash_dir) call cleanup_ondisk_files like get_diskfile_from_hash does | 09:38 |
kota_ | clayg: yeah | 09:40 |
kota_ | i think just ordering diskfile to cleanup is a way to a winner rather than unlink by hand | 09:42 |
clayg | i'm not sure it saves everything tho - you need to know if cleanup triggered a reclaim | 09:42 |
kota_ | cleanup_ondisk files does, that is cleanup_list_dir for old name AFAIK. | 09:43 |
kota_ | the point we need to care is the deleting hash dir for my opinion | 09:44 |
kota_ | that needs a lock to prevent racing, right? | 09:44 |
kota_ | i mean, recaim ts, deleting hash dir while a client is putting a new object | 09:45 |
kota_ | maybe | 09:45 |
clayg | kota_: and it's *kind* of inefficient of ssync to do that - call cleanup before opening the disk file - you just did the listdir and parsed all the ondisk info - then you open the disk file and it does the listdir and parses all the ondisk info :'( | 09:46 |
kota_ | I didn't look at the new patch set from mahatic sorry, i might be saying something wrong. | 09:46 |
kota_ | ah gah, exactly! | 09:46 |
kota_ | don't listdir and parse may times! | 09:47 |
clayg | i think you just pass on the ENOTEMPTY when you rmdir - on the put side - i think the renamer should mostly cover you? | 09:47 |
kota_ | maybe? wait a sec, looking the code | 09:48 |
kota_ | oh yeah, right now just pass OSError make sense. | 09:51 |
kota_ | yeah, we don't need a lock for it, I was wrong on that. | 09:55 |
mahatic | dunno how having get_diskfile_from_audit_location call cleanup_ondisk_files will be better as opposed to calling cleanup_ondisk_files (via get_hashes) only on reclaimable ts | 09:57 |
mahatic | maybe i'm missing some other problem | 09:57 |
clayg | i'm having a tough time pulling out _cleanup_ondisk_results so that you can call it with an existing df's _ondisk_info cache | 09:58 |
clayg | mahatic: I think mostly it's just symmetry - there's a lot of interfaces in diskfile - it'd be better if there were less and they were more similar and more composable | 10:00 |
clayg | but the *problem* as it were isn't so much calling cleanup_ondisk_files when you build it from audit location or when you open the file - it's the calling via get_hashes | 10:01 |
clayg | that get_hashes method the way it's being called now will rehash every invalid/unhashes suffix in the whole damn part PLUS the one you're explicitly forcing it to rehash/recal no matter it's invalid or not | 10:02 |
clayg | that's a lot of work - so the question is - is it all needed - and the answer is pretty clearly no - we could do a lot less file system thrashing and still ahve all the behaviors we want | 10:03 |
clayg | i'm mostly leaning toward just invalidating the hash and calling it a day | 10:06 |
mahatic | that makes sense. maybe could just call _hash_suffix_dir instead of get_hashes | 10:07 |
clayg | if I saw a clean way to call a supported interface in diskfile that handles the cleanup of a hashdir such that I could gently try: os.rmdir(); except ENOENT: pass my way up from hash to suffix and leave replication out of it i'd probably been keen on that too | 10:08 |
mahatic | clayg: yes it's super late for you. thanks much for spending time on this! | 10:08 |
clayg | mahatic: looking! | 10:08 |
kota_ | clayg: +1 that, we need that clean way to do that | 10:09 |
kota_ | and agree with mahatic you should go your bed | 10:09 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c https://review.openstack.org/318441 | 10:10 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c https://review.openstack.org/318441 | 10:10 |
clayg | nope, too much - we shouldn't be evaluating every hashdir int he suffix everytime we encounter one of these - there are going to be cases of multiple recliamable tombstones in the same suffix hit in the same audit pass (at leasrt initially) | 10:10 |
clayg | kota_: we *want* a clean way to do that - short of that I'm getting more and more happy with just invalidate the hash and let replication sort it out | 10:11 |
clayg | yeah i should go to bed - i was *going* to work on devstack tonite! | 10:11 |
kota_ | my bad english, that is my first comment on the patch I said " One is a suggestion to leave the role to delete the reclaimable ts to replicator." | 10:12 |
kota_ | :/ | 10:12 |
kota_ | clayg:^^ | 10:13 |
clayg | yeah auditor just notices it and flags it for the replicator | 10:14 |
clayg | i thought you ment making it for the replicator to notice it - which I didn't like - because I don't want the replicator going into a bunch of hashed suffixes - THAT'S WHY WE HASHED THEM | 10:15 |
kota_ | clayg: that's simple sorry for stopping you to go bed. | 10:15 |
clayg | lol | 10:15 |
kota_ | yes | 10:15 |
kota_ | ah, you mean auditer may notice via another (new) way to do that? | 10:16 |
kota_ | no, no more question | 10:16 |
kota_ | will ask tommorow | 10:16 |
* kota_ is going to be back home | 10:17 | |
mahatic | clayg: good night! kota_ have a good evening. Thanks to both of you. | 10:18 |
clayg | idk, just calling invalidate seems to take two passes to reap the hashdir (!?) | 10:19 |
openstackgerrit | Gábor Antal proposed openstack/swift: Use more specific asserts in test/unit/obj tests https://review.openstack.org/342830 | 10:20 |
mahatic | calling cleanup_ondisk_files giving the hash path of the ts file might achieve what we want | 10:24 |
mahatic | ok, but the issue is being able to call it with an existing df I guess :) looking at code | 10:27 |
clayg | mahatic: yeah i gotta give up for tonite - you have landed yourself in a right proper hozer this one - don't give up! | 10:33 |
clayg | g'ight | 10:33 |
mahatic | :) g'night | 10:34 |
*** zul has quit IRC | 10:58 | |
*** ouchkernel has quit IRC | 11:07 | |
*** cdelatte has quit IRC | 11:07 | |
*** darrenc has quit IRC | 11:07 | |
*** zhengyin has quit IRC | 11:07 | |
*** ejat has quit IRC | 11:07 | |
*** cdelatte has joined #openstack-swift | 11:09 | |
*** darrenc has joined #openstack-swift | 11:09 | |
*** zhengyin has joined #openstack-swift | 11:09 | |
*** ejat has joined #openstack-swift | 11:09 | |
*** ouchkernel has joined #openstack-swift | 11:10 | |
*** cdelatte has quit IRC | 11:15 | |
*** cdelatte has joined #openstack-swift | 11:30 | |
*** zul has joined #openstack-swift | 11:30 | |
mahatic | clayg: kota_ https://gist.github.com/MahatiC/f64ae7c08f5897ebe43415677486ed3c | 11:38 |
mahatic | did we consider that? | 11:38 |
*** dmorita has joined #openstack-swift | 11:51 | |
*** takashi has joined #openstack-swift | 11:54 | |
*** dmorita has quit IRC | 11:55 | |
*** kei_yama has quit IRC | 11:56 | |
*** ekarlso_ has joined #openstack-swift | 12:05 | |
mahatic | ^ sorry that gist is not complete yet, but using cleanup_ondisk_files that way was what I meant to convey | 12:06 |
*** manous has joined #openstack-swift | 12:09 | |
*** ekarlso_ has quit IRC | 12:11 | |
*** asettle has quit IRC | 12:13 | |
*** zul_ has joined #openstack-swift | 12:15 | |
*** zul_ has quit IRC | 12:16 | |
*** zul_ has joined #openstack-swift | 12:17 | |
*** zul has quit IRC | 12:17 | |
*** manous has quit IRC | 12:32 | |
*** Trixboxer has quit IRC | 12:38 | |
openstackgerrit | Mathias Bjoerkqvist proposed openstack/swift: WIP: Storing encryption root secret in Barbican https://review.openstack.org/364878 | 12:39 |
*** zul_ has quit IRC | 12:42 | |
*** zul has joined #openstack-swift | 12:43 | |
*** zul has quit IRC | 12:45 | |
*** zul has joined #openstack-swift | 12:45 | |
*** manous has joined #openstack-swift | 12:45 | |
*** Trixboxer has joined #openstack-swift | 12:50 | |
openstackgerrit | Andreas Jaeger proposed openstack/swift: Move bandit to pep8 https://review.openstack.org/364892 | 13:00 |
openstackgerrit | Christian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases https://review.openstack.org/344693 | 13:03 |
*** dmorita has joined #openstack-swift | 13:03 | |
*** manous has quit IRC | 13:03 | |
*** psachin has quit IRC | 13:04 | |
*** dmorita has quit IRC | 13:08 | |
*** tongli has joined #openstack-swift | 13:09 | |
*** klamath has joined #openstack-swift | 13:09 | |
*** ttrumm has quit IRC | 13:10 | |
*** klamath has quit IRC | 13:11 | |
*** ttrumm has joined #openstack-swift | 13:11 | |
*** klamath has joined #openstack-swift | 13:12 | |
*** ttrumm has quit IRC | 13:12 | |
*** asettle has joined #openstack-swift | 13:13 | |
*** manous has joined #openstack-swift | 13:16 | |
*** asettle has quit IRC | 13:19 | |
*** madorn has quit IRC | 13:27 | |
*** kencjohnston has quit IRC | 13:27 | |
*** StraubTW has joined #openstack-swift | 13:27 | |
*** StraubTW has quit IRC | 13:28 | |
*** StraubTW has joined #openstack-swift | 13:28 | |
*** kencjohnston has joined #openstack-swift | 13:32 | |
*** madorn has joined #openstack-swift | 13:34 | |
*** links has quit IRC | 13:41 | |
*** tesseract- has quit IRC | 14:03 | |
*** _JZ_ has joined #openstack-swift | 14:06 | |
*** sams-gleb has joined #openstack-swift | 14:10 | |
*** mingyu has quit IRC | 14:11 | |
*** tesseract- has joined #openstack-swift | 14:13 | |
*** dmorita has joined #openstack-swift | 14:15 | |
*** dmorita has quit IRC | 14:20 | |
*** takashi has quit IRC | 14:21 | |
*** asettle has joined #openstack-swift | 14:25 | |
*** takashi has joined #openstack-swift | 14:27 | |
*** diogogmt has joined #openstack-swift | 14:28 | |
*** schizo_ has quit IRC | 14:36 | |
*** schizo has joined #openstack-swift | 14:38 | |
*** manous has quit IRC | 14:44 | |
*** links has joined #openstack-swift | 14:47 | |
*** thebloggu has joined #openstack-swift | 14:55 | |
*** manous has joined #openstack-swift | 14:56 | |
*** rcernin has quit IRC | 15:01 | |
*** links has quit IRC | 15:03 | |
*** sams-gleb has quit IRC | 15:04 | |
*** jordanP has joined #openstack-swift | 15:07 | |
*** pcaruana has quit IRC | 15:15 | |
*** arch-nemesis has joined #openstack-swift | 15:19 | |
*** mingyu has joined #openstack-swift | 15:22 | |
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is restarting quickly to relieve resource pressure and restore normal performance | 15:22 | |
*** sams-gleb has joined #openstack-swift | 15:23 | |
*** arch-nemesis has quit IRC | 15:25 | |
notmyname | good morning | 15:26 |
*** chsc has joined #openstack-swift | 15:33 | |
*** chsc has joined #openstack-swift | 15:33 | |
*** silor has joined #openstack-swift | 15:37 | |
*** klamath has quit IRC | 15:37 | |
*** arch-nemesis has joined #openstack-swift | 15:39 | |
*** tesseract- has quit IRC | 15:42 | |
*** klamath has joined #openstack-swift | 15:51 | |
*** nadeem has joined #openstack-swift | 15:52 | |
*** sams-gleb has quit IRC | 15:53 | |
*** klamath has quit IRC | 15:53 | |
openstackgerrit | Christian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases https://review.openstack.org/344693 | 15:58 |
*** manous has quit IRC | 16:02 | |
*** tongli has quit IRC | 16:02 | |
*** baojg has joined #openstack-swift | 16:05 | |
*** mingyu has quit IRC | 16:11 | |
*** baojg has quit IRC | 16:17 | |
*** jordanP has quit IRC | 16:19 | |
*** asettle has quit IRC | 16:21 | |
notmyname | gerrit's going down in about 2 hours | 16:21 |
notmyname | 4 hour scheduled downtime | 16:22 |
*** zul has quit IRC | 16:23 | |
*** takashi has quit IRC | 16:26 | |
*** hseipp has quit IRC | 16:26 | |
*** admin6_ has quit IRC | 16:27 | |
*** tongli has joined #openstack-swift | 16:28 | |
*** tongli has quit IRC | 16:32 | |
*** zul has joined #openstack-swift | 16:35 | |
*** dmorita has joined #openstack-swift | 16:40 | |
*** tqtran has joined #openstack-swift | 16:43 | |
*** takashi has joined #openstack-swift | 16:46 | |
*** tongli has joined #openstack-swift | 16:49 | |
*** ChubYann has joined #openstack-swift | 16:52 | |
*** sams-gleb has joined #openstack-swift | 16:54 | |
*** tongli has quit IRC | 16:54 | |
openstackgerrit | Travis McPeak proposed openstack/swift: Updating Bandit config file https://review.openstack.org/365065 | 16:55 |
*** Suyi_ has joined #openstack-swift | 16:55 | |
*** tmcpeak has joined #openstack-swift | 16:55 | |
notmyname | zaitcev: haven't you looked at the bandit stuff before? ^ | 16:55 |
zaitcev | notmyname: The name sounds familiar but I did not look at it. Maybe I promised to review it an underdelivered as usual.... | 16:56 |
tmcpeak | o/ | 16:56 |
tmcpeak | I proposed the patch | 16:57 |
zaitcev | Oh god, not YAML, please anything | 16:57 |
tmcpeak | lol | 16:57 |
tmcpeak | JSON fans? | 16:57 |
notmyname | zaitcev: nah, I probably am just misremembering | 16:57 |
notmyname | tmcpeak: did you know there are 63 ways to format a multi-line string in yaml and you need a turing-complete parser to evaluate it? I discovered there facts abotu yaml recently. fun! | 16:58 |
tmcpeak | :\ | 16:58 |
tmcpeak | that's insane | 16:58 |
notmyname | I agree ;-) | 16:59 |
*** nadeem has quit IRC | 17:00 | |
*** sams-gleb has quit IRC | 17:01 | |
notmyname | tmcpeak: but to remove any confusion, we've got yaml in the repo now, and if that's what bandit uses, then that's what bandit uses. personally, I don't know much about it, and I saw that there's some work to make it a voting job | 17:03 |
tmcpeak | yeah, I proposed this patch to fix the job | 17:03 |
tmcpeak | Bandit changed the config file format, this updates it so the Bandit job works. Once it merges you can pick up the voting stuff again | 17:03 |
tmcpeak | well not you, but whoever | 17:03 |
*** baojg_ has joined #openstack-swift | 17:06 | |
*** takashi has quit IRC | 17:06 | |
*** nadeem has joined #openstack-swift | 17:06 | |
*** nadeem has quit IRC | 17:07 | |
*** nadeem has joined #openstack-swift | 17:08 | |
*** mingyu has joined #openstack-swift | 17:11 | |
*** ttrumm has joined #openstack-swift | 17:15 | |
*** takashi has joined #openstack-swift | 17:16 | |
*** mingyu has quit IRC | 17:16 | |
*** ttrumm has quit IRC | 17:22 | |
*** klamath has joined #openstack-swift | 17:23 | |
*** tongli has joined #openstack-swift | 17:25 | |
*** tongli has quit IRC | 17:29 | |
-openstackstatus- NOTICE: The infrastructure team is taking Gerrit offline for maintenance, beginning shortly after 18:00 UTC for a potentially 4 hour maintenance window. | 17:39 | |
*** tongli has joined #openstack-swift | 17:49 | |
*** nadeem has quit IRC | 17:50 | |
*** thebloggu has quit IRC | 17:52 | |
*** tongli has quit IRC | 17:53 | |
*** geaaru has quit IRC | 17:56 | |
*** silor has quit IRC | 17:59 | |
*** silor has joined #openstack-swift | 18:00 | |
*** baojg_ has quit IRC | 18:05 | |
notmyname | FYI https://review.openstack.org/#/c/355253/ | 18:05 |
patchbot | patch 355253 - openstack-dev/devstack - Add 'hitch' support for 'tls-proxy' option. | 18:05 |
-openstackstatus- NOTICE: Gerrit is now going offline for maintenance, reserving a maintenance window through 22:00 UTC. | 18:06 | |
*** ChanServ changes topic to "Gerrit is now going offline for maintenance, reserving a maintenance window through 22:00 UTC." | 18:06 | |
*** sams-gleb has joined #openstack-swift | 18:12 | |
*** mingyu has joined #openstack-swift | 18:14 | |
*** silor has quit IRC | 18:16 | |
*** mingyu has quit IRC | 18:19 | |
*** sams-gleb has quit IRC | 18:23 | |
clayg | mahatic: for me https://gist.github.com/MahatiC/f64ae7c08f5897ebe43415677486ed3c is very close! | 18:24 |
clayg | mahatic: the only downside is that it makes an additional listdir call | 18:24 |
clayg | notmyname: what's this hitch tls-proxy about? | 18:27 |
notmyname | clayg: I'm not completely sure TBH | 18:27 |
notmyname | clayg: but it caught my eye on the mailing list because I though it might have something to do with swift proxies in devstack. not sure. warrants a look | 18:28 |
clayg | BUT I CAN'T LOOK AT IT!? | 18:28 |
notmyname | clayg: turns out I have a local clone of devstack. | 18:28 |
*** caiobrentano_ has joined #openstack-swift | 18:29 | |
clayg | tmcpeak: i thought bandit flagged a bunch of stuff in swift? cause idk, we use hashlib or something? | 18:29 |
clayg | nowhey1? | 18:29 |
notmyname | huh. was only 3542 commits behind master ;-) | 18:29 |
tmcpeak | clayg: that's probably been disabled in the profile | 18:29 |
tmcpeak | whatever you had before I just copied over | 18:29 |
notmyname | hmm...looks like tls-proxy is a service that can be used in devstack to give a TLS endpoint. so that's nice | 18:30 |
notmyname | clayg: ok, prob not a thing to worry about per se, but the change from stud to hitch is good to know (that stud isn't a thing anymore in ubuntu) | 18:31 |
*** zaitcev has quit IRC | 18:32 | |
*** zaitcev has joined #openstack-swift | 18:32 | |
*** ChanServ sets mode: +v zaitcev | 18:32 | |
*** ogelbukh has quit IRC | 18:33 | |
*** ogelbukh has joined #openstack-swift | 18:34 | |
*** tongli has joined #openstack-swift | 18:38 | |
clayg | oh snap - gerrits back maybe? | 18:40 |
notmyname | the window's 4 hours long (staring 40 minutes ago) | 18:41 |
*** tongli has quit IRC | 18:42 | |
*** zhengyin has quit IRC | 18:45 | |
*** zhengyin has joined #openstack-swift | 18:46 | |
*** caiobrentano_ has quit IRC | 18:49 | |
openstackgerrit | David Goetz proposed openstack/swift: go: add part / replica count funcs into ring https://review.openstack.org/365093 | 18:52 |
*** silor has joined #openstack-swift | 19:00 | |
*** silor1 has joined #openstack-swift | 19:04 | |
*** silor has quit IRC | 19:06 | |
*** silor1 is now known as silor | 19:06 | |
*** Jeffrey4l has quit IRC | 19:07 | |
*** tongli has joined #openstack-swift | 19:09 | |
*** tongli has quit IRC | 19:09 | |
*** tongli has joined #openstack-swift | 19:09 | |
*** tongli has quit IRC | 19:09 | |
*** tongli has joined #openstack-swift | 19:09 | |
*** ChanServ changes topic to "Topic: Let's talk. We're nice. | Ideas: https://wiki.openstack.org/wiki/Swift/ideas | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift" | 19:15 | |
-openstackstatus- NOTICE: Gerrit is completing an online re-index, you may encounter slowness until it is complete | 19:15 | |
*** klamath has quit IRC | 19:16 | |
*** silor has quit IRC | 19:21 | |
*** delattec has joined #openstack-swift | 19:22 | |
*** cdelatte has quit IRC | 19:25 | |
*** delattec has quit IRC | 19:30 | |
*** links has joined #openstack-swift | 19:43 | |
*** tmcpeak has quit IRC | 19:54 | |
*** klamath has joined #openstack-swift | 19:55 | |
*** links has quit IRC | 19:55 | |
*** klamath has quit IRC | 19:57 | |
*** mingyu has joined #openstack-swift | 20:03 | |
*** openstackgerrit has quit IRC | 20:04 | |
*** openstackgerrit has joined #openstack-swift | 20:04 | |
*** tqtran has quit IRC | 20:07 | |
*** mingyu has quit IRC | 20:09 | |
openstackgerrit | Merged openstack/swift: Deprecate swift-temp-url https://review.openstack.org/348173 | 20:21 |
clayg | whooo! eat it swift-temp-url! | 20:30 |
clayg | so now lp bug #1607521 is a bigger deal :D | 20:31 |
openstack | Launchpad bug 1607521 in python-swiftclient "tempurl uses wrong HMAC with full path" [Medium,New] https://launchpad.net/bugs/1607521 | 20:31 |
*** tongli has quit IRC | 20:33 | |
*** tmcpeak has joined #openstack-swift | 20:33 | |
*** _JZ_ has quit IRC | 20:35 | |
timburke | clayg: nah, cschwede's got it :-) | 20:39 |
openstackgerrit | Merged openstack/swift: go: move REPCONN and REPLICATE call from object server to replicator https://review.openstack.org/364075 | 20:43 |
*** nadeem has joined #openstack-swift | 20:44 | |
*** tqtran has joined #openstack-swift | 20:54 | |
*** chsc has quit IRC | 21:11 | |
*** dmorita has quit IRC | 21:37 | |
*** dmorita has joined #openstack-swift | 21:39 | |
*** tmcpeak has left #openstack-swift | 21:43 | |
*** StraubTW has quit IRC | 21:46 | |
*** arch-nemesis has quit IRC | 21:47 | |
*** dmorita has quit IRC | 21:50 | |
*** dmorita has joined #openstack-swift | 21:51 | |
*** cebreidian has quit IRC | 21:58 | |
*** dmorita has quit IRC | 22:03 | |
*** cebreidian has joined #openstack-swift | 22:06 | |
*** dmorita has joined #openstack-swift | 22:07 | |
openstackgerrit | Mathias Bjoerkqvist proposed openstack/swift: WIP: Storing encryption root secret in Barbican https://review.openstack.org/364878 | 22:15 |
*** david-lyle has quit IRC | 22:15 | |
*** david-lyle has joined #openstack-swift | 22:17 | |
*** sanchitmalhotra has quit IRC | 22:26 | |
*** sanchitmalhotra has joined #openstack-swift | 22:26 | |
*** dmorita has quit IRC | 22:33 | |
*** dmorita has joined #openstack-swift | 22:34 | |
*** nadeem has quit IRC | 22:38 | |
*** dmorita has quit IRC | 22:38 | |
*** dmorita has joined #openstack-swift | 22:50 | |
*** mingyu has joined #openstack-swift | 22:53 | |
*** mingyu has quit IRC | 22:58 | |
*** jeblair is now known as corvus | 23:01 | |
*** vint_bra has quit IRC | 23:04 | |
*** asettle has joined #openstack-swift | 23:05 | |
*** Suyi_ has quit IRC | 23:09 | |
*** asettle has quit IRC | 23:10 | |
*** openstackgerrit has quit IRC | 23:18 | |
*** openstackgerrit has joined #openstack-swift | 23:19 | |
*** tqtran has quit IRC | 23:41 | |
*** asettle has joined #openstack-swift | 23:46 | |
*** dmorita has quit IRC | 23:57 | |
timburke | timur: question for next week: what's the expected behavior around https://review.openstack.org/#/c/363316/4/swift/proxy/controllers/base.py@1071 if end (or self.backend_headers['Range'], for that matter) is None? | 23:59 |
patchbot | patch 363316 - swift - Silence "Client disconnected" warnings on reads. (MERGED) | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!