Thursday, 2018-07-05

*** nguyenhai has joined #openstack-swift01:59
openstackgerritNguyen Hai proposed openstack/swift master: add lower-constraints job  https://review.openstack.org/55625502:04
*** bkopilov has quit IRC02:14
*** psachin` has joined #openstack-swift02:29
kota_hello world03:12
kota_yeah, it's quiet.03:12
mattoliveraukota_: morning03:35
*** bkopilov has joined #openstack-swift03:48
openstackgerritVu Cong Tuan proposed openstack/swift master: Replace unicode with six.text_type  https://review.openstack.org/58027704:09
openstackgerritPete Zaitcev proposed openstack/swift master: Make ShardRanges and its CLI py3-compliant  https://review.openstack.org/57032004:17
*** cshastri has joined #openstack-swift04:59
*** cbartz has joined #openstack-swift05:11
*** ccamacho has quit IRC05:14
*** psachin` has quit IRC05:27
*** psachin` has joined #openstack-swift05:29
*** ianychoi has joined #openstack-swift05:34
openstackgerritTim Burke proposed openstack/swift master: Make docs link consistent  https://review.openstack.org/58029106:05
openstackgerritTim Burke proposed openstack/swift master: Be consistent about capitalizing Swift in the README  https://review.openstack.org/58029206:06
mattoliverautimburke: is see your 4th of July festivities are over and your back at your laptop ;)06:07
*** armaan has joined #openstack-swift06:13
*** armaan has quit IRC06:15
*** armaan has joined #openstack-swift06:16
*** ccamacho has joined #openstack-swift06:19
*** armaan has quit IRC06:21
*** hseipp has joined #openstack-swift06:38
*** silor has joined #openstack-swift07:05
*** gkadam has joined #openstack-swift07:11
*** rcernin has quit IRC07:54
*** mikecmpbll has joined #openstack-swift08:00
*** silor has quit IRC08:02
*** silor has joined #openstack-swift08:02
*** geaaru has joined #openstack-swift08:02
*** mikecmpbll has quit IRC08:48
*** mikecmpbll has joined #openstack-swift08:49
*** cbartz has quit IRC08:55
openstackgerritMerged openstack/swift master: Address some review comments  https://review.openstack.org/55869209:40
*** armaan has joined #openstack-swift09:44
*** spsurya_ has quit IRC09:49
openstackgerritMerged openstack/swift master: Make docs link consistent  https://review.openstack.org/58029109:51
openstackgerritMerged openstack/swift master: Be consistent about capitalizing Swift in the README  https://review.openstack.org/58029209:53
*** silor1 has joined #openstack-swift10:02
*** silor has quit IRC10:04
*** silor1 is now known as silor10:04
openstackgerritYuxin Wang proposed openstack/swift master: HEAD to check existence before container PUT  https://review.openstack.org/58033310:04
*** armaan has quit IRC10:06
*** bkopilov has quit IRC10:28
*** cbartz has joined #openstack-swift10:38
*** silor has quit IRC10:56
*** hseipp has quit IRC11:20
*** armaan has joined #openstack-swift11:22
*** lifeless has quit IRC11:45
*** cbartz has quit IRC11:49
*** bkopilov has joined #openstack-swift11:57
*** kei_yama has quit IRC12:20
*** silor has joined #openstack-swift12:21
*** silor1 has joined #openstack-swift12:38
*** silor has quit IRC12:39
*** silor has joined #openstack-swift12:42
*** silor1 has quit IRC12:43
*** cshastri has quit IRC12:46
*** armaan has quit IRC12:46
*** armaan has joined #openstack-swift12:47
*** silor1 has joined #openstack-swift12:51
*** silor has quit IRC12:53
openstackgerritAlistair Coles proposed openstack/swift master: Make primary only and handoff only workers dump separate recon stats  https://review.openstack.org/58021512:55
openstackgerritAlistair Coles proposed openstack/swift master: Make obj replicator config error messages more informative  https://review.openstack.org/58021612:55
*** silor1 has quit IRC12:55
*** silor has joined #openstack-swift13:12
*** armaan has quit IRC13:16
*** armaan has joined #openstack-swift13:17
*** silor has quit IRC13:21
*** cbartz has joined #openstack-swift13:21
*** armaan has quit IRC13:21
*** armaan has joined #openstack-swift13:24
*** zaitcev has joined #openstack-swift13:40
*** ChanServ sets mode: +v zaitcev13:40
*** cbartz has quit IRC13:44
acolesclayg: mattoliverau: I need some help knowing how to aggregate replicator timing stats when there are handoff only and primary only workers https://review.openstack.org/#/c/580215/13:44
patchbotpatch 580215 - swift - Make primary only and handoff only workers dump se...13:44
acolesi.e. what is a sensible value to report for the aggregate replication_time?13:45
claygacoles: yes, this is a big problem13:45
acoles(see my comment on the patch)13:45
claygthe whole idea of cycle time needs to die13:45
claygwhich isn't good - because i'm pretty sure a lot of ops have some ideas/tools built around it13:46
acolesyup13:46
claygthe time between first worker starting and last worker finishing is what we want13:46
claygI honestly don't know if handoffs or primaries will finish first during a rebalance13:47
acoles^^ this is what the reconstructor reports, I believe13:47
claygalso - do we still have a way to say "do not do any primaries"13:47
acolesp 578213 does not seem to allow replicator_primary_only_workers=0 if replicator_handoff_only_workers is set13:48
patchbothttps://review.openstack.org/#/c/578213/ - swift - object-replicator: separate workers for primary/ha...13:48
claygbecause we'll want that for saving iops, even if the handoff workers get better at looping on handoffs until they finish13:48
claygacoles: but like - we could still say .. "handoffs_only = True" and that makes all workers handoff workers?  maybe?13:49
claygthe interactoin there is probably akward :\13:49
claygacoles: sounds like there's still a fair amount of design to do on this patch?  oops13:49
claygthanks for looking at it.13:49
acolesclayg: for replicator - you mean handoffs_first?13:51
claygacoles: LOL, yes I forgot replicator DOESN'T have a way to say "no primaries" :'(13:52
acolesI guess torgomatic had a reason to enforce minimum of one worker of each mode (handoffs/primaries)13:54
claygkeep in mind if it makes it simpler it would be great to make the replicator work like the reconstructor: https://github.com/openstack/swift/blob/master/swift/obj/reconstructor.py#L18813:55
claygacoles: I had asked about accidently configuring in "primaries only" mode - which afaik is not something anyone would ever want to do13:55
claygwe have on occasion wanted to do ONLY rebalance - but never ONLY primary sync13:56
acolesmakes sense13:56
acolesclayg: I could imagine p 578213 landing and a follow up relaxing constraint to allow zero primary_only. But I think the recon stats need to be fixed somehow before it lands.13:58
patchbothttps://review.openstack.org/#/c/578213/ - swift - object-replicator: separate workers for primary/ha...13:58
claygi agree, good scoring - thanks for looking at it!13:59
acolesclayg: so question is whether p 578213 is sane enough for now, albeit not the end goal of (first start - last finish)? Then follow up with changing to (first start - last finish).14:01
patchbothttps://review.openstack.org/#/c/578213/ - swift - object-replicator: separate workers for primary/ha...14:01
acolesargh, I mean https://review.openstack.org/#/c/580215/214:01
patchbotpatch 580215 - swift - Make primary only and handoff only workers dump se...14:01
acoles^^ if that is ok as a stop-gap then we could squash it and make progress.14:02
*** cbartz has joined #openstack-swift14:13
*** zaitcev has quit IRC14:24
*** zaitcev has joined #openstack-swift14:26
*** ChanServ sets mode: +v zaitcev14:26
*** armaan has quit IRC14:29
*** itlinux has quit IRC14:40
*** ccamacho1 has joined #openstack-swift14:44
*** ccamacho1 has quit IRC14:44
*** ccamacho1 has joined #openstack-swift14:45
*** ccamacho has quit IRC14:45
openstackgerritAlistair Coles proposed openstack/swift master: Tighten up expirer tests  https://review.openstack.org/35243814:47
openstackgerritAlistair Coles proposed openstack/swift master: Always fetch listings from shards when possible  https://review.openstack.org/57153114:55
*** silor has joined #openstack-swift14:55
openstackgerritAlistair Coles proposed openstack/swift master: swift-ring-builder shows hint about composite builder file  https://review.openstack.org/47572714:57
*** cbartz has quit IRC15:04
*** armaan has joined #openstack-swift15:08
*** itlinux has joined #openstack-swift15:25
*** gyee has joined #openstack-swift15:31
notmynamegood morning16:12
timburkegood morning16:14
*** silor has quit IRC16:25
*** mikecmpbll has quit IRC16:39
*** guimaluf has quit IRC16:45
*** armaan_ has joined #openstack-swift16:45
*** armaan has quit IRC16:45
*** armaan_ has quit IRC16:50
*** psachin` has quit IRC16:52
*** ccamacho1 has quit IRC17:03
openstackgerritAlistair Coles proposed openstack/swift master: Replace MIME with PUT+POST for EC and Encryption  https://review.openstack.org/42791117:10
openstackgerritAlistair Coles proposed openstack/swift master: Enable FakeConn to handle multiple requests/responses  https://review.openstack.org/57922817:10
openstackgerritAlistair Coles proposed openstack/swift master: WIP PUT+POST: test proxy object controller PUT path  https://review.openstack.org/57922917:10
acoleszaitcev: rebasing and added a few more tests in final patch ^^17:10
zaitcevacoles: thanks a lot. Can't wait to see if you did anything about that extra  raise ChunkReadError17:11
acoleszaitcev: which one is that? I haven't touched anything today, just added tests17:12
acolesoh, there were a few unnecessary self.app.use_put_v1 assignments in test_obj that I cleaned up17:12
zaitcevYou wrote "However, I don't think raising ChunkWriteTimout is the correct strategy. Raising an exception here will cause the entire PUT to terminate early, whereas it is only this putter that has failed - a quorum may still succeed. I *think* the right thing may be to make the failed response be the putter's final response, and then return - no poont sending the POST requests."17:12
acolesoh yeah17:13
zaitcevI didn't realize what would happen when I put it there. Seemed like I needed something to signal to the main loop that a putter failed.17:13
acoleszaitcev: this was in the last patchset actually https://review.openstack.org/#/c/579229/4/swift/proxy/controllers/obj.py17:13
patchbotpatch 579229 - swift - WIP PUT+POST: test proxy object controller PUT path17:13
acolesand the tests I've been adding assert the behaviour17:14
zaitcevyay let me see17:14
zaitcevgo go gadget git review -d 57922917:15
acolesTBH the putter final_resp dance can get confusing me but the tests seem to confirm things17:15
*** geaaru has quit IRC17:41
*** bkopilov has quit IRC17:43
*** bkopilov has joined #openstack-swift17:52
*** SkyRocknRoll has joined #openstack-swift17:55
*** SkyRocknRoll has quit IRC17:57
notmynameclayg: timburke: based on comments in gerrit, I'm tempted to go ahead and land both https://review.openstack.org/#/c/337960/ and https://review.openstack.org/#/c/575860/18:18
patchbotpatch 337960 - swift - Send correct SLO ETag for container updates18:18
patchbotpatch 575860 - swift - Include '-' in multipart ETags18:18
timburkenotmyname: i could also try another approach today -- basically, take the s3api approach and apply it to slo, too (while being careful to preserve any other override params)18:19
timburkei think it'd make clay happier, and still provide value for timur and others who might want to know about SLO-ness in listings18:20
*** ccamacho has joined #openstack-swift18:23
*** armaan has joined #openstack-swift18:32
*** armaan has quit IRC18:44
*** armaan has joined #openstack-swift18:45
*** armaan has quit IRC18:49
*** ccamacho has quit IRC18:54
*** UnfairFunction has joined #openstack-swift19:20
UnfairFunction /msg NickServ identify maosSo8e19:21
*** Chealion has quit IRC19:21
DHEprotip: set your nickserv password as your IRC connection password to auto-identify on connect without risk of this happening.19:21
UnfairFunctionHow do I open a bug for pyeclib?19:22
UnfairFunctionthank you, DHE :)19:22
tdasilvaUnfairFunction: https://bugs.launchpad.net/pyeclib19:23
UnfairFunctionthe pyeclib repo does not have a CONTRIBUTING page..19:23
*** Chealion has joined #openstack-swift19:24
tdasilvaUnfairFunction: good point, little busy atm, but will take a look at that19:27
tdasilvaeven if we just need to add the info about bugs here: https://github.com/openstack/pyeclib#code-maintenance19:27
*** UnfairFunction has quit IRC19:31
*** gkadam has quit IRC19:32
*** lifeless has joined #openstack-swift19:39
*** UnfairFunction has joined #openstack-swift20:12
*** UnfairFunction has quit IRC20:15
*** UnfairFunction has joined #openstack-swift20:15
*** ccamacho has joined #openstack-swift20:19
*** mikecmpbll has joined #openstack-swift21:21
*** armaan has joined #openstack-swift21:23
*** itlinux has quit IRC21:24
openstackgerritEhud Kaldor proposed openstack/swift master: added Alpine Linux (apk) entries to bindep.txt.  https://review.openstack.org/58051121:25
openstackgerritEhud Kaldor proposed openstack/swift master: added Alpine Linux (apk) entries to bindep.txt. closes-bug: #1780163 Change-Id: Iff24a2b02b8927113d616a5af06331f1a1e31170  https://review.openstack.org/58051121:29
openstackbug 1780163 in OpenStack Object Storage (swift) "no Alpine Linux (apk) entries in Swift bindep.txt" [Undecided,New] https://launchpad.net/bugs/178016321:29
*** rcernin has joined #openstack-swift22:00
*** armaan has quit IRC22:36
*** armaan has joined #openstack-swift22:37
*** armaan has quit IRC22:41
mattoliveraumorning22:49
notmynamemattoliverau: hello22:52
*** rcernin has quit IRC22:58
*** rcernin has joined #openstack-swift23:01
*** ianychoi_ has joined #openstack-swift23:01
*** ianychoi has quit IRC23:04
mattoliveraunotmyname: o/ enjoy the holiday?23:04
notmynameyeah. went on a hike with the kids. it was great23:06
*** kei_yama has joined #openstack-swift23:22
mattoliveraunice23:27
mattoliverauUnfairFunction: do mind if I quickly update your commit message for p 580511? Just some OCD. I can do it via gerrit, you'd still remain the patch author. It would mean I can then go land it :)23:58
patchbothttps://review.openstack.org/#/c/580511/ - swift - added Alpine Linux (apk) entries to bindep.txt. cl...23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!