Wednesday, 2018-01-03

*** tovin07_ has joined #openstack-swift00:43
*** cshastri has joined #openstack-swift01:07
*** catintheroof has quit IRC01:10
*** catintheroof has joined #openstack-swift01:11
*** gkadam has quit IRC01:15
*** catintheroof has quit IRC01:15
*** gkadam has joined #openstack-swift01:16
*** gyee has quit IRC01:16
*** tovin07_ has quit IRC01:26
*** tovin07_ has joined #openstack-swift01:40
openstackgerritMerged openstack/swift master: Display more info on empty rings  https://review.openstack.org/53025801:41
*** tonyb has quit IRC01:47
*** tonyb has joined #openstack-swift01:49
*** gkadam has quit IRC01:56
*** gkadam has joined #openstack-swift01:59
*** two_tired has joined #openstack-swift02:08
*** JimCheung has quit IRC02:40
*** JimCheung has joined #openstack-swift02:40
*** JimCheung has quit IRC02:45
*** JimCheung has joined #openstack-swift02:56
*** JimCheung has quit IRC03:02
*** gkadam has quit IRC03:07
*** flwang has quit IRC03:16
*** flwang has joined #openstack-swift03:17
*** links has joined #openstack-swift04:48
*** psachin has joined #openstack-swift04:56
*** links has quit IRC04:58
*** links has joined #openstack-swift05:03
openstackgerritMatthew Oliver proposed openstack/swift master: Show devices marked as deleted on empty rings  https://review.openstack.org/53083905:11
*** chsc has joined #openstack-swift05:22
*** chsc has quit IRC05:29
*** tovin07_ has quit IRC05:30
*** tovin07_ has joined #openstack-swift05:31
*** two_tired has quit IRC05:42
*** armaan has joined #openstack-swift05:45
*** cshastri has quit IRC06:18
*** cshastri has joined #openstack-swift06:33
*** pcaruana has joined #openstack-swift07:09
openstackgerritMerged openstack/swift master: Represent dispersion worse than one replicanth  https://review.openstack.org/52815507:10
hugokuohola07:19
hugokuoanyone knows the details about X-DELETE-AT-CONTAINER header?  I notice there's log `ssnode2-platform-centos7 object-server: X-Delete-At-Container header must be specified for expiring objects background PUT to work properly. Making best guess as to the container name for now. (txn: txc0b0c3861f504ca5bac62-005a4c8189)`07:20
hugokuoBut can't really find clue about how this header works tho07:20
openstackgerritMerged openstack/swift master: add swift-ring-builder option to recalculate dispersion  https://review.openstack.org/53049307:24
*** rcernin has quit IRC07:25
*** cshastri has quit IRC07:34
*** cshastri has joined #openstack-swift07:35
*** hseipp has joined #openstack-swift07:42
*** armaan has quit IRC08:04
*** armaan has joined #openstack-swift08:05
*** tesseract has joined #openstack-swift08:05
*** medy has joined #openstack-swift08:15
*** medy has quit IRC08:16
*** medy has joined #openstack-swift08:16
*** medy has quit IRC08:18
*** medy has joined #openstack-swift08:18
*** medy has quit IRC08:19
*** medy has joined #openstack-swift08:19
*** medy has quit IRC08:21
*** medy has joined #openstack-swift08:21
*** medy has quit IRC08:22
*** medy has joined #openstack-swift08:22
*** medy has quit IRC08:24
*** medy has joined #openstack-swift08:24
*** medy has quit IRC08:25
*** medy has joined #openstack-swift08:25
*** medy has quit IRC08:27
*** medy has joined #openstack-swift08:27
*** SkyRocknRoll has quit IRC08:28
*** medy has quit IRC08:28
*** medy has joined #openstack-swift08:28
*** medy has quit IRC08:29
*** SkyRocknRoll has joined #openstack-swift08:46
*** armaan has quit IRC08:48
*** armaan has joined #openstack-swift08:48
acolesgood morning08:49
*** SkyRocknRoll has quit IRC08:51
acoleshugokuo: you'll see those warnings when the object policy has more replicas (or EC fragments) than the container ring08:52
acoleshugokuo: they are annoying but not too concerning, there's some discussion here https://bugs.launchpad.net/swift/+bug/173358808:52
openstackLaunchpad bug 1733588 in OpenStack Object Storage (swift) "expiring objects warning if replica > 3" [Medium,In progress] - Assigned to Christopher Bartz (bartz)08:52
acolesand a link to an upstream patch to prevent the warnings08:53
hugokuoacoles: thx for clarification!08:53
acoleshugokuo: the header tells the object server the name of the container in which to place an expiry record for an object with x-delete-at. currently only 3 (or container ring replica number) of the object servers get sent this header, and the other object servers flag up the warning.08:54
acolesIIRC the plan in the bug fix is to send the header to all object servers08:55
hugokuoIt's annoying while seeing container-server delete 8 times for 5+3 EC.08:56
acoleshugokuo: yep. you have reminded me to review the patch ;)08:57
acolestimburke: mattoliverau in case you didn't notice it go by, I merged master to feature/deep yesterday08:58
hugokuothat helps. I can ignore all those suspicious logs.09:01
*** SkyRocknRoll has joined #openstack-swift09:03
*** cshastri has quit IRC09:21
*** cshastri has joined #openstack-swift09:21
*** d0ugal has quit IRC09:27
*** d0ugal has joined #openstack-swift09:28
*** d0ugal has quit IRC09:28
*** d0ugal has joined #openstack-swift09:28
*** SkyRocknRoll has quit IRC10:01
*** mvk has quit IRC10:06
*** tovin07_ has quit IRC10:06
*** mvk has joined #openstack-swift10:07
*** pcaruana has quit IRC10:09
*** pcaruana has joined #openstack-swift10:10
mattoliverauacoles: thanks man. First day back today so was mainly plaing email catch up. will hopefullt do some deep tomorrow :)10:10
*** armaan has quit IRC10:12
*** armaan has joined #openstack-swift10:13
*** SkyRocknRoll has joined #openstack-swift10:18
*** armaan has quit IRC10:29
*** armaan has joined #openstack-swift10:30
*** armaan has quit IRC10:43
*** armaan has joined #openstack-swift10:44
openstackgerritAlistair Coles proposed openstack/swift feature/deep: fixes for sharding/shrinking races  https://review.openstack.org/52993111:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Wait for found shard ranges to be replicated before cleaving  https://review.openstack.org/53089911:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Set swiftclient log level to WARNING for sharding probe tests  https://review.openstack.org/53090011:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add includes method to ShardRange  https://review.openstack.org/53090111:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Re-introduce shard range updates to root after shard has sharded  https://review.openstack.org/53090211:17
*** mvk has quit IRC11:23
*** armaan has quit IRC11:54
*** armaan has joined #openstack-swift11:54
*** cshastri has quit IRC11:58
*** mvk has joined #openstack-swift11:59
*** silor has joined #openstack-swift12:15
*** cshastri has joined #openstack-swift12:25
*** cshastri has quit IRC12:34
*** catintheroof has joined #openstack-swift12:58
*** catintheroof has quit IRC12:59
*** catintheroof has joined #openstack-swift12:59
*** armaan has quit IRC13:13
*** armaan has joined #openstack-swift13:13
*** SkyRocknRoll has quit IRC13:28
*** psachin has quit IRC13:29
*** psachin has joined #openstack-swift13:40
*** psachin has quit IRC13:43
*** JimCheung has joined #openstack-swift13:45
*** JimCheung has quit IRC13:50
*** links has quit IRC13:57
*** ianychoi has quit IRC14:53
*** silor has quit IRC15:20
*** links has joined #openstack-swift15:24
*** links has quit IRC15:30
*** silor has joined #openstack-swift15:47
*** chsc has joined #openstack-swift15:52
*** chsc has joined #openstack-swift15:52
*** armaan has quit IRC15:55
*** armaan has joined #openstack-swift15:55
*** openstackgerrit has quit IRC16:19
*** mvk has quit IRC16:24
*** pcaruana has quit IRC16:35
*** mvk has joined #openstack-swift16:37
*** mvk has quit IRC16:43
*** catintheroof has quit IRC16:55
*** mvk has joined #openstack-swift16:55
*** gyee has joined #openstack-swift16:58
*** silor has quit IRC17:12
timburkegood morning17:20
*** JimCheung has joined #openstack-swift17:22
*** hseipp has quit IRC17:23
*** tesseract has quit IRC17:38
*** mvk has quit IRC17:43
*** armaan has quit IRC18:06
timburkehmm... patches like p 530899 are *after* we moved the jobs around in p 528582, but the check results don't have any of the in-tree job results...18:06
patchbothttps://review.openstack.org/#/c/530899/ - swift (feature/deep) - Wait for found shard ranges to be replicated befor...18:06
patchbothttps://review.openstack.org/#/c/528582/ - swift - Native Zuul v3 tox jobs (MERGED)18:06
acolestimburke: hmm, and that was after I had merged master into the branch. do we have something missing on the feature branch?18:08
timburkedon't think so... i'm wondering if there's some branch-specification somewhere in the job parentage...18:09
acolestimburke: re https://review.openstack.org/#/c/530899/1/swift/container/sharder.py@475 I *do* think that being able to specify a subset of operations per run_once cycle will be incredibly helpful for testing, e.g. to simulate a failure part way through process_broker18:12
patchbotpatch 530899 - swift (feature/deep) - Wait for found shard ranges to be replicated befor...18:12
timburkeyeah, that'll need to happen regardless, i think. i wonder if it might be simpler to force it to go one step at a time, all the time18:12
*** armaan has joined #openstack-swift18:13
timburkethen we don't need to think about param plumbing at all18:13
acolestimburke: maybe, but we should consider the trade-off vs not waiting for an entire cycle before e.g. finding shard ranges and then doing anything with them18:16
*** ChanServ sets mode: +r 18:22
acolestimburke: mattoliverau: I've been looking at the RangeAnalyser and thinking about alternatives, and wrote some thoughts under 'How to select current set of active shard ranges when querying root container?' on the etherpad https://etherpad.openstack.org/p/deep-containers - please add any thoughts you might have18:31
*** openstackgerrit has joined #openstack-swift19:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add includes method to ShardRange  https://review.openstack.org/53090119:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Re-introduce shard range updates to root after shard has sharded  https://review.openstack.org/53090219:17
acolestimburke: good catch on the includes method, thanks19:17
acolesbtw I did consider rolling it into __contains__, but... KISS19:17
acolesfor now at least19:17
acolesg'night19:18
timburkeinterestingly, we *already* kinda support ShardRange(...) in ShardRang(...) -- it just doesn't do what you probably want19:18
*** pcaruana has joined #openstack-swift19:45
*** pcaruana has quit IRC19:59
*** Jeffrey4l has quit IRC20:11
*** Jeffrey4l has joined #openstack-swift20:24
mattoliverautimburke: cool, yeah I'll take a look once I'm sitting in the office post coffee :)20:37
*** JimCheung has quit IRC20:45
*** portdirect has quit IRC20:50
*** portdirect has joined #openstack-swift20:50
*** cleong has joined #openstack-swift21:09
*** cleong has quit IRC21:20
*** awkwardpenguin has joined #openstack-swift21:26
*** awkwardpenguin has quit IRC21:31
*** awkwardpenguin has joined #openstack-swift21:57
*** rcernin has joined #openstack-swift22:05
*** awkwardpenguin has quit IRC22:52
*** manous has joined #openstack-swift23:04

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!