Friday, 2016-11-25

*** gabor_antal has quit IRC00:04
*** gabor_antal has joined #openstack-swift00:04
*** tqtran has joined #openstack-swift00:09
*** tqtran has quit IRC00:13
*** gabor_antal_ has joined #openstack-swift00:14
*** gabor_antal has quit IRC00:18
kota_good morning01:08
mattoliveraukota_: morning01:22
kota_mattoliverau: hi :-D01:22
*** davideagle has quit IRC01:37
*** vint_bra has joined #openstack-swift01:51
*** Jeffrey4l has joined #openstack-swift02:11
*** vint_bra has quit IRC02:29
*** links has joined #openstack-swift03:48
*** ppai has joined #openstack-swift03:54
mahatic_good morning04:00
*** psachin has joined #openstack-swift04:09
*** tqtran has joined #openstack-swift04:10
*** tqtran has quit IRC04:15
mattoliveraumahatic_: morning04:21
*** SkyRocknRoll has joined #openstack-swift05:03
*** siva_krish has joined #openstack-swift06:01
openstackgerritKazuhiro MIYAHARA proposed openstack/swift: Remove 'X-Static-Large-Object' from .meta files  https://review.openstack.org/38541206:16
*** SkyRocknRoll has quit IRC06:23
*** SkyRocknRoll has joined #openstack-swift06:40
*** dmorita has joined #openstack-swift06:59
*** sams-gleb has joined #openstack-swift07:04
*** rcernin has joined #openstack-swift07:05
openstackgerritPavel Kvasnička proposed openstack/swift: WIP: Fix missing and corrupted suffixes during replication  https://review.openstack.org/40232407:17
*** rcernin has quit IRC07:26
*** rcernin has joined #openstack-swift07:28
*** hseipp has joined #openstack-swift07:40
*** dmorita has quit IRC07:47
*** pavel has joined #openstack-swift07:50
*** pavel is now known as PavelK07:51
*** rcernin has quit IRC07:51
*** silor has joined #openstack-swift07:51
PavelKcschwede: here?07:52
*** silor1 has joined #openstack-swift07:54
*** rcernin has joined #openstack-swift07:54
PavelKcschwede: I'd like to fix missing hashes in pkl and sometimes hard-recalculate all hashes. Do you working on patch 402204 now?07:55
patchbothttps://review.openstack.org/#/c/402204/ - swift - Add missing suffixes to hashes.pkl during replication07:55
*** silor has quit IRC07:55
*** silor1 is now known as silor07:55
*** Jeffrey4l has quit IRC07:57
*** silor has quit IRC08:02
*** siva_krish has quit IRC08:03
openstackgerritMahati Chamarthy proposed openstack/swift: Confirm receipt of SLO PUT with etag  https://review.openstack.org/39090108:05
*** silor has joined #openstack-swift08:11
*** amoralej|off is now known as amoralej08:11
cschwedePavelK: Hi! I’m working on making the listdir more deterministic right now08:11
*** tqtran has joined #openstack-swift08:12
*** silor1 has joined #openstack-swift08:14
*** silor has quit IRC08:15
*** silor1 is now known as silor08:15
PavelKcschwede: I offer more deterministic listing in patch 402324 - see swift/obj/replicator.py file without renaming do_list parameter08:17
patchbothttps://review.openstack.org/#/c/402324/ - swift - WIP: Fix missing and corrupted suffixes during rep...08:17
*** tqtran has quit IRC08:17
cschwedePavelK: i already started working on deterministc listings yesterday, told that to to onovy?08:18
cschwedePavelK: also, looking at that patch it also has some random shuffling, and that’s likely not enough?08:19
*** pcaruana has joined #openstack-swift08:19
PavelKcschwede: I'm waiting for path from you; please, ignore my commit - it's a draft08:20
*** geaaru has joined #openstack-swift08:20
onovyPavelK: cschwede: I think we need to sync what to do :) i have 2 ideas08:21
onovydo_list_dir only checks MISSING suffixies08:21
onovyand it's called every 10th run - non-deterministic08:21
onovymake it deterministic, which is my first idea08:21
onovycschwede: you are working on this, right?08:21
cschwedeonovy: yes08:21
onovycool08:21
onovysecond idea:08:21
onovyadd new param, check_all08:21
onovyrun it every 100th run, deterministric08:22
onovythis is nice-to-have08:22
onovyand it can fix currently corrupted suffixies, unrelated to current bug we are trying to fix08:22
onovybecause now, if hashes.pkl is not consistend with suffix dirs, nothing will fix it08:22
cschwedeonovy: PavelK: i think the most important thing is to land PavelK first patch pretty soon08:23
onovyok, so we will land it to our production and then we can confirm it helps08:23
onovy(rsync metrics should jump down)08:23
cschwedeonovy: i’m not sure about the re-computing of every suffix every 100th run. we need to check if there is currently an issue; if the suffix is already in the hashes.pkl, it is likely that it gets recomputed inbetween?08:24
onovywho recompute it?08:24
onovyi think there is no code for recompute it, if there isn't any write traffic to it08:25
openstackgerritPavel Kvasnička proposed openstack/swift: Fix missing suffixes during replication  https://review.openstack.org/40232408:27
*** rledisez has joined #openstack-swift08:35
*** geaaru has quit IRC08:39
*** asettle has joined #openstack-swift08:39
*** geaaru has joined #openstack-swift08:55
*** cbartz has joined #openstack-swift09:00
*** cbartz has quit IRC09:01
*** dmorita has joined #openstack-swift09:08
*** sams-gleb has quit IRC09:12
*** dmorita has quit IRC09:12
*** sams-gleb has joined #openstack-swift09:12
*** sams-gleb has quit IRC09:16
*** acoles_ is now known as acoles09:20
acolescschwede: onovy good morning09:32
onovymorning09:34
onovyacoles: we are going to upgrade 1 (of 4) zone in production cluster with Pavel's patch09:35
onovyacoles: and Pavel is here on IRC, PavelK09:35
acoleshi PavelK09:36
PavelKacoles: Hi09:36
cschwedeacoles: Hello Alistair!09:36
openstackgerritChristian Schwede proposed openstack/swift: Deterministic suffix update in hashes.pkl  https://review.openstack.org/40237609:36
cschwedeonovy: PavelK: ^^ the deterministic patch09:37
cschwedei run nearly 2000 replications with that, and this is the distribution: http://paste.openstack.org/show/590429/09:37
cschwedefirst column is number of updated suffix, second one is the partition id09:38
*** sams-gleb has joined #openstack-swift09:38
cschwedeeh, sorry, 6650 replications09:38
cschwedewhatever. it shows at least that every partition is updated as often as all others09:38
acolesok. O I have been thinking overnight and still not sure why your rsync stats stay high - I read PavelK comment on the gerrit review. At first, yes there will be zero-file-rsyncs because replicator recalculates a partition (random 10%) and destination does not have the "lost suffix", but after each of those rsyncs the destination gets a REPLICATE to recalc sync'd suffixes so after that both sides should be in sync?09:39
*** sams-gleb has quit IRC09:39
*** sams-gleb has joined #openstack-swift09:39
onovyacoles: yep, and they are09:40
onovyand we are writting to cluster, right?09:41
acolesonovy: yeah, so new writes regenerate the rpoblem09:41
onovyyep09:41
acolesproblem*09:41
acolesk09:41
acolesbut the unnecessary syncs should only occur when sender does a listdir, so approx 10%09:42
acolesdoes that make sense?09:42
*** psachin has quit IRC09:43
*** psachin has joined #openstack-swift09:43
acoleshmmm, actually new object writes AND reclaimable tombstones may trigger a suffix hash mismatch when the sender does listdirs09:45
*** davideagle_ has joined #openstack-swift09:47
acolescschwede: PavelK onovy re. the status of patch 401330...I have no problem merging that fix. I want to be sure we do not miss another lurking bug re. rsync rates, but that does not impede the patch fix.09:49
patchbothttps://review.openstack.org/#/c/401330/ - swift - Fixed regression in consolidate_hashes09:49
onovyacoles: i think we all ack it's regression and this is fix working09:50
onovyso let's marge it. if it will not lower rsync, we will continue in investigation09:50
onovyand we can reopen my bug later09:50
acolesBUT, we will want to backport this and I'd prefer to have some of the test cleanup from my follow up backported too, and backport may be easier from a single commit.09:50
onovyack09:50
onovyso should we merge it first?09:50
onovysquash it09:50
acolesonovy: yeah, if we can that would be ideal IMHO. but don't squash yet, it may be easier for cschwede to review my follow up while its separate09:52
acolescschwede: what do you think? should we try to review and squash https://review.openstack.org/#/c/402199/1 so we have single commit to backport from09:53
patchbotpatch 402199 - swift - Add assertions to invalidate_hashes tests09:53
acoles?09:53
cschwedeacoles: onovy: sounds good, looking into this right now09:53
cschwedeacoles: we probably want to backport the deterministic patch 402376 too09:53
patchbothttps://review.openstack.org/#/c/402376/ - swift - Deterministic suffix update in hashes.pkl09:53
onovyPavelK: please review patch 40219909:54
*** abalfour has quit IRC09:54
patchbothttps://review.openstack.org/#/c/402199/ - swift - Add assertions to invalidate_hashes tests09:54
acolesTBH the one thing I'd really like fixed is the flawed search for distinct suffixdir in the test. But its probably easier to keep change on master as close to a backport as we can.09:54
onovycschwede: ack for backport of deterministic patch too, but that should bem solo patch09:54
onovy*be09:55
cschwedeyep09:55
*** abalfour has joined #openstack-swift09:55
acolescschwede: yes but lets take that separately. PavelK patch is most urgent. but great you are working on determinism :)09:55
acolesI just squashed those two patches locally and cherry-picked back to mitaka, not completely clean but no probs, one of the modified test was new since mitaka10:02
onovyacoles: yep, have same conflict inside my local backport :)10:05
acolesI think we just include the new tests, can't hurt10:05
onovyright10:09
cschwedeacoles: hmm, i see tests failing locally on your patch 40219910:15
*** sams-gleb has quit IRC10:15
patchbothttps://review.openstack.org/#/c/402199/ - swift - Add assertions to invalidate_hashes tests10:15
cschwedehttp://paste.openstack.org/show/590434/10:16
cschwedenevermind, my failure10:16
*** sams-gleb has joined #openstack-swift10:16
acolescschwede: oh? had you made a change?10:17
cschwedeacoles: i messed up my saio… fixed now, tests are passing. sorry for the noise10:18
*** davideagle_ has quit IRC10:19
*** 18WAAUL0E has joined #openstack-swift10:22
acolescschwede: I did notice that the unit test will pick up whatever HASH_PATH_PREFIX etc you have in a local /etc/swift, which is why I care about the test that searches for a different suffixdir, because its not predictable10:23
acolescschwede: from your paste I infer that your SAIO, like mine, has swift_hash_path_prefix = changeme10:23
acoles:)10:23
cschwedeacoles: agreed, i was just checking that out :)10:23
cschwedeand with your test i also agree that there is a possible test issue in test_delete_when_suffix_hash_not_in_existing_pkl, and suffixes might be the same there - so i’m fine with merging both patches10:24
cschwedeacoles: i left a +2 on your patch 402199, just as a reference10:25
patchbothttps://review.openstack.org/#/c/402199/ - swift - Add assertions to invalidate_hashes tests10:25
*** asettle__ has joined #openstack-swift10:25
acolescschwede: thanks, I'll wait for PavelK or onovy to look over it10:25
acolescschwede: yeah, test_delete_when_suffix_hash_not_in_existing_pkl would always pass, but was not guaranteed to be using two distinct suffixes10:26
acolesif the test env had the "wrong" HASH_PATH_PREFIX10:27
*** asettle has quit IRC10:29
acolesafk in search of coffee10:31
*** asettle__ is now known as asettle10:39
openstackgerritMerged openstack/swift: use the new upper constraints infra features  https://review.openstack.org/35429110:40
acolesback, so PavelK if you are happy with patch 402199 then lets squash it into your then cschwede and I can get that merged10:44
patchbothttps://review.openstack.org/#/c/402199/ - swift - Add assertions to invalidate_hashes tests10:44
acolesI can push it if you want, I have done the squash already10:45
*** SkyRocknRoll has quit IRC11:19
onovyacoles: Pavel will be back soon11:29
onovygive as few minutes :)11:29
onovyus11:29
onovyacoles: you can squash, pavel ack yor patch11:35
acolesonovy: ok11:36
PavelK\quit11:37
*** PavelK has quit IRC11:37
openstackgerritAlistair Coles proposed openstack/swift: Fixed regression in consolidate_hashes  https://review.openstack.org/40133011:38
onovyacoles: i think you should add yourself as co-author?11:39
openstackgerritAlistair Coles proposed openstack/swift: Fixed regression in consolidate_hashes  https://review.openstack.org/40133011:41
acolesoh did Pavel quit?11:42
acolesonovy: say "great work" to Pavel! :)11:42
acolescschwede: I added +2 now ^^11:46
cschwedeacoles: onovy: thx, approved the patch - should be in the gate soon11:53
cschwedeacoles: does it make sense to create another bugreport about the non-deterministic update of hashes.pkl?11:53
acolesI think so, particularly because you pointed out that in extreme (low part power) the listdir might never happen11:54
cschwedeacoles: yeah… alright, i’ll do that11:55
*** oshritf has joined #openstack-swift12:03
*** vint_bra has joined #openstack-swift12:12
cschwedeacoles: hmm, even worse, it happens when a replicator has less than 10 partitions to replicate, which might be much more likely12:15
cschwedehttps://bugs.launchpad.net/swift/+bug/164480712:16
openstackLaunchpad bug 1644807 in OpenStack Object Storage (swift) "hashes.pkl suffix update is not deterministic and might be never triggered" [High,In progress] - Assigned to Christian Schwede (cschwede)12:16
acolescschwede: ack12:16
openstackgerritAlistair Coles proposed openstack/swift: Add test for object updater user-agent header  https://review.openstack.org/39852312:21
openstackgerritChristian Schwede proposed openstack/swift: Deterministic suffix update in hashes.pkl  https://review.openstack.org/40237612:22
cschwededumb gerrit, i just edited the commit msg…12:22
*** 18WAAUL0E has quit IRC12:29
acoleshuh, I just discovered this patch 250022 which got +"A back in March and never landed :/12:30
patchbothttps://review.openstack.org/#/c/250022/ - swift - Add missing unittests for some recon methods12:30
acolesI guess none of our dashboards are showing reviews that have +A12:31
*** pavel_ has joined #openstack-swift12:35
*** pavel1 has joined #openstack-swift12:35
*** pavel1 is now known as PavelK12:36
PavelKcschwede: acoles: Thanks for CR, we release to one locality in production12:39
*** oshritf has quit IRC12:40
acolescschwede: onovy PavelK backports here https://review.openstack.org/402509 and https://review.openstack.org/40250812:43
patchbotpatch 402509 - swift (stable/newton) - Fixed regression in consolidate_hashes12:43
patchbotpatch 402508 - swift (stable/mitaka) - Fixed regression in consolidate_hashes12:43
openstackgerritSachin Patil proposed openstack/swift: get_part_nodes should raise error on invalid part  https://review.openstack.org/40252212:48
psachinping clayg. Please review https://review.openstack.org/40252212:53
patchbotpatch 402522 - swift - get_part_nodes should raise error on invalid part12:53
*** davideagle_ has joined #openstack-swift12:55
onovyacoles: ad patch 250022 // it depends on other never-landed patch13:00
patchbothttps://review.openstack.org/#/c/250022/ - swift - Add missing unittests for some recon methods13:00
onovythis: https://review.openstack.org/#/c/240036/13:00
patchbotpatch 240036 - swift - Add unit test to test cli recon for the commands13:00
acolesoic13:04
onovyPeter is sad about it :(13:04
*** davideagle_ has quit IRC13:16
*** amoralej is now known as amoralej|lunch13:17
*** davideagle has joined #openstack-swift13:17
*** sams-gleb has quit IRC13:35
*** sams-gleb has joined #openstack-swift13:37
*** rcernin has quit IRC13:39
*** rcernin has joined #openstack-swift13:49
*** PavelK has quit IRC13:53
*** hogepodge has quit IRC13:59
*** tqtran has joined #openstack-swift14:14
*** psachin has quit IRC14:17
mahatic_so I update my liberasurecode to 1.3.1 and I still see this error on starting swift services -> http://paste.openstack.org/show/590463/14:18
mahatic_kota_: or anyone else: would you happen to be familiar with this error?14:18
*** tqtran has quit IRC14:19
onovymahatic_: it looks like your python-pyeclib doesn't see version from liberasurecode14:23
mahatic_I got that when I upgraded my pyeclib and then installed latest liberasurecode14:23
*** hogepodge has joined #openstack-swift14:23
onovybut you have liberasurecode, because there are errors directly from it :)14:23
onovyhow you installed liberasurecode?14:23
onovyhttp://paste.openstack.org/show/590466/14:25
openstackgerritChristian Schwede proposed openstack/swift: Deterministic suffix update in hashes.pkl  https://review.openstack.org/40237614:25
mahatic_Installed from here https://launchpad.net/ubuntu/+source/liberasurecode14:25
cschwedeacoles: now with better tests ^^14:25
onovymahatic_: so you downloaded binary .deb package ?14:25
onovywhat's your current distro?14:26
*** amoralej|lunch is now known as amoralej14:26
onovymahatic_: call this pls: python -c 'from pyeclib_c import get_liberasurecode_version ; print get_liberasurecode_version()'14:28
*** hogepodge has quit IRC14:28
onovyi guess: you need to reinstall python-pyeclib, because pyeclib_c is not correctly linked to new liberasurecode14:29
mahatic_onovy: hi, here you go: http://paste.openstack.org/show/590469/14:30
onovythis is my: 6604814:31
onovy(1.3.1)14:31
mahatic_hmm there are reports of this issue (but in syslog I believe) https://bitbucket.org/tsg-/liberasurecode/issues/23/spurious-messages-in-syslog14:31
*** links has quit IRC14:31
mahatic_I think I need to update the installed path in conf14:32
mahatic_will check that14:32
onovyyour pyeclib_c is definetly using wrong liberasurecode C lib14:32
onovyreally old one...14:32
onovyhmm it's funny. this version is "packed" inside python-pyeclib14:37
onovyso it just says: when you built python-pyeclib, this version of liberasurecode was installed on system14:37
onovyso rebuilt python-pyeclib -> fixed.14:37
onovymahatic_: must go now. reinstall/rebuild python-pyeclib and it will work. bye :)14:39
mahatic_onovy: hey sure. looks like my pkg is installed in the local lib path, need to fix it, thanks and bye! :)14:40
acolesmahatic_: hi mahatic_ , I am no expert, but I built liberasurecode from source follwing instructions on the README14:41
acolesfirst I purged old liberasurecode that i had installed with apt-get14:41
acolesand I used pip to upgrade pyeclib14:42
mahatic_acoles: hi, what was your source of liberasurecode? I picked it up from here https://launchpad.net/ubuntu/+source/liberasurecode and then did what README said14:42
kota_hello14:43
kota_mahatic: maybe you need to rebuild pyeclib *after* liberasurecode installation14:43
acolesmahatic_: https://github.com/openstack/liberasurecode14:44
acoleswhich version did you grab from launchpad, you need 1.3.1?14:44
kota_mahatic: via `python setup.py install` at pyeclib or `pip uninstall pyeclib` and `pip install pyeclib` agagin14:44
mahatic_I took 1.3.114:45
mahatic_kota_: I didn't build *after* upgrading, will check14:45
kota_ah, onovy has already suggested that.14:45
mahatic_kota_: hi btw, shouldn't you be off for the weekend? :)14:46
onovykota_: why is liberasurecode packed inside python-pyeclib binary when it is build?14:46
onovythis way i can't upgrade liberasurecode package in Debian without rebuilding python-pyeclib after every minor upgrade of lib14:46
kota_onovy: actually, not packed14:46
acolesI didnt think it was any more14:47
onovykota_: it's14:47
onovyif i install python-pyeclib from debian/sid, get_versions says i have 1.2.0 version14:47
kota_onovy: pyeclib just refers the liberasurecode_version.h which is installed at liberasurecode installation14:47
onovyeven i have liberasurecode version 1.3.114:47
onovyno :)14:47
onovypyeclib refers liberasurecode_version.h, which is DURING BUILD read14:47
onovyso if i have binary distribution of pyeclib, i have packed version14:48
kota_onovy: exacctly it's better to refer the actual version from .so lib which is used by pyeclib14:48
onovypyeclib_c is build during package build14:48
onovyright :)14:48
*** dmorita has joined #openstack-swift14:48
onovyis it possible to fix it? :)14:48
kota_yes, add the functionality to liberasurecode and then make pyeclib to use it.14:49
onovyyep, there aren't ABI inside liberasurecode, right?14:49
onovy(for version read)14:49
*** sams-gleb has quit IRC14:49
kota_onovy: however, probably it will make hard version constraint for us like recent isa-l issues14:50
*** sams-gleb has joined #openstack-swift14:50
kota_onovy: so that, I'm now pending it to decide how we should handle the version limitation.14:50
kota_s/to decide/until deciding/14:51
onovymake function inside liberasurecode for "gimme version"14:51
kota_yes14:51
onovypyeclib_c will ask this function14:51
mahatic_acoles: kota_ onovy rebuilding pyeclib fixed it, thanks!14:51
onovyand check constrains14:51
kota_onovy: yeah14:51
onovybecause using .h can cause big problems14:51
kota_mahatic_: congrats14:51
onovylike mahatic_ now had14:51
kota_i think i had description for the constraint on the 1.3.1-ish commit log...14:52
*** dmorita has quit IRC14:52
onovykota_: sry i must go now. can we continue discussion later pls?14:53
acolesmahatic_: also when you next run any tox job you'll probably need to add the -r flag to reinstall pyeclib in the venvs14:53
*** sams-gleb has quit IRC14:54
kota_onovy: sure, could we make it in the next week? it's getting midnight in my timezone in Fri14:55
mahatic_acoles: oic14:55
kota_hmm... https://review.openstack.org/#/c/398744/ has not laned yet :/14:55
patchbotpatch 398744 - pyeclib - Add soft warning log line when using liberasurecod...14:55
mahatic_acoles: thank you, I could really use that info :)14:56
mahatic_kota_: yeah, I was looking for a patch like that, I think that needs to be landed14:56
*** hogepodge has joined #openstack-swift15:00
kota_k, JST is now in Sat, so leaving off from online15:01
kota_bye, enjoy everyone your weekend.15:01
* kota_ is going to offline15:01
*** hogepodge has quit IRC15:05
openstackgerritMerged openstack/swift: Fixed regression in consolidate_hashes  https://review.openstack.org/40133015:09
mahatic_kota_: good night, have a nice weekend15:12
*** Jeffrey4l has joined #openstack-swift15:14
*** sams-gleb has joined #openstack-swift15:17
*** rcernin has quit IRC15:17
*** openstackgerrit has quit IRC15:18
*** openstackgerrit has joined #openstack-swift15:19
*** ppai has quit IRC15:21
*** rcernin has joined #openstack-swift15:22
*** rcernin has quit IRC15:30
openstackgerritFlavio Percoco proposed openstack/swift-bench: Show team and repo badges on README  https://review.openstack.org/40285015:38
openstackgerritFlavio Percoco proposed openstack/python-swiftclient: Show team and repo badges on README  https://review.openstack.org/40285315:38
*** asettle has quit IRC15:38
openstackgerritFlavio Percoco proposed openstack/swift: Show team and repo badges on README  https://review.openstack.org/40285615:39
openstackgerritFlavio Percoco proposed openstack/swift-specs: Show team and repo badges on README  https://review.openstack.org/40285915:40
*** bkopilov has joined #openstack-swift15:58
*** admin6 has left #openstack-swift15:59
*** cbartz has joined #openstack-swift16:01
*** geaaru has quit IRC16:34
*** thebloggu has joined #openstack-swift16:42
*** PavelK has joined #openstack-swift16:42
*** PavelK has quit IRC16:48
*** links has joined #openstack-swift16:51
*** rledisez has quit IRC17:10
*** Jeffrey4l has quit IRC17:12
*** links has quit IRC17:15
*** delewis has joined #openstack-swift17:21
*** hogepodge has joined #openstack-swift17:24
*** hseipp has quit IRC17:30
*** pcaruana has quit IRC17:33
*** tqtran has joined #openstack-swift18:16
*** hseipp has joined #openstack-swift18:20
*** tqtran has quit IRC18:21
*** amoralej is now known as amoralej|off18:23
*** hseipp has quit IRC18:27
*** davideagle has quit IRC18:31
*** ChubYann has joined #openstack-swift18:47
*** acoles is now known as acoles_18:52
*** asettle has joined #openstack-swift19:06
*** cbartz has quit IRC19:11
*** hogepodge has quit IRC19:11
*** asettle has quit IRC19:25
*** dmorita has joined #openstack-swift19:48
*** dmorita has quit IRC19:53
*** thebloggu has quit IRC19:55
*** hogepodge has joined #openstack-swift20:08
*** hseipp has joined #openstack-swift20:30
*** silor has quit IRC20:34
*** hseipp has quit IRC21:09
*** vint_bra has quit IRC21:41
*** nikivi has joined #openstack-swift21:53
*** nikivi has quit IRC21:58
*** pavel has joined #openstack-swift21:59
*** tqtran has joined #openstack-swift22:17
pavelonovy: I can't understand why rsync runs more often after restarting replicator daemon (I mean BEFORE fix). Partitions are ordered randomly each replication cycle so I can't understand why there is "better" order when replicator restarted. Any idea?22:18
*** pavel is now known as PavelK22:18
*** tqtran has quit IRC22:22
*** PavelK has quit IRC22:23
*** PavelK has joined #openstack-swift22:30
*** PavelK has quit IRC22:31
*** catintheroof has joined #openstack-swift22:34
*** hogepodge has quit IRC22:40
*** nikivi has joined #openstack-swift22:43
*** hogepodge has joined #openstack-swift22:51
*** nikivi has quit IRC23:02
*** davideagle has joined #openstack-swift23:28
*** sams-gleb has quit IRC23:40
*** sams-gleb has joined #openstack-swift23:41
*** sams-gleb has quit IRC23:45

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!