Friday, 2016-07-22

*** hosanai has joined #openstack-swift00:02
*** ChanServ sets mode: +v hosanai00:02
*** diogogmt has quit IRC00:08
*** jamielennox is now known as jamielennox|away00:14
*** Suyi_ has quit IRC00:16
*** chromatin has quit IRC00:38
*** Suyi_ has joined #openstack-swift00:39
*** _JZ_ has joined #openstack-swift00:48
*** garthb has quit IRC00:52
notmynamewell this is a very interesting email. http://lists.openstack.org/pipermail/openstack-dev/2016-July/099816.html00:56
*** aagrawal has joined #openstack-swift00:56
*** abhitechie has joined #openstack-swift00:56
*** vint_bra has joined #openstack-swift00:57
*** jerrygb has joined #openstack-swift00:57
openstackgerritKota Tsuyuzaki proposed openstack/swift: Raise ValueError if empty value coming into encrypt_header_val  https://review.openstack.org/33700000:58
notmynameIMO very interesting take on the slow review problem and how it affects the 80% of contributors who aren't super active every day00:59
kota_good morning01:01
*** jerrygb has quit IRC01:02
*** vint_bra has quit IRC01:10
*** hosanai has quit IRC01:21
*** derekjhyang has joined #openstack-swift01:24
*** asettle has joined #openstack-swift01:39
*** asettle has quit IRC01:44
*** vint_bra has joined #openstack-swift01:46
*** vint_bra has quit IRC01:47
*** hosanai has joined #openstack-swift01:52
*** ChanServ sets mode: +v hosanai01:52
*** furlongm_ has quit IRC01:56
*** Jeffrey4l_ has joined #openstack-swift01:56
*** adu has joined #openstack-swift02:16
kota_thanks timburke for reviewing patch 329307 :-)02:17
patchbotkota_: https://review.openstack.org/#/c/329307/ - swift - Avoid docs warning: Duplicate explicit target name02:17
openstackgerritKota Tsuyuzaki proposed openstack/swift: EC Fragment Duplication - Foundational Global EC Cluster Support  https://review.openstack.org/21916502:18
*** vint_bra has joined #openstack-swift02:19
kota_oh, pokemon go has been launched in Japan :P02:20
MooingLemurmoar server overload? ;302:24
kota_MooingLemur: probably, right now someone cannot download anyway :/02:26
*** aagrawal has quit IRC02:26
*** abhitechie has quit IRC02:27
*** chromatin has joined #openstack-swift02:38
*** vint_bra has quit IRC02:42
*** vint_bra has joined #openstack-swift02:44
*** jerrygb has joined #openstack-swift02:50
*** adu has quit IRC02:51
openstackgerritMerged openstack/swift: Avoid docs warning: Duplicate explicit target name  https://review.openstack.org/32930702:54
*** esker has quit IRC02:56
*** adu has joined #openstack-swift02:57
*** StraubTW has joined #openstack-swift02:57
*** esker has joined #openstack-swift02:58
*** sudorandom has quit IRC02:59
*** esker has quit IRC03:12
*** fifieldt has quit IRC03:15
*** jerrygb has quit IRC03:19
*** adu has quit IRC03:21
*** esker has joined #openstack-swift03:32
*** asettle has joined #openstack-swift03:36
*** esker has quit IRC03:36
*** esker has joined #openstack-swift03:36
*** asettle has quit IRC03:40
*** garthb has joined #openstack-swift03:51
*** dmorita has quit IRC04:01
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873604:06
*** StraubTW has quit IRC04:08
*** dmorita has joined #openstack-swift04:13
*** dmorita has quit IRC04:13
*** dmorita_ has joined #openstack-swift04:13
*** esker has quit IRC04:16
*** esker has joined #openstack-swift04:19
*** furlongm has joined #openstack-swift04:26
*** siva_krish has joined #openstack-swift04:31
*** dmorita_ has quit IRC04:34
*** chromatin has quit IRC04:34
*** d0ugal has quit IRC04:34
*** d0ugal has joined #openstack-swift04:36
*** dmorita has joined #openstack-swift04:36
*** klrmn has quit IRC04:37
*** vint_bra has quit IRC04:40
*** psachin has joined #openstack-swift04:41
*** dmorita has quit IRC04:41
*** vint_bra has joined #openstack-swift04:42
*** furlongm has quit IRC04:47
*** esker has quit IRC04:47
*** flwang1 has quit IRC04:50
*** vint_bra has quit IRC04:51
*** _JZ_ has quit IRC04:53
*** ppai has joined #openstack-swift05:01
*** SkyRocknRoll has joined #openstack-swift05:05
*** dmorita has joined #openstack-swift05:06
*** esker has joined #openstack-swift05:07
*** dmorita has quit IRC05:10
*** wer has quit IRC05:10
*** wer has joined #openstack-swift05:11
*** esker has quit IRC05:12
*** ppai has quit IRC05:15
*** abhitechie has joined #openstack-swift05:52
*** abhinavtechie has joined #openstack-swift05:52
*** furlongm has joined #openstack-swift05:54
*** ppai has joined #openstack-swift06:03
*** asettle has joined #openstack-swift06:06
*** esker has joined #openstack-swift06:10
*** asettle has quit IRC06:12
*** esker has quit IRC06:14
*** Suyi_ has quit IRC06:15
*** esker has joined #openstack-swift06:30
*** esker has quit IRC06:35
*** aagrawal has joined #openstack-swift06:38
*** abhinavtechie has quit IRC06:42
*** abhitechie has quit IRC06:42
*** abhitechie has joined #openstack-swift06:42
*** tesseract- has joined #openstack-swift06:45
*** garthb has quit IRC06:49
*** Annoldhappy has joined #openstack-swift06:55
*** Annoldhappy has quit IRC06:57
*** trananhkma has joined #openstack-swift07:02
*** dmorita has joined #openstack-swift07:18
*** pcaruana has joined #openstack-swift07:18
*** dmorita_ has joined #openstack-swift07:19
*** dmorita has quit IRC07:19
*** rcernin has joined #openstack-swift07:20
*** d0ugal has quit IRC07:20
*** rledisez has joined #openstack-swift07:21
*** dmorita_ has quit IRC07:24
*** esker has joined #openstack-swift07:32
*** esker has quit IRC07:36
*** maestropandy has joined #openstack-swift07:40
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844107:44
*** d0ugal has joined #openstack-swift07:52
*** natarej__ has joined #openstack-swift08:09
*** yarkot1 has quit IRC08:11
*** openstackgerrit has quit IRC08:11
*** a1|away has quit IRC08:11
*** early has quit IRC08:11
*** early has joined #openstack-swift08:11
*** sanchitmalhotra has quit IRC08:12
*** sanchitmalhotra has joined #openstack-swift08:12
*** a1|away has joined #openstack-swift08:12
*** brnelson has quit IRC08:12
*** natarej_ has quit IRC08:12
*** timur has quit IRC08:12
*** brnelson has joined #openstack-swift08:12
*** hoonetorg has quit IRC08:13
*** yarkot1 has joined #openstack-swift08:14
*** openstackgerrit has joined #openstack-swift08:14
*** timur has joined #openstack-swift08:17
*** hseipp has joined #openstack-swift08:27
*** mmcardle has joined #openstack-swift08:29
*** d0ugal has quit IRC08:30
*** gabor_antal has quit IRC08:34
*** esker has joined #openstack-swift08:44
*** esker has quit IRC08:48
*** gabor_antal has joined #openstack-swift08:49
*** asettle has joined #openstack-swift08:52
*** daemontool has joined #openstack-swift08:54
*** hosanai has quit IRC09:02
*** flwang1 has joined #openstack-swift09:02
openstackgerritEllen Leahy proposed openstack/swift: Added quotes to example echo in swift-temp-url  https://review.openstack.org/34532509:16
*** esker has joined #openstack-swift09:20
*** d0ugal has joined #openstack-swift09:22
*** esker has quit IRC09:24
*** asettle has quit IRC09:27
*** asettle has joined #openstack-swift09:28
*** asettle has quit IRC09:28
*** asettle has joined #openstack-swift09:29
*** acoles_ is now known as acoles09:32
*** siva_krish has quit IRC09:39
acolestimburke: did I not vote?! so you see how torn up I was :)09:39
acoleskota_: pokemon go launched in uk last week - now my son has a reason to walk the dog :)09:42
acolesnotmyname: I keep my laptop for dev and run my SAIO's on other hardware under my desk, although I do run them in VMs09:46
*** acoles is now known as acoles_10:12
*** mahatic_ has joined #openstack-swift10:25
*** mahatic has quit IRC10:25
*** asettle has quit IRC10:33
*** daemontool has quit IRC10:33
*** asettle has joined #openstack-swift10:33
*** daemontool has joined #openstack-swift10:34
*** daemontool has quit IRC10:35
*** acoles_ is now known as acoles10:41
*** d0ugal has quit IRC10:54
openstackgerritzheng yin proposed openstack/swift: Jugde container-name length  https://review.openstack.org/34480711:07
*** trananhkma has quit IRC11:07
*** cdelatte has joined #openstack-swift11:07
*** gabor_antal has quit IRC11:24
*** adu has joined #openstack-swift11:27
*** adu has quit IRC11:29
*** esker has joined #openstack-swift11:33
*** daemontool has joined #openstack-swift11:34
*** esker has quit IRC11:37
*** esker has joined #openstack-swift11:53
*** esker has quit IRC11:57
*** aagrawal has quit IRC12:01
*** abhitechie has quit IRC12:01
*** chromatin has joined #openstack-swift12:03
*** asettle has quit IRC12:04
*** asettle has joined #openstack-swift12:14
*** kei_yama has quit IRC12:15
*** adu has joined #openstack-swift12:17
openstackgerritMerged openstack/swift: Add log format to i18n  https://review.openstack.org/34405612:40
*** esker has joined #openstack-swift12:40
*** maestropandy has quit IRC12:40
*** ppai has quit IRC12:42
*** adu has quit IRC12:45
*** esker has quit IRC12:45
*** esker has joined #openstack-swift12:46
*** d0ugal has joined #openstack-swift12:48
*** NM has joined #openstack-swift12:48
*** acoles is now known as acoles_12:55
*** acoles_ is now known as acoles13:02
*** esker has quit IRC13:15
*** donagh has joined #openstack-swift13:16
openstackgerritEllen Leahy proposed openstack/swift: Added quotes to example echo in swift-temp-url  https://review.openstack.org/34532513:18
*** SkyRocknRoll has quit IRC13:22
*** StraubTW has joined #openstack-swift13:24
*** StraubTW has quit IRC13:24
*** StraubTW has joined #openstack-swift13:25
*** esker has joined #openstack-swift13:32
*** d0ugal has quit IRC13:33
*** dmorita has joined #openstack-swift13:35
*** sudorandom has joined #openstack-swift13:36
*** sudorandom has quit IRC13:38
*** diogogmt has joined #openstack-swift13:38
donaghacoles: similar pokemon go experience with my daughter. She walked 5k in one day. Getting worried though -- there are something like 140 pokemons, and shes up to 65 already13:38
*** dmorita has quit IRC13:40
*** jordanP has joined #openstack-swift13:50
acolesdonagh: the last few may be as rare as a sunny day in galway ;)13:50
*** sudorandom has joined #openstack-swift13:51
*** sudorandom has quit IRC13:52
admin6Hi there, Dummy question, does a "dispersion report" make sense for Erasure coding? and is the swift-dispersion-report compatible with Erasure coding (there is no way to specify a storage policy in dispersion.conf) ?13:54
openstackgerritMerged openstack/swift: Use more specific asserts in functional tests  https://review.openstack.org/34276413:55
*** diogogmt has quit IRC14:00
*** sudorandom has joined #openstack-swift14:02
*** esker has quit IRC14:04
*** chromatin has quit IRC14:05
openstackgerritSwapnil Kulkarni (coolsvap) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844114:22
*** esker has joined #openstack-swift14:23
donaghadmin6: It appears to work with EC. You need to use -P option to "point" at the storage policy14:23
admin6donagh: Ok thanks I’ll have a look, but option -P doesn’t seem to be documented.14:25
*** diogogmt has joined #openstack-swift14:26
admin6donagh: It works fine, one more happy guy one the earth thanks to you :-)14:32
*** esker has quit IRC14:38
*** tanee is now known as tanee_away14:39
*** asettle has quit IRC14:39
*** esker has joined #openstack-swift14:41
*** siva_krish has joined #openstack-swift14:43
pdardeaugood morning14:54
acolespdardeau: good morning14:57
pdardeaugood morning acoles14:59
*** nadeem has joined #openstack-swift14:59
*** StraubTW_ has joined #openstack-swift15:03
acolespdardeau: you were asking about the swift federation work we did in the past15:03
acolespdardeau: there is a very old write up here https://wiki.openstack.org/wiki/Swift/ClusterFederationBlueprint15:03
acolesclayg: you were asking me about that too ^15:04
acolespdardeau: last modified June 2013!15:04
pdardeauacoles: thanks!15:05
*** StraubTW has quit IRC15:05
acolespdardeau: we did implement it and there are some links to extremely old un-merged patches here https://blueprints.launchpad.net/swift/+spec/cluster-federation15:06
acolespdardeau: the only piece that got merged was generic sysmeta15:06
ntataclayg, will look into your patch and comments now.. Thanks for reviewing :)15:07
*** tesseract- has quit IRC15:09
*** jistr is now known as jistr|mtg15:09
tdasilvahello, i'm trying to remember how to run individual tests in functests and can't quite remember, anybody has any pointers?15:10
mahatic_tdasilva: nosetests?15:11
acolestdasilva: you can still use nosetests i think15:12
acolestdasilva: i often use the -m option to save typing the full test path15:12
tdasilvaacoles: yeah, i guess i´ll just switch to that...was trying to use ostestr15:13
tdasilvamahatic_: functests use ostestr by default instead of nosetests, i remember when we made the switch there was a regex way of running individual tests, but I forgot how to do it...15:13
mahatic_tdasilva: yeah I think timburke brought it up in the channel, he might know15:15
tdasilvanosetests test.functional.test_symlink worked!15:16
mahatic_ah you meant regex with nosetests? I thought using it explicitly with ostestr15:16
mahatic_yes nosetests /path works15:16
mahatic_acoles: hi, interesting - cluster federation info. I also stumbled onto this old blueprint - https://wiki.openstack.org/wiki/Swift-Improved-Object-Replicator -> would you know if it was ever considered?15:17
acolestdasilva: yeah i think you need a different syntax if you want to run a sungle test via the tox env15:17
*** jistr|mtg is now known as jistr15:17
ntatatdasilva, how about running via testr? testr init; testr run <path_to_funcTest>15:18
mahatic_acoles: oh well, nevermind I guess. now that we're going it have golang stuff it, that wouldn't be relevant I think15:19
mahatic_to have*15:19
acolestdasilva: ostestr --no-discover maybe? or --regex?15:20
tdasilvaacoles: tried both, didn't work15:21
acolestdasilva: hmmm, I guess that's why I still use nosetests ;)15:22
tdasilvaacoles: hehehe15:22
tdasilvayep15:22
acolesmahatic_: I had not seen that blueprint before - it is authored before my time with swift15:22
tdasilvawfm15:22
acolestdasilva: IIRC there is also no equivalent to nosetests -x with ostestr15:23
mahatic_acoles: oic15:23
mahatic_tdasilva: some doc on that http://docs.openstack.org/developer/os-testr/ostestr.html15:24
mahatic_there are some regex examples in there15:24
*** rcernin has quit IRC15:24
tdasilvamahatic_: i tried the example given: ostestr --no-discover test.test_thing.TestThing.test_thing_method15:25
tdasilvadidn't work for me15:25
*** siva_krish has left #openstack-swift15:25
*** ningliu has quit IRC15:27
*** ningliu^ has joined #openstack-swift15:27
mahatic_tdasilva: ostestr --no-discover test.functional.test_object.TestObject.test_container_write_only - this wfm15:28
*** ningliu^ is now known as ningliu15:28
tdasilvamahatic_: mmm..lemme try that15:29
*** bkeller` has quit IRC15:29
*** ntata has quit IRC15:29
*** kota_ has quit IRC15:29
*** bobby2_ has joined #openstack-swift15:30
*** nadeem has quit IRC15:30
tdasilvamahatic_: mm, that does work, but it fails in my symlinks tests, which means it probably has something to do with how symlinks are being setup...thanks for the pointer, will check that out15:30
mahatic_tdasilva: ah okay15:31
*** nadeem has joined #openstack-swift15:31
*** ctennis- has joined #openstack-swift15:31
*** ntata has joined #openstack-swift15:32
*** BAKfr_ has joined #openstack-swift15:33
*** garthb has joined #openstack-swift15:33
*** bkeller` has joined #openstack-swift15:33
*** bobby2 has quit IRC15:33
*** kota_ has joined #openstack-swift15:33
*** ChanServ sets mode: +v kota_15:33
*** ctennis has quit IRC15:35
*** BAKfr has quit IRC15:35
*** BAKfr_ is now known as BAKfr15:35
*** _JZ_ has joined #openstack-swift15:37
*** kota_ has quit IRC15:38
*** flwang1 has quit IRC15:39
*** greghaynes has quit IRC15:39
*** ouchkernel has quit IRC15:39
*** vern has quit IRC15:39
*** amit213 has quit IRC15:39
*** kmARC has quit IRC15:39
*** MooingLemur has quit IRC15:39
*** tristanC has quit IRC15:39
*** mmotiani_ has quit IRC15:39
*** Anticimex has quit IRC15:39
*** kota_ has joined #openstack-swift15:40
*** ChanServ sets mode: +v kota_15:40
notmynamegood morning15:41
*** Anticimex has joined #openstack-swift15:47
*** tristanC has joined #openstack-swift15:47
*** kmARC has joined #openstack-swift15:47
*** MooingLemur has joined #openstack-swift15:47
*** vern has joined #openstack-swift15:47
*** kota_ has quit IRC15:47
*** flwang1 has joined #openstack-swift15:47
*** mmotiani_ has joined #openstack-swift15:47
*** greghaynes has joined #openstack-swift15:48
*** amit213 has joined #openstack-swift15:48
*** ouchkernel has joined #openstack-swift15:48
*** pcaruana has quit IRC15:49
*** mmcardle has quit IRC15:49
*** psachin has quit IRC15:50
*** kota_ has joined #openstack-swift15:54
*** ChanServ sets mode: +v kota_15:54
*** daemontool_ has joined #openstack-swift15:54
*** mmcardle has joined #openstack-swift15:55
*** esker has quit IRC15:55
*** _JZ_ has quit IRC15:57
*** daemontool has quit IRC15:58
*** bill_az has joined #openstack-swift15:59
*** torgomatic has quit IRC16:00
*** psachin has joined #openstack-swift16:03
*** bill_az has quit IRC16:05
openstackgerritAlistair Coles proposed openstack/swift: Pass empty etag override values through encrypter  https://review.openstack.org/34610616:07
bkeller`has anyone had any issues with chef-zero erroring and interrupting the provisioning of the saio?16:07
*** garthb has quit IRC16:08
*** rledisez has quit IRC16:09
openstackgerritAlistair Coles proposed openstack/swift: Add test for copy using a Range header  https://review.openstack.org/32460716:15
*** jamielennox|away is now known as jamielennox16:16
*** jistr is now known as jistr|off16:16
*** jistr|off is now known as jistr16:17
*** david-lyle_ has joined #openstack-swift16:17
openstackgerritAlistair Coles proposed openstack/swift: Add test for copy using a Range header  https://review.openstack.org/32460716:20
*** hseipp has quit IRC16:22
*** david-lyle_ has quit IRC16:23
*** admin6 has quit IRC16:25
openstackgerritAlistair Coles proposed openstack/swift: Copy headers correctly when copying object  https://review.openstack.org/27272416:28
bkeller`well, turned out vagrant <= 1.8.1 (possibly 1.8.3) were broken and brew didn't know about newer ones :(, not that i know how it was working for me before though16:30
*** psachin has quit IRC16:34
timburkegood morning16:36
*** garthb has joined #openstack-swift16:38
*** dmorita has joined #openstack-swift16:39
openstackgerritAlistair Coles proposed openstack/swift: Cache fragment size for EC policy  https://review.openstack.org/34512016:45
*** Suyi_ has joined #openstack-swift16:51
*** dmorita has quit IRC16:51
*** dmorita has joined #openstack-swift16:58
*** klrmn has joined #openstack-swift17:02
*** mmcardle has quit IRC17:16
*** chsc has joined #openstack-swift17:20
*** geaaru has joined #openstack-swift17:22
*** daemontool_ has quit IRC17:24
*** acoles is now known as acoles_17:27
*** dmorita has quit IRC17:33
*** arch-nemesis has joined #openstack-swift17:35
*** abhitechie has joined #openstack-swift17:36
*** aagrawal has joined #openstack-swift17:36
*** dmorita has joined #openstack-swift17:38
*** tqtran has joined #openstack-swift17:46
*** dmorita has quit IRC17:48
*** tqtran_ has joined #openstack-swift17:48
*** tqtran has quit IRC17:50
*** Jeffrey4l_ has quit IRC17:57
*** itlinux has joined #openstack-swift18:01
*** zul_ has quit IRC18:06
openstackgerritMerged openstack/swift: Update dnspython to 1.14  https://review.openstack.org/33534718:08
claygheyoh!18:09
*** zul has joined #openstack-swift18:09
claygbkeller`: there was this for awhile -> https://github.com/swiftstack/vagrant-swift-all-in-one/issues/3818:10
bkeller`oh ok18:11
bkeller`i had been using the 12.10 workaround before but i never saw that issue thread18:11
claygi guess vagrant made a fix, so I just upgraded and closed the issue - I might could have considered maybe adding something to the vagrant file to complain about the bad vagrant versions?18:11
claygbkeller`: yeah I didn't really want to pin the chef version like that... maybe I *did* add the 'stable' thing to the vagrant file?  oh, but I guess my comment says that didn't work either18:12
bkeller`part of it was that i was expecing brew to know about the newer version18:12
claygthe point is old vagrant was stupid and it worked because chef was mostly stable, newer vagrant is sane18:12
claygyou install vagrant with brew?  I always just install from downloadds :\18:12
bkeller`i install everything with brew if i can :p18:13
*** mmcardle has joined #openstack-swift18:15
*** dmorita has joined #openstack-swift18:16
*** dmorita has quit IRC18:18
claygwhat's the impact of patch 346106 - there's no associated bug?18:19
patchbotclayg: https://review.openstack.org/#/c/346106/ - swift - Pass empty etag override values through encrypter18:19
claygseems to follow up on patch 337000 - which acoles_ apparently doens't like - but again, there's no associated bug?18:20
patchbotclayg: https://review.openstack.org/#/c/337000/ - swift - Raise ValueError if empty value coming into encryp...18:20
*** abhitechie has quit IRC18:21
*** david-lyle_ has joined #openstack-swift18:21
claygI'd really like to get a handle on known issues with encryption sometime early next week and figure out what we can fix and what if anything we'll just be living with for awhile?18:21
*** aagrawal has quit IRC18:21
openstackgerritThiago da Silva proposed openstack/swift: Symlink implementation.  https://review.openstack.org/23216218:22
*** can8dnSix has joined #openstack-swift18:23
*** dmorita has joined #openstack-swift18:25
*** david-lyle_ has quit IRC18:25
notmynameclayg: time until "bug: I can't read the on-disk data in an encrypted cluster" in 3..2..18:26
claygI just typed "patch 232162" into my chrome and stupid patchbot didn't turn it into a url?18:27
patchbotclayg: https://review.openstack.org/#/c/232162/ - swift - Symlink implementation.18:27
claygweek18:27
*** mmcardle has quit IRC18:28
tdasilvaclayg: hi, i just marked as wip as there's still some work to get done (see TODOs), but would love to hear some early feedback18:28
timburketdasilva: should we make that object-server change symlink-agnostic? ie, just always return all sysmeta headers?18:28
tdasilvatimburke: for now, i've gone with the idea of adding a little knowledge there in a POST request, but I don't think it is set in stone that it is the best approach18:30
tdasilvatimburke: which one would you prefer? line 77 here https://etherpad.openstack.org/p/swift_symlinks you seemed to advocate for adding the change the in the POST handler18:32
tdasilvatimburke: somehow I convinced myself that returning the symlink header on a POST would be useful in reducing calls in the future for auto-tiering18:33
timburkeright, we definitely need to send *something* back on POST. i just don't like having an object server that needs to think about symlinks in particular -- i'd advocate sending all sysmeta back in the POST response, and letting middlewares sort out what's interesting18:33
tdasilvatimburke: oooohhh, i see18:33
tdasilvahad not thought of it that way18:33
*** dmorita has quit IRC18:34
*** manous has joined #openstack-swift18:35
tdasilvaneed to step away for a bit, be back alter18:36
*** nadeem has quit IRC18:39
*** manous has quit IRC18:42
*** zul has quit IRC18:44
*** dmorita has joined #openstack-swift18:45
claygdidn't cschwede have a follow up fix for lp bug #155875418:45
openstackLaunchpad bug 1558754 in OpenStack Object Storage (swift) "remove devices before min-part-hours requires --force" [Undecided,Confirmed] https://launchpad.net/bugs/1558754 - Assigned to Jethro Sun (shwsun)18:45
*** dmorita has quit IRC18:46
*** gyee has joined #openstack-swift18:46
cschwedeclayg: sure :) patch 32696718:47
patchbotcschwede: https://review.openstack.org/#/c/326967/ - swift - Rebalance with min_part_seconds_left > 018:47
claygi was just going to say I found it!  but thanks18:47
*** gyee has quit IRC18:50
*** gyee has joined #openstack-swift19:01
*** diogogmt has quit IRC19:13
*** diogogmt has joined #openstack-swift19:14
*** zul has joined #openstack-swift19:18
*** dmorita has joined #openstack-swift19:19
*** mmcardle has joined #openstack-swift19:20
*** dmorita has quit IRC19:20
jrichliclayg: I'll take a look at the 2 crypto patches you mentioned and will let you know my take on things, fwiw19:21
*** diogogmt has quit IRC19:24
claygjrichli: that would be spectacular!19:25
*** gyee has quit IRC19:25
*** diogogmt has joined #openstack-swift19:27
openstackgerritDavid Goetz proposed openstack/swift: go: make a rate limiter for account per disk/server  https://review.openstack.org/34621119:28
openstackgerritMerged openstack/swift: Cache fragment size for EC policy  https://review.openstack.org/34512019:29
*** mmcardle has quit IRC19:38
*** nadeem has joined #openstack-swift19:57
*** nadeem has quit IRC19:57
*** nadeem has joined #openstack-swift19:58
flwang1clayg: ping   more recon questions :)20:01
flwang1clayg: What do "object_expiration_pass" and "expired_last_pass" mean? What information do these attributes provide for object expirer ?20:01
flwang1when i call swift-recon --expirer20:01
flwang1anybody can help answer above questions will be really appreciate :) thanks20:03
claygflwang1: idk, something about object expirer obvs.  probably related to it's cycle time.  I don't really track 'em just cause I haven't had problems with that subsystem to my knowledge20:05
claygflwang1: I hear aerwin3 is all about making the object-expirer awesome - maybe he looks at those numbers?20:05
claygahale: do you track recon data for object-expirer?20:05
flwang1clayg: recently i spent much time on recon and i found it's very hard to find documents about recon20:06
flwang1or there are somewhere, but i didn't found?20:07
claygnah, this one guy wrote it this one time and I don't think he works on swift anymore - people sort of use some pieces of it in different ways20:08
flwang1clayg: i see. shouldn't it a part of api ref?20:09
flwang1at least some kind of 'api ref'20:09
flwang1and publish it in the developer docs20:09
notmynamejust cause syn isn't working on recon any more doesn't mean recon is useless20:09
claygflwang1: I like the json drops from the consistency daemons and hate everything else about recon - other people seem to like the recon middleware's ability to grab at the json drops and various other "on-demand" types of commands - even less people (but non-zero!) like the cli utility and try to beat it into less terrible every once and again20:09
notmynameflwang1: no, the API ref is for clients. no end user has any business even having access to recon, much less using it for anything20:10
claygI think ahale was telling me they've extended recon internally to some degree20:10
flwang1notmyname: yep, fair enough20:11
flwang1the background is we(catalyst cloud) is trying to leverage recon for cluster healther monitoring20:11
claygnotmyname: I wasn't trying to say it's *useless* - i was trying to say it came in together as a whole system but it wasn't entirely baked and various parts have been used and extended to different degress20:11
flwang1and we just found it's very hard to understand those metrics since there is almost no documents20:11
notmynameclayg: oh yeah. that. +120:11
clayganyway, it doesn't surpirse me that folks have a hard time groking all if, and that some parts seem to be more useful than others20:12
notmynameflwang1: it's a good start, and there's good stuff there. but it's incomplete by itself. you'll get more and better info from logs and statsd. probably best to use it all20:12
flwang1notmyname: yes, we do20:12
notmynameflwang1: TBH when someone (like you) comes and asks about the metrics, I've got to go to the code to see what it means20:13
flwang1i have "done" most of the recon metrics, except the auditor and expirer20:13
flwang1notmyname: i see, i'm trying to do the same thing, but because i'm not a swift/object storage guy, so reading swift code is not easy for me, especially it has different architecture than the others :)20:14
flwang1i know it's a shame to ask this kind of questions as an openstack developers :(20:15
notmynameflwang1: oh yeah, I totally get that my main advantage is knowing where in the code to look. I'm just sympathizing with you on the lack of docs20:15
flwang1notmyname: got it20:15
notmynameflwang1: catalyst as in NZ as in Bruno Lago?20:15
flwang1notmyname: exactly :)20:16
notmynameok, thanks. (there are several catalysts out there)20:16
flwang1he is my manager and im the lead of dev20:16
notmynameoh, cool20:16
*** dmorita has joined #openstack-swift20:17
flwang1we're a small team, so basically except glance and zaqar, i have to play with every projects, include swift :D20:17
claygsigh, the problem with documenting it is that we'll probably be expected to keep it working - and some of it I'm not even sure if it's useful :'(20:17
flwang1but i found swift is the hardest one for me, TBH20:17
flwang1clayg: i agree with you here20:18
claygi *kinda* feel the same way about some of our statsd metrics - and I'm scared to add more that I think *might* be useful because I'm scared that I can't take them out :'(20:18
flwang1from the ops view, we would like to see an api like '/health'20:18
flwang1just like we did in Zaqar20:18
claygwe need to like scour all of telemetry and upvote our favorites then schedule some for deprecation then add some more and see how they go!20:18
flwang1it can tell you if the cluster is in a healthy status or not20:19
flwang1at least in a general level20:19
flwang1clayg: +120:19
pdardeauflwang1: can you provide an example (including the specifics) of what you would want to have come back from '/health'?20:19
claygI'd love to add my per device primary/handoff part counts to a recon drop from the replicator (instead of having my node agent do the same listdirs, and load the rings into his process) - but it's just as easy to do it out of band20:19
flwang1and remember the DocImpact tag when you review it :D20:19
claygflwang1: is Zaqar's /health api well documented?  maybe pdardeau could just copy it?20:20
flwang1clayg: it's a part of api-ref :)20:20
claygthat's sound *nothing* like the way I'd like to move with Swift telemetry20:21
flwang1see an example http://docs-draft.openstack.org/30/341930/3/check/gate-zaqar-api-ref/0e95cf8//api-ref/build/html/?expanded=health-detail20:21
timburkeclayg: jrichli: fwiw, my read on those two patches is that they seem reasonable, but they're more guards for future-us than fixing a bug20:21
pdardeauflwang1: this one? https://wiki.openstack.org/wiki/Zaqar/specs/api/v1#Check_Node_Health20:21
flwang1sorry, our api-ref hasn't been a part of the api ref on docs.openstack.org20:21
flwang1pdardeau: that's is old version, we have rename it as /ping, and in v2 we have a new api named /health20:22
*** david-lyle_ has joined #openstack-swift20:22
flwang1see above link i pasted20:23
claygtimburke: thanks20:23
flwang1it's most like /recon20:23
pdardeauflwang1: got it, saw the link right after i posted question20:23
claygpdardeau: here I guess http://docs-draft.openstack.org/30/341930/3/check/gate-zaqar-api-ref/0e95cf8//api-ref/build/html/?expanded=health-detail#health-health20:23
flwang1but it's more intuitive20:23
pdardeauflwang1: do you have an idea of which metrics/indicators you would expect in response?20:24
flwang1i think recon is a good tool/api, whatever we call it20:24
claygflwang1: I think it's just got more signal to noise, it seems designed around the idea that the entire storage layer might be "down" - swift doesn't really fail like that20:24
flwang1but from the ops view, we just found it's a little bit hard to leverage it for cluster health, though i know dispersion is another one i can use as well20:25
flwang1clayg: i know. but i think swift has done a great job to monitor itself, that's missing in most of other openstack projects20:26
flwang1IMHO, the service should be able to monitor itself from inside20:26
claygflwang1: if you come up with *the* set of guages that can say if a swift cluster is healthy or not ... you'd have one up on basically everyone in this channel20:27
claygmonitoring swift is a bit like readig the matrix - it's not by design - but as a highly available system things break in obscure ways that aren't obviously impactful... until they are20:27
*** david-lyle_ has quit IRC20:28
flwang1clayg: i can see your point, so why not just let everyone in the channel to contribute a *key* indicator to the /health api?20:28
notmynameisn't that called `git review`? ;-)20:28
flwang1notmyname: yes :D20:28
claygflwang1: mainly because there's no single node in a cluster that would have a *key* metric - it's a component of a higher order view :\20:29
flwang1actually, i really like the design/arch of swift, since it can monitor itself20:29
notmynameclayg: like the stories we get where the ops guy thought swift was a little slower, and then realized there was a whole rack of gear offline. but customers hadn't noticed yet20:29
claygwe could put everything behind an api - but then you're getting into the telemetry pipline - which ops to be somewhat opinionated on20:29
claygelk, statsd, collectl, graphite, graphana, collectd, recon drops to metrics, recon drops polled via api20:30
claygnotmyname: it's called doing it right ;)20:30
claygI *totally* understand flwang1's situation tho - I think about it a lot - and sometimes I think the current upstream laissez faire approach to overall cluster health will be a road block at somepoint20:32
flwang1clayg: yep, like you mentioned above, it's very hard to monitor swift I would say :)20:32
claygthere's just lots of ways to slice it - we should get more prescriptive I think - documenting all of the existing recon api results is possibly not the solution to "making it easier to monitor swift"20:34
openstackgerritNandini Tata proposed openstack/swift: crazy idea to check output  https://review.openstack.org/34567420:34
claygfor my money - I'd start with statsd - you can get a lot of value out of those graphs and the metrics got documented at some point for some reason20:34
*** dmorita has quit IRC20:35
claygafter that some sort of partition placment monitoring is key - the old dispersion populate and dispersion reports are pretty good - but they need some additional reimaging IMHO (dfg had commented he was thinking about these) - I like our per-disk/server/cluster-wide primary/handoff part count metrics20:36
*** dmorita has joined #openstack-swift20:37
claygntata: please pull in as much of patch 345674 into patch 319387 as appropriate (if anything) and I'll abandon my patch20:38
patchbotclayg: https://review.openstack.org/#/c/345674/ - swift - crazy idea to check output20:38
patchbotclayg: https://review.openstack.org/#/c/319387/ - swift - swift-ring-builder output corrected for ipv620:38
ntataclayg, sure, thanks!20:39
claygwell spotted on ip/replicaiton ipv6 column width20:39
claygGL20:39
claygbefore you bring in the new test infrastructure you might try to trick someone else into looking at it?  I'm not 100% the "stub files" are a good way to handle assertions around dense formatted text - it does *sorta* seem better than trying to embed it in the soruces files - but... like I said - it's just a crazy idea20:40
claygntata: I also really do mostly hate that method extraction I tried to pull of in the refactoring - really the only good thing there is the unrolling of the device loops into a single traversal I think20:40
flwang1clayg: ok, i trust your vision for this20:40
claygflwang1: i'm just talking out the side of my neck20:40
flwang1i'm just trying to make some noise to let you guys be aware of this :)20:41
claygflwang1: you should catch a ride with mattoliverau to barcelona and we can brain storm about it with ahale !20:41
flwang1clayg: cool, we can talk it a bit20:41
flwang1and i will be barcelna20:41
flwang1so let's have a beer o'clock20:41
claygflwang1: much appreicated, it's something everyone operating swift has on their mind I think (and most people working on swift are at least to some degree involved in operations I still think?)20:42
flwang1clayg: yep, swift ops is as'dfdkafjkdsajfkndsakfdsf@$%^&*()20:43
claygwe're getting better at talking more about our operations tooling I think, but it's always a seperate effort to take the thing you hacked together to integrate with *your* environment and scratch *your* itch into a more broardly useful context :'(20:43
notmynameflwang1: oh, also mattoliverau is on the west island, so his time zone is pretty close to yours20:44
flwang1notmyname: oh, really? cool20:46
flwang1i will catch up him on monday, since now it's Sat morning ;)20:46
*** garthb has quit IRC20:51
*** dmorita has quit IRC21:05
*** cdelatte has quit IRC21:08
*** StraubTW_ has quit IRC21:13
*** StraubTW has joined #openstack-swift21:14
*** adu has joined #openstack-swift21:18
*** dmorita has joined #openstack-swift21:20
*** CaioBrentano has quit IRC21:26
notmynamealternate language TC resolution proposal https://review.openstack.org/#/c/346243/21:27
patchbotnotmyname: patch 346243 - governance - policy and process for alternate programming langu...21:27
*** NM has quit IRC21:28
claygnotmyname: did you just abandon the other one?21:33
notmynamemy first one?21:33
notmynameno, that got closed for me. or -2 or something21:33
*** dmorita has quit IRC21:34
notmynamehttps://review.openstack.org/#/c/339175/21:34
patchbotnotmyname: patch 339175 - governance - Limited Use of Alternate Programming Languages (Go)21:34
notmynamethat's the other open one21:34
notmynameit's not mine, so I can't do anythign with it21:34
openstackgerritNandini Tata proposed openstack/swift: crazy idea to check output  https://review.openstack.org/34567421:34
*** dmorita has joined #openstack-swift21:37
*** jamielennox is now known as jamielennox|away21:45
*** adu has quit IRC21:49
*** jordanP has quit IRC21:54
*** dmorita has quit IRC22:14
*** StraubTW has quit IRC22:18
*** dmorita has joined #openstack-swift22:19
*** garthb has joined #openstack-swift22:20
*** david-lyle_ has joined #openstack-swift22:25
*** dmorita has quit IRC22:28
*** david-lyle_ has quit IRC22:29
*** dmorita has joined #openstack-swift22:45
*** pgbridge has quit IRC22:49
*** torgomatic has joined #openstack-swift22:49
*** ChanServ sets mode: +v torgomatic22:49
*** adu has joined #openstack-swift22:50
*** adu has quit IRC22:51
*** chsc has quit IRC22:59
*** nadeem has quit IRC23:01
*** chromatin has joined #openstack-swift23:31
*** dmorita has quit IRC23:47
*** dmorita has joined #openstack-swift23:50
*** dmorita has quit IRC23:50
*** dmorita_ has joined #openstack-swift23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!