Friday, 2015-05-29

*** lyrrad has quit IRC00:03
*** kutija has quit IRC00:04
MooingLemuror maybe it's the same fragment... but why doesn't it ever reconstruct?  Nothing's logged about it00:06
*** setmason has joined #openstack-swift00:16
MooingLemurit's missing two fragments, 0 and 10.00:16
*** gyee has quit IRC00:18
*** zhill_ has quit IRC00:19
*** remix_tj has quit IRC00:19
*** gyee has joined #openstack-swift00:25
*** zhill_ has joined #openstack-swift00:39
*** setmason_ has joined #openstack-swift00:39
*** setmason has quit IRC00:41
*** setmason_ is now known as setmason00:41
*** kota_ has joined #openstack-swift00:43
kota_morning00:43
*** annegentle has joined #openstack-swift00:45
*** SkyRocknRoll has quit IRC00:53
*** zhill_ has quit IRC00:59
*** charlesw has joined #openstack-swift01:02
*** annegentle has quit IRC01:03
*** asettle has quit IRC01:11
*** SkyRocknRoll has joined #openstack-swift01:19
*** blmartin has quit IRC01:32
*** blmartin_ has joined #openstack-swift01:32
*** setmason_ has joined #openstack-swift01:36
*** asettle has joined #openstack-swift01:37
*** setmason has quit IRC01:39
*** setmason_ is now known as setmason01:39
*** zackmdavis has left #openstack-swift01:55
*** kota_ has quit IRC01:56
*** proteusguy has quit IRC02:12
*** proteusguy has joined #openstack-swift02:23
*** wbhuber has quit IRC02:26
*** setmason has quit IRC02:31
*** lyrrad has joined #openstack-swift02:34
*** blmartin_ has quit IRC02:53
*** mwheckmann has joined #openstack-swift03:01
*** gyee is now known as operator9903:06
*** barra204 has quit IRC03:11
*** barra204 has joined #openstack-swift03:13
*** zhill_ has joined #openstack-swift03:17
*** zhill_ has quit IRC03:20
*** zhill has quit IRC03:45
*** zhill has joined #openstack-swift03:59
*** setmason has joined #openstack-swift04:00
*** mwheckmann has quit IRC04:08
*** proteusguy has quit IRC04:11
*** proteusguy has joined #openstack-swift04:14
*** janonymous has joined #openstack-swift04:15
*** kota_ has joined #openstack-swift04:19
*** asettle is now known as asettle-afk04:23
*** charlesw has quit IRC04:29
*** zhill has quit IRC04:34
*** SkyRocknRoll has quit IRC04:43
*** zhill has joined #openstack-swift04:46
*** zynisch_o7 has joined #openstack-swift04:48
*** setmason has quit IRC04:48
*** setmason has joined #openstack-swift04:50
*** Triveni has joined #openstack-swift04:55
MooingLemurclayg: I wonder if it was really broken all along when the ring wasn't properly dispersed for EC and that's when I uploaded those objects.05:15
MooingLemurbut I double-checked and made sure the current ring is good with validate_ec_ring_parts.py05:15
MooingLemurclayg: that's the only difference between the two containers I can think of (since one didn't lose anything)05:17
*** SkyRocknRoll has joined #openstack-swift05:27
*** SkyRocknRoll has joined #openstack-swift05:27
*** zynisch_o7 has quit IRC05:37
*** nadeem has joined #openstack-swift05:40
*** Triveni_ has joined #openstack-swift05:40
*** setmason_ has joined #openstack-swift05:40
*** peluse has quit IRC05:41
*** peluse has joined #openstack-swift05:42
*** setmason has quit IRC05:43
*** Triveni has quit IRC05:43
*** setmason_ has quit IRC05:46
cschwedeGood Morning!06:12
*** zackmdavis has joined #openstack-swift06:48
openstackgerritMerged openstack/swift: Remove simplejson from tests  https://review.openstack.org/18659006:57
mattoliveraucschwede: morning!07:02
*** leopoldj has joined #openstack-swift07:04
*** mmcardle has joined #openstack-swift07:16
*** asettle-afk is now known as asettle07:23
*** geaaru has joined #openstack-swift07:27
*** jistr has joined #openstack-swift07:38
*** bkopilov has quit IRC07:39
*** hseipp has joined #openstack-swift07:42
*** hseipp has quit IRC07:42
*** hseipp has joined #openstack-swift07:42
openstackgerritMerged openstack/python-swiftclient: Stop decoding object content  https://review.openstack.org/18465908:13
*** jordanP has joined #openstack-swift08:27
*** remix_tj has joined #openstack-swift08:29
*** nadeem has quit IRC08:45
*** silor has joined #openstack-swift09:24
*** km has quit IRC09:26
*** km has joined #openstack-swift09:31
*** aix has joined #openstack-swift09:41
*** acoles_away is now known as acoles09:44
*** km has quit IRC09:48
acolesjrichli clayg: "object-post-sysmeta" was the one i couldn't remember from yvr. thx!09:49
*** kei_yama has quit IRC09:50
*** bkopilov has joined #openstack-swift09:53
openstackgerritAlistair Coles proposed openstack/swift: Remove simplejson from staticweb  https://review.openstack.org/18617010:19
*** ppai has joined #openstack-swift10:29
openstackgerritChristian Schwede proposed openstack/swift: Ignore invalid PIDs in swift-init  https://review.openstack.org/18670310:31
*** asettle has quit IRC10:32
openstackgerritChristian Schwede proposed openstack/swift: Ignore invalid PIDs in swift-init  https://review.openstack.org/18670310:33
*** chenhuayi has joined #openstack-swift10:44
*** asettle has joined #openstack-swift10:46
*** SkyRocknRoll has quit IRC10:53
*** SkyRocknRoll has joined #openstack-swift10:53
*** aix has quit IRC10:54
*** chenhuayi has quit IRC11:08
*** cdelatte has quit IRC11:38
*** cdelatte has joined #openstack-swift11:39
*** aix has joined #openstack-swift11:45
*** silor has quit IRC11:56
*** aix has quit IRC12:06
*** aix has joined #openstack-swift12:08
*** Shimoda has joined #openstack-swift12:08
*** SkyRocknRoll has quit IRC12:09
openstackgerritChristian Schwede proposed openstack/swift: Ignore invalid PIDs in swift-init  https://review.openstack.org/18670312:11
openstackgerritKota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update  https://review.openstack.org/18673512:15
*** SkyRocknRoll has joined #openstack-swift12:17
openstackgerritKota Tsuyuzaki proposed openstack/swift: WIP: Fix missing container update  https://review.openstack.org/18673512:20
*** kota_ has quit IRC12:21
*** fthiagogv has joined #openstack-swift12:41
*** lpabon has joined #openstack-swift12:44
*** gsilvis has quit IRC12:50
*** SkyRocknRoll has quit IRC12:56
*** jkugel has joined #openstack-swift13:05
*** proteusguy has quit IRC13:10
*** lpabon has quit IRC13:12
tdasilvagood morning13:16
acolestdasilva: good morning13:19
*** zynisch_o7 has joined #openstack-swift13:22
*** proteusguy has joined #openstack-swift13:22
openstackgerritMerged openstack/swift: Remove simplejson from staticweb  https://review.openstack.org/18617013:23
*** silor has joined #openstack-swift13:25
*** annegentle has joined #openstack-swift13:29
*** gsilvis has joined #openstack-swift13:29
*** acampbel11 has joined #openstack-swift13:44
*** acampbell has joined #openstack-swift13:44
*** annegent_ has joined #openstack-swift13:44
*** annegentle has quit IRC13:45
*** gsilvis has quit IRC13:47
*** aix has quit IRC13:49
*** aix has joined #openstack-swift13:49
*** CaioBren_ has joined #openstack-swift13:52
*** mwheckmann has joined #openstack-swift13:54
*** lpabon has joined #openstack-swift13:54
*** jrichli has joined #openstack-swift13:56
*** CaioBrentano has quit IRC13:56
*** annegent_ has quit IRC13:57
*** jkugel has left #openstack-swift13:58
*** CaioBren_ has quit IRC14:00
*** charlesw has joined #openstack-swift14:03
*** SkyRocknRoll has joined #openstack-swift14:05
*** CaioBrentano has joined #openstack-swift14:05
*** acampbel11 has quit IRC14:07
*** acampbell has quit IRC14:07
*** ppai has quit IRC14:07
*** acampbell has joined #openstack-swift14:08
*** acampbel11 has joined #openstack-swift14:08
*** zynisch_o7 has quit IRC14:09
*** annegentle has joined #openstack-swift14:10
*** CaioBrentano has quit IRC14:13
*** CaioBrentano has joined #openstack-swift14:13
*** gsilvis has joined #openstack-swift14:15
openstackgerritChristian Schwede proposed openstack/swift-specs: Add object undelete spec  https://review.openstack.org/15542114:16
*** leopoldj has quit IRC14:17
*** breitz has quit IRC14:20
*** breitz has joined #openstack-swift14:21
*** gsilvis has quit IRC14:24
*** jistr has quit IRC14:26
*** acampbell has quit IRC14:31
*** acampbel11 has quit IRC14:31
zaitcevDoes anyone remember a time when someone submitted a humongous patch that swapped arguments in some kind of test assertion? The justification was that testtools mandated that order. We declined it because unittest was the opposite.14:32
*** wbhuber has joined #openstack-swift14:32
cschwedezaitcev: yes, i remember swapping arguments in tests - iirc unittest prefers the default as first argument, because if the test fails it will print more details then. do you have a specific patch in mind?14:35
*** esker has joined #openstack-swift14:35
zaitcevcschwede: someone picked the bug "move to testtools" today, so I expect we'll see a patch soon.14:36
acoleszaitcev: cschwede : was it 'expected value first, actual value second'?14:36
cschwedezaitcev: ah, ok. interesting14:36
zaitcevI hit it before with this, note that py3 is still the same as always was, it's just testtools being incompatible for no reason - http://bugs.python.org/issue2079814:36
cschwedeacoles: yes, at least for unittest14:37
zaitcevbug is https://bugs.launchpad.net/bugs/1179009 - jelly is coming for us, guys14:38
openstackLaunchpad bug 1179009 in Trove "Use testtools for base test class" [Wishlist,In progress] - Assigned to Wu Wenxiang (wu-wenxiang)14:38
zaitcevit's not very important, I was just curious14:38
*** acampbell has joined #openstack-swift14:40
*** acampbel11 has joined #openstack-swift14:40
*** acampbel11 has quit IRC14:40
*** acampbell has quit IRC14:40
*** acampbell has joined #openstack-swift14:40
*** acampbel11 has joined #openstack-swift14:41
acoleszaitcev: you had a +2 on patch 177836 (thx!) but I needed to fix a trivial merge conflict, any chance you could vote again and get it landed?14:41
patchbotacoles: https://review.openstack.org/#/c/177836/14:41
zaitcevacoles: sure14:42
acoleszaitcev: thank you14:42
zaitcevacoles: that patch caused me to spend countless minutes in the bathroom pondering if I ought to bikeshed that  yield ''  or not. Really, there's no way for this to leak across the TCP connection, so fixing it obviously fixes something unrelated, like a bug in test suite.14:43
eikkeany cores willing to +2 trivial patches (cherry-picks) 181834 and 181836 ?14:45
*** jistr has joined #openstack-swift14:47
acoleszaitcev: hmmm, i was pretty sure that the yield '' was causing probe tests to fail, something about the implementation of readline in ssync_sender maybe14:50
zaitcevacoles: that's what I thought too14:50
zaitcevacoles: well, it's probably more tricky than just that... I suspect eventlet gets involved somehow by faking syscalls in an imperfect way14:51
*** acampbell111 has joined #openstack-swift14:51
acoleseikke: idk about other swift cores but I don't have +2 button on backport reviews14:52
acolesnotmyname: ^^ how do we get those landed??14:52
*** acampbel11 has quit IRC14:52
*** acampbell has quit IRC14:52
*** acampbell111 has quit IRC14:56
*** CaioBrentano has quit IRC14:57
*** charlesw_ has joined #openstack-swift14:57
*** CaioBrentano has joined #openstack-swift14:57
openstackgerritMark Seger proposed openstack/swift: make sure user is root  https://review.openstack.org/18677914:58
eikkeacoles: interesting14:58
*** CaioBren_ has joined #openstack-swift14:58
*** CaioBren_ has quit IRC14:59
*** charlesw has quit IRC14:59
acoleseikke: hopefully notmyname can shed some light on that14:59
*** charlesw_ is now known as charlesw14:59
*** esker has quit IRC14:59
*** annegentle has quit IRC14:59
*** acampbell has joined #openstack-swift15:00
*** acampbel11 has joined #openstack-swift15:00
*** esker has joined #openstack-swift15:00
*** CaioBre__ has joined #openstack-swift15:01
*** CaioBrentano has quit IRC15:02
*** hseipp has left #openstack-swift15:11
*** CaioBre__ has quit IRC15:17
*** jordanP has quit IRC15:23
*** CaioBrentano has joined #openstack-swift15:29
*** CaioBrentano has quit IRC15:29
*** annegentle has joined #openstack-swift15:30
*** blmartin has joined #openstack-swift15:31
*** CaioBrentano has joined #openstack-swift15:31
*** CaioBrentano has quit IRC15:34
*** lyrrad has quit IRC15:36
*** gyee has joined #openstack-swift15:41
*** annegentle has quit IRC15:42
*** annegentle has joined #openstack-swift15:43
*** kutija has joined #openstack-swift15:46
cschwedeacoles: eikke: only PTLs and the stable maintainers can +2/approve patches on stable branches15:46
acolescschwede: ok. that explains. thx!15:46
openstackgerritMerged openstack/swift: Make SSYNC receiver return a reponse when initial checks fail  https://review.openstack.org/17783615:47
openstackgerritMerged openstack/swift: Remove _ensure_flush() from SSYNC receiver  https://review.openstack.org/17783715:50
*** nadeem has joined #openstack-swift15:56
*** nadeem has quit IRC15:56
*** jistr has quit IRC15:58
*** theanalyst has quit IRC15:58
*** SkyRocknRoll has quit IRC15:59
*** annegentle has quit IRC16:01
*** lyrrad has joined #openstack-swift16:02
*** theanalyst has joined #openstack-swift16:02
*** jistr has joined #openstack-swift16:06
*** jistr has quit IRC16:09
*** acoles is now known as acoles_away16:30
*** hseipp has joined #openstack-swift16:34
*** hseipp has quit IRC16:35
*** hseipp has joined #openstack-swift16:35
*** SkyRocknRoll has joined #openstack-swift16:35
notmynamegood morning16:36
*** SkyRocknRoll has quit IRC16:36
notmynameeikke: acoles_away: patch 18183416:37
patchbotnotmyname: https://review.openstack.org/#/c/181834/16:37
notmynamepatch 18183616:37
patchbotnotmyname: https://review.openstack.org/#/c/181836/16:37
notmynameI'll look at those and land as appropriate. seeing all the core +1s, it shouldn't be a problem16:38
*** silor has quit IRC16:38
*** esker has quit IRC16:38
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925016:42
*** SkyRocknRoll has joined #openstack-swift16:42
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873616:43
*** acoles_away is now known as acoles16:43
acolesnotmyname: thx16:43
*** lpabon has quit IRC16:44
*** charlesw has quit IRC16:45
*** charlesw has joined #openstack-swift16:45
*** acoles is now known as acoles_away16:50
*** lpabon has joined #openstack-swift16:50
*** lpabon has quit IRC16:54
notmynameacoles_away: eikke: done16:59
notmynamethanks for bringing it to my attention16:59
*** lyrrad has quit IRC17:04
*** Fin1te has joined #openstack-swift17:07
*** Shimoda has quit IRC17:09
*** Fin1te has quit IRC17:12
*** barra204 has quit IRC17:26
openstackgerritChristian Schwede proposed openstack/swift-specs: Add object undelete spec  https://review.openstack.org/15542117:28
*** aix has quit IRC17:31
*** CaioBrentano has joined #openstack-swift17:41
*** geaaru has quit IRC17:43
*** annegentle has joined #openstack-swift17:45
openstackgerritMerged openstack/swift: X-Auth-Token should be a bytestring.  https://review.openstack.org/18183417:49
openstackgerritMerged openstack/swift: X-Auth-Token should be a bytestring.  https://review.openstack.org/18183617:49
claygjrichli: sorry - got caught up in a issue or two yesterday - when you get online, try me again to look into those test failures for encryption18:07
*** barra204 has joined #openstack-swift18:08
*** annegentle has quit IRC18:08
*** annegentle has joined #openstack-swift18:09
*** lyrrad has joined #openstack-swift18:09
*** Fin1te has joined #openstack-swift18:10
jrichliclayg: thanks.  i gotta give a phone interview now18:13
claygjrichli: yeah i hear ya :(18:14
claygjrichli: er... I mean - good luck!  hope you catch a good one!18:14
*** barra204 has quit IRC18:15
jrichlilol :-)18:15
*** lpabon has joined #openstack-swift18:16
*** barra204 has joined #openstack-swift18:19
*** lpabon has quit IRC18:21
*** barra204_ has joined #openstack-swift18:27
*** barra204 has quit IRC18:31
*** hseipp has left #openstack-swift18:34
*** SkyRocknRoll has quit IRC18:34
*** annegentle has quit IRC18:41
*** lpabon has joined #openstack-swift18:48
*** barra204_ is now known as shakamunyi18:52
*** fthiagogv has quit IRC18:55
*** aix has joined #openstack-swift19:00
*** CaioBrentano has quit IRC19:03
*** CaioBrentano has joined #openstack-swift19:03
*** mmcardle has quit IRC19:04
*** B4rker has joined #openstack-swift19:10
*** silor has joined #openstack-swift19:16
*** acampbel11 has quit IRC19:32
*** acampbell has quit IRC19:32
*** lpabon has quit IRC19:37
*** silor has quit IRC19:37
*** CaioBrentano has quit IRC19:43
*** acampbell has joined #openstack-swift19:48
*** acampbel11 has joined #openstack-swift19:48
openstackgerritThiago da Silva proposed openstack/swift: versioned writes middleware  https://review.openstack.org/13434719:59
tdasilvazaitcev, clayg: ^^^ found a little bug concerning the 'allow_versioned_writes' flag, which is fixed now, overall I think it is good to go.20:01
zaitcevtdasilva: checking20:01
tdasilvaoh, I also added some more documentation to explain the whole idea of backwards compatibility and how in a future release the container flag would be deprecated...20:02
tdasilvazaitcev: thanks!20:02
*** bkopilov has quit IRC20:04
*** openstack has joined #openstack-swift20:06
*** tdasilva has quit IRC20:08
*** openstack has joined #openstack-swift20:31
*** Fin1te has quit IRC20:33
*** peluse has quit IRC20:40
*** acampbel11 has quit IRC20:41
*** acampbell has quit IRC20:41
*** peluse has joined #openstack-swift20:41
*** annegentle has joined #openstack-swift20:42
*** _bluev has joined #openstack-swift20:49
*** wbhuber has quit IRC20:55
*** Triveni_ has quit IRC20:56
*** charlesw has quit IRC20:56
*** openstackgerrit has quit IRC20:59
*** openstackgerrit has joined #openstack-swift20:59
*** annegentle has quit IRC21:17
*** jrichli has quit IRC21:24
*** shakamunyi has quit IRC21:26
*** lcurtis has joined #openstack-swift21:29
*** openstack has joined #openstack-swift21:32
lcurtishello all...question...if I have 3 replicas...two local and 1 at remote data center, and I lose both at local, will cluster pull from the remote when object is requsted?21:39
lcurtisand conversely, if i lose disk with 1 replica at the remote site, would it pull from my 'local' site?21:40
*** B4rker has quit IRC21:42
notmynameyes21:44
*** annegentle has joined #openstack-swift21:46
lcurtisnotmyname: would it automatically replicate or simply pull when requested?21:48
ctennisboth will happen, independent of each other21:50
ctennisGET requests will go to your 1 replica and continue going there until it is replicated elsewhere.  That may happen sometime later depending on how fast replication occurs.21:51
*** minwoob has quit IRC21:51
lcurtisctennis: thanks!21:57
*** blmartin has quit IRC22:13
*** annegentle has quit IRC22:18
*** annegentle has joined #openstack-swift22:20
*** mwheckmann has quit IRC22:24
*** lpabon has joined #openstack-swift22:28
*** aix has quit IRC22:39
*** annegentle has quit IRC22:40
openstackgerritDarrell Bishop proposed openstack/swift: Allow one object-server per disk deployment  https://review.openstack.org/18418922:42
*** lpabon has quit IRC22:42
*** B4rker has joined #openstack-swift22:43
swifterdarrellfor anyone following along at home, ^^^^^^^ consolidates my two patch sets and got marked WIP while I add the ability to do N workers per port22:45
swifterdarrellzaitcev: sure enough, benchmarking showed that more than one worker per port will be necessary to actually do better than "normal" when all disks are healthy22:46
*** josed has joined #openstack-swift22:48
zaitcevswifterdarrell: interesting22:56
swifterdarrellzaitcev: the approach will be to have the initial process inspect the config for the server_per_port option and additional server_per_port_worker_count (defaulting to something based on my benchmarking); I'm avoiding the existing worker count config var to avoid backwards compat biz and to ensure only adding server_per_port=True doesn't result in way too many processes22:58
zaitcevHmm...22:58
zaitcevYou know, I only noticed because we have too many confusing variables as it is.22:59
openstackgerritMerged openstack/swift: go: replace ghetto getpwnam with os/user  https://review.openstack.org/18363522:59
swifterdarrellzaitcev: that first process will then bind server_per_port_worker_count listen sockets for each port and then fire off the N workers (where N = drive_count * spp_worker_count), telling each worker which socket to actually use for accepting.22:59
swifterdarrellzaitcev: that first proc will then handle HUP/TERM, and process restarting (kind of like how my patch does now, where it knows which PIDs map to which port, which allows it to know which socket for a newly-forked child to listen on)23:00
zaitcevswifterdarrell: okay23:01
swifterdarrellzaitcev: anyway, it'll be AWESOME! you'll see!23:06
zaitcevswifterdarrell: bring it on!23:06
swifterdarrellzaitcev: and whatever my next patch I stand by is, it'll come with some solid numbers from a 2 beefy proxies + 10G network + 2 29-disk storage nodes (the best test platform I could put together on short notice)23:07
*** _bluev1 has joined #openstack-swift23:07
swifterdarrellzaitcev: still decent non-trivial bare-metal23:07
swifterdarrellzaitcev: learned that our guy who saw good results was in AWS and also was using 4 workers unix procs per disk (port); so I'm not dead in the water yet just because my initial numbers weren't great23:08
swifterdarrellzaitcev: (btw, latencies went slightly up w/server-per-port, but req/s was about even--so it wasn't very much worse either, which can't be said for thread_per_disk whcih I'm benchmarking right now and its req/s is way lower)23:09
swifterdarrellzaitcev: hope to have new patchset + numbers early next week23:09
*** _bluev has quit IRC23:09
zaitcevwait, wait, what thread_per_disk23:12
swifterdarrellzaitcev: WAT?  it's been in swift for a while23:16
swifterdarrellzaitcev: torgomatic added it23:16
swifterdarrellzaitcev: provides isolation for tarpit or otherwise hammered disks23:16
swifterdarrellzaitcev: but at the overhead of throwing all I/O calls through to a thread from a pool (with one threadpool per disk, in each object-server)23:17
swifterdarrellzaitcev: we'd planned for it to pretty much be able to be used all the time instead of "normal" style, but in practice overhead was too high (among other things the thread count is (drive_count * server_count * threads_per_disk) whcih can get quite high and thrash the kernel's scheduling23:18
zaitcevoh23:19
*** B4rker has quit IRC23:21
*** charlesw has joined #openstack-swift23:29
*** lcurtis has quit IRC23:31

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!