*** asettle has quit IRC | 00:02 | |
occupant | my first thought was writing cached data, but it still happens after doing a sync and having iostat zero out. | 00:05 |
---|---|---|
*** ppai has joined #openstack-swift | 00:07 | |
*** silor has joined #openstack-swift | 00:09 | |
*** silor has quit IRC | 00:14 | |
*** david-lyle has quit IRC | 00:16 | |
*** dmorita has quit IRC | 00:22 | |
*** dmorita has joined #openstack-swift | 00:24 | |
*** zhill has joined #openstack-swift | 00:26 | |
*** zul has quit IRC | 00:26 | |
*** silor has joined #openstack-swift | 00:28 | |
*** petertr7 is now known as petertr7_away | 00:31 | |
*** dmorita has quit IRC | 00:32 | |
*** zul has joined #openstack-swift | 00:37 | |
*** ppai has quit IRC | 00:40 | |
*** thurloat_isgone is now known as thurloat | 00:42 | |
*** dmorita has joined #openstack-swift | 00:45 | |
*** zul has quit IRC | 00:48 | |
swifterdarrell | torgomatic: +2 on https://review.openstack.org/#/c/180795/ if you can tweak those comments... | 00:56 |
*** wbhuber has joined #openstack-swift | 01:11 | |
*** haomaiwang has quit IRC | 01:13 | |
*** thurloat is now known as thurloat_isgone | 01:17 | |
*** silor has quit IRC | 01:48 | |
*** Fin1te has quit IRC | 01:53 | |
*** Fin1te has joined #openstack-swift | 02:04 | |
*** alejandrito has joined #openstack-swift | 02:04 | |
*** vjujjuri has quit IRC | 02:05 | |
*** wbhuber has quit IRC | 02:07 | |
*** wbhuber has joined #openstack-swift | 02:08 | |
*** petertr7_away is now known as petertr7 | 02:15 | |
*** minwoob has quit IRC | 02:26 | |
*** jkugel has joined #openstack-swift | 02:37 | |
*** jkugel has left #openstack-swift | 02:39 | |
*** wbhuber has quit IRC | 02:45 | |
*** Fin1te has quit IRC | 03:11 | |
*** silor has joined #openstack-swift | 03:23 | |
*** silor has quit IRC | 04:03 | |
*** proteusguy has joined #openstack-swift | 04:32 | |
*** vjujjuri has joined #openstack-swift | 04:42 | |
*** chlong_ has quit IRC | 05:03 | |
*** vjujjuri_ has joined #openstack-swift | 05:15 | |
*** chlong_ has joined #openstack-swift | 05:16 | |
*** vjujjuri has quit IRC | 05:17 | |
*** vjujjuri_ is now known as vjujjuri | 05:17 | |
*** harlowja has joined #openstack-swift | 05:25 | |
*** yuan has joined #openstack-swift | 05:36 | |
*** harlowja has quit IRC | 05:37 | |
*** harlowja has joined #openstack-swift | 05:42 | |
*** harlowja has quit IRC | 05:56 | |
*** chlong_ has quit IRC | 06:09 | |
*** zul has joined #openstack-swift | 06:16 | |
*** haomaiwang has joined #openstack-swift | 06:29 | |
*** chlong has joined #openstack-swift | 06:31 | |
*** nadeem has joined #openstack-swift | 06:36 | |
*** proteusguy has quit IRC | 06:47 | |
*** vjujjuri has quit IRC | 06:51 | |
*** vinsh has joined #openstack-swift | 06:52 | |
*** vinsh has quit IRC | 06:56 | |
*** proteusguy has joined #openstack-swift | 07:00 | |
openstackgerrit | Takashi Kajinami proposed openstack/swift: Ensure update of the container by object-updater https://review.openstack.org/99598 | 07:08 |
*** jistr has joined #openstack-swift | 07:18 | |
*** chlong has quit IRC | 07:37 | |
*** haigang has joined #openstack-swift | 07:49 | |
*** admin6 has joined #openstack-swift | 07:53 | |
*** geaaru has joined #openstack-swift | 08:07 | |
*** petertr7 is now known as petertr7_away | 08:24 | |
*** jyoti-ranjan has joined #openstack-swift | 08:43 | |
*** jyoti-ranjan has quit IRC | 08:44 | |
*** jyoti-ranjan has joined #openstack-swift | 08:45 | |
*** jyoti-ranjan has joined #openstack-swift | 08:54 | |
*** nadeem has quit IRC | 09:06 | |
*** aix has joined #openstack-swift | 09:29 | |
*** haigang has quit IRC | 09:41 | |
*** haomaiwang has quit IRC | 09:50 | |
*** mlima has quit IRC | 10:05 | |
*** NM has joined #openstack-swift | 10:17 | |
*** vinsh has joined #openstack-swift | 10:29 | |
*** vinsh has quit IRC | 10:34 | |
*** haomaiwa_ has joined #openstack-swift | 10:39 | |
*** petertr7_away is now known as petertr7 | 11:04 | |
*** knl has joined #openstack-swift | 11:08 | |
*** km has quit IRC | 11:09 | |
*** petertr7 is now known as petertr7_away | 11:14 | |
*** kei_yama has quit IRC | 11:21 | |
*** alejandrito has quit IRC | 11:27 | |
*** aix has quit IRC | 11:42 | |
*** SkyRocknRoll has joined #openstack-swift | 11:42 | |
*** SkyRocknRoll has joined #openstack-swift | 11:42 | |
*** NM has quit IRC | 11:55 | |
*** aix has joined #openstack-swift | 12:13 | |
*** vinsh has joined #openstack-swift | 12:18 | |
*** vinsh has quit IRC | 12:23 | |
*** alejandrito has joined #openstack-swift | 12:39 | |
*** SkyRocknRoll has quit IRC | 12:42 | |
*** SkyRocknRoll has joined #openstack-swift | 12:42 | |
*** SkyRocknRoll has joined #openstack-swift | 12:42 | |
*** alejandrito has quit IRC | 12:44 | |
*** wbhuber has joined #openstack-swift | 12:44 | |
*** SkyRocknRoll has quit IRC | 12:46 | |
*** SkyRocknRoll has joined #openstack-swift | 12:46 | |
*** alejandrito has joined #openstack-swift | 12:47 | |
*** wbhuber has quit IRC | 12:49 | |
*** chlong has joined #openstack-swift | 12:58 | |
openstackgerrit | Tim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks https://review.openstack.org/184479 | 13:09 |
timburke | torgomatic: ^^^fyi, the SLO thing we were talking about last night | 13:10 |
*** minwoob has joined #openstack-swift | 13:13 | |
*** chlong has quit IRC | 13:14 | |
*** chlong has joined #openstack-swift | 13:31 | |
*** silor has joined #openstack-swift | 13:32 | |
*** annegentle has joined #openstack-swift | 13:49 | |
glange | clayg: how did you guys performance test the golang object server? | 13:51 |
*** blmartin has joined #openstack-swift | 13:54 | |
*** nadeem has joined #openstack-swift | 13:58 | |
*** fthiagogv has joined #openstack-swift | 14:01 | |
*** vjujjuri has joined #openstack-swift | 14:03 | |
openstackgerrit | Yosef Moatti proposed openstack/swift: Initial implementation for the storlets spec https://review.openstack.org/184502 | 14:10 |
openstackgerrit | pradeep kumar singh proposed openstack/swift: Modify internal_client so that it reads the response if response status is not 200. https://review.openstack.org/183899 | 14:31 |
*** NM has joined #openstack-swift | 14:38 | |
*** zul has quit IRC | 14:42 | |
*** haomaiwa_ has quit IRC | 14:44 | |
*** nadeem has quit IRC | 14:45 | |
*** nadeem has joined #openstack-swift | 14:46 | |
*** silor has quit IRC | 14:50 | |
*** vjujjuri has quit IRC | 14:58 | |
*** annegentle has quit IRC | 15:00 | |
*** vinsh has joined #openstack-swift | 15:08 | |
*** NM has quit IRC | 15:09 | |
*** SkyRocknRoll has quit IRC | 15:12 | |
*** csd__ has joined #openstack-swift | 15:17 | |
*** lpabon has joined #openstack-swift | 15:18 | |
*** csd__ has quit IRC | 15:22 | |
*** lpabon has quit IRC | 15:29 | |
*** InAnimaTe has quit IRC | 15:34 | |
*** vinsh has quit IRC | 15:40 | |
*** david-lyle has joined #openstack-swift | 15:54 | |
*** admin6 has left #openstack-swift | 15:54 | |
*** dmorita has quit IRC | 15:54 | |
*** nadeem has quit IRC | 15:55 | |
*** vjujjuri has joined #openstack-swift | 15:56 | |
*** annegentle has joined #openstack-swift | 15:56 | |
*** csd__ has joined #openstack-swift | 15:58 | |
*** knl has quit IRC | 15:58 | |
*** haomaiwang has joined #openstack-swift | 15:59 | |
*** csd__ has quit IRC | 15:59 | |
*** csd__ has joined #openstack-swift | 15:59 | |
*** kota_ has joined #openstack-swift | 16:02 | |
*** zaitcev has joined #openstack-swift | 16:02 | |
*** ChanServ sets mode: +v zaitcev | 16:02 | |
*** mrda has joined #openstack-swift | 16:03 | |
clayg | glange: how did *you* guys performance test the golang object server!? | 16:03 |
*** kajinamit has joined #openstack-swift | 16:03 | |
*** ho has joined #openstack-swift | 16:03 | |
clayg | glange: I'm still working on it - there's a lot more work to go - it'll be nice to compare notes | 16:03 |
clayg | ... but right now - container sharding! | 16:03 |
*** dmorita has joined #openstack-swift | 16:03 | |
clayg | glange: redbo: dfg_: hurricanerix_: wish you were here! | 16:04 |
glange | clayg: I didn't do the testing myself, but it was direct to the object server (no proxy involved) | 16:04 |
*** annegentle has quit IRC | 16:04 | |
*** silor has joined #openstack-swift | 16:04 | |
*** csd__ has quit IRC | 16:06 | |
clayg | glange: that's where I'm starting as well | 16:06 |
clayg | glange: acctually - let me gist | 16:06 |
glange | ok | 16:06 |
clayg | glange: https://gist.github.com/clayg/31d5227dd2d586c891d6 | 16:06 |
*** annegentle has joined #openstack-swift | 16:08 | |
clayg | glange: you know, *something* like that - swift-bench also has a direct to object-server bench that i've used before | 16:08 |
glange | yeah | 16:08 |
clayg | glange: I'm not entirely sure how I want to handle spreading load across multiple devices when I think that's important - or how much the diversity of parts and object names matter | 16:09 |
glange | and settings on the object server might affect the outcome too | 16:10 |
glange | there are knobs to turn | 16:10 |
clayg | settings in the go object server - or python? | 16:11 |
glange | the go one, I'm not sure what settings were used | 16:12 |
*** lcurtis has joined #openstack-swift | 16:13 | |
*** jistr has quit IRC | 16:20 | |
zaitcev | clayg: https://github.com/matthewoliver/swift/tree/sharding_trie | 16:23 |
*** jyoti-ranjan has quit IRC | 16:33 | |
*** petertr7_away is now known as petertr7 | 16:42 | |
*** annegentle has quit IRC | 16:43 | |
*** NM has joined #openstack-swift | 16:43 | |
*** lpabon has joined #openstack-swift | 16:44 | |
*** NM has quit IRC | 16:45 | |
*** lpabon has quit IRC | 16:48 | |
*** annegentle has joined #openstack-swift | 16:54 | |
*** jamielennox|away is now known as jamielennox | 17:01 | |
*** zhill_ has joined #openstack-swift | 17:02 | |
*** annegentle has quit IRC | 17:05 | |
MooingLemur | clayg: everything seemed to finally finish reconstructing just a few minutes ago. Thanks for the help yesterday :) However, some of the reconstructor daemons are using ridiculous amounts of RAM | 17:26 |
MooingLemur | 4GB on 3, 7GB on another, and 1.5GB on the last. I'll restart them. I'm wondering if they leaked because of the sheer number of exceptions that they logged over time | 17:29 |
*** david-lyle has quit IRC | 17:29 | |
*** jsalem has joined #openstack-swift | 17:30 | |
zaitcev | MooingLemur: Clay is really busy right now speaking in a Summit session | 17:33 |
MooingLemur | heh, no worries | 17:33 |
*** geaaru has quit IRC | 17:38 | |
*** zhill_ has quit IRC | 17:42 | |
*** zaitcev has quit IRC | 17:45 | |
*** vjujjuri_ has joined #openstack-swift | 17:46 | |
*** vjujjuri has quit IRC | 17:49 | |
*** vjujjuri_ is now known as vjujjuri | 17:49 | |
*** vinsh has joined #openstack-swift | 17:50 | |
*** kota_ has quit IRC | 17:51 | |
*** vinsh has quit IRC | 17:52 | |
*** kota_ has joined #openstack-swift | 17:58 | |
*** mahatic has joined #openstack-swift | 17:59 | |
*** aix has quit IRC | 18:07 | |
*** B4rker has joined #openstack-swift | 18:19 | |
*** ptb_ has joined #openstack-swift | 18:22 | |
*** nadeem has joined #openstack-swift | 18:25 | |
*** jsalem has quit IRC | 18:30 | |
*** B4rker has quit IRC | 18:37 | |
*** anticw_ is now known as anticw | 18:38 | |
*** mahatic has quit IRC | 18:39 | |
briancline | python 2.7 is the current minimum supported version for swift, right? | 18:41 |
*** bhakta has left #openstack-swift | 18:42 | |
redbo | 2.6 is currently supported, but that's probably going away soon | 18:42 |
*** kota_ has quit IRC | 18:42 | |
*** ho has quit IRC | 18:42 | |
*** ptb_ has quit IRC | 18:45 | |
*** jsalem has joined #openstack-swift | 18:45 | |
briancline | ok, thanks. spotted a dict comprehension in a patch, will note it there | 18:47 |
*** kajinamit has quit IRC | 18:48 | |
*** dmorita has quit IRC | 18:50 | |
*** csmart has quit IRC | 18:54 | |
*** dionkalo has joined #openstack-swift | 19:02 | |
*** dmorita has joined #openstack-swift | 19:05 | |
*** jkugel has joined #openstack-swift | 19:08 | |
openstackgerrit | Thiago da Silva proposed openstack/swift-bench: add storage policy option https://review.openstack.org/184590 | 19:10 |
*** silor has quit IRC | 19:18 | |
*** david-lyle has joined #openstack-swift | 19:18 | |
*** david-lyle has quit IRC | 19:27 | |
*** thurloat_isgone is now known as thurloat | 19:28 | |
*** jsalem has quit IRC | 19:29 | |
*** jsalem has joined #openstack-swift | 19:31 | |
*** fthiagogv has quit IRC | 19:33 | |
*** dionkalo has left #openstack-swift | 19:34 | |
*** tab____ has joined #openstack-swift | 19:37 | |
*** jsalem has quit IRC | 19:40 | |
*** petertr7 is now known as petertr7_away | 19:43 | |
*** jamielennox is now known as jamielennox|away | 19:56 | |
*** bhakta has joined #openstack-swift | 19:58 | |
*** thurloat is now known as thurloat_isgone | 19:59 | |
*** dmorita has quit IRC | 20:01 | |
*** csmart has joined #openstack-swift | 20:02 | |
clayg | notmyname: torgomatic: did you guys already decide to drop py2.6 or was that something we're still trying to pretend we do? | 20:22 |
clayg | redbo: I'm spinning up my hummingbird-all-in-one - I'll get you a gist if you think you could drop some knowledge on me that'd be super awesome sause | 20:22 |
redbo | okay | 20:24 |
*** petertr7_away is now known as petertr7 | 20:27 | |
clayg | MooingLemur: but right now I'm eating lunch! | 20:29 |
clayg | MooingLemur: I don't really know what the memory footprint is all about... that can be hard to tease out sometimes | 20:29 |
MooingLemur | you're eating real food while the object servers have to eat EC fragments | 20:30 |
*** zhill_ has joined #openstack-swift | 20:30 | |
MooingLemur | I tried parallelizing container-sync last year, and with little python experience, managed to make something that worked, but it leaked so much that I had to run it in "once" mode in a loop. | 20:31 |
redbo | clayg: here's how I set up my CI stuff, if there are any hints in there. https://gist.github.com/redbo/d7133a069341a2f17119 | 20:31 |
clayg | redbo: yeah maybe - that's sweet! | 20:34 |
clayg | docker docker docker docker | 20:34 |
*** harlowja has joined #openstack-swift | 20:39 | |
*** david-lyle has joined #openstack-swift | 20:44 | |
openstackgerrit | Michael Barton proposed openstack/swift: go: object server SYNC report newer files https://review.openstack.org/184617 | 20:45 |
*** dmorita has joined #openstack-swift | 20:48 | |
*** kajinamit has joined #openstack-swift | 20:48 | |
MooingLemur | aha, no recon interface yet for reconstruction but the json data is there in the recon dir | 20:50 |
*** jamielennox|away is now known as jamielennox | 20:50 | |
clayg | this is the pad -> https://etherpad.openstack.org/p/liberty-swift-increase-part-power | 20:52 |
*** ho has joined #openstack-swift | 20:53 | |
*** kota_ has joined #openstack-swift | 20:54 | |
torgomatic | clayg: notmyname floated the idea on the mailing lists, and nobody really objected | 20:56 |
torgomatic | probably because the rest of openstack ditched 2.6 support a release or two aog | 20:56 |
torgomatic | *ago | 20:56 |
*** mwheckmann has quit IRC | 21:00 | |
*** jsalem has joined #openstack-swift | 21:01 | |
*** ppai has joined #openstack-swift | 21:02 | |
*** zaitcev has joined #openstack-swift | 21:03 | |
*** ChanServ sets mode: +v zaitcev | 21:03 | |
*** petertr7 is now known as petertr7_away | 21:08 | |
*** petertr7_away is now known as petertr7 | 21:08 | |
*** B4rker has joined #openstack-swift | 21:11 | |
*** zhill_ has quit IRC | 21:17 | |
*** zhill_ has joined #openstack-swift | 21:18 | |
*** mahatic has joined #openstack-swift | 21:23 | |
openstackgerrit | Tim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks https://review.openstack.org/184479 | 21:23 |
*** kota_ has quit IRC | 21:24 | |
*** harlowja has quit IRC | 21:24 | |
*** kajinamit has quit IRC | 21:24 | |
*** dmorita has quit IRC | 21:24 | |
*** david-lyle has quit IRC | 21:24 | |
*** jsalem has quit IRC | 21:25 | |
*** blmartin has quit IRC | 21:28 | |
redbo | win 4 | 21:31 |
*** harlowja has joined #openstack-swift | 21:32 | |
*** mahatic has quit IRC | 21:33 | |
*** B4rker has quit IRC | 21:34 | |
*** ho has quit IRC | 21:34 | |
*** zaitcev has quit IRC | 21:35 | |
*** ppai has quit IRC | 21:39 | |
*** jamielennox is now known as jamielennox|away | 21:43 | |
*** jsalem has joined #openstack-swift | 21:45 | |
*** jamielennox|away is now known as jamielennox | 21:59 | |
*** silor has joined #openstack-swift | 21:59 | |
*** thurloat_isgone is now known as thurloat | 22:02 | |
*** tab____ has quit IRC | 22:04 | |
*** jkugel has quit IRC | 22:10 | |
*** chlong has quit IRC | 22:12 | |
openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: Fix the missing SLO state on fast-post https://review.openstack.org/182564 | 22:12 |
*** silor has quit IRC | 22:14 | |
*** zhill_ is now known as zhill_laptop | 22:16 | |
*** jsalem has quit IRC | 22:16 | |
*** kota_ has joined #openstack-swift | 22:16 | |
openstackgerrit | Minwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary. https://review.openstack.org/178317 | 22:20 |
openstackgerrit | Tim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks https://review.openstack.org/184479 | 22:21 |
*** jsalem has joined #openstack-swift | 22:24 | |
*** harlowja has quit IRC | 22:29 | |
*** harlowja has joined #openstack-swift | 22:30 | |
*** B4rker has joined #openstack-swift | 22:30 | |
*** kota_ has quit IRC | 22:30 | |
*** kota_ has joined #openstack-swift | 22:31 | |
*** jamielennox is now known as jamielennox|away | 22:31 | |
*** ppai has joined #openstack-swift | 22:32 | |
*** B4rker has quit IRC | 22:34 | |
*** B4rker has joined #openstack-swift | 22:37 | |
*** jsalem has quit IRC | 22:39 | |
*** david-lyle has joined #openstack-swift | 22:45 | |
clayg | redbo: so this is where am at -> https://gist.github.com/clayg/6cc8df2687e700d85d09 | 22:46 |
clayg | redbo: and I don't even really know what direction I'm facing ;) | 22:46 |
*** zhill_laptop has quit IRC | 22:53 | |
clayg | dfg_: should I have a swift/go/bin/dbench - or just bin/hummingbird? | 22:57 |
redbo | just bin/hummingbird - you do "hummingird dbench [swiftbench-like conf file]" | 22:59 |
clayg | redbo: oh cool! | 23:03 |
clayg | redbo: does debench show up in --help for you? | 23:04 |
*** asettle has joined #openstack-swift | 23:05 | |
redbo | no. Actually none of the command line stuff is that good yet. | 23:05 |
*** km has joined #openstack-swift | 23:05 | |
redbo | clayg: if you do "hummingbird dbench" it spits out an example config. I'm looking at your errors, the first one looks like that just shouldn't be a goofy string comprison on log output. The second one is weird, but I hate how those tests rely on /etc/swift/proxy-server.conf being there anyway, I'm not too horribly surprised that it can break. | 23:07 |
*** jsalem has joined #openstack-swift | 23:08 | |
*** B4rker has quit IRC | 23:11 | |
*** david-lyle has quit IRC | 23:13 | |
*** Fin1te has joined #openstack-swift | 23:15 | |
*** harlowja has quit IRC | 23:18 | |
*** kei_yama has joined #openstack-swift | 23:19 | |
*** nadeem has quit IRC | 23:27 | |
*** shakamunyi has joined #openstack-swift | 23:27 | |
clayg | redbo: dude, rock on - no problem at all! I think part of the problem is I'm still getting tooled up on debugging go - and I'm sort of a fumbling idiot - those pointers are helpful - let me know if there's anything I can try/test | 23:28 |
*** Fin1te has quit IRC | 23:30 | |
*** dmorita has joined #openstack-swift | 23:32 | |
*** B4rker has joined #openstack-swift | 23:33 | |
*** chlong has joined #openstack-swift | 23:34 | |
clayg | can you guys just put in here :'( | 23:36 |
dmorita | https://etherpad.openstack.org/p/liberty-swift-softlayer | 23:36 |
*** kajinamit has joined #openstack-swift | 23:37 | |
openstackgerrit | Samuel Merritt proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks https://review.openstack.org/184479 | 23:45 |
*** B4rker has quit IRC | 23:48 | |
*** shakamunyi has quit IRC | 23:49 | |
*** nottrobin has quit IRC | 23:59 | |
*** nottrobin has joined #openstack-swift | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!