Wednesday, 2015-05-20

*** asettle has quit IRC00:02
occupantmy first thought was writing cached data, but it still happens after doing a sync and having iostat zero out.00:05
*** ppai has joined #openstack-swift00:07
*** silor has joined #openstack-swift00:09
*** silor has quit IRC00:14
*** david-lyle has quit IRC00:16
*** dmorita has quit IRC00:22
*** dmorita has joined #openstack-swift00:24
*** zhill has joined #openstack-swift00:26
*** zul has quit IRC00:26
*** silor has joined #openstack-swift00:28
*** petertr7 is now known as petertr7_away00:31
*** dmorita has quit IRC00:32
*** zul has joined #openstack-swift00:37
*** ppai has quit IRC00:40
*** thurloat_isgone is now known as thurloat00:42
*** dmorita has joined #openstack-swift00:45
*** zul has quit IRC00:48
swifterdarrelltorgomatic: +2 on https://review.openstack.org/#/c/180795/ if you can tweak those comments...00:56
*** wbhuber has joined #openstack-swift01:11
*** haomaiwang has quit IRC01:13
*** thurloat is now known as thurloat_isgone01:17
*** silor has quit IRC01:48
*** Fin1te has quit IRC01:53
*** Fin1te has joined #openstack-swift02:04
*** alejandrito has joined #openstack-swift02:04
*** vjujjuri has quit IRC02:05
*** wbhuber has quit IRC02:07
*** wbhuber has joined #openstack-swift02:08
*** petertr7_away is now known as petertr702:15
*** minwoob has quit IRC02:26
*** jkugel has joined #openstack-swift02:37
*** jkugel has left #openstack-swift02:39
*** wbhuber has quit IRC02:45
*** Fin1te has quit IRC03:11
*** silor has joined #openstack-swift03:23
*** silor has quit IRC04:03
*** proteusguy has joined #openstack-swift04:32
*** vjujjuri has joined #openstack-swift04:42
*** chlong_ has quit IRC05:03
*** vjujjuri_ has joined #openstack-swift05:15
*** chlong_ has joined #openstack-swift05:16
*** vjujjuri has quit IRC05:17
*** vjujjuri_ is now known as vjujjuri05:17
*** harlowja has joined #openstack-swift05:25
*** yuan has joined #openstack-swift05:36
*** harlowja has quit IRC05:37
*** harlowja has joined #openstack-swift05:42
*** harlowja has quit IRC05:56
*** chlong_ has quit IRC06:09
*** zul has joined #openstack-swift06:16
*** haomaiwang has joined #openstack-swift06:29
*** chlong has joined #openstack-swift06:31
*** nadeem has joined #openstack-swift06:36
*** proteusguy has quit IRC06:47
*** vjujjuri has quit IRC06:51
*** vinsh has joined #openstack-swift06:52
*** vinsh has quit IRC06:56
*** proteusguy has joined #openstack-swift07:00
openstackgerritTakashi Kajinami proposed openstack/swift: Ensure update of the container by object-updater  https://review.openstack.org/9959807:08
*** jistr has joined #openstack-swift07:18
*** chlong has quit IRC07:37
*** haigang has joined #openstack-swift07:49
*** admin6 has joined #openstack-swift07:53
*** geaaru has joined #openstack-swift08:07
*** petertr7 is now known as petertr7_away08:24
*** jyoti-ranjan has joined #openstack-swift08:43
*** jyoti-ranjan has quit IRC08:44
*** jyoti-ranjan has joined #openstack-swift08:45
*** jyoti-ranjan has joined #openstack-swift08:54
*** nadeem has quit IRC09:06
*** aix has joined #openstack-swift09:29
*** haigang has quit IRC09:41
*** haomaiwang has quit IRC09:50
*** mlima has quit IRC10:05
*** NM has joined #openstack-swift10:17
*** vinsh has joined #openstack-swift10:29
*** vinsh has quit IRC10:34
*** haomaiwa_ has joined #openstack-swift10:39
*** petertr7_away is now known as petertr711:04
*** knl has joined #openstack-swift11:08
*** km has quit IRC11:09
*** petertr7 is now known as petertr7_away11:14
*** kei_yama has quit IRC11:21
*** alejandrito has quit IRC11:27
*** aix has quit IRC11:42
*** SkyRocknRoll has joined #openstack-swift11:42
*** SkyRocknRoll has joined #openstack-swift11:42
*** NM has quit IRC11:55
*** aix has joined #openstack-swift12:13
*** vinsh has joined #openstack-swift12:18
*** vinsh has quit IRC12:23
*** alejandrito has joined #openstack-swift12:39
*** SkyRocknRoll has quit IRC12:42
*** SkyRocknRoll has joined #openstack-swift12:42
*** SkyRocknRoll has joined #openstack-swift12:42
*** alejandrito has quit IRC12:44
*** wbhuber has joined #openstack-swift12:44
*** SkyRocknRoll has quit IRC12:46
*** SkyRocknRoll has joined #openstack-swift12:46
*** alejandrito has joined #openstack-swift12:47
*** wbhuber has quit IRC12:49
*** chlong has joined #openstack-swift12:58
openstackgerritTim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks  https://review.openstack.org/18447913:09
timburketorgomatic: ^^^fyi, the SLO thing we were talking about last night13:10
*** minwoob has joined #openstack-swift13:13
*** chlong has quit IRC13:14
*** chlong has joined #openstack-swift13:31
*** silor has joined #openstack-swift13:32
*** annegentle has joined #openstack-swift13:49
glangeclayg: how did you guys performance test the golang object server?13:51
*** blmartin has joined #openstack-swift13:54
*** nadeem has joined #openstack-swift13:58
*** fthiagogv has joined #openstack-swift14:01
*** vjujjuri has joined #openstack-swift14:03
openstackgerritYosef  Moatti proposed openstack/swift: Initial implementation for the storlets spec  https://review.openstack.org/18450214:10
openstackgerritpradeep kumar singh proposed openstack/swift: Modify internal_client so that it  reads the response if response status is not 200.  https://review.openstack.org/18389914:31
*** NM has joined #openstack-swift14:38
*** zul has quit IRC14:42
*** haomaiwa_ has quit IRC14:44
*** nadeem has quit IRC14:45
*** nadeem has joined #openstack-swift14:46
*** silor has quit IRC14:50
*** vjujjuri has quit IRC14:58
*** annegentle has quit IRC15:00
*** vinsh has joined #openstack-swift15:08
*** NM has quit IRC15:09
*** SkyRocknRoll has quit IRC15:12
*** csd__ has joined #openstack-swift15:17
*** lpabon has joined #openstack-swift15:18
*** csd__ has quit IRC15:22
*** lpabon has quit IRC15:29
*** InAnimaTe has quit IRC15:34
*** vinsh has quit IRC15:40
*** david-lyle has joined #openstack-swift15:54
*** admin6 has left #openstack-swift15:54
*** dmorita has quit IRC15:54
*** nadeem has quit IRC15:55
*** vjujjuri has joined #openstack-swift15:56
*** annegentle has joined #openstack-swift15:56
*** csd__ has joined #openstack-swift15:58
*** knl has quit IRC15:58
*** haomaiwang has joined #openstack-swift15:59
*** csd__ has quit IRC15:59
*** csd__ has joined #openstack-swift15:59
*** kota_ has joined #openstack-swift16:02
*** zaitcev has joined #openstack-swift16:02
*** ChanServ sets mode: +v zaitcev16:02
*** mrda has joined #openstack-swift16:03
claygglange: how did *you* guys performance test the golang object server!?16:03
*** kajinamit has joined #openstack-swift16:03
*** ho has joined #openstack-swift16:03
claygglange: I'm still working on it - there's a lot more work to go - it'll be nice to compare notes16:03
clayg... but right now - container sharding!16:03
*** dmorita has joined #openstack-swift16:03
claygglange: redbo: dfg_: hurricanerix_: wish you were here!16:04
glangeclayg: I didn't do the testing myself, but it was direct to the object server (no proxy involved)16:04
*** annegentle has quit IRC16:04
*** silor has joined #openstack-swift16:04
*** csd__ has quit IRC16:06
claygglange: that's where I'm starting as well16:06
claygglange: acctually - let me gist16:06
glangeok16:06
claygglange: https://gist.github.com/clayg/31d5227dd2d586c891d616:06
*** annegentle has joined #openstack-swift16:08
claygglange: you know, *something* like that - swift-bench also has a direct to object-server bench that i've used before16:08
glangeyeah16:08
claygglange: I'm not entirely sure how I want to handle spreading load across multiple devices when I think that's important - or how much the diversity of parts and object names matter16:09
glangeand settings on the object server might affect the outcome too16:10
glangethere are knobs to turn16:10
claygsettings in the go object server - or python?16:11
glangethe go one, I'm not sure what settings were used16:12
*** lcurtis has joined #openstack-swift16:13
*** jistr has quit IRC16:20
zaitcevclayg: https://github.com/matthewoliver/swift/tree/sharding_trie16:23
*** jyoti-ranjan has quit IRC16:33
*** petertr7_away is now known as petertr716:42
*** annegentle has quit IRC16:43
*** NM has joined #openstack-swift16:43
*** lpabon has joined #openstack-swift16:44
*** NM has quit IRC16:45
*** lpabon has quit IRC16:48
*** annegentle has joined #openstack-swift16:54
*** jamielennox|away is now known as jamielennox17:01
*** zhill_ has joined #openstack-swift17:02
*** annegentle has quit IRC17:05
MooingLemurclayg: everything seemed to finally finish reconstructing just a few minutes ago.  Thanks for the help yesterday :)  However, some of the reconstructor daemons are using ridiculous amounts of RAM17:26
MooingLemur4GB on 3, 7GB on another, and 1.5GB on the last.  I'll restart them.  I'm wondering if they leaked because of the sheer number of exceptions that they logged over time17:29
*** david-lyle has quit IRC17:29
*** jsalem has joined #openstack-swift17:30
zaitcevMooingLemur: Clay is really busy right now speaking in a Summit session17:33
MooingLemurheh, no worries17:33
*** geaaru has quit IRC17:38
*** zhill_ has quit IRC17:42
*** zaitcev has quit IRC17:45
*** vjujjuri_ has joined #openstack-swift17:46
*** vjujjuri has quit IRC17:49
*** vjujjuri_ is now known as vjujjuri17:49
*** vinsh has joined #openstack-swift17:50
*** kota_ has quit IRC17:51
*** vinsh has quit IRC17:52
*** kota_ has joined #openstack-swift17:58
*** mahatic has joined #openstack-swift17:59
*** aix has quit IRC18:07
*** B4rker has joined #openstack-swift18:19
*** ptb_ has joined #openstack-swift18:22
*** nadeem has joined #openstack-swift18:25
*** jsalem has quit IRC18:30
*** B4rker has quit IRC18:37
*** anticw_ is now known as anticw18:38
*** mahatic has quit IRC18:39
brianclinepython 2.7 is the current minimum supported version for swift, right?18:41
*** bhakta has left #openstack-swift18:42
redbo2.6 is currently supported, but that's probably going away soon18:42
*** kota_ has quit IRC18:42
*** ho has quit IRC18:42
*** ptb_ has quit IRC18:45
*** jsalem has joined #openstack-swift18:45
brianclineok, thanks. spotted a dict comprehension in a patch, will note it there18:47
*** kajinamit has quit IRC18:48
*** dmorita has quit IRC18:50
*** csmart has quit IRC18:54
*** dionkalo has joined #openstack-swift19:02
*** dmorita has joined #openstack-swift19:05
*** jkugel has joined #openstack-swift19:08
openstackgerritThiago da Silva proposed openstack/swift-bench: add storage policy option  https://review.openstack.org/18459019:10
*** silor has quit IRC19:18
*** david-lyle has joined #openstack-swift19:18
*** david-lyle has quit IRC19:27
*** thurloat_isgone is now known as thurloat19:28
*** jsalem has quit IRC19:29
*** jsalem has joined #openstack-swift19:31
*** fthiagogv has quit IRC19:33
*** dionkalo has left #openstack-swift19:34
*** tab____ has joined #openstack-swift19:37
*** jsalem has quit IRC19:40
*** petertr7 is now known as petertr7_away19:43
*** jamielennox is now known as jamielennox|away19:56
*** bhakta has joined #openstack-swift19:58
*** thurloat is now known as thurloat_isgone19:59
*** dmorita has quit IRC20:01
*** csmart has joined #openstack-swift20:02
claygnotmyname: torgomatic: did you guys already decide to drop py2.6 or was that something we're still trying to pretend we do?20:22
claygredbo: I'm spinning up my hummingbird-all-in-one - I'll get you a gist if you think you could drop some knowledge on me that'd be super awesome sause20:22
redbookay20:24
*** petertr7_away is now known as petertr720:27
claygMooingLemur: but right now I'm eating lunch!20:29
claygMooingLemur: I don't really know what the memory footprint is all about... that can be hard to tease out sometimes20:29
MooingLemuryou're eating real food while the object servers have to eat EC fragments20:30
*** zhill_ has joined #openstack-swift20:30
MooingLemurI tried parallelizing container-sync last year, and with little python experience, managed to make something that worked, but it leaked so much that I had to run it in "once" mode in a loop.20:31
redboclayg: here's how I set up my CI stuff, if there are any hints in there.  https://gist.github.com/redbo/d7133a069341a2f1711920:31
claygredbo: yeah maybe - that's sweet!20:34
claygdocker docker docker docker20:34
*** harlowja has joined #openstack-swift20:39
*** david-lyle has joined #openstack-swift20:44
openstackgerritMichael Barton proposed openstack/swift: go: object server SYNC report newer files  https://review.openstack.org/18461720:45
*** dmorita has joined #openstack-swift20:48
*** kajinamit has joined #openstack-swift20:48
MooingLemuraha, no recon interface yet for reconstruction but the json data is there in the recon dir20:50
*** jamielennox|away is now known as jamielennox20:50
claygthis is the pad -> https://etherpad.openstack.org/p/liberty-swift-increase-part-power20:52
*** ho has joined #openstack-swift20:53
*** kota_ has joined #openstack-swift20:54
torgomaticclayg: notmyname floated the idea on the mailing lists, and nobody really objected20:56
torgomaticprobably because the rest of openstack ditched 2.6 support a release or two aog20:56
torgomatic*ago20:56
*** mwheckmann has quit IRC21:00
*** jsalem has joined #openstack-swift21:01
*** ppai has joined #openstack-swift21:02
*** zaitcev has joined #openstack-swift21:03
*** ChanServ sets mode: +v zaitcev21:03
*** petertr7 is now known as petertr7_away21:08
*** petertr7_away is now known as petertr721:08
*** B4rker has joined #openstack-swift21:11
*** zhill_ has quit IRC21:17
*** zhill_ has joined #openstack-swift21:18
*** mahatic has joined #openstack-swift21:23
openstackgerritTim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks  https://review.openstack.org/18447921:23
*** kota_ has quit IRC21:24
*** harlowja has quit IRC21:24
*** kajinamit has quit IRC21:24
*** dmorita has quit IRC21:24
*** david-lyle has quit IRC21:24
*** jsalem has quit IRC21:25
*** blmartin has quit IRC21:28
redbowin 421:31
*** harlowja has joined #openstack-swift21:32
*** mahatic has quit IRC21:33
*** B4rker has quit IRC21:34
*** ho has quit IRC21:34
*** zaitcev has quit IRC21:35
*** ppai has quit IRC21:39
*** jamielennox is now known as jamielennox|away21:43
*** jsalem has joined #openstack-swift21:45
*** jamielennox|away is now known as jamielennox21:59
*** silor has joined #openstack-swift21:59
*** thurloat_isgone is now known as thurloat22:02
*** tab____ has quit IRC22:04
*** jkugel has quit IRC22:10
*** chlong has quit IRC22:12
openstackgerritKota Tsuyuzaki proposed openstack/swift: Fix the missing SLO state on fast-post  https://review.openstack.org/18256422:12
*** silor has quit IRC22:14
*** zhill_ is now known as zhill_laptop22:16
*** jsalem has quit IRC22:16
*** kota_ has joined #openstack-swift22:16
openstackgerritMinwoo Bae proposed openstack/swift: The hash_cleanup_listdir function should only be called when necessary.  https://review.openstack.org/17831722:20
openstackgerritTim Burke proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks  https://review.openstack.org/18447922:21
*** jsalem has joined #openstack-swift22:24
*** harlowja has quit IRC22:29
*** harlowja has joined #openstack-swift22:30
*** B4rker has joined #openstack-swift22:30
*** kota_ has quit IRC22:30
*** kota_ has joined #openstack-swift22:31
*** jamielennox is now known as jamielennox|away22:31
*** ppai has joined #openstack-swift22:32
*** B4rker has quit IRC22:34
*** B4rker has joined #openstack-swift22:37
*** jsalem has quit IRC22:39
*** david-lyle has joined #openstack-swift22:45
claygredbo: so this is where am at -> https://gist.github.com/clayg/6cc8df2687e700d85d0922:46
claygredbo: and I don't even really know what direction I'm facing ;)22:46
*** zhill_laptop has quit IRC22:53
claygdfg_: should I have a swift/go/bin/dbench - or just bin/hummingbird?22:57
redbojust bin/hummingbird - you do "hummingird dbench [swiftbench-like conf file]"22:59
claygredbo: oh cool!23:03
claygredbo: does debench show up in --help for you?23:04
*** asettle has joined #openstack-swift23:05
redbono.  Actually none of the command line stuff is that good yet.23:05
*** km has joined #openstack-swift23:05
redboclayg: if you do "hummingbird dbench" it spits out an example config.  I'm looking at your errors, the first one looks like that just shouldn't be a goofy string comprison on log output.  The second one is weird, but I hate how those tests rely on /etc/swift/proxy-server.conf being there anyway, I'm not too horribly surprised that it can break.23:07
*** jsalem has joined #openstack-swift23:08
*** B4rker has quit IRC23:11
*** david-lyle has quit IRC23:13
*** Fin1te has joined #openstack-swift23:15
*** harlowja has quit IRC23:18
*** kei_yama has joined #openstack-swift23:19
*** nadeem has quit IRC23:27
*** shakamunyi has joined #openstack-swift23:27
claygredbo: dude, rock on - no problem at all!  I think part of the problem is I'm still getting tooled up on debugging go - and I'm sort of a fumbling idiot - those pointers are helpful - let me know if there's anything I can try/test23:28
*** Fin1te has quit IRC23:30
*** dmorita has joined #openstack-swift23:32
*** B4rker has joined #openstack-swift23:33
*** chlong has joined #openstack-swift23:34
claygcan you guys just put in here :'(23:36
dmoritahttps://etherpad.openstack.org/p/liberty-swift-softlayer23:36
*** kajinamit has joined #openstack-swift23:37
openstackgerritSamuel Merritt proposed openstack/swift: Allow SLO PUTs to forgo per-segment integrity checks  https://review.openstack.org/18447923:45
*** B4rker has quit IRC23:48
*** shakamunyi has quit IRC23:49
*** nottrobin has quit IRC23:59
*** nottrobin has joined #openstack-swift23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!