Saturday, 2014-11-29

*** flwang has quit IRC00:20
*** flwang has joined #openstack-swift00:44
*** kopparam has joined #openstack-swift00:52
*** Masahiro has joined #openstack-swift00:56
*** Masahiro has quit IRC01:00
*** rmcall has quit IRC01:19
*** kopparam has quit IRC01:22
*** flwang has quit IRC02:32
*** Masahiro has joined #openstack-swift02:44
*** Masahiro has quit IRC02:49
*** flwang has joined #openstack-swift02:56
*** kopparam has joined #openstack-swift03:08
*** kopparam has quit IRC03:41
*** Masahiro has joined #openstack-swift03:45
*** Masahiro has quit IRC03:50
*** flwang has quit IRC04:03
*** X019 has quit IRC04:08
*** X019 has joined #openstack-swift04:11
*** tellesnobrega_ has joined #openstack-swift04:15
*** flwang has joined #openstack-swift04:25
*** abhirc has quit IRC04:34
*** kopparam has joined #openstack-swift04:57
*** X019 has quit IRC05:05
*** kopparam has quit IRC05:26
*** Masahiro has joined #openstack-swift05:34
*** Masahiro has quit IRC05:39
*** mahatic has quit IRC06:04
*** mahatic has joined #openstack-swift06:31
*** dmsimardz has joined #openstack-swift06:34
*** dmsimardz is now known as dmsimard06:34
*** mordred_ has joined #openstack-swift06:34
*** zul has quit IRC06:37
*** ekarlso- has quit IRC06:37
*** mordred has quit IRC06:37
*** dmsimard_away has quit IRC06:37
*** mordred_ is now known as mordred06:37
*** zul has joined #openstack-swift06:38
*** ekarlso- has joined #openstack-swift06:38
*** fed007 has joined #openstack-swift06:40
fed007Hi06:40
fed007does anyone know how to force a rebalance?07:00
*** X019 has joined #openstack-swift07:01
*** cast has joined #openstack-swift07:02
fed007force the replication...07:03
*** haomaiwa_ has joined #openstack-swift07:12
*** kopparam has joined #openstack-swift07:16
*** Masahiro has joined #openstack-swift07:23
*** kopparam has quit IRC07:24
*** Masahiro has quit IRC07:27
*** madhuri has joined #openstack-swift07:35
madhuriHi, anyone there?07:35
madhuriI have an questioon regarding memory usage of proxy-server.07:36
fed007Hi07:38
*** mahatic has quit IRC07:40
madhuriHi fed00707:40
fed007Hi , not sure what your question is I am fairly new to this but might be able to help07:41
fed007I run 16 GB in mine07:41
fed007proxy nodes07:41
madhuriYes 12 gb in my case07:41
madhurido you know what could be the reason?07:42
fed007reason for what ?07:42
madhuriHigh consumption of memory?07:42
fed007oh I have maybe 2GB used  out of 1607:43
madhuriAs per the paramters that impact memory consumption, the maximum value for it must be near to 1 GB07:43
fed007I have low consuption but your load must be higher? for requests?07:43
madhuriI have tried testing swift performance using one worker process, put_queue_depth =10 and the chunk_size = 6407:44
fed007are you running a dedicated proxy node or comnied services?07:44
fed007combined...07:45
madhuri1024 request were running in parallel07:45
madhuriOn basis of above configuration, memory consumption must be somewhat nearby 65 MB (1024 request*10buffer*64KB07:45
madhuriOn basis of above configuration, memory consumption must be somewhat nearby 65 MB (1024 request*10buffer*64KB chunk)07:46
madhuriWhat was your configuration?07:46
fed007are you talking object server conf?07:49
madhurino proxy server conf07:49
fed007I am running defaults - whatever they are in 2.007:50
fed007not explicit setting07:50
fed007I am more focused on auth hacking07:50
madhuriWhat was your request rate and which release?07:51
fed007not sure yet - just setting up swiftonfile policies as object servers  - I have a new config07:52
fed007this irc is good someone with more testing details should come along shortly07:54
*** sungju has joined #openstack-swift07:57
madhuriThanks fed00708:01
fed007madhuri,  did you launch a 1024 threads at once... was it a sustaining call set looping?08:01
madhuriYes in parallel08:01
fed007I can run the same test if oyu have a python script or something///08:01
madhuriYes sure08:02
fed007I just setup a 48TB node...08:02
fed007with 16GB and all defaults atm08:02
fed007I am interested in seeing what it does...  1024 requests I see maybe spiking a but that is reeally nothing08:03
fed007I think it is more file I?O causing issues for you08:04
fed007I/O08:04
madhuriYes08:04
fed007http layer should be able to take a hammering08:04
madhurihttp://pastebin.com/P2zKLPTw08:08
madhuriYou can find the script ^08:09
fed007yep just setting it up...08:12
fed007how much mem was consumed or stayed unreleased when you ran?08:12
fed007why are u running rssync inn your scritp?08:17
fed007looks like you are moving some files around08:18
fed007I was expecting just to see the Put08:18
fed007what are you putting for your files param?08:22
fed007for command line exec08:22
*** Masahiro has joined #openstack-swift08:24
*** Masahiro has quit IRC08:28
madhuri12 GB08:42
*** madhuri_ has joined #openstack-swift08:43
madhuri_fed007: Actually I used Jmeter/cosbench/parallel_curl to test this scenraio08:44
madhuri_The memory consumption was actually analysed when running LRT through JMeter08:45
fed007ok I am just going to watch using linux tools...08:48
fed007I need to modify the script a bit to run for me08:48
fed007I have to roll for tonight but check with me tomorrow or next night08:49
madhuri_Ok thanks fed00708:49
madhuri_When can I get to know the results?08:50
fed007np I'll have specs for you when I run ...08:50
*** fed007 has quit IRC08:50
*** mmcardle has joined #openstack-swift09:16
*** dvorkbjel has quit IRC09:33
*** dvorkbjel has joined #openstack-swift09:39
*** haomaiwa_ has quit IRC09:39
*** foexle has joined #openstack-swift09:43
*** nellysmitt has joined #openstack-swift09:45
*** cast has quit IRC10:09
*** Masahiro has joined #openstack-swift10:12
*** Masahiro has quit IRC10:17
*** NM has joined #openstack-swift10:32
*** NM has quit IRC10:35
*** exploreshaifali has joined #openstack-swift10:40
*** kopparam has joined #openstack-swift11:00
*** sungju has quit IRC11:04
*** exploreshaifali has quit IRC11:14
*** NM has joined #openstack-swift11:28
*** NM has quit IRC11:33
*** exploreshaifali has joined #openstack-swift11:34
*** kopparam has quit IRC11:46
*** kopparam has joined #openstack-swift11:49
*** Masahiro has joined #openstack-swift11:58
*** kopparam has quit IRC11:59
*** Masahiro has quit IRC12:03
*** tellesnobrega_ has quit IRC12:10
*** mmcardle has quit IRC12:12
*** tellesnobrega_ has joined #openstack-swift12:44
*** nellysmitt has quit IRC13:03
*** exploreshaifali has quit IRC13:07
*** nellysmitt has joined #openstack-swift13:12
*** tellesnobrega_ has quit IRC13:19
*** evanjfraser has quit IRC13:24
*** evanjfraser has joined #openstack-swift13:24
*** silor has joined #openstack-swift13:29
*** X019 has quit IRC13:31
*** tellesnobrega_ has joined #openstack-swift13:37
*** Masahiro has joined #openstack-swift13:47
*** nellysmitt has quit IRC13:48
*** exploreshaifali has joined #openstack-swift13:48
*** tellesnobrega_ has quit IRC13:50
*** Masahiro has quit IRC13:52
*** exploreshaifali has quit IRC14:07
*** mmcardle has joined #openstack-swift14:28
*** mmcardle has quit IRC14:46
*** X019 has joined #openstack-swift15:09
*** foexle has quit IRC15:34
*** Masahiro has joined #openstack-swift15:36
*** Masahiro has quit IRC15:40
*** X019 has quit IRC15:43
*** nellysmitt has joined #openstack-swift15:48
*** kopparam has joined #openstack-swift15:51
*** nellysmitt has quit IRC15:53
*** exploreshaifali has joined #openstack-swift16:15
*** flwang has quit IRC16:21
*** kopparam has quit IRC16:23
*** tellesnobrega_ has joined #openstack-swift16:30
*** tellesnobrega_ has quit IRC16:45
*** tellesnobrega_ has joined #openstack-swift16:46
*** flwang has joined #openstack-swift16:47
*** mahatic has joined #openstack-swift16:54
*** foexle has joined #openstack-swift16:58
*** Masahiro has joined #openstack-swift17:25
*** Masahiro has quit IRC17:29
*** foexle has quit IRC17:33
*** nellysmitt has joined #openstack-swift17:49
*** nellysmitt has quit IRC17:54
*** flwang has quit IRC18:05
*** kopparam has joined #openstack-swift18:17
*** flwang has joined #openstack-swift18:18
*** rdaly2 has joined #openstack-swift18:29
*** d0ugal_ has joined #openstack-swift18:44
*** d0ugal has quit IRC18:45
*** d0ugal_ is now known as d0ugal18:45
*** d0ugal is now known as Guest1817018:46
*** exploreshaifali has quit IRC18:47
*** kopparam has quit IRC18:47
*** openstackgerrit has quit IRC18:48
*** openstackgerrit has joined #openstack-swift18:52
*** foexle has joined #openstack-swift18:56
*** Masahiro has joined #openstack-swift19:13
*** foexle has quit IRC19:14
*** foexle has joined #openstack-swift19:16
*** rdaly2 has quit IRC19:16
*** silor has quit IRC19:17
*** Masahiro has quit IRC19:18
*** rdaly2 has joined #openstack-swift19:18
*** rdaly2 has quit IRC19:19
*** foexle has quit IRC19:25
*** Viswanath has joined #openstack-swift19:26
*** rdaly2 has joined #openstack-swift19:26
*** Viswanath has quit IRC19:29
*** rdaly2 has quit IRC19:30
*** NM has joined #openstack-swift19:32
*** NM has quit IRC19:33
*** exploreshaifali has joined #openstack-swift19:40
*** exploreshaifali has quit IRC19:41
*** nellysmitt has joined #openstack-swift19:50
*** nellysmitt has quit IRC19:55
*** mmcardle has joined #openstack-swift20:27
*** mmcardle has quit IRC20:44
*** flwang has quit IRC20:56
*** Masahiro has joined #openstack-swift21:02
*** Masahiro has quit IRC21:07
*** flwang has joined #openstack-swift21:15
*** kopparam has joined #openstack-swift21:21
*** tellesnobrega_ has quit IRC21:42
*** kopparam has quit IRC21:49
*** nellysmitt has joined #openstack-swift21:51
*** nellysmitt has quit IRC21:55
*** flwang has quit IRC22:17
*** Masahiro has joined #openstack-swift22:51
*** Masahiro has quit IRC22:55
*** flwang has joined #openstack-swift22:55
*** flwang has quit IRC23:04
*** tellesnobrega_ has joined #openstack-swift23:12
*** tellesnobrega_ has quit IRC23:38
*** kopparam has joined #openstack-swift23:38
*** tellesnobrega_ has joined #openstack-swift23:38
*** flwang has joined #openstack-swift23:38
*** tellesnobrega_ has quit IRC23:39
*** nellysmitt has joined #openstack-swift23:52
*** nellysmitt has quit IRC23:56
*** flwang has quit IRC23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!