*** flwang has quit IRC | 00:20 | |
*** flwang has joined #openstack-swift | 00:44 | |
*** kopparam has joined #openstack-swift | 00:52 | |
*** Masahiro has joined #openstack-swift | 00:56 | |
*** Masahiro has quit IRC | 01:00 | |
*** rmcall has quit IRC | 01:19 | |
*** kopparam has quit IRC | 01:22 | |
*** flwang has quit IRC | 02:32 | |
*** Masahiro has joined #openstack-swift | 02:44 | |
*** Masahiro has quit IRC | 02:49 | |
*** flwang has joined #openstack-swift | 02:56 | |
*** kopparam has joined #openstack-swift | 03:08 | |
*** kopparam has quit IRC | 03:41 | |
*** Masahiro has joined #openstack-swift | 03:45 | |
*** Masahiro has quit IRC | 03:50 | |
*** flwang has quit IRC | 04:03 | |
*** X019 has quit IRC | 04:08 | |
*** X019 has joined #openstack-swift | 04:11 | |
*** tellesnobrega_ has joined #openstack-swift | 04:15 | |
*** flwang has joined #openstack-swift | 04:25 | |
*** abhirc has quit IRC | 04:34 | |
*** kopparam has joined #openstack-swift | 04:57 | |
*** X019 has quit IRC | 05:05 | |
*** kopparam has quit IRC | 05:26 | |
*** Masahiro has joined #openstack-swift | 05:34 | |
*** Masahiro has quit IRC | 05:39 | |
*** mahatic has quit IRC | 06:04 | |
*** mahatic has joined #openstack-swift | 06:31 | |
*** dmsimardz has joined #openstack-swift | 06:34 | |
*** dmsimardz is now known as dmsimard | 06:34 | |
*** mordred_ has joined #openstack-swift | 06:34 | |
*** zul has quit IRC | 06:37 | |
*** ekarlso- has quit IRC | 06:37 | |
*** mordred has quit IRC | 06:37 | |
*** dmsimard_away has quit IRC | 06:37 | |
*** mordred_ is now known as mordred | 06:37 | |
*** zul has joined #openstack-swift | 06:38 | |
*** ekarlso- has joined #openstack-swift | 06:38 | |
*** fed007 has joined #openstack-swift | 06:40 | |
fed007 | Hi | 06:40 |
---|---|---|
fed007 | does anyone know how to force a rebalance? | 07:00 |
*** X019 has joined #openstack-swift | 07:01 | |
*** cast has joined #openstack-swift | 07:02 | |
fed007 | force the replication... | 07:03 |
*** haomaiwa_ has joined #openstack-swift | 07:12 | |
*** kopparam has joined #openstack-swift | 07:16 | |
*** Masahiro has joined #openstack-swift | 07:23 | |
*** kopparam has quit IRC | 07:24 | |
*** Masahiro has quit IRC | 07:27 | |
*** madhuri has joined #openstack-swift | 07:35 | |
madhuri | Hi, anyone there? | 07:35 |
madhuri | I have an questioon regarding memory usage of proxy-server. | 07:36 |
fed007 | Hi | 07:38 |
*** mahatic has quit IRC | 07:40 | |
madhuri | Hi fed007 | 07:40 |
fed007 | Hi , not sure what your question is I am fairly new to this but might be able to help | 07:41 |
fed007 | I run 16 GB in mine | 07:41 |
fed007 | proxy nodes | 07:41 |
madhuri | Yes 12 gb in my case | 07:41 |
madhuri | do you know what could be the reason? | 07:42 |
fed007 | reason for what ? | 07:42 |
madhuri | High consumption of memory? | 07:42 |
fed007 | oh I have maybe 2GB used out of 16 | 07:43 |
madhuri | As per the paramters that impact memory consumption, the maximum value for it must be near to 1 GB | 07:43 |
fed007 | I have low consuption but your load must be higher? for requests? | 07:43 |
madhuri | I have tried testing swift performance using one worker process, put_queue_depth =10 and the chunk_size = 64 | 07:44 |
fed007 | are you running a dedicated proxy node or comnied services? | 07:44 |
fed007 | combined... | 07:45 |
madhuri | 1024 request were running in parallel | 07:45 |
madhuri | On basis of above configuration, memory consumption must be somewhat nearby 65 MB (1024 request*10buffer*64KB | 07:45 |
madhuri | On basis of above configuration, memory consumption must be somewhat nearby 65 MB (1024 request*10buffer*64KB chunk) | 07:46 |
madhuri | What was your configuration? | 07:46 |
fed007 | are you talking object server conf? | 07:49 |
madhuri | no proxy server conf | 07:49 |
fed007 | I am running defaults - whatever they are in 2.0 | 07:50 |
fed007 | not explicit setting | 07:50 |
fed007 | I am more focused on auth hacking | 07:50 |
madhuri | What was your request rate and which release? | 07:51 |
fed007 | not sure yet - just setting up swiftonfile policies as object servers - I have a new config | 07:52 |
fed007 | this irc is good someone with more testing details should come along shortly | 07:54 |
*** sungju has joined #openstack-swift | 07:57 | |
madhuri | Thanks fed007 | 08:01 |
fed007 | madhuri, did you launch a 1024 threads at once... was it a sustaining call set looping? | 08:01 |
madhuri | Yes in parallel | 08:01 |
fed007 | I can run the same test if oyu have a python script or something/// | 08:01 |
madhuri | Yes sure | 08:02 |
fed007 | I just setup a 48TB node... | 08:02 |
fed007 | with 16GB and all defaults atm | 08:02 |
fed007 | I am interested in seeing what it does... 1024 requests I see maybe spiking a but that is reeally nothing | 08:03 |
fed007 | I think it is more file I?O causing issues for you | 08:04 |
fed007 | I/O | 08:04 |
madhuri | Yes | 08:04 |
fed007 | http layer should be able to take a hammering | 08:04 |
madhuri | http://pastebin.com/P2zKLPTw | 08:08 |
madhuri | You can find the script ^ | 08:09 |
fed007 | yep just setting it up... | 08:12 |
fed007 | how much mem was consumed or stayed unreleased when you ran? | 08:12 |
fed007 | why are u running rssync inn your scritp? | 08:17 |
fed007 | looks like you are moving some files around | 08:18 |
fed007 | I was expecting just to see the Put | 08:18 |
fed007 | what are you putting for your files param? | 08:22 |
fed007 | for command line exec | 08:22 |
*** Masahiro has joined #openstack-swift | 08:24 | |
*** Masahiro has quit IRC | 08:28 | |
madhuri | 12 GB | 08:42 |
*** madhuri_ has joined #openstack-swift | 08:43 | |
madhuri_ | fed007: Actually I used Jmeter/cosbench/parallel_curl to test this scenraio | 08:44 |
madhuri_ | The memory consumption was actually analysed when running LRT through JMeter | 08:45 |
fed007 | ok I am just going to watch using linux tools... | 08:48 |
fed007 | I need to modify the script a bit to run for me | 08:48 |
fed007 | I have to roll for tonight but check with me tomorrow or next night | 08:49 |
madhuri_ | Ok thanks fed007 | 08:49 |
madhuri_ | When can I get to know the results? | 08:50 |
fed007 | np I'll have specs for you when I run ... | 08:50 |
*** fed007 has quit IRC | 08:50 | |
*** mmcardle has joined #openstack-swift | 09:16 | |
*** dvorkbjel has quit IRC | 09:33 | |
*** dvorkbjel has joined #openstack-swift | 09:39 | |
*** haomaiwa_ has quit IRC | 09:39 | |
*** foexle has joined #openstack-swift | 09:43 | |
*** nellysmitt has joined #openstack-swift | 09:45 | |
*** cast has quit IRC | 10:09 | |
*** Masahiro has joined #openstack-swift | 10:12 | |
*** Masahiro has quit IRC | 10:17 | |
*** NM has joined #openstack-swift | 10:32 | |
*** NM has quit IRC | 10:35 | |
*** exploreshaifali has joined #openstack-swift | 10:40 | |
*** kopparam has joined #openstack-swift | 11:00 | |
*** sungju has quit IRC | 11:04 | |
*** exploreshaifali has quit IRC | 11:14 | |
*** NM has joined #openstack-swift | 11:28 | |
*** NM has quit IRC | 11:33 | |
*** exploreshaifali has joined #openstack-swift | 11:34 | |
*** kopparam has quit IRC | 11:46 | |
*** kopparam has joined #openstack-swift | 11:49 | |
*** Masahiro has joined #openstack-swift | 11:58 | |
*** kopparam has quit IRC | 11:59 | |
*** Masahiro has quit IRC | 12:03 | |
*** tellesnobrega_ has quit IRC | 12:10 | |
*** mmcardle has quit IRC | 12:12 | |
*** tellesnobrega_ has joined #openstack-swift | 12:44 | |
*** nellysmitt has quit IRC | 13:03 | |
*** exploreshaifali has quit IRC | 13:07 | |
*** nellysmitt has joined #openstack-swift | 13:12 | |
*** tellesnobrega_ has quit IRC | 13:19 | |
*** evanjfraser has quit IRC | 13:24 | |
*** evanjfraser has joined #openstack-swift | 13:24 | |
*** silor has joined #openstack-swift | 13:29 | |
*** X019 has quit IRC | 13:31 | |
*** tellesnobrega_ has joined #openstack-swift | 13:37 | |
*** Masahiro has joined #openstack-swift | 13:47 | |
*** nellysmitt has quit IRC | 13:48 | |
*** exploreshaifali has joined #openstack-swift | 13:48 | |
*** tellesnobrega_ has quit IRC | 13:50 | |
*** Masahiro has quit IRC | 13:52 | |
*** exploreshaifali has quit IRC | 14:07 | |
*** mmcardle has joined #openstack-swift | 14:28 | |
*** mmcardle has quit IRC | 14:46 | |
*** X019 has joined #openstack-swift | 15:09 | |
*** foexle has quit IRC | 15:34 | |
*** Masahiro has joined #openstack-swift | 15:36 | |
*** Masahiro has quit IRC | 15:40 | |
*** X019 has quit IRC | 15:43 | |
*** nellysmitt has joined #openstack-swift | 15:48 | |
*** kopparam has joined #openstack-swift | 15:51 | |
*** nellysmitt has quit IRC | 15:53 | |
*** exploreshaifali has joined #openstack-swift | 16:15 | |
*** flwang has quit IRC | 16:21 | |
*** kopparam has quit IRC | 16:23 | |
*** tellesnobrega_ has joined #openstack-swift | 16:30 | |
*** tellesnobrega_ has quit IRC | 16:45 | |
*** tellesnobrega_ has joined #openstack-swift | 16:46 | |
*** flwang has joined #openstack-swift | 16:47 | |
*** mahatic has joined #openstack-swift | 16:54 | |
*** foexle has joined #openstack-swift | 16:58 | |
*** Masahiro has joined #openstack-swift | 17:25 | |
*** Masahiro has quit IRC | 17:29 | |
*** foexle has quit IRC | 17:33 | |
*** nellysmitt has joined #openstack-swift | 17:49 | |
*** nellysmitt has quit IRC | 17:54 | |
*** flwang has quit IRC | 18:05 | |
*** kopparam has joined #openstack-swift | 18:17 | |
*** flwang has joined #openstack-swift | 18:18 | |
*** rdaly2 has joined #openstack-swift | 18:29 | |
*** d0ugal_ has joined #openstack-swift | 18:44 | |
*** d0ugal has quit IRC | 18:45 | |
*** d0ugal_ is now known as d0ugal | 18:45 | |
*** d0ugal is now known as Guest18170 | 18:46 | |
*** exploreshaifali has quit IRC | 18:47 | |
*** kopparam has quit IRC | 18:47 | |
*** openstackgerrit has quit IRC | 18:48 | |
*** openstackgerrit has joined #openstack-swift | 18:52 | |
*** foexle has joined #openstack-swift | 18:56 | |
*** Masahiro has joined #openstack-swift | 19:13 | |
*** foexle has quit IRC | 19:14 | |
*** foexle has joined #openstack-swift | 19:16 | |
*** rdaly2 has quit IRC | 19:16 | |
*** silor has quit IRC | 19:17 | |
*** Masahiro has quit IRC | 19:18 | |
*** rdaly2 has joined #openstack-swift | 19:18 | |
*** rdaly2 has quit IRC | 19:19 | |
*** foexle has quit IRC | 19:25 | |
*** Viswanath has joined #openstack-swift | 19:26 | |
*** rdaly2 has joined #openstack-swift | 19:26 | |
*** Viswanath has quit IRC | 19:29 | |
*** rdaly2 has quit IRC | 19:30 | |
*** NM has joined #openstack-swift | 19:32 | |
*** NM has quit IRC | 19:33 | |
*** exploreshaifali has joined #openstack-swift | 19:40 | |
*** exploreshaifali has quit IRC | 19:41 | |
*** nellysmitt has joined #openstack-swift | 19:50 | |
*** nellysmitt has quit IRC | 19:55 | |
*** mmcardle has joined #openstack-swift | 20:27 | |
*** mmcardle has quit IRC | 20:44 | |
*** flwang has quit IRC | 20:56 | |
*** Masahiro has joined #openstack-swift | 21:02 | |
*** Masahiro has quit IRC | 21:07 | |
*** flwang has joined #openstack-swift | 21:15 | |
*** kopparam has joined #openstack-swift | 21:21 | |
*** tellesnobrega_ has quit IRC | 21:42 | |
*** kopparam has quit IRC | 21:49 | |
*** nellysmitt has joined #openstack-swift | 21:51 | |
*** nellysmitt has quit IRC | 21:55 | |
*** flwang has quit IRC | 22:17 | |
*** Masahiro has joined #openstack-swift | 22:51 | |
*** Masahiro has quit IRC | 22:55 | |
*** flwang has joined #openstack-swift | 22:55 | |
*** flwang has quit IRC | 23:04 | |
*** tellesnobrega_ has joined #openstack-swift | 23:12 | |
*** tellesnobrega_ has quit IRC | 23:38 | |
*** kopparam has joined #openstack-swift | 23:38 | |
*** tellesnobrega_ has joined #openstack-swift | 23:38 | |
*** flwang has joined #openstack-swift | 23:38 | |
*** tellesnobrega_ has quit IRC | 23:39 | |
*** nellysmitt has joined #openstack-swift | 23:52 | |
*** nellysmitt has quit IRC | 23:56 | |
*** flwang has quit IRC | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!