| *** oz_akan_ has joined #openstack-marconi | 00:00 | |
| *** jcru has quit IRC | 00:01 | |
| *** tedross has quit IRC | 00:03 | |
| *** oz_akan_ has quit IRC | 00:14 | |
| *** cpallares has joined #openstack-marconi | 00:20 | |
| *** cpallares has quit IRC | 00:20 | |
| *** cpallare_ has joined #openstack-marconi | 00:24 | |
| *** amitgandhi has joined #openstack-marconi | 00:35 | |
| *** amitgandhi has quit IRC | 00:42 | |
| *** cpallare_ has quit IRC | 00:54 | |
| *** amitgandhi has joined #openstack-marconi | 00:54 | |
| *** nosnos has joined #openstack-marconi | 01:12 | |
| *** cpallares has joined #openstack-marconi | 01:14 | |
| *** fifieldt has quit IRC | 01:40 | |
| *** mpanetta has quit IRC | 01:56 | |
| *** nosnos_ has joined #openstack-marconi | 02:01 | |
| *** nosnos has quit IRC | 02:04 | |
| *** amitgandhi has quit IRC | 02:09 | |
| *** amitgandhi has joined #openstack-marconi | 02:10 | |
| *** cpallares has quit IRC | 02:12 | |
| *** amitgandhi has quit IRC | 02:14 | |
| *** nosnos_ has quit IRC | 02:30 | |
| *** nosnos has joined #openstack-marconi | 02:31 | |
| *** haomaiwa_ has joined #openstack-marconi | 02:33 | |
| *** amitgandhi has joined #openstack-marconi | 03:10 | |
| *** amitgandhi has quit IRC | 03:15 | |
| *** amitgandhi has joined #openstack-marconi | 04:11 | |
| *** amitgandhi has quit IRC | 04:18 | |
| *** ayoung has quit IRC | 04:24 | |
| *** EmilienM has quit IRC | 06:13 | |
| *** jraim_ has quit IRC | 06:14 | |
| *** amitgandhi has joined #openstack-marconi | 06:15 | |
| *** wirehead_ has quit IRC | 06:15 | |
| *** wirehead_ has joined #openstack-marconi | 06:16 | |
| *** EmilienM has joined #openstack-marconi | 06:18 | |
| *** amitgandhi has quit IRC | 06:19 | |
| *** fifieldt has joined #openstack-marconi | 06:38 | |
| *** amitgandhi has joined #openstack-marconi | 07:15 | |
| *** amitgandhi has quit IRC | 07:20 | |
| *** jraim has joined #openstack-marconi | 08:03 | |
| *** amitgandhi has joined #openstack-marconi | 08:16 | |
| *** amitgandhi has quit IRC | 08:20 | |
| *** yassine has joined #openstack-marconi | 08:54 | |
| *** briancline has quit IRC | 08:56 | |
| *** EmilienM has quit IRC | 08:56 | |
| *** briancline has joined #openstack-marconi | 08:56 | |
| *** EmilienM has joined #openstack-marconi | 08:56 | |
| *** nosnos_ has joined #openstack-marconi | 08:57 | |
| *** fifieldt has quit IRC | 08:58 | |
| *** nosnos has quit IRC | 09:01 | |
| *** amitgandhi has joined #openstack-marconi | 09:17 | |
| *** _alexr_ has joined #openstack-marconi | 09:17 | |
| *** amitgandhi has quit IRC | 09:23 | |
| *** jamieh__ has joined #openstack-marconi | 09:28 | |
| *** ioncat has joined #openstack-marconi | 09:57 | |
| *** amitgandhi has joined #openstack-marconi | 10:20 | |
| *** ekarlso has quit IRC | 10:20 | |
| *** ekarlso has joined #openstack-marconi | 10:21 | |
| *** amitgandhi has quit IRC | 10:24 | |
| *** haomaiwa_ has quit IRC | 10:30 | |
| *** haomaiwang has joined #openstack-marconi | 10:31 | |
| *** haomaiwang has quit IRC | 10:36 | |
| *** nosnos_ has quit IRC | 11:08 | |
| *** nosnos has joined #openstack-marconi | 11:09 | |
| *** amitgandhi has joined #openstack-marconi | 11:20 | |
| *** amitgandhi has quit IRC | 11:24 | |
| *** haomaiwang has joined #openstack-marconi | 11:54 | |
| *** alcabrera has joined #openstack-marconi | 12:02 | |
| alcabrera | Good morning! | 12:04 |
|---|---|---|
| *** nosnos_ has joined #openstack-marconi | 12:07 | |
| *** nosnos has quit IRC | 12:10 | |
| *** nosnos_ has quit IRC | 12:11 | |
| *** amitgandhi has joined #openstack-marconi | 12:21 | |
| *** amitgandhi has quit IRC | 12:25 | |
| *** tedross has joined #openstack-marconi | 12:34 | |
| *** yassine has quit IRC | 12:54 | |
| *** yassine has joined #openstack-marconi | 12:54 | |
| *** amitgandhi has joined #openstack-marconi | 13:21 | |
| *** flaper87|afk is now known as flaper87 | 13:23 | |
| *** amitgandhi has quit IRC | 13:26 | |
| *** mcpierce has joined #openstack-marconi | 13:28 | |
| alcabrera | flaper87: o/ | 13:30 |
| flaper87 | alcabrera: yo yo yo!!!!! | 13:30 |
| flaper87 | alcabrera: goood morning! | 13:30 |
| alcabrera | :D | 13:31 |
| alcabrera | How goes your day? | 13:31 |
| flaper87 | alcabrera: it's going well, family leaves today so, a bit down! | 13:42 |
| flaper87 | alcabrera: what about you? | 13:42 |
| flaper87 | I'll get up to speed with reviews today / tomorrow morning | 13:42 |
| alcabrera | flaper87: time with family is good. I've been working from home more often to spend a little more time with my wife. :) | 13:44 |
| alcabrera | Things are going pretty well. I'm bordering hungry at this point, so I might go make breakfast soon. :D | 13:44 |
| alcabrera | I was going to mention reviews soon. We've got a bit of a backlog, but it's not too bad. | 13:45 |
| alcabrera | Oh! | 13:45 |
| alcabrera | That reminds me. | 13:45 |
| alcabrera | flaper87: with help from malini_afk, oz_akan, and mpanetta, we were able to really test out Marconi's scaling capabilities over the past week. | 13:46 |
| alcabrera | *especially* with regards to the sharding patch. | 13:46 |
| alcabrera | Awesome news | 13:46 |
| alcabrera | http://198.61.239.147:8000/log/20131111-2217/report.html | 13:46 |
| alcabrera | It scales. :D | 13:46 |
| flaper87 | HOLY SHIT!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! | 13:47 |
| flaper87 | (plop) | 13:47 |
| flaper87 | those are amazing news | 13:47 |
| flaper87 | sounds like we could do better on gets | 13:47 |
| alcabrera | hahaha | 13:48 |
| alcabrera | yeah, I was really happy about this, since we were trying to solve the mystery of scaling all last week. | 13:48 |
| alcabrera | At one point, we thought there was something wrong with all kinds of things (caching, network, etc.), but it just turned out that we were saturating tsung's load testing capabilities on 3 machines. We needed to bump the load generation servers up to 9. >.> | 13:49 |
| alcabrera | I wonder how we could do gets faster...? | 13:49 |
| alcabrera | I made a small optimization to deletes in the process of figuring out the scaling last week: https://github.com/rackerlabs/marconi/commit/a07dfad8f62a213a063727655c54ae0106ea82b1 | 13:50 |
| alcabrera | It's a patch I need to port over sometime soon - tiny one. :) | 13:51 |
| flaper87 | alcabrera: i think we'll have to profile queries again and figure out if there are queries that are not hitting the index | 13:57 |
| flaper87 | alcabrera: +1 for that optimization | 13:57 |
| flaper87 | alcabrera: all that is being tested on replica sets, right? | 13:58 |
| alcabrera | yup | 13:58 |
| alcabrera | It's... | 13:59 |
| alcabrera | 3 shards | 13:59 |
| alcabrera | each consisting of a replica set with 3 mongodbs | 13:59 |
| alcabrera | so 3*3s | 13:59 |
| alcabrera | flaper87: I profile'd all of the queries when I found that opt. | 13:59 |
| alcabrera | All of the 'finds' were hitting the index. | 13:59 |
| alcabrera | That one was just having to choose between 5 indices. | 14:00 |
| alcabrera | By profiled, I mean, pprint.pprint(cursor.explain) all the places. :P | 14:00 |
| flaper87 | mmhhh, interesting! | 14:00 |
| flaper87 | LOOOOOOOOOOOOOOOOOL | 14:00 |
| flaper87 | alcabrera: I think we need to enable the db profiler and configure MMS again | 14:00 |
| alcabrera | +1 | 14:01 |
| flaper87 | and see which queries are taking longer | 14:01 |
| flaper87 | that being said, do you know if it was hitting the replica as opposed to the master? | 14:01 |
| alcabrera | I'm not sure on that. | 14:01 |
| alcabrera | I suspect oz_akan and/or mpanetta could tell you more on which particular instance was taking the load. | 14:02 |
| flaper87 | ok | 14:02 |
| flaper87 | I'm thinking about mongod instance not being warmed up | 14:02 |
| flaper87 | or the mmap LRU not being enough | 14:03 |
| *** oz_akan_ has joined #openstack-marconi | 14:03 | |
| *** oz_akan_ has quit IRC | 14:04 | |
| *** oz_akan_ has joined #openstack-marconi | 14:05 | |
| alcabrera | oz_akan_: o/ | 14:06 |
| oz_akan_ | alcabrera: yep? | 14:07 |
| alcabrera | good morning. :) | 14:10 |
| alcabrera | oz_akan_: also, would you happen to have some data on whether our tests were hitting the primary or secondaries? | 14:11 |
| oz_akan_ | writes go to primary, reads go to secondaries excepts claims | 14:12 |
| *** flaper87 is now known as flaper87|afk | 14:13 | |
| alcabrera | flaper87: ^^ | 14:13 |
| alcabrera | flaper87|afk: just missed you. :P | 14:13 |
| *** amitgandhi has joined #openstack-marconi | 14:18 | |
| *** yassine has quit IRC | 14:27 | |
| *** jcru has joined #openstack-marconi | 14:37 | |
| *** ayoung has joined #openstack-marconi | 14:41 | |
| *** yassine has joined #openstack-marconi | 14:43 | |
| *** haomaiwang has quit IRC | 15:27 | |
| *** haomaiwang has joined #openstack-marconi | 15:27 | |
| *** haomaiwang has quit IRC | 15:32 | |
| *** malini_afk is now known as malini | 15:45 | |
| *** mpanetta has joined #openstack-marconi | 15:47 | |
| *** alcabrera has quit IRC | 15:48 | |
| *** malini is now known as malini_afk | 15:56 | |
| *** briancline has quit IRC | 16:02 | |
| *** briancline has joined #openstack-marconi | 16:13 | |
| *** amitgandhi has quit IRC | 16:36 | |
| *** jergerber has joined #openstack-marconi | 16:37 | |
| *** amitgandhi has joined #openstack-marconi | 16:37 | |
| *** amitgandhi has quit IRC | 16:38 | |
| *** amitgandhi has joined #openstack-marconi | 16:38 | |
| *** openstackgerrit has quit IRC | 17:03 | |
| *** yassine has quit IRC | 17:03 | |
| *** openstackgerrit has joined #openstack-marconi | 17:04 | |
| *** oz_akan_ has quit IRC | 17:33 | |
| *** cindy_ has joined #openstack-marconi | 17:36 | |
| *** cindy_ is now known as cpallares | 17:36 | |
| *** _alexr_ has quit IRC | 17:39 | |
| *** jamieh__ has quit IRC | 18:03 | |
| *** oz_akan_ has joined #openstack-marconi | 18:43 | |
| *** oz_akan_ has quit IRC | 18:50 | |
| *** oz_akan_ has joined #openstack-marconi | 18:50 | |
| *** alcabrera has joined #openstack-marconi | 18:56 | |
| *** alcabrera has quit IRC | 19:19 | |
| *** ekarlso has quit IRC | 20:22 | |
| *** ekarlso has joined #openstack-marconi | 20:22 | |
| *** jamieh__ has joined #openstack-marconi | 20:25 | |
| *** kgriffs_afk is now known as kgriffs | 20:42 | |
| *** jamieh__ has quit IRC | 20:49 | |
| *** jamieh__ has joined #openstack-marconi | 20:53 | |
| *** amit has joined #openstack-marconi | 22:16 | |
| *** amit is now known as Guest39481 | 22:16 | |
| *** amitgandhi has quit IRC | 22:19 | |
| openstackgerrit | A change was merged to openstack/python-marconiclient: Updated the readme to have valid links https://review.openstack.org/54406 | 22:24 |
| *** Guest39481 has quit IRC | 22:24 | |
| *** amitgandhi has joined #openstack-marconi | 22:25 | |
| *** ayoung has quit IRC | 22:39 | |
| *** mpanetta has quit IRC | 22:54 | |
| *** kgriffs is now known as kgriffs_afk | 22:55 | |
| *** amitgandhi has quit IRC | 23:03 | |
| *** amitgandhi has joined #openstack-marconi | 23:04 | |
| *** amitgandhi has quit IRC | 23:09 | |
| *** jergerber has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!