*** flwang has quit IRC | 00:02 | |
*** amitgandhi has joined #openstack-marconi | 00:08 | |
*** amitgandhi has quit IRC | 00:12 | |
*** flwang has joined #openstack-marconi | 00:20 | |
*** balajiiyer has joined #openstack-marconi | 00:21 | |
*** oz_akan_ has joined #openstack-marconi | 00:24 | |
*** reed has quit IRC | 00:28 | |
*** rongze has joined #openstack-marconi | 00:35 | |
*** rongze has quit IRC | 00:40 | |
*** flaper87 is now known as flaper87|afk | 00:42 | |
*** reed has joined #openstack-marconi | 00:44 | |
*** reed has quit IRC | 00:48 | |
*** kgriffs_afk is now known as kgriffs | 00:50 | |
*** amitgandhi has joined #openstack-marconi | 01:09 | |
*** kgriffs is now known as kgriffs_afk | 01:10 | |
*** amitgandhi has quit IRC | 01:15 | |
*** nosnos has joined #openstack-marconi | 01:35 | |
*** malini_afk is now known as malini | 01:43 | |
*** rongze has joined #openstack-marconi | 01:46 | |
*** kgriffs_afk is now known as kgriffs | 01:49 | |
*** renlt has joined #openstack-marconi | 02:05 | |
*** haomaiwa_ has quit IRC | 02:10 | |
*** haomaiwang has joined #openstack-marconi | 02:10 | |
*** haomaiwa_ has joined #openstack-marconi | 02:15 | |
*** haomaiwang has quit IRC | 02:17 | |
*** malini is now known as malini_afk | 02:51 | |
*** amitgandhi has joined #openstack-marconi | 03:12 | |
*** amitgandhi has quit IRC | 03:17 | |
*** kgriffs is now known as kgriffs_afk | 04:05 | |
*** amitgandhi has joined #openstack-marconi | 04:13 | |
*** amitgandhi has quit IRC | 04:17 | |
*** liang has joined #openstack-marconi | 04:22 | |
*** balajiiyer has quit IRC | 04:31 | |
*** rongze has quit IRC | 04:52 | |
*** chandankumar_ has joined #openstack-marconi | 05:08 | |
openstackgerrit | A change was merged to openstack/marconi: fix: ConnectionError no longer takes positional arguments https://review.openstack.org/68161 | 05:11 |
---|---|---|
*** amitgandhi has joined #openstack-marconi | 05:13 | |
*** amitgandhi has quit IRC | 05:18 | |
*** rongze has joined #openstack-marconi | 05:23 | |
*** rongze has quit IRC | 05:28 | |
*** rongze has joined #openstack-marconi | 05:35 | |
*** flwang has quit IRC | 05:36 | |
*** rongze has quit IRC | 05:40 | |
*** flwang has joined #openstack-marconi | 05:59 | |
*** oz_akan_ has quit IRC | 06:11 | |
*** amitgandhi has joined #openstack-marconi | 06:14 | |
*** rongze has joined #openstack-marconi | 06:17 | |
*** amitgandhi has quit IRC | 06:18 | |
*** oz_akan_ has joined #openstack-marconi | 06:42 | |
*** nosnos_ has joined #openstack-marconi | 06:43 | |
*** nosnos has quit IRC | 06:43 | |
*** oz_akan_ has quit IRC | 06:47 | |
*** amitgandhi has joined #openstack-marconi | 07:15 | |
*** amitgandhi has quit IRC | 07:19 | |
*** oz_akan_ has joined #openstack-marconi | 07:43 | |
*** oz_akan_ has quit IRC | 07:48 | |
*** flaper87|afk is now known as flaper87 | 08:03 | |
*** amitgandhi has joined #openstack-marconi | 08:15 | |
*** renlt has quit IRC | 08:18 | |
*** amitgandhi has quit IRC | 08:20 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Sync oslo-cache from oslo-incubator https://review.openstack.org/68121 | 08:36 |
*** oz_akan_ has joined #openstack-marconi | 08:44 | |
*** oz_akan_ has quit IRC | 08:48 | |
*** ykaplan has joined #openstack-marconi | 09:10 | |
*** amitgandhi has joined #openstack-marconi | 09:16 | |
liang | flaper87, there? | 09:17 |
flaper87 | liang: yes sir | 09:17 |
liang | flaper87, ;) | 09:18 |
liang | I have a question about the usage of the client lib - I always need to ensure the endpoint url contains '/v1' at the end. I am not sure if I missed something or it's supposed to be used that way. I proposed a patch for devstack on https://review.openstack.org/#/c/60754/ a while ago, but the feedback was that the version info would be eliminated even from the other APIs. | 09:18 |
flaper87 | liang: mhh, that's a good point. I didn't put it in keystone on purpose | 09:20 |
flaper87 | because of what Dean said | 09:21 |
*** amitgandhi has quit IRC | 09:21 | |
flaper87 | but I'm not sure there's actually a good way to append this to the url returned by keystone. I don't recall adding it | 09:21 |
flaper87 | mmhh | 09:21 |
flaper87 | let me check | 09:21 |
liang | I think keystone will just store the endpoint untouched. | 09:22 |
liang | In that case, we cannot directly consume the endpoint retrieved from Keystone. | 09:23 |
flaper87 | oh no, I now remember | 09:23 |
flaper87 | I did add it | 09:23 |
flaper87 | https://github.com/openstack/python-marconiclient/blob/master/marconiclient/transport/http.py#L60 | 09:23 |
flaper87 | marconiclient should add the version lable to the endpoint | 09:23 |
flaper87 | or better, the http transport should | 09:23 |
flaper87 | liang: if you needed that, it means that it's not working | 09:24 |
flaper87 | mmhh | 09:24 |
liang | hehe | 09:24 |
flaper87 | liang: can you debug that line? | 09:25 |
flaper87 | I don't have an environment with keystone and marconi installed handy | 09:25 |
flaper87 | I'll setup one, though | 09:25 |
liang | I seems I have to give the full endpoint with the latest client. | 09:25 |
* flaper87 does that | 09:25 | |
liang | ok | 09:25 |
liang | I will take a look | 09:25 |
flaper87 | liang: how are you creating the client instance ? | 09:25 |
liang | flaper87, http://paste.openstack.org/show/61665/ | 09:26 |
liang | That was extracted from https://review.openstack.org/#/c/61036/6/contrib/marconi-plugin/plugin/queue.py | 09:27 |
flaper87 | mmh, you know marconi can do that for you, don't you? | 09:29 |
flaper87 | I mean, getting the remote url | 09:29 |
flaper87 | from keystone | 09:30 |
flaper87 | liang: https://github.com/openstack/python-marconiclient/blob/master/marconiclient/queues/v1/client.py#L45 | 09:30 |
flaper87 | just pass the 'auth_opts' dict in the conf dict to the client instance | 09:30 |
flaper87 | oh well, you're basically doing that | 09:31 |
flaper87 | for auth | 09:31 |
flaper87 | mmh, probably that linde is a bit dangerous | 09:33 |
liang | yeah, the endpoint passed to client is also retrieved from keystone. And I have tested that | 09:33 |
flaper87 | liang: https://github.com/openstack/python-marconiclient/blob/master/examples/simple.py this works | 09:36 |
flaper87 | the only difference is that the example doesn't use auth_opts | 09:36 |
flaper87 | liang: I'll have to dig more into that :( let me setup an environement with keysotne and marconi | 09:39 |
*** oz_akan_ has joined #openstack-marconi | 09:44 | |
*** flwang has quit IRC | 09:47 | |
*** oz_akan_ has quit IRC | 09:49 | |
liang | flaper87, Thanks! | 09:49 |
liang | flaper87, a quick question, was the intention of https://github.com/openstack/python-marconiclient/blob/master/marconiclient/transport/http.py#L60 to add the /v1 prefix to the str ref? | 09:50 |
flaper87 | liang: that line removes the version from the reference because href are not suppose to have the version number, it should be set by the API itself | 09:54 |
flaper87 | I now have some doubts about that line | 09:54 |
flaper87 | also, there seems to be a missing append of the API version to the URL somewhere there | 09:54 |
flaper87 | :/ | 09:55 |
liang | Thanks! It seems the version number should be striped off from request.endpoint if it is there. Then add the version prefix to ref. So later when endpoint and ref is concatenated together the version number will be there. | 10:01 |
flaper87 | liang: yeah, more like "prepend the API version if it's not already there" | 10:02 |
liang | flaper87, yeah | 10:03 |
liang | flaper87, BTW, regarding the heat plugin patch, I moved the code to Heat contrib directory to speed up the review process hopefully. | 10:05 |
flaper87 | liang: cool, it makes sense. I guess you can move out of there when marconi will be integrated | 10:06 |
liang | flaper87, yeah, exactly what I planed to do ;) | 10:06 |
flaper87 | awesome :D | 10:06 |
liang | ;) | 10:06 |
*** amitgandhi has joined #openstack-marconi | 10:17 | |
*** amitgandhi has quit IRC | 10:21 | |
*** flwang has joined #openstack-marconi | 10:31 | |
*** liang has quit IRC | 10:39 | |
*** oz_akan_ has joined #openstack-marconi | 10:45 | |
*** oz_akan_ has quit IRC | 10:49 | |
*** ykaplan has quit IRC | 11:00 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: DRY applied to class names https://review.openstack.org/68352 | 11:09 |
*** amitgandhi has joined #openstack-marconi | 11:17 | |
*** andreykurilin has joined #openstack-marconi | 11:18 | |
*** amitgandhi has quit IRC | 11:22 | |
*** rongze has quit IRC | 11:26 | |
*** rongze has joined #openstack-marconi | 11:27 | |
*** rongze has quit IRC | 11:31 | |
openstackgerrit | Andrey Kurilin proposed a change to openstack/python-marconiclient: Fix wrong client name in utils https://review.openstack.org/68356 | 11:41 |
*** oz_akan_ has joined #openstack-marconi | 11:46 | |
*** oz_akan__ has joined #openstack-marconi | 11:47 | |
*** oz_akan_ has quit IRC | 11:51 | |
*** oz_akan__ has quit IRC | 11:52 | |
*** rongze has joined #openstack-marconi | 12:09 | |
*** rongze has quit IRC | 12:14 | |
*** amitgandhi has joined #openstack-marconi | 12:18 | |
*** amitgandhi has quit IRC | 12:22 | |
*** rongze has joined #openstack-marconi | 12:39 | |
openstackgerrit | Andrey Kurilin proposed a change to openstack/python-marconiclient: Delete unused module https://review.openstack.org/68356 | 12:39 |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Don't use `override_time` but mock instead https://review.openstack.org/68365 | 12:40 |
*** tedross has joined #openstack-marconi | 12:42 | |
*** mpanetta has joined #openstack-marconi | 12:55 | |
*** ykaplan has joined #openstack-marconi | 13:14 | |
*** amitgandhi has joined #openstack-marconi | 13:19 | |
*** vkmc has joined #openstack-marconi | 13:23 | |
*** vkmc has quit IRC | 13:23 | |
*** vkmc has joined #openstack-marconi | 13:23 | |
*** amitgandhi has quit IRC | 13:23 | |
*** rongze has quit IRC | 13:37 | |
*** thomasem has joined #openstack-marconi | 13:43 | |
*** rongze has joined #openstack-marconi | 13:47 | |
*** cpallares has joined #openstack-marconi | 13:56 | |
*** oz_akan_ has joined #openstack-marconi | 14:06 | |
*** rongze_ has joined #openstack-marconi | 14:14 | |
*** rongze has quit IRC | 14:16 | |
*** oz_akan_ has quit IRC | 14:17 | |
*** haomaiwang has joined #openstack-marconi | 14:17 | |
*** rongze has joined #openstack-marconi | 14:17 | |
*** oz_akan_ has joined #openstack-marconi | 14:18 | |
*** rongze_ has quit IRC | 14:19 | |
*** haomaiwa_ has quit IRC | 14:19 | |
*** jcru has joined #openstack-marconi | 14:20 | |
*** rongze_ has joined #openstack-marconi | 14:22 | |
*** rongze has quit IRC | 14:25 | |
*** amitgandhi has joined #openstack-marconi | 14:33 | |
*** amitgandhi has quit IRC | 14:33 | |
*** ykaplan has quit IRC | 14:34 | |
*** amitgandhi has joined #openstack-marconi | 14:34 | |
*** ykaplan has joined #openstack-marconi | 14:37 | |
*** rongze_ has quit IRC | 14:49 | |
*** balajiiyer has joined #openstack-marconi | 14:51 | |
*** nosnos_ has quit IRC | 14:57 | |
*** ametts has quit IRC | 14:58 | |
*** zyuan has joined #openstack-marconi | 14:58 | |
*** rongze has joined #openstack-marconi | 15:05 | |
*** amitgandhi has quit IRC | 15:07 | |
*** rongze has quit IRC | 15:22 | |
*** malini_afk is now known as malini | 15:22 | |
balajiiyer | Morning | 15:23 |
balajiiyer | kgriffs: Has the tarball been cut ? :) | 15:23 |
flaper87 | balajiiyer: morning :) | 15:23 |
flaper87 | balajiiyer: http://tarballs.openstack.org/marconi/ | 15:23 |
flaper87 | nope | 15:23 |
flaper87 | :) | 15:23 |
*** amitgandhi has joined #openstack-marconi | 15:25 | |
balajiiyer | Ah. ok. Zuul seems to be sane. so thats good news. | 15:26 |
*** amit has joined #openstack-marconi | 15:26 | |
*** amit is now known as Guest77862 | 15:27 | |
flaper87 | balajiiyer: define sane, pls | 15:27 |
flaper87 | :D | 15:27 |
*** amitgandhi has quit IRC | 15:29 | |
*** kgriffs_afk is now known as kgriffs | 15:30 | |
kgriffs | o/ | 15:31 |
* kgriffs hates traffic | 15:31 | |
flaper87 | kgriffs: hey hey! | 15:31 |
balajiiyer | oh, when I looked at it this morning queued events were down to 0. and not 1900+. :) | 15:31 |
kgriffs | heh | 15:31 |
* flaper87 hates traffic too | 15:31 | |
kgriffs | heck of a commute today - I had to drive from Austin to San Antonio. :p | 15:31 |
balajiiyer | kgriffs: I thought you liked traffic. Cars *queued* up on roads. | 15:32 |
kgriffs | LOL | 15:32 |
kgriffs | so, I'm not seeing a branch and/or tag on openstack/marconi | 15:33 |
kgriffs | and no icehouse-2 tarball | 15:34 |
kgriffs | so... | 15:34 |
kgriffs | not sure what is happening there | 15:34 |
kgriffs | was supposed to be done by now | 15:34 |
flaper87 | kgriffs: the cut hasn't been done, AFAIK | 15:34 |
kgriffs | flaper87: looks like it | 15:34 |
kgriffs | maybe ttx slept in. :p | 15:34 |
kgriffs | flaper87: looks like ttx is making the rounds now. | 15:35 |
kgriffs | malini: ping | 15:36 |
malini | kgriffs: pong | 15:36 |
flaper87 | kgriffs: just saw your message | 15:39 |
kgriffs | hey, so i benchmarked that patch | 15:39 |
flaper87 | kgriffs: what patch is pending? | 15:39 |
kgriffs | the atomic one | 15:39 |
kgriffs | i'm not sure it should go in... | 15:39 |
kgriffs | wanted to discuss it real quick | 15:39 |
flaper87 | I thought we said no | 15:39 |
flaper87 | sure | 15:39 |
malini | kgriffs: steppiong away for a meeting..will be back in an hr | 15:39 |
kgriffs | so, i think it is ok to slip it. any objections? | 15:39 |
kgriffs | malini: ok... real quick, the servers you gave me were a bit misconfigured | 15:40 |
kgriffs | really old version of marconi | 15:40 |
kgriffs | wrong ip addressed, etc. | 15:40 |
malini | kgriffs: hmmmm..tht is embarassing | 15:40 |
flaper87 | I was fine with it, TBH | 15:41 |
kgriffs | no problem, I just wanted to share what i did to update them | 15:41 |
kgriffs | flaper87: ok | 15:41 |
malini | you want to update it? | 15:41 |
flaper87 | I even +2'd :D | 15:41 |
malini | kgriffs: ^ | 15:41 |
kgriffs | malini: let's chat more after your meeting | 15:41 |
malini | ok | 15:41 |
flaper87 | that based on the thoughts that we'll need it and that we can improve it during i-3 | 15:41 |
kgriffs | but, my benchmarks showed no difference after the patch | 15:41 |
kgriffs | flaper87: ah, makes sense | 15:41 |
kgriffs | well... | 15:41 |
kgriffs | i think we might as well do it then. Code looks good, and benchmarks looks good - we can do more rigorous testing in i-3 | 15:42 |
kgriffs | sound OK? | 15:42 |
flaper87 | kgriffs: lets go for it | 15:42 |
kgriffs | looks like alej +2d so u can approve | 15:42 |
flaper87 | +A | 15:43 |
kgriffs | kk | 15:43 |
kgriffs | come on, zuul! | 15:47 |
kgriffs | any moment now... | 15:47 |
kgriffs | man | 15:51 |
kgriffs | soooo slow | 15:52 |
flaper87 | hehehe | 15:57 |
flaper87 | patience, young padawan | 15:58 |
*** chandankumar_ has quit IRC | 15:58 | |
openstackgerrit | A change was merged to openstack/marconi: fix(mongodb): Ensure batch message posts are atomic (all or nothing) https://review.openstack.org/67320 | 15:59 |
flaper87 | w00000000000000000000000000000000t | 15:59 |
*** Guest77862 has quit IRC | 16:01 | |
*** chandankumar_ has joined #openstack-marconi | 16:01 | |
*** sballe has joined #openstack-marconi | 16:02 | |
*** jamieh has joined #openstack-marconi | 16:02 | |
*** amitgandhi has joined #openstack-marconi | 16:16 | |
*** amit has joined #openstack-marconi | 16:17 | |
*** amit is now known as Guest4766 | 16:17 | |
*** Guest4766 is now known as amitgandhi_ | 16:17 | |
*** amitgandhi_ has quit IRC | 16:18 | |
*** amitgandhi has quit IRC | 16:20 | |
*** amitgandhi has joined #openstack-marconi | 16:21 | |
*** tedross has quit IRC | 16:33 | |
malini | kgriffs: sorry abt the whole mess up | 16:35 |
malini | Was trying to do too many things at once | 16:35 |
malini | But we really need to get the benchmarking stuff in our jenkins pipeline | 16:36 |
malini | I'll start working on it some time after mid Feb | 16:37 |
kgriffs | oz_akan_: some other dbs I have started looking at that could be alternatives to mongodb - http://www.orientechnologies.com/orientdb-vs-mongodb/, https://foundationdb.com, http://voltdb.com/ | 16:41 |
kgriffs | malini: hey, no worries. | 16:41 |
kgriffs | +1 for getting it into our pipeline | 16:41 |
kgriffs | anybody heard of a sort of "travis" for load testing? | 16:42 |
kgriffs | (Travis CI) | 16:42 |
* flaper87 doesn't recommend Orient. Not yet! | 16:43 | |
oz_akan_ | kgriffs: voltdb is too radical | 16:43 |
oz_akan_ | if it works it might work well | 16:43 |
oz_akan_ | I am not aware of others | 16:44 |
oz_akan_ | we need a db which can shard automatically | 16:44 |
oz_akan_ | or use ring (consistent hashing) | 16:44 |
oz_akan_ | I will reboot my laptop | 16:44 |
*** oz_akan_ has quit IRC | 16:44 | |
kgriffs | voltdb is backed by some hard-core research - not really "radical" as in "risky" i would say, but "radical" as in NewSQL | 16:45 |
*** tedross has joined #openstack-marconi | 16:45 | |
*** ykaplan has quit IRC | 16:45 | |
kgriffs | oz_akan_: mongodb can shard automatically | 16:45 |
kgriffs | flaper87: is orient too new or what? | 16:46 |
flaper87 | kgriffs: yeah, sorry, that was to vague | 16:46 |
flaper87 | so, it's not too bad. It's not too new either. IMHO, it's too many things. Also, I've close friends working with it and although they like it, the don't think it's there yet | 16:47 |
flaper87 | the comment is still vague but that's what I've got. It's all based on references | 16:47 |
flaper87 | from other trusted devs | 16:47 |
flaper87 | speaking of rings: https://github.com/flaper87/rust-ring | 16:48 |
flaper87 | :D | 16:48 |
flaper87 | I still have to complete it, I'll put some time on it today | 16:48 |
*** whenry has joined #openstack-marconi | 16:51 | |
kgriffs | flaper87: kk | 16:52 |
kgriffs | (wrt orient) | 16:52 |
kgriffs | so, I made this: https://blueprints.launchpad.net/marconi/+spec/alternative-storage-drivers | 16:52 |
kgriffs | not something to worry about right now, but maybe later | 16:52 |
kgriffs | flaper87: so, fwi, Oz is concerned that we can't balance a single queue across multiple storage shards right now | 16:53 |
kgriffs | but... | 16:53 |
flaper87 | I really would like us to dedicate some thoughts and time to real queuing technologies and see how we can integrate with those. I haven't dedicated enough time to that myself but I will | 16:53 |
kgriffs | flaper87: yeah | 16:53 |
kgriffs | so, the thing is, we keep using these DB things that weren't really designed for queueing, but they work OK | 16:53 |
flaper87 | kgriffs: mmg, why can't we shard queues ? | 16:53 |
kgriffs | so, there are two things to deal with | 16:54 |
kgriffs | first, the monotonic marker thing | 16:54 |
kgriffs | second, behavior of queues | 16:54 |
kgriffs | wrt behavior, you would expect the head and tail of the queue to be the most frequently accessed | 16:55 |
kgriffs | so, you can't simply do ranged sharding since you just end up with two roaming hotspots | 16:55 |
flaper87 | what about using p_q as sharding key? | 16:55 |
kgriffs | so, then you say, let's hash it out, so then my writes are fast, but my reads have to hit N nodes to gather in the results | 16:55 |
flaper87 | ah wait, he wants to split the queue | 16:56 |
kgriffs | yeah | 16:56 |
flaper87 | TBH, I don't think splitting the queue is a good idea. | 16:56 |
kgriffs | so I believe SQS does something of sharding a single queue but they are probably clever and try to minimize the number of nodes you have to query for a given range | 16:57 |
kgriffs | flaper87: yeah, that was my next thought | 16:57 |
flaper87 | I don't think there's much benefit from splitting the queue. Keeping it in a single shard makes queries faster, safer and isolated | 16:57 |
flaper87 | helps balancing the load | 16:57 |
kgriffs | yes, true | 16:57 |
*** tedross has quit IRC | 16:57 | |
kgriffs | the only thing is what to do with a really hot queue | 16:57 |
flaper87 | and more shards can be added without re-balancing others | 16:57 |
kgriffs | you can rate-limit to reduce impact on neighbors | 16:58 |
kgriffs | or you can migrate to less-busy node or eventually to a single-tenant shard, if you can make that cost-effective | 16:58 |
flaper87 | kgriffs: my first thought about that was: "That's the price to pay" which is not useful but kinda true | 16:58 |
flaper87 | a couple of solutions would be to migrate to an isolated node | 16:58 |
flaper87 | add replicas to the shard | 16:58 |
kgriffs | i think you could have a graduated response | 16:59 |
flaper87 | which will help distributing reads | 16:59 |
flaper87 | right | 16:59 |
kgriffs | you have shards that have fewer and fewer queues | 16:59 |
kgriffs | at some point you get to 1:1 | 16:59 |
kgriffs | now, if the user needs MOR | 16:59 |
kgriffs | you must scale up that single shard | 16:59 |
kgriffs | or just tell them go deploy it yourself | 16:59 |
flaper87 | also, that's one of the reasons why marconi's shards per queue (besides all the complex logics of doing a more granular shard) | 16:59 |
kgriffs | i'm pretty sure that 99% of users don't need extreme performance out of a single queue | 17:00 |
kgriffs | flaper87: right, and I'm still not convinced that it is a net win to shard a single queue | 17:00 |
kgriffs | for swift it works fine | 17:00 |
notmyname | ? | 17:01 |
kgriffs | but queue messages are short-lived and arranged as a time series | 17:01 |
flaper87 | yeah, but swift knows how to do it. Marconi doesn't | 17:01 |
kgriffs | notmyname: just talking about sharding object | 17:01 |
flaper87 | I mean, marconi relies on the underlying service | 17:01 |
flaper87 | it doesn't know how to do real sharding | 17:01 |
flaper87 | but anyway, I don't think sharding a queue on mongodb would give any real benefit | 17:02 |
flaper87 | we could do some tests / benchmarks | 17:02 |
kgriffs | flaper87: yeah, unless you are getting a lot of random access for queue messages, which I don't think is the usual use case! | 17:02 |
flaper87 | exactly | 17:04 |
kgriffs | i mean, what would you shard on? you could shard on time, but then you have roaming hotspot problem. You could use hash-based sharding but then you end up with scatter-gather queries | 17:04 |
kgriffs | tricky | 17:04 |
*** vkmc has quit IRC | 17:04 | |
flaper87 | also, splitting the queue has a penalty in the time constraint of marconi's response | 17:04 |
kgriffs | if you can limit the scatter-gather to a subset of nodes, it could maybe help | 17:04 |
kgriffs | but still a P | 17:04 |
kgriffs | PITA | 17:04 |
flaper87 | we don't have a specific expectation just yet, but we will at some point. | 17:04 |
kgriffs | flaper87: true | 17:05 |
flaper87 | one more -1 for sharding | 17:05 |
kgriffs | you can query multiple nodes in parallel, but then you have to take the time to splice things together | 17:05 |
flaper87 | if makes marconi less fault-tolerant | 17:05 |
flaper87 | if 1 shard goes down, we don't know how much knowledge per queue it has | 17:05 |
kgriffs | and then you really have to have some kind of proxy that sets the marker which means at some point everything will go through a single choke point anyway | 17:05 |
kgriffs | flaper87: yep | 17:06 |
flaper87 | it's also true that if a shard goes down, all the info about some queues will be lost | 17:06 |
flaper87 | assuming there are no replicas | 17:06 |
kgriffs | makes things very complicated | 17:06 |
*** tedross has joined #openstack-marconi | 17:06 | |
flaper87 | but anyway, it's about choosing whether to make all clients partially sad or some really sad while others will remain happy | 17:06 |
kgriffs | given all our constraints, i think our best bet is to try the approach of a sort of "winnowing" rebalancer | 17:06 |
flaper87 | all that being said, users can still shard queues, marconi should be able to talk to shard envs easily | 17:07 |
kgriffs | by users you mean operators? | 17:07 |
kgriffs | as in, they could have a storage driver that shards itself or relies on underlying db to do it? | 17:07 |
* kgriffs is about to run out of battery juice and needs to go borrow an adapter | 17:09 | |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: fix: Checking whether queue exists adds latency https://review.openstack.org/67978 | 17:09 |
flaper87 | kgriffs: yup | 17:10 |
flaper87 | kgriffs: yup, operator | 17:10 |
kgriffs | kk | 17:10 |
kgriffs | makes sense | 17:10 |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Add a _config_options function to Marconi https://review.openstack.org/68441 | 17:11 |
kgriffs | flaper87: consider, using containers a public provider could give someone a single-tenant marconi instance that rate-limits organically simply by restricting cpu slice they get | 17:11 |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: fix(wsgi): Cleanup limit config options https://review.openstack.org/67597 | 17:12 |
kgriffs | woot | 17:12 |
kgriffs | http://tarballs.openstack.org/marconi/ | 17:12 |
kgriffs | https://github.com/openstack/marconi/tree/milestone-proposed | 17:13 |
flaper87 | w000t | 17:13 |
*** zyuan has quit IRC | 17:14 | |
*** whenry has quit IRC | 17:15 | |
*** whenry has joined #openstack-marconi | 17:15 | |
*** tedross has quit IRC | 17:15 | |
*** alcabrera has joined #openstack-marconi | 17:16 | |
alcabrera | Hey! :D | 17:16 |
flaper87 | alcabrera: 'sup man! | 17:19 |
flaper87 | alcabrera: https://github.com/openstack/marconi/tree/milestone-proposed | 17:20 |
*** kgriffs is now known as kgriffs_afk | 17:20 | |
*** chandankumar_ has quit IRC | 17:24 | |
*** tedross has joined #openstack-marconi | 17:24 | |
* alcabrera checks | 17:26 | |
*** vkmc has joined #openstack-marconi | 17:28 | |
*** chandankumar_ has joined #openstack-marconi | 17:29 | |
*** jmckind has joined #openstack-marconi | 17:30 | |
alcabrera | woooo, milestone *cut* | 17:35 |
alcabrera | :D | 17:35 |
alcabrera | flaper87: ! | 17:35 |
flaper87 | :D | 17:35 |
alcabrera | so.... | 17:36 |
alcabrera | hmmm | 17:36 |
alcabrera | when do we get to do 'pip install marconi'? | 17:36 |
alcabrera | :D | 17:36 |
alcabrera | is that a thing? | 17:36 |
alcabrera | for OS projects? | 17:36 |
alcabrera | because marconi would benefit intensely from taht | 17:36 |
alcabrera | *that | 17:37 |
flaper87 | mmh nope, server modules don't get to pypi, AFAIK. | 17:37 |
flaper87 | but you can pip install -f tarball | 17:37 |
alcabrera | fair enough | 17:40 |
*** amitgandhi has quit IRC | 18:02 | |
*** amitgandhi has joined #openstack-marconi | 18:23 | |
*** amitgandhi has quit IRC | 18:28 | |
*** amitgandhi has joined #openstack-marconi | 18:29 | |
*** zyuan has joined #openstack-marconi | 18:33 | |
*** jamieh has quit IRC | 18:42 | |
*** oz_akan_ has joined #openstack-marconi | 18:56 | |
*** zyuan has quit IRC | 19:50 | |
*** cpallares has quit IRC | 19:50 | |
*** zyuan has joined #openstack-marconi | 19:52 | |
*** zyuan has joined #openstack-marconi | 19:53 | |
*** kgriffs_afk is now known as kgriffs | 20:09 | |
kgriffs | lovely | 20:11 |
kgriffs | http://logs.openstack.org/78/67978/2/check/gate-marconi-python27/7f2fc97/console.html | 20:11 |
kgriffs | anybody already looking at that? | 20:11 |
kgriffs | I guess that's a "no"? | 20:17 |
kgriffs | alcabrera: ^^^ | 20:17 |
kgriffs | another one: http://logs.openstack.org/97/67597/3/check/gate-marconi-python26/a0f78bc/console.html | 20:18 |
kgriffs | malini: ^^^ | 20:18 |
kgriffs | that either means the wsgi app failed to start (due to unhandled exception) or perhaps we didn't wait long enough for the wsgi server to come up before hitting it? | 20:20 |
* alcabrera catches up | 20:23 | |
alcabrera | kgriffs: that's a surprising error | 20:25 |
alcabrera | no, I haven't even noticed it today | 20:25 |
alcabrera | 'til just now | 20:25 |
alcabrera | as far as the wsgi app failing to start up, I'm not seeing that `marconi-server` mode from latest master. | 20:27 |
kgriffs | hmm | 20:31 |
kgriffs | i haven't been able to repro locally | 20:31 |
kgriffs | (either of those errors) | 20:31 |
kgriffs | alcabrera: looks like the functional tests don't use marconi-server cmd | 20:35 |
kgriffs | uses tests.functional.base.MarconiServer instead | 20:35 |
*** zyuan has quit IRC | 20:44 | |
*** malini is now known as malini_afk | 20:44 | |
*** zyuan has joined #openstack-marconi | 20:55 | |
*** zyuan has quit IRC | 20:59 | |
kgriffs | balajiiyer: ping | 21:06 |
*** amitgandhi has quit IRC | 21:07 | |
balajiiyer | kgriffs: ^^ | 21:09 |
*** zyuan has joined #openstack-marconi | 21:10 | |
*** vkmc has quit IRC | 21:11 | |
*** amitgandhi has joined #openstack-marconi | 21:13 | |
*** zyuan has quit IRC | 21:15 | |
*** amitgandhi has quit IRC | 21:15 | |
*** amitgandhi has joined #openstack-marconi | 21:16 | |
*** zyuan has joined #openstack-marconi | 21:26 | |
*** zyuan has quit IRC | 21:30 | |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: fix: Move decorator out of class definition since it is static https://review.openstack.org/68490 | 21:41 |
*** zyuan has joined #openstack-marconi | 21:42 | |
kgriffs | alcabrera: ^^^ experiment | 21:44 |
kgriffs | to see if that helps with one of the gate errors we've been seeing | 21:45 |
kgriffs | ok guys, I gotta hit the road. | 21:45 |
kgriffs | ttfn | 21:45 |
*** zyuan has quit IRC | 21:47 | |
alcabrera | kgriffs: o/ | 21:51 |
kgriffs | yo | 21:51 |
* kgriffs hasn't left quite yet | 21:51 | |
alcabrera | hehe | 21:52 |
alcabrera | I was about to head out myself. | 21:52 |
*** zyuan has joined #openstack-marconi | 21:58 | |
*** zyuan has quit IRC | 22:02 | |
*** mpanetta has quit IRC | 22:03 | |
*** oz_akan_ has quit IRC | 22:04 | |
*** alcabrera has quit IRC | 22:04 | |
*** zyuan has joined #openstack-marconi | 22:14 | |
*** kgriffs is now known as kgriffs_afk | 22:15 | |
*** zyuan has quit IRC | 22:18 | |
*** zyuan has joined #openstack-marconi | 22:30 | |
*** jergerber has joined #openstack-marconi | 22:31 | |
*** tedross has quit IRC | 22:32 | |
*** zyuan has quit IRC | 22:34 | |
*** zyuan has joined #openstack-marconi | 22:42 | |
*** zyuan has joined #openstack-marconi | 22:43 | |
*** thomasem has quit IRC | 22:48 | |
*** balajiiyer has quit IRC | 22:51 | |
*** amitgandhi has quit IRC | 23:15 | |
*** jcru has quit IRC | 23:20 | |
*** zyuan has quit IRC | 23:21 | |
*** sballe has quit IRC | 23:22 | |
*** sballe has joined #openstack-marconi | 23:22 | |
*** jergerber has quit IRC | 23:24 | |
*** sballe_ has joined #openstack-marconi | 23:34 | |
*** sballe has quit IRC | 23:35 | |
*** jmckind has quit IRC | 23:36 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!