Wednesday, 2013-10-09

*** mpanetta has joined #openstack-marconi00:00
*** mpanetta_ has joined #openstack-marconi00:01
*** amitgandhi has joined #openstack-marconi00:04
*** mpanetta has quit IRC00:05
*** oz_akan_ has joined #openstack-marconi00:09
*** reed has quit IRC00:10
*** mpanetta_ has quit IRC00:29
*** mpanetta has joined #openstack-marconi00:30
*** mpanetta has quit IRC00:34
*** tedross has quit IRC00:36
*** ayoung has quit IRC01:12
*** ayoung has joined #openstack-marconi01:12
*** mpanetta has joined #openstack-marconi01:14
*** mpanetta has quit IRC01:16
*** mpanetta has joined #openstack-marconi01:16
*** malini_afk is now known as malini01:20
*** mpanetta has quit IRC01:21
*** fifieldt has joined #openstack-marconi01:22
*** amitgandhi has quit IRC01:34
*** tedross has joined #openstack-marconi01:54
*** malini is now known as malini_afk02:18
*** tedross has quit IRC02:54
*** openstack has joined #openstack-marconi03:23
*** hobana.freenode.net sets mode: +ns 03:23
*** hobana.freenode.net sets mode: -o openstack03:29
-hobana.freenode.net- *** Notice -- TS for #openstack-marconi changed from 1381289012 to 135837596403:29
*** hobana.freenode.net sets mode: +ct-s 03:29
*** torgomatic has joined #openstack-marconi03:29
*** fifieldt has joined #openstack-marconi03:29
*** ayoung has joined #openstack-marconi03:29
*** oz_akan_ has joined #openstack-marconi03:29
*** jraim has joined #openstack-marconi03:29
*** Alex_Gaynor has joined #openstack-marconi03:29
*** openstackgerrit has joined #openstack-marconi03:29
*** notmyname has joined #openstack-marconi03:29
*** flaper87|afk has joined #openstack-marconi03:29
*** jarret has joined #openstack-marconi03:29
*** briancline has joined #openstack-marconi03:29
*** ametts has joined #openstack-marconi03:29
*** malini_afk has joined #openstack-marconi03:29
*** jdprax has joined #openstack-marconi03:29
*** EmilienM has joined #openstack-marconi03:29
*** gleicon___ has joined #openstack-marconi03:29
*** ekarlso has joined #openstack-marconi03:29
*** rektide has joined #openstack-marconi03:29
*** pquerna has joined #openstack-marconi03:29
*** jburkhart has joined #openstack-marconi03:29
*** lakspace has joined #openstack-marconi03:29
*** fvollero has joined #openstack-marconi03:29
*** westmaas has joined #openstack-marconi03:29
*** russellb has joined #openstack-marconi03:29
*** wirehead_ has joined #openstack-marconi03:29
*** megan_w has joined #openstack-marconi03:29
*** kgriffs_afk has joined #openstack-marconi03:29
*** zyuan has joined #openstack-marconi03:29
*** al-maisan has joined #openstack-marconi03:29
*** ChanServ has joined #openstack-marconi03:29
*** hobana.freenode.net sets mode: +oo kgriffs_afk ChanServ03:29
*** hobana.freenode.net changes topic to "open discussion"03:29
*** ayoung has quit IRC03:39
*** oz_akan_ has quit IRC05:18
*** oz_akan_ has joined #openstack-marconi05:19
*** flaper87|afk is now known as flaper8706:46
*** reed has joined #openstack-marconi06:49
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955006:49
*** flaper87 is now known as flaper87|afk07:24
*** yassine has joined #openstack-marconi07:57
*** flaper87|afk is now known as flaper8708:06
*** ykaplan has joined #openstack-marconi09:27
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Pass keywords to the request initialization  https://review.openstack.org/5056709:36
*** ykaplan has quit IRC09:47
*** flaper87 is now known as flaper87|afk10:17
*** alcabrera has joined #openstack-marconi10:27
alcabreraMorning. :)10:29
*** pycabrera has joined #openstack-marconi10:32
*** alcabrera has quit IRC10:35
*** ykaplan has joined #openstack-marconi10:52
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955011:11
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: storage sharding schema for marconi-queues  https://review.openstack.org/5045611:11
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955011:15
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: storage sharding schema for marconi-queues  https://review.openstack.org/5045611:16
*** flaper87|afk is now known as flaper8711:18
*** pycabrera is now known as alcabrera11:18
alcabreraflaper87: o/11:18
flaper87alcabrera: heyyyy11:18
flaper87alcabrera: good morning11:18
alcabreramorning! :D11:19
flaper87alcabrera: many things happening!!! :D11:19
flaper87alcabrera: thanks for the heads up, I really appreciated it!11:19
alcabreranp. :)11:19
alcabreraYou'll be seeing a stream of patches towards the sharding goal coming in over the next few days. :)11:20
alcabreraI'm currently reviewing all the things - I'm checking out the client patches before I dive back into getting sharding going.11:20
flaper87alcabrera: awesome, thanks!11:21
openstackgerritFlavio Percoco proposed a change to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955011:23
flaper87alcabrera: mmh, btw, I missed your "I'll fix this" email and overwrote your patch T_T11:23
flaper87anyway, this last one should be ok11:23
flaper87with all fixes, if you agree, I'll approve it after your +211:24
flaper87so we stop overwriting this patch11:24
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: storage sharding schema for marconi-queues  https://review.openstack.org/5045611:25
alcabreraflaper87: that would be awesome. :D11:25
alcabrera+2'd11:25
alcabreraAfter a "careful enough" review. :P11:25
flaper87LOL11:25
alcabreraWhen the diff stats change, I'm like, "Where's that one file with the one line change, HMMMM". :|11:26
flaper87btw, I'm not 100% convinced about making the transport "shard" aware, TBH. I'd like us to discuss that a bit better11:26
flaper87alcabrera: hahah, yeah, gerrit kept saying that there wasn't anything to push for review11:27
flaper87so I gave it a beautiful empty line change11:27
alcabreraI called it "reader friendly", heh. :P11:27
flaper87indeed :D11:27
alcabreraflaper87: I'm open for discussion on the sharding idea. If was a flurry of discussions yesterday at the office, so I'm happy to update you on theories. :)11:28
alcabreraAnd rationale - all that jazz.11:28
flaper87:D11:28
flaper87alcabrera: did you read my comment on Kurt's patch ?11:28
alcabreranot yet11:29
alcabreralemme see...11:29
flaper87kk, take your time! My thoughts go mainly around that11:29
flaper87I could start working on that right away11:29
flaper87since it's something I think is worth to have anyway11:29
flaper87and it can be very useful for this case11:29
alcabreraWhere's this bp? :)11:30
flaper87oh, didn't I add the link?11:30
flaper87it is there, my last comment11:30
alcabreraoh, I found it11:30
flaper87in the whole review11:30
alcabreraIt was inline.11:30
flaper87:D11:30
flaper87and inline11:30
alcabrera:P11:30
flaper87as well11:30
alcabreralol11:31
flaper87:P11:31
flaper87I can work on a prototype that doesn't interferes much with the shard work11:31
flaper87which would make the idea a bit clearer11:31
alcabreraThe bp sounds very functional, in the filer (\x -> isOdd x) $ filter (\x -> x > 10) kind of way.11:32
alcabrera*filter11:32
flaper87alcabrera: exactly11:32
flaper87it'll keep going forward until some of the calls returns something != None11:32
alcabreraI suspect such a filtering mechanism could form the backbone of tag/content-based message retrieval.11:33
flaper87yup11:33
alcabreraI'm cool with the idea, and I'm interested in seeing what it would look like. If it leads to the possibility of pluggable third-party middleware kind of deal, that's more power to being able to configure marconi to fit a user's needs.11:34
flaper87so, as for as shard is concerned, I'm thinking something like: filter, shard, controllers11:35
flaper87and if shard is enabled, I think the whole operation will be consumed at the 'shard' step11:35
flaper87It'll lookup for the right shard, do the operation and return the result11:36
alcabrerahmm11:36
alcabreraIt seems like the filter could fit at either the transport response layer or at the storage response layer. If you add the filters at the transport layer, then the storage drivers might be easier to write since implementors won't have to worry about applying filtering hook points if they don't need them. (kind of thinking out loud here)11:38
*** oz_akan_ has quit IRC11:39
flaper87alcabrera: but the storage layer won't know anything about the filter nor the transport layer11:39
flaper87I mean, middlewares we stay between the transport and the storage layer11:39
alcabreraflaper87: that's ideal, agreed. I'm wrapping my head around where to fit it in. :)11:39
alcabreraahh11:39
flaper87and they're applied before and after the operation is complete11:39
flaper87like on_request / on_response11:40
alcabreratransport <-> filter* <-> storage?11:40
flaper87yeah, although I wouldn11:40
flaper87damn11:40
flaper87I wouldn't call them filters11:40
flaper87but middlewares11:40
flaper87or something like that11:41
flaper87I'm seeing the ShardManager as a middleware11:41
flaper87for example11:41
flaper87that will sit there, between transport and storage11:41
flaper87and will route the current operation to the right shard11:41
alcabrerahmmm, interesting - sharding as middleware.11:42
ekarlsowhat's the plan for AMQP ?11:43
flaper87that will keep both the storage and transport implementation freaking simple11:43
alcabreraflaper87: +111:43
flaper87ekarlso: we'll discussing AMQP at the summit11:43
flaper87it's in our roadmap, although we haven't discussed it in deep11:43
flaper87ekarlso: thing is that we need to integrate some of the semantics we've right now with AMQP semantics11:44
flaper87and the biggest interrogation we've right now is whether to acccept 'Partially supported APIs' or to teak Marconi's API11:44
flaper87alcabrera: hope that makes more sense now11:45
flaper87alcabrera: I wanted to work on a POC this morning but I'm so freaking exited about the client that I lost the track of time11:45
flaper87plus had tons of other things to do11:45
alcabreraflaper87: Your explanation helps. A POC would really fill me in. :D11:46
flaper87but I'll have a POC ready before the end of tomorrow11:46
alcabreraflaper87: there's a never ending stream of things to be done. ;)11:46
alcabreracool, cool.11:46
alcabreraI'll have some more of the sharding fleshed out soon. kgriffs_afk will be in this office today - it's going to be quite a bit of "making things happen". :D11:47
flaper87awesome, so glad to hear that11:47
alcabreraflaper87: If you have  a few moments at some point, I'd love reviews for all the proxy bug fix patches I got in yesterday. They close around 4-5 of the niggling proxy issues that built up.11:48
alcabrerathings like: request.stream.read() vs. just request.stream when forwarding data. :P11:48
*** ykaplan has quit IRC11:49
flaper87alcabrera: yes sir, will do that in a few minutes! Count on it!11:49
alcabreraflaper87: w00t, awesome! Thanks!11:49
*** tedross has joined #openstack-marconi11:50
alcabreraflaper87: all client patches LGTM - +211:54
flaper87alcabrera: A.W.E.S.O.M.E11:54
flaper87I'd LOVE to get those merged today11:54
alcabreraI hope so, too. Things will be frantic once kgriffs_afk arrives in like... 4 hours. :P11:55
flaper87mmmh, 4 hours, mmhh! Not sure I'll be able to be around then.11:56
* flaper87 has some family visits11:57
flaper87This is going to be a fun month11:57
flaper87since they will be around for 1 month and 1/211:57
flaper87less time to hack more time for family11:57
alcabreragood, good. Stepping away from the code and enjoying some time will family does a person good. :D11:58
alcabrera*with11:58
*** vkmc has joined #openstack-marconi12:08
*** vkmc has quit IRC12:08
*** vkmc has joined #openstack-marconi12:08
*** jcru has joined #openstack-marconi12:10
*** ykaplan has joined #openstack-marconi12:15
*** oz_akan_ has joined #openstack-marconi12:45
*** fifieldt has quit IRC12:45
*** oz_akan_ has quit IRC12:46
*** oz_akan_ has joined #openstack-marconi12:47
flaper87fvollero: yo, how's the ES thing going ?12:48
* flaper87 curious, so freaking curious.12:48
flaper87fvollero: btw, did you get the 'third-party' plugin structure going ?12:49
flaper87fvollero: d00d, answer me :D13:02
flaper87fvollero: ok, you can keep the cocosette13:02
flaper87:D13:02
*** alcabrera is now known as alcabrera|afk13:04
*** mpanetta has joined #openstack-marconi13:07
*** amitgandhi has joined #openstack-marconi13:08
*** jergerber has joined #openstack-marconi13:08
openstackgerritA change was merged to openstack/marconi: Use oslo.config directly instead of common.config  https://review.openstack.org/4955013:16
flaper87w0000t13:16
alcabrera|afk(:D)13:19
*** yassine has quit IRC13:28
*** yassine has joined #openstack-marconi13:34
*** jcru has quit IRC13:35
*** ayoung has joined #openstack-marconi13:36
fvolleroflaper87: hahahahahahaha13:36
fvolleroflaper87: which third-party plugin structure r u talking about ?13:37
flaper87fvollero: I mean, how are you organizing your ES code ?13:38
flaper87What's the code structure of that plugin?13:38
fvolleroflaper87: i'm following the mongodb way13:38
fvolleroflaper87: about the messages and their ttl i've a small concern, because the message get evicted when the ttl end and i don't know if we want to be this the approach.13:39
flaper87fvollero: that's the way it should be13:40
*** dafter has joined #openstack-marconi13:40
flaper87if the message expires, we don't give a crap about it13:40
flaper87:D13:40
fvolleroflaper87: another thing is that we need to enable the _ttl at the initialization, because if not, even if it has a ttl but setted while the index was disabled it will not expire13:40
fvollerothe _ttl on the index was disabled13:40
flaper87fvollero: index initialization, you mean13:41
flaper87yeha, we can do that in the queue and message controller init13:41
fvolleroflaper87: yeah, that's my idea13:41
flaper87fvollero: now it's mine.... muahahahhahahaah13:41
* flaper87 STFU13:41
fvolleroflaper87: i got stopped by fixing something in puppet-ceilometer that need to be in packstack and foreman, so i was slowed down a bit13:41
flaper87fvollero: no worries13:42
fvolleroflaper87: i heard you spoke with mike13:42
flaper87fvollero: yup, I did!13:42
flaper87fvollero: I told him how much I hate you because of the cocosette thing13:42
flaper87now, if you send some my way, I can change my mind13:42
flaper87:D13:42
flaper87kidding13:42
fvolleroflaper87: good call :)13:42
fvolleroflaper87: you're so sweet13:43
fvolleroflaper87: my dear savoy toronto !13:43
flaper87fvollero: I told hime how much I love you and that I'm so freaking happy to have you in the team. Seriously!13:43
flaper87hiom*13:43
flaper87him*13:43
fvolleroflaper87: hahahaha13:43
flaper87fuck, I can't type today13:43
flaper87or ever13:43
flaper87anyway!13:43
fvolleroflaper87: i bet!13:44
flaper87fvollero: btw, I was also wondering whether you'd be interested in contributing on the client side13:44
fvolleroflaper87: why not! my plan is to put so much effort to become core :P13:45
*** malini_afk is now known as malini13:46
flaper87fvollero: awesome, awesome, awesomeeee!!!!13:47
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063813:48
flaper87aaaaaaaaaaaaaaaaaannnnnnnnnnnnnnnnnnnnnnnndddddddd there it GOEESSS.... The client IS ALIVEEE ^13:48
flaper87alcabrera|afk: ^^^^^^^^^^13:48
flaper87kgriffs_afk: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^13:48
* flaper87 begs to tests Gods!!!13:48
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063813:49
flaper87I meant, ^13:49
* ametts goes and looks13:50
* flaper87 should improve the commit message and explain the lower level API as well13:51
amettsflaper87: Jenkins barfed on your change, but I guess you know that already. :)13:52
flaper87#@$@#!%#$@%@#%#$%^!Q%#$@%@#%#$@%#@$^%$#@^$%^$#@%^#$13:53
flaper87T_T13:53
*** jcru has joined #openstack-marconi13:56
*** jcru has quit IRC13:59
*** jcru has joined #openstack-marconi13:59
*** yassine has quit IRC14:00
*** yassine has joined #openstack-marconi14:01
* flaper87 feels so fucking stupid14:04
openstackgerritFlavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods  https://review.openstack.org/5063814:05
flaper87ametts: Jenkins is happy now! :D14:09
* ametts thinks Jenkins is moody.14:10
* flaper87 puts the nutella away14:13
openstackgerritA change was merged to openstack/marconi: Replace deprecated method aliases in tests  https://review.openstack.org/5029714:17
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: validate queue listing limits in proxy  https://review.openstack.org/5034214:20
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: validate queue listing limits in proxy  https://review.openstack.org/5034214:22
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: proxy mongodb storage fields overspecified  https://review.openstack.org/5030514:23
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: fix: proxy mongodb storage fields overspecified  https://review.openstack.org/5030514:25
openstackgerritZhihao Yuan proposed a change to openstack/marconi: feat(validation): verify project id length  https://review.openstack.org/5049614:42
zyuanametts: oh he is.14:43
openstackgerritZhihao Yuan proposed a change to openstack/marconi: feat(test): queue context manager for proxy  https://review.openstack.org/4983014:47
*** flaper87 is now known as flaper87|afk15:05
*** flaper87|afk is now known as flaper8715:39
*** yassine has quit IRC15:45
*** flaper87 is now known as flaper87|afk15:47
*** ykaplan has quit IRC16:40
*** dafter has quit IRC17:23
*** tvb|afk has joined #openstack-marconi17:25
*** tvb|afk has quit IRC17:27
*** tvb|afk has joined #openstack-marconi17:27
*** tvb|afk has joined #openstack-marconi17:27
*** ORerik has joined #openstack-marconi17:33
*** tvb|afk has quit IRC17:37
*** dafter has joined #openstack-marconi17:38
*** dafter has quit IRC17:38
*** dafter has joined #openstack-marconi17:38
*** tvb|afk has joined #openstack-marconi17:40
*** tvb|afk has quit IRC17:40
*** tvb|afk has joined #openstack-marconi17:40
*** dafter has quit IRC17:42
openstackgerritZhihao Yuan proposed a change to openstack/marconi: fix: one less unnecessary modification  https://review.openstack.org/5069217:45
*** kgriffs_afk is now known as kgriffs17:56
*** kgriffs is now known as kgriffs_afk17:58
*** kgriffs_afk is now known as kgriffs18:11
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: split queues API into public/admin  https://review.openstack.org/5070118:12
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: add shard management resource  https://review.openstack.org/5070218:12
*** ykaplan has joined #openstack-marconi18:24
*** oz_akan_ has quit IRC18:29
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: split queues API into public/admin  https://review.openstack.org/5070118:29
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: add shard management resource  https://review.openstack.org/5070218:32
*** jraim_ has joined #openstack-marconi18:37
*** alcabrera|afk has quit IRC18:54
*** ayoung has quit IRC19:21
*** malini is now known as malini_afk19:25
openstackgerritAlejandro Cabrera proposed a change to openstack/marconi: feat: shards storage controller interface  https://review.openstack.org/5072119:25
*** ayoung has joined #openstack-marconi19:34
*** oz_akan_ has joined #openstack-marconi19:40
*** oz_akan_ has quit IRC19:45
amitgandhihttps://bugs.launchpad.net/marconi/+bug/123762019:48
*** jraim_ has quit IRC19:50
*** jraim_ has joined #openstack-marconi19:53
*** ayoung has quit IRC20:12
*** ayoung has joined #openstack-marconi20:38
*** vkmc has quit IRC20:54
*** ayoung has quit IRC21:10
*** jraim_ has quit IRC21:34
*** ykaplan has quit IRC21:42
*** tvb|afk has quit IRC22:05
*** dafter has joined #openstack-marconi22:06
*** jraim_ has joined #openstack-marconi22:08
*** dafter has quit IRC22:10
*** jergerber has quit IRC22:13
*** tedross has quit IRC22:13
*** mpanetta_ has joined #openstack-marconi22:29
*** mpanetta has quit IRC22:29
*** amitgandhi has quit IRC22:29
*** mpanetta_ has quit IRC22:43
*** jcru has quit IRC22:46
*** jraim_ has quit IRC22:49
*** dafter has joined #openstack-marconi23:16
*** dafter has quit IRC23:21
*** fifieldt has joined #openstack-marconi23:39
*** torgomatic has quit IRC23:49
*** torgomatic has joined #openstack-marconi23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!