*** shakamunyi has joined #openstack-marconi | 00:43 | |
openstackgerrit | A change was merged to openstack/marconi: Remove check queue exists endpoint https://review.openstack.org/108051 | 00:54 |
---|---|---|
*** oz_akan has joined #openstack-marconi | 01:01 | |
*** mwagner_lap has joined #openstack-marconi | 01:32 | |
*** nosnos has joined #openstack-marconi | 01:43 | |
openstackgerrit | A change was merged to openstack/marconi: API v1.1 - Encapsulate message post bodies in a JSON object https://review.openstack.org/108795 | 02:21 |
*** haomai___ has quit IRC | 02:36 | |
peoplemerge | wpf: ping | 02:51 |
*** prashanthr_1 has joined #openstack-marconi | 03:07 | |
prashanthr_1 | flaper87: Good morning :) | 03:09 |
*** nosnos has quit IRC | 03:15 | |
*** oz_akan has quit IRC | 03:42 | |
*** vkmc has quit IRC | 03:43 | |
*** prashanthr_1 has quit IRC | 03:45 | |
*** chandankumar has joined #openstack-marconi | 03:53 | |
*** oz_akan has joined #openstack-marconi | 04:05 | |
*** nosnos has joined #openstack-marconi | 04:18 | |
*** prashanthr_ has joined #openstack-marconi | 04:21 | |
*** oz_akan has quit IRC | 04:44 | |
*** oz_akan has joined #openstack-marconi | 04:45 | |
*** oz_akan_ has joined #openstack-marconi | 04:46 | |
*** oz_akan has quit IRC | 04:46 | |
*** chandankumar has quit IRC | 04:49 | |
*** oz_akan_ has quit IRC | 04:50 | |
*** prashanthr_1 has joined #openstack-marconi | 04:52 | |
*** prashanthr_ has quit IRC | 04:52 | |
*** chandankumar has joined #openstack-marconi | 04:59 | |
*** haomaiwa_ has joined #openstack-marconi | 05:13 | |
*** k4n0 has joined #openstack-marconi | 05:24 | |
*** celttechie has joined #openstack-marconi | 05:28 | |
*** celttechie is now known as celttechie_ | 05:32 | |
*** prashanthr_1 has quit IRC | 05:39 | |
*** prashanthr_ has joined #openstack-marconi | 05:41 | |
*** celttechie_ has left #openstack-marconi | 05:43 | |
*** prashanthr_ has quit IRC | 05:44 | |
*** prashanthr_ has joined #openstack-marconi | 05:46 | |
*** celttechie has joined #openstack-marconi | 05:51 | |
*** celttechie has quit IRC | 06:03 | |
*** celttechie has joined #openstack-marconi | 06:04 | |
wpf | peoplemerge: pong , sorry, this is my remote desktop , I forgot to set it "away", and now , I am back -:0 | 06:04 |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/marconi: Imported Translations from Transifex https://review.openstack.org/109193 | 06:07 |
*** oz_akan has joined #openstack-marconi | 06:16 | |
*** celttechie has quit IRC | 06:18 | |
*** oz_akan has quit IRC | 06:21 | |
prashanthr_ | flwang: Hi Good afternoon :) | 06:33 |
*** ChanServ changes topic to "OpenStack Queuing and Notification Service || Smile :D || Meetings every Tuesday @ 15:00 UTC || Wiki: https://wiki.openstack.org/wiki/Marconi || Paste: http://paste.openstack.org/ || Send messages and make some noise :D" | 06:33 | |
flwang | prashanthr_: hi | 06:33 |
prashanthr_ | flwang : Can i know how expired messages are purged from the mongodb database ? | 06:33 |
prashanthr_ | is it daemon based ? | 06:34 |
*** pquerna has left #openstack-marconi | 06:38 | |
wpf | with a quick look, I did not find the *purged* code (I remembered I ever saw some), are they just be filtered out? | 06:44 |
prashanthr_ | wpf: Ohh okay. So messages remain in the system until someone claims them | 06:46 |
wpf | expired messages can't be claimed I thought | 06:50 |
wpf | hoping flwang can provide some more details about the purge -:) | 06:50 |
wpf | prashanthr_: you did not find the code to purge them either ? | 06:51 |
prashanthr_ | wpf: Nope. | 06:53 |
prashanthr_ | I used to just filter out the expired messagesz | 06:53 |
prashanthr_ | when kgriffs|afk pointed it out | 06:54 |
prashanthr_ | and in Redis memory is very crucial | 06:54 |
prashanthr_ | so i think it's better to get rid of the expired messages | 06:54 |
wpf | in the sqlalchemy code, even the *purged* codes were commented, but the idea is to delete those one when posting messages | 06:56 |
*** shakamunyi has quit IRC | 07:03 | |
prashanthr_ | wpf: I did not get it sorry. | 07:06 |
wpf | the idea to purge the expired messages in sqlalchemy code is using the sql statement to delete them when posting messages | 07:09 |
wpf | but the code was commented out | 07:09 |
prashanthr_ | wpf: Ohh okay. I have not checked the sqlalchemy code at all. | 07:12 |
* prashanthr_ is lazy | 07:12 | |
*** oz_akan has joined #openstack-marconi | 07:17 | |
*** oz_akan_ has joined #openstack-marconi | 07:21 | |
*** oz_akan has quit IRC | 07:22 | |
*** oz_akan_ has quit IRC | 07:26 | |
*** prashanthr_ has left #openstack-marconi | 09:16 | |
*** flwang_ has joined #openstack-marconi | 09:42 | |
*** k4n0 has quit IRC | 10:07 | |
flwang_ | flaper87: around? | 10:17 |
*** k4n0 has joined #openstack-marconi | 10:21 | |
*** prashanthr_ has joined #openstack-marconi | 10:30 | |
*** oz_akan has joined #openstack-marconi | 10:58 | |
*** k4n0 has quit IRC | 11:01 | |
*** oz_akan has quit IRC | 11:03 | |
*** chandankumar has quit IRC | 11:17 | |
*** k4n0 has joined #openstack-marconi | 11:19 | |
*** chandankumar has joined #openstack-marconi | 11:32 | |
*** amitgandhi has joined #openstack-marconi | 11:44 | |
*** amitgandhi has joined #openstack-marconi | 11:44 | |
*** flwang_ has quit IRC | 11:56 | |
*** k4n0 has quit IRC | 11:59 | |
*** oz_akan has joined #openstack-marconi | 11:59 | |
*** oz_akan has quit IRC | 12:01 | |
*** nosnos has quit IRC | 12:09 | |
*** amitgandhi has quit IRC | 12:10 | |
*** denis_makogon has quit IRC | 12:16 | |
*** denis_makogon has joined #openstack-marconi | 12:18 | |
*** tongli has joined #openstack-marconi | 12:34 | |
*** abettadapur has joined #openstack-marconi | 12:37 | |
*** sriram has joined #openstack-marconi | 12:45 | |
*** catherin_ has joined #openstack-marconi | 13:06 | |
*** chandankumar has quit IRC | 13:10 | |
*** jmckind has joined #openstack-marconi | 13:11 | |
*** catherin_ has left #openstack-marconi | 13:13 | |
*** mwagner_lap has quit IRC | 13:14 | |
*** vkmc has joined #openstack-marconi | 13:16 | |
*** vkmc has quit IRC | 13:16 | |
*** vkmc has joined #openstack-marconi | 13:16 | |
*** amitgandhi has joined #openstack-marconi | 13:20 | |
*** amitgandhi has quit IRC | 13:20 | |
*** amitgandhi has joined #openstack-marconi | 13:21 | |
*** celttechie has joined #openstack-marconi | 13:23 | |
*** amitgand_ has joined #openstack-marconi | 13:25 | |
*** amitgandhi has quit IRC | 13:25 | |
vkmc | morninggg | 13:30 |
*** Obulpathi has joined #openstack-marconi | 13:32 | |
prashanthr_ | vkmc: Good mrng :) | 13:33 |
*** oz_akan has joined #openstack-marconi | 13:36 | |
vkmc | prashanthr_, morning! | 13:37 |
*** whenry has joined #openstack-marconi | 13:47 | |
*** mkoderer has quit IRC | 13:57 | |
*** flwang_ has joined #openstack-marconi | 13:57 | |
*** flwang_ has quit IRC | 14:01 | |
*** whenry has quit IRC | 14:09 | |
*** whenry has joined #openstack-marconi | 14:27 | |
*** cpallares has joined #openstack-marconi | 14:28 | |
*** rwsu has joined #openstack-marconi | 14:28 | |
*** shakamunyi has joined #openstack-marconi | 14:31 | |
vkmc | cpallares, o/ | 14:32 |
cpallares | hey vkmc! | 14:33 |
cpallares | vkmc: how are you? | 14:33 |
vkmc | cpallares, all good and you? :) | 14:33 |
*** mwagner_lap has joined #openstack-marconi | 14:38 | |
cpallares | cpallares: pretty good :) | 14:39 |
*** tonytan4ever has joined #openstack-marconi | 14:39 | |
*** malini has joined #openstack-marconi | 14:42 | |
*** kgriffs|afk is now known as kgriffs | 14:43 | |
*** tonytan4ever has quit IRC | 14:44 | |
vkmc | I'm watching flaper87 talking about brokers https://www.youtube.com/watch?v=pYzIOrAkb-A | 14:45 |
*** amitgand_ has quit IRC | 14:45 | |
vkmc | he rocked it | 14:45 |
*** whenry has quit IRC | 14:46 | |
*** sriram has quit IRC | 14:51 | |
*** shakamunyi has quit IRC | 14:53 | |
kgriffs | prashanthr_: as a first step, you could trigger deleting expired messages by each message post or message listing operation. | 14:55 |
kgriffs | however, that could add a lot of load to the system | 14:55 |
*** Obulpathi has quit IRC | 14:55 | |
kgriffs | so, the better long-term solution is to have some kind of separate GC daemon that runs on the box | 14:55 |
kgriffs | and every, say, 60 seconds it deletes all expired messages. | 14:56 |
prashanthr_ | kgriffs: Good morning ! :) | 14:56 |
prashanthr_ | Actually the deletion of the messages can be scheduled using setex call on the message id | 14:56 |
*** abettadapur has quit IRC | 14:56 | |
prashanthr_ | but i also maintain a list of all messages in a queue | 14:57 |
prashanthr_ | which cannot be removed using the setex call | 14:57 |
kgriffs | oh, I see. | 14:57 |
* kgriffs learned something new | 14:57 | |
kgriffs | guess that would make sense to have setex since people often use redis in place of memcache | 14:57 |
kgriffs | but yeah, there will need to be a way to periodically clean up list of all messages in the queue | 14:58 |
*** malini has quit IRC | 14:58 | |
kgriffs | I suppose another way is to keep a timestamp in there of the last cleanup time | 14:58 |
kgriffs | then on each message post operation, check the timestamp and also do a cleanup if 60 seconds has elapsed | 14:58 |
kgriffs | but that would still add some overhead to the post operation | 14:59 |
kgriffs | prashanthr_: good evening, btw! | 14:59 |
prashanthr_ | kgriffs: he he thanks :) I tried to use a technique similar to that for claims. But alcabrera|afk suggested that modules must have decoupling. | 14:59 |
prashanthr_ | and perform just one simple function | 15:00 |
kgriffs | ok | 15:00 |
kgriffs | what do you think about having a GC daemon? | 15:00 |
kgriffs | or it could just be a script that we tell people to put in crontab | 15:01 |
prashanthr_ | kgriffs: I think the crontab idea would be great | 15:01 |
prashanthr_ | as it would allow people the flexibility to schedule | 15:01 |
kgriffs | yep | 15:02 |
kgriffs | it's pretty simple, so doesn't seem to be much value having the script do its own scheduling | 15:02 |
*** chandankumar has joined #openstack-marconi | 15:02 | |
*** whenry has joined #openstack-marconi | 15:02 | |
prashanthr_ | kgriffs: agreed. | 15:03 |
prashanthr_ | Also a message lives on until there is a valid claim on it | 15:03 |
prashanthr_ | am i right here ? | 15:03 |
*** tonytan4ever has joined #openstack-marconi | 15:04 | |
kgriffs | actually, no it expires according to it's TTL | 15:09 |
prashanthr_ | kgriffs: Sure. | 15:10 |
prashanthr_ | I will start working on it. | 15:10 |
kgriffs | the caveat is | 15:10 |
kgriffs | that when you claim a message, it's lifetime will be extended so it does not expire before the claim does | 15:10 |
*** whenry has quit IRC | 15:10 | |
kgriffs | you can see that logic in the mongo driver | 15:10 |
kgriffs | (actually, it is extended to claim expiration + grace seconds) | 15:11 |
kgriffs | anyway, some people will use marconi simply as a message feed and not claim messages | 15:12 |
kgriffs | sort of the same way you might use http://atomhopper.org/ | 15:12 |
prashanthr_ | kgriffs: Ahh this makes sense. I shall have a look into atom hopper | 15:12 |
prashanthr_ | also i had a look at trollius | 15:13 |
kgriffs | so yeah, messages need to expire eventually in that use case and be deleted because you don't want the data set to grow forever. | 15:13 |
kgriffs | prashanthr_: oh yeah? I just came across it recently, but it looked like a promising way to get async I/O that works across py2 and py3 | 15:13 |
kgriffs | what have you found out about it? | 15:13 |
prashanthr_ | kgriffs: Yes i saw a video by Guido Van Rossum about it | 15:13 |
prashanthr_ | he just explains the asyncio part which is just py3.3+ compat | 15:14 |
prashanthr_ | but trillio works along the same lines | 15:14 |
kgriffs | right | 15:14 |
prashanthr_ | I think we can add a AsyncConnection class to redis-py | 15:14 |
prashanthr_ | which is basically an extension of the trollius.Protocol | 15:15 |
kgriffs | we may also need to submit a patch to pymongo so we can have async support on py3, but that is a project for another day | 15:15 |
kgriffs | (FWIW) | 15:15 |
prashanthr_ | which can send and receive data from the redis server | 15:16 |
kgriffs | prashanthr_: the asyncio stuff in 3.4 is pretty elegant, but yeah, depends on py3 language features | 15:16 |
kgriffs | prashanthr_: sounds good | 15:16 |
prashanthr_ | kgriffs: Do we have to work with redis-py community for this | 15:17 |
prashanthr_ | ? | 15:17 |
prashanthr_ | or we just extend it with our driver ? | 15:17 |
kgriffs | prashanthr_: wait, I thought there was a way to do it without patching redis-py? | 15:17 |
kgriffs | https://github.com/andymccurdy/redis-py#connections | 15:17 |
kgriffs | "You can create your own Connection subclasses as well." | 15:18 |
prashanthr_ | true. | 15:20 |
prashanthr_ | kgriffs:Right. | 15:20 |
prashanthr_ | Currently I am just developing it with a fork of the redis-py | 15:22 |
prashanthr_ | https://github.com/PrashanthRaghu/redis-py | 15:22 |
prashanthr_ | I will write a basic connection and then test it from there | 15:22 |
prashanthr_ | It currently has a dummy AsyncConnection class | 15:22 |
*** wirehead_ has quit IRC | 15:28 | |
*** wirehead_ has joined #openstack-marconi | 15:29 | |
*** prashanthr_ has quit IRC | 15:30 | |
*** oz_akan has quit IRC | 15:34 | |
*** denis_makogon has quit IRC | 15:38 | |
vkmc | kgriffs, morning! | 15:41 |
kgriffs | howdy! | 15:41 |
vkmc | I'm working on the client and finding some stuff that may need to be changed | 15:42 |
vkmc | in the API we removed the exists method for queues, should we remove it in the client as well? | 15:43 |
kgriffs | well, it still exists in the 1.0 API | 15:43 |
vkmc | yeah, that was my concern | 15:43 |
* kgriffs didn't intend to pun | 15:43 | |
* kgriffs but finds it funny anyway | 15:43 | |
vkmc | lol | 15:44 |
vkmc | gotcha | 15:44 |
kgriffs | vkmc: so... the question is what is our versioning strategy for the client? | 15:44 |
vkmc | yeah :p | 15:44 |
kgriffs | ideally, the client can query to server to figure out which apis are available | 15:44 |
kgriffs | I think there was a bp somewhere for exposing an endpoint for that | 15:45 |
kgriffs | but sans adding an api discovery endpoint, the client could just try to get homedocs for all known versions | 15:45 |
openstackgerrit | A change was merged to openstack/marconi: Imported Translations from Transifex https://review.openstack.org/109193 | 15:46 |
*** cpallares has quit IRC | 15:48 | |
kgriffs | oh, interesting. I just looked at this | 15:48 |
kgriffs | https://github.com/openstack/python-marconiclient/blob/master/marconiclient/queues/client.py | 15:48 |
kgriffs | looks like some thought has already been put into versioning | 15:48 |
vkmc | it looks like that | 15:49 |
kgriffs | so, by default you could return the most recent version | 15:49 |
kgriffs | and if you wanted to be even smarter, the default would probe the server to find out what it supports, and by default return the latest support api | 15:49 |
vkmc | I got confused with the client version and the api version | 15:49 |
kgriffs | looks like it may be a 1:1 relationship? | 15:50 |
kgriffs | v1 api, v1 client | 15:50 |
kgriffs | v1.1 api, v1.1 client | 15:50 |
vkmc | I noticed we have many features that has been modified in v1.1, so I was submitting bugs accordingly | 15:50 |
vkmc | yeah | 15:50 |
vkmc | but we have v1 currently | 15:50 |
vkmc | so it's ok to have the exist method and have shards instead of pools | 15:51 |
kgriffs | vkmc: we may just want to create one blueprint for all the client work to implement v1.1 | 15:51 |
vkmc | kgriffs, sounds good | 15:51 |
kgriffs | FWIW, I listed the client work under API v1.1 on the roadmap: https://wiki.openstack.org/wiki/Roadmap_(Marconi)#Upcoming_milestones | 15:51 |
vkmc | right now there are some bps for v1.1 | 15:51 |
kgriffs | did you see one for the client specifically? I can't remember if one was ever created | 15:52 |
kgriffs | I haven't yet gotten launchpad all cleaned up for j-3 | 15:52 |
vkmc | kgriffs, https://blueprints.launchpad.net/python-marconiclient/+spec/api-v1.1 | 15:53 |
kgriffs | but I did update the roadmap so we can figure out what belongs | 15:53 |
kgriffs | ah, cool | 15:53 |
kgriffs | I will move to j-3 | 15:53 |
vkmc | :) cool | 15:53 |
vkmc | I could work on that, for j-3 | 15:53 |
vkmc | right now I'm on the CLI but I found some dependencies | 15:54 |
kgriffs | ok, cool | 15:54 |
kgriffs | thanks! | 15:54 |
vkmc | I think that the CLI for v1 will be ready for j-3... the client for v1.1 depends on all those bps | 15:54 |
kgriffs | yep, we have tons of work to do. :p | 15:55 |
vkmc | well, the shards to pool thing affects v1 too :) so the report is valid | 15:56 |
vkmc | haha we will do it! | 15:56 |
vkmc | btw kgriffs, I'm a bit worried about the AMQP transport | 15:56 |
vkmc | driver | 15:56 |
vkmc | I saw it in the roadmap for J-3 | 15:56 |
vkmc | but I'm still not sure how we are going to deal with the binary messages AMQP can handle | 15:57 |
vkmc | what do you think would be better for Marconi in this stage? | 15:57 |
kgriffs | hmmm | 15:57 |
*** flwang_ has joined #openstack-marconi | 15:58 | |
vkmc | we also have some limitations for the claim support | 15:58 |
vkmc | so... the AMQP transport would support the prod/cons pattern only | 15:59 |
*** cpallares has joined #openstack-marconi | 15:59 | |
kgriffs | oic | 16:00 |
kgriffs | so, a few thoghts | 16:00 |
kgriffs | thoughts | 16:00 |
kgriffs | it's hard to know what is going to work sometimes before trying it (science!) | 16:01 |
vkmc | of course :) | 16:01 |
kgriffs | so, your work with AMQP has been really helpful in advancing our thinking | 16:02 |
*** flwang_ has quit IRC | 16:02 | |
vkmc | well, that's good to hear | 16:04 |
vkmc | if it helped for something, then I'm happy | 16:04 |
kgriffs | sounds like we still have more experimenting and work to do though that won't all fit in j-3 | 16:04 |
kgriffs | is that what you were thinking? | 16:04 |
vkmc | yeah, my main concern is that this was targeted for Juno and I couldn't deliver | 16:05 |
kgriffs | I really think there is an AMQP + Marconi story somewhere that could be a really useful thing for the community. | 16:05 |
vkmc | so I was looking for an alternative version, perhaps more limited, that would still be useful for Marconi | 16:06 |
kgriffs | I think that we will get there, but it will need some more time to sort out | 16:06 |
vkmc | sure | 16:07 |
kgriffs | so, let me see if I can somehow indicate that on the roadmap. | 16:07 |
vkmc | ok :) | 16:08 |
vkmc | so... for the last part of my internship I'll focus on the client | 16:08 |
vkmc | so at least I can contribute with some code, in other area | 16:08 |
vkmc | and continue with the research efforts for AMQP | 16:09 |
kgriffs | yeah, I think the AMQP research you've done is really valuable as I said before. But for j-3 we could definitely use help on the client. | 16:10 |
vkmc | will do that then | 16:12 |
vkmc | thanks kgriffs | 16:12 |
kgriffs | yw | 16:13 |
kgriffs | vkmc: btw, is there a wiki page somewhere that summarizes what you have learned about AMQP? | 16:14 |
kgriffs | I think that would be a great to have. | 16:14 |
kgriffs | ... | 16:18 |
kgriffs | .. | 16:19 |
kgriffs | BTW everyone, j-2 is done | 16:19 |
vkmc | kgriffs, yes there is | 16:21 |
vkmc | (sorry, got distracted by the phone) | 16:21 |
vkmc | I have to update it with the latest | 16:22 |
vkmc | https://wiki.openstack.org/wiki/Marconi/specs/amqp/api/v1 | 16:22 |
kgriffs | ah, cool | 16:22 |
vkmc | so... I'll try to leave a POC done | 16:23 |
vkmc | the client.py mentioned in that wiki is a simple implementation of an AMQP client I'll upload too | 16:23 |
kgriffs | cool, that would be hugely helpful. I just want to make sure we have everything squared away by the end of the internship | 16:26 |
vkmc | that AMQP transport implementation would only be able to receive and retrieve messages in a prod/cons fashion | 16:26 |
vkmc | yup | 16:26 |
vkmc | as I told flaper87 last week, I'm planning to keep contributing to Marconi after the internship so I will be around to keep with this research/implementation | 16:27 |
kgriffs | that would be awesome! | 16:27 |
vkmc | I'm done with college so I now can devote more time to open source :) | 16:27 |
kgriffs | we have a a few contributors who have been less active lately, so it would be great to have your continued support | 16:27 |
kgriffs | vkmc: oh, congrats! | 16:27 |
vkmc | kgriffs, thanks! | 16:28 |
kgriffs | bbl | 16:31 |
*** whenry has joined #openstack-marconi | 16:35 | |
*** kgriffs is now known as kgriffs|afk | 16:41 | |
*** tonytan4ever has quit IRC | 16:42 | |
*** chandankumar has quit IRC | 16:44 | |
*** celttechie is now known as celttechie|NotHe | 16:54 | |
*** rwsu has quit IRC | 16:58 | |
*** rwsu has joined #openstack-marconi | 16:59 | |
*** celttechie|NotHe has quit IRC | 17:05 | |
* peoplemerge is still in meetings | 17:06 | |
*** tonytan4ever has joined #openstack-marconi | 17:12 | |
*** tonytan4ever has quit IRC | 17:19 | |
*** cpallares has quit IRC | 17:22 | |
*** cpallares has joined #openstack-marconi | 17:23 | |
*** celttechie has joined #openstack-marconi | 17:27 | |
*** kgriffs|afk is now known as kgriffs | 17:31 | |
*** whenry has quit IRC | 17:40 | |
*** kgriffs is now known as kgriffs|afk | 17:41 | |
*** kgriffs|afk is now known as kgriffs | 17:42 | |
*** flwang_ has joined #openstack-marconi | 17:59 | |
*** kgriffs is now known as kgriffs|afk | 18:00 | |
*** cpallares1 has joined #openstack-marconi | 18:02 | |
*** cpallares has quit IRC | 18:02 | |
*** flwang_ has quit IRC | 18:03 | |
*** kgriffs|afk is now known as kgriffs | 18:13 | |
*** cpallares1 is now known as cpallares | 18:46 | |
*** mwagner_lap has quit IRC | 18:53 | |
*** vkmc has quit IRC | 18:54 | |
*** celttechie is now known as celttechie|NotHe | 19:05 | |
*** mkoderer_cloud has joined #openstack-marconi | 19:09 | |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: Deprecate partial field in v1.0, remove in v1.1 https://review.openstack.org/109391 | 19:12 |
*** malini has joined #openstack-marconi | 19:23 | |
*** kgriffs is now known as kgriffs|afk | 19:26 | |
*** celttechie|NotHe has quit IRC | 19:30 | |
*** vkmc has joined #openstack-marconi | 19:37 | |
*** ametts has quit IRC | 19:43 | |
*** tonytan4ever has joined #openstack-marconi | 19:44 | |
*** flwang_ has joined #openstack-marconi | 20:00 | |
*** oz_akan has joined #openstack-marconi | 20:03 | |
*** ametts has joined #openstack-marconi | 20:04 | |
*** flwang_ has quit IRC | 20:05 | |
*** chandankumar has joined #openstack-marconi | 20:10 | |
*** chandankumar has quit IRC | 20:17 | |
*** flwang_ has joined #openstack-marconi | 20:26 | |
*** kgriffs|afk is now known as kgriffs | 20:26 | |
*** mwagner_lap has joined #openstack-marconi | 20:26 | |
*** flwang_ has quit IRC | 20:28 | |
*** cpallares has quit IRC | 20:29 | |
*** kgriffs is now known as kgriffs|afk | 20:36 | |
*** ametts has quit IRC | 20:40 | |
*** kgriffs|afk is now known as kgriffs | 20:44 | |
*** jmckind has quit IRC | 20:56 | |
*** mpanetta has joined #openstack-marconi | 20:59 | |
*** mpanetta has quit IRC | 21:01 | |
*** mpanetta has joined #openstack-marconi | 21:02 | |
flwang | kgriffs: ping | 21:21 |
*** tonytan4ever has quit IRC | 21:22 | |
kgriffs | o/ | 21:25 |
kgriffs | hey there | 21:25 |
kgriffs | whats up? | 21:25 |
*** tongli has quit IRC | 21:29 | |
*** malini has quit IRC | 21:37 | |
*** celttechie has joined #openstack-marconi | 21:39 | |
flwang | just want to confirm how the sqlalchemy remove the expired messages | 21:40 |
flwang | kgriffs: somebody asked me the question yesterday, but I just know mongo driver is depends on the TTL of mongodb, but I found the code of sqlalchemdy about this is commented, am I missing anything? | 21:42 |
*** mkoderer_cloud has quit IRC | 21:42 | |
*** rwsu has quit IRC | 21:44 | |
*** oz_akan has quit IRC | 21:48 | |
*** vkmc has quit IRC | 21:48 | |
*** haomaiwa_ has quit IRC | 21:55 | |
kgriffs | when the sqlite code was ported to sqlalchemy, deleting expired messages somehow fell through the cracks. The old sqlite code was copied over and commented out as a reference, but never ported to sqla | 21:58 |
kgriffs | hope that makes sense... | 21:59 |
kgriffs | :) | 21:59 |
flwang | kgriffs: did you mean sqlalchemy can support similar TTL mechanism like mongo to remove the expired messages? | 22:02 |
kgriffs | no | 22:02 |
kgriffs | at least, not to my knowledge | 22:03 |
kgriffs | what I mean is that the raw SQL needs to be ported to sqla syntax | 22:03 |
kgriffs | flwang: I've actually got to run now, and I will be offline until Monday...thanks for helping sort this out. You now know everything I do about it. :) | 22:04 |
kgriffs | have a good weekend! | 22:05 |
flwang | ok, see you | 22:05 |
kgriffs | o/ | 22:08 |
kgriffs | cheers | 22:08 |
*** kgriffs is now known as kgriffs|afk | 22:09 | |
*** vkmc has joined #openstack-marconi | 22:22 | |
*** flwang_ has joined #openstack-marconi | 22:29 | |
*** flwang_ has quit IRC | 22:33 | |
*** balajiiyer has joined #openstack-marconi | 22:56 | |
*** oz_akan has joined #openstack-marconi | 23:26 | |
*** mpanetta has quit IRC | 23:47 | |
*** celttechie has quit IRC | 23:57 | |
*** celttechie has joined #openstack-marconi | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!