*** nosnos has joined #openstack-marconi | 00:34 | |
*** oz_akan_ has joined #openstack-marconi | 00:59 | |
*** kgriffs_afk is now known as kgriffs | 01:09 | |
*** reed has quit IRC | 01:25 | |
*** amitgandhi has quit IRC | 01:26 | |
*** kgriffs is now known as kgriffs_afk | 01:30 | |
*** vkmc has quit IRC | 01:34 | |
*** oz_akan_ has quit IRC | 01:45 | |
*** oz_akan_ has joined #openstack-marconi | 01:46 | |
*** oz_akan__ has joined #openstack-marconi | 03:16 | |
*** oz_akan_ has quit IRC | 03:19 | |
*** oz_akan__ has quit IRC | 03:20 | |
*** oz_akan__ has joined #openstack-marconi | 03:22 | |
*** oz_akan__ has quit IRC | 03:40 | |
*** oz_akan_ has joined #openstack-marconi | 04:51 | |
*** reed has joined #openstack-marconi | 04:52 | |
*** oz_akan_ has quit IRC | 04:55 | |
*** reed has quit IRC | 05:27 | |
*** flaper87|afk is now known as flaper87 | 06:38 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Implement HTTP Transport https://review.openstack.org/49788 | 07:16 |
---|---|---|
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods https://review.openstack.org/50638 | 07:16 |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Pass keywords to the request initialization https://review.openstack.org/50567 | 07:16 |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition https://review.openstack.org/51850 | 07:16 |
*** dafter has joined #openstack-marconi | 07:53 | |
*** yassine has joined #openstack-marconi | 08:05 | |
*** dafter has quit IRC | 09:17 | |
*** dafter has joined #openstack-marconi | 09:18 | |
*** dafter has quit IRC | 09:19 | |
*** dafter has joined #openstack-marconi | 09:31 | |
*** dafter has quit IRC | 09:52 | |
*** dafter has joined #openstack-marconi | 09:53 | |
*** dafter has quit IRC | 09:57 | |
*** dafter has joined #openstack-marconi | 09:57 | |
*** dafter has quit IRC | 10:03 | |
*** tvb|afk has joined #openstack-marconi | 10:06 | |
*** tvb|afk has quit IRC | 10:06 | |
*** tvb|afk has joined #openstack-marconi | 10:07 | |
*** tvb|afk has quit IRC | 10:07 | |
*** tvb|afk has joined #openstack-marconi | 10:07 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods https://review.openstack.org/50638 | 10:10 |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition https://review.openstack.org/51850 | 10:10 |
*** tvb|afk has quit IRC | 10:11 | |
*** dafter has joined #openstack-marconi | 10:26 | |
openstackgerrit | A change was merged to openstack/marconi: fix(queues): Global config used everywhere https://review.openstack.org/51705 | 10:34 |
*** flaper87 is now known as flaper87|afk | 10:51 | |
*** tedross has joined #openstack-marconi | 11:36 | |
*** nosnos has quit IRC | 11:48 | |
*** nosnos has joined #openstack-marconi | 11:49 | |
*** nosnos has quit IRC | 11:54 | |
*** flaper87|afk is now known as flaper87 | 12:41 | |
*** oz_akan_ has joined #openstack-marconi | 13:07 | |
*** oz_akan_ has quit IRC | 13:07 | |
*** oz_akan_ has joined #openstack-marconi | 13:08 | |
*** ayoung has quit IRC | 13:22 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Implement queue's API methods https://review.openstack.org/50638 | 13:34 |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Add list of required fields to the API definition https://review.openstack.org/51850 | 13:34 |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Bootstrap Messages support https://review.openstack.org/52389 | 13:39 |
*** kgriffs_afk is now known as kgriffs | 13:45 | |
openstackgerrit | A change was merged to openstack/marconi: Use stevedore instead of importutils https://review.openstack.org/51540 | 13:51 |
*** jcru has joined #openstack-marconi | 13:53 | |
*** jergerber has joined #openstack-marconi | 14:04 | |
*** amitgandhi has joined #openstack-marconi | 14:06 | |
*** amitgandhi has quit IRC | 14:12 | |
flaper87 | kgriffs: good morning | 14:12 |
*** amitgandhi has joined #openstack-marconi | 14:13 | |
fvollero | flaper87: morning to you... | 14:13 |
fvollero | flaper87: https://cloud.sugnu.eu/public.php?service=files&t=c7177b1199aa7f95380be717463b82fe | 14:13 |
kgriffs | good morning/afternoon! | 14:14 |
kgriffs | LOL | 14:14 |
flaper87 | fvollero: you seriously don't want kids, do you? | 14:15 |
flaper87 | :D | 14:15 |
flaper87 | kgriffs: hot news, the config patch landed | 14:15 |
flaper87 | we should get the other 2 merged as well | 14:15 |
flaper87 | but there's one with a -1 | 14:15 |
fvollero | flaper87: LOL :) I already gave to manu the shipment... i'll take a picture just for you to see | 14:16 |
kgriffs | flaper87: yeah, saw that. glad to have that monster patch wrapped up! | 14:16 |
flaper87 | kgriffs: also, it would be really nice if you could review the client patches as well! | 14:16 |
flaper87 | fvollero: :D GRAZIE!!!! | 14:16 |
kgriffs | flaper87: sure thing | 14:17 |
kgriffs | btw, needs rebase: https://review.openstack.org/#/c/51541/ | 14:17 |
kgriffs | I'd like to get those 2 pipeline patches of yours merged in and rebase the sharding on them before addressing feedback | 14:18 |
fvollero | flaper87: check again that link | 14:18 |
flaper87 | kgriffs: let me do that right away | 14:18 |
*** ayoung has joined #openstack-marconi | 14:18 | |
kgriffs | rock on | 14:18 |
flaper87 | fvollero: oooook, that looks better! | 14:18 |
fvollero | flaper87: :) | 14:18 |
flaper87 | fvollero: thanks buddy! Seriously! :) | 14:18 |
fvollero | flaper87: you're welcome :) | 14:19 |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Return a consumer function instead of consuming https://review.openstack.org/51541 | 14:22 |
flaper87 | kgriffs: ^ | 14:22 |
*** dafter has quit IRC | 14:23 | |
*** dafter has joined #openstack-marconi | 14:23 | |
*** dafter has quit IRC | 14:23 | |
*** dafter has joined #openstack-marconi | 14:23 | |
*** dafter has quit IRC | 14:28 | |
*** dafter has joined #openstack-marconi | 14:41 | |
*** dafter has quit IRC | 14:41 | |
*** dafter has joined #openstack-marconi | 14:41 | |
openstackgerrit | A change was merged to openstack/marconi: Return a consumer function instead of consuming https://review.openstack.org/51541 | 14:58 |
*** malini_afk is now known as malini | 15:15 | |
*** vkmc has joined #openstack-marconi | 15:18 | |
*** vkmc has quit IRC | 15:18 | |
*** vkmc has joined #openstack-marconi | 15:18 | |
openstackgerrit | Malini Kamalambal proposed a change to openstack/marconi: Validation for messages returned by queue/stats https://review.openstack.org/50995 | 15:24 |
malini | flaper87: ping | 15:33 |
flaper87 | malini: pong | 15:34 |
flaper87 | malini: gooood morning | 15:34 |
flaper87 | how are you doing? | 15:34 |
malini | good..how are you? | 15:34 |
*** etoews1 has joined #openstack-marconi | 15:34 | |
flaper87 | malini: great, thanks! :D | 15:35 |
malini | I was just looking at the wrong hreg bug you reported..Between this & the negative age in stats bug, I think we need to include more validation of response bodies in our tests | 15:35 |
etoews1 | i'm looking at the response for get queue stats. https://wiki.openstack.org/wiki/Marconi/specs/api/v1#Get_Queue_Stats | 15:35 |
etoews1 | is this a complete example? | 15:36 |
etoews1 | could there be something else at the same level as the messages key? | 15:36 |
etoews1 | will messages always (in v1) be the only top level key? | 15:36 |
malini | flaper87: I am debating between adding those validations in functional tests vs unit tests | 15:37 |
malini | you have any thoughts? | 15:37 |
kgriffs | etoews1: I think that example is correct. Let me verify. | 15:38 |
malini | etoews1: with the current implementation messages is the only top level key | 15:38 |
flaper87 | malini: I think unit tests would work in that case | 15:38 |
*** yassine has quit IRC | 15:39 | |
etoews1 | kgriffs. by correct do you mean complete? | 15:39 |
flaper87 | Since it is not 'endpoint' related but API, it can be tested using unittests | 15:39 |
etoews1 | i'm just wondering if there could be anything else in there. | 15:39 |
kgriffs | yes, correct and complete | 15:39 |
etoews1 | kgriffs malini: thanks for that info. | 15:39 |
kgriffs | in the future there may be, but not now. extensions could also add stuff in there, of course | 15:40 |
malini | flaper87: thanks! | 15:40 |
etoews1 | right. | 15:40 |
flaper87 | malini: np :) | 15:40 |
kgriffs | etoews1: rock on | 15:41 |
openstackgerrit | A change was merged to openstack/marconi: Validation for messages returned by queue/stats https://review.openstack.org/50995 | 15:41 |
kgriffs | btw, we are tracking feedback on the API, so please let us know if you come across anything not already listed | 15:41 |
kgriffs | https://wiki.openstack.org/wiki/Marconi/specs/api/next | 15:41 |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: feat: Storage sharding foundation https://review.openstack.org/50437 | 15:42 |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: fix(bootstrap): Logging CLI options don't work https://review.openstack.org/52216 | 15:42 |
kgriffs | flaper87: btw, I was just thinking, it would be cool if we passed the config object to stages when they are loaded | 15:44 |
flaper87 | kgriffs: yeah, I thought about that too and forgot to mention it in the commit summary. The reason why I didn't go down that road is because we don't have a Stage baseclass and I stuck to YAGNI. I see how that can be useful, though. | 15:46 |
flaper87 | I'm making some other changes to the pipeline (backward compatible, I guess) | 15:47 |
flaper87 | I can add that if we agree | 15:47 |
*** kgriffs is now known as kgriffs_afk | 15:50 | |
*** kgriffs1 has joined #openstack-marconi | 15:51 | |
*** ChanServ sets mode: +o kgriffs1 | 15:51 | |
kgriffs1 | I think it would be fine to add a base class. Seems like having conf available would encourage stages to not rely on global conf | 15:53 |
flaper87 | kgriffs1: +1 | 15:54 |
flaper87 | kgriffs1: man, it's weird to see your non-green nick :D | 15:54 |
*** kgriffs1 has left #openstack-marconi | 15:55 | |
*** kgriffs_afk is now known as kgriffs | 15:55 | |
etoews1 | in get queue stats, what is the unit of messages.oldest.age? | 15:57 |
*** kgriffs is now known as kgriffs_afk | 15:57 | |
*** dafter has quit IRC | 15:58 | |
*** kgriffs has joined #openstack-marconi | 15:58 | |
*** ChanServ sets mode: +o kgriffs | 15:59 | |
etoews1 | in get queue stats, to confirm, is messages.oldest.created the date/time of the oldest created message? | 16:00 |
*** ChanServ sets mode: +o flaper87 | 16:00 | |
malini | etoews1: that is correct | 16:01 |
etoews1 | malini: what is the unit of messages.oldest.age? | 16:03 |
*** kgriffs has quit IRC | 16:04 | |
*** kgriffs_afk is now known as kgriffs | 16:04 | |
*** dafter has joined #openstack-marconi | 16:05 | |
*** dafter has quit IRC | 16:05 | |
*** dafter has joined #openstack-marconi | 16:05 | |
kgriffs | etoews1: age is in seconds | 16:05 |
malini | etoews1: it's a timestamp like this one '"created": "2013-10-17T16:04:52Z"' | 16:05 |
kgriffs | flaper87: you should be able to change the topic now | 16:05 |
malini | etoews1: age is in seconds & created is the timestamp above | 16:06 |
*** dafter has quit IRC | 16:06 | |
malini | sorry for the confusion | 16:06 |
*** dafter has joined #openstack-marconi | 16:06 | |
flaper87 | kgriffs: thank you, sir! :) | 16:07 |
etoews1 | kgriffs malini: thx. | 16:07 |
*** dafter has quit IRC | 16:11 | |
kgriffs | flaper87: I addressed your feedback and rebased the sharding patch: https://review.openstack.org/#/c/50437/ | 16:13 |
openstackgerrit | Flavio Percoco proposed a change to openstack/marconi: Migrate from nosetest to testr https://review.openstack.org/52443 | 16:15 |
flaper87 | kgriffs: lemme take a look right away | 16:15 |
*** mpanetta has joined #openstack-marconi | 16:17 | |
kgriffs | cool, thx! | 16:18 |
kgriffs | ttfn | 16:18 |
*** mpanetta has quit IRC | 16:21 | |
*** mpanetta has joined #openstack-marconi | 16:21 | |
*** flaper87 changes topic to "OpenStack Queuing and Notification Service || Wiki: https://wiki.openstack.org/wiki/Marconi || Paste: http://paste.openstack.org/ || Smile: :D" | 16:22 | |
*** kgriffs is now known as kgriffs_afk | 16:43 | |
*** flaper87 is now known as flaper87|afk | 16:44 | |
*** reed has joined #openstack-marconi | 16:52 | |
*** tacuddy2000 has joined #openstack-marconi | 17:07 | |
*** fvollero is now known as fvollero|gone | 17:22 | |
zyuan | kgriffs_afk: ping | 17:38 |
*** mpanetta has quit IRC | 17:43 | |
*** mpanetta has joined #openstack-marconi | 17:44 | |
amitgandhi | kgriffs_afk: meeing | 18:04 |
amitgandhi | *meeting | 18:04 |
*** tacuddy2000 has quit IRC | 18:53 | |
*** malini is now known as malini_afk | 19:03 | |
*** malini_afk is now known as malini | 19:26 | |
*** kgriffs_afk is now known as kgriffs | 19:35 | |
*** malini is now known as malini_afk | 19:36 | |
*** vkmc has quit IRC | 20:01 | |
*** vkmc has joined #openstack-marconi | 20:01 | |
*** mpanetta_ has joined #openstack-marconi | 20:14 | |
*** mpanetta has quit IRC | 20:18 | |
kgriffs | all quiet on the western front... | 20:23 |
*** etoews1 has quit IRC | 21:03 | |
*** mpanetta_ has quit IRC | 21:06 | |
*** mpanetta has joined #openstack-marconi | 21:07 | |
*** oz_akan_ has quit IRC | 21:21 | |
*** tedross has quit IRC | 21:23 | |
zyuan | merge this first? https://review.openstack.org/#/c/50437/ | 21:25 |
russell_h | do I need to do something beyond just running a marconi instance to get messages GCed from mongo? | 21:30 |
russell_h | it seems like there were some changes related to this recently, but I can't figure out exactly how its supposed to work now | 21:30 |
zyuan | russell_h: no, they will expire, just not "on time" | 21:30 |
zyuan | TTL on messages is pretty much "minimal time to live" | 21:31 |
russell_h | gotcha | 21:31 |
russell_h | does mongo do some sort of periodic compatctions? | 21:31 |
zyuan | 1 min granularity iirc | 21:32 |
zyuan | i'm not too surprise even if it can live longer; incremental GC is modern languages can live much longer | 21:33 |
zyuan | in* | 21:33 |
*** whenry has quit IRC | 21:33 | |
russell_h | huh | 21:34 |
russell_h | odd that mongo doesn't filter these on read | 21:35 |
russell_h | zyuan: anyway, this makes sense (excepting mongo's oddities), thanks! | 21:35 |
zyuan | that'll be slow to distributed system | 21:35 |
russell_h | slower than actually returning the data? | 21:35 |
zyuan | (well, the sqlite driver does that, hehe) | 21:35 |
kgriffs | russell_h: we actually could filter by expired, but chose not to do it for performance | 21:36 |
zyuan | probably, because mongo itself also support sharding | 21:36 |
kgriffs | FWIW, we aren't currently using mongo's sharding feature | 21:36 |
kgriffs | the performance just comes from reduced index complexity and lookup time | 21:37 |
kgriffs | anyway, we are using mongo's TTL index feature | 21:37 |
russell_h | kgriffs: yeah, I'm just surprised that mongo doesn't do that itself | 21:37 |
kgriffs | so, on average, a message will live about 30 seconds past it's actual expiration | 21:37 |
kgriffs | russell_h: that would be nice! | 21:37 |
kgriffs | s/it's/its | 21:38 |
zyuan | many db with TTL support don't do it, including redis | 21:38 |
*** jergerber has quit IRC | 21:41 | |
zyuan | kgriffs: how can i test RountingController? | 21:47 |
zyuan | i need to write some tests for QueueController | 21:47 |
kgriffs | zyuan: You could just create an instance of sharding.Driver | 21:50 |
kgriffs | FWIW, there are some test configs under tests/etc | 21:50 |
kgriffs | e.g., wsgi_sqlite_sharded.conf | 21:51 |
kgriffs | they don't have configs for the catalog in there yet, just the sharding=true option set | 21:51 |
zyuan | ok | 21:51 |
*** amitgandhi has quit IRC | 21:56 | |
*** amitgandhi has joined #openstack-marconi | 22:01 | |
*** amitgandhi has quit IRC | 22:04 | |
zyuan | ConfigOpts nosetests nosetests's commandline arguments. this is an issue i solved before in the config module... | 22:05 |
*** amitgandhi has joined #openstack-marconi | 22:06 | |
zyuan | anyway. see you tomorrow! | 22:06 |
zyuan | setenv NOSE_NOCAPTURE 1 | 22:08 |
*** mpanetta_ has joined #openstack-marconi | 22:14 | |
*** mpanetta has quit IRC | 22:16 | |
*** malini_afk is now known as malini | 22:19 | |
*** amitgandhi has quit IRC | 22:28 | |
*** ayoung has quit IRC | 22:30 | |
*** kgriffs has left #openstack-marconi | 22:33 | |
*** malini is now known as malini_afk | 22:40 | |
*** reed has quit IRC | 22:54 | |
*** reed has joined #openstack-marconi | 22:59 | |
*** reed has quit IRC | 23:05 | |
*** jergerber has joined #openstack-marconi | 23:07 | |
*** reed has joined #openstack-marconi | 23:08 | |
*** reed has quit IRC | 23:09 | |
*** kgriffs has joined #openstack-marconi | 23:14 | |
*** ChanServ sets mode: +o kgriffs | 23:14 | |
*** mpanetta_ is now known as mpanetta | 23:19 | |
*** reed has joined #openstack-marconi | 23:21 | |
*** kgriffs is now known as kgriffs_afk | 23:24 | |
*** ayoung has joined #openstack-marconi | 23:45 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!