*** kgriffs|afk is now known as kgriffs | 00:08 | |
*** kgriffs is now known as kgriffs|afk | 00:09 | |
*** Sriram has joined #openstack-marconi | 00:14 | |
*** Sriram has quit IRC | 00:14 | |
*** Sriram has joined #openstack-marconi | 00:15 | |
*** abettadapur_ has joined #openstack-marconi | 01:00 | |
*** abettadapur_ has quit IRC | 01:00 | |
*** Sriram has quit IRC | 01:03 | |
*** shakamunyi has joined #openstack-marconi | 01:05 | |
*** shakayumi has joined #openstack-marconi | 01:15 | |
*** Sriram has joined #openstack-marconi | 01:18 | |
*** shakamunyi has quit IRC | 01:18 | |
*** vkmc has joined #openstack-marconi | 01:25 | |
*** Sriram has quit IRC | 01:51 | |
*** reed has quit IRC | 01:54 | |
*** flwang has quit IRC | 01:55 | |
*** flwang has joined #openstack-marconi | 02:39 | |
*** vkmc has quit IRC | 02:53 | |
*** shakayumi has quit IRC | 02:58 | |
*** prashanthr_ has joined #openstack-marconi | 03:09 | |
*** rossk has quit IRC | 03:13 | |
*** prashanthr_ has quit IRC | 03:14 | |
*** prashanthr_ has joined #openstack-marconi | 03:17 | |
*** prashanthr_ has quit IRC | 03:23 | |
*** haomaiwang has joined #openstack-marconi | 04:16 | |
*** chandan_kumar has joined #openstack-marconi | 04:20 | |
*** haomaiwang has quit IRC | 04:20 | |
*** haomaiwa_ has joined #openstack-marconi | 04:26 | |
*** chandan_kumar is now known as chandankumar | 04:26 | |
*** Sriram has joined #openstack-marconi | 04:29 | |
*** Sriram has quit IRC | 04:34 | |
*** haomaiwa_ has quit IRC | 04:43 | |
*** haomaiwa_ has joined #openstack-marconi | 05:23 | |
*** prashanthr_ has joined #openstack-marconi | 05:31 | |
*** prashanthr_ has quit IRC | 05:42 | |
*** haomaiwa_ has quit IRC | 06:07 | |
*** haomaiwang has joined #openstack-marconi | 06:07 | |
*** whenry has quit IRC | 06:11 | |
*** whenry has joined #openstack-marconi | 06:14 | |
*** haomai___ has joined #openstack-marconi | 06:23 | |
*** haomaiwang has quit IRC | 06:26 | |
*** whenry has quit IRC | 06:31 | |
*** prashanthr_ has joined #openstack-marconi | 06:54 | |
*** whenry has joined #openstack-marconi | 06:59 | |
*** prashanthr_ has quit IRC | 07:00 | |
*** flaper87|afk is now known as flaper87 | 07:06 | |
*** Manishanker has joined #openstack-marconi | 07:11 | |
*** Sriram has joined #openstack-marconi | 07:31 | |
*** AAzza has joined #openstack-marconi | 07:33 | |
*** Sriram has quit IRC | 07:35 | |
*** AAzza has quit IRC | 07:44 | |
*** AAzza has joined #openstack-marconi | 08:23 | |
*** renlt has joined #openstack-marconi | 08:28 | |
*** ekarlso has quit IRC | 08:29 | |
*** ekarlso has joined #openstack-marconi | 08:29 | |
*** flwang has quit IRC | 08:32 | |
*** flwang has joined #openstack-marconi | 08:40 | |
*** flwang has quit IRC | 09:24 | |
*** Sriram has joined #openstack-marconi | 09:32 | |
*** Sriram has quit IRC | 09:36 | |
*** renlt has quit IRC | 09:40 | |
*** AAzza has quit IRC | 10:14 | |
*** malini_afk is now known as malini | 10:55 | |
*** flwang has joined #openstack-marconi | 11:12 | |
*** tedross has joined #openstack-marconi | 11:38 | |
*** tedross has quit IRC | 11:49 | |
*** tedross_ has joined #openstack-marconi | 11:49 | |
*** tellesnobrega has joined #openstack-marconi | 12:07 | |
*** amitgandhi has joined #openstack-marconi | 12:15 | |
tellesnobrega | hi, im starting to use marconi, i would like to know if marconi is already integrated to openstack, and how can i use it | 12:16 |
---|---|---|
flaper87 | tellesnobrega: hey | 12:16 |
flaper87 | welcome :) | 12:16 |
flaper87 | Marconi is still in incubation. However, it's production ready | 12:16 |
tellesnobrega | flaper87: thanks, i think we have talked before. I was here for a while ago | 12:16 |
tellesnobrega | flaper87: i just installed a marconi server and created a queue | 12:17 |
tellesnobrega | following the github readme | 12:17 |
*** amitgandhi has quit IRC | 12:17 | |
flaper87 | tellesnobrega: awesome, are you using the client library or just CURL ? | 12:17 |
tellesnobrega | used curl | 12:17 |
*** jamie_h has joined #openstack-marconi | 12:17 | |
*** amitgandhi has joined #openstack-marconi | 12:17 | |
flaper87 | mmh, interesting. You know we've a client library now, right? :D | 12:19 |
flaper87 | we'll be releasing a new non-alpha version very soon | 12:19 |
tellesnobrega | thats good | 12:19 |
flaper87 | tellesnobrega: may I ask what your current use case is? | 12:21 |
tellesnobrega | flaper87: yes, right now i'm just testing, probably gonna have a client-server and try to communicate using marconi. But my real goal is to use it as the queue to carry streams of data to a stream processing tool that i want to have running in sahara | 12:22 |
*** mwagner_ has joined #openstack-marconi | 12:26 | |
tellesnobrega | i think i talked with you about it before. You said that it fit perfectly for this use case | 12:27 |
*** malini is now known as malini_afk | 12:30 | |
*** mwagner_lap has quit IRC | 12:30 | |
flaper87 | tellesnobrega: ah yeah, I now remember. Sorry, I've a poor memory :) | 12:35 |
tellesnobrega | flaper87: no problem | 12:36 |
tellesnobrega | flaper87: can i use marconi in openstack as a dev? | 12:43 |
*** haomaiwa_ has joined #openstack-marconi | 12:44 | |
flaper87 | tellesnobrega: totally | 12:44 |
flaper87 | there's also devstack support if you are using devstack | 12:45 |
*** haomai___ has quit IRC | 12:45 | |
tellesnobrega | cool. is there any documentation on how to do it? | 12:48 |
flaper87 | tellesnobrega: mmh, wait, I may have misunderstood what you meant | 12:49 |
flaper87 | tellesnobrega: What I meant to say is that you can use marconi and develop things on top of it | 12:50 |
flaper87 | even for other projects | 12:50 |
flaper87 | for other openstack projects* | 12:50 |
flaper87 | tellesnobrega: ah you meant documentation for devstack? | 12:50 |
flaper87 | tellesnobrega: enable_service marconi-server | 12:50 |
flaper87 | that should be enough to get marconi installed | 12:50 |
flaper87 | kgriffs|afk: https://review.openstack.org/92359 ;) | 12:51 |
tellesnobrega | flaper87: cool | 12:51 |
*** sriram has joined #openstack-marconi | 12:51 | |
tellesnobrega | flaper87: looks pretty easy. i will give it a shot | 12:51 |
*** haomai___ has joined #openstack-marconi | 12:57 | |
*** haomaiwa_ has quit IRC | 12:57 | |
*** jchai has joined #openstack-marconi | 12:58 | |
*** amitgandhi has quit IRC | 13:02 | |
*** balajiiyer has joined #openstack-marconi | 13:35 | |
*** chandankumar is now known as chandankumar|afk | 13:37 | |
*** balajiiyer has quit IRC | 13:38 | |
*** balajiiyer has joined #openstack-marconi | 13:39 | |
*** malini_afk is now known as malini | 13:42 | |
*** alcabrera|afk is now known as alcabrera | 13:52 | |
alcabrera | Good morning! :) | 13:53 |
sriram | good morning alcabrera :) | 13:53 |
alcabrera | sriram: how are you? :D | 13:56 |
sriram | alcabrera: I'm doing ok. you? | 13:57 |
alcabrera | I'm... amused. I trolled myself with my alarm clock this morning, sriram | 13:58 |
alcabrera | It set it's own timezone so that when it was 7am, it was actually 8am | 13:58 |
alcabrera | I felt so good, too, getting up *early* | 13:58 |
alcabrera | Thought I had more time. :P | 13:58 |
sriram | haha.. happens to me sometimes as well.. | 13:59 |
flaper87 | alcabrera: sriram gooooood morning | 13:59 |
sriram | flaper87: good morning :) How goes it in the robot world? :P | 14:00 |
flaper87 | allllll goood :D | 14:01 |
flaper87 | you? | 14:02 |
*** mwagner_ has quit IRC | 14:02 | |
*** AAzza has joined #openstack-marconi | 14:02 | |
alcabrera | flaper87: heya! :D | 14:03 |
flaper87 | alcabrera: yo yo yo! :D | 14:04 |
* flaper87 wonders what the weather will be like next week in ATL | 14:04 | |
flaper87 | It better doesn't rain or I'll be really mad | 14:04 |
alcabrera | well... | 14:04 |
alcabrera | >.> | 14:05 |
* flaper87 doesn't like rain and it's been raining for weeks here | 14:05 | |
alcabrera | the weather reports say chance of rain starting Sunday running 'til Tuesday | 14:05 |
sriram | yep | 14:05 |
alcabrera | rainy rainy rainy | 14:05 |
* flaper87 takes his shotgun and starts shutting the clouds | 14:05 | |
flaper87 | shooting | 14:05 |
flaper87 | I don't know | 14:05 |
flaper87 | damnit | 14:05 |
sriram | but its getting pretty warm this week. | 14:05 |
flaper87 | alcabrera: help | 14:05 |
flaper87 | :D | 14:05 |
alcabrera | lol | 14:06 |
* alcabrera seeds the clouds | 14:06 | |
* alcabrera might be doing it wrong. #sendhelp | 14:06 | |
*** cpallares has joined #openstack-marconi | 14:07 | |
flaper87 | lol | 14:08 |
flaper87 | btw, I... won't be able to attend the meeting today | 14:08 |
flaper87 | :/ | 14:08 |
flaper87 | got something to do before leaving and guess what? I've to do it at 17:00 today | 14:08 |
alcabrera | flaper87: good luck with the thing you must do! | 14:12 |
alcabrera | sounds like it's one of those that came u p unexpectedly | 14:12 |
alcabrera | flaper87: looks like we'll be voting on a new program name | 14:16 |
alcabrera | any thoights you'd like for me to proxy for today's meeting, since you won't be able to make it? | 14:17 |
alcabrera | *thoughts | 14:17 |
flaper87 | alcabrera: I'm leaning towards Messaging (re program name) | 14:19 |
flaper87 | that should include notifications and other messaging related things | 14:20 |
alcabrera | alright | 14:20 |
alcabrera | I'll keep that in mind (and in my logs) :D | 14:20 |
flaper87 | alcabrera: awesome, thanks man | 14:20 |
alcabrera | np. :) | 14:20 |
*** abettadapur_ has joined #openstack-marconi | 14:22 | |
cpallares | alcabrera: what? what new name? | 14:23 |
cpallares | alcabrera: also hi :D | 14:23 |
alcabrera | cpallares: hey! :D | 14:24 |
alcabrera | aaaaanddd | 14:24 |
alcabrera | cpallares: https://wiki.openstack.org/wiki/Meetings/Marconi#Agenda -- Marconi's program will be getting a new name | 14:24 |
alcabrera | I think from Queuing -> Messaging | 14:24 |
flaper87 | alcabrera: also also also, pls pls pls, FAQ FAQ FAQ | 14:25 |
flaper87 | just remind everyone we need to get that done | 14:25 |
flaper87 | :D | 14:25 |
alcabrera | oh yes, FAQ. :P | 14:26 |
flaper87 | alcabrera: re "Cut a new python-marconiclient release for PyPI" kgriffs|afk needs this to land, then ask to be added to the marconi-ptl group in reddit and then do the release: https://review.openstack.org/#/c/92359/ | 14:26 |
alcabrera | sweet! | 14:27 |
alcabrera | so close! | 14:27 |
alcabrera | we're gonna go beta, flaper87. :D | 14:27 |
flaper87 | wait, did I say reddit? | 14:28 |
flaper87 | WTF ? | 14:28 |
* flaper87 needs help | 14:28 | |
*** reed has joined #openstack-marconi | 14:30 | |
*** haomai___ has quit IRC | 14:32 | |
*** haomaiwa_ has joined #openstack-marconi | 14:32 | |
alcabrera | lol | 14:39 |
alcabrera | flaper87: I thought that was accurate | 14:39 |
alcabrera | for some reason, it made sense to me that we'd be leveraging reddit | 14:39 |
alcabrera | I have no idea why | 14:39 |
alcabrera | it just *seemed* right. :P | 14:39 |
flaper87 | alcabrera: just replace reddit with gerrit and then it'll make *more* sense | 14:40 |
flaper87 | :D | 14:40 |
flaper87 | https://rfk.id.au/blog/entry/pypy-js-faster-than-cpython/ | 14:40 |
alcabrera | Title: PyPy.js: Now faster than CPython, on a single carefully-tuned benchmark, after JIT warmup | 14:40 |
alcabrera | :D | 14:40 |
*** vkmc has joined #openstack-marconi | 14:50 | |
*** vkmc has quit IRC | 14:50 | |
*** vkmc has joined #openstack-marconi | 14:50 | |
*** shakayumi has joined #openstack-marconi | 14:51 | |
*** amitgandhi has joined #openstack-marconi | 14:53 | |
*** amitgandhi has quit IRC | 14:53 | |
*** kgriffs|afk is now known as kgriffs | 14:53 | |
*** amitgandhi has joined #openstack-marconi | 14:54 | |
alcabrera | meeting in 2 minutes, w00t | 14:57 |
kgriffs | wouldn't miss it. :) | 14:58 |
vkmc | :) Hi alcabrera, kgriffs! | 14:58 |
alcabrera | kgriffs: flaper87's gonna have to miss it, though. D: | 14:58 |
alcabrera | vkmc: heeey! :D | 14:58 |
kgriffs | meeting in #openstack-meeting-alt | 15:02 |
*** ametts has quit IRC | 15:02 | |
*** jergerber has joined #openstack-marconi | 15:04 | |
*** mwagner_ has joined #openstack-marconi | 15:07 | |
*** jchai is now known as jchai_afk | 15:12 | |
*** jchai_afk is now known as jchai | 15:21 | |
*** prashanthr_ has joined #openstack-marconi | 15:26 | |
prashanthr_ | Good morning ! :) | 15:27 |
malini | heyy prashanthr_ | 15:27 |
malini | we have our meeting @ #openstack-meeting-alt now | 15:27 |
prashanthr_ | malini: okay. :) can i also join ? | 15:28 |
alcabrera | prashanthr_: hey! Yeah, join the meeting. It's on for another 30m. :D | 15:28 |
malini | sure..its open for all | 15:28 |
*** haomaiwa_ has quit IRC | 15:29 | |
*** haomaiwa_ has joined #openstack-marconi | 15:30 | |
*** shakayumi has quit IRC | 15:31 | |
*** shakamunyi has joined #openstack-marconi | 15:32 | |
*** megan_w|afk is now known as megan_w | 15:33 | |
*** haomaiwa_ has quit IRC | 15:34 | |
*** rossk has joined #openstack-marconi | 15:42 | |
*** rossk has quit IRC | 15:42 | |
*** rossk has joined #openstack-marconi | 15:42 | |
*** AAzza has quit IRC | 16:01 | |
kgriffs | forgot to mention: "Write the Docs!" is one of our major themes for Juno. I want us to have the best docs out of any program. | 16:06 |
alcabrera | all this time, I've just been using https://wiki.openstack.org/wiki/Marconi/specs/api/v1#Endpoints_Synopsis to work with Marconi, heh. /cc vkmc, cpallares, prashanthr_, abettadapur_, malini | 16:06 |
*** megan_w is now known as megan_w|afk | 16:06 | |
kgriffs | I need everyone's help to make that happen | 16:06 |
kgriffs | alcabrera: do you have any time to play with maven and get the api reference published? | 16:06 |
vkmc | Thanks alcabrera! | 16:07 |
abettadapur_ | alcabrera: the nice thing is that it provides some concrete requests, but yeah, they are somewhat similar | 16:07 |
malini | kgriffs: as in keeping wiki etc. update, or creating real docs under deocs directory? | 16:07 |
kgriffs | alcabrera: if there is a way to generate RST, that would be perfect | 16:07 |
kgriffs | malini: good question; i didn't have time to clarify in the mtg | 16:07 |
kgriffs | let me do that now... | 16:07 |
alcabrera | kgriffs: tbh, maven makes me cringe. I'd love to avoid working with it. >.> | 16:07 |
prashanthr_ | alcabrera: this guide is also pretty descriptive. Thanks | 16:07 |
kgriffs | so, contributor docs and administrivia (blueprints, etc.) live on the wiki | 16:08 |
malini | wish oz were around to hear all the praise :) | 16:08 |
kgriffs | anything an app developer or system administrator would want to reference lives in the RST docs | 16:08 |
kgriffs | those get published here: http://docs.openstack.org/developer/marconi/ | 16:08 |
alcabrera | did anyone volunteer to take down the minutes today? I'll do so if no one else started. :) | 16:09 |
malini | kgriffs: does that page build from the docs directory in our repo? | 16:10 |
* alcabrera saved the minutes | 16:11 | |
alcabrera | vkmc, prashanthr_, abettadapur_: I like the synopsis version since I get to see the whole API in a single page. Less scrolling. :) | 16:12 |
alcabrera | but definitely, oz_akan's developer guide actually shows how to interact with basic tools! | 16:12 |
alcabrera | check out httpie as an alternative to curl, if you haven't already: https://github.com/jakubroztocil/httpie | 16:13 |
prashanthr_ | alcabrera: that's true. But for starter's the developer guide will give a detailed walkthrough. | 16:13 |
alcabrera | much friendlier | 16:13 |
prashanthr_ | Yes httpie is a lot better | 16:13 |
alcabrera | prashanthr_: very true - the synopsis definitely targets more experienced users. :) | 16:13 |
alcabrera | we need to be mindful of beginners. | 16:13 |
*** Manishanker has quit IRC | 16:13 | |
alcabrera | <3 | 16:13 |
vkmc | Great resources :) | 16:14 |
alcabrera | brb all - gotta take a call | 16:15 |
*** alcabrera is now known as alcabrera|afk | 16:15 | |
prashanthr_ | I was checking out marconi's codebase today there is a usage of pipelines during the bootstrapping process. I could not quite understand it. | 16:16 |
vkmc | brb too | 16:16 |
openstackgerrit | Alex Gaynor proposed a change to openstack/marconi: Fixed incorrect reST syntax. https://review.openstack.org/92401 | 16:18 |
*** alcabrera|afk is now known as alcabrera | 16:20 | |
kgriffs | prashanthr_: that feature hasn't seen much use yet. The idea is you can create "filter drivers" | 16:20 |
Alex_Gaynor | kgriffs: ^ doing my part for the best docs :-) | 16:20 |
kgriffs | Alex_Gaynor: w00t | 16:20 |
alcabrera | Alex_Gaynor: +2, nice catch. Always trips me up going 'MD <=> ReST' | 16:21 |
alcabrera | :P | 16:21 |
alcabrera | prashanthr_: will you still be here in 30m? I'm going to step away for lunch and a short break. I'd be happy to talk marconi code then. :) | 16:21 |
kgriffs | prashanthr_: a filter driver implements some or all of the storage driver interface in order to manipulate messages as the fly by | 16:21 |
kgriffs | or to add diagnostics or whatever | 16:21 |
openstackgerrit | Alex Gaynor proposed a change to openstack/marconi: Fixed incorrect reST syntax https://review.openstack.org/92401 | 16:22 |
alcabrera | or kgriffs could be awesome and explain the things while I'm away. ;) | 16:22 |
alcabrera | (pipeline uses: msg compression, msg encrypting, etc. ) | 16:22 |
kgriffs | malini: that user guide I linked to does indeed build from our docs dir | 16:22 |
malini | kgriffs: tht is awesome!! I didnt know we had tht | 16:23 |
kgriffs | malini, alcabrera: what we are missing is the API reference. I couldn't find anywhere that was published. I think you have to be integrated to get on the official api site | 16:23 |
kgriffs | do one of you have time to play with maven and see what our options are? | 16:24 |
malini | kgriffs: do you have an example page of what we need? | 16:24 |
malini | I am lost on what we need | 16:24 |
kgriffs | http://docs.openstack.org/api/openstack-identity-service/2.0/content/ | 16:25 |
kgriffs | we should be able to generate this from doc/wadl | 16:25 |
kgriffs | Catherine and Anne should be able to help us figure this out | 16:26 |
malini | kgriffs: I'll check with them on what needs to be done | 16:26 |
*** megan_w|afk is now known as megan_w | 16:27 | |
*** alcabrera is now known as alcabrera|afk | 16:27 | |
malini | alcabrera: I remember you mentioning Anne sent you some instructions on something - sorry I can't get any more vague | 16:27 |
malini | Was it related to this? | 16:27 |
prashanthr_ | kgriffs: tat's nice . i did not know about filter driver's. Is it kind of a decorator to a driver ?? | 16:29 |
prashanthr_ | alacabrera: yes. I will be here :) Have a nice lunch. | 16:29 |
kgriffs | not really a decorator. You just implement the driver interface in your class iirc. | 16:30 |
kgriffs | and then you add it to the marconi.conf file so stevedore will load it | 16:30 |
kgriffs | that should go in the user guide too. | 16:31 |
prashanthr_ | kgriffs: got it | 16:34 |
kgriffs | prashanthr_: I may be telling you lies; it's been a while since I've looked at that part of marconi. :p | 16:34 |
prashanthr_ | kgriffs: lolzzzz :P | 16:35 |
kgriffs | prashanthr_: but, we need to figure that out ASAP because I want to put timer hooks in there for benchmarking. :D | 16:36 |
kgriffs | https://etherpad.openstack.org/p/juno-marconi-benchmarking | 16:37 |
malini | kgriffs: per Anne we cannot be in docs.openstack.org till we graduate. | 16:38 |
malini | How did we ever get into http://docs.openstack.org/developer/marconi/ ? | 16:38 |
*** megan_w is now known as megan_w|afk | 16:41 | |
*** shakamunyi has quit IRC | 16:42 | |
*** mpanetta has joined #openstack-marconi | 16:50 | |
amitgandhi | malini: but we arent linked to from the home page: http://docs.openstack.org/developer/openstack-projects.html | 16:52 |
*** reed has quit IRC | 16:52 | |
amitgandhi | its a wiki so i guess anyone can create a section | 16:52 |
malini | aah...ok | 16:53 |
sriram | kgriffs: ping | 16:53 |
*** alcabrera|afk is now known as alcabrera | 16:53 | |
kgriffs | sriram: pong | 16:53 |
sriram | we have a basic haproxy setup. | 16:54 |
sriram | shall I start with a claims app or something? | 16:54 |
kgriffs | sriram: we also need a graphite box to post timings to | 16:54 |
sriram | also did some tinkering with graphite.. there's a dummy one running | 16:54 |
malini | kgriffs: do you want the API docs in http://docs.openstack.org/developer/marconi/ ? | 16:54 |
sriram | need to get it to interface. | 16:55 |
kgriffs | ok, then feel free to work on claims app. We need a way to do this using gevent so we can multiplex waiting on I/O/ | 16:55 |
malini | kgriffs: I mean as a new section under tht | 16:55 |
malini | kgriffs: maybe here http://docs.openstack.org/developer/marconi/api.html ? | 16:55 |
kgriffs | malini: good question... we basically have three options | 16:55 |
sriram | hmm, we will be multiprocessing right? | 16:55 |
alcabrera | kgriffs, sriram: how about using asyncio/trollius? | 16:55 |
kgriffs | 1. publish to official api site - can't do that because we aren't integrated | 16:56 |
kgriffs | 2. somehow publish to RST and get into the user guide | 16:56 |
kgriffs | 3. put up our own site - we may still have openstack-marconi.org registered | 16:56 |
malini | w.r.t #2 is http://docs.openstack.org/developer/marconi/api.html the user guide ? | 16:57 |
kgriffs | alcabrera: I was hoping to use python-marconiclient | 16:57 |
alcabrera | kgriffs: that shouldn't preclude python-marconiclient - it is 3k compatible; am I missing something? >.> | 16:58 |
kgriffs | I think we will have to hack the client lib to be async - it uses requests, right? Is there a way to magically make requests work with tulip? | 16:58 |
sriram | could we use grequests? | 16:59 |
alcabrera | ahh, I see what you're saying | 17:00 |
sriram | https://github.com/kennethreitz/grequests | 17:00 |
alcabrera | it'd have to be an upgrade to python-marconiclient | 17:00 |
alcabrera | http://stackoverflow.com/questions/22190403/how-could-i-use-requests-in-asyncio | 17:00 |
alcabrera | sriram: that's one of the approaches suggested in the above SO answer. Good thought. :) | 17:00 |
prashanthr_ | alcabrera: can we do the code discussion now ? | 17:04 |
alcabrera | prashanthr_: yup! | 17:05 |
alcabrera | ask me anything, and I' | 17:05 |
alcabrera | ll be happy to answer | 17:05 |
alcabrera | or find someone who can. :P | 17:05 |
prashanthr_ | ha ha sure. | 17:06 |
prashanthr_ | q1. How is cache being used in marconi . I saw the usage of oslo.cache with url memory:/// . what is the purpose of this ? | 17:06 |
alcabrera | prashanthr_: when marconi operates in a sharded context - | 17:07 |
alcabrera | the cache stores a mapping from (project_id + queue_name) => shard_location | 17:08 |
alcabrera | that way, we don't have to fetch the shard location from the catalogue on each request | 17:08 |
kgriffs | prashanthr_: we plan to use caching for other things, like checking whether a queue exists... WIP | 17:09 |
kgriffs | sriram: I'm thinking grequests is the shortest road to Rome | 17:10 |
prashanthr_ | alcabrera: Ahh okay, I am yet to dig into the sharding code in deep. | 17:10 |
prashanthr_ | kgriffs: Yes i have seen this here : https://bugs.launchpad.net/marconi/+bug/1245573. | 17:10 |
prashanthr_ | is there plans to add more cache backends like memcache ?? | 17:11 |
sriram | kgriffs: hmm, so do you think we should try it out? | 17:12 |
*** AAzza has joined #openstack-marconi | 17:12 | |
alcabrera | prashanthr_: oh yes! We had memcached at some point | 17:12 |
*** reed has joined #openstack-marconi | 17:12 | |
alcabrera | prashanthr_: we're really hoping to see a redis backend soon | 17:12 |
alcabrera | flaper87 put together a lovely memcached backend which just needs to be updated and pulled back in | 17:12 |
prashanthr_ | That's nice :). i was precisely thinking about the same. I think redis fits very naturally as a caching backend as well as the datastore. | 17:13 |
abettadapur_ | quick question: for v1.1, does /v1.1/queues/nonexistentqueue also return [ ] ? | 17:13 |
abettadapur_ | if the queue existed and was empty, it would return [ ] (if i understand correctly) | 17:13 |
sriram | its 204 for now | 17:13 |
sriram | I'm working on that patch | 17:14 |
alcabrera | prashanthr_: Redis as a data store is going to be awesome. I'm really excited about that happening this Summer! | 17:14 |
abettadapur_ | it is supposed to return that though yes? | 17:14 |
sriram | it shoudl be 200 with [] after that patch makes it in. | 17:14 |
sriram | abettadapur_: yes | 17:14 |
abettadapur_ | thanks | 17:14 |
abettadapur_ | is it for all CRUD operations on queues? | 17:15 |
abettadapur_ | i would guess that post message is still supposed to be 404 | 17:15 |
sriram | so post_message to a non existing queue will be a 201. | 17:16 |
sriram | could you be more specific? | 17:16 |
prashanthr_ | alcabrera: yes :). How can i test a sharded marconi queue ? should i run two instances of mongo ?? | 17:17 |
abettadapur_ | ok. the existing tests for v1 return 404 | 17:17 |
abettadapur_ | i'll read the v1.1 docs again | 17:17 |
abettadapur_ | (for a post on a non existent queue) | 17:18 |
sriram | yeah the docs for v1.1 need some updating | 17:18 |
sriram | I'll get on that. | 17:18 |
alcabrera | prashanthr_: yup! I like running three, all on localhost | 17:19 |
alcabrera | prashanthr_: using different ports - mongodb://localhost:27017, mongodb://localhost:27018, mongodb://localhost:27019, ... | 17:20 |
prashanthr_ | alcabrera: Will do that tomorrow. Time to load up my server with requests :). | 17:21 |
alcabrera | prashanthr_: awesome! :D | 17:22 |
prashanthr_ | I was just wondering if we could get some debug messages on the console when we fire up marconi-server | 17:22 |
prashanthr_ | caz i have to check the output of the log file to find out the error. | 17:22 |
prashanthr_ | But would that be difficult because the server is forked as a seperate process ? | 17:23 |
*** megan_w|afk is now known as megan_w | 17:23 | |
alcabrera | prashanthr_: hmm, there is a way to do it | 17:23 |
alcabrera | lemme cvheck the flag | 17:24 |
alcabrera | great typos: | 17:24 |
alcabrera | smore: command not found | 17:24 |
*** chandankumar|afk has quit IRC | 17:24 | |
kgriffs | -v | 17:24 |
kgriffs | that should do it | 17:25 |
alcabrera | kgriffs: +1 | 17:25 |
kgriffs | otherwise, you can configure logging via some other options and/or conf file | 17:25 |
alcabrera | prashanthr_: that did it | 17:25 |
prashanthr_ | kgriffs: alcabrera : thanks :). I guess that's some of the doubts which i had while looking at the code. Will look into some more aspects tomorrow :). | 17:27 |
alcabrera | prashanthr_: cool. I'll be around for more questions. :) | 17:30 |
alcabrera | AAzza, prashanthr_, vkmc: If you all get stuck at any point while looking through marconi, feel free to email me or ping ( flaper87, kgriffs, sriram, malini, flwang ). They're all awesome and friendly and know a lot about marconi. :) | 17:31 |
* alcabrera --> achievemnt unlocked: >5 nicks in a single IRC message | 17:31 | |
prashanthr_ | alcabrera: Sure :) will do that. Getting to learn so many new concepts while exploring the code :). Ha ha congrats on the achievement :) | 17:32 |
alcabrera | hehe. :D | 17:32 |
prashanthr_ | I am also putting the list of questions up here : | 17:32 |
prashanthr_ | https://etherpad.openstack.org/p/marconi-code-discussions | 17:32 |
prashanthr_ | Will update it on the go :) | 17:33 |
sriram | kgriffs: grequests seems to be working :) let me a do a quick test with deletes and claims and see it how it goes. | 17:33 |
alcabrera | oh sweet -- yeah, let's leverage these etherpads, prashanthr_! :) | 17:34 |
prashanthr_ | alcabrera : +1 :) | 17:35 |
prashanthr_ | I will retire for the night. Have a nice day ahead :) | 17:36 |
alcabrera | good night, prashanthr_! | 17:36 |
*** prashanthr_ has left #openstack-marconi | 17:37 | |
*** megan_w is now known as megan_w|afk | 17:37 | |
*** jamie_h has quit IRC | 17:44 | |
*** ametts has joined #openstack-marconi | 17:48 | |
flaper87 | o/ | 17:56 |
flaper87 | what's up PEOPLE!!!! | 17:56 |
flaper87 | Guess who's back? Back again! Guess who's back? Back again, back again.... | 17:56 |
flaper87 | (and so on) | 17:56 |
flaper87 | why is it that you always have fun when I'm not around? | 17:56 |
flaper87 | kgriffs: all good w/ the patch? | 17:57 |
alcabrera | flaper87: welcome back! | 17:57 |
*** chandan_kumar has joined #openstack-marconi | 17:58 | |
kgriffs | lol, maybe I should use this for the party invite: http://www.evite.com/event/create/?template=ce_tmnt_bdv | 18:01 |
* kgriffs thinks evite is short on good templates | 18:01 | |
alcabrera | kgriffs: cowabunga, yo. :P | 18:01 |
alcabrera | needs more pizza pie | 18:01 |
kgriffs | flaper87: oh yes. I'm rockin' the casbah | 18:02 |
kgriffs | http://status.openstack.org/zuul/ | 18:02 |
kgriffs | https://wiki.openstack.org/wiki/Marconi/docs/admin/release/how-to-release#Client | 18:02 |
flaper87 | kgriffs: awesome! Glad to hear that! | 18:04 |
kgriffs | maybe this one since flaper87 will be there ;) - http://www.evite.com/event/create/?template=italian&event_type=dinner_party | 18:04 |
flaper87 | wait, what's that? | 18:05 |
flaper87 | is that for Marconi's dinner ? | 18:05 |
flaper87 | AHHH sorry, I should have read the backlog | 18:05 |
flaper87 | :P | 18:05 |
flaper87 | be back later | 18:07 |
*** megan_w|afk is now known as megan_w | 18:18 | |
*** chandan_kumar has quit IRC | 18:22 | |
*** tedross_ has quit IRC | 18:29 | |
kgriffs | malini: I have the evite ready to send as soon as I get the emails from you | 18:30 |
malini | kgriffs: Getting those now | 18:31 |
*** megan_w is now known as megan_w|afk | 18:31 | |
malini | kgriffs: do you want to include everybody who has contributed code to marconi | 18:31 |
malini | last I checked, we had 34 | 18:31 |
kgriffs | mmm... sure | 18:32 |
kgriffs | bbl (lunch) | 18:33 |
*** kgriffs is now known as kgriffs|afk | 18:34 | |
*** megan_w|afk is now known as megan_w | 18:34 | |
*** kgriffs|afk is now known as kgriffs | 18:35 | |
*** tedross_ has joined #openstack-marconi | 18:43 | |
*** rektide has quit IRC | 18:46 | |
malini | vkmc, cpallares: can you pm me your email IDs, plz? | 18:46 |
malini | kgriffs: I just emailed you the list | 18:54 |
vkmc | Sure malini | 19:05 |
cpallares | vkmc: Are you going to the summit? :D | 19:05 |
vkmc | cpallares, I'm not :/ | 19:06 |
malini | :( | 19:06 |
cpallares | vkmc: oh :( | 19:06 |
vkmc | I'll be there with you remotely though :) following all the etherpads! haha | 19:06 |
cpallares | vkmc: haha | 19:06 |
* cpallares will take notes on the etherpad just for vkmc | 19:07 | |
vkmc | Thanks cpallares :D | 19:07 |
*** tedross_ has quit IRC | 19:19 | |
sriram | kgriffs: ping, how do we plugin grequests into python-marconi client? It works independently for now. | 19:33 |
*** tedross_ has joined #openstack-marconi | 19:34 | |
*** megan_w is now known as megan_w|afk | 19:59 | |
sriram | hmm, if we run the consumer async, we cant separate claim and delete as we would need the claim id, to delete it after claiming. | 20:01 |
*** amitgand_ has joined #openstack-marconi | 20:01 | |
sriram | so we would need them wrapped together and that operation can be async. | 20:01 |
sriram | we should have had pop in v1 :P | 20:02 |
alcabrera | Have a good night, all. :) | 20:03 |
sriram | good night alcabrera :) | 20:03 |
*** amitgand_ has quit IRC | 20:03 | |
*** alcabrera is now known as alcabrera|afk | 20:03 | |
*** amitgand_ has joined #openstack-marconi | 20:03 | |
*** amitgandhi has quit IRC | 20:04 | |
*** megan_w|afk is now known as megan_w | 20:07 | |
*** malini is now known as malini_afk | 20:08 | |
*** sriram has quit IRC | 20:10 | |
flaper87 | o/ | 20:14 |
* flaper87 back again | 20:14 | |
*** balajiiyer1 has joined #openstack-marconi | 20:30 | |
*** balajiiyer has quit IRC | 20:32 | |
*** balajiiyer1 has left #openstack-marconi | 20:35 | |
*** abettadapur_ has quit IRC | 20:36 | |
*** balajiiyer has joined #openstack-marconi | 20:46 | |
*** rektide has joined #openstack-marconi | 20:54 | |
*** malini_afk is now known as malini | 20:55 | |
*** jchai is now known as jchai_afk | 20:58 | |
*** jchai_afk is now known as jchai | 21:01 | |
kgriffs | flaper87: do you have privs to edit milestones here? https://launchpad.net/python-marconiclient | 21:02 |
flaper87 | yup | 21:02 |
flaper87 | don't you? | 21:02 |
kgriffs | nope | 21:02 |
kgriffs | unless I am missing where to do it | 21:02 |
flaper87 | kgriffs: you should, marconi-drivers have privs AFAIK | 21:03 |
flaper87 | and you're part of that group | 21:03 |
flaper87 | : | 21:03 |
flaper87 | :/ | 21:03 |
flaper87 | kgriffs: https://launchpad.net/python-marconiclient/+addseries | 21:03 |
kgriffs | ok, I can do that. How do you make an old series "inactive" | 21:04 |
kgriffs | seems like i've done this before... but it's been a while | 21:04 |
kgriffs | seems like you have to "release it" iirc, but I don't see anywhere to do that | 21:05 |
*** megan_w is now known as megan_w|afk | 21:05 | |
flaper87 | kgriffs: https://launchpad.net/python-marconiclient/icehouse | 21:05 |
flaper87 | you should see "Release Now" | 21:06 |
flaper87 | somewhere in there | 21:06 |
kgriffs | darn. I just noticed this overlaps our queue flavors session. We may need to divide-and-conquer: http://junodesignsummit.sched.org/event/82bbddb45555dc39fa6029ee56e7dc4e#.U2lO6a1dXr0 | 21:07 |
kgriffs | </random> | 21:07 |
kgriffs | flaper87: that's what I thought, but I don't see it anywhere. do you? | 21:07 |
flaper87 | kgriffs: mmh, I do. :/ | 21:08 |
flaper87 | kgriffs: it's in the table | 21:08 |
*** malini is now known as malini_afk | 21:08 | |
flaper87 | kgriffs: Milestones and releases | 21:08 |
*** megan_w|afk is now known as megan_w | 21:09 | |
*** amitgand_ has quit IRC | 21:09 | |
flaper87 | kgriffs: try again | 21:09 |
flaper87 | I added marconi-drivers as the "release-manager" | 21:10 |
kgriffs | oh man | 21:11 |
kgriffs | http://goo.gl/a1vjnf | 21:11 |
kgriffs | don't know how I missed it. The link is so *obvious* | 21:11 |
flaper87 | :P | 21:11 |
kgriffs | oh... maybe it wasn't there after all until you added marconi-drivers. :p | 21:12 |
* flaper87 acts like he did nothing just to make kgriffs facepalm again | 21:12 | |
kgriffs | ok, I'm going to clean up these milestones. Do we want to follow the regular release milestones going forward, or stick with v0, etc. ? | 21:13 |
flaper87 | I'd prefer to follow the server milestons | 21:14 |
flaper87 | and I'd like each blueprint owner to take care of the client implementation if necessary | 21:14 |
flaper87 | not that we can force people | 21:14 |
flaper87 | but it's worth asking anyway | 21:14 |
flaper87 | hopefully most of the contributors will agree to take care of the implementation in both sides | 21:15 |
flaper87 | ideally, we shouldn't release the server w/ a no full-featured client library | 21:15 |
flaper87 | that's like no releasing new features at all | 21:15 |
flaper87 | "Hey, we implemented super dooper queues with flavors candies and more but you can't use that until someone decides to add support for that to the client" #Fail | 21:16 |
kgriffs | +1 | 21:17 |
kgriffs | let me set up the series like that. And we should add a note to the (coming soon) "how to review patches" page on our wiki about this. | 21:17 |
kgriffs | as in, if a change is made to the api, reviewer should encourage the author to also do a python-marconiclient patch | 21:18 |
kgriffs | what do you think? | 21:18 |
flaper87 | sounds good to me | 21:18 |
flaper87 | we could also start tagging changes that require work on the client | 21:19 |
flaper87 | or even better, just make sure the blueprint is targetted for boths | 21:19 |
flaper87 | both | 21:19 |
kgriffs | good point. | 21:19 |
flaper87 | client and server | 21:19 |
kgriffs | flaper87: can you update our current blueprints so they are targeted as you propose? | 21:19 |
flaper87 | I will definitely look like | 21:19 |
flaper87 | WTF? | 21:20 |
flaper87 | do that* | 21:20 |
flaper87 | I was reading something while writing | 21:20 |
flaper87 | I should stop doing that | 21:20 |
kgriffs | flaper87: can you make marconi-drivers the release manager for trunk and v0 series? | 21:23 |
kgriffs | flaper87: lol | 21:23 |
kgriffs | multitasking kills more people... | 21:24 |
flaper87 | kgriffs: sure, lemme do that | 21:24 |
Alex_Gaynor | flaper87, kgriffs: can I bug one of you for a review on https://review.openstack.org/#/c/92401/ | 21:24 |
* flaper87 clicks | 21:24 | |
flaper87 | Alex_Gaynor: thanks, +2 | 21:25 |
flaper87 | kgriffs: done | 21:25 |
Alex_Gaynor | flaper87: thank you | 21:26 |
*** megan_w is now known as megan_w|afk | 21:28 | |
openstackgerrit | A change was merged to openstack/marconi: Fixed incorrect reST syntax https://review.openstack.org/92401 | 21:29 |
*** amitgandhi has joined #openstack-marconi | 21:34 | |
*** balajiiyer has quit IRC | 21:40 | |
*** AAzza has quit IRC | 21:41 | |
*** balajiiyer has joined #openstack-marconi | 21:43 | |
*** balajiiyer has left #openstack-marconi | 21:43 | |
*** amitgandhi has quit IRC | 21:48 | |
kgriffs | flaper87: I took a stab at mapping OS releases to PEP440 versions: https://wiki.openstack.org/wiki/Marconi/docs/admin/release/how-to-release | 21:54 |
kgriffs | I want to get to 1.0 ASAP since that gives developers warm fuzzies | 21:55 |
kgriffs | :D | 21:55 |
flaper87 | kgriffs: that sounds really good and I like that plan | 21:55 |
kgriffs | great. With that note, you are now PTL. | 21:55 |
* kgriffs runs away | 21:56 | |
* flaper87 follows kgriffs and throws the PTL hat to the air | 21:56 | |
flaper87 | :P | 21:56 |
kgriffs | w00t | 21:56 |
* kgriffs STFU and gets back to work | 21:56 | |
*** tedross_ has quit IRC | 21:57 | |
*** mpanetta has quit IRC | 21:58 | |
kgriffs | flaper87: hmmm. How do I change "development focus"? | 22:01 |
kgriffs | https://launchpad.net/python-marconiclient | 22:01 |
kgriffs | I wonder if this is another permissions thing | 22:02 |
* flaper87 gives kgriffs heaven's keys so he can access ALL THE THINGS | 22:02 | |
* kgriffs starts glowing | 22:02 | |
flaper87 | kgriffs: set marconi-drivers as the maintainer of the project | 22:03 |
flaper87 | you should now be able to do all the things | 22:03 |
* flaper87 didn't know a team could be used in that field | 22:03 | |
flaper87 | I also changed the dev focus | 22:03 |
kgriffs | flaper87: cool, thanks | 22:04 |
kgriffs | can you do me one more favor? | 22:04 |
kgriffs | go through all the client bugs and bps - mark them as "released" where appropriate | 22:04 |
flaper87 | kgriffs: sure thing, I'll do that | 22:06 |
kgriffs | thanks! | 22:06 |
flaper87 | there shouldn't be much there | 22:06 |
flaper87 | I remember doing it once | 22:06 |
flaper87 | anyway, I'll take care of that | 22:07 |
kgriffs | I'll make a mental note to add those bugs/bps to my regular triaging rounds. | 22:07 |
kgriffs | (in addition to the server ones) | 22:07 |
*** jchai is now known as jchai_afk | 22:22 | |
kgriffs | cheers guys, catch you later | 22:26 |
*** jchai_afk is now known as jchai | 22:26 | |
*** mwagner_ has quit IRC | 22:27 | |
*** kgriffs is now known as kgriffs|afk | 22:36 | |
*** jchai has quit IRC | 22:42 | |
*** rektide has quit IRC | 22:49 | |
*** cpallares has quit IRC | 23:11 | |
*** jergerber has quit IRC | 23:14 | |
*** amitgandhi has joined #openstack-marconi | 23:21 | |
*** amitgandhi has quit IRC | 23:38 | |
*** mwagner_ has joined #openstack-marconi | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!