*** rongze has quit IRC | 00:00 | |
*** kgriffs_afk is now known as kgriffs | 00:04 | |
*** oz_akan_ has joined #openstack-marconi | 00:09 | |
*** kgriffs is now known as kgriffs_afk | 00:14 | |
*** oz_akan_ has quit IRC | 00:14 | |
*** cpallares has quit IRC | 00:21 | |
*** amitgandhi has joined #openstack-marconi | 00:22 | |
*** amitgandhi has quit IRC | 00:28 | |
*** oz_akan_ has joined #openstack-marconi | 00:34 | |
*** oz_akan_ has quit IRC | 00:39 | |
*** amitgandhi has joined #openstack-marconi | 00:45 | |
*** oz_akan_ has joined #openstack-marconi | 01:11 | |
*** nosnos has joined #openstack-marconi | 01:26 | |
*** rongze has joined #openstack-marconi | 01:27 | |
*** rongze has quit IRC | 01:31 | |
*** oz_akan_ has quit IRC | 01:52 | |
*** flwang has joined #openstack-marconi | 01:55 | |
*** flwang has left #openstack-marconi | 01:56 | |
*** flwang has joined #openstack-marconi | 01:56 | |
*** reed has quit IRC | 02:00 | |
*** rongze has joined #openstack-marconi | 02:06 | |
*** oz_akan_ has joined #openstack-marconi | 02:54 | |
*** nosnos has quit IRC | 02:58 | |
*** oz_akan_ has quit IRC | 02:58 | |
*** nosnos has joined #openstack-marconi | 02:59 | |
*** flwang has quit IRC | 03:08 | |
*** oz_akan_ has joined #openstack-marconi | 03:09 | |
*** oz_akan_ has quit IRC | 03:14 | |
*** amitgandhi has quit IRC | 03:16 | |
*** amitgandhi has joined #openstack-marconi | 03:16 | |
*** amitgandhi has quit IRC | 03:21 | |
*** oz_akan_ has joined #openstack-marconi | 04:10 | |
*** oz_akan_ has quit IRC | 04:14 | |
*** flwang has joined #openstack-marconi | 04:17 | |
*** russell_h has quit IRC | 04:24 | |
*** russell_h has joined #openstack-marconi | 04:27 | |
*** rongze has quit IRC | 04:31 | |
*** jamieh has joined #openstack-marconi | 04:33 | |
*** oz_akan_ has joined #openstack-marconi | 05:11 | |
*** oz_akan_ has quit IRC | 05:15 | |
*** jamieh has quit IRC | 05:20 | |
*** russell_h has quit IRC | 05:42 | |
*** russell_h has joined #openstack-marconi | 05:42 | |
*** ykaplan has joined #openstack-marconi | 05:50 | |
*** oz_akan_ has joined #openstack-marconi | 06:13 | |
*** oz_akan_ has quit IRC | 06:17 | |
*** ykaplan has quit IRC | 07:23 | |
*** flaper87|afk is now known as flaper87 | 08:03 | |
*** oz_akan_ has joined #openstack-marconi | 08:15 | |
*** oz_akan_ has quit IRC | 08:19 | |
*** ykaplan has joined #openstack-marconi | 09:07 | |
*** yassine has joined #openstack-marconi | 09:10 | |
*** oz_akan_ has joined #openstack-marconi | 09:15 | |
*** oz_akan_ has quit IRC | 09:20 | |
*** flwang has quit IRC | 09:28 | |
*** flwang has joined #openstack-marconi | 10:14 | |
*** oz_akan_ has joined #openstack-marconi | 10:16 | |
*** oz_akan_ has quit IRC | 10:21 | |
*** ykaplan has quit IRC | 10:28 | |
*** rongze has joined #openstack-marconi | 10:28 | |
*** ykaplan has joined #openstack-marconi | 10:30 | |
*** rongze has quit IRC | 10:46 | |
*** rongze has joined #openstack-marconi | 11:03 | |
openstackgerrit | Fei Long Wang proposed a change to openstack/marconi: Fixes wrong hrefs when getting set of messages https://review.openstack.org/58092 | 11:09 |
---|---|---|
*** oz_akan_ has joined #openstack-marconi | 11:17 | |
*** oz_akan_ has quit IRC | 11:21 | |
*** ykaplan has quit IRC | 11:25 | |
*** ykaplan has joined #openstack-marconi | 11:33 | |
*** gordonsim has joined #openstack-marconi | 11:35 | |
openstackgerrit | Flavio Percoco proposed a change to openstack/python-marconiclient: Add `simple` example for the client library https://review.openstack.org/57554 | 11:36 |
*** rongze has quit IRC | 11:39 | |
openstackgerrit | A change was merged to openstack/python-marconiclient: Add `simple` example for the client library https://review.openstack.org/57554 | 11:39 |
*** fifieldt has quit IRC | 11:40 | |
*** rongze_ has joined #openstack-marconi | 11:56 | |
openstackgerrit | Fei Long Wang proposed a change to openstack/marconi: Fixes wrong hrefs when getting set of messages https://review.openstack.org/58092 | 12:06 |
*** oz_akan_ has joined #openstack-marconi | 12:18 | |
*** wirehead_ has quit IRC | 12:19 | |
*** oz_akan_ has quit IRC | 12:22 | |
*** wirehead_ has joined #openstack-marconi | 12:30 | |
flwang | anybody there? | 13:11 |
*** jergerber has joined #openstack-marconi | 13:11 | |
*** jamieh has joined #openstack-marconi | 13:12 | |
flaper87 | flwang: o/ | 13:14 |
flwang | I'm curious is there any plan to enable py3 in Marconi given it's a new project and the cost will be low | 13:14 |
*** ayoung has quit IRC | 13:22 | |
*** oz_akan_ has joined #openstack-marconi | 13:25 | |
*** oz_akan_ has quit IRC | 13:28 | |
flaper87 | flwang: there is. We have a non-voting gate | 13:29 |
flaper87 | and I was planning to start migrating it. Do you want to work on that? | 13:29 |
*** oz_akan_ has joined #openstack-marconi | 13:29 | |
flwang | i see, i mean do we want to enable it as a gate | 13:29 |
flaper87 | flwang: we want to make it voting as soon as it start's being green :D | 13:29 |
flwang | I'd like to do some investigation | 13:30 |
flaper87 | flwang: go ahead and make our day | 13:31 |
flaper87 | :D | 13:31 |
flwang | flaper87: sure, btw, would you mind revisiting my patch ? https://review.openstack.org/#/c/58092/ | 13:33 |
*** tedross has joined #openstack-marconi | 13:34 | |
flaper87 | flwang: small nit, otherwise it LGTM | 13:37 |
*** jamieh has quit IRC | 13:40 | |
*** mpanetta has joined #openstack-marconi | 13:41 | |
flwang | flaper87: will fix in next PS | 13:42 |
openstackgerrit | Fei Long Wang proposed a change to openstack/marconi: Fixes wrong hrefs when getting set of messages https://review.openstack.org/58092 | 14:13 |
openstackgerrit | Fei Long Wang proposed a change to openstack/marconi: Fixes wrong hrefs when getting set of messages https://review.openstack.org/58092 | 14:20 |
*** nosnos has quit IRC | 14:20 | |
*** rongze_ has quit IRC | 14:27 | |
*** thomasem has joined #openstack-marconi | 14:36 | |
*** rongze has joined #openstack-marconi | 14:38 | |
*** amitgandhi has joined #openstack-marconi | 14:38 | |
*** alcabrera has joined #openstack-marconi | 14:40 | |
alcabrera | Good morning! | 14:41 |
mpanetta | alcabrera: morning | 14:41 |
alcabrera | mpanetta: hey! :) | 14:43 |
mpanetta | how goes alcabrera? | 14:44 |
flaper87 | alcabrera: GOOD MORNING | 14:47 |
flaper87 | :D | 14:47 |
*** jcru has joined #openstack-marconi | 14:47 | |
alcabrera | flaper87: :D | 14:47 |
alcabrera | mpanetta: it's going pretty well. A good, slow morning before I get to reviews/code/fixes/blogs/everything. | 14:48 |
mpanetta | Slow is nice | 14:48 |
mpanetta | When does kgriffs_afk usually come around? | 14:49 |
alcabrera | he'll be here in 10 minutes, I'm guessing, since we have a notifications meeting. As for usually... seems to vary between 30 minutes from now and an hour from now. | 14:50 |
mpanetta | Ah cool thanks. | 14:52 |
alcabrera | flaper87: how do you feel about doing 5 super tiny reviews for annoying marconi bugs/small optimizations? ;) | 14:53 |
* alcabrera is ready to provide some links | 14:54 | |
*** amitgand_ has joined #openstack-marconi | 14:54 | |
flaper87 | alcabrera: lets do it! | 14:55 |
alcabrera | Alright, here we go! | 14:55 |
alcabrera | 1. https://review.openstack.org/#/c/59507/ (fix: memcached backend in oslo.cache returns None for set) | 14:56 |
megan_w | here for the notifications meeting o/ | 14:56 |
alcabrera | 2. https://review.openstack.org/#/c/59511/ (opt: mongodb hints) | 14:56 |
alcabrera | 3. https://review.openstack.org/#/c/59513/ (rm: proxy cruft) | 14:56 |
alcabrera | 4. https://review.openstack.org/#/c/59539/ (mongodb tests consume storage like crazy) | 14:56 |
flaper87 | alcabrera: 1. is it downstream only? I don't remember updating the oslo review | 14:56 |
*** kgriffs_afk is now known as kgriffs | 14:56 | |
alcabrera | flaper87: yeah, it's only downstream. I commented on the oslo.cache review awhile ago with this issue. | 14:57 |
alcabrera | 5. https://review.openstack.org/#/c/59541/ (fix: shard test failing) | 14:57 |
alcabrera | that's all of them. | 14:57 |
alcabrera | megan_w: hey! :D | 14:57 |
alcabrera | kgriffs: o/ | 14:57 |
flaper87 | alcabrera: yeah, I haven't addressed it yet because we're still changing things in the cache API | 14:57 |
flaper87 | T_T | 14:57 |
kgriffs | yo yo | 14:57 |
flaper87 | kgriffs: btw, I commented on that cache review. Great comments man! | 14:57 |
flaper87 | I'd like your feedback there before starting to work on another version | 14:57 |
kgriffs | flaper87: kk | 14:57 |
flaper87 | s/another/a new/ | 14:58 |
*** amitgandhi has quit IRC | 14:58 | |
kgriffs | I am going to try to start commenting on other oslo patches in general, but... so many ambitions, so little time. | 14:58 |
kgriffs | :p | 14:59 |
alcabrera | there's just too much to do, kgriffs! ;) | 14:59 |
kgriffs | alcabrera: yep! | 14:59 |
* kgriffs needs to invent a pop-tart that slows down time when you eat it | 14:59 | |
flaper87 | alcabrera: fix: mongodb tests consume storage like crazy | 15:00 |
flaper87 | LOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOL | 15:00 |
mpanetta | Please! | 15:00 |
flaper87 | that happened to me as well | 15:00 |
flaper87 | :D | 15:00 |
alcabrera | yeeeepp, flaper87! | 15:00 |
alcabrera | It was terrible. D: | 15:00 |
* kgriffs mkdir temporal_pop_tart; cd temporal_pop_tart; git init . | 15:01 | |
kgriffs | ok | 15:01 |
kgriffs | meeting time? | 15:01 |
alcabrera | ready | 15:01 |
megan_w | ready | 15:01 |
* mpanetta is starting to worry that someone may fall through the roof here... | 15:01 | |
kgriffs | amitgand_: ready for mtg? | 15:02 |
flaper87 | alcabrera: all +2 but (4) | 15:02 |
kgriffs | alcabrera: are you in the office? | 15:02 |
*** dragondm has joined #openstack-marconi | 15:02 | |
* alcabrera ssh poptart_box; cd temporal_pop_tart; touch recipe.txt; git ci -am "add recipe skeleton"; exit | 15:02 | |
flwang | o/ | 15:02 |
*** ildikov has joined #openstack-marconi | 15:02 | |
thomasem | o/ | 15:03 |
alcabrera | kgriffs: yup | 15:03 |
dragondm | o/ | 15:03 |
kgriffs | alcabrera: is amitgand_ around? | 15:03 |
kgriffs | dragondm, thomasem, flaper87: yo, thanks for coming! | 15:03 |
flaper87 | \o/ | 15:03 |
dragondm | no problem. | 15:03 |
alcabrera | kgriffs: yup, I just ping'd him | 15:03 |
kgriffs | kk | 15:03 |
flaper87 | 100euros, thanks! | 15:03 |
kgriffs | we'll start in 2 mins | 15:03 |
alcabrera | flaper87: thanks for the quick reviews! | 15:04 |
* kgriffs hands out pop-tarts | 15:04 | |
amitgand_ | kgriffs: hi | 15:04 |
kgriffs | amitgand_: thanks for coming! | 15:04 |
*** amitgand_ is now known as amitgandhi | 15:04 | |
kgriffs | I wanted to get your ideas since you did a hackday project around notifications | 15:04 |
kgriffs | ok | 15:04 |
kgriffs | let's get this party started. | 15:04 |
* kgriffs puts on party hat | 15:04 | |
kgriffs | #startmeeting marconi-notifications-brainstorm | 15:05 |
openstack | Meeting started Tue Dec 3 15:05:09 2013 UTC and is due to finish in 60 minutes. The chair is kgriffs. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:05 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:05 |
openstack | The meeting name has been set to 'marconi_notifications_brainstorm' | 15:05 |
kgriffs | #link https://etherpad.openstack.org/p/marconi-notifications-brainstorm | 15:05 |
kgriffs | #topic goals | 15:05 |
amitgandhi | #link https://github.com/amitgandhinz/cloud_notifications#api | 15:05 |
flaper87 | o/ | 15:05 |
kgriffs | OK, first off I wanted to get a rough consensus around what use cases we are trying to enable | 15:06 |
kgriffs | thoughts? | 15:06 |
megan_w | app development | 15:06 |
megan_w | alerting | 15:06 |
amitgandhi | reporting | 15:07 |
flaper87 | and notification | 15:07 |
thomasem | definitely reporting | 15:07 |
alcabrera | notifications, in the sense of, when X happens, users [Y] get a notifications in one or more of [Z] forms. | 15:07 |
* amitgandhi moves to etherpad | 15:07 | |
flaper87 | (events) | 15:07 |
flaper87 | alcabrera: out of my head | 15:07 |
flaper87 | thanks | 15:07 |
alcabrera | flaper87: :) | 15:07 |
flwang | alarm | 15:07 |
kgriffs | ok, let's get some concrete examples for those | 15:08 |
kgriffs | alerting? | 15:08 |
megan_w | 1. send me email when i use more than 100GB of CDN usage | 15:08 |
kgriffs | megan_w: is that an alarm? | 15:08 |
megan_w | maybe i'm confusing alarm and alerting | 15:09 |
megan_w | sorry | 15:09 |
alcabrera | a disk drive is reaching 90% capacity -> ops manager gets an sms and an email | 15:09 |
thomasem | Send me a report at the end of each day detailing the operation failures | 15:09 |
thomasem | But, I guess that's more from a deployers perspective. | 15:09 |
*** ayoung has joined #openstack-marconi | 15:09 | |
flaper87 | lets all go to the etherpad | 15:09 |
alcabrera | +1 | 15:09 |
* mpanetta watches | 15:10 | |
flaper87 | and then we can come back here | 15:10 |
*** gordc has joined #openstack-marconi | 15:10 | |
thomasem | Okay, cool | 15:10 |
mpanetta | I'm lurking, I hope that is ok. :) | 15:10 |
alcabrera | mpanetta: lurk away! | 15:10 |
kgriffs | flaper87: +1 | 15:10 |
kgriffs | just go and type in examples | 15:10 |
flwang | an alarm is like the alarm using in Ceilometer | 15:12 |
gordonsim | I'm not entirely clear on what exactly notifications means here. On the one hand there is a general pub-sub type mechanism to allow subscribers to be notified when messages of interest are published. On the other is a service built on top of something like that, which is essentially a precanned listener that handles the notification of a message by generating some 'external' notification (e.g. sends an SMS/Emai | 15:14 |
gordonsim | is this more of the second? | 15:15 |
gordonsim | or is the first in scope as well? | 15:15 |
flaper87 | gordonsim: it's pretty much both, TBH! | 15:16 |
flaper87 | The final goal is to allow people to do the second | 15:16 |
flaper87 | gordonsim: want to join? https://etherpad.openstack.org/p/marconi-notifications-brainstorm | 15:16 |
megan_w | i suppose there is something non-immediate about a report, right? that's what makes it differnt from alerting on some of these use cases..? | 15:17 |
gordonsim | flaper87: yes, I'm there | 15:17 |
flaper87 | gordonsim: ah sorry, I don't see your nick | 15:17 |
flaper87 | :D | 15:17 |
alcabrera | megan_w: I'm with you on that idea. The alarm would be triggered on some condition, whereas the report probably has a periodic nature. | 15:17 |
megan_w | right | 15:17 |
alcabrera | alarm behaves very much like alert | 15:18 |
kgriffs | megan_w: noted | 15:18 |
flwang | alcabrera: yep, but I prefer to use alarm to be consistent with the term using in Ceilometer | 15:19 |
flwang | and generally, alarm will trigger a binding action | 15:20 |
alcabrera | flwang: noted - the earlier we agree on common terminology, the better off we'll be in the long run. :) | 15:20 |
flwang | alcabrera: +1 | 15:21 |
kgriffs | #info Need way to avoid 2 email workers from resending the same message | 15:27 |
kgriffs | OK folks, looks like we are winding down on use cases and terminology | 15:28 |
kgriffs | let's wrap that up so we can move on to the next topic | 15:28 |
flwang | kgriffs: +1 :D | 15:28 |
mpanetta | So templates would be for presentation only? Why not use them to define the types of notifications as well? Or does that not make sense? | 15:33 |
alcabrera | mpanetta: hmm... I think template == output, so it could be the envelope for a given notification as presented to the target device/user. Trigger should be the input, in my mind. | 15:35 |
*** apmelton1 has joined #openstack-marconi | 15:35 | |
mpanetta | Ah ok | 15:35 |
kgriffs | mpanetta: yeah, each sink could have an associated template and trigger/pattern thingy | 15:36 |
mpanetta | So the templates would be a way to define what you are subscribing to? | 15:36 |
alcabrera | mpanetta: nah, that would be part of the pattern/trigger. The pattern/trigger might say, "when X arrives on channel [Y], notify [Z] using this particular Template" | 15:38 |
mpanetta | Ok, tht makes sense. | 15:38 |
kgriffs | #topic elephants | 15:38 |
kgriffs | (see etherpad) | 15:38 |
mpanetta | So colorful heh. Never done this etherpad thing before. | 15:39 |
alcabrera | mpanetta: this is one of the prettiest ones I've seen. 13 users. :D | 15:40 |
kgriffs | ok, great thoughts so far! | 15:41 |
kgriffs | we have 20 minutes left | 15:41 |
kgriffs | Moving on | 15:41 |
thomasem | cool | 15:41 |
kgriffs | #topic features | 15:42 |
mpanetta | Everything is an 'event' :P | 15:42 |
kgriffs | Any other features people want to add/talk about? | 15:42 |
kgriffs | (see etherpad under "Features: Stuff Users See") | 15:42 |
megan_w | sort of | 15:43 |
megan_w | i assume we leave the actual SMS, email, etc up to someone else? | 15:43 |
kgriffs | megan_w: +1 | 15:44 |
kgriffs | I think the marconi project should provide 2-3 reference sinks. | 15:44 |
kgriffs | 15:45 | |
kgriffs | webhook | 15:45 |
kgriffs | one more? | 15:45 |
amitgandhi | sms | 15:45 |
megan_w | yeah | 15:45 |
amitgandhi | and i think we need to do APN | 15:46 |
mpanetta | APN? | 15:46 |
amitgandhi | push notifications | 15:46 |
mpanetta | AH ok | 15:46 |
amitgandhi | it gives us the mobile market | 15:46 |
amitgandhi | amazon SNS introduced it a few months back also | 15:46 |
megan_w | totally agreed. people expect push here | 15:47 |
*** whenry has joined #openstack-marconi | 15:48 | |
kgriffs | I like APN | 15:49 |
kgriffs | I want to get people thinking mobile apps | 15:49 |
kgriffs | let's do that one | 15:49 |
kgriffs | people can insert their APN creds into the reference sink to try it out | 15:50 |
alcabrera | For the record, since I wasn't aware of APN... | 15:51 |
alcabrera | #info Apple Push Notification Service (APNS) | 15:51 |
thomasem | Thanks, was about to ask. =] | 15:51 |
kgriffs | Google has something similar for Android | 15:52 |
kgriffs | (I forget the name) | 15:52 |
kgriffs | OK, we are short on time | 15:52 |
flaper87 | APN = http://en.wikipedia.org/wiki/Access_Point_Name | 15:52 |
kgriffs | One more topic I wanted to touch on, then we will wrap up this session | 15:52 |
alcabrera | #info GCM = Google Cloud Message, Android's analogue to APNS | 15:53 |
kgriffs | flaper87: The "s" in "APNs" is significant, it turns out. :p | 15:53 |
flaper87 | :P | 15:53 |
mpanetta | TMTLA | 15:53 |
kgriffs | #topic how to publish messages to a sink | 15:54 |
kgriffs | OK, so thoughts on how events will get published? | 15:55 |
kgriffs | worker pool? | 15:55 |
kgriffs | pipleline stage within marconi itself? | 15:56 |
kgriffs | something else? | 15:56 |
alcabrera | I'm +1 for worker pool, so that the workers themselves can be scaled as needed | 15:56 |
* flaper87 has to step out for a bit! | 15:56 | |
amitgandhi | +1 for WP | 15:56 |
* flaper87 has a call | 15:56 | |
alcabrera | flaper87: D: | 15:56 |
flwang | I prefer pipeline | 15:56 |
alcabrera | flaper87: jk, see you soon. | 15:56 |
kgriffs | flaper87: need your vote on the above real quick | 15:56 |
flaper87 | if you guys want to discuss that, go ahead! I'll catch up. I don't want to break the flow | 15:56 |
kgriffs | (or when you get back) | 15:56 |
flaper87 | sure | 15:56 |
flaper87 | mmh, WP, it'll allow us to run them concurrently and / or distributed | 15:57 |
flaper87 | actually, concurrently :D | 15:57 |
alcabrera | I like the idea of a transformation pipeline, since it has a functional flavor to it. However, if a pipeline was the connecting mechanism, I'd want that to delegate out to the workers. | 15:57 |
flaper87 | we don't want to send yet another message to send a notification | 15:57 |
*** reed has joined #openstack-marconi | 15:57 | |
alcabrera | flaper87: +1 | 15:58 |
flwang | pipeline allow us to add numbers of transformer | 15:58 |
flwang | and the transformer can be customied by user | 15:58 |
kgriffs | so, with the pipeline approach we could just run lots of wsgi workers. non-blocking I/O would be crucial. | 15:58 |
kgriffs | also, as flwang pointed out, you can build up a simple workflow (think filter pipeline in photoshop) | 15:59 |
kgriffs | downside is you lose some efficiency since you can't scale queues and notifications independently | 15:59 |
kgriffs | oz_akan_: thoughts? | 15:59 |
dragondm | ^ we are working on this for Ceilometer.. | 15:59 |
alcabrera | My primary concern with the pipeline approach is the matter of independent worker scaling - would we just launch as many marconi instances as needed to meet the demand for all types of sinks (sms, apns, hooks, etc.)? | 16:00 |
amitgandhi | i like that worker pools can be scaled horizontally and are more resilient to workers crashing | 16:00 |
oz_akan_ | hi, I wasn't following the thread, let me have a look | 16:00 |
kgriffs | we might also consider some kind of hybrid idea | 16:00 |
kgriffs | for example, you could set up a distributed pipeline by stacking queues end-to-end | 16:00 |
mpanetta | Oh how unixy of you | 16:01 |
kgriffs | leave marconi-queues to do it's think. marconi-notifications sets up the queues, manages subscriptions and workers | 16:01 |
kgriffs | mpanetta: why thank you! I try. :D | 16:01 |
mpanetta | :) | 16:02 |
mpanetta | marconi == | :) | 16:02 |
*** ayoung has quit IRC | 16:02 | |
kgriffs | app | marconi | worker | sms | 16:02 |
alcabrera | yup - functional transforms all the way through | 16:03 |
kgriffs | app | queue1 | worker_a | queue2 | worker_b | sms | 16:03 |
kgriffs | something like that. | 16:03 |
mpanetta | Sounds good to me | 16:03 |
kgriffs | I think we just invented workflow-as-a-service | 16:03 |
* kgriffs winks at Mirantis | 16:04 | |
alcabrera | lol | 16:04 |
mpanetta | lol | 16:04 |
alcabrera | so that's another good elephant | 16:04 |
alcabrera | actually | 16:04 |
alcabrera | yeah, what's the deal with Mirantis + workers? | 16:04 |
alcabrera | Is that something we can use? | 16:04 |
flwang | kgriffs: it's Mistral workflow-as-a-service | 16:04 |
alcabrera | flwang: thanks for the clarification! | 16:04 |
kgriffs | yep | 16:04 |
alcabrera | #link https://wiki.openstack.org/wiki/Mistral | 16:05 |
kgriffs | Is there a concrete use case for doing multiple transformations or whatever? | 16:05 |
amitgandhi | oooph cloud cron! | 16:05 |
amitgandhi | *oooh | 16:05 |
kgriffs | Just thinking we may be getting ahead of ourselves | 16:05 |
kgriffs | amitgandhi: ooh, that would be nice | 16:05 |
alcabrera | anyway | 16:06 |
amitgandhi | its a mistral use case | 16:06 |
* alcabrera gets back to topic | 16:06 | |
kgriffs | we could set up a "cron" job that hits a web hook for the event data, then pushes it to a topic | 16:06 |
alcabrera | "how to publish messages to a sink" | 16:06 |
kgriffs | ok folks, looks like we are out of time | 16:06 |
thomasem | hmm? kgriffs Ceilometer is already and will be doing pipeline work for its own stuff. Is this in an effort to expose a pipeline to clients? | 16:06 |
kgriffs | I really appreciate everyones thoughts. We had a very productive brainstorming session! | 16:06 |
thomasem | Indeed | 16:07 |
amitgandhi | yeh this was fun | 16:07 |
kgriffs | thomasem: I definitely don't want to reinvent workflow/distributed pipeline | 16:07 |
amitgandhi | next steps? | 16:07 |
mpanetta | Mistral looks very interesting... | 16:07 |
thomasem | Haha, yeah. That'd be a bit wild. | 16:07 |
thomasem | :P | 16:07 |
kgriffs | OK, so I will attempt to summarize the etherpad into a pretty wiki | 16:07 |
kgriffs | And link that to the bp | 16:08 |
kgriffs | #link https://blueprints.launchpad.net/marconi/+spec/notifications | 16:08 |
flwang | cool | 16:08 |
thomasem | =] Cheers everyone! | 16:08 |
alcabrera | awesome, good session. :D | 16:08 |
mpanetta | kgriffs: So, about that merge... ;) | 16:09 |
kgriffs | then maybe next monday we can discuss sub-blueprints and get volunteers to start laying down code | 16:09 |
kgriffs | #endmeeting | 16:09 |
openstack | Meeting ended Tue Dec 3 16:09:19 2013 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 16:09 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/marconi_notifications_brainstorm/2013/marconi_notifications_brainstorm.2013-12-03-15.05.html | 16:09 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/marconi_notifications_brainstorm/2013/marconi_notifications_brainstorm.2013-12-03-15.05.txt | 16:09 |
openstack | Log: http://eavesdrop.openstack.org/meetings/marconi_notifications_brainstorm/2013/marconi_notifications_brainstorm.2013-12-03-15.05.log.html | 16:09 |
alcabrera | hmm... | 16:09 |
alcabrera | kgriffs: should we reference this minute over at the wiki standard location? | 16:09 |
alcabrera | s/minute/meeting | 16:09 |
kgriffs | alcabrera: sure! | 16:10 |
kgriffs | alcabrera: want to take care of that? | 16:10 |
alcabrera | kgriffs: alright, I'll link things up. I was already on it! ;) | 16:10 |
kgriffs | I will also link to it from the wiki | 16:10 |
kgriffs | alcabrera: rock on | 16:10 |
* kgriffs gives alcabrera a fresh box of pap tarts | 16:10 | |
flwang | alcabrera: kgriffs: could you pls revisit my patch https://review.openstack.org/#/c/58092/ ? | 16:11 |
alcabrera | flwang: will do! | 16:11 |
* alcabrera noms on the pop tarts | 16:11 | |
kgriffs | flwang: will do | 16:12 |
flwang | thank you, guys | 16:12 |
mpanetta | There is a python lib that does task flow management? Interesting... | 16:12 |
flwang | so tired to catch you guys every night :P | 16:12 |
flwang | mpanetta: yep | 16:12 |
flwang | it's named as taskflow | 16:13 |
flwang | driving by Yahoo! | 16:13 |
mpanetta | flwang: Yes, they mention it at the Mistra web page. | 16:13 |
flwang | mpanetta: https://wiki.openstack.org/wiki/TaskFlow | 16:13 |
mpanetta | Very interesting | 16:13 |
flwang | which has been used in Cinder | 16:14 |
flwang | and Glance is investigating it | 16:14 |
* mpanetta has much research to do... | 16:14 | |
mpanetta | kgriffs: Do you have a moment? | 16:14 |
alcabrera | meeting minutes all linked up | 16:14 |
alcabrera | time to review the things | 16:15 |
alcabrera | flwang: heh, turns out I was reviewing your patch just before this meeting started! I had the tab open and I was looking over the test. :) | 16:16 |
flwang | I'm standing by to address any coming comments :) | 16:17 |
*** ayoung has joined #openstack-marconi | 16:17 | |
kgriffs | mpanetta: sure | 16:20 |
kgriffs | btw, I still have a patch or two to rebase (sharding) and then I will bug alcabrera and flaper87 to get them reviewed ASAP | 16:21 |
alcabrera | flwang: +2'd | 16:21 |
flwang | alcabrera: cool, thanks. flaper87: I need your bless | 16:21 |
alcabrera | kgriffs: I'll be ready to review when you've rebased. I have 4 bug fixes and 1 optimization (< 10 LOC each on average) for you to check out. | 16:21 |
kgriffs | flwang: approved, but added a some comments (no show stoppers) | 16:22 |
flwang | kgriffs: thanks for the comments and the approval, it's my first baby in Marconi | 16:24 |
kgriffs | flwang: w00t | 16:24 |
* kgriffs gives flwang a high-five | 16:24 | |
alcabrera | flwang: nice! I'm looking to seeing you make more awesome happen in marconi. :) | 16:24 |
flwang | kgriffs: i have approved many patches, but i'm a little bit excited to get my first approval from Marconi :D | 16:24 |
alcabrera | looking forward to | 16:24 |
flwang | alcabrera: sure, thanks dude | 16:25 |
openstackgerrit | A change was merged to openstack/marconi: Fixes wrong hrefs when getting set of messages https://review.openstack.org/58092 | 16:25 |
flwang | kgriffs: i mean in Glance :) | 16:25 |
flwang | thank you, guys | 16:26 |
alcabrera | w00t | 16:27 |
mpanetta | kgriffs: Cool. I would like to have something today if possible. I have tests I need to run. | 16:34 |
mpanetta | I'm feeling a bit testy. :P | 16:34 |
*** yassine has quit IRC | 16:49 | |
* kgriffs steps on eggshells around mpanetta | 16:49 | |
mpanetta | Hmm, bad pun I guess :P | 16:50 |
kgriffs | alcabrera: btw, thanks for helping me overwrite all the free space on my drive. If someone steals my laptop, they won't be able to recover any deleted files now! | 16:50 |
* kgriffs needs that unit test fix! | 16:50 | |
mpanetta | haha | 16:50 |
alcabrera | kgriffs: np, no problem at all. ;) | 16:50 |
mpanetta | It isn't a bug, it is a feature! | 16:51 |
kgriffs | mpanetta: you said it! | 16:51 |
alcabrera | It *really* showed me the limitations of my SSD Linux partition (~50GB). :P | 16:51 |
alcabrera | I've never filled up space more quickly than that. | 16:51 |
mpanetta | I take it the test created a lot of messages... | 16:51 |
kgriffs | alcabrera: let's get this merged asap! https://review.openstack.org/#/c/59539/1/tests/unit/queues/storage/test_impl_mongodb.py | 16:52 |
alcabrera | I'll address that feedback now. :) | 16:53 |
kgriffs | thanks! | 16:55 |
kgriffs | I'm going to get tired typing "rm". :p | 16:55 |
openstackgerrit | A change was merged to openstack/marconi: fix: cache contract for memcached backend https://review.openstack.org/59507 | 16:56 |
* kgriffs writes a bash script entitled "clean" | 16:57 | |
mpanetta | hah | 16:59 |
kgriffs | mpanetta: btw, I am rebasing the sharding patches right now. will be ready for review soon! | 16:59 |
* kgriffs wants parallel testing for when MARCONI_TEST_MONGODB=1 | 17:00 | |
alcabrera | kgriffs: yeeeesss ^ | 17:01 |
openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: mongodb tests consume storage like crazy https://review.openstack.org/59539 | 17:03 |
alcabrera | kgriffs: ^^ (made it work with the mixin. Turns out it was as simple as flipping the order of inheritance.) | 17:03 |
alcabrera | flaper87: ^^ | 17:03 |
openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: shard test failing https://review.openstack.org/59541 | 17:04 |
mpanetta | kgriffs: Thank you :) | 17:04 |
flaper87 | alcabrera: another thought in-line. | 17:08 |
flaper87 | that implementation breaks _purge_database mro scanning. | 17:09 |
alcabrera | flaper87: good point - I like the idea about making the mixin inherit from testing.TestBase. | 17:09 |
alcabrera | Except at that point, I'd skip out on calling it a mixin and call it something else. :) | 17:09 |
flaper87 | alcabrera: sorry about that. I shouldn't have said mixin in first place | 17:09 |
alcabrera | updating the patch. :D | 17:09 |
alcabrera | no worries | 17:10 |
flaper87 | I did think about a mixin, I just realized that it's not that good after all | 17:10 |
alcabrera | I'm calling it: MongodbTestBase | 17:10 |
flaper87 | alcabrera: +1, wasn't there one already? You may want to put it in marconi/tests as opposed to tests/ | 17:11 |
alcabrera | I don't think we have one of those. :/ | 17:11 |
alcabrera | Given that it's mongodb-specific, I'm inclined to keep it in tests.unit.queues.storage.impl_mongodb | 17:11 |
alcabrera | it's going to override _prepare_conf, too, it seems. | 17:13 |
*** gordc has left #openstack-marconi | 17:13 | |
alcabrera | hrmmm... | 17:15 |
alcabrera | subtyping gets so weird sometimes. :/ | 17:15 |
*** mpanetta is now known as mpanetta_lunch | 17:15 | |
*** reed has quit IRC | 17:16 | |
flaper87 | alcabrera: ah, yeah, you're right. it's mongo stuff and should go under impl_mongo | 17:19 |
flaper87 | -ETOOMANYTHINGS | 17:19 |
alcabrera | flaper87: I think the easiest solution is just to have every class reimplement _purge_databases. It gets pretty nasty if we start getting all hierarchical, given that... | 17:24 |
alcabrera | _purge_databases is defined first in testing.TestBase, which... | 17:24 |
alcabrera | is then the parent of ControllerBase, which is then the parent of... | 17:24 |
alcabrera | XControllerTest | 17:24 |
flaper87 | alcabrera: mmh, wait, if you make that base class inherit from testing.testBase and then the others inherit from MongodbBase, what issues are there? | 17:25 |
alcabrera | MRO continues to strike, because the _purge_databases that is used is the first one declared in the parents list, e.g, class Y(A, B) | 17:25 |
alcabrera | vs. Y(B, A) | 17:25 |
*** kgriffs is now known as kgriffs_afk | 17:25 | |
flaper87 | yeah, but I mean, just have Y(MongodbBase) | 17:26 |
alcabrera | hmmm... | 17:26 |
flaper87 | ah | 17:26 |
flaper87 | no nevermind, I got your point | 17:26 |
flaper87 | in that case, ignore me! | 17:26 |
flaper87 | I agree with you | 17:26 |
alcabrera | but MongodbXControllerTest needs XControllerTest :P | 17:26 |
alcabrera | it's messy, heh. :x | 17:27 |
flaper87 | I forgot about the Controllers classes | 17:27 |
alcabrera | yup - it gets all diamondified | 17:27 |
*** ykaplan has quit IRC | 17:30 | |
alcabrera | I'm reverting to manual method override. | 17:30 |
alcabrera | I think we can come back to this later and attempt a more elegant solution. | 17:30 |
openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: mongodb tests consume storage like crazy https://review.openstack.org/59539 | 17:35 |
alcabrera | flaper87: now with a 100% more explicit commit message. ;) | 17:35 |
openstackgerrit | Alejandro Cabrera proposed a change to openstack/marconi: fix: shard test failing https://review.openstack.org/59541 | 17:35 |
*** ayoung has quit IRC | 17:39 | |
*** reed has joined #openstack-marconi | 17:41 | |
alcabrera | flaper87: thanks! | 17:49 |
flaper87 | alcabrera: ;) | 17:49 |
flaper87 | alcabrera: kgriffs_afk this one should be pretty easy to review: https://review.openstack.org/#/c/59566/ | 17:49 |
*** ayoung has joined #openstack-marconi | 17:51 | |
*** kgriffs_afk is now known as kgriffs | 17:52 | |
kgriffs | stupid intertubes | 17:52 |
kgriffs | back online at a thai restaurant | 17:53 |
kgriffs | (lunch) | 17:53 |
alcabrera | mmmm, thai... | 17:53 |
alcabrera | which reminds me - I should go heat up my lunch. | 17:53 |
alcabrera | I'll brb | 17:53 |
*** alcabrera is now known as alcabrera|afk | 17:53 | |
*** alcabrera|afk is now known as alcabrera | 17:55 | |
* kgriffs kgriffs is rebasing ALL THE THINGS! | 17:56 | |
alcabrera | kgriffs: go, kgriffs, go! :D | 17:56 |
*** rongze has quit IRC | 17:58 | |
flaper87 | kgriffs: go go go! | 18:09 |
* flaper87 will have authentic Italian pizza for dinner! | 18:09 | |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: chore: Pass cache into drivers https://review.openstack.org/54445 | 18:10 |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: feat(sharding): Cache shard mappings https://review.openstack.org/54945 | 18:10 |
alcabrera | kgriffs: awesome! | 18:12 |
alcabrera | flaper87: delicious! | 18:12 |
alcabrera | I'll review those cache patches very soon. | 18:12 |
kgriffs | those two are ready for review | 18:12 |
alcabrera | cache patch... cache patch... say that fast 4 or 5 times! | 18:12 |
kgriffs | LOL | 18:12 |
kgriffs | I think this channel wins for most lolz/day | 18:13 |
flaper87 | LOOOOOOOOOOOOL | 18:14 |
flaper87 | huahuahua | 18:14 |
kgriffs | I think the foundation should track that metric | 18:14 |
flaper87 | alcabrera: that must be tweeted | 18:14 |
kgriffs | vital stat | 18:14 |
kgriffs | ;) | 18:14 |
flaper87 | kgriffs: hahaha | 18:14 |
flaper87 | I've always said MArconi channel is the coolest, funiest and happiest channel throughout openstack | 18:15 |
flaper87 | kk, brb | 18:15 |
flaper87 | dinner | 18:15 |
kgriffs | I'd love to see a LOL graphite | 18:15 |
mpanetta_lunch | Mmm Thai is right. | 18:16 |
alcabrera | :P | 18:16 |
*** mpanetta_lunch is now known as mpanetta | 18:16 | |
kgriffs | then we could be like, "hey guys, looks like our LOLz are trending down this past month. we need to buckle down and get those numbers back up" | 18:16 |
mpanetta | kgriffs: (LOL) | 18:16 |
kgriffs | We'll have to hire ourselves a certified Lolz Master to keep us on track. | 18:17 |
alcabrera | kgriffs: haha | 18:17 |
alcabrera | ROFL-driven development | 18:18 |
kgriffs | LOOOOOOOOL | 18:18 |
alcabrera | "have no doubts - team morale is always on the up" | 18:18 |
thomasem | Contagious cheer in this IRC channel. | 18:19 |
thomasem | I must admit. | 18:19 |
mpanetta | Weee! | 18:19 |
alcabrera | :) | 18:19 |
* kgriffs is starting to wonder if he's had too much caffeine for the day | 18:20 | |
* thomasem is betting on it. | 18:20 | |
thomasem | =P | 18:20 |
mpanetta | Unless the merge is done, no you have not had enough :P | 18:20 |
thomasem | Lol | 18:21 |
alcabrera | ah, yes - reviews. | 18:21 |
alcabrera | I'll do that now. | 18:21 |
kgriffs | mpanetta: guess I better go get another coke | 18:21 |
kgriffs | ;) | 18:21 |
alcabrera | kgriffs: review for a review? Those 5 patches are one +2 away from making marconi happier for everyone. ;) | 18:21 |
kgriffs | ah yes | 18:21 |
kgriffs | I will do those right after mine are merged, or in between rebasing again, whichever comes first | 18:22 |
alcabrera | kk | 18:22 |
kgriffs | flaper87: I can haz teh reviewz? | 18:23 |
alcabrera | I keep expecting docstrings to contain cat-english since it comes up on this channel from time to time. | 18:24 |
alcabrera | "Pass teh cachez in for lower latencies." | 18:24 |
kgriffs | alcabrera: don't tempt me! | 18:24 |
alcabrera | Things like that. | 18:24 |
alcabrera | :P | 18:24 |
kgriffs | ROFL | 18:24 |
kgriffs | "...for teh lower latenzees" | 18:25 |
alcabrera | lol | 18:26 |
* kgriffs goes back to reviewens teh codez | 18:27 | |
alcabrera | kgriffs: both patches look good to me. +2 | 18:30 |
mpanetta | Doo eeet! | 18:30 |
*** mpanetta has quit IRC | 18:31 | |
kgriffs | flaper87: get back here and do some reviews! | 18:32 |
kgriffs | And bring some pizza with you! | 18:33 |
alcabrera | flaper87 just needs to give his blessing after that delicious italian pizza's all gone. :P | 18:33 |
* kgriffs wants pizza | 18:33 | |
*** openstackgerrit has quit IRC | 18:33 | |
*** openstackgerrit has joined #openstack-marconi | 18:33 | |
kgriffs | ok guys, I'mm making my way over to the office. be back in a few | 18:33 |
alcabrera | kgriffs: kk | 18:35 |
*** gordonsim has left #openstack-marconi | 18:37 | |
*** kgriffs is now known as kgriffs_afk | 18:43 | |
*** rongze has joined #openstack-marconi | 18:49 | |
*** sandywalsh_ has joined #openstack-marconi | 18:53 | |
*** rongze has quit IRC | 18:54 | |
flaper87 | back | 18:56 |
alcabrera | flaper87: w00t | 18:57 |
alcabrera | I'm about to head to a meeting. | 18:57 |
alcabrera | kgriffs_afk: wanted you to check the cache patches whenever you got a chance. :) | 18:57 |
flaper87 | alcabrera: kk, any urgent patch to review? | 18:57 |
alcabrera | I hope your pizza was *awesome*, by the way. | 18:57 |
alcabrera | just the cache patchews. | 18:57 |
alcabrera | *patches | 18:57 |
flaper87 | it was great. Spicy! | 18:58 |
flaper87 | :D | 18:58 |
alcabrera | yum! | 18:58 |
alcabrera | I'll probably be back in an hour. If I miss you in the process, I hope the rest of your night goes well, flaper87. :d | 18:58 |
alcabrera | :D | 18:58 |
flaper87 | Usage: yum [options] COMMAND | 18:58 |
alcabrera | lol :P | 18:59 |
flaper87 | alcabrera: thanks buddy, you too! | 18:59 |
flaper87 | take care | 18:59 |
*** alcabrera is now known as alcabrera|afk | 18:59 | |
*** amitgand_ has joined #openstack-marconi | 19:02 | |
*** mpanetta has joined #openstack-marconi | 19:03 | |
*** amitgandhi has quit IRC | 19:05 | |
*** kgriffs_afk is now known as kgriffs | 19:11 | |
*** mpanetta has quit IRC | 19:13 | |
*** mpanetta has joined #openstack-marconi | 19:13 | |
*** reed has quit IRC | 19:25 | |
*** reed has joined #openstack-marconi | 19:28 | |
*** rongze has joined #openstack-marconi | 19:51 | |
*** rongze has quit IRC | 19:56 | |
*** jcru has quit IRC | 20:01 | |
*** jcru has joined #openstack-marconi | 20:12 | |
*** alcabrera|afk is now known as alcabrera | 20:22 | |
openstackgerrit | Kurt Griffiths proposed a change to openstack/marconi: fix(mongo): Delete claimed message fails https://review.openstack.org/55001 | 20:46 |
*** amitgandhi has joined #openstack-marconi | 20:48 | |
alcabrera | kgriffs: +2'd | 20:48 |
alcabrera | kgriffs: I won't be around tomorrow. I've reviewed quite nearly every patch in the queue. Anything else you'd like me to keep in mind while I'm away? | 20:49 |
alcabrera | ponder, consider, retweet, etc.? :P | 20:49 |
kgriffs | heh | 20:49 |
kgriffs | nah, I think we're cool. If have a few minutes tomorrow morning to check on my patches to see if they need a final approval, that would be great. | 20:50 |
alcabrera | I don't think I'll be able to, since I'll be at the UGA vet getting my cat thoroughly checked up, but... | 20:51 |
alcabrera | you guys (flaper87) can ninja approve whatever I've +2'd | 20:51 |
alcabrera | ^^ consensus grant | 20:51 |
alcabrera | s/consensus/consent | 20:51 |
flaper87 | alcabrera: AWESOME! :D | 20:51 |
alcabrera | I've reviewed those through and through and I'm not expecting much to change. :) | 20:51 |
alcabrera | anyway~ | 20:52 |
*** amitgand_ has quit IRC | 20:52 | |
alcabrera | I'm out for the day. | 20:52 |
alcabrera | Stay lively, guys. :D | 20:52 |
mpanetta | see ya | 20:52 |
alcabrera | mpanetta: o/ | 20:52 |
*** alcabrera has quit IRC | 20:53 | |
*** rongze has joined #openstack-marconi | 20:53 | |
*** rongze has quit IRC | 20:58 | |
*** jcru has quit IRC | 21:00 | |
*** jcru has joined #openstack-marconi | 21:09 | |
*** sandywalsh_ has quit IRC | 21:10 | |
*** sandywalsh_ has joined #openstack-marconi | 21:27 | |
*** rongze has joined #openstack-marconi | 21:55 | |
*** rongze has quit IRC | 22:00 | |
*** reed has quit IRC | 22:06 | |
*** reed has joined #openstack-marconi | 22:07 | |
*** reed has quit IRC | 22:10 | |
*** reed has joined #openstack-marconi | 22:10 | |
*** ayoung has quit IRC | 22:14 | |
*** tedross has quit IRC | 22:21 | |
*** thomasem has quit IRC | 22:27 | |
*** fifieldt_ has joined #openstack-marconi | 22:52 | |
*** rongze has joined #openstack-marconi | 22:57 | |
*** rongze has quit IRC | 23:02 | |
*** fifieldt_ has quit IRC | 23:05 | |
*** fifieldt_ has joined #openstack-marconi | 23:07 | |
*** ametts has quit IRC | 23:11 | |
*** mpanetta has quit IRC | 23:17 | |
*** mpanetta has joined #openstack-marconi | 23:30 | |
*** amitgandhi has quit IRC | 23:32 | |
*** jamieh has joined #openstack-marconi | 23:35 | |
*** oz_akan_ has quit IRC | 23:37 | |
*** oz_akan_ has joined #openstack-marconi | 23:38 | |
*** oz_akan_ has quit IRC | 23:42 | |
*** jamieh has quit IRC | 23:48 | |
*** openstackgerrit has quit IRC | 23:56 | |
*** openstackgerrit has joined #openstack-marconi | 23:56 | |
*** rongze has joined #openstack-marconi | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!