Monday, 2014-12-01

*** mpanetta has joined #openstack-zaqar00:13
*** mpanetta has quit IRC00:17
*** cpallares has quit IRC02:35
*** achanda has joined #openstack-zaqar02:56
*** mpanetta has joined #openstack-zaqar03:14
*** mpanetta has quit IRC03:19
*** achanda has quit IRC03:39
*** achanda has joined #openstack-zaqar03:39
*** achanda has quit IRC03:40
*** achanda has joined #openstack-zaqar03:40
*** achanda has quit IRC03:44
*** vkmc has quit IRC03:55
*** achanda has joined #openstack-zaqar04:23
*** exploreshaifali has joined #openstack-zaqar04:50
*** amalagon has joined #openstack-zaqar04:54
*** amalagon has quit IRC04:54
*** achanda has quit IRC05:00
*** amalagon has joined #openstack-zaqar05:35
*** sgotliv has joined #openstack-zaqar05:36
*** amalagon has quit IRC05:39
*** achanda has joined #openstack-zaqar06:35
*** sgotliv has quit IRC06:43
*** achanda has quit IRC06:59
*** achanda has joined #openstack-zaqar07:00
*** achanda has quit IRC07:05
exploreshaifaliflaper87, gooood morning07:10
exploreshaifaliflaper87, please can you review https://review.openstack.org/#/c/134910/07:10
exploreshaifaliissue with dsvm-redis07:10
flaper87exploreshaifali: gooooooooooood morning07:21
flaper87:)07:21
flaper87sure thing, I'll review it in a bit07:21
exploreshaifaliflaper87, all right !07:22
exploreshaifali:)07:22
flaper87exploreshaifali: you need to configure the deprecated options for redis too07:27
flaper87:)07:27
flaper87exploreshaifali: just like you did for mongodb07:27
exploreshaifaliflaper87, oh yes !!07:28
exploreshaifaliflaper87, I have few question too07:28
flaper87exploreshaifali: go ahead07:28
exploreshaifalitest file - `tests/etc/wsgi_mongodb`07:28
flaper87exploreshaifali: btw, do you know how to debug gate issues?07:28
exploreshaifaliis for message databse only07:29
exploreshaifaliright ?07:29
exploreshaifaligate issues ?07:29
flaper87exploreshaifali: yes, that's for the data plane07:29
flaper87exploreshaifali: gate issue -> the dsvm-redis gate is not working. What's going on?07:29
flaper87:P07:29
exploreshaifaliand the test firl `tests/etc/wsgi_mongodb_pooled.conf` is for control plane07:29
flaper87exploreshaifali: in that one you need to configure both, control and data plane07:30
exploreshaifaliflaper87, yes I don't know much about it why that dsvm issues occuring07:30
flaper87exploreshaifali: you may want to watch this: https://www.youtube.com/watch?v=fowBDdLGBlU07:30
exploreshaifaliflaper87, okay :)07:31
exploreshaifaliand here https://review.openstack.org/#/c/134910/8/tests/etc/wsgi_mongodb_pooled.conf07:31
exploreshaifaliI want to configure both07:31
exploreshaifalidata and plane storage ?07:31
flaper87exploreshaifali: correct07:31
flaper87exploreshaifali: do you know why?07:31
exploreshaifaliI think it should not because it is related to pool stuff07:32
exploreshaifaliwe need only management part for pools and queues07:32
flaper87exploreshaifali: here's a general rule. The data plane should *always* be configured otherwise messages won't go anyway07:32
flaper87The management plane is required to enable pools and flavors07:33
exploreshaifaliflaper87, what exactly a flavor is ?07:33
exploreshaifaliI don't understand it well07:34
exploreshaifaliany page from where I can read about them07:34
flaper87exploreshaifali: well, actually, the message plane might not be needed if one uses pools and flavors but we need to discuss this a bit further07:35
flaper87exploreshaifali: sure, 2 secs07:35
flaper87exploreshaifali: I wrote about pools here: http://blog.flaper87.com/post/zaqar-pools-explained/07:35
flaper87exploreshaifali: flavors are a user-facing resource that exposes pools in a consumable way07:36
exploreshaifaliflaper87, just one more - here https://review.openstack.org/#/c/134910/8/zaqar/queues/storage/utils.py we don't need management store07:36
flaper87ok, that description is actually very confusing07:36
flaper87in other words, flavors allow you to choose a group of pools based on their capabilities07:36
flaper87exploreshaifali: no, IIRC, the management store is not needed there07:37
exploreshaifaliokay - flavors are the combinations of capabilities07:37
flaper87exploreshaifali: correct07:37
flaper87damn, I hate that dynamic_conf function07:37
exploreshaifalihahaha :D07:38
exploreshaifaliflaper87, okay.. Thanks !!07:39
exploreshaifaliflaper87, btw I am having my college exams from Dec 4  to 1107:40
exploreshaifaliso may be I won't be much active in those days07:40
flaper87exploreshaifali: ok ok, thanks for letting me know07:41
flaper87:D07:41
flaper87exploreshaifali: and very good luck with that07:42
flaper87you've got a whole bunch of zaqarians supporting you07:42
exploreshaifaliflaper87, Thanks a loooooot !!!07:42
exploreshaifaliyes you all are there07:42
exploreshaifaliI know ;)07:42
*** exploreshaifali has quit IRC07:56
*** yfujioka has joined #openstack-zaqar08:00
*** dynarro has joined #openstack-zaqar08:00
*** sgotliv has joined #openstack-zaqar08:36
*** ekarlso- has quit IRC08:52
*** ekarlso- has joined #openstack-zaqar09:10
*** sgotliv has quit IRC09:30
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Gets 'flavor' data if the resource exists  https://review.openstack.org/13763509:49
*** openstackgerrit has quit IRC09:50
*** openstackgerrit has joined #openstack-zaqar09:50
*** sgotliv has joined #openstack-zaqar10:07
openstackgerritFlavio Percoco proposed openstack/zaqar-specs: Move approved specs under an approved dir  https://review.openstack.org/13803010:24
openstackgerritMerged openstack/zaqar-specs: Move approved specs under an approved dir  https://review.openstack.org/13803010:34
flaper87flwang: ping10:39
flaper87flwang: how are you doing?10:39
flaper87Can we sync on the notification work?10:39
flaper87How's it going?10:39
*** yfujioka has quit IRC10:51
*** dynarro has quit IRC11:01
*** exploreshaifali has joined #openstack-zaqar11:07
*** vkmc has joined #openstack-zaqar11:23
vkmcgood morning!11:25
*** sgotliv has quit IRC11:28
vkmcflaper87, hey o/11:38
*** sgotliv has joined #openstack-zaqar11:40
flaper87vkmc: hey hey12:08
flaper87vkmc: goooooooood morning12:08
vkmc:)12:09
*** exploreshaifali has quit IRC12:12
vkmcaddings the missing functional tests for v1 means a lot of duplication12:18
vkmcshould we add them, considering that v1 is freezed?12:18
vkmchttps://bugs.launchpad.net/zaqar/+bug/124675712:18
vkmcflaper87, your thoughts are welcome ^12:18
vkmcwrt coverage, is the right thing to do12:19
flaper87what's missing ?12:19
flaper87I thought we had everything12:19
* flaper87 reads the fucking bug12:19
vkmc*v1*12:20
flaper87aahh, fuck v112:20
vkmcpools tests12:20
flaper87:D12:20
vkmcI don't mind adding them12:20
vkmcbut I don't want to add more code if its not needed12:20
flaper87please, don't copy paste what I said in the bug12:20
flaper87:P12:20
vkmcI won't :)12:20
flaper87nah, no need, lets advise people to move to v1.112:20
vkmcall right12:20
flaper87https://review.openstack.org/#/c/137635/3/zaqarclient/tests/queues/flavor.py,cm12:21
flaper87vkmc: ^^^ you commented on the wrong line12:21
flaper87>.>12:21
vkmcflaper87, I know, sorry12:21
flaper87lets wait for dynarro to come back and update the patch12:21
vkmcsure12:21
flaper87vkmc: I know you know, I just wanted to point it out12:22
flaper87because it's monday12:22
flaper87and monday is not suppose to be nice12:22
flaper87:P12:22
vkmclet's make Mondays unfriendly12:22
vkmcby the way12:22
vkmcwould you be working on persistent transports?12:23
flaper87if there's anything I can help with, yeah :)12:23
vkmcI'm asking because you assigned yourself to the blueprint12:23
flaper87no, wait, I changed that12:23
flaper87I added myself as approver12:23
* flaper87 checks again12:24
flaper87I hate launchpad12:24
vkmcnot cool dud12:24
flaper87really, I hate it12:24
vkmchahahhaa12:24
flaper87I swear I put my name in the approvers field12:24
flaper87I think it just got it backwards12:24
flaper87vkmc: done :D12:24
vkmcstop blaming the software :P12:24
vkmcahahaha12:24
vkmcok12:25
flaper87vkmc: you stop blaming me >.>12:25
flaper87:P12:25
* flaper87 is a cool dud12:25
vkmcits Monday12:25
vkmcyou said that12:25
vkmc:P12:25
flaper87right12:26
*** bradjones has quit IRC12:26
vkmcok12:26
*** bradjones has joined #openstack-zaqar12:26
vkmcI drop some notes on websockets yesterday12:26
vkmcand now I was reading the code for the POC12:27
flaper87vkmc: cool beans, I really gotta finish this nova patch to enter the review hell asap12:32
vkmcflaper87, hang on there12:33
vkmc:)12:33
vkmcflaper87, btw, do you know in which version of ubuntu they changed mongodb for mongod?13:12
vkmcand they are no longer supporting mongodb13:13
flaper87erm, no idea13:13
flaper87:/13:13
flaper87vkmc: what version are you using? are you having issues w/ devstack?13:14
vkmcflaper87, well yeah, devstack is broken right now with... ubuntu 12.04 and mongo 2.4.913:15
vkmcI'm about to submit a fix13:15
flaper87I think we're not supporting 12.04 anymore13:16
vkmcalso... we are defaulting to mongo and we removed pymongo from requirements13:17
vkmcsorry, 14.0413:17
flaper87ah ok13:17
flaper87are we using mongodb as the default?13:17
flaper87I don't recall13:17
flaper87probably in devstack, yes13:17
flaper87but not in the codebase13:17
vkmcyeah13:17
vkmcdevstack13:17
flaper87the devstack has to install pymongo itself13:17
flaper87:D13:17
vkmchuh, it didn't do that yesterday13:18
vkmcI'll add it if its missing13:18
flaper87it'd be weird13:18
flaper87also, how is the gate passing if 14.04 is broken?13:18
vkmcgood point13:19
vkmcit must be my deployment... my mongo version or something13:19
vkmcpymongo is there13:20
vkmcits definitely my deployment :)13:20
flaper87vkmc: Happy Monday13:20
*** dynarro has joined #openstack-zaqar13:20
vkmcflaper87, same for you13:20
flaper87:P13:21
vkmcyou should choose mentees better :P13:21
flaper87vkmc: no no, I like you, you make it easy to mess with you13:22
openstackgerritDoraly Navarro proposed openstack/python-zaqarclient: Gets 'flavor' data if the resource exists  https://review.openstack.org/13763513:26
*** dynarro has quit IRC13:27
flaper87vkmc: ^13:27
flaper87I don't mean to stress you with reviews but I'd like to make that gate voting13:28
flaper87and propose it for zaqar too13:28
vkmcsure thing13:28
vkmcthere13:30
*** dynarro has joined #openstack-zaqar13:38
dynarrovkmc: I guess you were right when you said that bug was boring hahaha13:40
flaper87dynarro: LOOOOOOOOOOL, I guess you weren't when you volunteered to work on it13:41
flaper87:P13:41
flaper87vkmc: btw, you asked for more music recommendations: http://open.spotify.com/artist/1yDbenrXWhaQij3SCpsXe713:41
flaper87"How to destroy Angles"13:41
flaper87kragniz: ^13:41
flaper87dude you haven't even said hi today13:41
flaper87you should be ashamed13:41
kragniz;_:13:41
kragnizI'm sorrrrrry!13:41
flaper87Anyway, that's Trent Reznor (NiN dude) and his wife13:42
kragnizI'll start again13:42
kragnizgood morning, everyone! \o/13:42
flaper87Also, Alessandro Cortini13:42
flaper87vkmc: Alessandro Cortini is the guy from SONOIO (his solo project)13:42
flaper87he's was also part of NiN13:42
flaper87kragniz: GOOOOOOOOOOOOOOOOOOOOOOD MORNING!13:43
flaper87hope you're doing great today13:43
flaper87despite it being Monday13:43
kragnizflaper87: I'm doing well!13:43
flaper87kragniz: despite this? https://twitter.com/flaper87/status/53941450579798835213:43
kragnizexcept for cycling though a cloud on the way to the office13:44
flaper87kragniz: damn :(13:44
kragnizit felt like a cloud, at least13:44
flaper87LOOOOL13:44
flaper87Was it yellow ?13:44
flaper87or yellowish13:44
kragnizI should keep a towel at my desk13:44
dynarroflaper87: I regret LOL13:44
kragnizno, very grey13:44
flaper87kragniz: ok, then it was either a cloud or a pigeon13:45
vkmcdynarro, I warned you haha!13:45
vkmcflaper87, thanks :D13:45
kragnizflaper87: it was a very big pigeon if it was one of those13:45
vkmckragniz, o/13:45
kragnizvkmc: \o13:45
flaper87kragniz: Don't you guys have a weird thing in a lake called Ness ?13:48
kragnizthe loch ness monster?13:48
flaper87I'm pretty sure you also have big 90% transparent pigeons13:48
kragnizflaper87: yeah, but normally you see the feet13:49
flaper87ok, that's a question. If they fly, why do they need feet ?13:49
flaper87They should just land when they need to rest13:49
flaper87and then fly13:49
kragnizgood point13:49
kragnizor have four wings13:49
flaper87That way, we wouldn't ahve gazillions of pigeons in all the fucking squares in the world13:50
kragnizwhen one pair needs to rest, just use the others13:50
flaper87right13:50
openstackgerritMerged openstack/python-zaqarclient: Gets 'flavor' data if the resource exists  https://review.openstack.org/13763513:51
flaper87https://twitter.com/flaper87/status/53941694736105472113:54
kragnizhaha13:54
flaper87vkmc: if you're interested in a specific song, I'd recommend this one: http://open.spotify.com/track/0FdDewrvAF7LCd5Vf2FjgR13:55
* vkmc clicks 13:55
flaper87https://www.youtube.com/watch?v=Oq3pDuJeMqQ13:56
flaper87that's the video13:56
flaper87vkmc: kragniz ^13:56
kragnizflaper87: ty!13:56
flaper87it's really good (both video and song)13:56
* vkmc listening A Drowing13:56
flaper87And you can see the three of them13:56
vkmcits really good... feels like NIN after some sleep pills (for now)13:57
flaper87hahaha, well, it's basically NIN... The best 2 guys from NIN13:57
vkmcyeah13:58
vkmcMariqueen has a great voice, she is up to the game! must be hard to be Raznor's wife haha14:00
*** sriram has joined #openstack-zaqar14:07
*** jchai has joined #openstack-zaqar14:14
*** mpanetta has joined #openstack-zaqar14:23
vkmc(╯°□°)╯︵ ┻━┻14:31
flaper87(╯°□°)╯︵ ┻━┻14:36
sriram\_o_/14:37
* sriram tries to catch the thrown tables.14:38
*** ametts has joined #openstack-zaqar14:38
flaper87https://twitter.com/flaper87/status/53942908085338521614:42
* kragniz is envious of flaper87 14:43
kragnizpls share14:43
kragnizpls14:43
* flaper87 sends some gummy bears to kragniz vkmc and sriram14:44
vkmc:D14:45
vkmcomg dud14:45
vkmcthat's an excesive amount of gummy stuff14:46
vkmcnot only bears14:46
kragnizit's the not-bears that look extra yummy14:46
* sriram does a pole vault to catch gummy bears14:48
* sriram creates olympic record!14:48
* sriram crowd goes wild14:48
sriram:P14:48
flaper87gummy stuff is never enough14:51
openstackgerritFlavio Percoco proposed openstack/zaqar: Add capabilities property to the DataDriver  https://review.openstack.org/13563714:52
flaper87MEETING IN 1014:52
vkmcmeeting in 5?14:52
vkmcoh14:52
kragnizCOFFEE IN 814:53
vkmclol14:53
flaper87714:53
kragniz614:54
flaper87514:55
kragniz414:56
flaper87fuck14:56
flaper87Error(NaN)14:56
flaper87314:57
flaper87dynarro: vkmc kragniz sriram kgriffs|afk start joining #openstack-meeting-314:57
flaper87214:58
kragniz> implying I'm not already there14:58
*** cpallares has joined #openstack-zaqar15:00
cpallareso/15:05
vkmccpallares, \o15:07
vkmcmeeting in #openstack-meeting-315:07
*** exploreshaifali has joined #openstack-zaqar15:14
*** amitgandhinz has joined #openstack-zaqar15:34
*** kgriffs|afk is now known as kgriffs15:36
*** exploreshaifali has quit IRC15:39
vkmcflaper87, we have in 30' the meeting of websockets15:58
flaper87vkmc: yup15:59
vkmcI forgot lunchtime so I hope its short15:59
flaper87kgriffs: there's a hangout with Keith in 30'15:59
flaper87want to join?15:59
kgriffsnot sure... what's the agenda?16:00
flaper87kgriffs: status updates16:01
kgriffssure, I'll listen in16:02
vkmcI'm a bit bothered that I don't have a clear architecture idea yet16:03
kgriffsvkmc: would you like to discuss?16:10
vkmckgriffs, if you have some spare time, of course I'd16:10
kgriffsso where did things end up as far as basic decisions?16:11
kgriffswe are settled on websockets16:11
kgriffsbut other than that?16:12
* kgriffs wishes he had more time to keep up with the specs16:12
vkmcwe are going to use ws4py to implement this16:12
vkmcand msgpack as a serialization protocol16:12
vkmcwe also have two pocs to consider16:12
vkmcmy main concern is... considering current Zaqar arch16:14
vkmcwe will have to design this transport in a different way that the base16:15
vkmcwhich is highly coupled to wsgi16:16
* kgriffs looks16:17
*** dynarro has quit IRC16:18
kgriffsby "base" do you mean this? https://github.com/openstack/zaqar/blob/master/zaqar/queues/transport/base.py16:19
vkmcyeap16:20
vkmcwell in fact, not that16:20
vkmcthe mapping between the transport operations and the storage16:20
* flaper87 back16:21
kgriffsI feel the urge to draw16:21
* kgriffs realizes he left his ipad at home16:21
kgriffsvkmc: so, the storage layer exposes an interface16:22
vkmcoh a draw would be cool16:22
vkmcyeah16:22
kgriffsare you saying the storage driver interface does not map well to a non-HTTP transport?16:22
* kgriffs wishes for a shared vizio for the Nth time16:23
vkmcI'm not sure yet16:24
flaper87http://whiteboardfox.com16:24
kgriffsoooh16:24
kgriffshttp://whiteboardfox.com/26405-2092-755216:25
flaper87;)16:25
kgriffsman, I really need my ipad for this16:25
flaper87it works well on the iad16:25
flaper87iPad16:25
* flaper87 has tested it16:25
kgriffsOK, I give up. Can't do this with a trackpad16:27
vkmcjajaja16:27
vkmchahaha*16:27
flaper87vkmc: can you join the Hangout and add me?16:27
flaper87The invited my redhat account16:28
vkmcsure16:28
vkmcthey invited my personal domain account so I'll try16:28
flaper87oh, mmh16:28
flaper87great16:28
vkmclet me invite you16:31
vkmchttps://plus.google.com/hangouts/_/symantec40.com/zaqar-websocket16:31
vkmcclick there16:32
*** exploreshaifali has joined #openstack-zaqar16:33
kgriffsmind if I listen in?16:34
vkmcjoin us :)16:34
*** achanda has joined #openstack-zaqar16:43
exploreshaifalihey vkmc \o16:53
*** jimhoagland has joined #openstack-zaqar17:09
*** amalagon has joined #openstack-zaqar17:14
*** amalagon has quit IRC17:15
*** amalagon has joined #openstack-zaqar17:16
kgriffso/17:20
kgriffsvkmc: so, msgpack vs. protobuf.17:21
vkmchey exploreshaifali o/17:21
vkmcjimhoagland, o/17:21
vkmckgriffs, yeah17:21
kgriffsdid you say that you did look at performance already between the two?17:21
vkmcI did17:21
vkmcthe situation with that is quite confusing though17:22
vkmcmsgpack claims to be 4 times more faster than protobuf17:22
vkmcbut some benchmarking shows that its not true17:22
vkmclet me get some links17:22
kgriffsoic17:22
vkmchttp://theburningmonk.com/2011/12/performance-test-binary-serializers-part-ii/17:23
vkmcits quite old though, it might have changed17:23
kgriffsi didn't see any info on the pad/wiki about it so wanted to ask17:23
vkmcyeah, I didn't update it17:23
kgriffsI think it is sufficient to know that "speed-wise there’s not much sep­a­rat­ing the two"17:24
vkmcI digged more into it when I saw the POC was made using protobuf17:24
vkmcyeah17:24
vkmcthat's why I asked if there were another reason17:24
vkmcto use protobuf17:24
kgriffsthey liked the compact format17:24
ekarlso-vkmc: what was the websocket stuff ?17:24
kgriffsand they were familiar with it already17:24
kgriffsi imagine msgpack can't be that different in terms of compactness17:25
vkmckgriffs, yeah :)17:25
vkmcnope, its the same17:25
kgriffsdid you look at that as well?17:25
vkmcand its more natural maybe... because its more similar to JSON17:25
*** exploreshaifali has quit IRC17:25
kgriffswhich is more similar to JSON?17:26
vkmcmsgpack17:26
kgriffsgot it17:26
kgriffsok, so it sounds like we should be OK with msgpack then17:26
vkmcyeah17:26
vkmcwe also had a first approach on adopting msgpack17:26
kgriffsnext up... STOMP17:26
kgriffsflaper87: ping17:26
vkmcbbl17:26
flaper87pong17:27
flaper87kgriffs: ^17:27
vkmcekarlso-, we will implement a websocket driver17:27
flaper87:P17:27
kgriffsso, I saw your comment17:27
kgriffson the spec re STOMP17:27
flaper87kgriffs: what comment ?17:27
flaper87ah ok17:27
flaper87:P17:27
kgriffsso, it doesn't go over HTTP17:27
kgriffsis is just designed to be HTTP-like17:27
kgriffsso you would run it over TCP if I understand correctly17:27
kgriffsright?17:27
kgriffshttp://stomp.github.io/stomp-specification-1.2.html#Abstract17:28
flaper87oh, mmh17:28
kgriffsthe reason I suggested taking another look was STOMP defines some of the stuff we need and we don't have to figure out a new protocol17:29
kgriffslike, it has a notion of "headers"17:29
kgriffsheart beat17:29
flaper87right17:29
kgriffssubscribing and getting push messages17:29
flaper87that's probably a good fit too17:29
kgriffscontent type17:29
flaper87not sure where I got that http thing from17:29
kgriffsby comparison, MQTT is more opinionated17:30
kgriffsbut it seemed like STOMP was fairly generic and we might be able to use it17:30
flaper87kgriffs: I'll take a look at STOMP again, I'm sorry for the misleading comment17:31
flaper87IIRC, there are libraries supporting STOMP for the browser17:31
kgriffsno problem. I just think we should take a fair look. If we can use it, great, because it saves us time - we don't have to figure out how to do error handling, push messages, etc.17:32
flaper87kgriffs: agreed... plus it's already used elsewhere17:33
*** sgotliv has quit IRC17:34
kgriffskk, I gotta run for a bit17:35
jimhoaglandkgriffs, vkmc, as we mentioned on the call, we are fine with whatever encoding makes the most sense.  If you are looking at encode/decode performance in Python, you should be sure the benchmark used a 2.6.x version of the protobuf library as is reportedly much faster.17:40
*** reed has joined #openstack-zaqar17:51
flaper87jimhoagland: I think we're after performance but also adoption17:51
flaper87The broader the support is for a specific encoding, the better17:52
vkmcjimhoagland, ok, thanks, we will keep you updated with any changes18:00
flaper87vkmc: did you push your food down your throat ?18:02
flaper87(says the guy that can have lunch in 5 mins )18:03
flaper87s/have/finish/18:03
vkmcflaper87, I'm trained to eat very fast over the keyboard18:03
vkmcI put it on my cv18:03
vkmcnow I'm craving for candy18:05
*** jimhoagland has quit IRC18:05
* flaper87 gives vkmc some gummy berries18:05
kragnizvkmc: there is a vending machine rather close to me18:05
vkmcomg OMG! nom nom nom18:05
kragnizI don't think it has a good effect on my health18:05
vkmcoh I would be eating so much sugar if I were you >.>18:06
vkmcI think I'm going to do as flaper87... keep a stash of candy18:07
kragnizI have that, too18:07
flaper87vkmc: good girl, goooooood girl18:07
kragnizor had, until I ate it all18:08
*** achanda has quit IRC18:18
flaper87Guys, btw, remember to follow the hacksummit.org18:21
flaper87Obviously, if you want18:21
flaper87:D18:21
kragnizflaper87: is it any good so far?18:21
flaper87I missed the first one but it was an intro to the summit18:22
flaper87the ongoing one is about Azure18:22
flaper87I'm not interested in that one18:23
flaper87There's no schedule so, figuring it out as we go18:23
vkmcthere is an agenda18:25
vkmc#fail18:28
flaper87what?18:29
flaper87I mean, there's a speakers agenda18:29
vkmcthey mailed it18:29
flaper87not topics18:29
flaper87With titles and stop?18:29
flaper87s/stop/stuff/18:29
flaper87OMG18:29
flaper87I need help18:29
flaper87ahhh18:29
flaper87they sent it today18:29
vkmcTODAY 11AM-12PM PST - Culture and Happiness in Virtual Teams - FLOYD MARINESCU18:29
vkmcseems like a title for a presentation18:30
vkmccoming up next18:30
vkmchaha18:30
flaper87yeah18:30
flaper87brb18:30
vkmcI wanna hear Alex18:30
*** jimhoagland has joined #openstack-zaqar18:34
*** davideagnello has joined #openstack-zaqar18:37
*** sgotliv has joined #openstack-zaqar18:40
*** sgotliv has quit IRC18:45
vkmcpoor Microsoft dud... 'I have to pay for my Azure account, they wouldn't give a free account for me'18:47
kragniz;_;18:48
vkmc:'|18:48
* flaper87 back18:53
vkmcbet on Javascript18:54
*** davideagnello has quit IRC19:00
*** davideagnello has joined #openstack-zaqar19:01
vkmcCulture and Happiness in Virtual Teams next19:06
vkmcwe should totally give some suggestions there19:06
vkmc'it's everything about poptarts'19:07
*** davideagnello has quit IRC19:07
*** davideagnello has joined #openstack-zaqar19:08
cpallareskgriffs, mpanetta: You should check out the sparkfun cyber monday deals :D https://www.sparkfun.com/CyberMonday201419:14
kragnizcpallares: weee!19:14
* kgriffs clicks19:14
mpanettacpallares: Did so last night :)19:14
cpallaresmpanetta: Bought anything?19:15
mpanettacpallares: Nah, didn't see anything I coud not live without19:15
mpanettaI think I have too many projects not finished to start something new ;)19:15
cpallaresmpanetta: Me too, but I'm debating on buying my littler brother a makey-makey.19:16
mpanettaOh cool19:16
cpallaresmpanetta: I mean, I've been wanting to play with one since forever, but $50 seems quite unreasonable :P19:17
mpanettaWhat did they discount it to?19:17
cpallaresmpanetta: It's 40% off.19:17
mpanettaOh damn!19:17
mpanettawow19:18
cpallareslol19:18
cpallaresmpanetta: https://www.sparkfun.com/products/1151119:18
cpallaresJust for this hour.19:18
flaper87vkmc: I'm not likuing that talk much19:20
vkmcyeah me neither19:20
vkmcwe are a level 5 community, that is what I could learn19:20
flaper87if this dude invites us to infoq again, I'll consume the bandwidth by yelling at him through it19:25
*** sgotliv has joined #openstack-zaqar19:25
* cpallares wonders what flaper87 and vkmc are talking about19:27
flaper87cpallares: hacksummit.org19:28
flaper87it's live now19:28
vkmcahaha19:28
vkmcyeah19:28
flaper87InfoQ CEO is talking about virtual teams19:28
vkmcI stopped listening19:28
flaper87and he's invited the audience to go and read InfoQ a gazillion times19:28
kragnizflaper87: that doesn't sound great19:33
*** davideagnello has quit IRC19:33
*** davideagnello has joined #openstack-zaqar19:35
*** davideagnello has quit IRC19:35
*** davideagnello has joined #openstack-zaqar19:35
flwangflaper87: ping19:51
*** jchai is now known as jchai_afk19:53
*** exploreshaifali has joined #openstack-zaqar19:58
*** jimhoagland has quit IRC20:03
exploreshaifalivkmc, are you able to access https://hacksummit.org/ ?20:05
kragnizexploreshaifali: they're getting DDOSed20:06
cpallaresexploreshaifali: If you refresh long enough you'll get through20:07
exploreshaifalikragniz, oh! ok20:07
exploreshaifalicpallares, I did that many times but same response :(20:08
cpallaresexploreshaifali: Ah, well it was happening to me as well, maybe the talk that's on right now is more popular?20:08
kragnizexploreshaifali: I think you can direcly connect20:09
kragnizor at least I've heard that20:09
exploreshaifalicpallares, ya that could be a case :)20:09
exploreshaifalikragniz, directly connect ?20:09
kragnizto the hangout20:10
exploreshaifalikragniz, okay, let me try :)20:11
*** jchai_afk is now known as jchai20:11
*** davideagnello has quit IRC20:11
cpallaresexploreshaifali: https://www.youtube.com/watch?v=b1i865DVYGU#t=42820:14
exploreshaifalicpallares, ooohh Thaks a looot :)20:14
*** wpf has quit IRC20:14
exploreshaifali*thanks20:14
*** wpf has joined #openstack-zaqar20:16
*** davideagnello has joined #openstack-zaqar20:21
vkmchttp://www.crowdcast.io/e/hack_summit3 mirror20:29
flaper87omg, this dude is going to make me cry20:37
flaper87.... of pain20:37
flaper87flwang: pong20:38
flwangflaper87: i have a standup meeting in 5 minutes, will you be online after 20 min?20:38
flwangflaper87: I'd like to sync the notification20:39
flaper87that's entirely, possibly, maybe20:39
flwangok, a quick question is kgriffs is not a fan of splitting the notification service and queues20:40
flaper87flwang: you mean, he prefers to keep everything under queues ?20:40
flwangflaper87: that means he seems prefer to keep the notification related stuff in current queues folder20:40
flwangyes20:40
flwangkgriffs: are u around?20:41
flwangand I'm almost convinced :)20:41
flaper87mmh but then what's the queue's package for?20:42
flaper87should we get rid of it?20:42
*** jimhoagland has joined #openstack-zaqar20:42
flaper87we created it because we wanted to split notifications and queues20:42
flaper87but we also said we wanted them to be completely separate services20:42
flwangflaper87: it's a good question, for both of the cases, we may need some refactoring work for the structure20:42
flwangyep, kgriffs thinks the notification case is most like one of the supported cases of queue20:43
*** flwang1 has joined #openstack-zaqar20:43
kgriffshere20:45
flwangkgriffs: cool20:45
flwangkgriffs: would you mind talking about the notification service structure?20:45
kgriffssorry, I recently got assigned like three more projects at Rackspace so I'm spread pretty thin lately. :p20:45
flwangbrb20:45
kgriffsflaper87: so, question about taskflow20:46
flaper87kgriffs: shoot20:46
kgriffsso, with taskflow what are my options for farming out work?20:48
kgriffsiirc, you can do it in-process (gevent/eventlet/tulip)20:48
sriramyou can look at conductors. they basically pull stuff off a jobboard and run it in an engine.20:49
kgriffssriram: is that part of taskflow or is this a different project?20:49
sriramits part of taskflow20:49
sriramThats the abc: https://github.com/openstack/taskflow/blob/master/taskflow/conductors/base.py20:50
sriramIt would be like a producer-consumer scenario.20:51
sriramwhere your conductor acts as the consumer.20:51
kgriffsok, so I am assuming I can run some engines in a separate process from my web  server?20:52
sriramyes.20:52
sriramI was able to run 8, through multiprocessing.20:52
kgriffsflaper87: so your proposal was to implement the message delivery agents as taskflow engines?20:52
sriramOhh, yeah that could work.20:53
*** jimhoagland has left #openstack-zaqar20:53
flaper87kgriffs: yeah20:53
kgriffsnot sure if I have the terminology right20:53
flaper87you can run engines in a separate process if you want but that may require an external thing to send the message20:53
sriramsince the conductors are always running, anytime something new is posted on the jobboard, they act on it immediately. -> notification.20:53
*** jimhoagland has joined #openstack-zaqar20:53
sriramsounds really neat.20:54
kgriffsok20:54
flaper87You can run tasks concurrently in the same process and distributedly in more processes20:54
kgriffsthe business logic for the task - how is that defined? Stevedore plugin for engines or what?20:54
kgriffs(by logic, I mean the actual code that would handle pushing to webhook, SMS, APN, etc.)20:55
flaper87kgriffs: you need to implement a Task class20:55
flaper87IIRC, they're loadable through stevedore20:55
kgriffsok, so what Zaqar would need to deliver is some task classes20:56
sriramits usually inside an execute function, inside a class that inherits Task20:56
flaper87kgriffs: right20:56
sriramif i'm not mistaken.20:56
kgriffswell, 1-2 "out of the box" and then operators can add more20:56
flaper87sriram: correct20:56
flaper87kgriffs: right20:56
kgriffsshould those be their own package (installable standalone)20:56
kgriffsor would you just20:56
kgriffspip install zaqar20:56
kgriffsthen that installs the entry points20:57
flaper87I think you should get the built-in ones with zaqar20:57
* kgriffs is thinking out loud20:57
flaper87which will install the entry_points20:57
flaper87as we do for the storage/transport drivers20:57
kgriffsok, so I may have a taskflow engine farm that just runs these tasks. For those I would still pip install zaqar even though I don't intend to use the API server20:58
kgriffsflaper87: I think we should have separate packages, but use a zaqar.* namespace to unify them20:59
* kgriffs ducks20:59
*** amitgandhinz has quit IRC21:00
kgriffsflwang: ok, so it seems that we can group the notifications implementation in two21:00
kgriffsfirst group is the API - adding the ability for a user to CRUD subscriptions to a queue or topic21:00
flaper87wait, you still need a process that is running the whole thing21:00
flaper87which is part of zaqar21:01
flaper87it could be zaqar-worker21:01
flaper87I dunno21:01
*** amitgandhinz has joined #openstack-zaqar21:01
kgriffsoh21:01
kgriffsI see21:01
flaper87but I think we need to dig more into that21:01
kgriffsyou need to bootstrap taskflow for that worker farm21:01
kgriffsbecause taskflow is purely a library?21:01
flaper87because I'd hate to tell people, "Hey, this is a messaging service but if you want to scale notifications you need to install rabbitmq to have distributed workers"21:01
kgriffsit doesn't provide a taskflow-agent21:02
flaper87kgriffs: correct, it's just a library21:02
kgriffsok21:02
kgriffsso if you don't want to run these tasks on your web heads directly21:02
kgriffsyou need some zaqar-notifications-agent process or something21:02
* flwang back21:02
flwangsorry, what's the notification-agent for?21:03
flaper87kgriffs: right21:03
flwangam i missing something?21:03
kgriffsflwang: the proposal is to use taskflow to distribute tasks21:03
kgriffsso21:03
flwangkgriffs: yep, I know21:04
kgriffsok21:04
kgriffsso taskflow is a library21:04
flwangkgriffs: you mean we many need some remote processor?21:04
flwanginstalled in remote node?21:04
kgriffsyeah21:04
flwangkgriffs: ah, ok, yep, it's possible21:05
flaper87kgriffs: do you think running it in the webheads won't scale enough?21:05
kgriffsbecause a large deployment won't want to push stuff to, say, SMTP or webhook from the webheads, but will want to farm that out to a worker pool21:05
kgriffsflaper87: exactly21:05
kgriffswell, kind of21:05
flaper87kgriffs: mmh21:05
kgriffsI know for a fact some operators like to keep their processes fairly pure21:06
flwangkgriffs: flaper87: could you target a distributed agent in stage 2?21:06
kgriffsit is easier from a capacity management and a diagnostics standpoint21:06
flaper87flwang: sure21:06
kgriffsso they don't want webheads also doing notifciations21:06
flwanggiven it's a built in support by taskflow21:06
*** dynarro has joined #openstack-zaqar21:06
flaper87kgriffs: mmh21:06
flaper87I'm worried about what an Zaqar deployment will look like21:07
kgriffsI don't think it is something we have to force21:07
kgriffswe can definitely have the "easy button" installation where the webheads also push the notifications21:07
kgriffsbut as a second iteration, we will need to have some kind of story around distributed agents21:08
kgriffs(as an alternative option)21:08
kgriffsflwang: so yeah, we could develop this iteratively as you suggested21:09
*** dynarro has quit IRC21:10
flwangkgriffs: it would be good21:10
kgriffsreally all that is needed for the second iteration is creating that agent to bootstrap taskflow, tell it where to start getting jobs from21:11
kgriffsand operators could run farms of these agents21:11
flaper87kgriffs: ok, but I think we should get straight what we'll recommend as a communication channel for that distribution21:11
flaper87I understand that but what are we going to recommend for that21:12
flaper87?21:12
kgriffsfirst, quick question21:13
kgriffsdoes taskflow choose an engine based on job type or something?21:13
kgriffsbasically, I want to have a group of notification agents dedicated to email vs. webhooks, for example21:14
kgriffsflaper87: what are the options for channels?21:14
flaper87http://docs.openstack.org/developer/taskflow/workers.html21:15
* kgriffs looks21:15
flaper87oslo.messaging, basically21:15
kgriffsfine, I'll RTFM21:15
kgriffs:p21:15
flaper87haha, no no21:16
flaper87I didn't mean that21:16
flaper87:P21:16
kgriffs:)21:16
flaper87kgriffs: ^ ^ ^ ^21:16
flaper87:P21:16
kgriffsOK, so what do we need to decide?21:19
kgriffswouldn't we just embed the worker config in the zaqar-notification-agent INI ?21:21
kgriffshttp://docs.openstack.org/developer/taskflow/workers.html#id121:21
kgriffsthen the operator can set it up however they like21:21
kgriffsand we can refer them to the taskflow/oslo.messaging docs21:22
*** wpf1 has joined #openstack-zaqar21:28
*** fesp has joined #openstack-zaqar21:28
flwangkgriffs: it works for me21:28
*** amitgandhinz has quit IRC21:33
*** wpf has quit IRC21:35
*** flaper87 has quit IRC21:35
*** fesp is now known as flaper8721:35
*** amitgandhinz has joined #openstack-zaqar21:35
kgriffskk. but that would be a "round two" project (zaqar-notification-agent)21:35
kgriffsfirst thing is to just assume everything is handled in the web server process21:36
kgriffsflwang: is there an etherpad for notes on this topic, btw?21:36
flwangkgriffs: nope, but i'm happy to create one to track our discussion21:37
kgriffsok, could you make one real quick?21:37
kgriffsI'd like to discuss directory structure21:37
kgriffswould be easier on a pad21:37
kgriffs:p21:37
flwanghttps://etherpad.openstack.org/p/zaqar-notification21:38
flwangnot sure if we should leverage an existed notification etherpad21:38
flwangI believe we have 1 or 2 etherpads about notification21:38
flwangflaper87: if you still around, please join https://etherpad.openstack.org/p/zaqar-notification21:49
kgriffsflwang: ok, so I think we have a good proposal there. Just need to see what flaper87 thinks22:00
flwangkgriffs: right22:00
flwangkgriffs: I will push the guy to get his opinion22:00
kgriffs:)22:00
flwangkgriffs: thank you for the awesome proposal22:00
kgriffsno problem, thanks for helping figure it out22:01
flwangkgriffs: it makes more sense for me22:01
*** sriram has quit IRC22:09
*** amitgandhinz has quit IRC22:14
*** amitgandhinz has joined #openstack-zaqar22:15
*** exploreshaifali has quit IRC22:26
*** jchai has quit IRC22:37
*** amitgandhinz has quit IRC23:07
*** jimhoagland has quit IRC23:27
*** mpanetta has quit IRC23:30
*** echevemaster has joined #openstack-zaqar23:30
*** jimhoagland has joined #openstack-zaqar23:41

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!