Friday, 2014-07-18

« Thursday, 2014-07-17 Index Saturday, 2014-07-19 »
*** amalagon has quit IRC00:11
*** oz_akan has joined #openstack-marconi00:17
*** Sriram has joined #openstack-marconi00:25
*** Sriram has left #openstack-marconi00:27
peoplemerge'db type could not be determined'00:32
*** nosnos has joined #openstack-marconi00:53
*** prashanthr_ has joined #openstack-marconi00:55
*** reed has quit IRC00:56
peoplemergethat's odd, my falcon doesn't have ordereddict as a transitive dep on py2600:57
*** oz_akan has quit IRC01:04
*** malini2 has quit IRC01:11
*** oz_akan has joined #openstack-marconi01:19
*** oz_akan has quit IRC01:36
*** oz_akan has joined #openstack-marconi01:37
*** oz_akan has quit IRC01:41
*** haomaiwa_ has quit IRC02:06
*** haomaiwang has joined #openstack-marconi02:06
*** mwagner_lap has joined #openstack-marconi02:10
*** rossk has quit IRC02:31
*** tongli has joined #openstack-marconi02:55
*** haomai___ has joined #openstack-marconi02:57
*** tongli has quit IRC02:59
*** haomaiwang has quit IRC02:59
*** haomai___ has quit IRC03:04
*** haomaiwang has joined #openstack-marconi03:05
*** oz_akan has joined #openstack-marconi03:10
*** nosnos has quit IRC03:21
*** prashanthr_ has quit IRC03:47
*** prashanthr_ has joined #openstack-marconi03:47
*** nosnos has joined #openstack-marconi03:50
*** haomai___ has joined #openstack-marconi04:12
*** prashanthr_ has quit IRC04:13
*** haomaiwang has quit IRC04:15
*** oz_akan has quit IRC04:19
*** itisit has joined #openstack-marconi04:22
openstackgerritKurt Griffiths proposed a change to openstack/marconi: feat(v1.1): Default TTL and grace values  https://review.openstack.org/10688804:25
*** renlt has joined #openstack-marconi04:26
*** renlt has quit IRC04:27
openstackgerritKurt Griffiths proposed a change to openstack/marconi: feat(v1.1): Default TTL and grace values  https://review.openstack.org/10688804:28
*** renlt has joined #openstack-marconi04:28
*** haomai___ has quit IRC05:16
*** chandankumar has joined #openstack-marconi05:16
*** haomaiwang has joined #openstack-marconi05:16
*** amalagon has joined #openstack-marconi05:19
*** amalagon has left #openstack-marconi05:19
*** peoplemerge_ has quit IRC05:21
*** haomaiw__ has joined #openstack-marconi05:22
*** itisit has quit IRC05:23
*** itisit has joined #openstack-marconi05:24
*** haomaiwang has quit IRC05:25
*** k4n0 has joined #openstack-marconi05:30
*** prashanthr_ has joined #openstack-marconi05:36
*** prashanthr_ has quit IRC06:02
*** prashanthr_1 has joined #openstack-marconi06:02
*** flaper87|afk is now known as flaper8706:09
*** prashanthr_1 has quit IRC06:20
*** prashanthr_ has joined #openstack-marconi06:20
*** prashanthr_ has quit IRC06:20
*** prashanthr_ has joined #openstack-marconi06:21
*** prashanthr_ has joined #openstack-marconi06:22
*** prashanthr_ has quit IRC06:22
*** prashanthr_ has joined #openstack-marconi06:23
*** prashanthr_ has quit IRC06:24
*** prashanthr_ has joined #openstack-marconi06:25
*** prashanthr_ has quit IRC06:34
*** prashanthr_1 has joined #openstack-marconi06:34
*** prashanthr_1 has quit IRC06:54
*** prashanthr_ has joined #openstack-marconi06:54
*** prashanthr_ has joined #openstack-marconi06:55
*** mkoderer has joined #openstack-marconi07:04
*** prashanthr_ has quit IRC07:14
*** prashanthr_ has joined #openstack-marconi07:16
*** prashanthr_ has quit IRC07:43
*** prashanthr_ has joined #openstack-marconi07:43
openstackgerritPrashanth Raghu proposed a change to openstack/marconi: Implements Queue and Message Controllers for Redis  https://review.openstack.org/9717808:05
prashanthr_flaper87: Hello :)08:05
*** prashanthr_ has quit IRC08:08
*** prashanthr_ has joined #openstack-marconi08:08
flaper87prashanthr_: hey hey08:08
flaper87I was looking for you yday08:08
flaper87I don't remember why08:08
flaper87oh wait08:08
flaper87redis08:08
flaper87right08:08
flaper87:P08:08
prashanthr_flaper87: Yeah :P I just slept on my desk08:08
prashanthr_first day in the gym :P08:09
prashanthr_I have removed all the unrequired files08:09
prashanthr_today morning08:09
flaper87prashanthr_: awesome, I'll review again08:10
prashanthr_flaper87: Sure. thanks a lot. Sorry for bugging you so many times.08:10
*** prashanthr_ has quit IRC08:12
*** prashanthr_ has joined #openstack-marconi08:13
flaper87prashanthr_: oh, don't worry. Please do ping me08:15
*** prashanthr_ has quit IRC08:20
*** prashanthr_ has joined #openstack-marconi08:20
prashanthr_flaper87: Sure :)08:20
* flaper87 is going to regret that08:20
flaper87:P08:20
*** prashanthr_ has quit IRC08:21
*** prashanthr_1 has joined #openstack-marconi08:21
*** prashanthr_ has joined #openstack-marconi08:22
* prashanthr_ wil make sure he regrets :P08:22
*** stannie has joined #openstack-marconi08:43
*** haomaiw__ has quit IRC09:15
*** haomaiwang has joined #openstack-marconi09:15
*** haomai___ has joined #openstack-marconi10:15
*** haomaiwang has quit IRC10:17
openstackgerritOpenStack Proposal Bot proposed a change to openstack/marconi: Updated from global requirements  https://review.openstack.org/10650610:37
*** renlt has quit IRC10:39
*** denis_makogon has joined #openstack-marconi10:48
*** malini has joined #openstack-marconi11:01
*** malini has quit IRC11:02
*** malini has joined #openstack-marconi11:02
*** nosnos has quit IRC11:03
*** renlt has joined #openstack-marconi12:13
*** flwang has quit IRC12:21
*** AAzza has joined #openstack-marconi12:23
*** flwang has joined #openstack-marconi12:32
*** chandankumar has quit IRC12:35
*** sriram has joined #openstack-marconi12:38
*** flwang has quit IRC12:42
*** chandankumar has joined #openstack-marconi12:43
*** itisit has quit IRC12:43
*** malini has quit IRC12:49
*** tongli has joined #openstack-marconi13:04
*** Catherin_ has joined #openstack-marconi13:11
*** Catherin_ has quit IRC13:11
*** Catherin_ has joined #openstack-marconi13:12
*** mpanetta has joined #openstack-marconi13:15
*** peoplemerge_ has joined #openstack-marconi13:16
*** abettadapur has joined #openstack-marconi13:20
*** prashanthr_ has quit IRC13:21
*** AAzza has quit IRC13:28
*** amitgandhi has joined #openstack-marconi13:31
*** malini has joined #openstack-marconi13:32
*** Obulpathi has joined #openstack-marconi13:33
*** k4n0 has quit IRC13:47
*** oz_akan has joined #openstack-marconi13:52
*** abettadapur has quit IRC13:57
*** ametts has quit IRC13:58
*** ametts has joined #openstack-marconi14:11
maliniflaper87: hello!14:18
flaper87malini: hey :D14:19
maliniflaper87: how are you?14:19
sriramGoooood morning everyone :D14:19
flaper87malini: I'm great, what about you?14:20
flaper87sriram: hey hey14:20
maliniflaper87: good :)14:20
maliniAre you planning to take on https://blueprints.launchpad.net/marconi/+spec/api-v1.1-remove-check-queue-existence ?14:20
*** tongli has quit IRC14:20
*** jay-atl has joined #openstack-marconi14:22
sriramquestion: if we remove queue check existence, wont lazy queue create get broken?14:24
malinisriram: if it does, we dont need to implement this bp :-P14:25
sriramI was wondering because of this. https://github.com/openstack/marconi/blob/master/marconi/queues/transport/wsgi/v1_1/messages.py#L16514:27
sriramflaper87: ^14:27
sriramI may be wrong.14:27
flaper87we would remove it from the API not the storage plane14:27
*** tonytan4ever has joined #openstack-marconi14:27
sriramaaah, got you.14:28
* sriram is slow this morning14:28
*** vkmc has joined #openstack-marconi14:37
*** oz_akan_ has joined #openstack-marconi14:38
*** oz_akan has quit IRC14:38
vkmchiii14:40
maliniheyy vkmc!14:43
*** flwang has joined #openstack-marconi14:44
vkmchi malini :)14:44
flaper87malini: if you're not doing that, I'll stab it14:46
*** tonytan4ever has quit IRC14:54
*** alcabrera|afk is now known as alcabrera15:01
alcabreragood morning. o/15:01
vkmcmorning alcabrera o/15:02
alcabreraheya, vkmc! how are you? :)15:02
vkmcI woke up with a headache, but I'm good now!15:03
vkmcalcabrera, you?15:03
alcabreraI woke up too early to get boxes to pack for the move from the local grocery store. I'm tired, but happy. :)15:05
malinicoming back to, https://blueprints.launchpad.net/marconi/+spec/api-v1.1-remove-check-queue-existence - Should we really get rid of this?15:06
sriramwoo alcabrera :) great to see you here.15:06
srirammalini: as flaper87 mentioned I think thats the transport API we are getting rid of15:06
maliniWhat if someone creates a queue & wants to make sure it is really there for some reason?15:06
*** cpallares has joined #openstack-marconi15:06
alcabrerahola, sriram!15:06
malinialcabrera: woww…are you ready to start packing?15:06
alcabrerayes, malini - right after oscon!15:07
sriramwe will still keep the storage controller queue existence check around.15:07
srirammalini: ^15:07
*** tonytan4ever has joined #openstack-marconi15:07
malinisriram: yes, but it is not something an user can access15:07
malinialcabrera: where is oscon happening?15:07
sriramjuly 18?15:07
sriramoops15:08
sriramjuly 20-2415:08
* sriram didnt realise july 18 was today :P15:08
alcabreramalini: as sriram said. I'll be giving my talk @ 5pm on the 22nd. :)15:09
*** flaper87 is now known as flaper87|afk15:09
sriramlive streaming? :D15:09
malinitht must be exciting alcabrera!15:09
vkmcyaay alcabrera :D15:10
vkmcfor both the moving and the talk15:10
alcabrerathanks, vkmc. :)15:10
alcabrerasriram: no livestream for the track talks, I believe.15:10
alcabrerahowever, the videos should be made public shortly after!15:10
srirammalini: correct, but I think that is going to be the point? users do not need to care about queues being there anymore.15:11
alcabreraand of course, you have a direct link to the source, so once I finish putting these slides together, feel free to ping me. :)15:11
*** Catherin_ has left #openstack-marconi15:12
malinisriram: yeah..Maybe it's my squirrel brain loving to hoard - But we are taking away user's ability to chk the queue existence..15:12
maliniAnyways I agree, thts the whole point of lazy queues15:13
sriram:) lol at the squirell15:13
openstackgerritMalini Kamalambal proposed a change to openstack/marconi: Remove check queue exists endpoint.  https://review.openstack.org/10805115:39
*** chandankumar has quit IRC15:45
*** itisit has joined #openstack-marconi15:45
sriramthat was a quick patch :D15:47
malini:D15:47
srirambbl lunh15:55
sriramlunch15:55
*** sriram has quit IRC15:56
*** amitgandhi has quit IRC16:08
*** jay-atl has quit IRC16:11
*** kgriffs|afk is now known as kgriffs16:12
*** rossk has joined #openstack-marconi16:38
*** sriram has joined #openstack-marconi16:41
peoplemerge_MORNING all!16:41
peoplemerge_sorry for shouting, caps log was on, but then it fits doesn't it??16:41
*** sriram1 has joined #openstack-marconi16:42
*** sriram has quit IRC16:42
vkmcHI peoplemerge!16:43
alcabreraheya, peoplemerge_. :)16:44
alcabreraso much energy. ;)16:44
*** tonytan4ever has quit IRC16:49
kgriffsalcabrera: congrats on getting your talk accepted. I hadn't heard about that until today.16:49
kgriffsalcabrera: you need a new nick16:49
kgriffsmay I suggest...16:49
*** tonytan4ever has joined #openstack-marconi16:49
kgriffsTHE HASKELLNATOR16:49
* kgriffs queue awesome theme song16:49
*** tonytan4ever has quit IRC16:51
alcabrerakgriffs: hahaha16:53
alcabrerathanks!16:54
kgriffsrock on16:54
alcabrerabeen listening to mega man music all day. I imagine I could appropriate a theme from there for the title "THE HASKELLNATOR". ;)16:54
mpanettaHaha which one alcabrera? :)16:55
alcabrerampanetta: I'm not sure yet! Maybe Storm Eagle (MMX1) or The Skiver (MMX5). Ooh - Gemini Man (MM2), because symmetry + reflection16:56
*** mkoderer has quit IRC17:02
*** amitgandhi has joined #openstack-marconi17:07
peoplemerge_+1THE HASKELLNATOR17:10
alcabreratype error: No instance for (Num [Char]) arising from a use of ‘+’17:13
alcabrera:D17:13
*** peoplemerge_ has quit IRC17:19
malinikgriffs: ping17:38
kgriffso/17:39
malinikgriffs: w.r.t default value when message ttl is not specified17:39
maliniI was wondering if we should make it another config option, instead of using the max_ttk17:40
maliniLets say the vendor has max_ttl configured to 2 weeks17:40
malinithe message will inadvertently stay in storage for too long17:40
kgriffsthat is a good point. I did think about it some, but I'm not sure either if the tradeoffs make sense17:41
kgriffsso, between max and min, max is safer for the user17:41
kgriffsI think safety is most important in this case17:42
kgriffsthat leaves us with either using max or defining a third value17:42
kgriffshmmm17:42
* kgriffs is thinking17:42
maliniWill we have perf impact with too many messages in the storage?17:44
kgriffswe could allow people to set their own defaults. But... what is there incentive to choose something less than max? I guess if the operator is charging them based on a watermark of messages in the queue, they would want to keep that watermark low17:44
kgriffsmalini: oh, depends. :)17:44
kgriffsdepends on how many messages can fit in RAM at a time in the case of Redis and Mongo17:45
kgriffsalso size of the index would go up17:45
kgriffsfor redis flavor I would expect you to keep max fairly low anyway, like 6 hours or less17:46
kgriffsfor durable store (mongo, alternative-durable-thing-whatever-maybe-leveldb) max could be higher since you can swap out to disk.17:46
kgriffshowever, even in that case, you would probably try to keep things fitting in RAM for performance, and just have disk as a durable backup in case your box crashes17:47
kgriffshmmm...17:47
malinione of the concerns we had during cloud queues phase was some rogue customer can start using queues as a storage with a 2 week TTL17:49
kgriffsadding a third config option would help manage this. But it also depends on how many clients opt to use the defaults vs. being explicit17:49
kgriffsmalini: well, some people want long TTLs for batch processing17:49
maliniyeah..sure17:49
kgriffsso you have to mitigate that with max message size, and give people incentives to voluntarily choose lower TTLs when it isn't really needed17:50
sriram1if we make it visible and not obscure it, perhaps there might be a use for it.17:50
kgriffsbut here with default TTL we are encouraging people to use max TTL17:50
kgriffsso I see your point17:50
*** sriram1 is now known as sriram17:50
* sriram looks around for sriram117:50
malinisriram: adding to tht, we have sriram2 as well :D17:51
* sriram ducks17:51
malinikgriffs: anyways, just wanted to bring tht up17:52
*** renlt has quit IRC17:52
kgriffshmmm. http://wac.450f.edgecastcdn.net/80450F/thefw.com/files/2013/02/CalvinHobbesDuplicator.jpg17:52
sriramlol17:52
malini:D17:52
malinithe machine malfunctioned..17:52
malinithe clone no way resembles the original, in our case17:53
kgriffsLOL17:53
sriramthe clones have low ttls :P17:53
maliniuh oh..17:53
maliniI am now worried for sriram217:53
sriramkidding :P17:53
kgriffsso.... anyway.... only thing holding me back by defining a third value is adding one more thing the user had to think about17:54
kgriffsbut, I guess saying, "check with your operator for the default value" wouldn't be *that* confusing17:54
* kgriffs is starting to be won over17:54
sriramyeah17:55
*** Obulpathi has quit IRC17:55
malinikgriffs: I get your point - we want to keep the configs as simple as we can17:55
*** Obulpathi has joined #openstack-marconi17:55
malininewer options will add a lot of fine print to read17:56
kgriffsyeah, that is a good way to put it.17:56
maliniso tht is settled17:57
kgriffsTBH, I'm not totally sure which way to go17:57
*** denis_makogon has quit IRC17:57
malinime too :(17:58
kgriffswell, let's think about this17:58
kgriffs(not that we haven't been already, heh)17:59
kgriffsfor a durable store, I as an operator will be more comfortable setting a high max TTL, say 2 weeks17:59
kgriffsnow, if everyone uses default TTLs17:59
kgriffsthen all messages are living 2 weeks unless they are manually deleted17:59
maliniyes18:00
kgriffsso, if you are using the queue for task distribution, messages will usually not live 2 weeks18:00
kgriffssince they will be constantly created and deleted18:00
kgriffsother patterns, like broadcast, I suspect the usual case is the message would be read soon after being created. then it would chill out for 1.9 weeks18:01
kgriffsif the server runs out of RAM, it will page out inactive parts of the collection18:01
kgriffsso, those "chilled" messages would page out to disk18:02
* malini needs to find a more creative response than yes18:02
kgriffsI think that would work out OK performance-wise18:02
malinijust tht oz_akan_ would not like any more messages than is needed in his hardware18:02
kgriffsexcept for the case of the index... depending on how the DB implements their index, it may not be able to page out the references to the cold messages18:03
sriramperhaps we can set it per flavor?18:03
srirambut that makes it even more complicated. :/18:04
kgriffssriram: I think the min and max limits should be set per flavor, regardless18:04
sriramYes, what i meant was different values of default per flavor.18:04
srirambut thats even more state to maintain, and makes things needlessly complicated.18:04
kgriffsright, we would do that as well. but that is assuming we are going to introduce a separate default config option in the first place18:05
sriramcorrect18:05
sriramjust thinking ahead :P18:05
kgriffsidk, I think it may be OK to introduce a new option18:05
kgriffsit is more fine print, but it isn't hard to understand either18:05
maliniwish we can just toss a coin ^o)18:05
kgriffsheh18:06
kgriffsok, what is everyone's vote?18:06
* sriram tosses a coin18:06
sriramWhat?? It lands on edge :P18:06
malini:D18:06
* sriram (un)possible18:06
* sriram shuts up18:06
kgriffs#startvote Introduce new default TTL and grace config options? Yes, No, Abstain18:06
kgriffsdarn18:06
* kgriffs is lazy and doesn't want to start a meeting18:07
sriram#vote Yes18:07
sriramNow, everyone knows my opinion :P18:07
malini#vote Yes18:07
alcabrera#vote Yes18:07
malinisriram rigged the vote ;)18:07
sriramhahaha18:07
alcabrera:)18:07
* sriram evil grin18:07
sriramwe need flaper87|afk's opinion as well.18:09
*** cpallares has quit IRC18:09
kgriffs#vote Yes18:09
kgriffs#endvote18:09
kgriffsok, cool then18:10
kgriffsI guess I will go do that18:10
kgriffsbut first... me need food18:10
* sriram sends poptarts18:10
sriramin a queue18:10
sriramwhich can actually be POPed18:11
sriram:P18:11
malinidoes it have a TTL set?18:11
sriram14 days of food :P18:11
malini:D18:11
alcabreraall food has a TTL -- except frozen burritos. those things will outlive time18:14
kgriffsand twinkies18:15
kgriffsbbl18:15
*** malini has quit IRC18:22
*** tonytan4ever has joined #openstack-marconi18:28
*** cpallares has joined #openstack-marconi18:37
mpanettaalcabrera: Gemini Man FTW :P18:42
alcabrerampanetta: I learned of "The Megas" today and I've been listening to *all* their music.18:44
mpanettaWho are they?18:44
alcabreraThey are a rock-vocal group that do remixes of Mega Man music18:44
alcabrerathey have a 2-album collection that focuses on Megaman 318:44
alcabreraHistory Repeating: Blue and History Repeating: Red18:44
alcabreraso good18:44
alcabrerahere's my favorite song so far: Can't Stop the Top - http://themegas.bandcamp.com/track/cant-stop-the-top18:45
mpanettaOh cool logo18:47
alcabreraI want the shirt so badly, mpanetta: http://www.themegas.com/wp-content/uploads/2014/02/new-vs-mockup.png :D18:48
mpanettaOh this was for Top Mans stage yeah?18:48
alcabrerayup!18:48
mpanettaOh sweet shirt!18:48
mpanettaThey have a show in Orlando on Aug 7th heh18:49
alcabrerahehe18:49
alcabreraI'll listen from over here, all digital like. I can't handle concerts, but super cool that they tour.18:49
alcabrera:P18:49
mpanettaIve only been to one concert in my life lol18:50
alcabrerasame here18:50
mpanettaUnless you consider the times I briefly visited the concert rooms at dragoncon18:50
*** cpallares has left #openstack-marconi19:07
*** cpallares has joined #openstack-marconi19:07
*** ametts has quit IRC19:13
*** tongli has joined #openstack-marconi19:16
kgriffssomething I learned today19:19
kgriffshttp://www.pythoncentral.io/measure-time-in-python-time-time-vs-time-clock/19:19
kgriffsok, now I am going to go get food for realz19:19
kgriffsbbl19:19
*** tonytan4ever has quit IRC19:22
*** tonytan4ever has joined #openstack-marconi19:24
*** kgriffs is now known as kgriffs|afk19:29
*** ametts has joined #openstack-marconi19:31
*** tonytan4ever has quit IRC19:35
*** malini has joined #openstack-marconi19:36
*** malini has quit IRC19:37
*** malini has joined #openstack-marconi19:37
*** ametts has quit IRC19:40
openstackgerritMalini Kamalambal proposed a change to openstack/marconi: Remove check queue exists endpoint  https://review.openstack.org/10805119:45
*** tonytan4ever has joined #openstack-marconi19:48
*** kgriffs|afk is now known as kgriffs19:50
*** ametts has joined #openstack-marconi19:52
*** amitgandhi has quit IRC19:55
*** rwsu has quit IRC19:55
*** amitgandhi has joined #openstack-marconi19:55
*** rwsu has joined #openstack-marconi19:55
*** kgriffs is now known as kgriffs|afk19:59
*** ametts has quit IRC19:59
*** cpallares has quit IRC20:02
*** rwsu has quit IRC20:09
*** Obulpath_ has joined #openstack-marconi20:15
*** kgriffs|afk is now known as kgriffs20:15
*** kgriffs is now known as kgriffs|afk20:16
*** ametts has joined #openstack-marconi20:19
*** Obulpathi has quit IRC20:19
*** rwsu has joined #openstack-marconi20:21
*** tongli has quit IRC20:26
peoplemergenothing but python trouble today :/ py26 and py33 are bust but at least I can test my code on py27.  This is probably a hole I dug myself into with trusty.  Gonna have lunch and code up some msgpack on py27.20:28
*** sriram has quit IRC20:32
*** alcabrera is now known as alcabrera|afk20:35
*** Obulpath_ has quit IRC20:41
malinikgriffs|afk: when you get a chance, can you take  look at this http://logs.openstack.org/51/108051/2/check/gate-marconi-python26/4e8234f/testr_results.html.gz ? It is failing  with falcon import errors20:45
*** mpanetta has quit IRC21:14
*** jimhoagland has joined #openstack-marconi21:16
*** itisit has quit IRC21:50
*** oz_akan_ has quit IRC21:56
*** jimhoagland has quit IRC21:59
*** ametts has quit IRC22:08
*** amitgandhi has quit IRC22:21
*** tonytan4ever has quit IRC22:42
*** Catherin_ has joined #openstack-marconi22:46
peoplemergeah I guess I'm not the only one with falcon import errors22:49
*** Catherin_ has quit IRC22:50
openstackgerritKurt Griffiths proposed a change to openstack/marconi: feat(v1.1): Default TTL and grace values  https://review.openstack.org/10688822:50
*** malini has quit IRC23:42
« Thursday, 2014-07-17 Index Saturday, 2014-07-19 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!