*** vkmc has joined #openstack-marconi | 00:41 | |
*** amitgandhi has quit IRC | 02:40 | |
*** vkmc has quit IRC | 03:02 | |
*** fifieldt has joined #openstack-marconi | 05:34 | |
*** fifieldt has quit IRC | 06:06 | |
*** flaper87|afk is now known as flaper87 | 07:04 | |
*** fifieldt has joined #openstack-marconi | 07:25 | |
*** flaper87 is now known as flaper87|afk | 07:33 | |
*** flaper87|afk is now known as flaper87 | 07:38 | |
*** flaper87 is now known as flaper87|afk | 09:24 | |
*** flaper87|afk is now known as flaper87 | 09:25 | |
*** _alexr_ has joined #openstack-marconi | 09:36 | |
flaper87 | !help | 11:19 |
---|---|---|
openstack | flaper87: (help [<plugin>] [<command>]) -- This command gives a useful description of what <command> does. <plugin> is only necessary if the command is in more than one plugin. | 11:19 |
*** JRow has joined #openstack-marconi | 11:23 | |
*** vkmc has joined #openstack-marconi | 11:58 | |
*** cppcabrera has joined #openstack-marconi | 12:22 | |
cppcabrera | Morning~ | 12:23 |
*** amitgandhi has joined #openstack-marconi | 12:37 | |
*** amitgandhi has quit IRC | 12:38 | |
*** amitgandhi has joined #openstack-marconi | 12:38 | |
*** zyuan has quit IRC | 12:39 | |
*** flaper87 is now known as flaper87|afk | 12:54 | |
*** flaper87|afk is now known as flaper87 | 12:54 | |
flaper87 | cppcabrera: Morning | 12:55 |
flaper87 | :D | 12:55 |
cppcabrera | Hey hey, flaper87. :) | 12:56 |
cppcabrera | And it begins: https://github.com/cabrera/marconi-redis | 12:57 |
flaper87 | cppcabrera: awesome, looking forward to see it working | 12:58 |
*** malini_afk is now known as malini | 13:20 | |
*** ayoung has joined #openstack-marconi | 13:34 | |
* flaper87 is working on functional tests config refactor | 13:46 | |
cppcabrera | woot :) | 13:47 |
flaper87 | cppcabrera: :D I've some patches ready but I'll submit them all once I finish this one | 13:47 |
cppcabrera | As they come in, and as I notice them, I'll be glad to review. :) | 13:51 |
* cppcabrera wrestles for the first time with the basics of openstack-common.conf | 13:51 | |
cppcabrera | It's actually not too bad. :P | 13:51 |
flaper87 | hehehe, can't wait | 13:54 |
*** fifieldt has quit IRC | 14:02 | |
*** kgriffs_afk is now known as kgriffs | 14:12 | |
*** meganw has joined #openstack-marconi | 14:20 | |
flaper87 | w00000000t, test_claims ported to oslo.config | 14:43 |
flaper87 | 2 more suites to go | 14:43 |
flaper87 | then tox, then embedded marconi-sever execution | 14:43 |
ametts | flaper87: Rock on! | 14:44 |
flaper87 | mmh, I guess first embedded execution | 14:44 |
flaper87 | ametts: :) | 14:44 |
* flaper87 wonders what kgriffs and malini hacking-day projects are | 14:45 | |
kgriffs | heh | 14:45 |
kgriffs | not sure if I am participating since I'm not in Atlanta, but if I do it will likely be Falcon 0.1.7 | 14:46 |
cppcabrera | awesome, flaper87! | 14:46 |
ametts | malini is still stirring up marconi trouble. I'm hearing the phrases "Random 404s and 400s" from her in the hallway.... | 14:46 |
amitgandhi | she was saying that yesterday too - i wonder if its from kgriffs patch | 14:47 |
flaper87 | LOOOOOL | 14:47 |
kgriffs | hmmm | 14:47 |
amitgandhi | either that, or the patch has exposed a new issue prev unknown | 14:47 |
flaper87 | if there are no chairs flying, it means there's still hope | 14:48 |
kgriffs | malini: do you get the same errors w/o the patch? | 14:48 |
malini | kgriffs: I 'think' it might be a pre-patch thing.. | 14:49 |
*** oz_akan_ has joined #openstack-marconi | 14:49 | |
malini | when I run the test_claims.py functional test, I get random 404s on post_claim, patch_claim etc. | 14:49 |
oz_akan_ | I forgot to start my irc client | 14:49 |
malini | So I tried running the test in debug with pdb & the 404s no longer show up | 14:50 |
amitgandhi | is marconi too fast now? | 14:50 |
malini | in any case ,it shud not be 404 (as long as the queue exists & it does) | 14:51 |
amitgandhi | are we running into propogation issues? | 14:51 |
amitgandhi | reading from secondaries | 14:51 |
kgriffs | that was what I was wondering as well | 14:51 |
oz_akan_ | 404 is different | 14:51 |
flaper87 | w0000t test_messages ported | 14:51 |
amitgandhi | pdb mode runs slower giving it enough time to propogate | 14:51 |
malini | flaper87 gets a cherry poptart | 14:52 |
flaper87 | w000t | 14:52 |
amitgandhi | i need to go make another smoothie - brb | 14:52 |
malini | amitgandhi: just because its healthy doesnt men, you can keep gorging ;) | 14:52 |
malini | mean* | 14:52 |
oz_akan_ | hehe | 14:53 |
* ametts thinks amitgandhi is mixing the smoothie ingredients with the margarita ingredients. Stay out of that cabinet, Amit! | 14:53 | |
oz_akan_ | what a smell | 14:54 |
malini | oz_akan_ : chk if you still have your salt ;) | 14:54 |
oz_akan_ | :D | 14:55 |
oz_akan_ | I had stacked it, so I must have some more (saltstack) | 14:55 |
* cppcabrera awaits flaper87's refactoring patch | 14:56 | |
malini | kgriffs, cppcabrera: can one of you look at the 404 issue? Ihavent opened a bug yet, since we dont know if its the code | 14:57 |
kgriffs | malini: can you add a delay between creating the queue and testing whether it exists? | 14:58 |
amitgandhi | ametts: i already raided the tequila cabinet (but only to get the agave nectar) | 14:58 |
kgriffs | amitgandhi: suuuuuure. ;) | 14:59 |
amitgandhi | rum would go well with this though - we need rum ametts - put it in the next stationary order please =) | 14:59 |
ametts | I'm not sure they have that in the Staples catalog... | 14:59 |
malini | kgriffs: http://paste.openstack.org/show/45472/ | 15:00 |
malini | since the post messages get a 201, I dont see any reason the queue wud vanish before the claims | 15:02 |
cppcabrera | that's pretty weird, malini. AFAICS, it's like the claim|queue ceases to exist after posting enough messages to it. | 15:02 |
kgriffs | it's because we don't check for queue existence anymore | 15:02 |
kgriffs | (before posting a message) | 15:02 |
kgriffs | if you try forcing a delay before attempting to claim some messages, ti should avoid the 404 if my hypothesis is correct | 15:04 |
malini | kgriffs: hmmm, in tht case if the queue doesnt exist, dont we return a 404 ? | 15:05 |
malini | I am trying out the sleep now | 15:06 |
* ametts wishes malini wouldn't sleep on the job | 15:06 | |
malini | :D | 15:07 |
cppcabrera | time.nap(10) # a more human-friendly variant on time.sleep | 15:11 |
openstackgerrit | Kurt Griffiths proposed a change to stackforge/marconi: chore: Track the up-and-coming oslo.cache module https://review.openstack.org/44131 | 15:11 |
malini | a 'nap' between posting & claiming messages removed the 404 | 15:13 |
amitgandhi | a ' nap | 15:13 |
amitgandhi | ugh | 15:13 |
malini | cppcabrera wanted a more human friendly term ;) | 15:13 |
amitgandhi | a 'nap' indicates that the nap can be interrupted. 'sleep' indicates DND until time is up | 15:13 |
malini | but I get a 404 between post & patch claims (with no sleep) | 15:13 |
malini | trying to add sleep between those two | 15:14 |
amitgandhi | do you get the 404's with just one worker also? | 15:14 |
* amitgandhi wonders if hitting some sort of race condition | 15:15 | |
malini | I have just one worker | 15:16 |
malini | kgriffs: The sleep seems to make things better. Please run test_claims.py against test env for a repro | 15:20 |
malini | You'll see a few random 404s | 15:20 |
malini | I am back to figuring out whats wrong with the tsung tests | 15:21 |
malini | Ping me if you need anything | 15:21 |
kgriffs | malini: if the sleep makes things better, then we have to decide whether we just document this behavior or try to work around it. Eventual consistency is kind of something you have to live with in order to scale out | 15:22 |
kgriffs | (although there are some recent attempts to be fully consistent and yet still crazy fast with writes) | 15:23 |
malini | I think this is the same issue, kevin ran into in his test app | 15:23 |
malini | kgriffs:But I still dont understand why its a 404 and not 204, for post claims | 15:25 |
malini | why does the server think there is no queue :-S | 15:25 |
*** meganw has quit IRC | 15:29 | |
*** meganw has joined #openstack-marconi | 15:30 | |
kgriffs | malni: implementation detail. post claim checks whether the queue exists before doing anything else, while post messages just assumes it is there (for performance) | 15:31 |
kgriffs | makes me wonder why we check when claiming messages? | 15:31 |
flaper87 | malini: some tests in test_queue are not passing :( | 15:31 |
malini | I know two of them | 15:32 |
kgriffs | flaper87: thoughts on my last comment? | 15:32 |
malini | 1) tests invalid auth - wont work locally , but I am open to getting rid of tht if we need to | 15:32 |
flaper87 | kgriffs: mmh, I remember discussing that | 15:32 |
flaper87 | let me try to remember | 15:33 |
flaper87 | kgriffs: ah, nevermind, we discussed that for deletion | 15:34 |
malini | 2) non ASCII metadata - I think there is something wrong in tht comparison..I missed to fix it :-$ | 15:34 |
*** meganw has quit IRC | 15:34 | |
flaper87 | not creation | 15:34 |
flaper87 | malini: kk, I'll get rid of the auth tests, meaning disable if auth_on is false | 15:34 |
malini | 3) https://bugs.launchpad.net/marconi/+bug/1208873 is still failing | 15:34 |
malini | flaper87: tht is 3 failing tests, I remember | 15:35 |
flaper87 | malini: kk, I thought it was related to the migration | 15:35 |
flaper87 | thanks for the heads up | 15:35 |
flaper87 | kgriffs: FWIW, I'd prefer Marconi's API to be as lazy as possible | 15:35 |
flaper87 | meaning, less checks | 15:36 |
kgriffs | so, just remove that check? | 15:36 |
flaper87 | kgriffs: yup, but, if we remove it we'll have to change the returned status code | 15:38 |
flaper87 | right? | 15:38 |
flaper87 | mmh, wait a sec | 15:38 |
kgriffs | it would just return no messages claimed | 15:38 |
kgriffs | 204 | 15:39 |
kgriffs | also, I was mistaken about posting messages | 15:39 |
kgriffs | it also checks for existence | 15:39 |
flaper87 | kgriffs: but we do verify it for message posting https://github.com/stackforge/marconi/blob/master/marconi/storage/mongodb/messages.py#L482 | 15:40 |
flaper87 | ah that | 15:40 |
flaper87 | :P | 15:40 |
flaper87 | sorry, I didn't read | 15:40 |
kgriffs | heh, we need to stop doing this. :p | 15:40 |
flaper87 | yeah :D | 15:40 |
flaper87 | so, I t makes sense for mmessages' post | 15:41 |
flaper87 | to check, that is | 15:41 |
kgriffs | I was just thinking about that | 15:42 |
kgriffs | if you don't check, and a queue really doesn't exist, then you have orphaned messages that may never get cleaned up | 15:42 |
kgriffs | I guess we could add that to the garbage collector | 15:42 |
flaper87 | exactly | 15:42 |
kgriffs | but then it gets weird with the stats call | 15:43 |
kgriffs | so... | 15:43 |
kgriffs | we could remove it for claims I guess | 15:43 |
flaper87 | I agree | 15:43 |
kgriffs | and cache the call in the message post | 15:44 |
kgriffs | https://review.openstack.org/#/c/44131/ | 15:44 |
kgriffs | (hint, hint) | 15:44 |
kgriffs | p.s. - https://review.openstack.org/#/c/44363/ | 15:44 |
* kgriffs feels like a dope for forgetting to update the unit test the first timie | 15:45 | |
* kgriffs is listening to http://www.radioparadise.com | 15:45 | |
kgriffs | malini: is there a bug for that 404 thing? | 15:49 |
kgriffs | if not, I'll just submit a patch w/o a reference | 15:49 |
* kgriffs loves quick turnaround on feedback | 15:49 | |
* kgriffs q.e.d. loves IRC | 15:49 | |
*** meganw has joined #openstack-marconi | 15:49 | |
kgriffs | sweet! | 15:50 |
kgriffs | it's the meganw-a-nator | 15:50 |
malini | kgriffs: no ..let me open one | 15:50 |
malini | https://bugs.launchpad.net/marconi/+bug/1218990 | 15:52 |
kgriffs | sweet. I'm on it | 15:56 |
openstackgerrit | A change was merged to stackforge/marconi: chore: Track the up-and-coming oslo.cache module https://review.openstack.org/44131 | 15:57 |
cppcabrera | woot | 15:58 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Pull actual tests out of marconi/tests https://review.openstack.org/44475 | 15:59 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Remove util packages https://review.openstack.org/44476 | 15:59 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Use oslo.config for functional tests https://review.openstack.org/44477 | 15:59 |
kgriffs | hooray for oslo.config! | 15:59 |
cppcabrera | ohh, flaper87 has test refactorings available for review. | 16:01 |
flaper87 | cppcabrera: :) | 16:01 |
* kgriffs wishes he could just click on an output for tox and jump to the line of code | 16:02 | |
*** meganw has quit IRC | 16:03 | |
* flaper87 wishes what kgriffs whishes | 16:03 | |
kgriffs | anybody handy with bash scripting who could write that for me? | 16:03 |
kgriffs | (hint hint) | 16:03 |
kgriffs | flaper87: do you thing an image pastebin would best be integrated with paste directly, or standalone? | 16:04 |
* kgriffs is going to make that for hackday next friday) | 16:04 | |
kgriffs | http://paste.openstack.org/ | 16:04 |
kgriffs | I think I need to find a way to run tox from sublime. If I'm likely it already is smart enough to understand tracebacks | 16:05 |
flaper87 | integrated means we'll have a single url for both text and images | 16:05 |
flaper87 | which sounds good | 16:05 |
flaper87 | :) | 16:06 |
flaper87 | I think you can extend logedit | 16:06 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Remove util packages https://review.openstack.org/44476 | 16:07 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Use oslo.config for functional tests https://review.openstack.org/44477 | 16:07 |
kgriffs | cool | 16:08 |
kgriffs | http://paste.openstack.org/about/ | 16:08 |
kgriffs | http://www.pocoo.org/projects/lodgeit/ | 16:09 |
flaper87 | cppcabrera: ha, you catch that import :P | 16:12 |
flaper87 | so, that's a temporary hack | 16:12 |
flaper87 | thing is that we need to import wsgi to register wsgi configs (and validation configs) | 16:13 |
cppcabrera | ahhh :) | 16:13 |
flaper87 | I should've added a comment | 16:13 |
* cppcabrera reviews 80% thoroughly | 16:13 | |
flaper87 | if we let those patches land, I'll start working on the integration with tox right away | 16:14 |
flaper87 | kgriffs: can you review those patches ? | 16:15 |
kgriffs | https://groups.google.com/forum/#!topic/pocoo-libs/0WvXXwAjnpc | 16:17 |
kgriffs | flaper87: will do, but it may take me an hour or two to get to that | 16:17 |
flaper87 | kgriffs: kk, thanks!! | 16:17 |
flaper87 | kgriffs: +1 for the email | 16:17 |
flaper87 | malini: patches are up there | 16:18 |
flaper87 | :D | 16:18 |
flaper87 | malini: you must review them | 16:18 |
malini | flaper87: wooot!! will get to it now | 16:18 |
* flaper87 moved his hand like a Jedi while writing his last message | 16:18 | |
flaper87 | brb guys | 16:19 |
cppcabrera | lol | 16:20 |
* kgriffs wants pianobar for radio paradise | 16:22 | |
* kgriffs would call it paradisefound | 16:23 | |
kgriffs | oooh | 16:27 |
kgriffs | http://wesbos.com/sublime-text-build-scripts/ | 16:27 |
kgriffs | my wish has been granted. This will be easy | 16:27 |
cppcabrera | woot | 16:28 |
kgriffs | http://docs.sublimetext.info/en/latest/file_processing/build_systems.html | 16:30 |
* kgriffs is sooo off-topic today | 16:30 | |
* kgriffs needs more sleep and less caffeine | 16:30 | |
cppcabrera | Me, too, kgriffs. I'm running on 2 hours worth of sleep today. :P | 16:31 |
kgriffs | yay, got a +2 on https://review.openstack.org/#/c/44363/ | 17:20 |
cppcabrera | sweet - you'll have that merged in no time.time()! | 17:21 |
malini | https://bugs.launchpad.net/marconi/+bug/1219019 | 17:24 |
cppcabrera | Fun Python fact of the day - expanding generators works like expanding lists, e.g. | 17:26 |
cppcabrera | x = [i for i in range(100)]; print(*x) | 17:26 |
malini | flaper87: will oslo.cfg use the local functional-tests.conf if its there auto-magically ? | 17:27 |
cppcabrera | x =([i for i in range(100)); print(*x) | 17:27 |
cppcabrera | x = (i for i in range(100)); print(*x) | 17:27 |
cppcabrera | Both work | 17:27 |
cppcabrera | tested on py2.7 and py3.3 | 17:27 |
*** key4 has quit IRC | 17:33 | |
*** key4 has joined #openstack-marconi | 17:33 | |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Remove util packages https://review.openstack.org/44476 | 18:15 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Use oslo.config for functional tests https://review.openstack.org/44477 | 18:15 |
flaper87 | cppcabrera: updated | 18:15 |
flaper87 | :) | 18:15 |
flaper87 | malini: correct | 18:15 |
flaper87 | malini: well, not magically, we're actually telling it where it is | 18:15 |
flaper87 | the user is expected to specify where the configs for tests are | 18:16 |
flaper87 | I'll document that better when the integration with tox is completed | 18:16 |
flaper87 | malini: commented here https://review.openstack.org/#/c/44475/ | 18:18 |
*** ametts has quit IRC | 18:18 | |
* flaper87 doesn't understand what weird formatting gerrit uses for comments | 18:19 | |
flaper87 | brb.... again! | 18:19 |
malini | flaper87: tht sounds good to me.. | 18:28 |
malini | Just a couple of minor stuff https://review.openstack.org/#/c/44475/ | 18:28 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Pull actual tests out of marconi/tests https://review.openstack.org/44475 | 18:33 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Remove util packages https://review.openstack.org/44476 | 18:33 |
openstackgerrit | Flavio Percoco proposed a change to stackforge/marconi: Use oslo.config for functional tests https://review.openstack.org/44477 | 18:33 |
flaper87 | malini: addressed them, thanks a lot | 18:34 |
cppcabrera | +1 malini - good reviews :) | 18:36 |
cppcabrera | I'm too sleep-deprived today to give solid reviews. :P | 18:36 |
malini | flaper87: review both..Thanks a lot!!!!! | 18:37 |
malini | I would give you a real poptart if you were here :) | 18:38 |
flaper87 | malini: you're missing this one https://review.openstack.org/#/c/44476/ | 18:38 |
flaper87 | :D | 18:38 |
malini | done! | 18:39 |
flaper87 | malini: AWESOME! Thanks | 18:39 |
flaper87 | so, next step is making everything run under tox | 18:40 |
malini | YES!! | 18:40 |
cppcabrera | yaaaay | 18:40 |
flaper87 | but, before that, we need to execute marconi from within our functional tests | 18:40 |
cppcabrera | flaper87: setUpModule? | 18:41 |
flaper87 | cppcabrera: mmh, I think it has to be either setUpClass or setUp, most likely a mix of both | 18:42 |
cppcabrera | setUpClass sounds appropriate to me. | 18:42 |
malini | I was looking at the glance tests you pointed to a while back | 18:42 |
malini | those were pretty cool :) | 18:43 |
flaper87 | yeah :D | 18:43 |
malini | you is flaper87 :D | 18:43 |
flaper87 | those are pretty cool, I'd like to do something along those lines | 18:43 |
flaper87 | but there are a couple of things I'd like to change to keep it fast and re-use resources when possible | 18:43 |
cppcabrera | Just one more component left to the redis storage driver - claims. :) | 18:56 |
flaper87 | cppcabrera: w00000000t | 19:06 |
*** JRow has quit IRC | 19:18 | |
oz_akan_ | kgriffs: has your patch been merged to master/ | 19:37 |
kgriffs | I think so | 19:38 |
oz_akan_ | https://github.com/stackforge/marconi/commits/master | 19:38 |
oz_akan_ | I can't see | 19:38 |
kgriffs | hmm | 19:38 |
kgriffs | nevermind, need to fix some stuff | 19:39 |
kgriffs | https://review.openstack.org/#/c/44340/ | 19:39 |
oz_akan_ | ok | 19:39 |
*** openstack has joined #openstack-marconi | 19:43 | |
kgriffs | flaper87: responded to you comments on the perf patch | 19:46 |
openstackgerrit | Kurt Griffiths proposed a change to stackforge/marconi: fix: Claim can return 404 https://review.openstack.org/44536 | 19:53 |
openstackgerrit | Kurt Griffiths proposed a change to stackforge/marconi: fix: Claim can return 404 https://review.openstack.org/44536 | 20:33 |
*** malini is now known as malini_afk | 20:37 | |
kgriffs | no meeting on Monday | 20:38 |
flaper87 | kgriffs: kk, I'll take a look in a bit | 20:47 |
flaper87 | kgriffs: mmh, when can we discuss the endpoints thing? | 20:47 |
flaper87 | we need to do that before the TC meeting | 20:48 |
kgriffs | flaper87: yes, we need to do that | 20:48 |
kgriffs | tuesday earlier in the day? | 20:48 |
flaper87 | kgriffs: +1 | 20:49 |
kgriffs | most people won't be around monday (it's a holiday in the US) | 20:49 |
flaper87 | ah, didn't know that | 20:49 |
flaper87 | yeah, sure | 20:49 |
flaper87 | Tuesday earlier in the day sounds good | 20:49 |
kgriffs | kk, just ping me tues | 20:49 |
*** fifieldt has joined #openstack-marconi | 21:12 | |
*** amitgandhi has quit IRC | 21:16 | |
*** openstackgerrit has quit IRC | 21:25 | |
*** openstackgerrit has joined #openstack-marconi | 21:25 | |
*** oz_akan_ has quit IRC | 21:28 | |
*** cppcabrera has quit IRC | 21:29 | |
*** ayoung has quit IRC | 22:08 | |
openstackgerrit | Kurt Griffiths proposed a change to stackforge/marconi: fix: find_one() running slow (MongoDB) https://review.openstack.org/44560 | 22:14 |
*** _alexr_ has quit IRC | 22:42 | |
*** kgriffs is now known as kgriffs_afk | 22:45 | |
*** kgriffs_afk is now known as kgriffs | 23:14 | |
*** flaper87 is now known as flaper87|afk | 23:22 | |
*** kgriffs is now known as kgriffs_afk | 23:28 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!