| *** openstackgerrit has quit IRC | 00:19 | |
| *** openstackgerrit has joined #openstack-marconi | 00:21 | |
| *** openstackgerrit has quit IRC | 00:34 | |
| *** openstackgerrit has joined #openstack-marconi | 00:35 | |
| *** openstackgerrit has quit IRC | 00:49 | |
| *** openstackgerrit has joined #openstack-marconi | 00:51 | |
| *** vkmc has joined #openstack-marconi | 00:54 | |
| *** vkmc has quit IRC | 00:54 | |
| *** haomaiwang has joined #openstack-marconi | 01:30 | |
| *** haomaiwang has quit IRC | 01:34 | |
| *** prashanthr_ has joined #openstack-marconi | 01:59 | |
| *** peopleme1ge has joined #openstack-marconi | 02:56 | |
| *** nosnos_ has joined #openstack-marconi | 02:57 | |
| *** rossk_ has joined #openstack-marconi | 02:57 | |
| *** ametts_ has joined #openstack-marconi | 02:57 | |
| *** peoplemerge has quit IRC | 03:03 | |
| *** pquerna has quit IRC | 03:03 | |
| *** nosnos has quit IRC | 03:03 | |
| *** russell_h has quit IRC | 03:03 | |
| *** ametts has quit IRC | 03:03 | |
| *** rossk has quit IRC | 03:03 | |
| *** russell_h has joined #openstack-marconi | 03:03 | |
| *** russell_h has quit IRC | 03:03 | |
| *** russell_h has joined #openstack-marconi | 03:04 | |
| *** russell_h has quit IRC | 03:05 | |
| *** russell_h has joined #openstack-marconi | 03:05 | |
| *** pquerna has joined #openstack-marconi | 03:09 | |
| *** pquerna has joined #openstack-marconi | 03:09 | |
| *** malini_afk is now known as malini | 03:15 | |
| *** boris-42 has quit IRC | 03:23 | |
| *** boris-42 has joined #openstack-marconi | 03:29 | |
| *** malini is now known as malini_afk | 03:39 | |
| *** nosnos_ has quit IRC | 03:52 | |
| *** haomaiwang has joined #openstack-marconi | 04:35 | |
| *** nosnos has joined #openstack-marconi | 04:35 | |
| *** haomaiwang has quit IRC | 04:40 | |
| *** prashanthr_ has quit IRC | 04:46 | |
| *** prashanthr_ has joined #openstack-marconi | 04:47 | |
| *** cpallares has quit IRC | 04:51 | |
| *** reed has quit IRC | 04:54 | |
| *** igor_ has joined #openstack-marconi | 04:59 | |
| *** igor__ has quit IRC | 05:02 | |
| *** mkoderer has joined #openstack-marconi | 05:54 | |
| *** prashanthr_ has quit IRC | 06:02 | |
| *** prashanthr_ has joined #openstack-marconi | 06:04 | |
| *** AAzza has joined #openstack-marconi | 06:34 | |
| *** shivamshukla has joined #openstack-marconi | 07:01 | |
| *** rossk_ has quit IRC | 07:12 | |
| *** flwang has quit IRC | 07:31 | |
| *** flwang has joined #openstack-marconi | 08:16 | |
| *** jamie_h has joined #openstack-marconi | 08:26 | |
| *** ykaplan has joined #openstack-marconi | 08:26 | |
| *** haomaiwa_ has joined #openstack-marconi | 08:42 | |
| *** flwang has left #openstack-marconi | 08:43 | |
| *** haomaiwa_ has quit IRC | 08:47 | |
| *** ashishsnigam has joined #openstack-marconi | 08:51 | |
| *** prashanthr_ has quit IRC | 09:37 | |
| *** AAzza has quit IRC | 09:38 | |
| *** haomaiwang has joined #openstack-marconi | 10:45 | |
| *** haomaiwang has quit IRC | 11:01 | |
| *** flaper87|afk is now known as flaper87 | 11:05 | |
| *** flaper87 is now known as flaper87|afk | 11:27 | |
| *** ashishsnigam has quit IRC | 11:30 | |
| *** tedross has joined #openstack-marconi | 11:31 | |
| shivamshukla | Hi All | 11:47 |
|---|---|---|
| *** Gammo has quit IRC | 11:49 | |
| *** AAzza has joined #openstack-marconi | 11:49 | |
| *** mwagner_lap has quit IRC | 11:54 | |
| *** AAzza has left #openstack-marconi | 11:57 | |
| *** oz_akan_ has joined #openstack-marconi | 11:59 | |
| *** _rohitm has joined #openstack-marconi | 12:05 | |
| _rohitm | hi all | 12:05 |
| shivamshukla | Hi _rohitm | 12:05 |
| _rohitm | hey man..wassup | 12:06 |
| shivamshukla | i m kinda new to marconi can you help me build it | 12:06 |
| _rohitm | oh....i am also new and wanted some pointers | 12:07 |
| shivamshukla | :-) | 12:07 |
| shivamshukla | found the starting point here https://github.com/openstack/marconi | 12:09 |
| shivamshukla | and here | 12:09 |
| shivamshukla | https://wiki.openstack.org/wiki/Marconi | 12:09 |
| *** _rohitm has quit IRC | 12:14 | |
| *** oz_akan_ has quit IRC | 12:17 | |
| *** oz_akan_ has joined #openstack-marconi | 12:17 | |
| *** flaper87|afk is now known as flaper87 | 12:18 | |
| flaper87 | WHAT'S UP PEOPLE!?!?!??!?!! | 12:18 |
| flaper87 | shivamshukla: you | 12:18 |
| flaper87 | shivamshukla: you're very welcome to this channel | 12:18 |
| flaper87 | hope you'll find marconi amazingly fun to work with | 12:18 |
| *** oz_akan_ has quit IRC | 12:23 | |
| *** malini_afk is now known as malini | 12:26 | |
| *** nosnos has quit IRC | 12:31 | |
| flaper87 | kgriffs: yo, it's too early for you to be around. What happened? | 12:34 |
| flaper87 | :D | 12:34 |
| flaper87 | malini: hey :) | 12:34 |
| malini | hello!! | 12:35 |
| flaper87 | malini: hope you're doing great :) | 12:35 |
| malini | yes!!! except check-tempest-dsvm-marconi is failing in one of the jobs, & it was just made voting y'day :-# | 12:36 |
| flaper87 | holy crap | 12:36 |
| flaper87 | I actually +1'd that patch | 12:37 |
| flaper87 | is it because we reverted the metadata thing? | 12:37 |
| flaper87 | I guess no. tempest should hit v1.0 | 12:37 |
| malini | no.. | 12:38 |
| malini | '/opt/stack/new/devstack/extras.d/70-marconi.sh: line 17: create_marconi_accounts: command not found' | 12:38 |
| malini | tht is weird.. | 12:38 |
| malini | since we didnt change anything around tht | 12:38 |
| flaper87 | that is weird indeed | 12:38 |
| malini | the pnly recent change is https://github.com/openstack-dev/devstack/commit/b0c3859c30632e24b1da6c65645cb7fd735791a1 | 12:38 |
| flaper87 | also, the gate passed when the patch was approved | 12:38 |
| malini | only* | 12:38 |
| flaper87 | was another patch approved after ours ? | 12:38 |
| malini | nothing in marconi | 12:39 |
| malini | let me check all of devstack | 12:39 |
| flaper87 | I meant in devstack | 12:39 |
| malini | I meant lib/marconi | 12:39 |
| malini | nothing tht shud impact us | 12:39 |
| flaper87 | malini: did you try running it in a brand new box? | 12:41 |
| malini | was just about to do tht | 12:42 |
| *** sriram has joined #openstack-marconi | 12:54 | |
| *** sriram has quit IRC | 12:55 | |
| *** sriram has joined #openstack-marconi | 12:55 | |
| *** abettadapur has joined #openstack-marconi | 12:58 | |
| *** jchai has joined #openstack-marconi | 13:00 | |
| *** prashanthr_ has joined #openstack-marconi | 13:19 | |
| *** mpanetta has joined #openstack-marconi | 13:27 | |
| *** alcabrera|afk is now known as alcabrera | 13:47 | |
| alcabrera | good morning! :) | 13:47 |
| flaper87 | alcabrera: gooooood morning | 13:47 |
| flaper87 | I see that atlanta just woke up | 13:48 |
| flaper87 | I've an idea. Lets shake Texas and scare the hell out of the folks based there | 13:48 |
| flaper87 | please, please, please, please | 13:48 |
| alcabrera | oh? | 13:48 |
| alcabrera | how? | 13:48 |
| flaper87 | alcabrera: you're suppose to help me with that | 13:48 |
| flaper87 | I can't do everything | 13:49 |
| flaper87 | come one | 13:49 |
| flaper87 | on* | 13:49 |
| alcabrera | scare them to what ends? >.> | 13:49 |
| * alcabrera does not sit well with this idea | 13:49 | |
| *** balajiiyer has joined #openstack-marconi | 13:56 | |
| flaper87 | alcabrera: :( | 13:56 |
| flaper87 | alcabrera: just to wake them up | 13:56 |
| *** balajiiyer has quit IRC | 13:56 | |
| alcabrera | ahhh | 13:56 |
| *** balajiiyer has joined #openstack-marconi | 13:56 | |
| alcabrera | I don't do well when I'm woken up by surprise. :P | 13:57 |
| prashanthr_ | alcabrera and flaper87 : Good morningggg :) | 13:58 |
| flaper87 | alcabrera: that's why you should always wake up before everyone else :P | 13:58 |
| flaper87 | prashanthr_: hey :) | 13:58 |
| * mpanetta is still sleeping :P | 13:59 | |
| sriram | wake up mpanetta! :P | 14:00 |
| mpanetta | No :P | 14:00 |
| alcabrera | lol | 14:01 |
| alcabrera | prashanthr_: hey! :) | 14:01 |
| * flaper87 shakes mpanetta | 14:01 | |
| flaper87 | mpanetta: scared? Woken up? | 14:01 |
| * mpanetta flops like a ragdoll :P | 14:02 | |
| *** haomaiwang has joined #openstack-marconi | 14:02 | |
| mpanetta | Wha? | 14:02 |
| mpanetta | :P | 14:02 |
| *** Obulpathi has joined #openstack-marconi | 14:03 | |
| *** Obulpathi has quit IRC | 14:05 | |
| *** Obulpathi has joined #openstack-marconi | 14:05 | |
| *** jamie_h has quit IRC | 14:11 | |
| *** jamie_h has joined #openstack-marconi | 14:12 | |
| *** cpallares has joined #openstack-marconi | 14:13 | |
| *** AAzza has joined #openstack-marconi | 14:14 | |
| *** oz_akan_ has joined #openstack-marconi | 14:19 | |
| *** amalagon has quit IRC | 14:19 | |
| *** whenry has joined #openstack-marconi | 14:24 | |
| mpanetta | Yeah, I am definitely still asleep... I just went to look for my bananna, that I already ate... | 14:31 |
| alcabrera | oh no, banana's gone. :( | 14:31 |
| *** haomaiwang has quit IRC | 14:34 | |
| *** jchai is now known as jchai_afk | 14:40 | |
| alcabrera | prashanthr_: how goes the redis effort? :) | 14:42 |
| prashanthr_ | alcabrera: Redis is going awesome :) completed the basic version of queue management | 14:42 |
| prashanthr_ | :) | 14:42 |
| alcabrera | nice! | 14:42 |
| prashanthr_ | now able to create , delete queues | 14:43 |
| flaper87 | prashanthr_: do you know if the redis client library is Py3K compatible? | 14:43 |
| prashanthr_ | and also manage queue metadata :) | 14:43 |
| flaper87 | prashanthr_: you're fast | 14:43 |
| flaper87 | :S | 14:43 |
| flaper87 | is the redis work based on alcabrera's previous work? | 14:43 |
| alcabrera | flaper87: redis-client is py3 compatible, according to https://pypi.python.org/pypi/redis/2.9.1 | 14:44 |
| flaper87 | oh cool | 14:44 |
| * flaper87 is too lazy to search on pypi | 14:44 | |
| flaper87 | :D | 14:44 |
| prashanthr_ | flaper87 : :) ha ha it's still the basic version. | 14:44 |
| flaper87 | prashanthr_: may I ask how you created the package? Did you copy mongodb's ? | 14:45 |
| flaper87 | peopleme1ge: there? | 14:45 |
| prashanthr_ | flaper87: Nope i just copied the base classes initially. | 14:46 |
| prashanthr_ | now implementing the methods one-by-one | 14:46 |
| prashanthr_ | :) | 14:46 |
| prashanthr_ | alcabrera: I had some questions. do we have a meeting today ? | 14:48 |
| alcabrera | prashanthr_: yup! | 14:48 |
| alcabrera | we'll get started in 10m | 14:48 |
| prashanthr_ | alcabrera: Awesome :) sure :) | 14:48 |
| alcabrera | AAzza: thanks for filing the py3 bug about the requirements files. :) | 14:48 |
| *** oz_akan_ has quit IRC | 14:50 | |
| *** oz_akan_ has joined #openstack-marconi | 14:51 | |
| alcabrera | alright~ | 15:01 |
| alcabrera | before I get distracted | 15:01 |
| alcabrera | prashanthr_, AAzza: do you all have 20-30m to meet and talk about how project work is going? | 15:02 |
| prashanthr_ | alcabrera: Sure. | 15:02 |
| AAzza | yeap, of course | 15:03 |
| alcabrera | cool | 15:03 |
| alcabrera | let's get started | 15:03 |
| alcabrera | AAzza: could you share what the latest is on marconi-py3? | 15:03 |
| AAzza | alcabrera: not so much actually for now, first have configured testing environment for myself with 4 versions of python) | 15:05 |
| alcabrera | nice! which versions, out of curiosity? | 15:05 |
| AAzza | alcabrera: py26, py27, py33 and py34 | 15:05 |
| alcabrera | could you also install pypy-2.3, AAzza? | 15:06 |
| AAzza | alcabrera: yes, could try, good idea forgot about it | 15:06 |
| alcabrera | thanks! | 15:06 |
| alcabrera | we want to keep our pypy support top notch | 15:06 |
| alcabrera | AAzza: I also noticed you submitted this patch: https://review.openstack.org/#/c/94642/ | 15:07 |
| *** igor_ has quit IRC | 15:07 | |
| AAzza | alcabrera: yes, patch with requirements | 15:07 |
| *** igor has joined #openstack-marconi | 15:07 | |
| AAzza | alcabrera: if it will be merged, then we can see that my patches actually reduce number of failing tests | 15:08 |
| alcabrera | I'll work with kgriffs to see that move forward | 15:08 |
| AAzza | alcabrera: plan to start bugs shown by tests. will do investiagations for now | 15:08 |
| AAzza | alcabrera: i suppose have a problem that unit tests are not running under py33, not failing just not running. kinda strange | 15:09 |
| alcabrera | hmm | 15:09 |
| alcabrera | oh yeah | 15:09 |
| alcabrera | I remember that | 15:09 |
| alcabrera | they took *really* long to run on my machine | 15:10 |
| AAzza | alcabrera: not that problem | 15:10 |
| alcabrera | AAzza: I'll look into it today, and get back to you with how long they take to run from a fresh environment. | 15:10 |
| AAzza | alcabrera: it works for me now, but only functional | 15:10 |
| AAzza | alcabrera: looks like unit tests are just skiped) but really not sure, need to dig into it | 15:11 |
| alcabrera | let's investigate that | 15:11 |
| alcabrera | can you sync up with me tomorrow for about 5m around the same time AAzza? | 15:11 |
| *** igor has quit IRC | 15:12 | |
| AAzza | alcabrera: tomorrow, about same time? yes sure | 15:12 |
| alcabrera | thank you. :) | 15:12 |
| alcabrera | AAzza: anything else you'd like to discuss before we hear prashanthr_'s updates? | 15:12 |
| AAzza | alcabrera: hmmm, prorably tomorrow, after investigation :) so can switch to prashanthr_ | 15:13 |
| alcabrera | alright | 15:14 |
| alcabrera | prashanthr_: how goes marconi-redis? :) | 15:14 |
| prashanthr_ | alcabrera and AAzza: py3k compatibility is a constant exercise i guess :) | 15:14 |
| alcabrera | oh yes, definitely! | 15:14 |
| prashanthr_ | so many new stuffs in py3 | 15:14 |
| prashanthr_ | marconi-redis is now accepting new requests for queues | 15:15 |
| prashanthr_ | i have tested with wsgi v1.0 | 15:15 |
| prashanthr_ | today | 15:15 |
| alcabrera | wsgi 1.0? | 15:16 |
| alcabrera | could you elaborate, prashanthr_? | 15:16 |
| prashanthr_ | today i implemented the methods for QueueController for redis | 15:16 |
| prashanthr_ | so now i am able to create / delete queues | 15:17 |
| prashanthr_ | and also set and get metadata related to queues | 15:17 |
| prashanthr_ | then i tested it with marconi API v1.0 | 15:17 |
| prashanthr_ | it works fine | 15:17 |
| alcabrera | ahhh, I see | 15:17 |
| alcabrera | wsgi 1.0 -> marconi API 1.0 | 15:18 |
| alcabrera | I got confused, since the WSGI specification in the python ecosystem is pep 333 and pep 3333 | 15:18 |
| alcabrera | wonderful | 15:18 |
| alcabrera | it sounds like things are going well! | 15:18 |
| prashanthr_ | alcabrera : yes. yeah me also was inititally confused because they are in wsgi/v1.0 folders :( | 15:18 |
| alcabrera | I'm taking a quick look at your repo at the moment | 15:18 |
| prashanthr_ | sure. I have some doubts will ask them after that. | 15:19 |
| AAzza | prashanthr_: just curious, how do you represent/store queue in redis?) | 15:19 |
| alcabrera | I need to check with flaper87 on this, but -- will we be bringing in redis support as a core storage driver for marconi? | 15:19 |
| prashanthr_ | AAzza: i represent the queue information as a Redis Hash | 15:20 |
| flaper87 | alcabrera: yup | 15:20 |
| alcabrera | cool | 15:20 |
| flaper87 | as-in, it'll land in the code base and we'll guarantee maintenance for it | 15:20 |
| alcabrera | alright, your current approach and repo setup looks good prashanthr_ :) | 15:20 |
| alcabrera | so - another thought just occurred to me | 15:20 |
| alcabrera | flaper87: should we be using the gerrit patchset approach to developing redis storage, rather than GH commits? | 15:21 |
| prashanthr_ | alcabrera: thank you :). | 15:21 |
| flaper87 | oh yeah, that'd be the recommended way to do it | 15:21 |
| alcabrera | so we need to make a change there | 15:21 |
| flaper87 | that'll invite the community to chime in and it'll give the driver more visibility | 15:22 |
| alcabrera | prashanthr_: are you familiar with the openstack gerrit patch workflow? :) | 15:22 |
| flaper87 | I'd recommend using the same approach we used for sqlalchemy | 15:22 |
| alcabrera | flaper87: agreed | 15:22 |
| prashanthr_ | alcabrera: Yes. I have submitted 2 patches already. | 15:22 |
| flaper87 | 1. setup the driver base code and test cases (no logic) | 15:22 |
| flaper87 | 2. Start adding some logic for queues | 15:22 |
| alcabrera | prashanthr_: cool! Could you submit a redis storage starter patch sometime soon? | 15:22 |
| flaper87 | 3. Add logic required for messages (some parts need the claim code to be ready, those can be put on-hold) | 15:23 |
| flaper87 | 4. add logic for claims | 15:23 |
| flaper87 | 5. Add the remaining parts in the message controller | 15:23 |
| flaper87 | 6. Add stats in the queue controller | 15:23 |
| flaper87 | 7. add support for redis pools | 15:23 |
| flaper87 | pools = partitions = sharding (this is all marconi related) | 15:23 |
| prashanthr_ | Sure :) Will start with it tomorrow. so how should i go about creating the bugs for the workflow ? | 15:24 |
| prashanthr_ | Will it be on similar lines as the points mentioned by flaper87 ? | 15:24 |
| alcabrera | prashanthr_: I'd like for you to submit patches referencing a redis-storage blueprint | 15:24 |
| alcabrera | I need to find that and make sure you're assigned to it | 15:24 |
| alcabrera | and flaper87's implementation strategy sounds perfect | 15:25 |
| alcabrera | ah, yes | 15:25 |
| alcabrera | this thing: https://blueprints.launchpad.net/marconi/+spec/redis-storage-driver prashanthr_ | 15:25 |
| prashanthr_ | alcabrera: Ohh i did not know that i could submit patches related to bp's. Yeah kgriffs assigned it to me. | 15:25 |
| alcabrera | which you're already assigned to. :D | 15:25 |
| alcabrera | so to address a blueprint in a patch | 15:25 |
| alcabrera | include the following comment in your patch | 15:25 |
| alcabrera | #Partially-Implements bp/redis-storage-driver | 15:26 |
| alcabrera | or if it finishees support | 15:26 |
| alcabrera | #Implements bp/redis-storage-driver | 15:26 |
| alcabrera | flaper87: does that look correct? | 15:26 |
| alcabrera | (by comment, I mean: part of your git commit message) | 15:26 |
| prashanthr_ | alcabrera: Sure. I will do that. | 15:27 |
| alcabrera | prashanthr_: https://wiki.openstack.org/wiki/Sahara/GitCommits (Ctrl+F Partially implements) | 15:27 |
| alcabrera | I got the syntax wrong. >.> | 15:27 |
| alcabrera | prashanthr_: thank you! | 15:27 |
| flaper87 | Partially-implements blueprint: redis-storage-driver | 15:27 |
| prashanthr_ | alcabrera: I have some questions. Can I ask them now ? | 15:28 |
| flaper87 | the last patch should have a Implements blueprint: redis-storage-driver | 15:28 |
| *** igor_ has joined #openstack-marconi | 15:28 | |
| alcabrera | prashanthr_: yup, go ahead. :) | 15:28 |
| prashanthr_ | the marker for listing of queues has to be the name of the last queue which has been returned to the client. | 15:29 |
| prashanthr_ | Am i right ? | 15:29 |
| alcabrera | hmmm | 15:30 |
| * alcabrera thinks | 15:30 | |
| alcabrera | yes | 15:30 |
| alcabrera | so they can then pass in that marker on future queries | 15:30 |
| alcabrera | to paginate from the right place | 15:30 |
| prashanthr_ | alcabrera: I have a small glitch related to Redis here. I am unable to use any redis datastructures to implement this. | 15:30 |
| prashanthr_ | I can do it with lists but the operation will be very slow | 15:31 |
| alcabrera | IIRC, I had to use zsets, prashanthr_ | 15:31 |
| alcabrera | they provide lexicographical ordering | 15:31 |
| alcabrera | prashanthr_: https://github.com/cabrera/marconi-redis/blob/master/marconi_redis/queues/storage/redis/queues.py#L57 (example) | 15:31 |
| prashanthr_ | alcabrera: Sure. I will check it. | 15:32 |
| alcabrera | cool | 15:32 |
| alcabrera | yeah, that tripped me up to when I tinkered with a redis driver. :) | 15:32 |
| alcabrera | I hope my efforts will help you! | 15:32 |
| *** igor_ has quit IRC | 15:32 | |
| alcabrera | *to -> too | 15:32 |
| prashanthr_ | alcabrera: this is an invaluable reference for me :) | 15:32 |
| prashanthr_ | ahh there is msgpack here as well :) | 15:33 |
| alcabrera | yup! :D | 15:33 |
| alcabrera | alright | 15:33 |
| alcabrera | do you have other concerns, prashanthr_? | 15:33 |
| prashanthr_ | alcabrera: I do have 2 more questions. Am i taking too much time ? | 15:34 |
| alcabrera | not at all -- go ahead. :) | 15:34 |
| prashanthr_ | alcabrera: this is a stupid question sorry. Actually when seeing the license for the files there were 3-4 types of them | 15:34 |
| prashanthr_ | from Rackspace/RedHat/Apache etc. | 15:34 |
| prashanthr_ | what should i use ? | 15:35 |
| alcabrera | no question is a stupid question. :) | 15:35 |
| alcabrera | as for the license header | 15:35 |
| alcabrera | I'm not entirely sure | 15:35 |
| alcabrera | but | 15:35 |
| alcabrera | I'm inclined to believe that Openstack Foundation is probably the way to go | 15:35 |
| alcabrera | flaper87: what do you think? | 15:35 |
| malini | prashanthr_: I have seen somebody use their personal name in one of the projects | 15:35 |
| malini | let me chk if I can use tht, since you are not affiliated to any company | 15:36 |
| malini | find* | 15:36 |
| alcabrera | malini: that might work, too! | 15:36 |
| alcabrera | malini: thank you for chiming in. :) | 15:36 |
| * flaper87 reads backlog | 15:36 | |
| flaper87 | the important piece is the license not the copyright | 15:36 |
| flaper87 | so, as long as the license is there, you can omit the copyright line | 15:36 |
| flaper87 | if you want to add it, you can add your name there | 15:37 |
| flaper87 | or the foundation | 15:37 |
| prashanthr_ | flaper87 and malini : thank you :) | 15:37 |
| flaper87 | and by important I meant, requied | 15:37 |
| flaper87 | required :) | 15:37 |
| alcabrera | I'd like to emphasize that there's no stupid questions, prashanthr_, AAzza. Ask anything, and we'll take it seriously. :D | 15:37 |
| prashanthr_ | alcabrera: ha ha sure :) | 15:37 |
| malini | prashanthr_: See example here https://github.com/stackforge/solum/blob/master/solum/tests/api/base.py | 15:38 |
| flaper87 | I'd like to emphasize that I'm full of bad jokes | 15:38 |
| flaper87 | :D | 15:38 |
| prashanthr_ | flaper87 :) | 15:38 |
| *** igor_ has joined #openstack-marconi | 15:38 | |
| * alcabrera verifies that flaper87 is full of bad jokes | 15:38 | |
| alcabrera | <3 | 15:38 |
| flaper87 | :P | 15:38 |
| alcabrera | you said you had one more question, prashanthr_? | 15:38 |
| *** jamie_h has quit IRC | 15:38 | |
| prashanthr_ | yes last question : Some of my code kinda of violates DRY in the utils part | 15:38 |
| prashanthr_ | is that f9 ? | 15:39 |
| alcabrera | f9 -> fine? | 15:39 |
| prashanthr_ | like scoped_project_queue and the reconnection decorators | 15:39 |
| malini | f9 sounds cool :) | 15:39 |
| prashanthr_ | alcabrera: ha ha yeah. watsapp lingo :) got into me now. | 15:39 |
| alcabrera | heh. I've never seen it, but it makes sense. :) | 15:39 |
| alcabrera | interesting | 15:39 |
| alcabrera | but yes | 15:40 |
| alcabrera | wrt DRYness | 15:40 |
| *** igor__ has joined #openstack-marconi | 15:40 | |
| alcabrera | I think for starters, we can try to be DRY as we go | 15:40 |
| alcabrera | and if it's something that's far too duplicated, it'll be brought up in code review | 15:40 |
| alcabrera | so | 15:40 |
| alcabrera | case by case | 15:40 |
| prashanthr_ | alcabrera: Sure. I have made a small note in the code as well. | 15:41 |
| alcabrera | works for me. Just submit a patch and we'll give it a look over. :) | 15:41 |
| *** flaper87 is now known as flaper87|afk | 15:41 | |
| alcabrera | with that -- | 15:41 |
| alcabrera | any closing thoughts/questions/opinions AAzza, prashanthr_? | 15:42 |
| *** cpallares has quit IRC | 15:42 | |
| prashanthr_ | alcabrera: Sure. will do it. | 15:42 |
| AAzza | alcabrera: no, everything is clear;) except 5 version of python on one system is not what you want from life) | 15:43 |
| prashanthr_ | alcabrera: None from my side :). crystal clear for today :) | 15:43 |
| prashanthr_ | AAzza : ha ha :) | 15:43 |
| *** igor_ has quit IRC | 15:43 | |
| *** jamie_h has joined #openstack-marconi | 15:43 | |
| alcabrera | AAzza: haha, so true | 15:43 |
| alcabrera | hurray! | 15:43 |
| alcabrera | with that, we close our first GSoC/OPW meeting | 15:43 |
| alcabrera | thanks all | 15:43 |
| prashanthr_ | awesome :) thank you !! | 15:44 |
| *** igor__ has quit IRC | 15:44 | |
| *** abettadapur has quit IRC | 15:46 | |
| *** vkmc has joined #openstack-marconi | 15:47 | |
| *** vkmc has quit IRC | 15:47 | |
| *** vkmc has joined #openstack-marconi | 15:47 | |
| *** reed has joined #openstack-marconi | 15:50 | |
| alcabrera | AAzza: it took 5m16.805s for all my unit tests to fail when running 'tox -e py33' w/ memcached removed from the reqs fail | 15:51 |
| alcabrera | reqs file | 15:51 |
| vkmc | howdie! :) | 15:52 |
| alcabrera | vkmc: heyyyy! | 15:52 |
| alcabrera | how are you? :) | 15:52 |
| vkmc | hi alcabrera! fine, and you? | 15:58 |
| vkmc | catching up with emails and stuff, just came from college | 15:58 |
| alcabrera | doing great, thanks! | 15:59 |
| alcabrera | vkmc: If you've some spare time, I'd love to catch up with you regarding amqp. :) | 15:59 |
| *** abettadapur has joined #openstack-marconi | 16:00 | |
| AAzza | alcabrera: you see if you filter tests with tox -e py33 -- tests.functional, that tests are running and failing, but with tox -- e py33 -- tests.unit no tests are running and task finishes sucessfully :-( the same commands for py27 works well | 16:01 |
| *** _rohitm has joined #openstack-marconi | 16:02 | |
| *** jchai_afk is now known as jchai | 16:04 | |
| alcabrera | AAzza: oh yeah! tests.unit does skip things, and I'm not sure why. L/ | 16:05 |
| alcabrera | :/ | 16:05 |
| AAzza | alcabrera: is searching now... | 16:08 |
| alcabrera | thanks! | 16:10 |
| vkmc | alcabrera, sure, I started reading some of the documentation but I still have some details to check out | 16:11 |
| alcabrera | I did some reading, too, vkmc. | 16:12 |
| alcabrera | the connection protocol looks a bit complex at the low level side. It mimicks TCP, as far as I can tell. :/ | 16:12 |
| alcabrera | I think we can sidestep most of that, though | 16:13 |
| alcabrera | since I'm sure a python-amqp client exists | 16:13 |
| vkmc | alcabrera, yeah it looks like TCP | 16:13 |
| vkmc | for the v1.0 version | 16:14 |
| alcabrera | I'm still unsure on whether we should work on a 1.0 or a 0.9.1 amqp storage layer. :/ | 16:15 |
| alcabrera | we'll need to figure this out at the next marconi meeting | 16:16 |
| alcabrera | vkmc: I'm adding an agenda item as "AMQP in Marconi: What Version(s) to Support" | 16:17 |
| alcabrera | do you mind if I list you as a co-contributor to this topic? | 16:18 |
| vkmc | please do! :) | 16:18 |
| alcabrera | cool! thanks. :) | 16:19 |
| alcabrera | phew | 16:19 |
| *** mwagner_lap has joined #openstack-marconi | 16:19 | |
| alcabrera | next meeting is going to be busy | 16:19 |
| alcabrera | https://wiki.openstack.org/wiki/Meetings/Marconi#Extra_Stuff | 16:20 |
| vkmc | flaper87 suggested me to focus on 1.0 only... thought it would be great if we can discuss if when we know the features better | 16:22 |
| alcabrera | hmmm | 16:23 |
| alcabrera | the main python client only supports amqp 0.9.1 | 16:23 |
| *** prashanthr_ has quit IRC | 16:23 | |
| alcabrera | this worries me a little | 16:23 |
| alcabrera | though I could be missing something | 16:23 |
| alcabrera | vkmc, flaper87|afk: let me know if you find a python client that supports amqp 1.0 | 16:24 |
| vkmc | I'm on it! | 16:24 |
| vkmc | (can't guarantee I'll find it though) | 16:24 |
| alcabrera | no worries if you can't. :) | 16:27 |
| alcabrera | it just means we have more information | 16:27 |
| *** jergerber has joined #openstack-marconi | 16:39 | |
| *** igor__ has joined #openstack-marconi | 16:40 | |
| AAzza | alcabrera: it looks like the problem is with testr itself, bug with filtering on py3, https://bugs.launchpad.net/testrepository/+bug/1317607 so actually when run all tests, all tests are run, just can't filter them for now:-( | 16:44 |
| alcabrera | sadness. :( | 16:44 |
| alcabrera | thanks for finding this, AAzza! | 16:44 |
| *** igor__ has quit IRC | 16:45 | |
| vkmc | brb | 16:55 |
| *** alcabrera is now known as alcabrera|afk | 17:00 | |
| *** balajiiyer has quit IRC | 17:07 | |
| *** ykaplan has quit IRC | 17:10 | |
| *** alcabrera|afk is now known as alcabrera | 17:36 | |
| *** _rohitm has quit IRC | 17:37 | |
| *** balajiiyer has joined #openstack-marconi | 17:41 | |
| *** igor_ has joined #openstack-marconi | 17:42 | |
| *** igor_ has quit IRC | 17:46 | |
| peopleme1ge | flaper87|afk: I'm back | 17:52 |
| *** peopleme1ge is now known as peoplemerge | 17:58 | |
| *** vkmc has quit IRC | 18:01 | |
| *** jamie_h has quit IRC | 18:12 | |
| *** vkmc has joined #openstack-marconi | 18:15 | |
| *** Obulpath_ has joined #openstack-marconi | 18:16 | |
| *** Obulpathi has quit IRC | 18:20 | |
| *** vkmc has quit IRC | 18:23 | |
| sriram | malini: https://blueprints.launchpad.net/marconi/+spec/decoupling-unit-tests we need this prioritized as well. | 18:32 |
| malini | done | 18:33 |
| *** Obulpath_ has quit IRC | 18:36 | |
| *** Obulpathi has joined #openstack-marconi | 18:37 | |
| *** igor_ has joined #openstack-marconi | 18:42 | |
| *** vkmc has joined #openstack-marconi | 18:45 | |
| *** igor_ has quit IRC | 18:47 | |
| *** vkmc has quit IRC | 19:23 | |
| *** vkmc has joined #openstack-marconi | 19:24 | |
| *** vkmc has quit IRC | 19:24 | |
| *** vkmc has joined #openstack-marconi | 19:24 | |
| *** flaper87|afk is now known as flaper87 | 19:42 | |
| *** igor_ has joined #openstack-marconi | 19:43 | |
| *** igor_ has quit IRC | 19:47 | |
| * flaper87 is back and says hi | 19:57 | |
| alcabrera | o/ | 19:57 |
| * flaper87 reads backlog | 19:58 | |
| flaper87 | I think we've pretty much decided to go with 1.0 | 19:58 |
| flaper87 | we can bring it up again in our next meeting but unless there's something critical that will change our minds, I think 1.0 is the way we'll go | 19:58 |
| vkmc | hi flaper87 o/ | 19:59 |
| flaper87 | vkmc: hey | 19:59 |
| flaper87 | vkmc: Have you started reading about amqp 1.0 ? | 19:59 |
| vkmc | I'm on it yeah, still have test it | 20:00 |
| flaper87 | as for the library, we'll use qpid-proton | 20:00 |
| flaper87 | it's a messaging library based on the amqp 1.0 standard | 20:00 |
| vkmc | cool! | 20:01 |
| vkmc | I was checking on pika, but it's AMQP 0.9 | 20:01 |
| alcabrera | https://pypi.python.org/pypi/qpid-python -- this one flaper87? | 20:01 |
| flaper87 | nope, 2 secs | 20:01 |
| flaper87 | The qpid family may be confusing | 20:02 |
| alcabrera | oh, wait | 20:02 |
| flaper87 | qpid-python should be the qpid library (0.9) | 20:02 |
| flaper87 | there's qpid-dispatch which is a message router | 20:02 |
| alcabrera | it's not on pypi yet it seems. >.> | 20:02 |
| flaper87 | then qpid-proton | 20:02 |
| flaper87 | :D | 20:02 |
| flaper87 | http://qpid.apache.org/proton/ | 20:02 |
| flaper87 | that one | 20:02 |
| flaper87 | it's weird, it should be there | 20:02 |
| flaper87 | I'll check on the guys behind it | 20:03 |
| tjanczuk_ | So... AMQP... ;) | 20:03 |
| tjanczuk_ | What is the rationale again for 1.0 vs 0.9? | 20:03 |
| alcabrera | I'm out for the day, all. :) | 20:05 |
| alcabrera | take care. o/ | 20:05 |
| flaper87 | cross-broker, single implementation, message oriented, support for peer-to-peer, easier to scale, support for federation and easier to put behind HA | 20:05 |
| flaper87 | alcabrera: thanks | 20:05 |
| flaper87 | take care | 20:05 |
| *** alcabrera is now known as alcabrera|afk | 20:06 | |
| vkmc | ttfn alcabrera, enjoy your evening o/ | 20:07 |
| tjanczuk_ | Given that this is storage layer and the protocol is not exposed, folks really don't care if this is AMQP or FooBar, right? I wonder the focus of this decision should be on the actual product rather than protocol. | 20:07 |
| flaper87 | that's a good concern. I think it should be both, TBH. What Marconi will support won't only help marconi but the overall community. | 20:10 |
| flaper87 | I think the benefits that AMQP 1.0 brings as a standard will help marconi as well | 20:11 |
| flaper87 | some of those are the ones I mentioned before | 20:11 |
| tjanczuk_ | Looking at this from the product perspective, Rabbit has a lot going for it: it is very popular, well supported, large community, active development, already used in OpenStack (so folks deploying OpenStack need one less area of expertise). | 20:13 |
| tjanczuk_ | And frankly I think it is less important if the intergation is over AMQP 0.9, MQTT, or STOMP. OK, maybe not STOMP ;) | 20:13 |
| tjanczuk_ | Cutting to the chase: I would love to see a Rabbit-based storage layer in Marconi. I can write it. If I do, can this become part of the project? | 20:21 |
| *** igor_ has joined #openstack-marconi | 20:25 | |
| *** igor__ has joined #openstack-marconi | 20:27 | |
| flaper87 | Again, I think that's a valid concern but I'm less worried about that | 20:29 |
| flaper87 | I spoke with some rabbitmq guys and the only reason they haven't started dedicating *LOT* of time to it is because there wasn't a huge demand | 20:29 |
| *** igor_ has quit IRC | 20:30 | |
| flaper87 | I think OpenStack is huge enough and is worth the amqp 1.0 support | 20:30 |
| flaper87 | if what rabbitmq needs is a reason to support it, I'll be more than happy to give them that motivation | 20:30 |
| flaper87 | I'll hopefully have more info about this soon | 20:31 |
| *** igor__ has quit IRC | 20:32 | |
| *** mwagner_lap has quit IRC | 20:33 | |
| *** sriram has quit IRC | 20:33 | |
| *** balajiiyer has quit IRC | 20:33 | |
| malini | fyi…the broken tempest job was due to my devstack patch | 20:34 |
| malini | I have submitted to fix this https://review.openstack.org/#/c/94919/ | 20:34 |
| flaper87 | malini: :( what happened ? | 20:35 |
| malini | But I am waiting for the experimental job to get back the results, to make sure tht fixes it | 20:35 |
| flaper87 | oh :S | 20:35 |
| malini | flaper87: I am embarassed to admit it.But bad syntax in the shell script | 20:35 |
| flaper87 | but, how did it pass? | 20:35 |
| tjanczuk_ | flapper87: Waiting for AMQP 1.0 to get popular enough for Rabbit to decide to support it, even if this happens, does not sound like timely way to enable people to use Rabbit with Marconi. | 20:36 |
| malini | devstack doesnt have gate jobs to check if the script works..so it got past | 20:36 |
| tjanczuk_ | So again: if I write it, can this become part of the project? | 20:36 |
| *** abettadapur has quit IRC | 20:36 | |
| *** balajiiyer has joined #openstack-marconi | 20:36 | |
| malini | tjanczuk_: why can't it become part of the project, if you write it? | 20:37 |
| flaper87 | To be clear. They support it as in they respond to bug reports | 20:37 |
| flaper87 | I've asked for the list of supported features | 20:38 |
| flaper87 | (and missing ones) | 20:38 |
| flaper87 | I'll hopefully have it in the next few days | 20:38 |
| flaper87 | tjanczuk_: as for 0.9 in Marconi's code base, I wouldn't be fully against it but I'm not convinced. For starters, I'd hate to have support for rabbit and not other brokers | 20:39 |
| flaper87 | and I do care about that, regardless rabbit being the most deployed broker | 20:39 |
| tjanczuk_ | flapper87: There are no notable deployments of rabbit with amqp 1.0 I am aware of. Everyone I know uses it with the built-in 0.9. Including OpenStack. | 20:39 |
| tjanczuk_ | Is this necessarily an XOR? Maybe we can have 1.0 and 0.9? | 20:40 |
| flaper87 | tjanczuk_: It's not an XOR. As of now, I think 1.0 will happen regardless. 0.9 will be an addition | 20:40 |
| flaper87 | You could start working on it as an external plugin and we can discuss adding it to the codebase later | 20:41 |
| flaper87 | I think that's a fair approach | 20:41 |
| flaper87 | Installing marconi w/ the rabbit driver would be a matter of doing: $ pip install marconi-rabbit-driver | 20:42 |
| tjanczuk_ | Is the redis driver going to be internal or external? | 20:43 |
| flaper87 | internal | 20:44 |
| flaper87 | The current plan is to support: mongodb, redis and amqp 1.0 | 20:44 |
| flaper87 | there's sqlalchemy but lets not talk about that | 20:44 |
| flaper87 | :P | 20:44 |
| tjanczuk_ | So what makes something internal vs external? | 20:45 |
| tjanczuk_ | What's the principle? | 20:45 |
| flaper87 | Right now what gets into the code base is what the team considers required and most importantly what the team is willing to/capable of maintain(ing) | 20:47 |
| flaper87 | There are some brilliant interns working on the redis driver and the amqp one | 20:47 |
| flaper87 | I really hope they'll maintain them afterwards | 20:47 |
| flaper87 | but in the real awful case they won't, the team will be able to take over | 20:48 |
| flaper87 | This rationals will likely change in the future | 20:48 |
| flaper87 | but we definitely want to keep this set vary but small | 20:48 |
| flaper87 | Marconi was built with the community in mind | 20:48 |
| flaper87 | which means it has everything needed for the community to contribute without having the code in marconi's root | 20:49 |
| flaper87 | with all that said, I need to step out for a bit | 20:49 |
| flaper87 | I hope it makes sense for you | 20:49 |
| flaper87 | if it doesn't, please, by all means, speak up :) | 20:49 |
| flaper87 | malini: we haven't talked about the functional tests | 20:50 |
| malini | flaper87: aah yes! | 20:50 |
| flaper87 | but based on the few things we said, we should probably keep everything as is and focus on other things | 20:50 |
| malini | flaper87: I got this idea from one of the tempest sessions | 20:50 |
| malini | flaper87: The neutron folks are forking on implementing their functional tests, so tht they can just copy over their tests to tempest | 20:52 |
| malini | i.e instead of maintaining two sets of tests (the project level functional tests + tempest API tests), write one set of tests which can live in both the repos | 20:52 |
| tjanczuk_ | flapper87: What would be required for the rabbit storage to become internal? | 20:53 |
| malini | flaper87: this will help us avoid duplicate efforts - tht is the only advantage | 20:53 |
| malini | flaper87: on the flip side we lose a lot of flexibility -eg. tempest does class level setups for tests etc. + validations happens in the queuing client etc. | 20:54 |
| malini | flaper87: So I am still split b/w if we should try doing tht or not | 20:55 |
| malini | also we'll have to stop using ddt | 20:55 |
| flaper87 | malini: I think we're better of by having our own test suite | 20:56 |
| flaper87 | when it comes to tests, I think there's some value in duplicating the test suites | 20:57 |
| flaper87 | there are also some drawbacks | 20:57 |
| flaper87 | that said, I'm not really happy with the way things are done in tempest | 20:57 |
| flaper87 | so, I'd really prefer not pulling them into marconi | 20:57 |
| malini | flaper87: I dont see much value in duplication - but I like a lot of the stuff we are doing now, & we'll have to stop those if we go the tempest friendly route | 20:57 |
| flaper87 | malini: the value in keeping both things separate is that we get more people to look deeply in our API besides us | 20:58 |
| flaper87 | if we write tempest tests and copy them to tempest, then it'd be just us looking at it | 20:58 |
| malini | as is, I am the only one looking at both :D | 20:59 |
| flaper87 | and that may hide some UX issues | 20:59 |
| flaper87 | malini: yup :D | 20:59 |
| malini | hopefully tht'll change as we get more contributors | 20:59 |
| flaper87 | that said, we should probably re-consider this during K | 20:59 |
| malini | yes.. | 20:59 |
| flaper87 | I think we've enough things in our plate for Juno | 20:59 |
| malini | Lets continue the current route & re-evaluate during K | 20:59 |
| flaper87 | awesome, sounds good | 21:00 |
| malini | hopefully the common tempest libs will be mature by then | 21:00 |
| flaper87 | yeah | 21:00 |
| malini | there was also some talk abt an oslo lib for tests | 21:00 |
| flaper87 | oslo.tests | 21:01 |
| flaper87 | that one we should use | 21:01 |
| *** cpallares has joined #openstack-marconi | 21:01 | |
| malini | flaper87: does it already exist? | 21:01 |
| flaper87 | yup | 21:02 |
| *** jay-atl has quit IRC | 21:02 | |
| flaper87 | malini: https://github.com/openstack/oslo.test | 21:02 |
| flaper87 | it's very simple | 21:02 |
| flaper87 | I'll migrate our code to use that library soon | 21:02 |
| flaper87 | that's supposed to be the liasion work | 21:02 |
| malini | doesnt look like they have functional tests yet | 21:03 |
| malini | https://github.com/openstack/oslo.test/tree/master/tests | 21:03 |
| malini | maybe tht'll come next | 21:03 |
| flaper87 | oh no no, that lib is just for base clases and some common code | 21:04 |
| tjanczuk_ | flapper87: I really care about the rabbit storage layer to be internal. What would be required to make this happen (besides me writing it)? | 21:04 |
| flaper87 | we could probably contribute back with support for functional tests | 21:04 |
| flaper87 | tjanczuk_: Don't get me wrong, I care about it too. You writing it is the first thing for sure. That'd be really helpful | 21:05 |
| flaper87 | and thanked | 21:05 |
| *** oz_akan_ has quit IRC | 21:06 | |
| flaper87 | We need to discuss the inclusion in the codebase but before doing that, we need to sort some other things out | 21:06 |
| *** boris-42 has quit IRC | 21:06 | |
| flaper87 | for example: What is the minimum set of required features in a store driver | 21:06 |
| flaper87 | What are the required changes in the API for an AMQP/broker-based driver? | 21:07 |
| flaper87 | etc | 21:07 |
| flaper87 | that's one of the reasons I'm recommending to start as an external driver | 21:07 |
| flaper87 | and then we can discuss the inclusion based on the parameters I just mentioned and other things | 21:07 |
| flaper87 | tjanczuk_: thanks for your input on this | 21:07 |
| tjanczuk_ | My understanding is this discussion would need to happen for redis and amqp 1.0 as well, so rabbit driver would not really affect the outcome. From the perspective the difference between 1.0 and 0.9 is insubstantial. | 21:08 |
| *** boris-42 has joined #openstack-marconi | 21:08 | |
| tjanczuk_ | And actually I will be happy to help flesh out some of these questions as part of the work. | 21:08 |
| flaper87 | Absolutely, those questions are valid for the three new drivers we're targeting | 21:10 |
| tjanczuk_ | Besides the features/APIs aspects, what are the "other things" that inclusion would be based on? | 21:15 |
| *** balajiiyer has quit IRC | 21:23 | |
| *** igor_ has joined #openstack-marconi | 21:28 | |
| *** lakspace has quit IRC | 21:31 | |
| *** igor_ has quit IRC | 21:32 | |
| *** tedross has quit IRC | 21:35 | |
| *** AAzza has quit IRC | 21:35 | |
| *** vkmc has quit IRC | 21:43 | |
| *** vkmc has joined #openstack-marconi | 21:43 | |
| *** malini is now known as malini_afk | 21:46 | |
| *** Obulpathi has quit IRC | 21:50 | |
| *** mpanetta has quit IRC | 21:52 | |
| *** reed has quit IRC | 22:01 | |
| *** mkoderer has quit IRC | 22:02 | |
| *** jchai has quit IRC | 22:05 | |
| *** boris-42 has quit IRC | 22:17 | |
| *** boris-42 has joined #openstack-marconi | 22:20 | |
| *** flaper87 is now known as flaper87|afk | 22:24 | |
| *** igor_ has joined #openstack-marconi | 22:28 | |
| *** jergerber has quit IRC | 22:32 | |
| *** igor_ has quit IRC | 22:33 | |
| *** mwagner_lap has joined #openstack-marconi | 22:42 | |
| *** openstackgerrit has quit IRC | 23:19 | |
| *** openstackgerrit has joined #openstack-marconi | 23:21 | |
| *** cpallares has quit IRC | 23:25 | |
| *** oz_akan_ has joined #openstack-marconi | 23:26 | |
| *** igor_ has joined #openstack-marconi | 23:29 | |
| *** igor_ has quit IRC | 23:34 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!