*** keith_newstadt has quit IRC | 00:11 | |
*** keith_newstadt has joined #openstack-marconi | 00:11 | |
*** amitgandhi has joined #openstack-marconi | 00:21 | |
*** Hao has joined #openstack-marconi | 00:33 | |
*** Hao has quit IRC | 00:38 | |
*** oz_akan_ has joined #openstack-marconi | 01:10 | |
*** keith_newstadt has quit IRC | 01:12 | |
*** keith_newstadt has joined #openstack-marconi | 01:12 | |
*** keith_newstadt has quit IRC | 01:22 | |
*** Hao has joined #openstack-marconi | 01:34 | |
*** Hao has quit IRC | 01:39 | |
*** nosnos has joined #openstack-marconi | 01:48 | |
*** amitgandhi has quit IRC | 01:52 | |
*** mwagner_lap has quit IRC | 02:04 | |
*** prashanthr_ has joined #openstack-marconi | 02:16 | |
prashanthr_ | flwang: Hello. Good morning. | 02:16 |
---|---|---|
flwang | prashanthr_: hey there | 02:17 |
prashanthr_ | how you doing ? I had a small question for you. | 02:17 |
flwang | good, thank you. what's the qiz? | 02:18 |
prashanthr_ | you had mentioned to me that we no longer add backend dependencies to requirements.txt. | 02:18 |
prashanthr_ | hence we would need it to be added to test-requirements.txt | 02:18 |
flwang | yep, I noticed that the other components are doing that | 02:18 |
flwang | wait a sec, let me find a link | 02:19 |
prashanthr_ | sure. | 02:19 |
flwang | https://github.com/openstack/ceilometer/commit/febc8347f79a69531e8b69c3f4f7fd8ecefd2033 | 02:20 |
flwang | does that make any sense for you? | 02:20 |
prashanthr_ | Will check it. | 02:21 |
prashanthr_ | flwang: Yes it does | 02:21 |
prashanthr_ | makes sense caz most driver dependancies are not required while deployment | 02:21 |
flwang | yes | 02:21 |
flwang | that's the point | 02:21 |
flwang | so that's why I asked | 02:21 |
prashanthr_ | So when i add it to test-requirements should I create a new section called #Backends. | 02:22 |
prashanthr_ | there are none currently | 02:22 |
flwang | up to you, it's not a big deal | 02:22 |
prashanthr_ | okay sure. | 02:23 |
prashanthr_ | I will go ahead with that. | 02:23 |
flwang | awesome, thanks for working on this, you're doing great job | 02:23 |
prashanthr_ | thanks flwang :). | 02:23 |
prashanthr_ | flwang: When i did a git pull of the latest version and tried to run the unit tests most of them are failing with an ImportError. | 02:33 |
flwang | prashanthr_: really? I didn't see any error in my local env | 02:34 |
*** flwang_ has joined #openstack-marconi | 02:34 | |
prashanthr_ | Yes. they are saying unable to import marconi.common.pipeline | 02:34 |
prashanthr_ | sorry | 02:34 |
prashanthr_ | marconi.common.decorators | 02:34 |
prashanthr_ | https://etherpad.openstack.org/p/marconi-err | 02:35 |
prashanthr_ | I have pasted the error @ the etherpad | 02:35 |
*** flwang_ has quit IRC | 02:39 | |
*** cpallares has quit IRC | 02:45 | |
*** haomaiw__ has quit IRC | 02:46 | |
*** haomaiwang has joined #openstack-marconi | 02:46 | |
prashanthr_ | flwang: Can you send me an etherpad of your marconi.conf ? | 02:52 |
flwang | sure | 02:53 |
flwang | wait a min | 02:53 |
flwang | http://paste.openstack.org/show/85861/ | 02:54 |
prashanthr_ | thanks :) | 02:55 |
*** haomai___ has joined #openstack-marconi | 03:02 | |
*** haomaiwang has quit IRC | 03:04 | |
wpf | flwang: I also run into the same issue ,seems to be related with oslo.i18n, I'd pip install -r requirement.txt | 03:07 |
wpf | but did not work | 03:07 |
wpf | what can I do? | 03:07 |
flwang | you mean the patch delivered by flaper87? | 03:08 |
wpf | File "marconi/common/pipeline.py", line 36, in <module> | 03:08 |
wpf | from marconi.common import decorators | 03:08 |
wpf | ImportError: cannot import name decorators | 03:08 |
flwang | can you checkout a new branch to back to a commit before that and try again? | 03:08 |
wpf | File "marconi/i18n.py", line 16, in <module> | 03:08 |
wpf | from oslo.i18n import * # noqa | 03:08 |
wpf | ImportError: No module named i18n | 03:08 |
flwang | ok, let me check | 03:09 |
flwang | marconi works fine after reinstall the requirements.txt | 03:12 |
wpf | oops , I'd reinstall it , let me try again | 03:13 |
* vkmc lurks | 03:16 | |
prashanthr_ | wpf: | 03:16 |
prashanthr_ | reinstalling fixes the issues | 03:16 |
prashanthr_ | vkmc: Hello. Good evening | 03:17 |
prashanthr_ | :) | 03:17 |
wpf | I run "sudo pip install -r requirement.txt" | 03:17 |
vkmc | prashanthr_, morning prashanthr! :) | 03:17 |
prashanthr_ | wpf: you can install marconi instead using pip install -e . in the marconi base folder | 03:18 |
prashanthr_ | it installs all the requirements | 03:18 |
wpf | I did that ever | 03:18 |
prashanthr_ | hmm then it must reflect the new changes. | 03:19 |
wpf | it seems that tox did refresh the dependencies | 03:19 |
wpf | I can run the marconi-server -v | 03:19 |
prashanthr_ | wpf: Hmmm. | 03:20 |
wpf | how to refresh tox , -:) | 03:20 |
wpf | prashanthr_: you can run "tox -e py27" successfully ,right? | 03:20 |
prashanthr_ | wpf: Yes i can now after reinstalling :) | 03:21 |
wpf | prashanthr_: Ok, maybe I have to remove .tox to make it work | 03:22 |
prashanthr_ | Ahh the error actually still exists but since i shifted to my new branch | 03:22 |
prashanthr_ | i did not find it | 03:22 |
*** nosnos has quit IRC | 03:23 | |
prashanthr_ | wpf: Deleting .tox and running the tests works | 03:25 |
prashanthr_ | you were bang on :) | 03:25 |
wpf | -:) | 03:26 |
vkmc | boo something happened with the switch to oslo i18n? | 03:26 |
prashanthr_ | tests failing ? | 03:26 |
prashanthr_ | vkmc : tests failing ? | 03:27 |
vkmc | I haven't tried it, I just was reading the backlog | 03:27 |
wpf | seems tox did not refresh the dependencies or I don't know how to refresh it without deleting .tox | 03:27 |
flwang | prashanthr_: or you can try tox --recreate -e py27 | 03:27 |
wpf | Ok, I will try --recreate | 03:28 |
prashanthr_ | flwang : Ahh. This reinstalls the dependencies again :) | 03:28 |
prashanthr_ | thanks for it :) | 03:28 |
flwang | prashanthr_: sure | 03:29 |
*** prashanthr_ has quit IRC | 03:32 | |
*** prashanthr_1 has joined #openstack-marconi | 03:33 | |
*** Hao has joined #openstack-marconi | 03:35 | |
*** Hao has quit IRC | 03:40 | |
*** oz_akan_ has quit IRC | 03:46 | |
prashanthr_1 | flwang: Any idea what "H405 multi line docstring summary not separated with an empty line | 03:46 |
prashanthr_1 | " means ? | 03:46 |
*** prashanthr_1 has quit IRC | 03:52 | |
*** nosnos has joined #openstack-marconi | 03:53 | |
*** prashanthr_ has joined #openstack-marconi | 03:55 | |
flwang | can you paste the code? | 03:56 |
*** prashanthr_ has quit IRC | 04:09 | |
*** oz_akan_ has joined #openstack-marconi | 04:17 | |
*** oz_akan_ has quit IRC | 04:21 | |
*** chandankumar has joined #openstack-marconi | 04:34 | |
*** flwang_ has joined #openstack-marconi | 04:35 | |
*** flwang_ has quit IRC | 04:39 | |
*** chandankumar has quit IRC | 04:44 | |
*** keith_newstadt has joined #openstack-marconi | 04:49 | |
*** vkmc has quit IRC | 04:53 | |
*** keith_newstadt has quit IRC | 04:53 | |
*** keith_newstadt has joined #openstack-marconi | 04:53 | |
*** oz_akan_ has joined #openstack-marconi | 05:17 | |
*** oz_akan_ has quit IRC | 05:22 | |
*** chandankumar has joined #openstack-marconi | 05:24 | |
*** k4n0 has joined #openstack-marconi | 05:35 | |
*** prashanthr_ has joined #openstack-marconi | 05:47 | |
prashanthr_ | flwang: I did tox --recreate -e pep8 | 05:47 |
prashanthr_ | and installed the new requirements | 05:47 |
prashanthr_ | it's working fine now :) | 05:48 |
prashanthr_ | H405 multi line docstring summary not separated with an empty line -> adding an empty new line before every line in a multi line docstring | 05:48 |
prashanthr_ | example : | 05:48 |
prashanthr_ | """ This is a multi line | 05:48 |
prashanthr_ | comment. | 05:48 |
prashanthr_ | """ | 05:48 |
prashanthr_ | i mean there has to be a line between "This is a multi line" and the line containing "comment" | 05:49 |
wpf | prashanthr_: http://docs.openstack.org/developer/hacking/, check here | 05:49 |
wpf | [H405] Multi line docstrings should start with a one line summary followed by an empty line. | 05:49 |
prashanthr_ | wpf: Ahh this is perfect. thanks a lot :) | 05:50 |
wpf | np | 05:50 |
*** nosnos has quit IRC | 06:08 | |
*** AAzza_afk is now known as AAzza | 06:11 | |
*** oz_akan_ has joined #openstack-marconi | 06:18 | |
*** oz_akan_ has quit IRC | 06:23 | |
*** mkoderer has joined #openstack-marconi | 06:26 | |
* flaper87 should've probably mentioned that reinstalling requirements was needed | 06:29 | |
*** haomai___ has quit IRC | 06:40 | |
*** haomaiwa_ has joined #openstack-marconi | 06:41 | |
*** AAzza is now known as AAzza_afk | 06:46 | |
*** ykaplan has joined #openstack-marconi | 07:01 | |
*** AAzza_afk is now known as AAzza | 07:02 | |
*** haomai___ has joined #openstack-marconi | 07:12 | |
*** haomaiwa_ has quit IRC | 07:15 | |
*** amalagon has quit IRC | 07:18 | |
*** oz_akan_ has joined #openstack-marconi | 07:19 | |
*** oz_akan_ has quit IRC | 07:23 | |
prashanthr_ | flwang: I had a small doubt. | 07:48 |
prashanthr_ | while i run pep8 tests | 07:48 |
prashanthr_ | i get the error | 07:48 |
prashanthr_ | H104 File contains nothing but comments | 07:48 |
prashanthr_ | __init__.py | 07:48 |
prashanthr_ | so i deleted it | 07:48 |
prashanthr_ | but without it i am unable to load the driver | 07:48 |
wpf | prashanthr_: then you don't need the comments in it | 08:02 |
wpf | just an empty one is ok | 08:02 |
prashanthr_ | wpf: Cool. thanks :) | 08:03 |
wpf | prashanthr_: np | 08:03 |
openstackgerrit | Prashanth Raghu proposed a change to openstack/marconi: Implements Queue and Message Controllers for Redis https://review.openstack.org/97178 | 08:12 |
*** oz_akan_ has joined #openstack-marconi | 08:20 | |
*** oz_akan_ has quit IRC | 08:25 | |
*** AAzza is now known as AAzza_afk | 08:29 | |
prashanthr_ | flwang: I want a review to depend on the latest version of another one | 08:45 |
prashanthr_ | as it is showing updated | 08:45 |
prashanthr_ | how do i do it ? | 08:45 |
wpf | maybe he is away , -:) | 08:47 |
prashanthr_ | wpf: Yeah i guess :) | 08:52 |
wpf | is the rebase what you want ? | 08:52 |
wpf | do you mean that you'd modify your PS in your local ,and you want set it review again? | 08:56 |
wpf | then you need to "git commit --amend" and git review again | 08:57 |
wpf | prashanthr_: | 09:01 |
prashanthr_ | wpf: Sorry. I have change 2 depending on change 1 | 09:01 |
prashanthr_ | now i have made a small amendment to change 1 | 09:01 |
prashanthr_ | so now change 2 shows it's dependancy as outdated | 09:02 |
wpf | wow, you depend on unmerged changes in another branch? | 09:03 |
prashanthr_ | hmm yeah kind of a complex mix and mash :P | 09:03 |
flaper87 | prashanthr_: you need to rebase | 09:15 |
prashanthr_ | sure. Doing that now | 09:15 |
prashanthr_ | saw the comment on jenkins | 09:15 |
flaper87 | if change 1 is in branch-a, you need to rebase branch-b where change 2 is to latest branch-a | 09:16 |
prashanthr_ | flaper87: Yup doing that now :) | 09:16 |
openstackgerrit | Prashanth Raghu proposed a change to openstack/marconi: Implementation of claims controller for Redis https://review.openstack.org/104055 | 09:17 |
*** oz_akan_ has joined #openstack-marconi | 09:21 | |
*** oz_akan_ has quit IRC | 09:22 | |
*** oz_akan_ has joined #openstack-marconi | 09:22 | |
openstackgerrit | Prashanth Raghu proposed a change to openstack/marconi: Implements Pools and Catalogue controllers for Redis https://review.openstack.org/104058 | 09:24 |
*** haomai___ has quit IRC | 09:26 | |
*** haomaiwang has joined #openstack-marconi | 09:27 | |
*** oz_akan_ has quit IRC | 09:27 | |
*** dmakogon_ is now known as denis_makogon | 09:43 | |
*** flwang_ has joined #openstack-marconi | 09:54 | |
*** haomaiw__ has joined #openstack-marconi | 10:06 | |
*** haomaiwang has quit IRC | 10:09 | |
*** oz_akan_ has joined #openstack-marconi | 10:23 | |
*** oz_akan_ has quit IRC | 10:28 | |
*** prashanthr_ has quit IRC | 11:02 | |
*** tedross has joined #openstack-marconi | 11:09 | |
*** malini has joined #openstack-marconi | 11:11 | |
*** vkmc has joined #openstack-marconi | 11:25 | |
*** vkmc has quit IRC | 11:25 | |
*** vkmc has joined #openstack-marconi | 11:25 | |
*** k4n0 has quit IRC | 11:26 | |
vkmc | morning! | 11:27 |
flaper87 | vkmc: 'sup ? | 11:36 |
flaper87 | vkmc: congrats, i guess :P | 11:36 |
* flaper87 is messing with vkmc | 11:36 | |
vkmc | flaper87, hey youu :) | 11:37 |
*** malini has quit IRC | 11:37 | |
vkmc | flaper87, thanks thanks | 11:38 |
vkmc | what happened with the neds? they let you down! | 11:39 |
* vkmc messes back | 11:40 | |
flaper87 | LOL | 11:40 |
flaper87 | lets admit, that game was booooooooooooooooooooooooooooooriiiiiingggggggggggg | 11:40 |
vkmc | I prefer a slow game | 11:41 |
flaper87 | and I really hate penalties, I don't think it's a fair way of winning (regardless the team) | 11:41 |
vkmc | and not 5 goals in 30 min | 11:41 |
flaper87 | but hey, someone has to win, right? | 11:41 |
vkmc | yes I suffered like hell | 11:41 |
vkmc | just one tiny comment... the netherlands are great pulling tshirts and hiding it :p | 11:43 |
flaper87 | LOL, fair enough, I saw lot of that | 11:43 |
vkmc | so now... the germans! | 11:44 |
flaper87 | GO GERMANY | 11:45 |
vkmc | https://www.youtube.com/watch?v=TahSjSjOE9o | 11:45 |
* flaper87 hides | 11:45 | |
flaper87 | LOOOL | 11:45 |
vkmc | yeah go cheer germany ¬¬ | 11:45 |
*** openstackgerrit has quit IRC | 11:47 | |
vkmc | flaper87, btw, I looked into the URI parser yesterday... I couldn't find it :( | 11:51 |
vkmc | flaper87, I'll ask gsim, but for what I saw... kgiusti had to build a parser himself too for pyngus | 11:52 |
flaper87 | vkmc: oh mmh, if he did then there's probably nothing useful in proton | 11:52 |
flaper87 | which is a shame | 11:52 |
vkmc | here https://github.com/kgiusti/pyngus/blob/master/examples/python/utils.py#L30-L39 | 11:52 |
flaper87 | vkmc: at least you can copy/paste what kgiusti did | 11:53 |
* flaper87 never said that | 11:53 | |
vkmc | haha I already had it working... but kgiusti' only takes host and port, not queues or other fancy stuff | 11:53 |
vkmc | flaper87, btw, this is already working https://github.com/vkmc/marconi-transport-amqp10/tree/master/marconi/queues/transport/amqp | 11:54 |
* flaper87 clicks | 11:54 | |
vkmc | post messages to Marconi server | 11:54 |
vkmc | mongo saves them | 11:54 |
vkmc | and no one can get it later :D | 11:54 |
* vkmc working on GET now | 11:54 | |
flaper87 | vkmc: why do you need to get the queue from there? | 11:54 |
flaper87 | I mean, I know what you're doing with it but isn't there another way to get that info? | 11:55 |
vkmc | flaper87, I'll check it out... maybe there is some attribute or something to ease things a bit | 11:55 |
flaper87 | vkmc: I think it'd be better to rely on something that doesn't require parsing the URI | 11:57 |
flaper87 | parsing may be expensive and error prone | 11:57 |
vkmc | I'm aware of that yeah | 11:57 |
flaper87 | if there's no other good way to do it then fine | 11:57 |
flaper87 | cool | 11:57 |
flaper87 | :D | 11:57 |
vkmc | in fact that code there if you don't specify a queue, breaks :) | 11:58 |
vkmc | things is, AMQP allows clients sending messages without queues | 11:58 |
vkmc | it send everything to a 'common queue' | 11:58 |
* flaper87 will quite programming and become a future guesser | 11:58 | |
flaper87 | vkmc: if a client sends a message without queue, we basically can't do anything with that message | 11:59 |
vkmc | fortune teller? with tarot cards and all? :o | 11:59 |
vkmc | flaper87, in our API, we can't | 11:59 |
vkmc | Marconi raises and exception in that case | 11:59 |
flaper87 | no no, I'll be a future guesser because I'll likely be wrong most of the time so I can't call that telling but guessing :P | 11:59 |
vkmc | so we have to capture that | 11:59 |
* vkmc was picturing flaper87 with fancy clothes reading hands | 12:00 | |
flaper87 | LOL, I want aladin's shoes | 12:00 |
vkmc | haha | 12:02 |
vkmc | another thing | 12:03 |
vkmc | how are we providing the client-id and project-id? | 12:04 |
vkmc | I thought that maybe, our best call here, is to put it in the conf | 12:04 |
vkmc | well, the client-id... the project-id cannot be done that way | 12:04 |
flaper87 | ametts: just FYI jealousy interest. I went to an open-cinema event lastnight and watched a movie by the lake in the open. Just sayin' | 12:08 |
flaper87 | vkmc: which conf? | 12:08 |
vkmc | flaper87, marconi.conf, or some special conf for amqp | 12:08 |
vkmc | unless we authenticate with user and password instead of a token | 12:10 |
vkmc | and declare the project-id as namespace | 12:10 |
flaper87 | oh, mmh, isn't there a way to recognize a client's request in AMQP's headers? | 12:11 |
vkmc | flaper87, we could use the client-id for client-id and the correlation-id for project-id | 12:13 |
vkmc | but | 12:13 |
flaper87 | mmhhh | 12:13 |
vkmc | it's the client responsability to specify it before sending the message | 12:13 |
flaper87 | how do I tell Azure which queue I want to post a message to when using AMQP? | 12:14 |
vkmc | it doesn't appear explicitly in the address | 12:14 |
vkmc | azure --> "amqps://[username]:[password]@[namespace].servicebus.windows.net/[entity]" | 12:14 |
flaper87 | ooooooooooohhhhhhhhhhhhhhhhhhhhhhhhhhhh | 12:15 |
flaper87 | namespace | 12:15 |
flaper87 | mmh | 12:15 |
flaper87 | nasty, elegant and clever | 12:15 |
vkmc | oh no | 12:15 |
vkmc | the [entity] is the queue | 12:16 |
vkmc | namespace is our project-id concept | 12:16 |
flaper87 | and the namespace would be the project | 12:16 |
flaper87 | right | 12:16 |
flaper87 | so, I guess we'll have to parse the url | 12:16 |
flaper87 | and fuck the client-id | 12:16 |
* flaper87 never said that | 12:16 | |
vkmc | lol | 12:16 |
vkmc | we need to require the amqp address syntax as much as possible | 12:17 |
vkmc | need to require lol | 12:17 |
vkmc | we require | 12:17 |
vkmc | otherwise all the interoperability of AMQP goes to the trash | 12:18 |
vkmc | and one final thing | 12:40 |
vkmc | (note how I bug you in little doses so you don't hate me much) | 12:41 |
vkmc | for the consumer role | 12:41 |
*** sriram has joined #openstack-marconi | 12:41 | |
vkmc | when it suscribes to a queue | 12:42 |
vkmc | the server should send it all the messages that queue | 12:42 |
vkmc | or that should be the normal behaviour... not sure if for the prod/cons scenario as well | 12:42 |
vkmc | there is no way to know that there is a new consumer unless it sends a message to the server | 12:43 |
flaper87 | malini|afk: https://review.openstack.org/#/c/98777/ :) | 12:43 |
flaper87 | and good morning | 12:43 |
flaper87 | vkmc: remember to ping me :P | 12:43 |
flaper87 | I get distracted very easily | 12:43 |
vkmc | haha I know, I ping you when there is enough to keep you entertained | 12:43 |
vkmc | so... flaper87 ^^ | 12:43 |
flaper87 | vkmc: hahaha, good strategy. 1 big ping instead of 10 tiny ones | 12:44 |
vkmc | yup :D | 12:44 |
flaper87 | that's weird, mmhh. There must be a way to know when there's a new connection aiming to consume messages | 12:45 |
flaper87 | hard thing is the connection may be persistent | 12:45 |
flaper87 | which means we'll have to keep track of who's connected | 12:46 |
flaper87 | crap | 12:46 |
vkmc | exactly | 12:46 |
vkmc | this is the subcription thing I was mentioning yesterday | 12:46 |
flaper87 | yeah but I thought you were just talking about pub/sub | 12:46 |
vkmc | I was | 12:46 |
flaper87 | HA! | 12:46 |
* flaper87 knew that | 12:46 | |
flaper87 | :P | 12:46 |
vkmc | but in the producer/consumer scenario we need to do something alike... less complex though | 12:46 |
* flaper87 pulls vkmc chair | 12:47 | |
flaper87 | yeah | 12:47 |
vkmc | maybe sending a dummy message, like the first part in the three way handshake for tcp | 12:47 |
flaper87 | that's unfortunate, though. Nonetheless, since we have to do it, we better do it right and for both | 12:47 |
vkmc | yup it is | 12:48 |
vkmc | is slightly related with the notifications bp | 12:48 |
flaper87 | let me dig into this a bit | 12:48 |
vkmc | ok | 12:49 |
vkmc | I'll think in a decent solution too | 12:49 |
vkmc | I don't want all this to be on your shoulders.. but well, that happens when you are that smart | 12:49 |
*** mpanetta has joined #openstack-marconi | 12:57 | |
*** oz_akan_ has joined #openstack-marconi | 12:57 | |
flaper87 | vkmc: http://qpid.apache.org/releases/qpid-proton-0.7/protocol-engine/python/api/proton.Messenger-class.html#recv | 12:58 |
flaper87 | vkmc: so, according to that doc, the recv call accepts an `n` keyword which specifies how many messages the client wants to receive | 12:58 |
flaper87 | this means the consumer is telling the server it wants some messages and how many it wants | 12:59 |
vkmc | flaper87, exactly, but that works only if there is some remote node sending messages to it | 12:59 |
vkmc | eer | 12:59 |
flaper87 | the part that we need to solve is: "If the Messenger is in blocking mode, this call will block until at least one Message is available in the incoming queue." | 13:00 |
*** jmckind has joined #openstack-marconi | 13:00 | |
*** jmckind has quit IRC | 13:00 | |
flaper87 | but that's probably done by proton itself | 13:00 |
flaper87 | not sure, I'll ping gsim | 13:00 |
*** jmckind has joined #openstack-marconi | 13:00 | |
vkmc | flaper87, I'll try it right now | 13:02 |
flaper87 | I think the easiest solution is to keep the sessions around | 13:02 |
vkmc | but, afaik, the recv() feature works if there is a node executing send() somewhere in the network | 13:02 |
vkmc | yes we have a subscriptions map | 13:03 |
vkmc | well, I'll let you know what I find | 13:03 |
vkmc | thaaaaaaaaaaanks for everything Fla | 13:04 |
vkmc | you are really kind (despite you cheer for Germany) :) | 13:05 |
*** mwagner_lap has joined #openstack-marconi | 13:05 | |
*** tedross has quit IRC | 13:05 | |
flaper87 | vkmc: recv() should work if there's a node that it can connect to and get messages from | 13:06 |
flaper87 | that would be marconi | 13:06 |
flaper87 | remember that amqp 1.0 defines a way to send messages between peers and that includes intermediari nodes that store messages | 13:06 |
flaper87 | in other words, marconi would be an amqp1.0 peer | 13:07 |
vkmc | awesome | 13:07 |
*** flwang_ has quit IRC | 13:13 | |
*** malini has joined #openstack-marconi | 13:17 | |
*** tedross has joined #openstack-marconi | 13:18 | |
*** alcabrera|afk is now known as alcabrera | 13:26 | |
flaper87 | vkmc: https://github.com/rhs/qpid-proton-demo | 13:26 |
flaper87 | you may want to take a look to that demo | 13:27 |
flaper87 | it basically implements a broker using proton | 13:27 |
flaper87 | the main difference is that it doesn't use the Messenger API | 13:27 |
flaper87 | that's where we want to get after we figure out how good/bad this will work using the Messenger API | 13:27 |
alcabrera | good morning! :) | 13:28 |
flaper87 | alcabrera: goooooood morning | 13:28 |
alcabrera | heya flaper87. How are you? | 13:29 |
vkmc | thanks flaper87, I'll check it out | 13:29 |
flaper87 | alcabrera: I'm doing great, what about you? How's it going on your new tasks? Haskell all the way, w000t | 13:29 |
vkmc | alcabrera, hiiiiiiii | 13:29 |
alcabrera | vkmc, hello! :) | 13:29 |
* flaper87 laughs because vkmc doesn't know he just asked her to read java | 13:29 | |
alcabrera | oh no java. D: | 13:30 |
alcabrera | flaper87: I'm great! The tasks are coming slowly, since they're mostly waiting for me to move to Austin, TX before assigning me the meatier things. I've written a log parser in haskell so far. Aside from that, I've been enjoying studying type and category theory. | 13:31 |
alcabrera | so | 13:31 |
alcabrera | many | 13:31 |
alcabrera | good | 13:31 |
alcabrera | math books | 13:31 |
flaper87 | alcabrera: I'm glad to hear that, it sounds like you're having a blast | 13:31 |
alcabrera | oh yeah! | 13:31 |
flaper87 | I should do that as well, it's just been a crazy period | 13:31 |
flaper87 | in a good way, but still crazy | 13:32 |
alcabrera | keeping busy and traveling every where, flaper87? :) | 13:33 |
flaper87 | alcabrera: yeah | 13:33 |
vkmc | flaper87, I kinda heared an evil laugh | 13:33 |
vkmc | far away | 13:33 |
vkmc | somewhere in Italy | 13:33 |
flaper87 | alcabrera: and there's also this girl, vkmc. Man, she's all crazy about AMQP and keeps talking about it like every single second. OMFG | 13:34 |
alcabrera | "javahahaha", could be heard echoing through Italy | 13:34 |
* flaper87 ducks and runs far far away from vkmc | 13:34 | |
vkmc | alcabrera, 'good' and 'math books' are not expected to be together haha | 13:34 |
alcabrera | it struck me as well, vkmc. ;) | 13:35 |
alcabrera | I was like | 13:35 |
alcabrera | wait | 13:35 |
alcabrera | wow, I said that | 13:35 |
alcabrera | "nice" | 13:35 |
alcabrera | :D | 13:35 |
alcabrera | "Topoi: The Categorial Analysis of Logic" kept me very entertained this morning | 13:35 |
vkmc | flaper87, tomorrow morning... you will hear someone knocking at your door | 13:39 |
vkmc | and instead of hearing 'braaaains' | 13:39 |
vkmc | you will hear... 'amqppp' | 13:39 |
mpanetta | hah | 13:41 |
*** Obulpathi has joined #openstack-marconi | 13:43 | |
*** Obulpathi has quit IRC | 13:44 | |
vkmc | alcabrera, what is categorial analysis about? more or less | 13:44 |
vkmc | sounds interesting | 13:44 |
flaper87 | hahahahahhahaha | 13:44 |
*** Obulpathi has joined #openstack-marconi | 13:45 | |
flaper87 | vkmc: I don't believe that you'll come all the way just to scream AMQP at me at 7am. I'm sure as hell that you'll come here with that intention then you'll see the lake, sit there and think: "Fuck AMQP, flavio and openstack all together" | 13:45 |
flaper87 | :D | 13:45 |
alcabrera | vkmc: categorial analysis is about understanding the relationship between functions in terms of their compositions, and understanding how they transform/map objects while maintaining/changing their structures | 13:46 |
alcabrera | it is a new foundation for msathematics that exceeds the potential of set theory and is also very useful from a functional programming POV | 13:46 |
alcabrera | new as in -- invented around 1950s :P | 13:47 |
alcabrera | just, it hasn't been widely introduced to most curriculum | 13:47 |
vkmc | flaper87, of course :D but since I'm there I'll take the chance to haunt you | 13:47 |
vkmc | alcabrera, wow neat! | 13:48 |
flaper87 | damn :/ | 13:48 |
alcabrera | haha, the serenity of that lake. :) | 13:48 |
*** ametts has quit IRC | 13:49 | |
*** ametts has joined #openstack-marconi | 13:52 | |
*** tedross has quit IRC | 14:03 | |
*** amitgandhi has joined #openstack-marconi | 14:04 | |
*** ykaplan has quit IRC | 14:19 | |
*** tedross has joined #openstack-marconi | 14:19 | |
*** prashanthr_ has joined #openstack-marconi | 14:21 | |
prashanthr_ | My first merge to the main branch today :) | 14:22 |
prashanthr_ | Finally | 14:22 |
prashanthr_ | Good morning all btw :) | 14:22 |
vkmc | \o/ go prashanthr_ | 14:24 |
prashanthr_ | vkmc: Hey i was able to fix the pep8 error issues today | 14:24 |
alcabrera | yay. prashanthr_! | 14:24 |
prashanthr_ | alcabrera: Thank you :) Now the review process has speedened up :) | 14:24 |
alcabrera | :) | 14:25 |
vkmc | prashanthr_, awesome :) | 14:25 |
prashanthr_ | vkmc: In future if you see that many tests are failing or inconsistent with jenkins behaviour | 14:25 |
prashanthr_ | you could just do | 14:25 |
prashanthr_ | tox --recreate -e py27,pep8 | 14:25 |
prashanthr_ | to update all the requirements | 14:25 |
prashanthr_ | at one shot | 14:26 |
flaper87 | alcabrera: do you feel like reviewing this patch? https://review.openstack.org/#/c/98777/ | 14:28 |
*** cpallares has joined #openstack-marconi | 14:28 | |
*** amalagon has joined #openstack-marconi | 14:28 | |
flaper87 | malini: good morning :) | 14:29 |
flaper87 | why are you so silent? | 14:29 |
flaper87 | malini: is there https://review.openstack.org/#/c/98777/ something you're https://review.openstack.org/#/c/98777/ running away from? | 14:29 |
vkmc | prashanthr_, oh thanks for that... I didn't know how to update the requirements :) | 14:29 |
alcabrera | flaper87: I'll pass on reviewing that. thanks for checking, though. :) | 14:30 |
flaper87 | alcabrera: np, :) | 14:30 |
prashanthr_ | vkmc: Welcome. flwang helped me with this today morning. | 14:30 |
*** prashanthr_ has quit IRC | 14:30 | |
*** AAzza_afk is now known as AAzza | 14:30 | |
*** prashanthr_ has joined #openstack-marconi | 14:32 | |
*** ykaplan has joined #openstack-marconi | 14:33 | |
prashanthr_ | alcabrera: I needed a small help with git. | 14:34 |
* flaper87 goes for a walk | 14:34 | |
alcabrera | prashanthr_: sure thing. what can I help with? | 14:35 |
prashanthr_ | I have a change https://review.openstack.org/#/c/97178/ | 14:35 |
prashanthr_ | which is the basis for https://review.openstack.org/104055 | 14:35 |
prashanthr_ | because of this dependency when i change the first commit | 14:35 |
prashanthr_ | and submit a review | 14:36 |
prashanthr_ | the second one says outdated | 14:36 |
prashanthr_ | how should I go about solving this issue ? | 14:36 |
alcabrera | hmmm | 14:36 |
alcabrera | so 104055 depends on 97178 | 14:36 |
prashanthr_ | yes | 14:36 |
alcabrera | 97178 was updated | 14:36 |
prashanthr_ | right | 14:36 |
alcabrera | and 104055 neds to be rebased | 14:36 |
alcabrera | so the trick I use there | 14:36 |
alcabrera | the easy case: click 'rebase' on 104055 | 14:37 |
alcabrera | if that doesn't work | 14:37 |
alcabrera | you need to git down, which I'll detail in a moment | 14:37 |
mpanetta | git down? | 14:38 |
prashanthr_ | Sure. | 14:38 |
prashanthr_ | I will try the first one. | 14:39 |
prashanthr_ | today i reverted all changes on branch 1 | 14:39 |
prashanthr_ | and reworked completely one another branch | 14:39 |
prashanthr_ | which was quite time consuming. | 14:39 |
alcabrera | sometimes the hardest part of OS development | 14:40 |
alcabrera | is rebase hell | 14:40 |
alcabrera | in the process of making it through reviews | 14:40 |
alcabrera | I've totally been there. :P | 14:40 |
prashanthr_ | alcabrera: ha ha :) | 14:42 |
prashanthr_ | I think i will stall claims and pools reviews | 14:42 |
prashanthr_ | until i get queues and messages | 14:43 |
prashanthr_ | through | 14:43 |
prashanthr_ | and then finally rebase | 14:43 |
alcabrera | makes sense. :) | 14:44 |
alcabrera | prashanthr_: http://lpaste.net/5711959173969739776 | 14:44 |
alcabrera | that details my procedure for rebasing in the face of reviews/changes | 14:44 |
malini | flaper87: yes..not enough pop-tarts | 14:52 |
malini | flaper87: Sorry..was in a meeting | 14:52 |
malini | checking it out now | 14:52 |
alcabrera | heya, malini. :) | 14:52 |
prashanthr_ | alcabrera: this is just woow. Thanks a lot :) | 14:52 |
prashanthr_ | malini, flaper87: Good morning. | 14:53 |
malini | heyyy alcabrera & prashanthr_!! | 14:54 |
alcabrera | prashanthr_: glad you find it helpful. It may need a little tweaking, as the last chance I had an opportunity to practice it was well ove three months ago. :P | 14:55 |
prashanthr_ | alcabrera: This will be bookmarked on all browsers immediately :) | 14:55 |
*** abettadapur has joined #openstack-marconi | 14:56 | |
alcabrera | hahaha, yay! | 14:56 |
prashanthr_ | alcabrera: Meeeeeeting time :) | 15:03 |
alcabrera | oh yeah! | 15:04 |
alcabrera | thanks, prashanthr_ | 15:04 |
alcabrera | I'm all late today. :P | 15:04 |
prashanthr_ | alcabrera: No problems :) | 15:04 |
alcabrera | AAzza, prashanthr_, vkmc: would you all like to join me for a gsoc/opw update? :) | 15:05 |
vkmc | alcabrera, Sure! | 15:05 |
prashanthr_ | prashanthr_: Sure ! | 15:05 |
alcabrera | awesome! | 15:06 |
alcabrera | let's start in reverse order today. :D | 15:06 |
alcabrera | vkmc: could you share the latest? | 15:07 |
vkmc | alcabrera, sure :) | 15:07 |
vkmc | alcabrera, since last week I have been working on the AMQP transport driver | 15:08 |
vkmc | several design decisions came up so I've worked along with flaper87 to come up with something that allows us to take full profit of the performance provided by AMQP while keeping consistency with our way of doing things | 15:09 |
alcabrera | that sounds like quite the challenge! | 15:09 |
*** Obulpath_ has joined #openstack-marconi | 15:09 | |
vkmc | s/to come up with something/to come up with a design | 15:09 |
alcabrera | what next steps do you see for the amqp transport? | 15:10 |
*** Obulpathi has quit IRC | 15:10 | |
vkmc | yeah semantics are really different so it took us some time to define what we wanted to add for this first version | 15:10 |
vkmc | well, the current amqp transport driver can receive messages and store them in the storage backend | 15:10 |
vkmc | but no one can retrieve it those messages yet :p | 15:11 |
alcabrera | hehe | 15:11 |
vkmc | so I'm working on adding a way to allow clients to suscribe to those queues and get the messages | 15:11 |
vkmc | we are going to implement a prod/cons pattern now | 15:11 |
vkmc | the pub/sub pattern is harder since it depends on notifications | 15:11 |
vkmc | I've put up a wiki with all the changes in here... | 15:12 |
vkmc | https://wiki.openstack.org/wiki/Marconi/specs/amqp/api/v1 | 15:12 |
alcabrera | ah! nice! | 15:12 |
vkmc | and the code is in my github repo https://github.com/vkmc/marconi-transport-amqp10 | 15:13 |
vkmc | I'll add instructions of how to use it soon in case someone is curious | 15:13 |
alcabrera | thanks! | 15:13 |
alcabrera | one quick question | 15:13 |
vkmc | sure | 15:14 |
alcabrera | is client.py something that we write? | 15:14 |
*** ChanServ sets mode: +o kgriffs | 15:14 | |
*** flwang_ has joined #openstack-marconi | 15:14 | |
vkmc | nope, is something I wrote | 15:14 |
vkmc | I'll upload it soon | 15:14 |
alcabrera | ah, alright! | 15:14 |
vkmc | it's a simple AMQP client | 15:14 |
alcabrera | on that client.py | 15:14 |
alcabrera | does it also expose an API that can be used to embed the functionality in another python application? | 15:14 |
alcabrera | client:queue.post(subject, body) | 15:15 |
alcabrera | etc. | 15:15 |
*** malini has quit IRC | 15:15 | |
vkmc | yes, it shows how users should use proton to interact with Marconi using AMQP | 15:15 |
vkmc | a very simple version of it | 15:15 |
alcabrera | sweet. :) | 15:16 |
alcabrera | so it sounds like the next steps are to flesh out the design a bit more, to extend the client, and to retrieve mesasges | 15:16 |
vkmc | client.py is a simple way to test the server :) since there is no AMQP 1.0 shell client | 15:16 |
alcabrera | *messages | 15:16 |
vkmc | exactly | 15:16 |
vkmc | the latter is maybe the most important | 15:16 |
alcabrera | agreed. it's just one of those 'must-have' features. ;) | 15:17 |
vkmc | haha yes | 15:17 |
vkmc | now I'm reading Java code flaper87 shared with me | 15:17 |
alcabrera | any other thoughts/updates vkmc? | 15:17 |
vkmc | nothing else for now alcabrera | 15:17 |
vkmc | thanks | 15:17 |
alcabrera | oh yeah, Java. requires coffee to parse. | 15:17 |
alcabrera | thanks, vkmc. :) | 15:17 |
vkmc | haha yes | 15:18 |
alcabrera | prashanthr_: how goes redis, rebasing, and reviews? :) | 15:18 |
*** flwang_ has quit IRC | 15:18 | |
prashanthr_ | alcabrera: It's going really nice and pacy now :) | 15:18 |
prashanthr_ | yes. New set of comments have come in recently from | 15:19 |
prashanthr_ | flwang | 15:19 |
*** malini has joined #openstack-marconi | 15:19 | |
prashanthr_ | for the queues and messages controllers | 15:19 |
prashanthr_ | I was just doing that | 15:19 |
prashanthr_ | meanwhile i have rebased and submitted | 15:19 |
prashanthr_ | new reviews for all my other patches | 15:19 |
prashanthr_ | so they have made their way into the repository :) | 15:19 |
prashanthr_ | I also was interacting with flaper87 | 15:20 |
prashanthr_ | over the last two days | 15:20 |
prashanthr_ | over redis integration into | 15:20 |
prashanthr_ | oslo.cache | 15:20 |
alcabrera | what were flaper87's thoughts? | 15:20 |
kgriffs | helloooooooo | 15:20 |
prashanthr_ | but it seems like they have shifted the design of oslo.cache | 15:20 |
alcabrera | heya, kgriffs. :) | 15:20 |
vkmc | kgriffs, hiiiiiiiii | 15:20 |
alcabrera | ah | 15:20 |
prashanthr_ | https://review.openstack.org/#/c/97155/ | 15:21 |
prashanthr_ | Here is the spec for the new design | 15:21 |
kgriffs | flaper87: ping | 15:21 |
alcabrera | ah, I remember reading about this long ago | 15:21 |
alcabrera | dogpile.cache | 15:21 |
prashanthr_ | it uses a common pattern called dogpile.cache | 15:21 |
prashanthr_ | I had invested two days to code into the redis cache | 15:21 |
prashanthr_ | and all the associated test cases | 15:22 |
prashanthr_ | :( | 15:22 |
kgriffs | dang. Well, at least you gained some experience. :) | 15:22 |
alcabrera | yeah, definitely a bonus for experience. community sometimes shifts like that. | 15:22 |
prashanthr_ | kgriffs, alcabrera: true :) | 15:22 |
alcabrera | you know redis all the better for it | 15:23 |
prashanthr_ | But i feel even with dogpile.cache the API is not going to change | 15:23 |
prashanthr_ | so i feel some parts of the code can still be reused :) | 15:23 |
*** abettadapur has quit IRC | 15:23 | |
alcabrera | hopefully! | 15:23 |
alcabrera | since my understanding | 15:23 |
alcabrera | is that dogpile.cache does not allow for remote caching | 15:23 |
alcabrera | which is a plus for memcache/redis-based solutions | 15:24 |
alcabrera | so I imagine there's a bit of discussion to be had there still | 15:24 |
*** keith_newstadt has quit IRC | 15:24 | |
prashanthr_ | alcabrera: True | 15:24 |
prashanthr_ | flaper87 suggested me to interact with the oslo committee | 15:25 |
prashanthr_ | if I was willing to work | 15:25 |
alcabrera | that's a good idea | 15:25 |
prashanthr_ | So i thought i would study a bit about dogpile | 15:25 |
prashanthr_ | before a approach the team | 15:25 |
prashanthr_ | So I invested sometime into dogpile | 15:25 |
prashanthr_ | and some examples | 15:25 |
kgriffs | If they do move to dogpile does that preclude creating a hierarchical caching driver? E.g., L1 (local), L2 (remote) | 15:25 |
kgriffs | If they are just putting a facade on dogpile.cache's API then there isn't an opportunity to create meta-drivers like that. | 15:26 |
prashanthr_ | hmm kgriffs, I still need to invest some more time into dogpile cache. | 15:26 |
alcabrera | ah, sweet -- http://dogpilecache.readthedocs.org/en/latest/usage.html#creating-backends | 15:27 |
alcabrera | dogpile supports custom backends | 15:27 |
alcabrera | I take it leveraging custom backends | 15:27 |
kgriffs | oic | 15:27 |
alcabrera | one could create hierarchical caching with dogpile | 15:27 |
prashanthr_ | alcabrera: thanks for that. Yes we can create backends | 15:27 |
prashanthr_ | the team has plans for memcached, redis | 15:27 |
prashanthr_ | and couchbase | 15:27 |
alcabrera | you'd just need to encode the TTL semantics onto the chosen backend | 15:27 |
alcabrera | lots of options. :) | 15:28 |
alcabrera | alright | 15:28 |
prashanthr_ | alcabrera: Right. | 15:28 |
alcabrera | so next steps for me | 15:28 |
alcabrera | are to help review your patches prashanthr_. :D | 15:28 |
prashanthr_ | alcabrera: Ha ha yes. | 15:28 |
alcabrera | I'll take some review time between today and tomorrow | 15:28 |
prashanthr_ | sure. | 15:29 |
prashanthr_ | thanks a lot :) | 15:29 |
alcabrera | thank you, too. :) | 15:29 |
prashanthr_ | I will not update my reviews | 15:29 |
prashanthr_ | tonight | 15:29 |
alcabrera | yeah, get some rest! | 15:29 |
alcabrera | any other thoughts/updates prashanthr_? | 15:29 |
prashanthr_ | alcabrera: I am done :). | 15:29 |
alcabrera | thanks! | 15:29 |
alcabrera | AAzza: are you available to share some updates? :) | 15:30 |
AAzza | alcabrera: yes, i'm here | 15:30 |
alcabrera | yay! | 15:30 |
alcabrera | what's the latest? | 15:30 |
AAzza | alcabrera: i was busy making storage unit tests running in pooled setup. just uploaded patches yesterday | 15:31 |
AAzza | alcabrera: really need review, because I have some questions about how to several things | 15:31 |
*** chandankumar has quit IRC | 15:31 | |
alcabrera | I'll give it a review between today and tomorrow. | 15:31 |
peoplemerge | Me too | 15:31 |
alcabrera | to see if I can clarify the gaps. | 15:31 |
AAzza | alcabrera: have no time to try benchmarking, hopefully will do is starting from next monday | 15:32 |
peoplemerge | g'morning all! | 15:32 |
alcabrera | good morning, peoplemerge. :) | 15:32 |
AAzza | peoplemerge: morning) | 15:32 |
vkmc | peoplemerge, hi! | 15:32 |
*** openstackgerrit has joined #openstack-marconi | 15:33 | |
alcabrera | are there any question you'd like to bring up now, AAzza? | 15:33 |
AAzza | alcabrera: hmmm.... | 15:33 |
AAzza | alcabrera: for now - no. | 15:33 |
alcabrera | kk | 15:34 |
alcabrera | I started reading existing comments on your two patches | 15:34 |
*** Alex_Gaynor has left #openstack-marconi | 15:34 | |
alcabrera | I think I'll be able to help | 15:34 |
AAzza | alcabrera: good, thanks) | 15:34 |
alcabrera | any other thoughts/updates to share, AAzza? :) | 15:35 |
*** Obulpath_ has quit IRC | 15:35 | |
prashanthr_ | alcabrera: Also I have begun with py33 compat for redis. Need AAzza's help on this. | 15:35 |
prashanthr_ | oops sry alcabrera | 15:35 |
AAzza | prashanthr_: i'm here to help) | 15:36 |
prashanthr_ | AAzza: thanks :) | 15:36 |
alcabrera | no worries, prashanthr_. | 15:36 |
malini | whee whee whee This is an interesting thread http://www.mail-archive.com/openstack-dev@lists.openstack.org/msg29099.html ..looks like ppl are finally seeing some value in project level functional testing <:o) | 15:36 |
AAzza | alcabrera: no, nothing else) | 15:36 |
alcabrera | thanks, AAzza! | 15:37 |
alcabrera | yay, malini! | 15:37 |
alcabrera | with that, we come to a close on our update meeting. Thanks all for joining in! | 15:37 |
AAzza | from next monday i will be available rarely on irc, but will read and answer everything at least once per day. and surely will review and update my commits. | 15:37 |
alcabrera | thanks for the heads up, AAzza. | 15:38 |
peoplemerge | What's the update meeting? | 15:38 |
prashanthr_ | AAzza: I am getting an error like this | 15:39 |
prashanthr_ | https://etherpad.openstack.org/p/py3-error | 15:39 |
prashanthr_ | when i try | 15:39 |
prashanthr_ | tox -e py33 | 15:39 |
vkmc | peoplemerge, is for OPW/GSoC interns :) | 15:40 |
vkmc | alcabrera, thanks! | 15:40 |
alcabrera | we hold it once a week on Thursdays, peoplemerge. :) | 15:40 |
peoplemerge | vkmc: ah ok! | 15:40 |
AAzza | prashanthr_: it seems you should install also python3-dev | 15:42 |
AAzza | prashanthr_: or package like that. maybe python33-dev for py33) | 15:43 |
*** Obulpathi has joined #openstack-marconi | 15:43 | |
peoplemerge | So regular meeting I have down as TU 8-850 PST. Would it be good to join one held this day of the week since I'm onboarding? | 15:43 |
prashanthr_ | AAzza: Can i work with py32 ? | 15:43 |
alcabrera | prashanthr_: avoid py32, if you can. | 15:44 |
kgriffs | btw, folks, we need to go into crunch mode | 15:44 |
kgriffs | py32 is BAAADNESS | 15:45 |
alcabrera | py33 adds many compatibility features that make it possible to work with py2.6+ | 15:45 |
kgriffs | mostly because it doesn't support the u prefix on strings. :p | 15:45 |
prashanthr_ | alcabrera,kgriffs: Ahh got it. Strings are the large part of the compatibility :D :P | 15:45 |
AAzza | prashanthr_: if you use ubuntu in has some ppa for all major python versions. | 15:46 |
alcabrera | peoplemerge: I'd like to limit the Thursday meeting updates to interns-only, but you're welcome to join in and ask questions. :) | 15:46 |
peoplemerge | alcabrera: ok will do | 15:46 |
vkmc | brb | 15:46 |
alcabrera | kgriffs: crunch time? | 15:46 |
AAzza | prashanthr_: it doesn't work very well, but at least it is a way to install. https://launchpad.net/~fkrull/+archive/ubuntu/deadsnakes | 15:47 |
peoplemerge | I sent in a patch to review yesterday. I see how they'll appear in review now, I see the commit message could have been more consise in the beginning. | 15:49 |
peoplemerge | kgriffs: vkmc: could sb have a peek at 105830? | 15:51 |
malini | kgriffs: welcome back! I thought you went into the vacation black hole :) | 15:52 |
peoplemerge | I figured I could start with the simplest test that could possbibly (not) work. | 15:52 |
*** amitgandhi has quit IRC | 15:53 | |
peoplemerge | kgriffs: ah you probably have lot of catchup! | 15:53 |
kgriffs | yep, I'm still trying to sort out what everyone's been up to. :) | 15:54 |
kgriffs | anyway, I just want to highlight we have ~12 days left in j-2 | 15:54 |
kgriffs | and a TON OF WORK LEFT | 15:54 |
kgriffs | https://launchpad.net/marconi/+milestone/juno-2 | 15:54 |
kgriffs | I'd like to slip as little as possible. I just assigned myself to a few items | 15:55 |
prashanthr_ | AAzza: Yup i installed the headers | 15:55 |
kgriffs | We need everyone to focus on j-2 bps and bugs | 15:55 |
prashanthr_ | and now it's setup | 15:55 |
kgriffs | and pretty please do lots of reviews so that doesn't become the bottleneck. :D | 15:55 |
peoplemerge | kgriffs: is msgpack on the critical path for j-2? | 15:55 |
kgriffs | I think so, because I'd like to have v1.1 squared away for j-3 so it has a full milestone to bake and be debugged. | 15:56 |
openstackgerrit | A change was merged to openstack/marconi: Start scratching Queue Flavors api https://review.openstack.org/98777 | 15:56 |
kgriffs | I suspect client SDK authors may have some 1.1 feedback during j-3 too that we want to address | 15:56 |
peoplemerge | Good, I have the time now, but it may take some input. I'll definitely do reviews. | 15:57 |
kgriffs | rock on | 15:58 |
kgriffs | thanks man | 15:58 |
* flaper87 back | 15:59 | |
flaper87 | kgriffs: HELLOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO | 15:59 |
*** amitgandhi has joined #openstack-marconi | 15:59 | |
peoplemerge | flaper87: Hey! | 16:00 |
flaper87 | peoplemerge: hey hey :D | 16:01 |
flaper87 | kgriffs: we also need tons of reviews | 16:01 |
*** prashanthr_ has quit IRC | 16:02 | |
kgriffs | o/ | 16:03 |
flaper87 | kgriffs: how are you? Hope you had a great time off | 16:04 |
kgriffs | it was nice. Colorado is lovely in the summer. :D | 16:04 |
kgriffs | Was there visiting family | 16:04 |
kgriffs | flaper87: I think the rename will have to wait until j-3 | 16:05 |
kgriffs | Marconi --> Naav | 16:06 |
kgriffs | what do you think? | 16:06 |
flaper87 | kgriffs: agreed | 16:07 |
flaper87 | kgriffs: re flavors, with enough reviews we can get it done for j-2 | 16:08 |
flaper87 | I'm almost done with the API too | 16:08 |
flaper87 | and I won't do sqlalchemy | 16:08 |
flaper87 | (based on our latest agreements w.r.t that driver) | 16:08 |
*** keith_newstadt has joined #openstack-marconi | 16:09 | |
kgriffs | ok | 16:10 |
kgriffs | makes sense | 16:10 |
kgriffs | flaper87: re the API, is that documented yet on the wiki? I assume this will be part of v1.1? | 16:11 |
flaper87 | kgriffs: part of v1.1 yup, documented not yet. I'm planning to do so soon. It's actually part of the control API which we have not documented yet | 16:11 |
flaper87 | (AFAIK) | 16:11 |
flaper87 | oh mmh | 16:12 |
*** ykaplan has quit IRC | 16:12 | |
flaper87 | oh no yeah, that's control API, the queue flavor goes into the queue's metadata | 16:12 |
flaper87 | oh well, I guess j-2 is too optimistic | 16:12 |
flaper87 | but lets not push it back yet | 16:12 |
malini | flaper87: w.r.t the tests for storage API for https://review.openstack.org/#/c/90202/ - did you intend these https://github.com/openstack/marconi/tree/master/tests/unit/queues/storage ? | 16:13 |
*** whenry has joined #openstack-marconi | 16:13 | |
flaper87 | malini: yup | 16:14 |
kgriffs | kk | 16:14 |
malini | flaper87: thx! | 16:15 |
peoplemerge | Searched for marconi,status:open and started looking at Sriram's review 98875, could be really useful to what I'm doing, but looks like kgriffs you've already checked it out. Is there somewhere I should start? | 16:16 |
*** ykaplan has joined #openstack-marconi | 16:19 | |
*** ykaplan has quit IRC | 16:27 | |
*** Obulpathi has quit IRC | 16:30 | |
*** Obulpathi has joined #openstack-marconi | 16:31 | |
*** Obulpathi has quit IRC | 16:35 | |
*** vkmc has quit IRC | 16:43 | |
*** chandankumar has joined #openstack-marconi | 16:45 | |
*** flaper87 is now known as flaper87|afk | 16:51 | |
*** reed has joined #openstack-marconi | 16:54 | |
*** denis_makogon has quit IRC | 16:55 | |
*** vkmc has joined #openstack-marconi | 16:56 | |
*** vkmc has quit IRC | 16:56 | |
*** vkmc has joined #openstack-marconi | 16:56 | |
* peoplemerge is looking into the requirements*.txt updates from global | 17:00 | |
peoplemerge | there are several requiring simple rebases | 17:00 |
*** amitgandhi has quit IRC | 17:04 | |
*** Obulpathi has joined #openstack-marconi | 17:07 | |
kgriffs | peoplemerge: I need to go back and take a second pass on that, but I think the plan was to get it "good enough" and we can do more polishing in a follow up patch | 17:28 |
kgriffs | (re the benchmarking patch) | 17:29 |
peoplemerge | kgriffs: ah ok | 17:33 |
*** cpallares has quit IRC | 17:34 | |
*** cpallares has joined #openstack-marconi | 17:34 | |
peoplemerge | I'm looking into the requirements updates now, the pythonclient (99093) should merge fine... but I'd like to get a gut check on code coverage. | 17:38 |
kgriffs | I think that one is fine since Jenkins gave it a +1 | 17:39 |
peoplemerge | specifically do we have enough coverage to +1? I cherrypicked this and started running tests but haven't figured how to measure coverage | 17:39 |
peoplemerge | Thought so, just wanted to be safe and ask | 17:39 |
kgriffs | oh, wrt test coverage there is a tox job | 17:40 |
kgriffs | tox -e cover | 17:40 |
kgriffs | see if that works | 17:40 |
peoplemerge | ahhh | 17:40 |
kgriffs | usually for requirements.txt changes proposed by the bot we just fast-track those, requiring a single +2 to merge, since they are really just syncing with the global-requirements.txt | 17:41 |
peoplemerge | what's everyone using for multiple python version? I just downloaded pyenv and have been switching between em by hand each time | 17:41 |
peoplemerge | nice | 17:41 |
kgriffs | oh, I usually just use tox | 17:41 |
kgriffs | tox uses virtualenv iirc | 17:42 |
kgriffs | so, if you have ran a tox test, say | 17:42 |
kgriffs | tox -e py27 | 17:42 |
peoplemerge | yeah.. so do you have all necessary pythons in your system path? | 17:42 |
peoplemerge | right me too | 17:42 |
peoplemerge | My desktop is trusty which doesn't have a 3.3 package -- 3.4 only | 17:42 |
peoplemerge | etc | 17:42 |
kgriffs | and you want to manually go in there and, e.g., run pdb you can do "source .tox/py27/bin/activate" | 17:43 |
peoplemerge | it's going to get irritating fast to swich among all them | 17:43 |
kgriffs | oh, yeah, I just make sure I have system versions installed for all the tox envs | 17:43 |
kgriffs | tox is pretty good at discovering what you have installed | 17:43 |
peoplemerge | ok sounds better | 17:43 |
kgriffs | speaking of 3.4, we should add an env for that | 17:44 |
kgriffs | :) | 17:44 |
peoplemerge | Does upstream already support it? | 17:44 |
peoplemerge | & critical for j2? | 17:45 |
kgriffs | mmm, good question. I thought I heard they now had trusty | 17:45 |
kgriffs | peoplemerge: nah, this is low priority | 17:45 |
peoplemerge | ya | 17:45 |
kgriffs | j3, low priority I'd say | 17:45 |
*** AAzza is now known as AAzza_afk | 17:45 | |
*** vkmc_ has joined #openstack-marconi | 17:46 | |
kgriffs | fwiw, I've ran into a similar issue with 3.3/3.4 on my MBP | 17:46 |
kgriffs | brew formula was updated to install 3.4, and there is no 3.3 option any more | 17:47 |
peoplemerge | ya | 17:47 |
kgriffs | Im going to try the official installer next | 17:48 |
kgriffs | https://www.python.org/downloads/release/python-335/ | 17:48 |
peoplemerge | I've been switching between projects too and have found it easier to do a fresh install of my workstation every time I switch. I've got it all pretty automated so it's a 20 minute swap | 17:48 |
*** vkmc has quit IRC | 17:49 | |
*** vkmc_ is now known as vkmc | 17:49 | |
*** vkmc has quit IRC | 17:49 | |
*** vkmc has joined #openstack-marconi | 17:49 | |
kgriffs | vkmc: hey there o/ | 17:49 |
kgriffs | vkmc: did we ever reach a conclusion about pylint? | 17:49 |
kgriffs | peoplemerge: that's some serious swap! | 17:50 |
kgriffs | maybe docker can help? ;) | 17:50 |
*** amitgandhi has joined #openstack-marconi | 17:50 | |
peoplemerge | I just got frustrated with devstack clean not working | 17:50 |
kgriffs | heh | 17:50 |
peoplemerge | That was part of the problem actually :/ | 17:50 |
openstackgerrit | A change was merged to openstack/python-marconiclient: Updated from global requirements https://review.openstack.org/99093 | 17:50 |
kgriffs | devstack needs to be rewritten to use containers | 17:50 |
peoplemerge | would be nice | 17:50 |
kgriffs | just my %0.02 | 17:51 |
kgriffs | s/$/% | 17:51 |
peoplemerge | Hey I'm a huge fan of docker | 17:51 |
peoplemerge | it'll be hard to make something be everything to everyone tho | 17:51 |
peoplemerge | It's handy to not do vm-inside-vm sometimes | 17:52 |
* peoplemerge is looking at pythonz to install all these versions for me | 17:53 | |
peoplemerge | pyenv doesn't seem to want to do multiple simultaneous system installs | 17:54 |
malini | peoplemerge: I believe they don't recommend installing devstack in ur real work machines :) | 17:56 |
malini | I wonder where I got tht idea *-) | 17:58 |
kgriffs | heh | 17:58 |
peoplemerge | malini: yah, I have a dedicated machine for devstack at work, and a dedicated machine at home | 17:58 |
kgriffs | if devstack isn't useful on your work box, and it also doesn't accurately reflect a real production deployment, what's the point of it? | 17:58 |
malini | It was written in pre-container era, & probably fit the needs then | 17:59 |
kgriffs | I suppose it is useful in a way, but I'd much prefer something that treats the services as truly decoupled (SOA anyone?) | 17:59 |
peoplemerge | What's been working well is a desktop bridge that has irc in screen session, dual homed to my openstack dev box that gets a clean OS about 1x/week. | 18:00 |
kgriffs | If only the infra team had, like, 2x as many people as they do now they may have the bandwidth to work on rewriting devstack | 18:00 |
kgriffs | :p | 18:00 |
peoplemerge | No risk of a rogue DHCP server messing with our netadmins :) | 18:01 |
kgriffs | rock on | 18:01 |
kgriffs | hmm... I think I will start using pyenv to run multiple ipython sessions when I am playing around with behavior and benchmarking stuff across different python versions | 18:02 |
*** tedross has quit IRC | 18:02 | |
* kgriffs goes off to do that | 18:02 | |
*** keith_newstadt has quit IRC | 18:09 | |
*** keith_newstadt has joined #openstack-marconi | 18:10 | |
kgriffs | ok folks, I'll be back later. lunch and all that. I'll try and get some reviews done later today (still trying to catch up since being gone) | 18:12 |
*** kgriffs is now known as kgriffs|afk | 18:13 | |
*** mwagner_lap has quit IRC | 18:21 | |
*** tedross has joined #openstack-marconi | 18:25 | |
*** mwagner_lap has joined #openstack-marconi | 18:41 | |
*** mkoderer has quit IRC | 18:52 | |
*** malini has quit IRC | 18:54 | |
*** kgriffs|afk is now known as kgriffs | 18:57 | |
peoplemerge | eww, py26 on trusty was painful. Required code change in setup.py - libdirs missing /usr/lib/x86_64-linux-gnu | 19:05 |
peoplemerge | google...dig dig dig ... google ... | 19:06 |
*** amitgandhi has quit IRC | 19:17 | |
*** chandankumar has quit IRC | 19:25 | |
*** Obulpathi has quit IRC | 19:27 | |
*** Obulpathi has joined #openstack-marconi | 19:28 | |
*** flaper87|afk is now known as flaper87 | 19:30 | |
*** tedross has quit IRC | 19:34 | |
*** kgriffs is now known as kgriffs|afk | 19:34 | |
vkmc | kgriffs|afk, hey K, I should it today | 19:50 |
*** keith_newstadt has quit IRC | 20:06 | |
*** keith_newstadt has joined #openstack-marconi | 20:07 | |
*** amitgandhi has joined #openstack-marconi | 20:10 | |
*** cpallares has quit IRC | 20:46 | |
*** cpallares has joined #openstack-marconi | 20:46 | |
*** sriram has quit IRC | 20:46 | |
*** jay-atl has joined #openstack-marconi | 20:49 | |
*** alcabrera is now known as alcabrera|afk | 20:54 | |
*** mwagner_lap has quit IRC | 20:56 | |
*** flaper87 is now known as flaper87|afk | 20:57 | |
*** mpanetta has quit IRC | 21:06 | |
*** rossk has joined #openstack-marconi | 21:11 | |
*** jmckind has quit IRC | 21:15 | |
*** flwang_ has joined #openstack-marconi | 21:16 | |
*** flwang_ has quit IRC | 21:21 | |
*** Obulpathi has quit IRC | 21:26 | |
vkmc | peoplemerge, how are you doing with msgpack? | 21:29 |
vkmc | peoplemerge, I checked out your patchset but probably you will get a better review from some core dev :) | 21:29 |
peoplemerge | vkmc: can you review | 21:29 |
peoplemerge | nice! | 21:30 |
peoplemerge | I just wanted to see if I was coding in the right direction | 21:30 |
vkmc | I'll add my humble comments though :) | 21:30 |
peoplemerge | if you 'grep json marconi' there is a _lot_ | 21:30 |
vkmc | yes... every single piece of code uses json for something | 21:30 |
peoplemerge | not all in the transport | 21:31 |
peoplemerge | so sorry, got to run to a meeting... day job :( | 21:31 |
vkmc | if I understood correctly, you have to add support for msgpack in the transport v1.1 API? | 21:32 |
vkmc | np | 21:32 |
vkmc | just wanted you to know that was someone reviewing your patch | 21:32 |
vkmc | peoplemerge, ttfn o/ | 21:32 |
*** cpallares has quit IRC | 21:34 | |
*** amalagon has quit IRC | 22:02 | |
*** amitgandhi has quit IRC | 22:16 | |
*** oz_akan_ has quit IRC | 22:21 | |
*** reed has quit IRC | 22:32 | |
*** rwsu has quit IRC | 22:32 | |
*** dmitryme has quit IRC | 22:32 | |
*** ametts has quit IRC | 22:32 | |
*** vkmc has quit IRC | 22:32 | |
*** rektide has quit IRC | 22:33 | |
*** rossk has quit IRC | 22:33 | |
*** pquerna has quit IRC | 22:33 | |
*** haomaiw__ has quit IRC | 22:33 | |
*** jraim has quit IRC | 22:33 | |
*** ciypro|afk has quit IRC | 22:33 | |
*** jay-atl has quit IRC | 22:33 | |
*** openstackgerrit has quit IRC | 22:33 | |
*** ekarlso has quit IRC | 22:33 | |
*** boris-42 has quit IRC | 22:33 | |
*** whenry has quit IRC | 22:33 | |
*** malini|afk has quit IRC | 22:33 | |
*** peoplemerge has quit IRC | 22:33 | |
*** AAzza_afk has quit IRC | 22:33 | |
*** tmu_ has quit IRC | 22:33 | |
*** sebasmagri has quit IRC | 22:33 | |
*** keith_newstadt has quit IRC | 22:33 | |
*** fifieldt has quit IRC | 22:33 | |
*** Ephur has quit IRC | 22:33 | |
*** megan_w has quit IRC | 22:33 | |
*** wpf has quit IRC | 22:33 | |
*** kgriffs|afk has quit IRC | 22:33 | |
*** VeggieMeat has quit IRC | 22:33 | |
*** lvh has quit IRC | 22:33 | |
*** alcabrera|afk has quit IRC | 22:33 | |
*** flaper87|afk has quit IRC | 22:33 | |
*** ChanServ has quit IRC | 22:33 | |
*** dmitryme has joined #openstack-marconi | 22:36 | |
*** rwsu has joined #openstack-marconi | 22:36 | |
*** rossk has joined #openstack-marconi | 22:36 | |
*** jay-atl has joined #openstack-marconi | 22:36 | |
*** keith_newstadt has joined #openstack-marconi | 22:36 | |
*** vkmc has joined #openstack-marconi | 22:36 | |
*** whenry has joined #openstack-marconi | 22:36 | |
*** openstackgerrit has joined #openstack-marconi | 22:36 | |
*** ametts has joined #openstack-marconi | 22:36 | |
*** haomaiw__ has joined #openstack-marconi | 22:36 | |
*** boris-42 has joined #openstack-marconi | 22:36 | |
*** rektide has joined #openstack-marconi | 22:36 | |
*** fifieldt has joined #openstack-marconi | 22:36 | |
*** Ephur has joined #openstack-marconi | 22:36 | |
*** jraim has joined #openstack-marconi | 22:36 | |
*** malini|afk has joined #openstack-marconi | 22:36 | |
*** megan_w has joined #openstack-marconi | 22:36 | |
*** ekarlso has joined #openstack-marconi | 22:36 | |
*** peoplemerge has joined #openstack-marconi | 22:36 | |
*** AAzza_afk has joined #openstack-marconi | 22:36 | |
*** ciypro|afk has joined #openstack-marconi | 22:36 | |
*** wpf has joined #openstack-marconi | 22:36 | |
*** pquerna has joined #openstack-marconi | 22:36 | |
*** kgriffs|afk has joined #openstack-marconi | 22:36 | |
*** VeggieMeat has joined #openstack-marconi | 22:36 | |
*** lvh has joined #openstack-marconi | 22:36 | |
*** alcabrera|afk has joined #openstack-marconi | 22:36 | |
*** flaper87|afk has joined #openstack-marconi | 22:36 | |
*** tmu_ has joined #openstack-marconi | 22:36 | |
*** sebasmagri has joined #openstack-marconi | 22:36 | |
*** ChanServ has joined #openstack-marconi | 22:36 | |
*** dickson.freenode.net sets mode: +ooo kgriffs|afk flaper87|afk ChanServ | 22:36 | |
*** reed has joined #openstack-marconi | 22:39 | |
*** flwang_ has joined #openstack-marconi | 23:17 | |
*** flwang_ has quit IRC | 23:22 | |
*** alcabrera|afk is now known as alcabrera | 23:40 | |
*** prashanthr_ has joined #openstack-marconi | 23:44 | |
openstackgerrit | OpenStack Proposal Bot proposed a change to openstack/marconi: Updated from global requirements https://review.openstack.org/104385 | 23:51 |
*** alcabrera is now known as alcabrera|afk | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!