15:11:26 #startmeeting marconi-team 15:11:27 Meeting started Tue Jan 7 15:11:26 2014 UTC and is due to finish in 60 minutes. The chair is kgriffs. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:11:28 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:11:30 The meeting name has been set to 'marconi_team' 15:11:34 o/ 15:11:35 #topic Review actions from last time 15:11:46 damnit, I hate that topic 15:11:49 * kgriffs calls on the gentlemen in the red hat 15:12:10 #link http://eavesdrop.openstack.org/meetings/marconi/2013/marconi.2013-12-17-15.11.html 15:12:30 kgriffs to create bp for notifications based on brainstorming session 15:12:31 oops 15:12:33 Client patches, half done 15:12:34 never happened 15:12:51 flaper87: kk 15:12:54 BUT 15:12:56 I wonder what's holding things up? 15:12:57 I've a BUT! 15:13:01 * kgriffs ducks 15:13:13 kgriffs: you're holding half of that action item 15:13:14 :D 15:13:18 the message part was implemented 15:13:18 :P 15:13:29 #action kgriffs to finish reviewing client patchez 15:13:36 the claim is still pending BUT in my defense I found a new guy - sebasmagri - that will work on that 15:13:37 w00t 15:13:42 there, now I *have* to do it. :D 15:13:45 that's how we roll 15:13:47 :D 15:13:47 sweet 15:13:57 * kgriffs likes new contributors 15:14:05 ask yeela to attend to Marconi's meetings 15:14:05 We're lacking of half feature but gained a new contributor 15:14:14 flaper87: ^^^ 15:14:21 :) 15:14:24 thanks flaper87 15:14:25 ykaplan: please, join the meeting :) 15:14:30 kgriffs: ^^^ just did 15:14:32 :D 15:14:37 huahauhauha 15:14:38 what's up with sqlite anyway? 15:14:41 oops 15:14:45 I meant sqlalchemy 15:14:57 I guess we'll get to that shortly 15:14:59 so, tables and the datadriver were merged 15:15:10 she's already working on the queue controller 15:15:32 ykaplan: right? ^^^ 15:15:51 flaper87, kgriffs: right :) 15:16:00 awesome. :) 15:16:03 excellent 15:16:15 #action ykaplan to finish up queue controller 15:16:23 ykaplan: so happy you're here! kgriffs had a shotgun in his hands and he was starring at me! 15:16:25 there, now you have to do it. :D 15:16:31 lol 15:16:32 Now he can stare at you! 15:16:36 the power of actions 15:16:36 ykaplan: ^ 15:16:38 * kgriffs stares 15:16:38 :D 15:17:00 one mores 15:17:01 kgriffs to finish up v1.1 api spec 15:17:09 flaper87: ;) 15:17:17 so, I have first draft ready 15:17:17 https://wiki.openstack.org/wiki/Marconi/specs/api/v1.1 15:17:28 awesome 15:17:29 please take a look. We will be reviewing it in future meetings 15:17:34 (piece by piece) 15:17:34 any changes to the API so far? 15:17:38 #link https://wiki.openstack.org/wiki/Marconi/specs/api/v1.1 15:18:55 flaper87: there is a list 15:18:58 +1 for x-project-id header change. 15:19:05 #link https://wiki.openstack.org/wiki/Marconi/specs/api/v1.1#Changes_from_v1.0 15:19:16 "Changes from v1.0" 15:19:26 I like this section - very concise. 15:19:29 so, I don't want to spend a lot of time on it just now - let's reserve that for future meetings 15:19:58 or, feel free to ping my anytime in this channel to discuss parts of it 15:20:10 yeah, I'll read that off-line 15:20:13 kk 15:20:33 next topic 15:20:34 #action everyone to review the 1.1 spec and share feedback 15:20:50 cool 15:20:50 * flaper87 wonders who's that guy.... 15:20:54 yup, let's move along 15:20:58 Icehouse Roadmap 15:21:01 #topic Icehouse Roadmap 15:21:09 so, I guess we already discussed this some last time 15:21:26 #link https://blueprints.launchpad.net/marconi/icehouse 15:21:27 I'm trying to remember why it was still on the agenda. :p 15:21:31 this is looking good! 15:21:41 kgriffs: I think you didn't remove it 15:21:42 :) 15:21:44 ah, yes 15:21:48 well, um... 15:21:51 * kgriffs coughs into hand 15:21:55 next topic 15:21:58 yup 15:21:58 one moment 15:22:02 :D 15:22:20 everyone please note that if you want something in i-2 it needs to be assigned that milestone AND needs an "assignee" 15:22:34 that is all 15:22:35 carry on 15:23:05 I will try to backfill stuff but if you notice something missing a milestone or assignee, please feel free to update it 15:23:22 Review Graduation BPs/Bugs 15:23:31 #topic Review Graduation BPs/Bugs 15:23:53 Graduation check is just a month away! 15:24:03 #link https://wiki.openstack.org/wiki/Marconi/Incubation/Graduation 15:24:12 alcabrera: about that 15:24:31 I think we will be removing the graduation milestone and creating an umbrella blueprint for all of these instead 15:24:40 (as recommended by ttx) 15:24:53 #action kgriffs to remove graduation milestone and create umbrella bp 15:24:59 anyway 15:25:04 let's go through these 15:25:04 * flaper87 thinks it'll be really hard to make it for Ith 15:25:11 lets keep fighting for that, though 15:25:16 agreed 15:25:18 (on both counts) 15:25:19 yes 15:25:30 ok, 15:25:35 so first up in API 1.1 15:25:37 is the umbrella blue print just an organizational thing or does it have an affect on graduation? 15:25:38 what is blocking us from Ith? 15:25:44 megan_w: organizational 15:25:47 k 15:25:53 malini: https://wiki.openstack.org/wiki/Marconi/Incubation/Graduation 15:25:58 all that 15:26:01 it's what the openstack release team would like us to do 15:26:13 flaper87: :D 15:26:13 do we know the progress on each item 15:26:27 starting with icehouse-2 we are going to be following official release procedures. 15:26:42 amitgandhi: let's go over that now 15:27:10 btw, let me introduce balajiiyer to the team 15:27:16 ok 15:27:21 * kgriffs give amitgandhi the floor 15:27:34 marconi team - meet balajiiyer 15:27:34 Hello everyone 15:27:39 balajiiyer: meet the marconi team 15:27:48 balajiiyer: yooooooooooooooo 15:27:57 balajiiyer: is one of our software managers and senior devs in atl 15:27:57 balajiiyer: please, tell me you're a coder and you'll contribute to marconi 15:27:58 balajiiyer: welcome o/ 15:28:06 we are moving him into contributing on marconi 15:28:13 w000000000000000000000000000000000000000000000000000000000000000000000000t 15:28:15 Im a coder and will contribute to marconi 15:28:19 :) 15:28:22 he spent his christmas break getting up to speed with the code and environment 15:28:26 balajiiyer: welcome! :D 15:28:41 balajiiyer: awesome, awesome... I'm italian and I'll bring nutella, pasta and many other italian things to ATL just for you! 15:28:42 balajiiyer: you would have got some poptarts, if not for the health stuff ;) 15:28:53 * flaper87 hopes that means sometihng 15:29:02 flaper87: balajiiyer is also our health advocate here 15:29:03 flaper87: awesome, I love italian food. I can code for pizza 15:29:13 welcome man, glad to see you! 15:29:17 balajiiyer: tht is going to ATL mailing list 15:29:49 ok, back to the grad items 15:29:54 * kgriffs almost made an action item for pasta 15:30:00 ok, so api 1.1 15:30:06 I have that targeted to i-3 15:30:15 and started since I got the spec drafted 15:30:42 next we have SQL driver 15:31:03 ykaplan gave her update on that earlier 15:31:38 next is client lib 15:31:41 #link https://blueprints.launchpad.net/marconi/+spec/api-v1.1 15:32:07 the hot news there is we will have an alpha version on pypi soon-ish! 15:32:22 #link https://blueprints.launchpad.net/python-marconiclient/+spec/python-marconiclient-v1 15:32:28 yeah, so, the client is in good shape 15:32:37 message support is about to be merged 15:32:40 kgriffs: right? ;) 15:32:43 * kgriffs just realized he pasted the wrong link! 15:32:48 heh 15:32:53 i certainly hope so 15:32:54 I also added the support shards 15:32:58 * kgriffs tells his clone to get to work 15:33:02 and sebasmagri will work on claims 15:33:07 cool 15:33:16 so, sounds like we are making good progress there 15:33:17 which will make the client feature complete 15:33:26 excellent 15:33:36 yeah, we're like 2 features away from having a complete client 15:33:43 W00T 15:33:48 * alcabrera is excited about the client 15:33:59 we really need to release an alpha version, though. The next items depend on that 15:34:03 yep 15:34:09 thanks segue dude! 15:34:11 #link https://blueprints.launchpad.net/marconi/+spec/heat-template 15:34:23 blocked by client 15:34:36 kgriffs: last time I checked, he was making some progress but the client blocked him 15:35:11 * kgriffs hates seques. Fell off one once. 15:35:17 flaper87: kk 15:35:34 devstack integration is DONE 15:35:48 sweet 15:35:51 =D 15:35:54 malini... 15:35:58 #link https://blueprints.launchpad.net/marconi/+spec/tempest-integration 15:36:04 thts in progress https://review.openstack.org/#/q/topic:bp/add-basic-marconi-tests,n,z 15:36:26 I got some feedback y'day on the tempest patch 15:36:33 would you call it "slow progress" or "good progress" ? 15:36:51 its slow progress - because of delays in getting reviews 15:36:54 kk 15:37:33 next 15:37:40 balajiiyer... 15:37:42 #link https://blueprints.launchpad.net/marconi/+spec/pecan-framework 15:37:57 I have started looking at that blueprint 15:38:19 Hoping to make that bp started by this week 15:38:26 ok, cool 15:38:33 I'll help balajiiyer get ramped up on that. :) 15:38:42 ok 15:38:42 alcabrera: +1 15:38:55 remember, we don't have to implement everything 15:38:59 alcabrera: thanks 15:39:17 I'd say, lets focus on the base features (creating queues, post messages) 15:39:25 but, what we do implement we should try to be as "idiomatic" Pecan as possible - meaning, it should do it the "recommended Pecan way" 15:39:35 sounds good 15:39:37 lest make sure they are both super optimized and that we can test this stuff once and for all 15:39:38 don't worry about claims 15:39:39 stats 15:39:41 etc. 15:39:49 kgriffs: ok, sounds good 15:39:53 I also am planning to count LOC 15:39:55 ;) 15:40:01 LOOOL 15:40:06 heh. :P 15:40:11 :) 15:40:15 what about complexity maccabe scores =P 15:40:20 pecan is winning right now - 0 LOC 15:40:21 and NOC (number of commits) 15:40:22 :P 15:40:26 amitgandhi: good idea! 15:40:28 * kgriffs adds to list 15:41:01 side bar 15:41:19 Falcon has 445 stars on github. Just sayin' 15:41:25 :D 15:41:40 lol 15:41:44 446* 15:41:48 :D 15:41:59 Just sayin' 15:42:00 yes, everyone go star it right now 15:42:01 :D 15:42:04 :D 15:42:04 hahgahahha 15:42:54 next ? 15:42:56 next BP? :P 15:43:01 "Get into the service catalog" 15:43:08 mhh, that's done 15:43:10 so, i found out we just need to document our service name 15:43:18 it is up to providers to put it in if they want 15:43:25 yeah! 15:43:30 Done in devstack, I mean 15:43:40 flaper87: can you document the name on the wiki? 15:43:46 that you used in devstack? 15:43:46 kgriffs: yup 15:43:50 cook, thanks! 15:43:56 my pleasure! 15:44:05 #action flaper87 to document service catalog name - make it canonical or whatever 15:44:20 next is horizon integration 15:44:28 #link https://blueprints.launchpad.net/marconi/+spec/marconi-horizon-integration 15:44:41 I am going to make this low priority 15:44:51 erm, everytime I read that BP, I just focus on the "nice to have" part of it 15:44:53 I think we will have a hard time getting everything else done for icehouse as it is 15:44:54 :P 15:45:28 agreed re: horizon 15:45:41 I am going to assign it to balajiiyer 15:45:44 just for fun. 15:45:47 LOL 15:45:57 ok, i do have a reason 15:46:14 im thinking of potentially pulling one of our UX guys onto that but that cant happen until mid feb probably 15:46:16 he has the most web frontend experience 15:46:23 ok 15:46:29 amitgandhi: let me know and we can reassign 15:46:34 ok 15:46:44 although 15:46:48 TBH, we could also get some horizon dev to do it 15:46:58 I mean, ask if someone would like to stab that 15:46:59 i have learned that being assigned to a bp just means you are responsible for reporting status each week 15:47:04 not necessarily implementing all of it 15:47:06 but, cough cough cough, we need the client 15:47:11 yep 15:47:23 last item 15:47:24 "Focus on a single transport - avoid scope creep" 15:47:29 sort of a meta-blueprint 15:47:39 we discussed this recently 15:47:42 I think we are ok there 15:48:04 yeah, lets focus on wsgi for graduation the rest is just R&D for now 15:48:22 doing multiple-transports is going to run as a side-by-side experiment. If it pans out, cool beans. If not, then we can claim innocence. 15:49:12 ok, any other bps anyone wants to discuss before we move on to bugs? 15:49:41 mmh, 10 mins left 15:49:45 :/ 15:49:48 yeah 15:50:01 well, heck, we are in our own channel this week, so no conflicts! :p 15:50:08 LOL 15:50:11 #topic Updates on bugs 15:50:54 #link https://bugs.launchpad.net/marconi/+bugs?field.searchtext=&orderby=-importance&search=Search&field.status%3Alist=NEW&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE&assignee_option=any&field.assignee=&field.bug_reporter=&field.bug_commenter=&field.subscriber=&field.structural_subscriber=&fie 15:50:54 ld.tag=&field.tags_combinator=ANY&field.has_cve.used=&field.omit_dupes.used=&field.omit_dupes=on&field.affects_me.used=&field.has_patch.used=&field.has_branches.used=&field.has_branches=on&field.has_no_branches.used=&field.has_no_branches=on&field.has_blueprints.used=&field.has_blueprints=on&field.has_no_blueprints.used=&field.has_no_blueprints=on 15:50:58 crappies 15:51:02 yikes 15:51:03 let me try that again 15:51:04 MY EYES! 15:51:08 http://goo.gl/7lIJ4q 15:51:10 much better 15:51:38 first three - no changes afaik. I am still tring to get to the autoreconnect one. 15:52:05 I've been working on 3 bugs, I could give updates about those 15:52:09 ok 15:52:11 go for it 15:52:24 1) https://bugs.launchpad.net/marconi/+bug/1261579 15:52:30 I've a quesiton there 15:52:53 We said we're going to count the whole body request and limit based on that 15:53:28 BUT, if we do that, we'll be also counting ttl, {}, [], etc as part of the message 15:53:49 should we iterate over the message list and sum up the size of the message content? 15:54:03 mmm 15:54:09 that sounds a bit slow 15:54:20 OR 15:54:22 you might do it using a regex or something, but yeah 15:54:23 slow 15:54:25 I think it's fine just counting the content length. 15:54:32 let's just KISS 15:54:44 alcabrera: yeah, that was my OR 15:54:45 Considering that the TTLs and symbols that aren't the message body would add maybe 100 bytes. 15:54:48 if people complain, we can throw in some fudge room 15:54:50 but let me add something 15:55:00 * kgriffs listens 15:55:04 we should also advice users with a +/- valid max_size 15:55:15 for example: If you want the max size to be 256 15:55:37 we recommend using 512 because most of the rquest size is consumed by the json crap 15:55:41 or something like that 15:56:14 I had another idea when you mentioned +/-, flaper87. 15:56:19 alcabrera: shoot 15:56:21 When a person goes over the message size limit 15:56:31 We can return as part of the error message by how much they went over. 15:56:46 +1 15:56:52 make it so 15:56:59 ok, so, content-length <= max_size 15:57:10 flaper87: yup 15:57:13 2) https://bugs.launchpad.net/marconi/+bug/1244228 15:57:14 megan_w: what do you think about this? 15:57:23 actually 15:57:25 #link https://bugs.launchpad.net/marconi/+bug/1244228 15:57:37 megan_w: we are going to redefine max message size to be much simpler 15:57:37 it's not as simple as it seems 15:57:47 * flaper87 STFU and waits for megan_w 15:58:05 its defined today by the entire message, excluing whitespace, right 15:58:08 ? 15:58:32 megan_w: today we say the sum of the "body" subdocument in the JSON, excluding whitespace, must be x 15:58:55 we want to simplify and just say that the entire document you send up, as-is, counts toward the max size 15:59:14 yes, that seems much better 15:59:19 sweet 15:59:19 awesome 15:59:23 cool 15:59:29 ok, back to bugs 15:59:35 it's not as simple as it seems 15:59:37 (20 seconds) 15:59:54 oslo.config makes it really difficult to have lazy options and CLI registered 16:00:02 I have an idea of how to implement that 16:00:09 so, I'll send a patch shortly 16:00:19 it'll need some re-usable hacks 16:00:23 cool - I'll review that soon after it arrives. :D 16:00:29 #link https://bugs.launchpad.net/marconi/+bug/1266454 16:00:39 ok, that needs some discussion 16:00:52 agreed 16:01:01 kgriffs: made a good point saying that health is used by LB to know whether marconi is running 16:01:08 that's very useful 16:01:23 however, I think health provides more info than the user is interested in 16:01:31 LB=load balancing? 16:01:33 I proposed having a /ping endpoint 16:01:38 returning 200 / 404 16:01:40 flwang: yes 16:01:46 well, today it doesn't provide more info, but it could 16:01:46 got it 16:01:52 and kgriffs proposed adding a ?detailed=true query param 16:01:57 flaper87: I like this /ping idea. 16:02:03 kgriffs: I'd say it will, TBH 16:02:20 I've gotta run. I'll be back online in ~30. 16:02:23 ElaseticSearch has a health endpoint and it provides a lot of useful info 16:02:24 does ping return the status of the webhead or the backends also? 16:02:33 so this is what I think 16:02:43 amitgandhi: that specific node 16:02:49 version 1.0's health endpoint is renamed to /ping in v1.1 16:02:58 i mean, semantically 16:03:03 I think we can return more info in /health, such as all the status of shard point 16:03:06 so what health does today, ping does in 1.1 16:03:39 health today for admins is differnt to health for users (ie for users always returns 204 unless node is down) 16:03:39 kgriffs: sounds good 16:03:52 ok, let me update the 1.1 bp 16:03:55 kgriffs: does mean we won't rename it now, but only semantically? 16:04:02 amitgandhi: mmh, not entirely true, AFAIK 16:04:05 it does the same for both 16:04:09 and then let's create a new bp for adding a /health endpoint that gives operations info 16:04:14 my concern with ping doing the backend checks is the load it will generate 16:04:29 kgriffs: i'd like to work on that 16:04:37 flaper87: ok, feel free to add a bp 16:04:46 #action kgriffs to update 1.1 spec with ping endpoint 16:05:18 kgriffs: but I'd say the client should point to v1.1 16:05:27 kgriffs: are you talking to me? this is flwang 16:05:35 flwang: Let's target to icehouse-3 - if it gets in, then we can make it part of the 1.1 spec 16:05:55 kgriffs: ok, btw, what's the due date of i-3? 16:06:09 https://wiki.openstack.org/wiki/Icehouse_Release_Schedule 16:06:24 kgriffs: got, thanks 16:06:44 amitgandhi: valid concern. The current code just does a very cheap ping to mongo to see if it is alive 16:06:54 the ping is for load balancers only 16:07:00 fwiw 16:07:11 yeah, returns the state of that specific node 16:07:13 which brings us to this: https://bugs.launchpad.net/marconi/+bug/1242926 16:07:31 Rackspace does a trick in Cloud Queues to make this work today 16:07:38 but I want a better solution 16:08:05 At this point it should become /ping 16:08:14 but yeah, I agree 16:08:19 yes, so that bug will change to reference /ping 16:08:27 kgriffs: yep, if we're going to provide more if in /health, then I think we need auth for it 16:08:29 I would like to schedule this for i-3 as well (this bug) 16:08:54 more info 16:09:03 kgriffs: lets do that, I think avoiding auth for this endpoint is good 16:09:07 so ping would be no auth, but also restricted to LB only (x-forwarded-for) to avoid abuse by end users 16:09:23 kgriffs: +1 16:09:23 kgriffs: right 16:09:37 we should have some configurable restrictions for that endpoint 16:09:48 unless no auth is being used at all 16:10:32 flaper87: can you post your thoughts in a comment on that bug? 16:10:39 https://bugs.launchpad.net/marconi/+bug/1242926 16:10:51 kgriffs: I'm already doing that :) 16:11:01 excellent 16:11:32 last bug real quick that I wanted to cover 16:11:35 malini... 16:11:35 https://bugs.launchpad.net/marconi/+bug/1261904 16:12:08 can anyone confirm this has been fixed? 16:12:30 kgriffs: I can chk tht 16:12:36 kk 16:12:40 thanks! 16:13:46 ok folks, any parting thoughts, questions, concerns, or rude remarks? 16:14:35 #endmeeting