17:01:00 #startmeeting Designate 17:01:00 Meeting started Wed Apr 15 17:01:00 2015 UTC and is due to finish in 60 minutes. The chair is Kiall. Information about MeetBot at http://wiki.debian.org/MeetBot. 17:01:01 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 17:01:05 The meeting name has been set to 'designate' 17:01:11 Hey folks - Who's about? 17:01:15 o/ 17:01:16 o/ 17:01:26 o/ 17:01:31 o/ 17:01:32 o/ 17:01:35 o/ 17:01:37 o? 17:01:49 Okay - Let's get started :) 17:01:51 #topic Kilo Release Status (kiall - recurring) 17:01:56 Woo - RC1 is out (finally!) 17:02:05 ttx cut rc1 for us last night :) 17:02:20 congratulations! 17:02:33 Thanks everyone for the hard work - it's beena busy 6 months for everyone :) 17:03:10 congrats guys !!! 17:03:17 This also marks the moment of APIv2 == STABLE, v1 == DEPRECIATED :) 17:03:40 \o/ 17:03:45 Woo! 17:03:46 woohoo 17:03:47 so happy :) 17:03:55 * mugsie hates the v1 api 17:04:00 Okay .. So, https://bugs.launchpad.net/designate/+bugs?field.tag=kilo-rc-potential - We've still got a few issues, some not so important, some important enough to warrant an rc2 :) 17:04:07 mugsie: agreed! 17:04:17 one more year, and we can kill it fully 17:04:18 Bugs which you believe should be considered for kilo final should be tagged "kilo-rc-potential" 17:04:33 (standard for all the projects etc etc) 17:05:05 myself, mugsie and ekarlso have been in a conf room all week standing up a production style deploy, and testing testing testing 17:05:17 We've found a few issues today tho.. bug 1444384 being the only one filed so far 17:05:18 bug 1444384 in Designate "mDNS workers - TCP/UDP sockets missing flags" [Critical,In progress] https://launchpad.net/bugs/1444384 - Assigned to Kiall Mac Innes (kiall) 17:05:58 Ideally, even though we're open for Liberty changes, we can get everyone testing and finding+fixing bugs, rather than powering onto L ;) 17:06:18 Any changes needed for K must be pushed to the master branch first, then the proposed/kilo branch. 17:06:24 Any questions on process? 17:07:07 is there a document that lists the way to backport changes from one branch to another? 17:07:11 i know we are concentrating on bugs, when will the Liberty work be decided/scoped? 17:07:15 Mmm.. Probably! 17:07:47 vinod1: in general it is just cherrypicking commits from master to the proposed/kilo branch 17:07:47 vinod1: https://wiki.openstack.org/wiki/Branch_Model is the one I'm thinking of 17:08:01 But, it's not a "How To" style 17:08:08 rjrjr: scoped in vancouver / planned from now 17:08:11 i think 17:08:20 but we can start scoping things before 17:08:28 rjrjr: I'm thinking we kickoff L talk for half of next week's meet.. 17:08:28 great! 17:09:17 vinod1: https://wiki.openstack.org/wiki/StableBranch found the other page I'm thinking of 17:09:35 Thanks Kiall 17:09:36 proposed/kilo looks very like stable/foo - identical I think from a process POV 17:10:38 Okay, so.. With K-RC1 out, and L stuff not happening till next week's meet at earliest, then, we don't have a huge amount to discuss today :) So.. I'll move to Open Discussion.. and mention a few of the bugs we found today (but haven't filed yet) 17:10:47 #topic Open Discussion 17:10:57 before I do tho, any other topics from other people? 17:11:30 is there a list started for the Liberty work being proposed? we have stuff we'd like to add to it. 17:11:42 just the specs 17:11:57 * elarson was curious as well 17:12:01 so, get some preliminary specs in? 17:12:02 mugsie: thanks for confirming 17:12:08 so, specs in gerrit, and blueprints on launchpad 17:12:14 and launchapd :) http://launchpad.net/designate/+milestone/liberty-1 I think.. LP won't load right now 17:12:34 Wow - hotel wifi sucks. 4seconds lag -_- 17:12:36 rjrjr: fire away 17:12:54 good to know where to propose stuff that we'd like to add 17:13:22 i will merge the Open Liberty Specs after this 17:14:01 so the basic process is to file a blueprint on launchpad, and the wite a spec, that references the bp, in openstack/designste-specs 17:14:13 same review process etc will apply 17:14:34 mugsie: i'll show bharath what i have done in the past for this. 17:14:41 rjrjr: cool :) 17:14:55 mugsie: btw, I submitted a patch to add liberty specs 17:15:07 b/c I have the hook api spec as well 17:15:15 elarson: yea, I saw it. think it is failing gate atm though... 17:15:22 dog gone it 17:15:27 Okay, so.. Bugs myself / ekarlso / mugsie found today... 17:15:27 1) bug 1444384 - More than 1 worker with mDNS was exploding, hampering performance and limiting you to a single CPU. Hopefully have a patch up. 17:15:28 2) No # - Under high load, we're seeing the DB Connection Pool get exhausted.. This *could* be a a config / pool size issue.. or it could be highlighting an issue somewhere 17:15:28 3) No # - Pool Manager with workers, every worker runs the periodic tasks 17:15:28 bug 1444384 in Designate "mDNS workers - TCP/UDP sockets missing flags" [Critical,In progress] https://launchpad.net/bugs/1444384 - Assigned to Kiall Mac Innes (kiall) 17:15:29 will look at it in a bit :) 17:15:42 4) No # - Multiple Pool Manager - every PM is running periodic sync 17:16:58 elarson: ah, you combined them :) 17:17:01 and - I think, but haven't verified, 6) every pool manager's sync's are syncing zones for every pool.. 17:17:24 5* 17:17:30 Those make sense. 17:17:30 mugsie: yeah, I sort of had to b/c you can't add a directory in vcs 17:18:04 i wouldn't mind tackling 3,4,6 17:18:11 :) 17:18:20 of course that didn't stop me from being confused as to why I couldn't rebase my hook api spec on top of the libery branch ;) 17:18:41 I was going to tackle 3 tomorrow, as it's not helping out testing :D 17:18:52 k 17:18:53 But other than that, there all open.. I just need to file some bugs 17:20:06 So - Has anyone else managed to get testing Kilo properly now that we're - in theory - done? 17:20:11 Do we want to do bug triage? 17:20:21 yea, mugsie mentioned I skipped it ;) 17:20:57 https://bugs.launchpad.net/designate/+bugs?field.tag=kilo-rc-potential <-- should also be triaged, rejecting bugs we don't think are worth another RC for. 17:21:09 you are going to use Kilo for the workshop in Vancouver, correct? 17:21:19 Yep, we will :) 17:21:20 rjrjr: that would be the plan 17:21:45 or tip of liberty if it has some stuff we want to show off :) 17:21:58 Oh.. Also found bug 1444414 today... Bind AXFR's from the "first" master in it's list.. which leads to a very busy mdns-001 instance ;) 17:21:59 bug 1444414 in Designate "Order of nameservers is not random" [Medium,Triaged] https://launchpad.net/bugs/1444414 17:22:40 so, bug triage? 17:22:44 Alright, should we go through the bugs? We can do the kilo-rc-potential ones first? 17:22:50 rc first i think 17:22:51 timsim: sounds good :) 17:23:02 https://bugs.launchpad.net/designate/+bug/1444384 17:23:03 Launchpad bug 1444384 in Designate "mDNS workers - TCP/UDP sockets missing flags" [Critical,In progress] - Assigned to Kiall Mac Innes (kiall) 17:23:11 ++ for rc2 17:23:17 +1 17:23:18 Yep critical/high rc2 for me 17:23:19 +1 17:23:38 yeah, critical i think 17:23:48 Yea, we've known mDNS will be a bottleneck since day 1.. and this just makes it worse! We noticed a HUGE improvement going from 1 -> 2 workers.. More than 2x oddly enough. 17:24:03 We don't have a rc2 milestone.. I'll get one 17:24:15 Alright, so we just add them to a list for now? 17:24:27 add an k-rc2 tag to them? 17:24:38 timsim: yea, #info bug 123 for rc2 will add them to the meeting logs 17:24:40 bug 123 in Launchpad itself "There's no direct way to see the project info when translating it" [Medium,Fix released] https://launchpad.net/bugs/123 17:24:42 #action kiall to ask ttx to create a a rc2 17:24:47 milestone 17:24:53 Alright. 17:25:10 #info bug 1444384 to kilo-rc2 17:25:11 bug 1444384 in Designate "mDNS workers - TCP/UDP sockets missing flags" [Critical,In progress] https://launchpad.net/bugs/1444384 - Assigned to Kiall Mac Innes (kiall) 17:25:18 That'll do it :) 17:25:25 https://bugs.launchpad.net/designate/+bug/1437699 17:25:27 Launchpad bug 1437699 in Designate "mDNS should Handle Bad File Descriptor" [Medium,New] - Assigned to Ron Rickard (rjrjr) 17:26:04 -1, in that, if it happens to get fixed, great.. But it only logs the exception in exceptional circumstances.. So I'm personally not too pushed 17:26:24 seems like it can wait. 17:26:27 Not sure if others agreed, hence I added it 17:26:38 push to l 17:26:41 reproducing it is going to be fun. 17:26:43 currently it is marked for liberty 17:26:54 If it's an easy fix, it'd be good to add if someone has time, but if not, no big. Alright it'll stay liberty-1 then. 17:27:29 https://bugs.launchpad.net/designate/+bug/1444414 17:27:30 Launchpad bug 1444414 in Designate "Order of nameservers is not random" [Medium,Triaged] 17:27:39 timsim: yea, if it's easy.. and it might be! I just haven't looked.. then landing it is no issue IMO after we have at least one other RC2 patch landed 17:27:54 (e.g. when we already know an RC2 is 100% coming, vs that alone causing a RC2) 17:27:58 i think 1444414 is high. 17:28:20 yeah 17:28:28 and RC2 17:28:29 I think this one should be in rc2 fo sho 17:28:45 Yea, it's a small fix to balance out the load. 17:28:48 +1 17:29:00 +1 for rc2 17:29:01 #info bug 1444414 to rc2 17:29:02 bug 1444414 in Designate "Order of nameservers is not random" [Medium,Triaged] https://launchpad.net/bugs/1444414 17:29:11 https://bugs.launchpad.net/designate/+bug/1442141 17:29:13 Launchpad bug 1442141 in Designate "designate-api Throws Error on stop()" [Undecided,New] - Assigned to Graham Hayes (grahamhayes) 17:29:24 not rc2 imho 17:29:36 mugsie was looking into this.. I'd love to see it fixed, but it seems be a buried inside eventlet :( 17:29:48 Yeah, probably not worth it then. 17:29:58 what is the ramifications of the problem? 17:30:01 One of the glance folks made a change to eventlet.wsgi for their use case, and it's caused this for us :( 17:30:31 So liberty, medium? 17:30:37 ++ 17:30:44 https://github.com/eventlet/eventlet/commit/1c30e9b39f4330babcb3665df4c1a3ba694bc6c1 <-- was the commit that caused it 17:30:52 rjrjr: not much, just the error message that shows on stop() 17:31:02 okay. in that case +1 17:31:09 is only designate-api affected and not the other services? 17:31:19 vinod1: yep, only affects the API 17:31:30 Well.. 1 other reason we might want to say rc2 17:31:34 * elarson tried to fix that the other day 17:31:44 i've seen the "greenthreads will never terminate" in Juno. 17:31:50 not fixing it means restarting with break open connections rather than wait for them to complete, I believe. 17:31:51 just not the stuff after that. 17:32:49 good to have for rc2 if it is an easy fix 17:32:54 i think l - due to the time and effort needed, and the limited impact 17:33:10 it is most likey not going to have an easy fix 17:33:14 vinod1: it doesn't look to be an easy fix.. mugsie spent a few hours at it last week and kept hitting more edge cases 17:33:18 but, need more time to dig into it 17:33:28 in that case - liberty 17:33:28 liberty 17:33:36 Seems like it's probably too much work/too small impact to get into kilo 17:33:54 ++ 17:34:08 We good to move on? 17:34:14 Yea, let's call it L and if we find a easy fix, great.. back into K if there's another RC 17:34:19 Cool 17:34:20 https://bugs.launchpad.net/designate/+bug/1442890 17:34:21 Launchpad bug 1442890 in Designate "Remove support for sqlite" [Wishlist,New] - Assigned to Endre Karlson (endre-karlson) 17:34:21 IRC lag SUCKS -_- 17:34:45 move to L 17:34:53 100% not a rc2 thing 17:34:57 That's more of a blueprint I reckon, but ++ 100 17:35:04 (and yea.. ++100 in L ;) 17:35:04 Yeah we're done with the rc1 potential ones, FYI 17:35:10 ah 17:35:11 :) 17:35:29 https://bugs.launchpad.net/designate/+bug/1442699 17:35:30 Launchpad bug 1442699 in Designate "Add admin endpoint to the list of versions" [Undecided,In progress] - Assigned to Vinod Mangalpally (vinod-mang) 17:35:30 i would move to a medium, 17:36:27 Again, L.. Medium? 17:36:32 liberty 17:36:34 low-medium liberty 17:36:43 Alright, medium-liberty it is 17:36:56 (Side track I've asked theirry re a RC2 milestone, I suspect he's gone home for the day though) 17:37:04 https://bugs.launchpad.net/python-designateclient/+bug/1443858 17:37:05 Launchpad bug 1443858 in python-designateclient "Designateclient does not support to provide domain names instead of domain ids" [Undecided,In progress] - Assigned to Cedric Brandily (cbrandily) 17:37:41 we have tagged for kilo there, so high 17:37:47 So... here's one that's changed recently. clients now have stable branches, and work closer to the server projects than they used to. I'm not 100% familar with the process now. 17:37:52 (we dont have milestones in the client) 17:38:54 So I guess we just slap importance->high on it? 17:39:00 seems aggressive for kilo. 17:39:04 anyway, code is up for it (I haven't reviewed yet tho).. So let's say Medium+L? 17:39:14 never mind then. :( 17:39:24 didn't realize we already had the code for it. 17:39:43 So should we be getting milestones for the client? 17:39:48 so, no more IDs for domains in the client I'm all for. 17:39:53 Yea, and I have no clue what the new client release process is.. hasn't entirely settled in yet.. etc 17:40:06 I'll find out before next week's meet. 17:40:20 Ok. I'll ust put medium on it. 17:40:26 so, the client will support domain names or IDs, correct? 17:40:27 Humm .. actually.. I likely will have to miss next weeks meet. 17:40:27 there is also the openstack-sdk to consider. not sure if that is still really far out though 17:40:38 is -sdk still a thing? 17:40:47 there is openstackclient 17:40:47 * elarson was under the impression it was 17:41:14 if it is - great :) 17:41:20 * elarson does a good job bringing up things that can only be answered with more questions ;) 17:41:28 lol :) 17:41:33 mugsie: I can send an email about it 17:41:41 but the new client should be based on openstack-client for the cli 17:41:42 Okay, was that the end of the list timsim? 17:41:48 elarson: cool, that would be good 17:41:50 2 more quick ones 17:41:50 https://bugs.launchpad.net/python-designateclient/+bug/1443858 17:41:52 Launchpad bug 1443858 in python-designateclient "Designateclient does not support to provide domain names instead of domain ids" [Undecided,In progress] - Assigned to Cedric Brandily (cbrandily) 17:41:57 https://bugs.launchpad.net/python-designateclient/+bug/1444452 17:41:58 Launchpad bug 1444452 in python-designateclient " Designateclient does not support relative names in record-create command" [Undecided,In progress] - Assigned to Cedric Brandily (cbrandily) 17:42:18 https://bugs.launchpad.net/designate/+bug/1443588 17:42:19 Launchpad bug 1443588 in Designate "designate-dashboard reuses update domain screen as view details screen" [Undecided,In progress] - Assigned to Eric Peterson (ericpeterson-l) 17:42:22 I can *feel* rjrjr dancing @ his desk right now for both of those ;) 17:42:34 Sorry, that first one was what we just did 17:42:48 actually, whoever is doing the workshop walkthrough will appreciate these changes. :) 17:43:03 but yeah, loving these items. 17:43:29 dashboard - high, l 17:43:34 bug 1443588 - L+Medium again.. Code is up, we can likely merge to master today/tomorrow.. 17:43:35 bug 1443588 in Designate "designate-dashboard reuses update domain screen as view details screen" [Undecided,In progress] https://launchpad.net/bugs/1443588 - Assigned to Eric Peterson (ericpeterson-l) 17:43:46 Alrighty 17:43:49 it just needs a +A afaik 17:43:58 +1 17:44:21 Alright, done :) 17:44:54 Sorted :) 17:45:28 So - Any final topics? 17:45:48 you'll have the other bugs written up for triage next week? 17:45:54 Not from me 17:45:58 and can they still be kilo rc-2 candidates next week? 17:46:14 some of those bugs you mentioned earlier seem important. 17:46:17 rjrjr: Yep, I'll get them filed 17:46:29 #link https://wiki.openstack.org/wiki/Kilo_Release_Schedule 17:46:56 final release date is Apr 30 - In theory, we could release an RC as late as then.. I wouldn't exactly want to though. 17:47:28 we'd be shipping a Kilo with a severely disabled PM. 17:47:55 sorry, crippled, not disabled. :) 17:47:59 Yea, there all small little issues tho.. So they should all be easy enough to fix! (Famous last works!) 17:48:02 words* 17:48:32 we can jump on some of those when you get them written up. 17:48:46 Okay, well, sounds like were done. Thanks guys, please get as much testing of.. everything.. as you can :) 17:49:08 Myself / mugsie / ekarlso will be locked back up in the conference room again tomorrow to do our bit ;) 17:49:19 thanks guys. 17:49:21 Cya! 17:49:25 o/ 17:49:32 #endmeeting