Wednesday, 2014-07-09

*** yidclare has quit IRC00:09
*** vinod1 has joined #openstack-dns00:12
*** richm has left #openstack-dns00:22
*** msisk has joined #openstack-dns01:05
*** m1crofarmer has joined #openstack-dns01:40
*** nosnos has joined #openstack-dns01:44
*** m1crofarmer has quit IRC01:55
*** vinod1 has quit IRC02:34
*** m1crofarmer has joined #openstack-dns03:06
*** vinod1 has joined #openstack-dns03:08
*** msisk has quit IRC03:13
*** vinod1 has quit IRC03:20
*** nosnos has quit IRC03:20
*** m1crofarmer has quit IRC04:09
*** m1crofarmer has joined #openstack-dns04:09
*** nosnos has joined #openstack-dns04:13
*** nosnos has quit IRC04:24
*** m1crofarmer has left #openstack-dns06:42
*** Amresh has joined #openstack-dns07:58
*** Amresh has quit IRC08:25
*** mwagner_lap has joined #openstack-dns12:36
*** vinod1 has joined #openstack-dns12:41
*** richm has joined #openstack-dns12:59
*** sballe has joined #openstack-dns13:01
*** vinod1 has quit IRC13:09
*** timsim has joined #openstack-dns13:18
*** rickerc_ has joined #openstack-dns13:40
*** jaycaz has joined #openstack-dns13:41
*** retr0h_ has joined #openstack-dns13:43
*** rektide_ has joined #openstack-dns13:44
*** rickerc has quit IRC13:48
*** uvirtbot has quit IRC13:48
*** rektide has quit IRC13:48
*** retr0h has quit IRC13:48
*** rickerc_ is now known as rickerc13:48
*** eankutse has joined #openstack-dns13:53
*** uvirtbot has joined #openstack-dns13:57
*** vinod1 has joined #openstack-dns13:59
*** vinod1 has quit IRC14:11
*** betsy has joined #openstack-dns14:20
*** msisk has joined #openstack-dns14:20
*** vinod1 has joined #openstack-dns14:48
*** msisk_ has joined #openstack-dns14:56
*** msisk has quit IRC14:59
*** jaycaz has quit IRC15:01
*** sballe has quit IRC15:21
*** jaycaz has joined #openstack-dns15:34
*** yidclare has joined #openstack-dns16:24
*** retr0h_ is now known as retr0h16:25
*** retr0h has quit IRC16:26
*** retr0h has joined #openstack-dns16:26
*** richm has quit IRC16:27
*** shakamunyi has joined #openstack-dns16:33
*** shakamunyi has quit IRC16:33
*** shakamunyi has joined #openstack-dns16:34
*** bandarji has joined #openstack-dns16:34
*** yidclare has quit IRC16:36
*** richm has joined #openstack-dns16:40
Kiall@mordred - I still don't believe you ;)16:46
Kialloops - this ain't HipChat16:46
timsimAt least it wasn't your password.16:46
Kialltimsim: I've never done that before, I swear .. <insert smiley face with fingers crossed here>16:47
*** richm has quit IRC16:53
*** yidclare has joined #openstack-dns16:54
Kiallmeet in 516:55
*** dtx00ff has joined #openstack-dns16:58
*** rjrjr has joined #openstack-dns16:59
*** crc32 has joined #openstack-dns17:03
*** richm has joined #openstack-dns17:07
*** mwagner_lap has quit IRC17:08
*** dtx00ff has quit IRC17:22
*** dtx00ff has joined #openstack-dns17:22
*** dtx00ff has quit IRC17:27
*** mwagner_lap has joined #openstack-dns17:36
KiallHeya18:05
Kialljaycaz: about?18:05
jaycazhey18:05
jaycazso, in regards to the count feature18:06
jaycazhttps://blueprints.launchpad.net/designate/+spec/zone-and-record-totalcount18:06
KiallSo .. One of the things I was thinking about when I first suggested the "Objects" stuff, was for providing a place to hold all this "extra" stuff we have and want to keep when handling our data.18:06
KiallThe old "everything is a dict or a list" stuff didn't give us anywhere to hold things like "What was the original value of domain.name before the end user changed it?" or "How may results do we have in total for this paged query"18:07
jaycazRight.  That sounds like it would be a valuable addition for a lot of different applications18:07
KiallWhile, with the objects stuff, we actually have somewhere for that kind of info.18:07
Kiallhttps://review.openstack.org/#/c/105021 Was my first pass on getting a "ListObject" type in place, which I was doing in hopes of making the rebase of betsy's stuff easier.. The timing just happens to work for this too :)18:08
jaycazhaha yeah, the timing looks like it'll work out pretty well!18:09
KiallWith ^ review, we no longer return plain python lists from the storage layer.. we return our own Object, which can have "advanced functionality" attached to it18:09
Kiallhttps://review.openstack.org/#/c/105021/7/designate/objects/base.py18:09
Kiallthe "class ListObjectMixin(object):" at L25218:09
Kialleverything that's implemented on it today is standard "list" stuff..18:09
jaycazso, from the looks of it, the list should have the count that this feature needs18:10
KiallBut, we could easily expand that to include fields for things like "total_results"18:10
jaycazwould this count be for the list of resources before or after filtering/18:10
KiallWith that, you would then be able to do things like this:18:10
Kiallrecords = RecordList(....)18:11
Kiallfor record in records:18:11
Kiall   print record.name18:11
Kiallprint records.total_results18:11
Kialland the storage layer can populate the "total_results" field18:11
jaycazah, that makes sense18:12
KiallI think that could be implemented quite easily, with something like: .. 1 sec while 1 type it :)18:13
Kiallhttp://paste.openstack.org/show/85814/18:16
KiallWhere most of ^ is implemented in #10502118:17
Kialljust not the paging specific stuff18:17
jaycazall right then, that seems simple enough18:17
jaycazso do you think it should be implemented then?18:18
jaycazat least, after your change is merged in?18:18
KiallWell - I marked that change as -2 thinking that it didn't help massively with rebasing betsy's stuff, but now that there is an immediate use for it, why not merge it.18:19
rjrjrdoes Designate allow for delegation of subdomains today?18:19
Kiallrjrjr: graham is working on that right now, it's a feature we're on the hook for delivering real soon now at HP18:20
Kiallmugsie: BP link handy?18:20
*** yidclare has quit IRC18:21
mugsieeh - its aproved18:22
jaycazKiall: all right then, I'll work on it if you decide to merge it and whenever it's merged!18:22
mugsieyou set rtd dodnt you?18:22
Kialli have no idea what that means mugsie ;)18:22
mugsieread the docs18:23
Kialljaycaz: you don't actually have to way for it to merge..18:23
mugsiehttp://designate-specs.readthedocs.org/en/latest/specs/juno/zone-migration-between-tenants.html <- rjrjr18:23
Kiallyou can download that change with `git review -d 105021` then, `git checkout -b expose-paging` and work away as if it was merged18:23
jaycazKiall: ah, good point.  I'll do that then18:23
Kiallmugsie: .. Read The Docs18:23
Kiallrtd :)18:23
mugsie?18:24
*** dtx00ff has joined #openstack-dns18:25
ekarlsobetsy: u landed your v2 patch yet ? :p18:25
Kiallekarlso: nope, I'm working on rebasing it now18:26
betsyYeah. It’s all in Kiall’s capable hands to merge in18:26
Kiallbetsy: capable? lol18:26
Kiall;)18:26
betsyDefinitely! :)18:26
*** dtx00ff has quit IRC18:26
betsybetter you than me. :D18:27
*** msisk_ has quit IRC18:27
*** msisk has joined #openstack-dns18:28
KiallAnyway - I'm going to grab a beer and re-review if https://review.openstack.org/#/c/105038/ will help or not18:29
eankutseKiall: :-)18:32
*** yidclare has joined #openstack-dns18:34
*** timsim has quit IRC18:36
*** dtx00ff has joined #openstack-dns18:43
*** yidclare has quit IRC18:45
KiallOkay - beer'd. ;)18:45
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Implement a ListObjectMixin class  https://review.openstack.org/10502118:52
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Implement equality methods on DesignateObject  https://review.openstack.org/10503618:52
openstackgerritKiall Mac Innes proposed a change to openstack/designate: WIP: Attach records to RecordSet objects  https://review.openstack.org/10503818:52
Kiall^ simple rebase of my current patches..18:52
mugsieKiall: https://review.openstack.org/#/c/105843/19:00
*** eankutse has quit IRC19:03
KiallIs it not going to fail the requirements test again mugsie?19:04
*** vinod2 has joined #openstack-dns19:04
KiallOHH19:05
KiallAwesome19:05
KiallOHH19:05
Kialldid you talk to doug about that?19:05
*** vinod1 has quit IRC19:05
KiallWill it be appected? It's an alpha afterall19:05
*** timsim has joined #openstack-dns19:06
*** eankutse has joined #openstack-dns19:07
*** jaycaz has quit IRC19:08
KiallSometimes, I hate pep819:09
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Implement a ListObjectMixin class  https://review.openstack.org/10502119:10
openstackgerritKiall Mac Innes proposed a change to openstack/designate: WIP: Attach records to RecordSet objects  https://review.openstack.org/10503819:10
Kialls/Sometimes/Whenever it bites me/19:10
*** jaycaz has joined #openstack-dns19:15
richmKiall: I find that beer helps with pep8 bites19:20
*** shakamunyi has quit IRC19:20
richmwell, red wine anyway - I think the tannins help with bites19:21
KiallI'm hoping the overloaded with chili pizza I'm cooking will help ;)19:23
openstackgerritVinod Mangalpally proposed a change to openstack/designate: Answer dns record queries  https://review.openstack.org/10584519:25
Kiallvinod2: when you said "nearly done".. i didn't think you were that close ;)19:26
vinod2kiall: i had some question as TODO in the code - if you know the answers that would be helpful19:29
timsimKiall/mugsie: Is the ability to have multiple pool managers sending notifies to a single pool in the plan? Say I had 10 nameservers in five different datacenters that were going to be identical. Could I have pool managers in every datacenter that all got the same message when a zone was added?19:31
*** dtx00ff has quit IRC19:32
*** dtx00ff has joined #openstack-dns19:32
Kiallhaving some dinner, will have a look in a few vinod219:33
Kialltimsim: I think the plan was each pool has 1 active and N standby mangers.. can't remember offhand19:33
timsimWhat would standby managers do?19:34
Kiallwait for an active to fail and takeover.. I can't remember the reasoning for active/standby offhand anymore, I'm sure mugsie does though19:34
KiallI think it might have been a "small steps" thing... active/passive first.. then active/active19:35
timsimRight, that's what I thought, eventually there would be the ability to have multiple active pool manager for a pool.19:36
*** yidclare has joined #openstack-dns19:41
Kialltimsim: Thinking about it some more, the difficulty with multiple active pool managers was ensuring changes are applied serially. I'm not sure that's an issue with mDNS anymore, but baby steps is likely still the right way :)19:42
timsimYeah, just thinking about having a really big DNS deployment where you want to have all of them serve the same data, you don't want one pool manager sending notifies to all those servers in different DCs.19:43
*** dtx00ff has quit IRC19:48
*** shakamunyi has joined #openstack-dns19:49
Kiallvinod2: left some comments inline, looks too simple to be true ;)19:49
*** shakamunyi has quit IRC19:49
Kialland some more coming.. spotted 1 other thing19:50
vinod2I will check what bind does with invalid packets later today19:52
*** yidclare has quit IRC19:53
Kiallpublished the other comments, again, looks great, I can't believe how simple it ended up :)19:53
*** eankutse has quit IRC19:57
*** eankutse has joined #openstack-dns19:57
*** rektide_ is now known as rektide19:57
vinod2i know - once i started working on it - that was my question too - which is why i want you to validate that i have not overlooked something major20:02
Kiall;)20:02
*** msisk has quit IRC20:02
KiallThere are definitely improvements to be made, things like reducing the # of text -> DNS conversions etc, but those are dependant on other changes and have to come later20:03
KiallLooking at the code, I'm also thinking we "adapt" the idea of WSGI middlewares to DNS..20:04
*** bandarji has quit IRC20:04
*** bandarji has joined #openstack-dns20:04
KiallPacket comes in, First middleware decodes, second strips+validates TSIG, third does source IP filtering, finally the "app" answers20:05
*** bandarji has quit IRC20:05
KiallBut that's just me thinking out load and a few steps ahead20:05
*** msisk has joined #openstack-dns20:05
Kiallvinod2 / betsy so.. Q.. When someone does a find/get/update_recordset .. should we always include the records on the object returned?20:07
Kiallall the records*20:07
KiallIt looks like betsy's patch does that, and it looks like it'll be the same with the objects approach.. (Just thinking out loud and trying to figure out how to make the 2 play nice)20:09
betsyI think so, yes20:09
vinod2since we do not expose the records individually or allow them to be accessed, i think so too20:09
betsyA recordset should always have all the records20:09
KiallOkay - That's the answer I wanted to hear :)20:09
betsyThe only other option to updating all the records would be to implement the json patch instead of using put for the updates20:11
*** dtx00ff has joined #openstack-dns20:11
betsyIf we had that, it would solve a lot of the update problems20:11
KiallEven then, the patch should probably apply to the RecordSet object, with the records attached20:11
betsyYes, definitely20:12
betsyThe RecordSet could have a json patch option instead of the PUT, then it’s clear which items, including which record, needs to be updated20:13
betsyBut we haven’t implimented json patch20:13
*** shakamunyi has joined #openstack-dns20:15
*** shakamunyi has quit IRC20:15
KiallOkay.. So, I'm starting to become convinced that in order to merge our patches.. I need to circle back to https://review.openstack.org/#/c/103587/ and rework it a little20:15
KiallSpecifically, it needs to share the same code as get/find etc do (from_sqla), and that code needs to handle SQLA relations correctly.20:16
*** bandarji has joined #openstack-dns20:16
jaycazKiall: so, for the zones/records count, you want to avoid two calls to central.  Is it also possible to avoid two queries in the database? (one for find, one for count all)20:17
KiallSadly.. SQL sucks and 2 calls are necessary20:17
Kiallbut ideally, 2 calls to central would be avoided, and the 2 sql queries happen in the one SQL transaction20:18
*** vinod2 has quit IRC20:18
jaycazokay, now it's starting to all make sense!20:18
jaycazthanks Kiall!20:18
Kialle.g. one call to the storage driver executes both queries, and returns 1 object20:19
*** vinod1 has joined #openstack-dns20:23
*** shakamunyi has joined #openstack-dns20:24
*** bandarji has quit IRC20:28
*** timsim has quit IRC20:32
*** yidclare has joined #openstack-dns20:41
*** yidclare has quit IRC20:41
jaycazKiall: do I also need to add a field in the schema (e.g. "zones.json")?20:42
KiallYea, but that depends what we want the API to look like20:46
KiallMaybe the API would be along the lines of {"domains": [], "links": {}, "meta": {"total_domains": 1.5million}} or something?20:47
Kiall(Total off the top of my head)20:47
jaycazwell, I think I have another prototype working for zones20:49
jaycazit looks different from what you're saying20:49
jaycazbut the view can always be changed, right?20:49
KiallYep - easily enough20:50
KiallAs I said, off the top of my head.. We should probably put some proper thought into what the API might look at20:50
Kialllike*20:50
Kialland compare to other APIs if they have something similar etc20:51
Kialle.g. even if it's only a very small BP, it would be worth filing one to the specs repo to decide on the API20:52
* Kiall has just broke everything.. NOOOO20:53
Kiall:(20:53
jaycazhmm, all right then, I'll look into that20:55
*** jaycaz has quit IRC20:55
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Implement a ListObjectMixin class  https://review.openstack.org/10502120:58
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Iterator methods should be on DictObjectMixin  https://review.openstack.org/10502020:58
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Implement equality methods on DesignateObject  https://review.openstack.org/10503620:58
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Update's should use objects  https://review.openstack.org/10358720:58
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Provide a standard method for populating an object from a model  https://review.openstack.org/10587420:58
*** bandarji has joined #openstack-dns20:59
*** jaycaz has joined #openstack-dns21:00
*** shakamunyi has quit IRC21:08
*** shakamunyi has joined #openstack-dns21:09
*** shakamunyi has quit IRC21:09
*** shakamunyi has joined #openstack-dns21:10
KiallNothing like that moment you run the tests thinking "Let's see what breaks" and you're greeted with:21:16
Kiall  py27: commands succeeded21:16
Kiall  congratulations :)21:17
*** eankutse has quit IRC21:17
*** eankutse has joined #openstack-dns21:17
openstackgerritKiall Mac Innes proposed a change to openstack/designate: WIP: Attach records to RecordSet objects  https://review.openstack.org/10588721:31
vinod1kiall: do we have an agenda on what we want to talk about at the midsummit meetup?21:33
Kiallvinod1: I'm hoping it's pools pools pools ;)21:34
KiallSince we're actually at the point where we can implement21:34
Kiallvinod1: https://review.openstack.org/#/c/105887 is my take #2 attempt at merging the records attached to recordsets and objects stuffs... Thoughts?21:35
KiallIt only implements the read methods so far21:35
vinod1looking through it now21:35
*** yidclare has joined #openstack-dns21:37
*** sballe has joined #openstack-dns21:42
*** jaycaz1 has joined #openstack-dns21:47
*** jaycaz has quit IRC21:49
vinod1kiall: regarding your change - from a quick look at this - it does look good21:49
KiallCool - I'm hoping it resolves the differences between the objects changes and betsy's change.. Hopefully :(21:50
*** shakamunyi has quit IRC21:53
*** shakamunyi has joined #openstack-dns21:54
*** shakamunyi has quit IRC21:54
*** vinod1 has quit IRC21:55
betsylooks good to me, but won’t my code have to change, too? In order to match?21:59
KiallThat's the plan, right now the code has to change anyway to match the "objects way" - I'm pretty sure the biggest disconnect between the two patches is how we handle the records on a dict vs on objects22:01
KiallSo, knocking that out and rebasing will hopefully fix everything :)22:01
openstackgerritKiall Mac Innes proposed a change to openstack/designate: WIP: Attach records to RecordSet objects  https://review.openstack.org/10588722:01
KiallOnly update left.. the hard one..22:02
betsydefinitely the hardest one!22:02
*** jaycaz1 has quit IRC22:02
Kiall        # TODO: Fek22:05
Kiall^ what I've got so far ;)22:05
*** msisk has quit IRC22:16
*** bandarji has quit IRC22:23
*** vinod1 has joined #openstack-dns22:34
*** eankutse has quit IRC22:51
*** vinod1 has quit IRC22:54
*** vinod1 has joined #openstack-dns22:55
*** dtx00ff has quit IRC22:58
*** vinod1 has quit IRC23:07
openstackgerritKiall Mac Innes proposed a change to openstack/designate: WIP: Attach records to RecordSet objects  https://review.openstack.org/10588723:21
Kiallbetsy: Update in ^ .. Rebase time!23:22
betsySo what exactly do I need to do?23:22
KiallAh, I'll still do it :) I'm just sure ^ will make it easier for me :D23:23
Kiallnow the records are exposed in an "Objects compatible" way, so there shouldn't be too much pain :)23:23
betsyOkay. So you’re gonna merge my stuff in, too?23:24
KiallYea, I'll try pull your stuff on top again now23:24
KiallSkipping a few bits which ^ change does differently.. i.e. the storage bits23:25
*** msisk has joined #openstack-dns23:25
betsyYeah. I saw that23:25
KiallOnly a few conflicts ;) http://paste.openstack.org/show/85846/23:26
betsySo close!23:27
Kiallconflicts could still mean it's all merged horribly ;)23:28
*** dtx00ff has joined #openstack-dns23:28
betsyhopefully not :(23:29
betsyIt’s very late in Ireland!23:29
KiallRunning the tests, expecting explosions.23:32
Kiall99 fails - But - I'm pretty sure they all failed in the same spot for the same reason.. progress :)23:33
betsyOnly 99 is actually pretty good. :)23:33
KiallI actually think it's because of the test updates too23:34
Kialltext fixture*23:34
Kialltest*23:34
betsyAh. Yes. I changed those to include a record for recordset23:34
Kiallthe queue is small, so I'll upload23:34
openstackgerritKiall Mac Innes proposed a change to openstack/designate: Modify Recordset API  https://review.openstack.org/10289223:35
Kialltest output @ https://jenkins06.openstack.org/job/gate-designate-python27/115/consoleFull23:36
KiallSome kludges later to change the default fixtures back and, FAILED (id=280, failures=18 (-81))23:41
Kialland down to 13 fails :)23:43
betsyNice!23:47
KiallMost of those were fixed by breaking your tests though by changing the recordset fixtures back - because of the objects change, that would need to be-reworked.. I think I can sort it our without changing the fixtures though... I think.23:49
KiallAnyway - 99% sure all the remaining breakage is in the tests rather than code now23:50
betsyYeah!!!23:50
*** vinod1 has joined #openstack-dns23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!