*** darshan104 has joined #openstack-dns | 00:33 | |
*** darshan104 has quit IRC | 01:22 | |
*** darshan104 has joined #openstack-dns | 01:24 | |
*** darshan104 has quit IRC | 01:34 | |
*** darshan104 has joined #openstack-dns | 01:35 | |
*** EricGonczer_ has joined #openstack-dns | 01:38 | |
*** darshan104 has quit IRC | 01:40 | |
*** nosnos has joined #openstack-dns | 01:51 | |
*** EricGonczer_ has quit IRC | 01:54 | |
*** HenryG_ is now known as HenryG | 02:01 | |
*** nkinder has joined #openstack-dns | 02:32 | |
*** nkinder has quit IRC | 02:59 | |
*** darshan104 has joined #openstack-dns | 03:34 | |
*** darshan104 has quit IRC | 03:39 | |
*** darshan104 has joined #openstack-dns | 04:35 | |
*** darshan104 has quit IRC | 04:40 | |
*** darshan104 has joined #openstack-dns | 04:51 | |
*** nosnos has quit IRC | 05:57 | |
*** nosnos_ has joined #openstack-dns | 06:00 | |
*** darshan104 has quit IRC | 08:13 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Rollback master backend on all exceptions in multi backend https://review.openstack.org/119718 | 09:19 |
---|---|---|
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Rollback master backend on all exceptions in multi backend https://review.openstack.org/119718 | 09:20 |
*** jordanP has joined #openstack-dns | 10:19 | |
jordanP | hi | 10:19 |
ekarlso- | jordanP: hey | 10:20 |
jordanP | is grahamhayes around here ? | 10:20 |
jordanP | what's his usual nick name ? | 10:20 |
ekarlso- | ping mugsie :) | 10:20 |
jordanP | mugsie, :) ping | 10:20 |
jordanP | ekarlso-, thanks for the info | 10:21 |
jordanP | mugsie, i'll leave a message, ping me back if you have time : I am looking at https://github.com/openstack/designate/commit/47e92c4da5e8bdbec2016fbad7921656e9722e96 You moved the call to policy.init() to designate/service.py. But it seems that designate api and designate central doesn't inherit from a class defined in designate/service.py. Thus the call to policy.init() is never done. For instance, in a fresh devstack, I can"t launch designate centra | 10:25 |
jordanP | l. Moreoever I get the following stack trace in the default nova notification handler of designate-sink : http://paste.openstack.org/show/108176/ | 10:25 |
jordanP | i am having launch, brb | 10:26 |
mugsie | jordanP: hey | 10:30 |
jordanP | mugsie, hey | 10:30 |
mugsie | yeah - I found this issue with the agent last week | 10:30 |
openstackgerrit | Endre Karlson proposed a change to openstack/designate: Make use of SQLA Core in PowerDNS https://review.openstack.org/119516 | 10:30 |
mugsie | but, afik central / api are fine - they should be inheriting from designate/service | 10:30 |
mugsie | let me dig into the central / api iussue - I will upload my ps for the agent | 10:31 |
mugsie | you have logs from the central startup? | 10:31 |
jordanP | mugsie, central seems to inherit from wsgi.Service | 10:31 |
jordanP | mugsie, the stack trace looked exactly as http://paste.openstack.org/show/108176/ | 10:32 |
Kiall | "central seems to inherit from wsgi.Service" huh no, that's can't be right? | 10:32 |
mugsie | jordanP: https://github.com/openstack/designate/blob/master/designate/central/service.py#L72 | 10:32 |
mugsie | that is from desingate/service | 10:32 |
Kiall | Oh.. I guess he means the api inherits from wsgi.Service | 10:33 |
jordanP | yeah sorry.... | 10:33 |
Kiall | Which it does, humm | 10:33 |
Kiall | Why aren't we seeing this in the gate? | 10:33 |
jordanP | i am 100% new to designate, I just want to give it a try | 10:33 |
mugsie | the api policy gets init'sd in the middleware afik | 10:33 |
Kiall | jordanP: So, designate-central should launch fine - every commit causes a devstack install to be done, and some tests performed against it... What error are you seeing? | 10:34 |
Kiall | mugsie: no references to policy in the middleware.py file | 10:34 |
jordanP | Kiall, at the moment I am seeing this error http://paste.openstack.org/show/108176/ when designate sink receives a notification | 10:35 |
mugsie | oh... | 10:35 |
mugsie | this might be a policy config file issue | 10:36 |
mugsie | can you paste the full output when you start the api? | 10:36 |
mugsie | (redact any passwords etc) | 10:36 |
jordanP | yep | 10:36 |
jordanP | designate api logs : http://paste.openstack.org/show/108184/ | 10:38 |
jordanP | cloud@jordan-test-1:~/devstack$ ls -la /etc/designate/policy.json | 10:39 |
jordanP | -rw-r--r-- 1 cloud cloud 2251 Aug 29 14:28 /etc/designate/policy.json | 10:39 |
jordanP | mugsie, ^^ | 10:40 |
mugsie | jordanP: k looking now | 10:42 |
jordanP | k | 10:42 |
Kiall | yep.. waiting for a devstack run to complete to have a look myself | 10:47 |
jordanP | it seems that sink inherits from service.Service, but this is the module defined in "from designate.openstack.common import service" | 10:49 |
jordanP | and not designate/service.py | 10:49 |
Kiall | Really? That's probably a mistake.. Humm | 10:50 |
jordanP | yeah it seems so, 90% sure | 10:50 |
jordanP | :) | 10:50 |
Kiall | Okay.. Could you report a bug for the sink issue? I can work up a fix for that one now | 10:52 |
jordanP | designate central is fine because it doesn't import designate.openstack.common import service | 10:52 |
jordanP | Kiall, I will submit a bug report in an hour or so | 10:53 |
jordanP | i'll have launch with collegues before, otherwise i'll alone :( | 10:53 |
Kiall | :D | 10:53 |
mugsie | jordanP: just did a fresh devstack - central & api both seem to be working fine | 11:12 |
mugsie | havent tested sink | 11:12 |
Kiall | mugsie: I've reproduced, api bails.. and Sink is def wrong too | 11:19 |
Kiall | It only happens with ?all_tenants=1 - where the policy code is called... | 11:19 |
mugsie | hum | 11:20 |
mugsie | that definitly used to work | 11:20 |
Kiall | jordanP: I filed bug 1366764 for the sink part of this issue, think I have a fix ready... | 11:21 |
uvirtbot | Launchpad bug 1366764 in designate "Policy is not initialized in designate-sink" [High,Triaged] https://launchpad.net/bugs/1366764 | 11:21 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Ensure designate-sink has policy initialized https://review.openstack.org/119735 | 11:22 |
*** mwagner_lap has quit IRC | 11:23 | |
Kiall | and bug 1366766 for the API side, which is a more involved fix (at least, if we do it "correctly") | 11:25 |
uvirtbot | Launchpad bug 1366766 in designate "Policy is not initialized in designate-api" [High,Confirmed] https://launchpad.net/bugs/1366766 | 11:25 |
openstackgerrit | Endre Karlson proposed a change to openstack/designate: Make use of SQLA Core in PowerDNS https://review.openstack.org/119516 | 11:29 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Ensure designate-sink has policy initialized https://review.openstack.org/119735 | 11:37 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Ensure designate-api has policy initialized https://review.openstack.org/119737 | 11:37 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Ensure designate-api has policy initialized https://review.openstack.org/119737 | 11:38 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Ensure designate-api has policy initialized https://review.openstack.org/119737 | 11:39 |
Kiall | (probably the last review for that ;)) | 11:39 |
jordanP | i am back | 11:48 |
jordanP | Kiall, thanks for the patch, I'll test this right now :) | 11:52 |
Kiall | jordanP: sure, there's 2 patches.. 1 for sink and 1 for the api .. They should work :) | 11:53 |
*** mwagner_lap has joined #openstack-dns | 12:02 | |
*** nosnos_ has quit IRC | 12:13 | |
*** RaginBajin has joined #openstack-dns | 12:14 | |
*** nosnos has joined #openstack-dns | 12:14 | |
*** diga has joined #openstack-dns | 12:14 | |
*** nosnos has quit IRC | 12:18 | |
*** betsy has joined #openstack-dns | 12:25 | |
betsy | Kiall: You around? | 12:26 |
Kiall | Heya | 12:26 |
Kiall | betsy: yep, I am | 12:26 |
betsy | good morning | 12:26 |
betsy | So, I wanted to ask you about the managed feature | 12:26 |
betsy | I couldn’t figure out how it is suppose to work. There are about 5 fields for it in the database | 12:27 |
betsy | Is it written up anywhere? | 12:27 |
Kiall | No, and I think it may even be "broken" at the minute.. the API should be rejecting calls to update/delete managed=True stuff, but it's not | 12:28 |
betsy | Right. We talked about that it’s broken and I looked into fixing it, but I’m not sure how it’s supposed to work | 12:29 |
betsy | Could you open a bug for it and describe how it’s supposed to work? | 12:29 |
betsy | Who can update it? | 12:29 |
betsy | Admins or only a certain project id? | 12:29 |
Kiall | Sure.. I can file a bug, in the meantime.. The original intent was actually fairly simple - if managed=True, Nobody should be allowed edit it via the API as the resource is "managed internally" by Designate. | 12:32 |
betsy | Then how does it get changed if nobody can edit it? | 12:34 |
betsy | For example, if the SOA is managed, it still has to be updated every time the serial number changes. | 12:34 |
betsy | Does it skip the policy file? | 12:35 |
betsy | Anyway, I description would help | 12:35 |
mugsie | betsy: that would be designate changing it internally, not via the API | 12:36 |
Kiall | So, the `if managed==True: raise YouCantDoThisException()` would live in the API layer, so internal updates for SOA etc would never hit that code | 12:37 |
Kiall | (sorry - debugging/discussing about 3 issues at once ;) Hence the short replies :D) | 12:37 |
betsy | :) No problem. | 12:37 |
betsy | What about the other db fields? How do they fit it? | 12:37 |
betsy | Anyway. You can write up the bug and I can ask any other questions about it later | 12:39 |
*** diga has quit IRC | 12:49 | |
*** richm1 has joined #openstack-dns | 13:11 | |
Kiall | betsy: so, we've discovered a fairly serious issue with the expose NS/SOA stuff.. While tracing another issue, I noticed the NS/SOA generation code was still in the powerdns / bind / ipa backends .. | 13:13 |
Kiall | I expected to find duplicates of the NS/SOA's in the DB.. But.. Didn't, it seems anything done with create/update/delete_recordset is effectively ignored by the backends as the methods aren't implemented .. | 13:13 |
Kiall | Things seemed to work, as the SOA/NS generation was still in place, and because the gate uses the V1 API, which does create/update/delete_record rather than create/update/delete_recordset | 13:14 |
Kiall | Working through what we need to fix it now :( | 13:14 |
*** EricGonczer_ has joined #openstack-dns | 13:30 | |
*** eankutse has joined #openstack-dns | 13:44 | |
jordanP | Kiall, so I tested your patched, they seem to work, they got ride of the policy engine not being initialised. Now I get another error when designate-sink receives a notification from nova, the stack trace is here : http://paste.openstack.org/show/108289/ | 13:50 |
jordanP | could it be related to the problem you mentionned half an hour ago ? | 13:50 |
Kiall | Possibly - It seems we have a pretty serious issue right now that went unnoticed :( | 13:51 |
Kiall | (and debugging the policy issues you spotted led me to find it! Thanks ;)) | 13:52 |
jordanP | okay, that's good to know | 13:54 |
*** timsim has joined #openstack-dns | 13:59 | |
*** nkinder has joined #openstack-dns | 14:00 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: WIP: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 14:04 |
Kiall | mugsie: .. start of the fix, some tests still failing - haven't dug in yet | 14:04 |
mugsie | k | 14:07 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: WIP: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 14:10 |
Kiall | Tests fixed.. Never try to fix something "While you're in there anyway" | 14:11 |
mugsie | :) | 14:11 |
mugsie | thats just a good rule for life | 14:11 |
betsy | kiall: let me know if I can help | 14:28 |
*** betsy has quit IRC | 14:29 | |
*** paul_glass has joined #openstack-dns | 14:33 | |
*** paul_glass has quit IRC | 14:36 | |
*** paul_glass has joined #openstack-dns | 14:37 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: WIP: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 15:01 |
*** paul_glass1 has joined #openstack-dns | 15:06 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 15:09 |
Kiall | mugsie: .. https://review.openstack.org/#/c/119768/4/designate/resources/templates/bind9-zone.jinja2 | 15:09 |
*** paul_glass has quit IRC | 15:09 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 15:11 |
*** EricGonc_ has joined #openstack-dns | 15:11 | |
Kiall | Okay.. bind+powerdns both work as expected etc now... | 15:11 |
*** EricGonczer_ has quit IRC | 15:11 | |
*** vinod1 has joined #openstack-dns | 15:21 | |
*** betsy has joined #openstack-dns | 15:25 | |
*** EricGonczer_ has joined #openstack-dns | 15:36 | |
*** EricGonc_ has quit IRC | 15:36 | |
*** mikedillion has joined #openstack-dns | 15:40 | |
*** mwagner_lap has quit IRC | 15:46 | |
openstackgerrit | Vinod Mangalpally proposed a change to openstack/designate: _find_recordsets returns active recordsets only https://review.openstack.org/119502 | 15:53 |
*** rmoe has quit IRC | 15:53 | |
*** mikedillion has quit IRC | 16:04 | |
*** EricGonc_ has joined #openstack-dns | 16:04 | |
*** EricGonczer_ has quit IRC | 16:04 | |
*** rmoe has joined #openstack-dns | 16:08 | |
*** EricGonc_ has quit IRC | 16:09 | |
*** mikedillion has joined #openstack-dns | 16:09 | |
*** EricGonczer_ has joined #openstack-dns | 16:12 | |
vinod1 | kiall/mugsie: Re https://review.openstack.org/#/c/119502/ | 16:16 |
vinod1 | Mugsie mentioned adding a new parameter | 16:16 |
mugsie | vinod1: Kiall has decided he doesn't like the parameter, so an extra item in the criterion should work | 16:17 |
vinod1 | Adding another key/value pair to criterion too looks good | 16:17 |
mugsie | yeah - the name should be domains_deleted - as it is about if the domain is deleted, not the recordset | 16:17 |
vinod1 | okay - will add a domains_deleted to the criterion | 16:19 |
mugsie | cool - thanks vinod1 | 16:21 |
*** mikedillion has quit IRC | 16:28 | |
*** mikedillion has joined #openstack-dns | 16:30 | |
*** darshan104 has joined #openstack-dns | 16:39 | |
*** jordanP has quit IRC | 16:42 | |
openstackgerrit | Vinod Mangalpally proposed a change to openstack/designate: _find_recordsets returns active recordsets only https://review.openstack.org/119502 | 17:03 |
Kiall | vinod1: Discovered a pretty big issue earlier.. https://review.openstack.org/#/c/119768/ is a review to (hopefully) fix it | 17:15 |
Kiall | vinod1: you guys know bind better, so the "workaround" I've put in for bind might have a better alternative... | 17:15 |
vinod1 | reviewing it now | 17:15 |
*** rjrjr has joined #openstack-dns | 17:18 | |
*** EricGonc_ has joined #openstack-dns | 17:19 | |
*** EricGonczer_ has quit IRC | 17:19 | |
Kiall | thanks | 17:21 |
*** eankutse has quit IRC | 17:31 | |
*** mwagner_lap has joined #openstack-dns | 17:36 | |
*** darshan104 has quit IRC | 17:47 | |
*** rjrjr has quit IRC | 17:51 | |
*** eankutse has joined #openstack-dns | 18:09 | |
*** diga has joined #openstack-dns | 18:17 | |
*** vinod1 has quit IRC | 18:33 | |
*** darshan104 has joined #openstack-dns | 18:36 | |
*** diga has quit IRC | 18:39 | |
*** vinod1 has joined #openstack-dns | 18:41 | |
*** vinod1 has quit IRC | 18:45 | |
*** vinod1 has joined #openstack-dns | 18:46 | |
*** mikedillion has quit IRC | 18:49 | |
*** openstackgerrit has quit IRC | 18:51 | |
Kiall | openstackgerrit - who said you could leave? ;) | 18:51 |
timsim | slacker... | 18:52 |
Kiall | ;) | 18:53 |
*** mikedillion has joined #openstack-dns | 19:04 | |
*** openstackgerrit has joined #openstack-dns | 19:06 | |
*** ChanServ sets mode: +v openstackgerrit | 19:06 | |
*** openstackgerrit has quit IRC | 19:06 | |
*** openstackgerrit has joined #openstack-dns | 19:07 | |
*** ChanServ sets mode: +v openstackgerrit | 19:07 | |
openstackgerrit | Betsy Luzader proposed a change to openstack/designate: Downgrade in 039 does not delete NS recordsets https://review.openstack.org/119890 | 19:34 |
*** zain has joined #openstack-dns | 19:37 | |
openstackgerrit | A change was merged to openstack/designate: _find_recordsets returns active recordsets only https://review.openstack.org/119502 | 19:38 |
*** amcrn has joined #openstack-dns | 19:40 | |
*** darshan104 has quit IRC | 20:18 | |
betsy | Kiall: for https://review.openstack.org/#/c/119890/, and filtering on individual records — what would I look for, if the record data == the server name, delete? | 20:25 |
Kiall | I think you need to find the recordset ID, then `DELETE FROM records where recordset_id = <ID> AND managed = True` | 20:26 |
Kiall | (or do a join and DELETE ... WHERE recordsets.name = <name> AND recordsets.type = <type> AND records.managed = True` | 20:26 |
Kiall | re managed=True - They are, L152 shows the migration added records are getting managed=True | 20:27 |
betsy | That would work, except for one thing… | 20:27 |
betsy | When I’m looking at mysql, all the managed are set to 0, not 1 | 20:28 |
Kiall | Yea, zones added after that won't get managed = True.. Which sucks.. But we have no way to tell those apart from user added ones :( | 20:28 |
Kiall | If you add zones before migration 39, they'll have it | 20:28 |
betsy | Nope, they don’t | 20:28 |
betsy | I just redid this vagrant box with 39 | 20:28 |
betsy | They’re set to managed=True in the code, but the db is still set to 0 | 20:29 |
Kiall | Humm, That's odd.. The code looks to be doing it | 20:29 |
Kiall | if that's not working for some reason, then, we have no way to tell the difference :( | 20:30 |
betsy | Bad word! Bad word! | 20:31 |
betsy | Oh, never mind! | 20:32 |
betsy | I just ran the upgrade again and it worked! | 20:32 |
betsy | I scared myself | 20:32 |
* Kiall hides.. Not-deterministic migrations are always scary ;) | 20:33 | |
betsy | I’d been playing with the downgrade and upgrade too many times testing the bug I just submitted | 20:33 |
*** vinod1 has quit IRC | 20:33 | |
betsy | So, can I filter on the records being managed = true and type = ns and that’s it? | 20:33 |
Kiall | We probably also want to add managed=True here, so future ones get marked too: https://github.com/openstack/designate/blob/master/designate/central/service.py#L411 | 20:34 |
betsy | Or do I still need to check for root delegation? | 20:34 |
Kiall | Well, we only add NS's at the root, so probably best to find just those | 20:34 |
* Kiall hates Jinja2's whitespace control | 20:34 | |
betsy | Would there be any that were managed = true that are not root? | 20:35 |
betsy | Or is that not a good assumption? | 20:35 |
betsy | And I’ll fix the managed = true in central for ns and soa | 20:36 |
Kiall | In theory, there could be.. Either in the future we add some, or some sink plugin is creating them, etc etc - We wouldn't want to accidentally purge those :) | 20:36 |
*** darshan104 has joined #openstack-dns | 20:36 | |
betsy | That’s true. Ok. | 20:36 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 20:39 |
Kiall | vinod: Just fixed the whitespace issue in the bind9 template... ^ | 20:39 |
betsy | Kiall: One more question | 20:40 |
betsy | If I delete the records instead of the recordsets, wouldn’t that leave empty NS recordsets in the db? | 20:40 |
Kiall | vinod: logs at .. http://paste.openstack.org/show/108452/ | 20:40 |
Kiall | Yes, but that's a much better position than deleting customer data :) We could check if there are no more records in the RRSet, then delete it too if there are none | 20:41 |
betsy | ok | 20:42 |
Kiall | (We have customers with NS records at the root, deleting them would be disastrous ;)) | 20:42 |
betsy | So back to the drawing board. :) | 20:45 |
*** HenryG has quit IRC | 20:48 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Backends need to implement c/u/d_recordset https://review.openstack.org/119768 | 20:55 |
Kiall | vinod: also spotted your (2) part in the comment + fixed | 20:55 |
*** HenryG has joined #openstack-dns | 21:00 | |
betsy | Kiall: With expose NS and SOA, you cannot update the root NS recordset, which means you can’t add a non-managed record to it | 21:05 |
*** amcrn has quit IRC | 21:05 | |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Support filtering on Zone/RecordSet status https://review.openstack.org/110157 | 21:05 |
openstackgerrit | Kiall Mac Innes proposed a change to openstack/designate: Support filtering on Zone/RecordSet status https://review.openstack.org/110157 | 21:07 |
*** mwagner_lap has quit IRC | 21:08 | |
Kiall | betsy: Wasn't that just a temp restriction, until we fixed managed? | 21:08 |
betsy | Yeah, I guess it was. | 21:08 |
betsy | Ok. I’ll just ignore that for now and change the db by hand, so I can test my fix | 21:09 |
*** arborism has joined #openstack-dns | 21:10 | |
*** arborism is now known as amcrn | 21:11 | |
*** EricGonc_ has quit IRC | 21:20 | |
*** eankutse has quit IRC | 21:29 | |
*** darshan104 has quit IRC | 21:35 | |
*** darshan104 has joined #openstack-dns | 21:37 | |
*** mikedillion has quit IRC | 21:46 | |
*** zain has quit IRC | 21:47 | |
*** zain1 has joined #openstack-dns | 21:47 | |
*** vinod1 has joined #openstack-dns | 21:48 | |
*** zain1 has quit IRC | 21:53 | |
*** betsy has quit IRC | 22:03 | |
*** timsim has quit IRC | 22:09 | |
*** darshan104 has quit IRC | 22:15 | |
*** darshan104 has joined #openstack-dns | 22:15 | |
*** mwagner_lap has joined #openstack-dns | 22:24 | |
*** amcrn_ has joined #openstack-dns | 22:30 | |
*** paul_glass1 has quit IRC | 22:32 | |
*** amcrn has quit IRC | 22:32 | |
*** zain has joined #openstack-dns | 22:38 | |
*** vinod1 has quit IRC | 22:49 | |
*** eankutse has joined #openstack-dns | 22:52 | |
*** zain has quit IRC | 22:54 | |
openstackgerrit | A change was merged to openstack/designate: Rollback master backend on all exceptions in multi backend https://review.openstack.org/119718 | 22:59 |
*** amcrn_ is now known as amcrn | 23:01 | |
*** eankutse has quit IRC | 23:21 | |
*** eankutse has joined #openstack-dns | 23:21 | |
*** betsy has joined #openstack-dns | 23:35 | |
*** nkinder has quit IRC | 23:42 | |
*** eankutse has quit IRC | 23:45 | |
*** richm1 has quit IRC | 23:47 | |
*** eankutse has joined #openstack-dns | 23:48 | |
*** betsy has quit IRC | 23:53 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!