*** bandarji has quit IRC | 00:01 | |
*** jorgem has quit IRC | 00:01 | |
*** bandarji has joined #openstack-dns | 00:02 | |
*** vinod1 has joined #openstack-dns | 00:03 | |
*** sbfox has quit IRC | 00:07 | |
*** dtx00ff has quit IRC | 00:13 | |
*** vinod1 has quit IRC | 00:18 | |
*** vinod1 has joined #openstack-dns | 00:20 | |
*** nkinder has joined #openstack-dns | 00:20 | |
*** vinod1 has quit IRC | 00:23 | |
*** rmoe has quit IRC | 00:31 | |
*** mwagner_lap has joined #openstack-dns | 00:40 | |
*** rmoe has joined #openstack-dns | 00:47 | |
*** rmoe has quit IRC | 01:08 | |
*** rmoe has joined #openstack-dns | 01:20 | |
*** crc32 has quit IRC | 01:25 | |
*** sbfox has joined #openstack-dns | 01:37 | |
*** msisk has quit IRC | 01:45 | |
*** nosnos has joined #openstack-dns | 01:46 | |
*** yidclare has quit IRC | 02:01 | |
*** sbfox has quit IRC | 02:04 | |
*** bandarji has quit IRC | 02:10 | |
*** richm has quit IRC | 02:17 | |
*** yidclare has joined #openstack-dns | 02:35 | |
*** yidclare has quit IRC | 02:48 | |
*** dtx00ff has joined #openstack-dns | 03:01 | |
*** sballe has joined #openstack-dns | 03:11 | |
*** sballe has quit IRC | 03:26 | |
*** sballe has joined #openstack-dns | 03:27 | |
*** dtx00ff has quit IRC | 03:34 | |
*** nosnos has quit IRC | 03:43 | |
*** sballe has quit IRC | 03:43 | |
*** vinod1 has joined #openstack-dns | 04:05 | |
*** vinod1 has quit IRC | 04:06 | |
*** vinod1 has joined #openstack-dns | 04:12 | |
*** vinod1 has quit IRC | 04:13 | |
*** sballe has joined #openstack-dns | 04:25 | |
*** sballe has quit IRC | 04:32 | |
*** matsuhashi has joined #openstack-dns | 04:39 | |
*** vinod1 has joined #openstack-dns | 04:40 | |
*** nosnos has joined #openstack-dns | 04:41 | |
*** dtx00ff has joined #openstack-dns | 04:43 | |
*** sbfox has joined #openstack-dns | 04:54 | |
*** vinod1 has quit IRC | 04:57 | |
*** dtx00ff_ has joined #openstack-dns | 04:59 | |
*** dtx00ff has quit IRC | 05:03 | |
*** CaptTofu has quit IRC | 06:04 | |
*** harmw has quit IRC | 06:06 | |
*** simonmcc has quit IRC | 06:06 | |
*** CaptTofu has joined #openstack-dns | 06:06 | |
*** harmw has joined #openstack-dns | 06:07 | |
*** simonmcc has joined #openstack-dns | 06:08 | |
*** ytwu has joined #openstack-dns | 06:12 | |
*** dtx00ff has joined #openstack-dns | 06:13 | |
*** dtx00ff_ has quit IRC | 06:16 | |
*** ttrumm has joined #openstack-dns | 06:32 | |
*** sbfox has quit IRC | 06:42 | |
*** sbfox has joined #openstack-dns | 06:44 | |
*** dtx00ff_ has joined #openstack-dns | 07:47 | |
*** dtx00ff has quit IRC | 07:50 | |
*** dtx00ff_ has quit IRC | 08:00 | |
*** amarao has joined #openstack-dns | 08:56 | |
*** sbfox has quit IRC | 09:25 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure designte-sink does not exit when no handlers are enabled https://review.openstack.org/98071 | 09:42 |
---|---|---|
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure designte-sink does not exit when no handlers are enabled https://review.openstack.org/98071 | 09:46 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Sync with global-requirements https://review.openstack.org/98073 | 09:55 |
*** matsuhashi has quit IRC | 10:31 | |
*** matsuhashi has joined #openstack-dns | 10:34 | |
*** matsuhashi has quit IRC | 11:06 | |
*** matsuhashi has joined #openstack-dns | 11:06 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure DevStack gate passes https://review.openstack.org/98071 | 11:07 |
*** matsuhashi has quit IRC | 11:10 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure DevStack gate passes https://review.openstack.org/98071 | 11:15 |
*** nosnos has quit IRC | 11:20 | |
*** matsuhashi has joined #openstack-dns | 11:24 | |
*** matsuhashi has quit IRC | 11:24 | |
*** matsuhashi has joined #openstack-dns | 11:24 | |
*** matsuhashi has quit IRC | 11:29 | |
*** ttrumm has quit IRC | 11:45 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure DevStack gate passes https://review.openstack.org/98071 | 12:11 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 12:21 |
Kiall | mugsie: 2014-06-05 12:22:32.813 | Finished: SUCCESS | 12:22 |
mugsie | sweet | 12:22 |
Kiall | Need to revert Rich's patch though :'( | 12:23 |
mugsie | the sink? | 12:23 |
Kiall | I can't see a way to fix it otherwise :'( | 12:23 |
Kiall | yea | 12:23 |
Kiall | And the revert fails to merge :'( | 12:23 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 12:27 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 12:41 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure designte-sink does not exit when no handlers are enabled https://review.openstack.org/98095 | 12:41 |
*** eankutse has joined #openstack-dns | 12:57 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 12:59 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Switch stop_designate to use screen_stop rather than `kill` https://review.openstack.org/98101 | 12:59 |
*** vinod1 has joined #openstack-dns | 13:00 | |
*** jmcbride has joined #openstack-dns | 13:06 | |
*** nkinder has quit IRC | 13:10 | |
*** jmcbride1 has joined #openstack-dns | 13:22 | |
*** jmcbride has quit IRC | 13:23 | |
*** vinod1 has quit IRC | 13:31 | |
*** vinod1 has joined #openstack-dns | 13:33 | |
*** vinod1 has quit IRC | 13:37 | |
*** vinod1 has joined #openstack-dns | 13:41 | |
*** jmcbride1 has quit IRC | 13:43 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure our DevStack plugin cleans up services it starts https://review.openstack.org/98111 | 13:44 |
*** vinod1 has quit IRC | 13:48 | |
*** vinod1 has joined #openstack-dns | 13:51 | |
*** vinod1 has quit IRC | 13:52 | |
*** sballe has joined #openstack-dns | 13:55 | |
*** jmcbride has joined #openstack-dns | 13:58 | |
*** crc32 has joined #openstack-dns | 14:00 | |
*** nkinder has joined #openstack-dns | 14:01 | |
*** jaycaz has joined #openstack-dns | 14:01 | |
*** nkinder has quit IRC | 14:05 | |
*** jorgem has joined #openstack-dns | 14:08 | |
*** tmc3inphilly has joined #openstack-dns | 14:12 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure our DevStack plugin cleans up services it starts https://review.openstack.org/98111 | 14:13 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 14:13 |
Kiall | Devstack will kill me -_- | 14:13 |
*** tmc3inphilly has quit IRC | 14:14 | |
*** tmc3inphilly has joined #openstack-dns | 14:14 | |
*** tmc3inphilly has quit IRC | 14:15 | |
*** tmc3inphilly has joined #openstack-dns | 14:16 | |
*** nkinder has joined #openstack-dns | 14:18 | |
*** yidclare has joined #openstack-dns | 14:23 | |
*** vinod1 has joined #openstack-dns | 14:26 | |
openstackgerrit | Endre Karlson proposed a change to stackforge/designate: Switch to oslo.db https://review.openstack.org/98122 | 14:28 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure our DevStack plugin cleans up services it starts https://review.openstack.org/98111 | 14:31 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 14:31 |
*** rmoe has quit IRC | 14:31 | |
*** yidclare has quit IRC | 14:33 | |
*** vinod1 has quit IRC | 14:37 | |
*** msisk has joined #openstack-dns | 14:39 | |
*** betsy has joined #openstack-dns | 14:40 | |
*** rmoe has joined #openstack-dns | 14:45 | |
eankutse | Kiall: heya | 14:53 |
Kiall | eankutse: heya | 14:58 |
eankutse | question | 14:58 |
eankutse | In the mdns dependency graph here (#link https://blueprints.launchpad.net/designate/+spec/mdns-master), the item labeled 'mdns-designate-mdns-functional' which has three other task below it - Is that item just place holder for the items below it or is it a deliverable in itself? | 14:58 |
*** jmcbride has quit IRC | 15:00 | |
eankutse | Kiall: brb | 15:00 |
Kiall | eankutse: sorry, just dialed into a call | 15:01 |
*** ytwu has quit IRC | 15:06 | |
*** ytwu has joined #openstack-dns | 15:07 | |
*** jmcbride has joined #openstack-dns | 15:12 | |
*** jmcbride has quit IRC | 15:16 | |
*** jmcbride has joined #openstack-dns | 15:17 | |
*** jmcbride has quit IRC | 15:19 | |
*** vinod1 has joined #openstack-dns | 15:20 | |
*** bandarji has joined #openstack-dns | 15:23 | |
*** rmoe has quit IRC | 15:25 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Revert "add sink support to designate devstack" https://review.openstack.org/98093 | 15:26 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure we configure all keystone middleware options https://review.openstack.org/98151 | 15:26 |
jaycaz | Hello openstack-dns! My name is Jordan and I'm the new intern on the Cloud DNS team at Rackspace. I was looking into features to implement and was told that Designate was in need of a more comprehensive logging system... | 15:26 |
jaycaz | First, for anyone particularly familiar with the logging system, where should I look to first to understand the internals? | 15:28 |
*** jmcbride has joined #openstack-dns | 15:28 | |
jaycaz | Second, for anyone, what kind of information do you think the logging system is missing, or it has already but could be removed? | 15:29 |
mugsie | jaycaz: it depends on what your definition of logging is ;) | 15:31 |
Kiall | jaycaz: I think it's biggest failings are lack of consistency (some debug messages should be warnings, some warnings should be info), combined with just not putting enough info out without having debug enabled | 15:31 |
Kiall | Hi BTW :) | 15:31 |
jaycaz | Hi Kiall! I see you're a big contributor to the Designate repo | 15:32 |
Kiall | Yep - You could say that :D | 15:32 |
mugsie | I think there is a requirement for an Audit Trail from within RAX - was that what was being talked about? | 15:32 |
*** richm has joined #openstack-dns | 15:32 | |
eankutse | Kiall is the Tech Lead for Designate :-) | 15:32 |
jaycaz | oh, makes sense then :P | 15:33 |
Kiall | jaycaz: So, you're tsimmons replacement after he graduated? :) | 15:33 |
jaycaz | #link https://blueprints.launchpad.net/designate/+spec/standardize-logging | 15:34 |
jaycaz | actually, it's related to this blueprint that vinod1 posted | 15:34 |
jaycaz | and yes, I'm the replacement intern. tsimmons has already been a great help | 15:35 |
mugsie | jaycaz: ah yes | 15:35 |
mugsie | that is 100% needed | 15:36 |
jaycaz | Great! I'd be glad to help improve it then. | 15:36 |
mugsie | i dont think the logging system itself needs replaceing | 15:36 |
mugsie | it is what we log that is the problem | 15:37 |
mugsie | we dont have a standardise level (aka what is info, debug etc) | 15:37 |
mugsie | and the logs are all formated inconsistantly | 15:37 |
richm | rjrjr: In your bind9 delete testing, do you have allow-update set in your bind9 config? | 15:37 |
jaycaz | mugsie: good to know; maybe defining these groups more clearly would be a good place to start | 15:38 |
mugsie | yes - i think that would help alright | 15:41 |
jaycaz | I found the designate/openstack/common/log.py file. Are there any more files responsible for the logging? | 15:41 |
mugsie | for implemeting it? no | 15:42 |
mugsie | for actually logging, pretty much all files will import that one | 15:42 |
mugsie | (we can't change that file - it is a common logging lib from upstream openstack) | 15:43 |
jaycaz | okay, good to know. then I have a good place to start! | 15:43 |
jaycaz | Thanks all! I'll probably be back with more questions soon :P | 15:44 |
mugsie | cool | 15:44 |
*** rmoe has joined #openstack-dns | 15:45 | |
mugsie | just shout out in here | 15:45 |
mugsie | you based in austin as well? | 15:45 |
jaycaz | yup! I'm sitting right between msisk and eankutse | 15:45 |
jaycaz | they've both been invaluable | 15:45 |
jaycaz | as well as the rest of the team | 15:46 |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Testing https://review.openstack.org/98163 | 15:55 |
Kiall | DevStack will literally kill me | 15:55 |
richm | Kiall: why all of the changes to lib/designate? | 15:58 |
Kiall | richm: I've been suspecting designate-sink is part of the failure, or the stop/start done in there for sink, or .. | 15:58 |
Kiall | Honestly clutching at straws right now ;) | 15:59 |
richm | What failure? | 15:59 |
*** vinod1 has quit IRC | 15:59 | |
mugsie | richm: gate job | 15:59 |
mugsie | (the one we need to get incubated ;) ) | 15:59 |
richm | can you post a link to the failure? | 15:59 |
Kiall | The new devstack gate job refuses to pass, or give enough enough to debug -_- | 15:59 |
mugsie | richm: http://logs.openstack.org/93/98093/7/check/gate-designate-devstack-dsvm/a5c2dfd | 16:00 |
*** sbfox has joined #openstack-dns | 16:00 | |
*** vinod1 has joined #openstack-dns | 16:04 | |
*** tmc3inphilly has quit IRC | 16:05 | |
richm | central fails | 16:06 |
richm | http://logs.openstack.org/93/98093/7/check/gate-designate-devstack-dsvm/a5c2dfd/logs/screen-designate-central.txt.gz | 16:07 |
richm | AttributeError: 'Connection' object has no attribute 'connection_errors' | 16:07 |
Kiall | richm: I think that was unrelated, more recent failures: http://logs.openstack.org/63/98163/1/check/gate-designate-devstack-dsvm/4fbdcb6/logs/screen-designate-central.txt.gz | 16:08 |
Kiall | richm: I have a series of fixes BTW, not of which fix the gate: https://review.openstack.org/#/q/status:open+project:stackforge/designate+branch:master+topic:devstack-gate,n,z | 16:11 |
Kiall | The revert can most likely be dropped | 16:11 |
Kiall | It was an earlier suspicion which seems to have no panned out | 16:11 |
*** vinod1 has quit IRC | 16:12 | |
*** rossk has joined #openstack-dns | 16:14 | |
*** bandarji has quit IRC | 16:14 | |
*** bandarji has joined #openstack-dns | 16:16 | |
Kiall | http://paste.openstack.org/show/82977/ | 16:17 |
Kiall | L85 | 16:17 |
Kiall | looks relavant | 16:17 |
Kiall | ERROR: HTTPConnectionPool(host='172.16.1.8', port=9001): Max retries exceeded with url: /v1//servers (Caused by <class 'socket.error'>: [Errno 111] Connection refused) | 16:19 |
richm | looks like api is not running | 16:20 |
*** openstackgerrit has quit IRC | 16:20 | |
*** openstackgerrit has joined #openstack-dns | 16:20 | |
*** ChanServ sets mode: +v openstackgerrit | 16:20 | |
*** nkinder has quit IRC | 16:21 | |
*** nkinder has joined #openstack-dns | 16:23 | |
*** sballe has quit IRC | 16:26 | |
Kiall | yea, I'm wondering if it's a race condition | 16:27 |
richm | I've had to put in strategic sleeps when running devstack on slow VMs | 16:28 |
Kiall | It also only happens with USE_SCREEN=false (like the gate) | 16:31 |
Kiall | nice. | 16:32 |
richm | ok - I'll try a test on my slow vm with USE_SCREEN=false | 16:33 |
*** jaycaz has quit IRC | 16:46 | |
*** sballe has joined #openstack-dns | 16:46 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Testing https://review.openstack.org/98163 | 16:52 |
*** ytwu has quit IRC | 16:53 | |
*** ytwu has joined #openstack-dns | 16:54 | |
*** sbfox has quit IRC | 17:00 | |
*** jmcbride has quit IRC | 17:02 | |
*** jmcbride has joined #openstack-dns | 17:03 | |
*** sbfox has joined #openstack-dns | 17:03 | |
*** nkinder has quit IRC | 17:04 | |
*** jmcbride has quit IRC | 17:07 | |
*** amarao has quit IRC | 17:10 | |
richm | Kiall: in stop_designate - try using screen_stop $serv instead of using "screen" directly | 17:11 |
Kiall | richm: https://review.openstack.org/#/c/98101/ :) | 17:11 |
Kiall | There is 4 or 5 issues I've found :P | 17:12 |
*** jaycaz has joined #openstack-dns | 17:12 | |
Kiall | https://review.openstack.org/#/c/98163/ | 17:12 |
Kiall | that patch suceeded :D | 17:12 |
*** jaycaz has quit IRC | 17:12 | |
*** jaycaz has joined #openstack-dns | 17:12 | |
Kiall | I'd like to un-revert your change from it, and see if it still suceeds next | 17:12 |
*** sbfox has quit IRC | 17:13 | |
richm | ok | 17:13 |
*** jaycaz has quit IRC | 17:15 | |
rjrjr | richm: allow-update is set in my bind9 configuration. | 17:16 |
richm | Is the purpose of allow-update to allow rndc or nsupdate to work? | 17:17 |
*** dtx00ff has joined #openstack-dns | 17:19 | |
rjrjr | it allows dynamic updates, so it is there for nsupdate. i'm not 100% sure about rndc. | 17:19 |
*** bandarji has quit IRC | 17:19 | |
openstackgerrit | Kiall Mac Innes proposed a change to stackforge/designate: Ensure we configure all keystone middleware options https://review.openstack.org/98151 | 17:20 |
*** bandarji has joined #openstack-dns | 17:20 | |
*** nkinder has joined #openstack-dns | 17:20 | |
richm | do we support using nsupdate with designate? | 17:23 |
richm | afaict, if you use nsupdate directly against bind9, designate will not know about that change | 17:24 |
rjrjr | you are correct. but my bind is not just used for Designate managed zones ... | 17:24 |
richm | can we config something like "allow-update only for zones not managed by Designate"? | 17:25 |
*** sballe has quit IRC | 17:25 | |
rjrjr | you can move allow-update to the zone specific section of a configuration file. | 17:25 |
richm | The reason I'm asking - I tried your patch on my setup - it failed because rndc freeze/thaw are only allowed when allow-update is on | 17:26 |
rjrjr | well, then you answered the question about it being needed for rndc. 8^) | 17:26 |
richm | I do not have allow-update in my config, because I do not want to allow updates to designate managed zones | 17:27 |
*** yidclare has joined #openstack-dns | 17:27 | |
rjrjr | so, your thinking is drop the freeze/thaw and have the allow-update moved to the zone specific portion of the config file. or, keep the freeze/thaw and document the allow-update. | 17:27 |
richm | or, 3rd option, can the bind9 backend figure out if the zone is dynamic, and use freeze/thaw if so, otherwise, skip the freeze/thaw? | 17:28 |
*** eankutse has quit IRC | 17:28 | |
richm | Otherwise, it seems to me that, since we do not allow dynamic updates to designate managed zones, we should document that (if not already), and do not use freeze/thaw | 17:29 |
rjrjr | we could do that. | 17:29 |
rjrjr | let me take a look and provide another patch. 8^) | 17:30 |
richm | ok | 17:30 |
rjrjr | which option do you prefer? | 17:30 |
richm | I prefer 1 - drop freeze/thaw and assume no dynamic update | 17:30 |
rjrjr | okay. that is the approach i will take. | 17:30 |
*** jaycaz has joined #openstack-dns | 17:30 | |
*** msisk_ has joined #openstack-dns | 17:31 | |
richm | Anyone else care to chime in? | 17:31 |
*** vinod1 has joined #openstack-dns | 17:31 | |
*** msisk has quit IRC | 17:31 | |
rjrjr | when mdns comes in Juno, we'll be putting it back. 8^) | 17:31 |
*** eankutse has joined #openstack-dns | 17:32 | |
*** eankutse has quit IRC | 17:32 | |
*** eankutse has joined #openstack-dns | 17:32 | |
*** vinod1 has quit IRC | 17:32 | |
richm | possibly, but I thought that mdns would remove the need for it | 17:33 |
*** sbfox has joined #openstack-dns | 17:33 | |
rjrjr | sorry, you are correct. the nsupdate tools will work against mdns, not the DNS server being provisioned. | 17:33 |
rjrjr | my bad. 8^( | 17:34 |
richm | no worries | 17:34 |
rjrjr | okay, give me about an hour. i'll fix this up and test. | 17:34 |
richm | arg - using screen_stop in stop_designate, with USE_SCREEN=false - screen_stop designate-api will kill the entire devstack process :-P | 17:35 |
*** jmcbride has joined #openstack-dns | 17:36 | |
rjrjr | richm: the more i think about this, the more i like option 3. my problem is we have thousands of zones. not keen on updating all of them. 8^( | 17:37 |
richm | ok, that will be more difficult to code, but certainly much more flexible | 17:38 |
rjrjr | it seems if we can provide the flexibility for Designate to know how this is configured, it would be better. | 17:38 |
*** vinod1 has joined #openstack-dns | 17:38 | |
richm | yes | 17:39 |
richm | Then the bind9 backend will need to have a full fledged bind config/zone file parser | 17:40 |
richm | well, probably just config file | 17:41 |
richm | I'm assuming we can leverage zoneextractor.py | 17:41 |
richm | or, another approach | 17:41 |
richm | when rndc freeze fails, because the zone is not dynamic, does it return a unique error code? | 17:42 |
rjrjr | i'm going to revert the code in the fix (i.e. go with 1) i'll create a new bug and fix for this. | 17:42 |
rjrjr | my approach will be to add a configuration to Designate which defaults to no allow-update. it can be overridden. in the code, we can try the default and if that fails with the expected error, try the other way. this way, if you don't have allow-update configured globally, no changes needed. if you do, add the option to Designate config. in either case, a failure will cause the other method to be tried. | 17:44 |
richm | ok, sounds good | 17:44 |
rjrjr | the default will more or less be a shortcut to which method to try first. | 17:45 |
*** msisk_ has quit IRC | 17:45 | |
rjrjr | reload only or freeze, reload, thaw. | 17:45 |
*** msisk has joined #openstack-dns | 17:45 | |
*** spiffxp_ has quit IRC | 17:45 | |
rjrjr | sorry default = configuration - the default with be reload only | 17:45 |
*** spiffxp has joined #openstack-dns | 17:48 | |
*** jmcbride1 has joined #openstack-dns | 17:51 | |
*** jmcbride has quit IRC | 17:52 | |
*** msisk_ has joined #openstack-dns | 17:52 | |
*** msisk has quit IRC | 17:53 | |
*** msisk_ has quit IRC | 17:55 | |
*** msisk has joined #openstack-dns | 17:56 | |
Kiall | mugsie / betsy / vinod1 - can I get some reviews on this lot: https://review.openstack.org/#/q/status:open+project:stackforge/designate+branch:master+topic:devstack-gate,n,z | 17:57 |
*** sbfox has quit IRC | 17:57 | |
Kiall | they should all be good, and are blockers to the DevStack gate a few of the TC are waiting on | 17:58 |
Kiall | Still not a complete fix though | 17:58 |
vinod1 | i will look at them shortly | 17:58 |
openstackgerrit | Ron Rickard proposed a change to stackforge/designate: Bug #1261894: Deleting Record With BIND 9 Driver Fails https://review.openstack.org/96204 | 17:58 |
Kiall | (Except the revert one, please don't approve that - It's marked as WIP ;)) | 17:59 |
*** sbfox has joined #openstack-dns | 18:02 | |
*** dtx00ff has quit IRC | 18:14 | |
*** dtx00ff has joined #openstack-dns | 18:14 | |
rjrjr | richm: what error were you seeing with the freeze, reload, thaw in your configuration? | 18:17 |
betsy | kiall: I’ll look at them now | 18:24 |
Kiall | thanks | 18:28 |
Kiall | Really annoying, I can't reproduce the failure locally anymore :( | 18:28 |
rjrjr | richm? | 18:29 |
rjrjr | i took out the allow-update in my configuration and the freeze, reload, thaw is still working. | 18:30 |
richm | rjrjr: ok - I'm testing the latest patch now | 18:32 |
*** tmc3inphilly has joined #openstack-dns | 18:33 | |
*** jaycaz1 has joined #openstack-dns | 18:33 | |
rjrjr | no. i'm wondering what the error was with the freeze, reload, thaw code. i have allow-update disabled in my configuration and i'm having no problems with the code. | 18:33 |
*** tmc3inphilly has left #openstack-dns | 18:33 | |
richm | rjrjr: hmm - not sure - perhaps a Fedora 20 only thing? The docs say that rdnc freeze is not allowed if the zone is not dynamic | 18:33 |
*** jaycaz has quit IRC | 18:34 | |
rjrjr | what version of BIND9 are you using? | 18:34 |
rjrjr | you didn't actually get an error during your testing? | 18:34 |
richm | 9.9.4-12.P2.f20 | 18:34 |
richm | I did get an error | 18:34 |
richm | rndc: 'freeze' failed: not dynamic | 18:35 |
*** jaycaz1 has quit IRC | 18:37 | |
*** jaycaz has joined #openstack-dns | 18:37 | |
openstackgerrit | A change was merged to stackforge/designate: Ensure designte-sink does not exit when no handlers are enabled https://review.openstack.org/98095 | 18:40 |
openstackgerrit | A change was merged to stackforge/designate: Switch stop_designate to use screen_stop rather than `kill` https://review.openstack.org/98101 | 18:40 |
*** jmcbride has joined #openstack-dns | 18:41 | |
richm | rjrjr: with your latest patch - delete record works - delete domain does not - domain is still in DNS | 18:41 |
richm | the domain is still listed in the zones.config file | 18:41 |
*** jmcbride1 has quit IRC | 18:41 | |
rjrjr | i just tested and the zones.config file is empty | 18:43 |
rjrjr | are the logs showing anything? | 18:43 |
richm | no | 18:43 |
richm | the .zone file for the domain is gone | 18:43 |
openstackgerrit | A change was merged to stackforge/designate: Ensure our DevStack plugin cleans up services it starts https://review.openstack.org/98111 | 18:44 |
richm | In my case, stack.sh will create a zone | 18:44 |
richm | so there is always at least 1 zone | 18:44 |
rjrjr | richm: i just tried a few more tests. in every case, the zone file is removed and also removed from the zones.config file. | 18:48 |
richm | ok - I am going to debug central and see what's going on here | 18:49 |
rjrjr | is designate domain-list showing the domain? | 18:49 |
*** jaycaz has quit IRC | 18:49 | |
rjrjr | how about dig @localhost <domain>? | 18:49 |
rjrjr | just wondering if all the other activities are being completed except for the zones.config file. | 18:49 |
richm | designate domain-list does not show the domain | 18:50 |
richm | dig @localhost domain shows the domain | 18:50 |
rjrjr | for this to be true, the domain_sync would have failed. | 18:51 |
*** jaycaz has joined #openstack-dns | 18:51 | |
rjrjr | sorry, _sync_delete_domain in the bind9 driver. | 18:52 |
*** sbfox1 has joined #openstack-dns | 18:52 | |
*** eankutse has quit IRC | 18:52 | |
rjrjr | did you see the 'rndc delzone' command in the central logs? | 18:52 |
*** vinod1 has quit IRC | 18:53 | |
richm | no | 18:54 |
rjrjr | but yet the *.zone is missing? this is very strange... | 18:54 |
*** sbfox has quit IRC | 18:54 | |
richm | sorry, the .zone is there | 18:55 |
richm | sorry, not there | 18:55 |
richm | however | 18:55 |
*** jmcbride has quit IRC | 18:56 | |
richm | never mind - the .nzf file is the same as the zones.config file | 18:56 |
*** jaycaz has quit IRC | 18:56 | |
rjrjr | and it is pointing to a non-existing file, correct? | 18:57 |
rjrjr | do you have 'root_helper = sudo' in /etc/designate/designate.conf? | 18:57 |
*** jmcbride has joined #openstack-dns | 18:57 | |
*** jaycaz has joined #openstack-dns | 18:58 | |
rjrjr | sorry, asking if the zones.config has an entry for the zone but pointing at the *.zone file that was removed. | 18:58 |
*** jaycaz has quit IRC | 18:58 | |
*** vinod1 has joined #openstack-dns | 18:59 | |
rjrjr | it really looks like the _sync_delete_domain method in the impl_bind9 driver is what messed up here. it looks like it did somethings, but not others. | 18:59 |
richm | yes | 18:59 |
richm | the zones.config file has an entry for the zone but the .zone file was removed | 18:59 |
*** vinod1 has quit IRC | 18:59 | |
*** vinod1 has joined #openstack-dns | 18:59 | |
rjrjr | i'm assuming you have debug turned on for logging? did you see the message 'Delete Domain: <domain-id> _sync_delete_domain' | 19:01 |
*** jmcbride has quit IRC | 19:02 | |
richm | no, I don't have debug on | 19:02 |
rjrjr | the _sync_delete_domain method - 1) deletes the zone file 2) runs the rndc delzone command 3) syncs the zones.config file with the *.nzf file. | 19:02 |
richm | I'm running central in pdb now | 19:02 |
*** jmcbride has joined #openstack-dns | 19:04 | |
rjrjr | i will quit bugging you until you have a chance to diagnose. | 19:04 |
rjrjr | 8^) | 19:04 |
*** eankutse has joined #openstack-dns | 19:11 | |
rjrjr | richm: so, i have the following in my configuration - allow-update { none; }; and i can still run a 'rndc freeze <zone>' without any error. the BIND version I am using is 9.8.1-P1. | 19:15 |
*** yidclare has quit IRC | 19:15 | |
*** vinod1 has quit IRC | 19:15 | |
*** vinod1 has joined #openstack-dns | 19:16 | |
*** vinod2 has joined #openstack-dns | 19:21 | |
*** dtx00ff has quit IRC | 19:21 | |
*** vinod1 has quit IRC | 19:22 | |
*** sbfox1 has quit IRC | 19:24 | |
*** jaycaz has joined #openstack-dns | 19:31 | |
richm | hmm | 19:32 |
rjrjr | what's up? | 19:34 |
betsy | rjrjr: You’re latest patch worked for me | 19:34 |
betsy | It’s now correctly deleting the record from the zone file | 19:34 |
rjrjr | can you verify it deletes domains correctly too? richm is having a problem i cannot reproduce. | 19:35 |
betsy | Ok. I’ll try delete recordsets and domains next | 19:35 |
rjrjr | thanks! | 19:35 |
richm | yeah, record deletion works for me, domain/zone deletion does not | 19:35 |
*** vinod2 has quit IRC | 19:38 | |
*** sbfox has joined #openstack-dns | 19:38 | |
*** RaginBaj_ has quit IRC | 19:41 | |
*** jaycaz has joined #openstack-dns | 19:41 | |
rjrjr | richm: were the debug logs any help? | 19:45 |
betsy | When I deleted a recordset that contained 2 records, it correctly deleted the 2 records | 19:46 |
richm | still trying to debug | 19:46 |
betsy | When I delieted a zone, it correctly deleted it from the zones.config file | 19:46 |
rjrjr | so, betsy, this is working for you? | 19:46 |
betsy | However, as far as the zone file itself in bind, there were 4 of them all with different serial numbers | 19:47 |
betsy | Seems like every time I added a new recordset or record it updated the serial number, but created a new zone file, like: | 19:47 |
betsy | -rw-r--r-- 1 vagrant vagrant 267 Jun 5 18:55 example33.com._04f4a9ce-c685-44d5-b391-25c7834186dc.zone | 19:48 |
betsy | -rw-r--r-- 1 vagrant vagrant 267 Jun 5 18:56 example33.com._5112a787-3994-4c7f-8664-db91103518c2.zone | 19:48 |
betsy | -rw-r--r-- 1 vagrant vagrant 267 Jun 5 18:58 example33.com._7f8e0059-519b-4619-9759-caf1ba922d22.zone | 19:48 |
betsy | It did delete the latest zone file, but left these 3 | 19:48 |
betsy | Is it supposed to do that? Are y’all seeing that? | 19:48 |
rjrjr | the ._<domain-id>.zone is interesting. the domain-id kept changing? | 19:49 |
betsy | but the zones.config file was correct | 19:49 |
betsy | Well, actually, I didn’t check to see if it kept changing the domain-id in the zones.config file | 19:50 |
rjrjr | how about deleting those, creating a new zone, adding records, etc. when you run a 'designate domain-list' the ID should match the ID in the file name. see if it keeps changing. | 19:50 |
rjrjr | honestly, i only touched code dealing with deleting objects in storage. <gulp> | 19:51 |
betsy | rjrjr: Actually, I’ve seen this before, but I thought it was because my bind9 was old and corrupted | 19:51 |
rjrjr | richm/betsy, are you working off the latest code in master with this patch applied? | 19:51 |
betsy | I just created this box before I started testing so it was empty | 19:51 |
betsy | I am | 19:51 |
rjrjr | strange. | 19:52 |
richm | yes, latest code in master, with my other commits for devstack/bind9 | 19:52 |
rjrjr | those *.zone files are managed by Designate, not BIND. | 19:52 |
betsy | The zone id couldn’t have changed because I was using the same one the whole time to get the recordsets and records | 19:52 |
rjrjr | the zone-id matched the *.zone file that was deleted. then what are these other files? | 19:53 |
betsy | It’s only that bind kept writing the files — hmm let me check if any of those ending numbers were the recordset id | 19:53 |
richm | so what exactly is rndc delzone supposed to do? | 19:53 |
richm | I can run it multiple times with no errors | 19:53 |
richm | dig still shows the SOA record | 19:53 |
rjrjr | it deletes the zone dynamically from bind. the *.nzf file should be updated when you run it to remove an existing zone. | 19:54 |
rjrjr | so, if you zone is example.com 'rndc delzone example.com' removes it from bind, including updating the *.nzf file. | 19:54 |
richm | nope - not happening | 19:54 |
richm | is allow-update required for this? | 19:55 |
rjrjr | you have allow-new-zones yes; in your bind configuration? you must or the zone wouldn't have been added. | 19:55 |
richm | yes | 19:56 |
rjrjr | richm: i removed allow-update from my configuration and i can add/delete zones. | 19:56 |
rjrjr | you can try it though and see. | 19:56 |
richm | Is there an "allow-del-zones"? | 19:56 |
richm | I can add zones/records just fine, and delete records | 19:56 |
richm | I just can't delete zones | 19:56 |
betsy | I can delete zones | 19:57 |
rjrjr | seems like a config issue if the rndc delzone isn't working. try adding zones using rndc addzone and deleting them. | 19:57 |
betsy | I just seem to have extra files hanging around | 19:57 |
rjrjr | betsy, is it creating new files while you work with it? | 19:57 |
richm | the file xxxxx.nzf - does "nzf" stand for "new zone file"? | 19:58 |
rjrjr | richm: <shrug> i just know that file deals with dynamically adding zones. your guess sounds good. | 20:00 |
richm | I get this error in /var/log/messages deleted zone exercise-xxx.com. was missing from the new zone file | 20:01 |
openstackgerrit | A change was merged to stackforge/designate: Ensure we configure all keystone middleware options https://review.openstack.org/98151 | 20:02 |
rjrjr | does *.nzf or zones.config show that zone? | 20:02 |
richm | xxx.nzf shows the zone | 20:04 |
richm | and so does zones.config | 20:04 |
rjrjr | and it is giving that error? try restarting bind and doing it again. | 20:04 |
richm | ok - upon restart, bind complains that the .zone file is mentioned in the .nfz/zones.config file - now, domain is missing from dig | 20:06 |
rjrjr | betsy: the code that creates the zone file is in the _sync_domain method in impl_bind9.py. the code reads: output_path = os.path.join(output_folder, '%s.zone' % "_".join([domain['name'], domain['id']])) | 20:06 |
rjrjr | richm: i would clean this up and retest. remove the *.nzf file, *.config file, delete the domains from designate, and restart bind. | 20:07 |
richm | ok | 20:07 |
betsy | Yes. It seems to be working correctly | 20:07 |
betsy | The zone is definitely deleted correctly | 20:07 |
*** vinod1 has joined #openstack-dns | 20:07 | |
rjrjr | then you can add a zone, then delete the zone. you can try using 'rndc' first. | 20:08 |
rjrjr | betsy: cool. 8^) | 20:08 |
richm | betsy: do you have allow-update in your bind config? | 20:09 |
betsy | let me look. I know I have ‘allow-new-zones yes;’ | 20:10 |
betsy | Well, that’s in the named.conf.options | 20:11 |
richm | right | 20:11 |
richm | unless you have set allow-update per-zone | 20:11 |
rjrjr | richm: i have about 20 minutes before i'm sucked up into a meeting for the afternoon. i'll keep monitoring this chat and responding as you go, but my response time might slow down depending upon what is being talked about in the meeting. 8^) | 20:12 |
richm | ok - I'll keep debugging | 20:12 |
rjrjr | you're problem is definitely more interesting. 8^) | 20:12 |
betsy | Is that the .conf you’re asking about or is it another one? | 20:12 |
richm | betsy: yes, I guess - not sure how to set allow-update per-zone, if that would be in a zone file or somewhere else | 20:13 |
betsy | I know. So many places to configure things | 20:13 |
rjrjr | betsy: richm is using RedHat. you are probably ubuntu. run a 'grep allow-update' from the /etc/bind directory. | 20:14 |
richm | yeah, and it could be a platform problem | 20:14 |
rjrjr | richm, one problem might be where bind expects the *.nzf and where designate expects it. | 20:14 |
rjrjr | designate expects the *.nzf file to reside in /var/cache/bind | 20:15 |
rjrjr | betsy that should read 'grep allow-update *' in the /etc/bind directory. | 20:16 |
richm | I think that's it | 20:17 |
richm | not setting nzf_path | 20:17 |
richm | and of course, neither designate nor bind seems to be complaining that the path doesn't exist :P | 20:17 |
betsy | Didn’t find anything | 20:17 |
richm | ok - I think it's my problem | 20:18 |
rjrjr | LOL - Designate Jenkins never ran. man, i'm never going to get this code release. 8^( | 20:20 |
*** richm1 has joined #openstack-dns | 20:21 | |
rjrjr | does anyone know if a way to tell Gerrit to rerun the Designate Jenkins job? (or in this case, run it?) | 20:21 |
*** richm1 has left #openstack-dns | 20:21 | |
richm | https://wiki.openstack.org/wiki/GerritJenkinsGit | 20:21 |
richm | Test Failures | 20:21 |
richm | you may leave a comment with the text "recheck no bug" | 20:22 |
*** dtx00ff has joined #openstack-dns | 20:22 | |
*** richm1 has joined #openstack-dns | 20:24 | |
*** richm1 has left #openstack-dns | 20:24 | |
rjrjr | richm: thanks. kicked it off again. <fingers crossed> | 20:25 |
rjrjr | richm: so are things working now? | 20:26 |
betsy | I’ll +2 it once it passes Jenkins | 20:27 |
*** vinod1 has quit IRC | 20:27 | |
rjrjr | betsy, thanks! | 20:28 |
*** vinod1 has joined #openstack-dns | 20:32 | |
richm | no, not working :P | 20:33 |
richm | It may be a permissions problem | 20:35 |
richm | Fedora wants bind to run as named:named | 20:35 |
richm | I'm running designate as my user id | 20:35 |
richm | I've added my user id to the named group | 20:36 |
richm | but some files are not being created with named group ownership, nor group write permission | 20:36 |
rjrjr | hmmm... another thing to look at is the value of the directory option in bind. that is where it is expecting the *.nzf file to be located. | 20:37 |
richm | right - that is correct | 20:37 |
*** yidclare has joined #openstack-dns | 20:39 | |
rjrjr | on ubuntu, the bind user owns bind and files are all root:bind | 20:39 |
*** nkinder has quit IRC | 20:40 | |
*** vinod1 has quit IRC | 20:40 | |
richm | arg | 20:46 |
richm | delzone works if you omit the trailing "." | 20:46 |
*** yidclare has quit IRC | 20:47 | |
richm | what the ...? | 20:49 |
rjrjr | ? | 20:49 |
richm | in the xxx.nzf, the zone is listed without the trailing dot | 20:50 |
richm | I guess named is looking for an exact match :P | 20:50 |
richm | e.g. I have | 20:51 |
richm | zone "my.zone.tld" { type master; file "/path/to/my.zone.tld.zone"; }; | 20:51 |
richm | so, rndc delzone my.zone.tld. does not work | 20:51 |
richm | but rndc delzone my.zone.tld does work | 20:52 |
richm | my man page for rndc shows an example for addzone like this: rndc addzone example.com '{.... | 20:54 |
richm | so, no trailing dot | 20:55 |
*** jmcbride has quit IRC | 20:56 | |
*** betsy has quit IRC | 20:56 | |
richm | how does it work on ubuntu? | 20:57 |
rjrjr | trailing . works fine. | 20:59 |
rjrjr | richm: i added and deleted a zone manually using 'rndc' with a trailing dot and it worked fine. | 21:02 |
rjrjr | Designate will use the trailing dot. | 21:03 |
richm | every example I've been able to find shows addzone used without a trailing dot | 21:04 |
*** eankutse has quit IRC | 21:04 | |
richm | so - bug in fedora bind/rndc? "feature" of ubuntu bind/rndc? | 21:05 |
richm | can one of you guys who use ubuntu confirm that the xxx.nzf file contains the domain with the trailing dot, or not? | 21:16 |
*** sbfox has quit IRC | 21:18 | |
*** RandeepJalli has joined #openstack-dns | 21:21 | |
RandeepJalli | Does anyone by chance have a link to the videos for the third talk by Kiall from the atlanta summit? about the DNS loadbalancer ? | 21:22 |
RandeepJalli | or the powerpoint? | 21:22 |
Kiall | RandeepJalli: I don't think I gave a full talk in Atlanta? ;) | 21:23 |
RandeepJalli | oh ok | 21:23 |
RandeepJalli | it was on the wiki | 21:23 |
RandeepJalli | so I just thought maybe there was a video or something floating around | 21:23 |
Kiall | Oh - That was a discussion about potential talks | 21:23 |
RandeepJalli | AHHHHHH | 21:23 |
RandeepJalli | ok that makes sense | 21:23 |
RandeepJalli | lol | 21:23 |
RandeepJalli | so to be clear that's code that isn't currently a part of designate ? (the loadbalancer) | 21:24 |
RandeepJalli | or is it? and if so do you have a pointer or perhaps a link? | 21:24 |
Kiall | no, it's not :) | 21:25 |
RandeepJalli | understood! | 21:25 |
RandeepJalli | I'm just getting started! thanks for your help! I'd love to contribute and/or help you guys make that! it sounds like a fun project! | 21:25 |
*** msisk has quit IRC | 21:29 | |
rjrjr | richm: the *.nzf files are using the trailing dot. | 21:36 |
rjrjr | kiall: the Designate Jenkins job is not running for https://review.openstack.org/#/c/96204/ | 21:36 |
Kiall | I disabled it in favor of gate-designate-devstack-dsvm - prematurely it seems. | 21:37 |
rjrjr | okay. so the fix can be +2'd then. 8^) | 21:38 |
Kiall | Can I look at it in the morning? Doing final prep for a deploy tomorrow :( | 21:40 |
rjrjr | sure. betsy said she would +2 it. just not sure if she knows Designate Jenkins is disabled. | 21:40 |
*** nkinder has joined #openstack-dns | 21:42 | |
*** sbfox has joined #openstack-dns | 21:45 | |
richm | I have an ubuntu system - bind9 9.9.5.dfsg - I did an addzone junk.local. | 21:46 |
richm | the .nzf file _does not_ have the trailing dot | 21:47 |
richm | rndc delzone junk.local. does not work | 21:47 |
*** yidclare has joined #openstack-dns | 21:47 | |
richm | could this be a "bug" in bind 9.9? rjrjr - you said you were using bind 9.8? | 21:48 |
rjrjr | richm: when Designate performs the 'addzone' it uses a trailing dot. | 21:52 |
richm | right | 21:52 |
rjrjr | did you use Designate for the addzone or did you do it manually? i suspect it will work either way, as long as you are consistent. | 21:52 |
richm | manually - so on Fedora 20, and ubuntu latest (bind 9.9.5), addzone (or bind) will silently strip the trailing dot when it puts it in the .nzf file | 21:53 |
richm | then delzone domain.tld. will fail | 21:53 |
richm | this is all manually, no designate | 21:54 |
richm | are all of you guys using bind9 9.8? | 21:54 |
rjrjr | that's interesting. it also seems to enforce a 'rndc freeze' on only dynamic zones. | 21:54 |
rjrjr | another issue i wasn't able to reproduce. | 21:54 |
rjrjr | i'll have to build a server with the latest BIND and test in the future. | 21:56 |
richm | I opened a bug against Fedora - https://bugzilla.redhat.com/show_bug.cgi?id=1105329 | 21:59 |
richm | rjrjr: you are using bind9 9.8, right? | 22:00 |
rjrjr | yes, BIND 9.8.1-P1 on ubuntu 12.04 | 22:01 |
rjrjr | richm: if you manually add a zone to your configuration using a trailing dot, does bind complain? | 22:05 |
rjrjr | (i.e. don't use 'rndc addzone' but add the zone to the configuration file(s).) | 22:05 |
richm | not sure - but I will note that all of the default zones (e.g. zones.rfc1918) _do not_ have a trailing dot | 22:09 |
richm | zone "10.in-addr.arpa" { type master; file "/etc/bind/db.empty"; } | 22:09 |
richm | etc. | 22:09 |
richm | the only zone with a trailing dot is zone "." in named.conf.default-zones | 22:11 |
*** jorgem has quit IRC | 22:12 | |
rjrjr | same here. | 22:12 |
* richm is getting the feeling that bind (not zone file) configuration does not want the trailing dot | 22:16 | |
rjrjr | a fix for this would be to have the bind9 driver strip the trailing dot for the rndc commands. i've verified this will work on the version of BIND I'm using. it seems to work with or without trailing dots, as long as you are consistent. | 22:16 |
rjrjr | but, that is a different bug than the one i was fixing. 8^) | 22:17 |
rjrjr | richm: want me to open a Designate bug for this? | 22:19 |
richm | sure | 22:20 |
richm | thanks | 22:20 |
rjrjr | i can fix it once my other fix is accepted. 8^) | 22:21 |
richm | ok | 22:21 |
richm | heh - take a look at impl_powerdns/__init__.py create_domain(): | 22:22 |
richm | domain_m.update({ | 22:22 |
richm | 'designate_id': domain['id'], | 22:22 |
richm | 'name': domain['name'].rstrip('.'), | 22:22 |
richm | looks like powerdns also does not like the trailing dot | 22:23 |
rjrjr | https://bugs.launchpad.net/designate/+bug/1326984 | 22:25 |
*** jaycaz has quit IRC | 23:03 | |
*** msisk has joined #openstack-dns | 23:05 | |
*** sbfox has quit IRC | 23:23 | |
*** spiffxp has quit IRC | 23:28 | |
*** yidclare has quit IRC | 23:38 | |
*** betsy has joined #openstack-dns | 23:47 | |
*** vinod1 has joined #openstack-dns | 23:52 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!