Wednesday, 2018-03-28

*** openstack has joined #openstack-dns00:14
*** ChanServ sets mode: +o openstack00:14
*** puck has quit IRC00:24
*** odyssey4me has quit IRC00:53
*** odyssey4me has joined #openstack-dns00:53
*** itlinux has joined #openstack-dns01:07
*** itlinux has quit IRC01:15
*** _ix has quit IRC01:56
*** AlexeyAbashkin has joined #openstack-dns02:12
*** AlexeyAbashkin has quit IRC02:16
*** caowei has joined #openstack-dns02:26
openstackgerritMerged openstack/designate master: Follow the new PTI for document build  https://review.openstack.org/55671102:53
*** diman has joined #openstack-dns03:09
*** diman has quit IRC03:13
*** itlinux has joined #openstack-dns03:18
*** caowei has quit IRC03:24
openstackgerritOpenStack Proposal Bot proposed openstack/designate master: Updated from global requirements  https://review.openstack.org/55713403:25
*** kbyrne has quit IRC03:51
*** caowei has joined #openstack-dns03:55
*** kbyrne has joined #openstack-dns03:56
*** renmak_ has joined #openstack-dns04:02
*** renmak__ has joined #openstack-dns04:02
*** renmak__ has quit IRC05:15
*** renmak_ has quit IRC05:15
*** renmak__ has joined #openstack-dns05:19
*** renmak_ has joined #openstack-dns05:19
*** browny has quit IRC05:26
*** renmak__ has quit IRC05:48
*** renmak_ has quit IRC05:48
*** nyloc has quit IRC05:53
openstackgerritMerged openstack/designate master: Updated from global requirements  https://review.openstack.org/55713405:54
*** browny has joined #openstack-dns06:09
*** marst has quit IRC06:14
*** pcaruana has joined #openstack-dns06:38
*** marst has joined #openstack-dns06:47
*** diman has joined #openstack-dns06:54
*** diman has quit IRC06:59
*** ianychoi has quit IRC07:10
*** nyloc has joined #openstack-dns07:30
*** AlexeyAbashkin has joined #openstack-dns08:00
*** ktibi has joined #openstack-dns08:05
*** nyloc has quit IRC08:49
*** itlinux has quit IRC09:36
*** _ix has joined #openstack-dns09:37
*** caowei has quit IRC10:09
*** ianychoi has joined #openstack-dns10:15
*** abalutoiu_ has quit IRC11:03
*** abalutoiu has joined #openstack-dns11:06
*** ktibi has quit IRC11:54
*** abalutoiu_ has joined #openstack-dns12:11
*** abalutoiu has quit IRC12:15
*** odyssey4me has quit IRC12:22
*** odyssey4me has joined #openstack-dns12:22
*** _ix has quit IRC12:32
*** abalutoiu__ has joined #openstack-dns12:34
*** _ix has joined #openstack-dns12:38
*** abalutoiu_ has quit IRC12:39
*** _ix has quit IRC12:47
*** diman has joined #openstack-dns12:49
*** diman has quit IRC13:05
*** _ix has joined #openstack-dns13:09
*** _ix has quit IRC13:14
*** diman has joined #openstack-dns13:14
*** diman has quit IRC13:17
*** diman has joined #openstack-dns13:17
*** diman has quit IRC13:21
*** diman has joined #openstack-dns13:23
*** diman has quit IRC13:27
*** diman has joined #openstack-dns13:39
*** diman has quit IRC13:39
*** diman has joined #openstack-dns13:40
*** diman has quit IRC13:44
*** _ix has joined #openstack-dns13:53
*** simon-AS559 has joined #openstack-dns13:59
fricklermugsie: do we have meeting time now? /me is confused and jet-lagged by dst14:00
mugsieI think so14:01
fricklermugsie: seems your rebase on https://review.openstack.org/295253 introduced an extra empty line that is making the gerrit job sad14:24
mugsiefrickler: damn14:25
mugsiethat job doesn't run on a mac at all unfortunately - and I am working remotely today -_-14:26
*** ianychoi_ has joined #openstack-dns14:33
*** ianychoi has quit IRC14:36
*** pcaruana has quit IRC15:09
*** marst has quit IRC15:10
*** marst has joined #openstack-dns15:16
*** diman has joined #openstack-dns15:38
*** diman has quit IRC15:43
*** itlinux has joined #openstack-dns15:54
*** marst has quit IRC16:02
*** diman has joined #openstack-dns16:19
*** simon-AS559 has quit IRC16:21
*** rfreire has joined #openstack-dns16:21
rfreirehi hi #designate! o/ /me trying to work his way in Newton version and managed to make _almost_ everything to work16:22
rfreirealmost :-)16:22
rfreire= CURRENT ISSUE =16:22
rfreireAfter creating a RR, in mdns.log I find zone serial mismatch. See a sample:16:23
rfreire2018-03-28 16:22:49.780 30560 INFO designate.mdns.notify [req-eff4ad86-518d-4655-afbd-eb9adf468d2e - - - - -] Sending 'SOA' for 'example.com.' to '192.168.100.182:53'.16:23
rfreire2018-03-28 16:22:49.782 30560 DEBUG designate.mdns.notify [req-eff4ad86-518d-4655-afbd-eb9adf468d2e - - - - -] Got lower serial for 'example.com.' to '192.168.100.182:53'. Expected:'1522253049'. Got:'1522249811'.Retries left='6' get_serial_number /usr/lib/python2.7/site-packages/designate/mdns/notify.py:16316:23
rfreire2018-03-28 16:23:04.783 30560 INFO designate.mdns.notify [req-eff4ad86-518d-4655-afbd-eb9adf468d2e - - - - -] Sending 'SOA' for 'example.com.' to '192.168.100.182:53'.16:23
rfreire2018-03-28 16:23:04.784 30560 DEBUG designate.mdns.notify [req-eff4ad86-518d-4655-afbd-eb9adf468d2e - - - - -] Got lower serial for 'example.com.' to '192.168.100.182:53'. Expected:'1522253049'. Got:'1522249811'.Retries left='5' get_serial_number /usr/lib/python2.7/site-packages/designate/mdns/notify.py:16316:23
rfreire--16:23
rfreireAnyone seen that? :|16:23
mugsierfreire: is there any errors in the logs on the dns server?16:24
rfreireRight now, my zone is in error state:16:24
rfreiremugsie, o/16:24
*** diman has quit IRC16:24
mugsie(bind / pdns / etc)16:24
rfreiremugsie, _none_ at this moment16:24
rfreiremugsie, interestingly; somerhing happens from time to time in Designate and works everything out16:24
rfreirecheck it out:16:24
mugsieoh. is there any logs showing a zone transfer is actually happening?16:24
rfreire--16:24
rfreire2018-03-28 15:55:15.041 30560 DEBUG designate.service [-] Handling UDP Request from: 192.168.100.182:18202 _dns_handle_udp /usr/lib/python2.7/site-packages/designate/service.py:43316:24
rfreire2018-03-28 15:55:15.043 30560 DEBUG designate.plugin [-] Looking for driver sqlalchemy in designate.storage get_driver /usr/lib/python2.7/site-packages/designate/plugin.py:11516:25
rfreire2018-03-28 15:55:15.075 30560 DEBUG designate.plugin [-] Loaded plugin storage:sqlalchemy __init__ /usr/lib/python2.7/site-packages/designate/plugin.py:3916:25
rfreire2018-03-28 15:55:15.091 30560 DEBUG oslo_db.sqlalchemy.engines [-] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/16:25
rfreirelib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py:26116:25
rfreire2018-03-28 15:55:15.107 30560 DEBUG designate.storage.impl_sqlalchemy [req-ef1e9300-d3cd-4ea9-858b-1ced03ca647b - - - - -] Fetched zone <Zone id:'71cfd214-f53c-4ed8-878e-587e0778fdd6' type:'PRIMARY' name:'example.com.' pool_id:'794ccc2c-d751-44fe-b57f-8894c9f5c842' serial16:25
rfreire:'1522249811' action:'UPDATE' status:'ERROR'> _find_zones /usr/lib/python2.7/site-packages/designate/storage/impl_sqlalchemy/__init__.py:26116:25
rfreire2018-03-28 15:55:15.109 30560 DEBUG designate.service [-] Handling TCP Request from: 192.168.100.182:59767 _dns_handle_tcp /usr/lib/python2.7/site-packages/designate/service.py:32116:25
rfreire2018-03-28 15:55:15.117 30560 DEBUG designate.storage.impl_sqlalchemy [req-3edbabbc-4880-4c11-a550-2423752a2937 - - - - -] Fetched zone <Zone id:'71cfd214-f53c-4ed8-878e-587e0778fdd6' type:'PRIMARY' name:'example.com.' pool_id:'794ccc2c-d751-44fe-b57f-8894c9f5c842' serial16:25
rfreire:'1522249811' action:'UPDATE' status:'ERROR'> _find_zones /usr/lib/python2.7/site-packages/designate/storage/impl_sqlalchemy/__init__.py:26116:25
rfreire2018-03-28 15:55:15.129 30560 WARNING designate.service [req-3edbabbc-4880-4c11-a550-2423752a2937 - - - - -] Invalid packet from: 192.168.100.182:5976716:25
rfreire---16:25
rfreireAfter that task, everything gets in sync16:25
rfreireRRs created/deleted etc16:25
rfreireuntil the next manipulation16:25
rfreirewhich will cause the serial mismatch again16:25
rfreirethen enters this misterious task16:25
rfreireand squares out everything up again16:25
* rfreire grins16:25
mugsieso it looks like notifies are not getting sent to the dns server16:25
rfreireThe scenario is pretty simple right mugsie16:26
mugsieyesah16:26
rfreirethis is a local BIND server16:26
rfreirerunning in the same system as the Designate services.16:26
mugsieso - is there any errors in the the pool-manager logs?16:26
rfreirethis:16:26
rfreire--16:26
rfreire2018-03-28 16:26:19.759 30567 DEBUG designate.pool_manager.service [req-afc5e269-bcab-4c2e-88fa-41c33cadd50a - - - - -] Calling update_status for example.com. : UPDATE : ERROR : 1522249811 update_status /usr/lib/python2.7/site-packages/designate/pool_manager/service.py:64416:26
rfreire2018-03-28 16:26:19.761 30567 DEBUG designate.pool_manager.service [req-afc5e269-bcab-4c2e-88fa-41c33cadd50a - - - - -] Cache hit! Retrieved status ERROR and serial 1522249811 for zone example.com. on nameserver 192.168.100.182:53 with action UPDATE from the cache. _retrieve_statuses /usr/lib/python2.7/site-packages/designate/pool_manager/service.py:94716:26
rfreire2018-03-28 16:26:19.764 30567 DEBUG designate.pool_manager.service [req-afc5e269-bcab-4c2e-88fa-41c33cadd50a - - - - -] Cache hit! Retrieved status ERROR and serial 1522249811 for zone example.com. on nameserver 192.168.100.182:53 with action UPDATE from the cache. _retrieve_statuses /usr/lib/python2.7/site-packages/designate/pool_manager/service.py:94716:26
rfreire2018-03-28 16:26:19.765 30567 DEBUG designate.pool_manager.service [req-afc5e269-bcab-4c2e-88fa-41c33cadd50a - - - - -] Cache hit! Retrieved status ERROR and serial 1522249811 for zone example.com. on nameserver 192.168.100.182:53 with action UPDATE from the cache. _retrieve_statuses /usr/lib/python2.7/site-packages/designate/pool_manager/service.py:94716:26
rfreire--16:27
rfreireonly this16:27
rfreireand in debug mode only16:27
rfreireseem that it is just confirming that will keep the zone in ERROR state because of the zone mismatch16:27
rfreire[root@agoravai10-cont1 designate(keystone_admin)]# grep ERR pool-manager.log  | grep -v DEB16:28
rfreire[root@agoravai10-cont1 designate(keystone_admin)]#16:28
rfreireno error messages besides the debug messages16:28
* rfreire hangs himself16:28
*** marst has joined #openstack-dns16:30
mugsieso, can I have a look at the pools.yaml ?16:33
rfreireor course!16:33
mugsieredact passwords etc obvoisly :P16:33
rfreiremugsie, https://pastebin.com/Hcs7TCaq16:35
* rfreire thinks it is it? :-}16:35
* rfreire ran # designate-manage pool show_config16:36
mugsieaha16:36
mugsieadd :16:36
mugsiehost: 127.0.0.116:36
mugsieport: 5316:36
mugsieto the "options" section16:36
rfreireum wat mugsie ?16:38
rfreireso in options16:38
rfreireI add the host and port?16:38
rfreirebesides the rndc stuffs?16:38
mugsieyeah16:38
mugsiehttps://docs.openstack.org/designate/latest/admin/backends/bind9.html16:38
* rfreire gives a try!!!16:39
rfreiremugsie, so in order to import it: designate-manage pool update --file /dev/shm/output.yml --delete True16:41
rfreirerighto?16:41
mugsieyou can leave the --delete True16:41
mugsieso, remove the --delete True16:41
rfreireokay!16:41
rfreireRestarting services16:41
* rfreire zeroes the logs too16:41
mugsielook for stuff about zone transfers in the bind logs as well16:43
rfreirehnrm right.16:45
* rfreire kills himself16:47
rfreireMar 28 16:46:13 agoravai10-cont1 named[26635]: client 127.0.0.1#43730: received notify for zone 'example.com'16:47
rfreireMar 28 16:46:13 agoravai10-cont1 named[26635]: zone example.com/IN: refused notify from non-master: 127.0.0.1#4373016:47
* rfreire fixes addresses16:47
rfreire>_<16:47
mugsierfreire: :) happens to the best of us16:49
rfreiremugsie, if you are interested16:50
rfreiremugsie, I have written a script to configure RDO (newton) step by step16:50
*** diman has joined #openstack-dns16:50
mugsieyeah - that would be great16:51
mugsiecsn compare it to the install docs to see what wegot wrong :)16:51
rfreiremugsie, https://pastebin.com/M0iLxF8S16:51
rfreireFEW changes pending16:51
rfreire(and I have a meeting in few seconds)16:51
rfreiremugsie, PERRRRRRFECT16:53
rfreirethat did the trick!!!!16:53
* rfreire does his happy dance16:53
rfreire\o/16:53
mugsie:D16:53
rfreirewill create another instance from zero from the new script16:53
rfreireand will share here16:53
rfreire(meeting permitting)16:53
rfreireTHANK YOU VERY MUCHO16:53
rfreiremugsie++16:53
rfreirebnemec, ^ there it is Ben!16:53
rfreiremugsie, just a side note16:54
rfreirethe host: should be the real ip address16:54
rfreiresince I have not allowed localhost16:54
rfreireso it ended as:16:54
rfreire      host: 192.168.100.18216:54
rfreire      port: 5316:54
rfreire--16:54
*** diman has quit IRC16:55
*** nyloc has joined #openstack-dns17:07
*** AlexeyAbashkin has quit IRC17:08
rfreiremugsie, golden: https://pastebin.com/KCcnPH3r17:21
rfreirebnemec, ^17:21
rfreireWorks for OpenStack Newton.17:22
*** jmccrory has quit IRC17:59
*** itlinux has quit IRC18:00
*** jmccrory has joined #openstack-dns18:06
*** itlinux has joined #openstack-dns18:15
*** AlexeyAbashkin has joined #openstack-dns18:54
*** AlexeyAbashkin has quit IRC18:59
*** diman has joined #openstack-dns19:58
*** diman has quit IRC20:03
rfreiremugsie, hey Graham! o/20:44
rfreireStill around?20:44
*** puck has joined #openstack-dns20:44
rfreirewell #openstack-dns here's the thingy :-) Now I'm trying to make Nova chat with Designate. It seems that Designate picks up the notification in the bus. But fails with Could not find zone.20:47
rfreireHere's the thing.20:47
*** diman has joined #openstack-dns20:47
rfreire[root@aa10-cont1 designate(keystone_admin)]# openstack zone list20:47
rfreire+--------------------------------------+------------------+---------+------------+--------+--------+20:47
rfreire| id                                   | name             | type    |     serial | status | action |20:47
rfreire+--------------------------------------+------------------+---------+------------+--------+--------+20:47
rfreire| 8d662524-97ca-4b95-a074-73f49f1fb6a5 | example.com.     | PRIMARY | 1522267053 | ACTIVE | NONE   |20:47
rfreire| 199ba8c9-6350-4cee-9e4c-edb64b5bcb1b | interna.rf01.co. | PRIMARY | 1522267699 | ACTIVE | NONE   |20:47
rfreire+--------------------------------------+------------------+---------+------------+--------+--------+20:47
rfreire--20:47
rfreireI'm using the 2nd zone over there (interna.rf01.co), which is 199ba8c9-6350-4cee-9e4c-edb64b5bcb1b20:47
rfreire--20:47
rfreireWhich is dilligently declared in designate.conf:20:47
rfreire[handler:nova_fixed]20:48
rfreiredomain_id = 199ba8c9-6350-4cee-9e4c-edb64b5bcb1b20:48
rfreire--20:48
rfreireAs well for the float20:48
rfreire[handler:neutron_floatingip]20:48
rfreiredomain_id = 199ba8c9-6350-4cee-9e4c-edb64b5bcb1b20:48
rfreire--20:48
rfreireWhat am I overlooking this time? ¯\_(ツ)_/¯20:48
rfreiredesignate.conf in its full glory:20:49
rfreirehttps://pastebin.com/aq68PdEQ20:49
rfreire--20:51
rfreireFor what is worth, same problems happens when assigning float in Neutron20:51
rfreireBoth shows up in sink.log20:51
rfreirebut then, thre's this could not find zone20:51
*** diman has quit IRC20:52
*** itlinux has quit IRC21:14
*** rfreire is now known as rfreire|afk21:21
*** puck has quit IRC21:25
-openstackstatus- NOTICE: the zuul web dashboard will experience a short downtime as we roll out some changes - no job execution should be affected21:51
*** rfreire|afk is now known as rfreire21:55
*** diman has joined #openstack-dns22:52
*** puck has joined #openstack-dns22:57
*** diman has quit IRC22:57
rfreireBump ^ ? :-)22:58
*** puck has quit IRC23:25
-openstackstatus- NOTICE: Zuul has been restarted to update to the latest code; existing changes have been re-enqueued, you may need to recheck changes uploaded in the past 10 minutes23:57
*** puck has joined #openstack-dns23:59
*** diman has joined #openstack-dns23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!