Monday, 2018-05-14

*** masber has joined #openstack-dns00:03
*** masber has quit IRC00:03
*** masber has joined #openstack-dns00:03
*** masber has quit IRC00:04
*** masber has joined #openstack-dns00:04
*** masber has quit IRC00:04
*** masber has joined #openstack-dns00:06
*** masber has quit IRC00:06
*** masber has joined #openstack-dns00:08
*** trungnv has joined #openstack-dns01:33
*** caowei has joined #openstack-dns02:23
*** pcaruana has joined #openstack-dns06:31
*** Tbone has joined #openstack-dns06:59
TboneMorning all, I just started with a kolla deployment of designate and everything seemed to have gone well. I noticed however that the mdns service was listening on the public interface which is fine but the bind9 service was listening on the private network interface. bind9 should definitely listen on the public interface as well..07:02
Tbonejust wanted to make sure if anyone else deployed designate via kolla and experienced the same ?07:02
*** trungnv has quit IRC07:35
*** trungnv has joined #openstack-dns07:35
*** AlexeyAbashkin has joined #openstack-dns07:46
*** ivve has quit IRC08:11
*** salmankhan has joined #openstack-dns08:12
*** MarkBaker has joined #openstack-dns08:23
*** sapcc-bot4 has joined #openstack-dns09:00
openstackgerritNguyen Van Trung proposed openstack/designate master: Allow to check pep8 along with D000  https://review.openstack.org/56745809:03
*** sapcc-bot3 has quit IRC09:04
openstackgerritNguyen Van Trung proposed openstack/designate master: Change copyright information for field.py  https://review.openstack.org/56523709:06
*** masber has quit IRC09:06
*** salmankhan has quit IRC09:25
*** salmankhan has joined #openstack-dns09:31
openstackgerritNguyen Van Trung proposed openstack/designate master: Allow to check pep8 along with D000  https://review.openstack.org/56745809:40
*** abalutoiu has joined #openstack-dns09:47
*** Tbone has quit IRC11:14
*** livelace has joined #openstack-dns11:50
*** Tbone has joined #openstack-dns11:54
*** abalutoiu has quit IRC12:10
*** abalutoiu has joined #openstack-dns12:23
*** MarkBaker has quit IRC12:24
*** abalutoiu_ has joined #openstack-dns12:36
*** MarkBaker has joined #openstack-dns12:40
*** abalutoiu has quit IRC12:40
*** MarkBaker has quit IRC13:25
*** MarkBaker has joined #openstack-dns13:37
*** Tbone has quit IRC13:48
*** beekneemech is now known as bnemec13:59
*** MarkBaker has quit IRC14:21
*** pcaruana has quit IRC15:02
eanderssonTbone there is a variable called dns_interface for designate-mdns to control which interface private vs. public designate should be using16:08
eanderssonAs for bind take a look at this https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/designate/templates/named.conf.j216:09
eandersson> #api_interface: "{{ network_interface }}"16:10
eanderssonIt looks like you need to modify that variable to have bind listen to a public interface16:10
*** pcaruana has joined #openstack-dns16:20
*** salmankhan has quit IRC16:31
*** rfreire has joined #openstack-dns16:38
*** AlexeyAbashkin has quit IRC16:57
*** rfreire_ has joined #openstack-dns17:02
*** rfreire is now known as Guest2598917:02
*** rfreire_ is now known as rfreire17:02
*** mugsie has quit IRC17:06
*** mugsie has joined #openstack-dns17:06
*** mugsie has quit IRC17:08
*** mugsie has joined #openstack-dns17:12
*** mugsie has quit IRC17:12
*** mugsie has joined #openstack-dns17:12
*** sapd1 has joined #openstack-dns17:12
*** rfreire has quit IRC17:27
*** rfreire has joined #openstack-dns17:28
eanderssonmugsie, for the Bad Action error17:49
eanderssonDo you think it's something that would be safe to ignore? as in catching and logging, as opposed to the current exception?17:49
mugsieIt can be an issue, I think17:50
mugsie*think*17:50
mugsieI think it might have something to do with OVO17:50
mugsiebut that is just my gut speaking17:50
eanderssonI see - I can try to dig a big deeper17:50
eanderssonFor sure feels like a race condition17:51
mugsiebut - in theory, we should be able to recover this later anyway, so ignoring it may be fine17:51
eanderssonYea - the lab looks fine, but of course that is a tiny deployment, not sure how this would look in a prod env17:52
mugsieYeah. I am more worried right now about the service status bug that is open17:53
eanderssonAh yea been meaning to look into that one17:53
rfreire<eandersson> mugsie, for the Bad Action error <- I've seen some in Netflix17:54
eanderssonAh yea - the db thing is a thing17:55
eanderssonJust confirmed in my lab17:55
eanderssoncount(*) 43857617:55
mugsieeandersson: https://media.giphy.com/media/h3LIsfXuPqALK/giphy.gif17:58
mugsierektide: Netflix?17:58
mugsies/rektide/rfreire/17:58
rfreiremugsie, bad action, bad actors..17:58
rfreirejust a monday bad joke17:58
rfreire<grins>17:58
mugsienice17:58
rfreiremugsie, I deserved that giphy17:58
rfreirethat was awful bad17:59
*** ircuser-1 has joined #openstack-dns18:05
*** idlemind has joined #openstack-dns18:27
eanderssonmugsie, > [req-0f896b0f-a0d6-4edd-815a-15787ec31a07 None None] Could not find ServiceStatus: ServiceStatusNotFound: Could not find ServiceStatus18:28
mugsie-_-18:29
eanderssonhttp://paste.openstack.org/show/720943/18:29
eanderssonI'll throw in a quick PR18:31
*** salmankhan has joined #openstack-dns18:33
mugsieYeah, this is a rocky issue18:40
mugsiequeens release for my stuff is fine18:40
eanderssonThe above was from Queens18:40
eandersson> designate==6.0.118:41
mugsieuuuuu ....18:41
mugsiegraham@s003:/etc/designate$ dpkg -l designate18:41
mugsieDesired=Unknown/Install/Remove/Purge/Hold18:41
mugsie| Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend18:41
mugsie|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)18:41
mugsie||/ Name                                                Version                        Architecture                   Description18:41
mugsie+++-===================================================-==============================-==============================-===========================================================================================================18:41
mugsieii  designate                                           1:6.0.0-0ubuntu1~cloud0        all                            OpenStack DNS as a Service - metapackage18:41
mugsieoh, no way18:41
eanderssonIt's only affecting worker/producer18:42
eanderssonStill trying to figure out exactly why18:42
eanderssonSo this might be more than one issue18:47
eanderssonlet me whipe the status database18:48
eanderssonlol can't delete the entries due to deadlock18:49
rfreire\o/18:50
eanderssonso I think what is happening is that at some point a duplicate entry gets created for the worker/producer18:52
eanderssonwhen that happens the sql query will never succeed, as the value is no longer unique18:52
eanderssonservice_name + hostname should always be unique18:52
eanderssonso probably a schema issue18:53
eanderssonmugsie, you can probably reproduce this by creating a duplicate entry for one of the services18:54
mugsieyeah, that seems legit18:59
*** sapd1 has quit IRC19:10
*** rfreire has quit IRC19:25
*** rfreire has joined #openstack-dns19:26
*** rfreire has quit IRC19:34
*** rfreire has joined #openstack-dns19:35
*** rfreire has quit IRC19:47
*** salmankhan has quit IRC19:48
eanderssonmugsie, never touched the orm stuff before, you wanna do the patch?19:59
eanderssonWe just need to do something like this I guess https://github.com/openstack/designate/blob/master/designate/storage/impl_sqlalchemy/migrate_repo/versions/082_unique_ns_record.py19:59
eanderssonThis is unfortunately a two year old bug.20:01
eanderssonWe should handle this in code as well.20:02
eanderssonmaybe change find_service_status to find_service_statuses in central, and raise an exception if there are more than one20:03
*** pcaruana has quit IRC20:43
openstackgerritErik Olof Gunnar Andersson proposed openstack/designate master: [WIP] Add unqiue constraint to service_statuses  https://review.openstack.org/56837220:52
*** livelace has quit IRC20:54
*** kiall has quit IRC20:54
*** kiall has joined #openstack-dns20:55
*** kiall has joined #openstack-dns20:55
eanderssonmugsie, ^21:03
*** bnemec has quit IRC21:17
*** bnemec has joined #openstack-dns21:18
openstackgerritErik Olof Gunnar Andersson proposed openstack/designate master: [WIP] Add unqiue constraint to service_statuses  https://review.openstack.org/56837222:11

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!