Thursday, 2014-10-30

*** EricGonczer_ has joined #openstack-dns00:05
*** rmoe has quit IRC00:12
*** EricGonczer_ has quit IRC00:17
*** EricGonczer_ has joined #openstack-dns00:22
*** rmoe has joined #openstack-dns00:28
*** bitblt has quit IRC00:34
*** EricGonczer_ has quit IRC00:56
*** EricGonczer_ has joined #openstack-dns00:57
*** EricGonczer_ has quit IRC00:57
*** jmcbride has joined #openstack-dns00:58
*** HenryG has quit IRC01:04
*** HenryG_ has joined #openstack-dns01:04
*** harmw has quit IRC01:04
*** HenryG_ is now known as HenryG01:04
*** harmw has joined #openstack-dns01:06
*** russellb has quit IRC01:09
*** mgagne has quit IRC01:10
*** nosnos has joined #openstack-dns01:14
*** russellb has joined #openstack-dns01:15
*** EricGonczer_ has joined #openstack-dns01:16
*** mgagne has joined #openstack-dns01:21
*** mgagne is now known as Guest7651101:21
*** Guest76511 is now known as mgagne01:22
*** mgagne is now known as Guest5133901:23
*** openstackgerrit has joined #openstack-dns01:30
*** ChanServ sets mode: +v openstackgerrit01:30
*** vinod1 has joined #openstack-dns01:53
*** vinod1 has quit IRC01:53
*** jmcbride has quit IRC01:58
*** richm has quit IRC02:01
*** EricGonczer_ has quit IRC02:23
*** openstackgerrit has quit IRC03:10
*** rmoe has quit IRC03:12
*** rmoe has joined #openstack-dns03:13
*** nosnos has quit IRC03:27
*** nosnos has joined #openstack-dns04:27
*** nosnos has quit IRC05:20
*** nosnos has joined #openstack-dns05:23
*** nosnos has quit IRC06:14
*** nosnos has joined #openstack-dns06:18
*** k4n0 has joined #openstack-dns06:37
*** simon-AS559 has joined #openstack-dns07:15
rjrjr_Is https://review.openstack.org/#/c/125868/ ready to be merged?07:40
rjrjr_https://review.openstack.org/#/c/131312/ is ready for review.  (BIND9 pool driver)07:41
rjrjr_https://review.openstack.org/#/c/131901/ is also ready for review. (Central/Storage changes)07:42
rjrjr_i'm turning my attention to the pool_manager_proxy backend driver.  i'm going to grab some sleep and start in on that first thing in the morning.07:43
*** jordanP has joined #openstack-dns08:39
*** jordanP has quit IRC08:40
*** jordanP has joined #openstack-dns08:41
*** jordanP has quit IRC08:42
*** jordanP has joined #openstack-dns08:42
*** nosnos has quit IRC08:45
*** mudrykaa has quit IRC08:50
*** mudrykaa has joined #openstack-dns08:51
*** nosnos has joined #openstack-dns09:41
*** eandersson has joined #openstack-dns10:07
eanderssonMorning.11:28
eanderssonIs there a way of adding a managed_resource_id and managed_resource_type using the Designate Client?11:28
eanderssonI am running into issues as we have a sync script that is based on the client, but as they are not managed, they are not found by the sink.11:29
*** vinod has joined #openstack-dns11:36
*** jmcbride has joined #openstack-dns11:42
*** vinod has left #openstack-dns11:44
*** jmcbride has quit IRC11:48
*** mwagner_lap has quit IRC12:25
eanderssonWe upgraded from 2014.1 to 2014.2 and today I am seeing this error whenever I try to create more than 2 VM's.12:35
eanderssonOperationalError: (OperationalError) (1205, 'Lock wait timeout exceeded; try restarting transaction')12:35
eanderssonAnyone seen that error when creating records through the handlers?12:36
eanderssonThis seems to be related to threading. If I add a lock to process_notification this does not seem to happen.13:11
*** richm has joined #openstack-dns13:12
Kialleandersson: Humm, I had tested the notification pieces a week or two ago and didn't notice that.. What is your DB setup look like?13:17
eanderssonIt's a simple MySQL db with PowerDNS.13:18
eanderssonI didn't notice it until someone created a bunch of servers at the same time.13:19
KiallSingle DB server, no multi master or Percona Cluster or anything? (I've seen that particular error when using Percona Cluster incorrectly..)13:19
eanderssonI first noticed it in our cluster in production, but I can easily re-create it on my dev setup.13:19
eanderssonAlthough, I am using a custom notification plugin based on the Address class.13:19
Kiallrjrjr_: about? You've done more work with notification handlers than I recently, did you run into anything like this?13:20
eandersson*BaseAddressHandler13:20
Kialleandersson: by any chance is it reproducible with the same handlers?13:20
*** mwagner_lap has joined #openstack-dns13:21
KiallI'm guessing so, but before I start testing it'd be nice to know for sure :)13:21
eanderssonI can try it out later, but it is identical to that handler.13:21
eanderssonOne thing that really took me off guard btw with that implemention is the Managed bit13:21
eanderssonhttps://github.com/openstack/designate/blob/master/designate/notification_handler/base.py#L17513:21
eanderssonI thought it was smart to disable Managed, without realizing that if you do, there is nothing critera, which means that the all domain records will be deleted. :p13:22
eandersson*no critera13:22
KiallOH.13:22
KiallThat's a bug and a half :(13:22
eanderssonbtw will you be in Paris next week Kiall?13:23
KiallYes, I will..13:23
KiallQ - what's your use case for sink? I'm personally go back and forth on being in favor of deleting that whole piece of code and looking towards proper integrations with nova/neutron.. But knowing everyones uses cases for it helps? :)13:25
eanderssonThere are a couple of reasons. One of them being that we need to sync the database with a sync script.13:26
eanderssonAs far as I understand if the record is managed by the plugin, we cannot use the client to run a sync script.13:27
jordanPKiall, in my previous job, we used sink to automatically delete floating IP PTR record when a user releases a floating IP from his tenant13:27
Kialleandersson: Correct, managed == "user shouldn't be able to modify this record", but you bring up a decent use case, we could likely make that work for users with a certain role via the API easily enugh.13:27
eanderssonYea, that would be perfect.13:28
eanderssonWe also use the Sink for services outside of the scope of Designate, e.g. updating LDAP.13:28
eanderssonPrimarily as it offers everything we need and has been very stable.13:29
KiallInteresting, sink listens to events from Nova, creates DNS stuff, the calls out to LDAP?13:29
eanderssonYep13:29
eanderssonIt is more a legacy thing13:29
KiallThat's a use case I hadn't considered :)13:29
eanderssonI am working on a extremly simple... and stupid solution until I can figure out the Lock issue.13:29
eanderssonI am going to use the client for creating and deleting records. :P13:30
eanderssonbut fot eh criterion thing I already have a working concept to fix that. I add an else statement and only add managed_resource_id and type.13:30
eandersson*for the13:30
eanderssonThat way it wont delete all records if it is not managed, and can still find the record when trying to delete it.13:31
Kialleandersson: ah cool, I just filed a bug for it - bug 138766213:31
uvirtbotLaunchpad bug 1387662 in designate "Sample Sink Handlers can delete ALL records in a zone" [Critical,Triaged] https://launchpad.net/bugs/138766213:31
eanderssonperfec13:31
eanderssont13:31
eanderssonbtw if you have some time over at the confrence I would love to meet up in person and discuss some of the issues we have encountered13:32
KiallIf you have thoughts on the fix, drop them in there (or better yet, if you have a fix, you can submit it :))13:32
KiallYep - We have 3 sessions on the Tuesday from 11:15 -> 14:40 or so.. there will be a few of the usual faces around these parts there..13:33
eanderssonAwesome. I can't wait. Never been excited to got to a Confrence before. :p13:34
KiallLOL - First OpenStack conference?13:34
eanderssonYea :)13:34
KiallYea, There certainly a different kind of conference!13:35
eanderssonOh one more issue! :p13:35
eanderssonall_tenants13:35
*** jmcbride has joined #openstack-dns13:35
KiallKinda 3 conferences in 1 .. Standard Conference, Trade Show, and Talking-Only Hackathon ;)13:35
eanderssonIt was implemented in 2014.2 rc2 I think13:35
eanderssonIs it intended that as an admin, you can access all records?13:36
eanderssonhaha yea, I'll be there all five days.13:36
eanderssongoing to be interesting to say the least13:36
eandersson*can't13:36
eanderssonWhen using Central you have something like this13:37
eanderssoncontext = DesignateContext.get_admin_context(all_tenants=True)13:37
eanderssonWhich is awesome, but when using the Client I cannot figure out how to pass on all_tenants.13:37
KiallAh.. I don't think we have it in the client yet..13:37
KiallYou can pass it via the API as a ?all_tenants=True query string, and it should kick in from there...13:38
eanderssonHaha ok, good, it was another issue that was driving me nuts, as I was so sure I was missing something.13:38
Kiall(assuming you have the right permissions....)13:38
Kiallanyway.. Your lock issue.. Could you reproduce it and run SHOW ENGINE INNODB STATUS; against the MySQL server straight after? It will show the reason for the fail somewhere near the bottom13:40
KiallIt should list out the two TX's and their queries which held the locks13:40
eanderssonI'll try to get that done today. I just need to get a quick fix in place first.13:40
KiallCool - I'm on my laptop so don't have an easy way to test it out (Booting multiple VMs in a DevStack VM on this means the events come SO far apart its unlikely we'll hit any issues...)13:42
*** simon-AS5591 has joined #openstack-dns13:44
*** paul_glass has joined #openstack-dns13:44
*** simon-AS559 has quit IRC13:47
*** rediskin has joined #openstack-dns13:49
rediskinhi all13:49
ekarlsorediskin: hey Sergey :)13:51
*** EricGonczer_ has joined #openstack-dns13:52
rediskinekarlso: hi Endre13:52
eandersson@Kiall: Is there a good place to paste the MySQL logs?14:19
eanderssonI am guessing that it is related to this -> ------- TRX HAS BEEN WAITING 38 SEC FOR THIS LOCK TO BE GRANTED:14:19
eanderssonI can reproduce it using the DesignateClient when performing multiple at the same time.14:21
*** boris-42 has joined #openstack-dns14:23
boris-42ekarlso so what about enabling designate quotas by default?14:27
boris-42ekarlso btw hi14:27
ekarlsoboris-42: yeah, i've mentioned that to Kiall :)14:28
rediskinekarlso: quotas are implemented? I thought it not implemented yet14:29
boris-42rediskin what you saw was abstract class14:29
boris-42rediskin (some kind of pluggablity) as far as I understood14:29
ekarlsorediskin: they are, just not enabled by default I think :)14:30
*** EricGonczer_ has quit IRC14:30
rediskinoh, ok. I'll take a closer look on it14:30
boris-42ekarlso so what said Kiall?14:31
boris-42=)14:31
*** mwagner_lap has quit IRC14:31
*** nosnos has quit IRC14:32
rediskinbtw boris-42, ekarlso why we can't enable quotas exclusively for gates?14:32
*** k4n0 has quit IRC14:34
*** EricGonczer_ has joined #openstack-dns14:36
rediskinekarlso: i cant find option for enabling quota in devstack/localrc. is this option even exist?14:41
ekarlsorediskin: enabled_extensions or so14:41
ekarlsoI think u need local.conf though14:41
rediskinekarlso: nothing like that in devstack/lib/designate14:42
*** jmcbride has quit IRC14:48
*** jmcbride has joined #openstack-dns14:48
*** timsim has joined #openstack-dns14:51
timsimmugsie, ekarlso, vinod: Presentation practice at some point today?14:58
*** betsy has joined #openstack-dns15:01
mugsietimsim: yup.. let me find a few times that are on the calender15:04
mugsies/on/on my/15:05
*** vinod has joined #openstack-dns15:06
ekarlsotimsim: sure: )15:35
*** mwagner_lap has joined #openstack-dns15:37
*** bitblt has joined #openstack-dns15:54
*** rmoe has quit IRC16:01
*** eandersson has quit IRC16:02
*** jmcbride has quit IRC16:09
*** jmcbride has joined #openstack-dns16:12
*** rmoe has joined #openstack-dns16:13
*** Kiall has quit IRC16:49
*** jmcbride has quit IRC16:51
*** vinod has quit IRC16:56
*** EricGonczer_ has quit IRC17:10
*** EricGonczer_ has joined #openstack-dns17:10
*** BaconAndEggs1967 has joined #openstack-dns17:12
*** pino has joined #openstack-dns17:13
*** paul_glass has quit IRC17:14
*** pino has quit IRC17:14
*** pino has joined #openstack-dns17:15
*** mikedillion has joined #openstack-dns17:18
*** rjrjr_ has quit IRC17:23
mugsietimsim: does an hour or so suit you?17:24
*** rediskin has left #openstack-dns17:48
*** simon-AS5591 has quit IRC17:52
*** pino has quit IRC17:57
*** eandersson has joined #openstack-dns18:04
*** Kiall has joined #openstack-dns18:12
*** simon-AS559 has joined #openstack-dns18:14
*** simon-AS5591 has joined #openstack-dns18:16
*** simon-AS559 has quit IRC18:19
*** ryanpetrello has joined #openstack-dns18:33
*** jordanP has quit IRC18:38
*** paul_glass has joined #openstack-dns18:49
timsimmugsie: Any time after right now is good. Just got back from lunch :P18:51
*** ryanpetrello has quit IRC18:52
*** jmcbride has joined #openstack-dns18:54
*** eandersson has quit IRC18:54
mugsietimsim: cool18:55
mugsieJust sent an email - will try and grab ekarlso now as well18:55
timsimJust let me know when you're free and we'll head toward a room.18:56
timsimOr, when you're ready18:56
mugsieI am free now, just seeing if endre is :)18:57
*** timsim has quit IRC19:05
*** timsim has joined #openstack-dns19:06
ekarlsohere now ^19:06
mugsietimsim: want to head towards a room? :)19:07
timsimwalking now :P19:07
timsimAlright, ready when you are :)19:09
mugsietimsim: sent you an invite19:10
*** jmcbride has quit IRC19:14
*** jmcbride has joined #openstack-dns19:14
ekarlsoa q on pools, is 1 manager responsable for 1 pool or ?19:22
rjrjra pool can have multiple managers.19:25
rjrjrbut, a manager can only manage one pool.19:25
*** mikedillion has quit IRC19:26
ekarlsorjrjr: so 1 process pr then pr pool ?19:30
rjrjrpr?19:31
ekarlsoI mean, there's a 1:1 pool > pool mgr process thing going ?19:31
rjrjra pool will have many pool managers.  a pool manager will be responsible for only 1 pool.19:32
rjrjryou would run multiple pool managers per pool for redundancy reasons.19:33
rjrjrand performance.19:33
mugsieyup - no SPoF for us :)19:44
mugsie(i hope)19:44
rjrjrekarlso: the pool manager service code doesn't really address this yet.  now that the storage code is ready, i should be adding that in the next couple of days.  basically, the pool name in the config file determines which pool the pool manager is responsible for.  then it will only manage domains for that specific pool.19:56
rjrjri'm working on this integration pieces now in pool manager.19:57
rjrjrthis = these19:57
*** timsim has quit IRC20:06
ekarlsorjrjr: u going to summit ?20:13
ekarlsohttps://review.openstack.org/130852 < thought on that ?20:21
*** paul_glass has quit IRC20:22
*** jmcbride has quit IRC20:32
*** eandersson has joined #openstack-dns20:34
*** betsy has quit IRC21:00
*** jmcbride has joined #openstack-dns21:04
rjrjrekarlso: i am going to the summit.21:18
*** eandersson has quit IRC21:24
*** eandersson has joined #openstack-dns21:25
ekarlsocool)21:25
*** simon-AS5591 has quit IRC21:31
*** jmcbride has quit IRC22:02
*** BaconAndEggs1967 has left #openstack-dns22:28
*** pino has joined #openstack-dns22:48
*** bitblt has quit IRC22:59
*** EricGonczer_ has quit IRC23:28
*** pino has quit IRC23:29
*** pino has joined #openstack-dns23:38
*** boris-42 has quit IRC23:45
*** boris-42 has joined #openstack-dns23:51
*** eandersson has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!