Friday, 2013-12-20

*** vipul-away is now known as vipul00:04
*** betsy has quit IRC00:33
*** zane has quit IRC01:01
*** nosnos has joined #openstack-dns01:04
*** HenryG has quit IRC01:10
*** CaptTofu has joined #openstack-dns01:12
*** zane has joined #openstack-dns01:32
*** krow1 has joined #openstack-dns01:47
*** krow has quit IRC01:47
*** krow1 has quit IRC01:47
*** matsuhashi has joined #openstack-dns01:58
*** HenryG has joined #openstack-dns02:03
*** zane1 has joined #openstack-dns02:09
*** zane has quit IRC02:09
*** rossk has quit IRC02:11
*** CaptTofu has quit IRC02:41
*** CaptTofu has joined #openstack-dns02:42
*** krow has joined #openstack-dns03:24
*** krow has quit IRC03:50
*** jmcbride has joined #openstack-dns03:53
*** jmcbride has quit IRC04:02
*** krow has joined #openstack-dns04:32
*** eankutse has joined #openstack-dns04:38
*** eankutse has quit IRC04:38
*** eankutse has joined #openstack-dns04:39
*** krow has quit IRC04:50
*** krow has joined #openstack-dns04:57
*** eankutse1 has joined #openstack-dns05:18
*** eankutse has quit IRC05:21
*** eankutse1 has quit IRC05:23
*** zane1 has quit IRC05:45
*** krow has quit IRC05:51
*** krow has joined #openstack-dns06:22
*** zane has joined #openstack-dns06:29
*** krow has quit IRC06:39
*** nosnos has quit IRC06:41
*** nosnos has joined #openstack-dns06:42
*** nosnos_ has joined #openstack-dns07:03
*** krow has joined #openstack-dns07:04
*** nosnos has quit IRC07:05
*** zane has quit IRC07:34
*** krow has quit IRC08:34
*** matsuhashi has quit IRC09:12
*** matsuhashi has joined #openstack-dns09:12
*** matsuhashi has quit IRC09:16
*** matsuhashi has joined #openstack-dns09:17
*** nosnos_ has quit IRC09:19
*** matsuhashi has quit IRC09:41
*** krow has joined #openstack-dns10:32
kiallartom: re bug 1262851 / https://review.openstack.org/#/c/6321611:29
kiallI'm trying to see when that might be triggered... and am finding it hard :)11:30
*** krow has quit IRC11:31
kiallDOOH - Always realize my mistake right as I speak .. tests are happening with the fake backend, hence not triggering them.11:31
kiallOkay.. I 100% see what's happening now11:32
kialland your other review has exposed an issue with our InsertFromSelect implementation.. Fun -_-11:44
*** krow has joined #openstack-dns11:46
*** krow has quit IRC11:52
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Specify column names during the PowerDNS backends InsertFromSelect's  https://review.openstack.org/6340012:46
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Test database migration schema  https://review.openstack.org/6207912:46
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Specify column names during the PowerDNS backends InsertFromSelect's  https://review.openstack.org/6340012:49
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Test database migration schema  https://review.openstack.org/6207912:49
openstackgerritA change was merged to stackforge/designate: Do not try to update records if there are none  https://review.openstack.org/6321612:54
*** CaptTofu has quit IRC13:13
*** CaptTofu_ has joined #openstack-dns13:13
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Specify column names during the PowerDNS backends InsertFromSelect's  https://review.openstack.org/6340013:30
openstackgerritKiall Mac Innes proposed a change to stackforge/designate: Test database migration schema  https://review.openstack.org/6207913:30
*** jmcbride has joined #openstack-dns13:32
*** jmcbride has quit IRC14:01
kiallartom: Humm .. Having an issue seeing why your test using migrations patchset is failing on top of https://review.openstack.org/#/c/6340014:06
*** eankutse has joined #openstack-dns14:15
*** eankutse has quit IRC14:15
*** eankutse has joined #openstack-dns14:15
*** betsy has joined #openstack-dns14:32
artomOk, let's sort through this.14:38
artomSo https://review.openstack.org/#/c/63216/ (do not update NS records if there are none) is OK.14:39
artomhttps://review.openstack.org/#/c/63208/ (designate_recordset_id) should be abandoned, yes? It's been superseded by https://review.openstack.org/#/c/63400 (InsertFromSelect)14:40
*** CaptTofu_ has quit IRC14:40
artomMight as well ping kiall...14:41
artomDid your commits (PS4-6) to https://review.openstack.org/#/c/62079/ introduce any code changes?14:42
*** CaptTofu has joined #openstack-dns14:42
*** eankutse1 has joined #openstack-dns14:52
artomkiall, ah, I see what you mean.14:54
*** eankutse has quit IRC14:54
artomThe same IntegrityError that I see in Jenkin's logs is happening for me...14:54
artomExcept I only get it for py26...14:54
artomAnd before submitting my PS yesterday I didn't get it at all, so I chalked it up to feral packets or other voodoo...14:55
artomWhoa, rerunning tox makes the error appear in py27 but not py26...15:03
artomI suspect something is wrong about how the tempfiles are handled...15:03
*** jmcbride has joined #openstack-dns15:04
*** CaptTofu has quit IRC15:07
*** CaptTofu has joined #openstack-dns15:07
*** jmcbride has quit IRC15:08
*** Adri2000 has quit IRC15:13
*** jmcbride has joined #openstack-dns15:13
*** jmcbride has quit IRC15:16
*** pasquier-s has quit IRC15:16
*** jmcbride has joined #openstack-dns15:25
*** betsy has quit IRC15:26
artomAh, I think some tempfile names are colliding.15:26
artomIf I empty out /tmp the errors go away.15:26
artomDoesn't explain why it's happening on Jenkins though...15:26
artomMaybe other tests are using loads of tempfiles as well?15:27
*** CaptTofu has quit IRC15:28
*** jmcbride has quit IRC15:30
*** tsimmons has joined #openstack-dns15:31
tsimmonskiall: artom: I recently deployed the latest code to a couple of distributed environments and i'm getting PowerDNS backend failures of the type "Column count doesn't match value count at row 1" does this have anything to do with what you guys were discussing?15:50
*** jmcbride has joined #openstack-dns15:50
*** jmcbride has quit IRC15:54
artomtsimmons, it does.15:57
*** jmcbride has joined #openstack-dns15:57
artomtsimmons, I think once https://review.openstack.org/#/c/63400 is merged it should be fixed.15:57
tsimmonsartom: Alright, that's what I figured. Thanks!15:59
*** jmcbride has quit IRC16:00
*** Adri2000 has joined #openstack-dns16:14
*** zane has joined #openstack-dns16:29
*** zane1 has joined #openstack-dns16:30
*** zane has quit IRC16:34
kiallartom: heya17:07
kiallyea - I think the DB migration test patch is dodgy and failing .. sometimes.. :)17:08
openstackgerritA change was merged to stackforge/designate: Specify column names during the PowerDNS backends InsertFromSelect's  https://review.openstack.org/6340017:10
kiallartom: no code changes at all, I just put your PS on top of mine to have it's tests run17:12
kiall(the new one's you wrote..)17:12
artomkiall, gotcha.17:13
artomTrying to fix the DB migrations PS before leaving.17:13
*** zane1 has quit IRC17:14
* artom is confused about what gets called when in a Fixture...17:15
kiallYea - I don't know that library well enough either17:21
*** jorgem has joined #openstack-dns17:28
*** betsy has joined #openstack-dns17:29
artomThis was easier whenI had db_manager ;)17:31
*** jmcbride has joined #openstack-dns17:31
*** eankutse1 has quit IRC17:39
*** zane has joined #openstack-dns17:44
betsykiall: Hi. I discovered where the bug is in my create_blacklist. In storage/api.py, if I comment out the @contextlib.contextmanager, and the related code to that, it works fine. Maybe I'm missing something that needs to be added to use contextlib.contextmanager? Any ideas?18:00
kiallbetsy: heya, dealing with some internal stuff right now can't really look!18:03
betsynp. I don't think I really need to use @contextlib anyway, so I'm proceeding on that assumption. You can correct me later when you have the time. :D18:04
*** jmcbride has quit IRC18:04
*** jmcbride has joined #openstack-dns18:08
*** EmilienM has quit IRC18:19
*** EmilienM has joined #openstack-dns18:20
*** jmcbride has quit IRC18:23
*** jmcbride has joined #openstack-dns18:36
*** eankutse has joined #openstack-dns18:40
*** eankutse has quit IRC18:40
*** eankutse has joined #openstack-dns18:40
*** zane has quit IRC19:01
*** tsimmons has quit IRC19:05
*** zane1 has joined #openstack-dns19:15
*** zane1 has quit IRC19:16
*** zane1 has joined #openstack-dns19:16
*** zane1 has quit IRC19:52
artomWhelp, I'm not getting nothing done in this atmosphere.19:53
artomI think the db migration patch will wait :(19:53
artomDue to a whole bunch of circumstances, most of the office is working from home, and the people that are here are anticipating the Christmas party tonight.19:54
*** zane has joined #openstack-dns20:00
*** tsimmons has joined #openstack-dns20:09
*** jmcbride has quit IRC20:14
*** rjrjr has joined #openstack-dns20:16
*** jmcbride has joined #openstack-dns20:30
*** artom has quit IRC20:32
tsimmonskiall: I'm sure you'll see this at some point. Should "six>=1.4.1" be in the requirements.txt file? When I do a fresh install, I always run into a problem running "python setup.py develop" and have to upgrade six from 1.1.0 to 1.4.1. Just thought I'd bring it up.20:43
*** CaptTofu has joined #openstack-dns20:50
*** eankutse has quit IRC20:59
*** eankutse has joined #openstack-dns20:59
kialltsimmons: ehh, I don't think we use six anywhere, it's likely a dependency of a dependency21:26
kialland - as you can see - often causes more pain than it's worth!21:26
tsimmonsAh, ok. It was messing up some automation I was doing, having to install it every time, that's how I noticed it. Just thought I'd mention it :)21:28
kiallThat said.. I re-install the virtualenv ever few days, as does every Jenkins test run21:28
kiallWe don't normally see that?21:28
tsimmonsHm. I'm probably doing something odd. I'll look at it. Thanks!21:29
kiall"Laptop battery critically low" <-- brb ;)21:29
kiallback..21:32
kiallSo, how are you installing it? into a virtualenv or "straight" onto the server etc?21:32
tsimmonsHah, this time I was doing it straight onto the server, that's probably where the problem lies. But seriously, you should go relax, it's Friday night!21:33
kiallHah - Easy night tonight, tomorrow night, now that's different ;)21:35
tsimmonsWell that works too :P21:35
kiallSo, straight onto a server can be awkward.. Dependency hell and all that!21:36
tsimmonsI was afraid of that, I've never done much with virtualenvs...21:36
kiallIf it's ubuntu, the ubuntu-cloud-archive for havana should have everything we need..21:37
tsimmonsdebian :/21:37
tsimmonsShould be pretty close though21:37
kiallinstalling all the deps from .deb's, then designate from source should work cleanly.. but once pip starts downloading dependencies to install globally, you're asking for something, somewhere to break21:38
kiallartom spent some time trying to get it going on debian, apparently "everything is too old"21:38
kiallThey ship the deps for openstack circa a 3-4 releases ago last I looked21:39
kiallubuntu has the "cloud-archive" where they put newer versions of everything needed for each openstack release..21:39
tsimmonsThat seems useful.21:39
kiallWe try and stick to the same versions so we can be compatible and easier to install alongside etc21:39
*** CaptTofu has quit IRC21:40
kiallYea, we use a good chunk of their packages in out deploy.. Every .deb we can avoid building ourselves is a win ;)21:40
kialls/out/our/21:41
tsimmonsI've obviously still got a lot to learn. So the designate packages use the cloud-archive packages for their dependencies, and you can install the requirements from the cloud-archive even if you aren't installing the designate packages?21:45
*** amitg-web has joined #openstack-dns21:59
*** amitg-web has joined #openstack-dns21:59
*** amitg-web has quit IRC22:00
kialltsimmons - sorry, AFK (Friday night and all ;)) But.. Yea, the designate .deb's we have here require the cloud-archive packages for dependencies ... https://launchpad.net/~designate-ppa/+archive/havana/22:23
kiallWell, they require the right dependencies, the cloud-archive "just happens" to fulfill then22:23
*** krow has joined #openstack-dns22:25
tsimmonsSo for a proper deployment you would use that apt repo to get the dependencies?22:25
kialltsimmons: For our production deploy, we have Jenkins jobs that build .deb's from a private "fork" of designate..  The fork exists just to give us control over what's in the open source repo vs production.e.g. we might need to backport a critical fix right after a major change has landed in the open source repo.. To allow for quick patches, we keep the fork..22:32
kiallAnwyay - We pull or cherry-pick commits in there, build .debs which go then through to the release process22:33
kiallSo, the same process is used for everything from rabbit to mysql to python updates22:33
tsimmonsMhm, makes sense.22:34
kiallHah - It sounds much more sensible than reality ;) But I've yet to see a totally sane release process!22:34
kiallAnyway - The end result is, we deploy via .deb's is production..22:35
tsimmonsYeah I'm sure there's plenty of things to go wrong.22:35
tsimmonsYeah that's what I imagined you would do22:35
kiallYep - Lots!22:35
kiallI've heard from .. somewhere .. that RAX tends to deploy their python stuff by building a virtualenv in jenkins (or w/e) and using that as the release artifact ..22:36
kialle.g. Trove deploys should be roughly equivalent to Designate deploys, just we don't have the guest/customer instances to worry about22:36
tsimmonsYeah I figured when we got a little further along i'd talk to them.22:37
*** krow has quit IRC22:37
tsimmonsI'm learning to use Chef right now, that's where my curiosity comes from :P22:37
kiallOhh ... Nooo!22:37
tsimmonshaha22:37
kiallSave your sanity ;)22:37
tsimmonshahaha22:37
tsimmonsShould I use something else?22:38
kiallI'd say use what the company has experience with..22:39
kiall(We use it, I hate it, Thinking about moving to something else)22:40
tsimmonsYeah, most of them use Chef. It seems alright so far.22:40
kiallChef is scripting disguised as config management the way I see it.. It looks great, until you start getting into some more complex situations..22:41
tsimmonsYeah I've already had to put some scripts in that I wrote.22:41
kiallGod forbid your designate.conf gets updated, a designate-api restart is queued, and then some other totally unrelated cookbook fails..22:41
kiallThe restart will never happen, the file will have already been changed, so the next run goes "all good"22:42
tsimmonsOh god that happens?22:42
kiallYea.. Chef doesn't handle failure gracefully at all.. It just dies.22:42
tsimmonsThat's kind of scary22:43
kiallThe Puppet model of CI makes so much more sense to me, even if it's harder to grasp at first..22:44
kiallthe distinction between "how the world should look" from "how to make it look like that" is really clean in Puppet and Salt (if used right..)22:44
tsimmonsI know someone who knows Puppet.22:45
kiallIt's impossible to put an if statement in a puppet manifest, everything *must* be declarative and the implementation details of how to inspect the current state and make the changes if necessary are abstracted away.22:45
tsimmonsHm. So if you were to recommend one for Designate...22:47
kiallAnyway - "Which CM tool?" is like asking "Which region?" - there's no one answer and everything thinks everyone else is an idiot :)22:47
*** eankutse1 has joined #openstack-dns22:47
kiallreligion*22:47
tsimmonsI suppose so. Maybe I should just go back to coding :P22:49
kiallI'd recommend whichever you have the most experience to draw on :) Even if that turns out to be a bunch of bash scripts! All the CM tools I've tried are hard to learn and impossible to debug.. experience is the only thing that matters ;)22:49
*** jmcbride has quit IRC22:49
kiall(That said - We're planning our escape to Salt ;))22:49
tsimmonsYeah that's one of the ones we discussed.22:50
*** eankutse has quit IRC22:51
kiallAnyway - Time for some TV, enjoy the weekend / Christmas if you're finished up today!22:51
tsimmonsFor sure man. Thanks for everything!22:52
eankutse1tsimmons: sounds like there's quite a bit to learn with Chef to do things right? :-)22:54
tsimmonsA lot. To do it 100% "right" probably isn't possible.22:54
eankutse1;-)22:54
*** eankutse1 has quit IRC22:55
*** amitg has joined #openstack-dns22:57
*** yahoo has joined #openstack-dns22:57
*** test-i has joined #openstack-dns22:59
test-ihi22:59
tsimmonsHello :)22:59
kialltsimmons / eankutse .. one last thing (or 3 or 4..)22:59
tsimmons:)23:00
kiallstart with something simpler - like an ntpd server cookbook .. i.e. packaged in debian already, well known etc..23:00
kiallif you us23:00
kialle chef .. lookup test-kitchen23:00
kialland - lookup berkself + watch this video for some really good advice on "the right way" to do chef.. http://www.getchef.com/blog/chefconf-talks/the-berkshelf-way-jamie-winsor/23:01
tsimmonsNice! I'll look at it.23:01
kiallOkay - Now I'm gone ;)23:02
tsimmonsThanks again :D23:03
*** jorgem has quit IRC23:22
*** CaptTofu has joined #openstack-dns23:23
*** krow has joined #openstack-dns23:44
*** krow has quit IRC23:53
*** CaptTofu has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!