Wednesday, 2014-07-02

openstackgerritMichael Yu proposed a change to openstack/trove: Adds Backup/Restore support for Couchbase  https://review.openstack.org/8673100:10
openstackgerritMichael Yu proposed a change to openstack/trove: Adds Backup/Restore support for Couchbase  https://review.openstack.org/8673100:13
openstackgerritMichael Yu proposed a change to openstack/trove: Adds Backup/Restore support for Couchbase  https://review.openstack.org/8673100:13
*** demorris has quit IRC00:13
*** achampion has joined #openstack-trove00:45
*** annashen_ has joined #openstack-trove00:52
*** yidclare has joined #openstack-trove00:55
*** yidclare has quit IRC01:07
*** annashen_ has quit IRC01:28
*** nosnos has joined #openstack-trove01:49
*** nosnos has quit IRC01:55
*** nosnos has joined #openstack-trove01:55
*** robertmyers has joined #openstack-trove01:56
*** boden has quit IRC02:03
*** annashen_ has joined #openstack-trove02:11
*** mattgriffin has joined #openstack-trove02:18
*** ajc_ has joined #openstack-trove02:50
*** nehav has joined #openstack-trove03:07
*** ramishra has joined #openstack-trove03:11
*** robertmyers has quit IRC03:17
*** nosnos has quit IRC03:27
openstackgerritNikhil Manchanda proposed a change to openstack/trove: Cleaned up sample trove-guestagent.conf  https://review.openstack.org/10406203:40
openstackgerritNikhil Manchanda proposed a change to openstack/trove: Cleaned up sample trove-guestagent.conf  https://review.openstack.org/10406203:43
*** mattgriffin has quit IRC03:49
*** nehav has quit IRC03:50
*** coolsvap|afk is now known as coolsvap03:53
*** ramishra has quit IRC04:37
*** nosnos has joined #openstack-trove04:42
*** ramishra has joined #openstack-trove04:49
*** SushillKM has joined #openstack-trove05:23
*** rwsu has quit IRC05:24
*** juantwo has quit IRC05:24
*** eghobo has joined #openstack-trove05:30
*** sgotliv has joined #openstack-trove05:35
*** nehav has joined #openstack-trove05:52
*** eguz has joined #openstack-trove05:53
*** eghobo has quit IRC05:57
*** nehav has quit IRC06:01
openstackgerritOpenStack Proposal Bot proposed a change to openstack/trove: Imported Translations from Transifex  https://review.openstack.org/10407406:05
openstackgerritNikhil Manchanda proposed a change to openstack/trove: Cleaned up sample trove-guestagent.conf  https://review.openstack.org/10406206:40
*** julienvey has joined #openstack-trove06:50
*** eguz has quit IRC06:55
*** karimb has joined #openstack-trove07:03
*** karimb has quit IRC07:05
*** karimb has joined #openstack-trove07:06
*** julienvey has quit IRC07:07
*** flaper87|afk is now known as flaper8707:19
*** annashen_ has quit IRC07:24
*** flaper87 is now known as flaper87|afk07:35
*** sgotliv has quit IRC07:46
openstackgerritCraig Vyvial proposed a change to openstack/trove: parse the mysql cnf file for password  https://review.openstack.org/10410708:10
openstackgerritCraig Vyvial proposed a change to openstack/trove: guestagent contract for packages should be a list  https://review.openstack.org/10410808:10
*** fifieldt_ has joined #openstack-trove08:16
*** flaper87|afk is now known as flaper8708:17
*** julienvey has joined #openstack-trove08:18
*** fifieldt has quit IRC08:18
*** ViswaV_ has joined #openstack-trove08:20
*** julienvey has quit IRC08:22
*** ViswaV has quit IRC08:24
*** ramishra has quit IRC08:30
*** ramishra has joined #openstack-trove08:30
*** fifieldt_ is now known as fifieldt08:31
*** boden has joined #openstack-trove08:37
*** sgotliv has joined #openstack-trove09:02
*** Longgeek has joined #openstack-trove09:03
*** Longgeek has quit IRC09:03
*** Longgeek has joined #openstack-trove09:04
*** sgotliv has quit IRC09:08
*** sgotliv has joined #openstack-trove09:09
*** ramishra has quit IRC09:27
*** ramishra has joined #openstack-trove09:35
*** Longgeek has quit IRC10:03
*** Longgeek has joined #openstack-trove10:03
*** Longgeek has quit IRC10:07
*** ramishra has quit IRC10:21
*** Longgeek has joined #openstack-trove10:21
*** ramishra_ has joined #openstack-trove10:25
*** sgotliv has quit IRC10:37
*** ramishra_ has quit IRC10:39
*** sgotliv has joined #openstack-trove11:05
*** Longgeek has quit IRC11:10
*** Longgeek has joined #openstack-trove11:10
*** sgotliv has quit IRC11:12
*** SushillKM has quit IRC11:17
*** coolsvap is now known as coolsvap|afk11:23
*** sgotliv has joined #openstack-trove11:26
*** sgotliv has quit IRC11:39
*** sgotliv has joined #openstack-trove11:39
*** ajc_ has quit IRC11:58
*** nosnos has quit IRC11:59
*** nosnos has joined #openstack-trove11:59
*** sgotliv has quit IRC12:01
*** SushillKM has joined #openstack-trove12:01
*** Longgeek_ has joined #openstack-trove12:02
*** juantwo has joined #openstack-trove12:03
*** nosnos has quit IRC12:04
*** Longgeek has quit IRC12:06
*** Longgeek_ has quit IRC12:07
*** Longgeek has joined #openstack-trove12:08
*** sgotliv has joined #openstack-trove12:14
*** pdmars has joined #openstack-trove12:27
*** achampion has quit IRC12:27
*** pdmars_ has joined #openstack-trove12:31
*** pdmars has quit IRC12:31
*** nehav has joined #openstack-trove12:37
openstackgerritOpenStack Proposal Bot proposed a change to openstack/trove: Updated from global requirements  https://review.openstack.org/10402312:39
*** SushillKM has quit IRC12:44
*** demorris has joined #openstack-trove12:54
*** radez_g0n3 is now known as radez12:55
openstackgerriticcha-sethi proposed a change to openstack/trove: Allow users the ability to update the instance name  https://review.openstack.org/9270113:13
*** sgotliv has quit IRC13:34
*** nehav has quit IRC13:37
*** ViswaV_ has quit IRC13:41
*** ViswaV has joined #openstack-trove13:43
*** sgotliv has joined #openstack-trove13:48
*** thedodd has joined #openstack-trove13:51
*** jcru has joined #openstack-trove13:52
*** jcru has quit IRC13:52
*** jcru has joined #openstack-trove13:53
*** miqui has quit IRC13:56
*** robertmyers has joined #openstack-trove13:57
*** juantwo has quit IRC14:01
*** mattgriffin has joined #openstack-trove14:07
*** achampion has joined #openstack-trove14:09
*** rwsu has joined #openstack-trove14:10
*** juantwo has joined #openstack-trove14:12
*** grapex has joined #openstack-trove14:13
*** grapex__ has joined #openstack-trove14:14
*** grapex has quit IRC14:17
*** glucas has left #openstack-trove14:19
*** jmontemayor has joined #openstack-trove14:22
*** jmontemayor_ has joined #openstack-trove14:23
*** demorris has quit IRC14:25
*** jmontemayor has quit IRC14:27
*** glucas has joined #openstack-trove14:28
*** juantwo has quit IRC14:29
*** jcru_ has joined #openstack-trove14:29
*** jcru has quit IRC14:30
*** demorris has joined #openstack-trove14:31
*** jcru has joined #openstack-trove14:39
*** amytron has joined #openstack-trove14:41
*** jcru_ has quit IRC14:41
*** juantwo has joined #openstack-trove14:43
*** juantwo has quit IRC14:44
*** juantwo has joined #openstack-trove14:44
*** jcru has quit IRC14:47
*** Gordon has joined #openstack-trove14:48
*** Gordon is now known as Guest8600514:48
*** Guest86005 has quit IRC14:48
*** coolsvap|afk is now known as coolsvap14:53
*** annashen_ has joined #openstack-trove14:58
*** demorris has quit IRC14:59
*** miqui has joined #openstack-trove14:59
*** robertmy_ has joined #openstack-trove14:59
*** robertmyers has quit IRC15:02
*** robertmy_ has quit IRC15:03
*** robertmyers has joined #openstack-trove15:03
*** nehav has joined #openstack-trove15:07
*** demorris has joined #openstack-trove15:08
*** mattgriffin has quit IRC15:11
*** jcru has joined #openstack-trove15:16
*** jcru has quit IRC15:16
*** jcru has joined #openstack-trove15:17
openstackgerritRueben Ramirez proposed a change to openstack/trove: Extends datastore capability overrides and adds management cmds  https://review.openstack.org/10401115:29
*** demorris has quit IRC15:42
*** juantwo has quit IRC15:51
openstackgerritamrith proposed a change to openstack/trove: Logging audit for trove/db module  https://review.openstack.org/10395315:51
*** nehav has quit IRC15:52
*** pdmars_ has quit IRC15:54
*** jmontemayor_ has quit IRC15:54
*** demorris has joined #openstack-trove15:59
*** jmontemayor has joined #openstack-trove16:01
*** nehav has joined #openstack-trove16:01
*** demorris_ has joined #openstack-trove16:02
*** jmontemayor_ has joined #openstack-trove16:03
*** jmontemayor has quit IRC16:03
*** eghobo has joined #openstack-trove16:03
*** demorris has quit IRC16:04
*** demorris_ is now known as demorris16:04
*** iccha1 has quit IRC16:05
*** nehav has quit IRC16:06
*** nehav1 has joined #openstack-trove16:06
*** eghobo has quit IRC16:08
*** eghobo has joined #openstack-trove16:08
*** juantwo has joined #openstack-trove16:10
*** Gordon has joined #openstack-trove16:11
*** Gordon is now known as Guest8047516:12
*** coolsvap is now known as coolsvap|afk16:12
*** annashen_ has quit IRC16:12
*** Guest80475 has quit IRC16:12
*** mattgriffin has joined #openstack-trove16:18
*** ViswaV_ has joined #openstack-trove16:26
*** yidclare has joined #openstack-trove16:28
*** ViswaV has quit IRC16:29
*** flaper87 is now known as flaper87|afk16:34
*** ViswaV has joined #openstack-trove16:35
*** ViswaV__ has joined #openstack-trove16:35
*** ViswaV_ has quit IRC16:38
*** dkehn__ has joined #openstack-trove16:39
*** ViswaV has quit IRC16:39
*** karimb has quit IRC16:41
*** dkehnx has quit IRC16:41
*** Isotopp has quit IRC16:43
*** thedodd has quit IRC16:44
*** sgotliv has quit IRC16:50
*** Isotopp has joined #openstack-trove16:55
*** demorris has quit IRC16:55
*** dkehn__ is now known as dkehnx16:57
*** iccha has joined #openstack-trove16:59
*** nehav1 has quit IRC16:59
*** juantwo has quit IRC16:59
*** Longgeek has quit IRC17:02
*** jmontemayor_ has quit IRC17:03
*** nehav has joined #openstack-trove17:04
*** demorris has joined #openstack-trove17:05
*** yidclare has quit IRC17:07
*** yidclare has joined #openstack-trove17:08
*** annashen_ has joined #openstack-trove17:09
*** juantwo has joined #openstack-trove17:11
*** juantwo has quit IRC17:13
*** juantwo has joined #openstack-trove17:13
*** eghobo has quit IRC17:14
*** SnowDust has joined #openstack-trove17:20
*** dkehn__ has joined #openstack-trove17:21
*** amcrn has joined #openstack-trove17:23
*** dkehn__ has quit IRC17:23
*** dkehn__ has joined #openstack-trove17:24
*** dkehnx has quit IRC17:25
*** dkehn__ is now known as dkehnx17:26
*** iccha has quit IRC17:27
*** michael-yu has joined #openstack-trove17:31
*** michael-yu has quit IRC17:31
*** michael-yu has joined #openstack-trove17:32
*** demorris has quit IRC17:42
*** nehav has quit IRC17:44
*** saurabhs has joined #openstack-trove17:46
*** grapex__ has quit IRC17:47
*** kevinconway has joined #openstack-trove17:47
*** grapex has joined #openstack-trove17:47
*** iccha has joined #openstack-trove17:47
*** openstackgerrit has quit IRC17:49
*** openstackgerrit has joined #openstack-trove17:49
*** denis_makogon_ has joined #openstack-trove17:50
*** iccha has quit IRC17:50
*** iccha has joined #openstack-trove17:50
*** denis_makogon has quit IRC17:51
*** denis_makogon_ is now known as denis_makogon17:51
*** dmakogon_ has joined #openstack-trove17:51
*** Yogesh has joined #openstack-trove18:07
*** shayneburgess has joined #openstack-trove18:07
*** saurabhs1 has joined #openstack-trove18:11
*** saurabhs has quit IRC18:14
*** shayneburgess has left #openstack-trove18:24
*** shayneburgess has joined #openstack-trove18:25
*** michael-yu has quit IRC18:25
*** michael-yu has joined #openstack-trove18:26
*** jmontemayor has joined #openstack-trove18:27
*** nehav has joined #openstack-trove18:36
*** nehav has quit IRC18:37
*** michael-yu has quit IRC18:38
*** saurabhs1 has quit IRC18:43
*** saurabhs has joined #openstack-trove18:43
*** eghobo has joined #openstack-trove18:47
*** eghobo has quit IRC18:47
*** eghobo has joined #openstack-trove18:48
*** michael-yu has joined #openstack-trove18:49
*** demorris has joined #openstack-trove18:57
*** tvoran has joined #openstack-trove18:59
*** yidclare has quit IRC19:01
amrithSlickNik, are we going to contine the conversation here?19:01
SnowDusthi denis_makogon: lets talk then19:01
*** mat-lowery_ is now known as mat-lowery19:01
SlickNikyes.19:01
*** tvoran_ has joined #openstack-trove19:02
SlickNikamrith, grapex, iccha, vipul, dougshelley66: got a couple of minutes19:02
vipulsure..19:02
grapexSlickNik: Unfortunately no, we've got two hours of meetings here. :(19:02
SnowDusthello team .. lets talk vertica datastore patchsets ..19:03
*** rueben has joined #openstack-trove19:03
SnowDustdenis_makogon u there ?19:03
denis_makogonyes19:03
amrithis there a blueprint for the capability that iccha is looking to implement? she shared amrith: we want to offer two db's one with volumes and one without in the same trove instance19:03
SnowDustso breifing u .. last wed meeting .. majority of team ..was interested in the same patchset without a split19:03
amrithshe shared: https://blueprints.launchpad.net/trove/+spec/per-datastore-volume-support19:03
amrithrobertmeyers said:  amrith: we want to offer two db's one with volumes and one without in the same trove instance19:04
*** jmontemayor has quit IRC19:04
*** iccha_ has joined #openstack-trove19:04
ruebenwanted to ask about tempest test failures....19:04
amritham I understanding this correct?19:04
*** tvoran_ has quit IRC19:04
iccha_got dc19:04
ruebenhttp://logs.openstack.org/11/104011/2/check/check-tempest-dsvm-full/b186146/console.html#_2014-07-02...19:04
*** tvoran__ has joined #openstack-trove19:04
rueben...the only thing that's failing on my patch set 2 https://review.openstack.org/#/c/104011/19:04
*** jmontemayor has joined #openstack-trove19:04
vipulamrith: sounds about right19:05
*** tvoran has quit IRC19:05
*** iccha has quit IRC19:05
iccha_amrith: i got dc, back online19:06
SnowDust?? denis_makogon ..19:06
*** tvoran__ has quit IRC19:06
glucasamrith: Seems to be the use case used in the capabilities spec as well19:06
*** tvoran has joined #openstack-trove19:06
glucasi.e. Trove has a a capability for volume support, but operators can choose what datastore versions use that capability19:07
denis_makogonSnowDust, SlickNik Yogesh, my concern about single patchset is that main patchset for vertica datastore proposes too much changes that are not related to vertica at atll19:07
denis_makogon*at all19:07
*** jmontemayor_ has joined #openstack-trove19:07
denis_makogonthe things like CRUD extensions19:07
SnowDustdenis_makogon : the entirety of the patchset is just for vertica implementation .. and thats the BP19:08
denis_makogonit hasn't been discussed at all19:08
SlickNikgrapex / iccha_: What's a good time that works for you guys to close the loop on this?19:08
SlickNikthis being how the volumes per datastore ties in with the capabilities bp in progress.19:09
iccha_SlickNik: does in two hours work for you?19:09
denis_makogonSnowDust, no, completely, BP says, we would implement users/schemes/root API, but it's impossible in terms of current framework19:09
iccha_but from the meeting i got the consensus was we start off with config values for groups like [mysql] and tie that into what we decide the general strategy for capabilties is SlickNik19:10
denis_makogonSlickNik, SnowDust, vertica features should be iterated19:10
amrithsorry, am back. just stepped away for a second.19:10
denis_makogon1. main things (provisioning, resizing, etc).19:10
denis_makogon2. backup/restore19:10
SnowDustdenis_makogon, but do u think the framework got changed ? is it such a change ?19:11
*** jmontemayor has quit IRC19:11
*** rueben has quit IRC19:11
iccha_SlickNik: there might be additional concerns to be addressed. our responses depend on trove_support_volume and this is a general concern irrespective of which strategy we use. its highlighted in the wiki page19:11
denis_makogon3. extensions refactoring (probably right after migration to pecan ReST framework)19:11
denis_makogon4. CRUD19:11
denis_makogonSnowDust, of course it got changed, whole extension framework got refactored without any info in the BP19:12
Yogeshdenis_makogon: I thought the changes were not drastic and on the lines of existing datastores19:12
denis_makogonSnowDust, those changes weren't approved19:12
SnowDustdenis_makogon: the code remains around the same things using same core libraries from openstack.common19:13
SnowDustwhere is the framework change ?19:13
denis_makogonYogesh, everything can fit to other datastores, but it hasn't been discussed at all19:13
amrithiccha_, SlickNik ... re: capabilities and iccha_'s bp, I didn't get the same understanding that she just mentioned. My understanding was that her BP is put on hold till we figure out what becomes of capabilities.19:13
denis_makogonSnowDust, committer changed trove/extension/ framework19:13
denis_makogonSnowDust, so, i would say - bring it to ML and let's discuss it there19:14
Yogeshdenis_makogon: if there is a need, we can bring it on the table for discussion and review...19:14
SnowDustdenis_makogon, sure19:14
Yogeshi agree that anything out of the datastore implementation should be discussed19:15
denis_makogonYogesh, so why does commiter did un-approved changes?19:15
Yogeshdenis_makogin: the reviewer can review and give comments19:16
denis_makogoni really think that whole patch should be iterated, in 3-4 stages19:16
Yogeshand they can be discussed in the forum19:16
Yogeshdenis_makogon: its been ages that the patch has been there19:16
Yogesha comment could've really paced things up19:17
SnowDustdenis_makogon, its very fine line .. the framework change u are citing doesnot mean a lot until there is any services/components working changing they work similar19:17
denis_makogonYogesh, i reviewed it not even once19:17
denis_makogonwith same complains, and they were ignored19:17
SnowDustdenis_makogon, :) who ignored .. we are still discussing / hearing u ..19:18
denis_makogoncool19:18
YogeshSnowDust: i liked the idea of breaking...19:18
glucasSlickNik: question about oslo.db sync, since it just came up in the meeting...19:18
SnowDustbut waiting for the community too19:18
denis_makogonthen let this discussion will go to the ML19:18
denis_makogonglucas, yup =)19:18
Yogeshwe can break the patchset into logical pieces19:18
SnowDustYogesh, last mid week meeting.. SlickNik, amrith both suggested not to break19:19
glucasSlickNik: I've got https://review.openstack.org/#/c/91629 for which you said it should be part of an oslo db sync. Should this not be going in for now?19:19
YogeshSlickNik: guidance?19:19
denis_makogonglucas, seems like yes19:19
denis_makogonglucas, oslo.db relays on [database] configuration group19:20
Yogeshvipul: SlickNik: Amrith: looking forward for inputs from you guys...19:20
SlickNikamrith: I don't think her volume per datastore bp necessarily needs to be put on hold. I think that (as vipul mentioned earlier), we could implement both her bp, and capabilities such that neither is blocked on the other.19:20
glucasdenis_makogon: right, I'd proposed changes to support that but wasn't aware of the whole oslo sync process at the time..19:21
amrithSlickNik, I don't know how you would do that without having rework later.19:21
denis_makogonglucas, so am i, but now, we're on the same page and now we know what and when we'll do19:21
amrithin the long run, I think it would be easier if her BP used a simple impl of capabilities which abstracts that functionality.19:22
SlickNikamrith: What is the plan for capability values that exist in the config file today (i.e. volume_support)?19:22
amriththat's the question, right. What I'm proposing is that the implementation of capabilities shoudl make that transparent to the consumer (in this case, iccha's code)19:23
amrithwhat is being proposed is that she go off and impelement some code to go and directly read out of config files.19:23
amriththis breaks a future abstraction; or at least means that this abstraction will have to rework her code AND move the volume support wherever it wants.19:24
SlickNikEven without talking about iccha's code, from a pure design perspective, what's our story around capability values that exist in the config file today?19:24
openstackgerritSteve Leon proposed a change to openstack/trove: Make storage strategy available for trove API and TM  https://review.openstack.org/8624219:25
amrithfrom a pure design perspective, I think there are some things which will remain in config files, albeit very limited or potentially going to zero over time.19:25
amrithi.e. the access to config files would be through capabilities19:25
SlickNikamrith: FWIW I think that's the proposal. Use a version of capabilities that doesn't rely on the API / db pieces that are still being fleshed out, but instead rely on the "fallback to config file" behavior that we're probably going to need in the long run anyway.19:25
amriththat was my understanding.19:25
amrithSlickNik, my last comment was a continuation of my previous statement, not a response to your comment.19:26
amrithThat said, I believe that what iccha_ is saying is that the code they will go ahead and implement something that directly reads config files. I'm searching for what she exactly said to verify, ...19:27
amrithhere ...19:28
amrithbut from the meeting i got the consensus was we start off with config values for groups like [mysql] and tie that into what we decide the general strategy for capabilties is19:28
amriththere might be additional concerns to be addressed. our responses depend on trove_support_volume and this is a general concern irrespective of which strategy we use. its highlighted in the wiki page19:28
amrithat 15:1019:28
amrithwhich I understand to be different from the proposal you just described, a proposal by the way which I agree with.19:29
SlickNikamrith: yup, that's why I want to have a meeting to make sure we're on the same page.19:29
amrithAt issue, I believe, is who "falls back to the config file". it is my opinion that the capabilities be the one that falls back. It is my understanding that what iccha is proposing is that her code fall back to config.19:29
amrithunderstood (re: your most recent comment, same page etc.,)19:30
amriththanks!19:30
SlickNikiccha_: unfortunately I have 2 back-to-back hourly meetings at 2 PDT, so that doesn't work for me :(19:31
SlickNikamrith: So I think another issue at the heart of the matter is whether this "fallback" mechanism for capabilities is already implemented, or still needs to be (and whether the original design needs to be updated).19:36
amrithSlickNik, yes. I agree.19:36
*** demorris has quit IRC19:41
*** yidclare has joined #openstack-trove19:42
SlickNikglucas: if an oslo db sync gets us cleaner config options for the db connection, I'm all for it.19:43
SlickNikglucas: unless it's a monumental task (and a cost-benefit analysis indicates otherwise).19:43
* anteaya lines up for some of SlickNik's time19:45
SlickNikanteaya: I've been meaning to catch up with you and sukhdev this morning, but haven't had a chance yet.19:46
anteayaI'm here19:46
anteayaI haven't talked to sukhdev lately19:46
anteayawhat can I do to help?19:46
SlickNikSo I followed the instruction on the doc, but ran into some issues.19:46
*** SnowDust has quit IRC19:46
anteayacan you paste them?19:46
anteayaI'll chase down sudhdev19:46
SlickNikI did, but paste was acting flaky earlier and only pasted half of it.19:47
SlickNikI have a gist, one sec.19:47
anteayakk19:47
SlickNikhttps://gist.github.com/anonymous/7984f4180fdd271a8c4f19:47
anteayathanks19:47
anteayaSlickNik: okay let me see if I can track down Sukhdev19:48
anteayathanks19:48
openstackgerritA change was merged to openstack/trove: Add sample admin_{user,tenant_name,password}  https://review.openstack.org/9929619:49
SlickNikOkay, let's take this to #openstack-infra,19:49
*** tvoran has quit IRC19:50
*** tvoran has joined #openstack-trove19:53
*** tvoran has quit IRC19:54
*** tvoran has joined #openstack-trove19:55
*** jmontemayor_ has quit IRC19:56
SlickNikYogesh / snowdust: I don't think the size of the changes is the issue (though small patches do make it easier for quick reviews).19:56
SlickNikThe bigger issue here is that there's no way of testing / validating that these actually work.19:56
SlickNikI believe the bigger issue is how we can get some CI around validating datastore scenarios.19:56
SlickNikSomething like running a "simple" set of integration tests, like spinning up an instance and making sure it come ACTIVE successfully (something like the "simple" group) would help a lot here.19:57
*** zzelle has joined #openstack-trove19:58
*** SnowDust has joined #openstack-trove19:58
*** demorris has joined #openstack-trove20:00
*** michael-yu has quit IRC20:03
iccha_SlickNik: how abt 3 pm PDT?20:03
*** demorris_ has joined #openstack-trove20:03
*** nehav has joined #openstack-trove20:04
*** demorris has quit IRC20:05
*** demorris_ is now known as demorris20:05
*** jmontemayor has joined #openstack-trove20:05
SnowDusthi SlickNik, on vertica datastore patch .. your observations ?20:06
*** tvoran has quit IRC20:06
SnowDusti just joined back .. may be i missed20:06
*** zzelle has left #openstack-trove20:06
*** tvoran has joined #openstack-trove20:07
YogeshSnowDust: lemme send you what SlickNIk said20:07
SnowDustsure ..20:07
Yogeshmore on the lines of the test strategy we discussed the last time20:07
SnowDustok .. means patchset will remain the same20:09
SnowDustno splits20:09
esmutedenis_makogon: Do you have any other concern beside the use of "global"? If not, could you remove the -1 so that it doesnt prevent other people from looking at it? We need this fix asap. https://review.openstack.org/#/c/102585/20:10
*** thedodd has joined #openstack-trove20:10
*** boden has quit IRC20:11
*** SnowDust has quit IRC20:11
*** radez is now known as radez_g0n320:13
*** michael-yu has joined #openstack-trove20:18
*** rueben has joined #openstack-trove20:19
iccha_amrith: how do u suggest i look at the config for per datastore given that it doesnt exist for per datastore right now20:24
*** ViswaV has joined #openstack-trove20:25
amrithiccha_, I was hoping we could have a conversation with SlickNik and others on core and folks in rax to figure out what the best path is forward.20:25
ruebenamrith: hey sorry!  We're having a huge planning day today, which has made it hard to multi-task at rax20:26
*** ViswaV__ has quit IRC20:26
amrithrueben, sounds good. what about tomorrow? SlickNik had many meetings back to back (I thought). let me check20:27
ruebenamrith: I'm not sure what everyone's availability is for the rest of the day20:27
ruebenI believe tomorrow should be easier to meet20:27
amrithyes, SlickNik said he has two back to back hourly meetings at 2pm PDT.20:27
SlickNikamrith / rueben / iccha_: I'm free after 4 PDT today —  and anytime tomorrow if that works better.20:28
iccha_SlickNik: 4 PM works for me20:30
*** achampion has quit IRC20:30
amrith7pm eastern is fine for me but I don't have a life ;)20:30
amrithlet me check if dougshelley66 can also join us20:30
ruebeniccha_: you guys feel free to meet up and I'll catch up on the details tomorrow :)20:31
*** ViswaV_ has joined #openstack-trove20:32
*** yidclare has quit IRC20:32
*** ViswaV has quit IRC20:35
*** denis_makogon has quit IRC20:44
*** demorris has quit IRC20:45
openstackgerritCraig Vyvial proposed a change to openstack/trove: parse the mysql cnf file for password  https://review.openstack.org/10410720:46
openstackgerritCraig Vyvial proposed a change to openstack/trove: guestagent contract for packages should be a list  https://review.openstack.org/10410820:47
*** juantwo has quit IRC20:51
johnmaAre there any instructions available on how to setup a new datastore type in a redstack env.  Currently I have a Legacy MySQL as the default and want to setup MySQL or MongoDB20:51
glucasjohnma: the redstack kick-start command will create a guest image and set up a datastore20:52
glucasjohnma: for example, ./redstack kick-start mysql20:52
*** miqui has quit IRC20:53
johnmaThank you so much glucas. Let me try that. What if I wanted to do the same for mongodb or any other type, could I do it through redstack as well?20:54
*** ViswaV has joined #openstack-trove20:54
*** ViswaV_ has quit IRC20:55
SlickNikjohnma: I believe you can use the same command for mongodb as well.20:55
johnmaThank you SlickNik & glucas. appreciate it. I will give it a try20:57
*** rueben has quit IRC20:58
SlickNikjohnma: One thing to remember is that the command updates the default datastore and version every time it's run, so the last run will define which datastore type is actually set up as the default one.20:58
johnmaok and is there another way to set the default to our like21:00
*** jmontemayor has quit IRC21:01
*** nehav has quit IRC21:01
johnmaThank you SlickNik. This has been very helpful.21:03
*** iccha_ has quit IRC21:05
*** grapex_ has joined #openstack-trove21:06
*** grapex has quit IRC21:08
*** nehav has joined #openstack-trove21:08
*** yidclare has joined #openstack-trove21:12
*** jcru has quit IRC21:13
*** jcru has joined #openstack-trove21:13
*** Yogesh has quit IRC21:13
*** iccha has joined #openstack-trove21:18
*** Yogesh has joined #openstack-trove21:21
*** tvoran has quit IRC21:23
*** tvoran has joined #openstack-trove21:27
*** yidclare has quit IRC21:28
*** glucas has left #openstack-trove21:30
*** glucas has joined #openstack-trove21:31
*** iccha1 has joined #openstack-trove21:40
*** iccha has quit IRC21:40
*** iccha1 has quit IRC21:41
*** iccha has joined #openstack-trove21:46
*** nehav has quit IRC21:51
*** grapex has joined #openstack-trove21:54
*** grapex_ has quit IRC21:54
*** grapex_ has joined #openstack-trove21:56
*** grapex has quit IRC21:56
johnmaI ran the following command ./redstack kick-start mysql but when I run the trove command datastore-list I still see only 'Legacy MySQL'. Am i missing something here21:59
openstackgerritSteve Leon proposed a change to openstack/trove: Make storage strategy available for trove API and TM  https://review.openstack.org/8624221:59
esmutejohnma: it could be that the mysql datastore is not active21:59
esmutecan you check the datastore_versions table ?22:00
johnmaThank you esmute. Can you show me how to verify the datastore_versions table. I am really new with trove22:01
esmutego to the trove database and check the datastores and datastore_versions tables22:03
amrithjohnma, did kick-start mysql complete successfully?22:03
esmuteeither you datastore was not created propertly or they are not active22:03
*** yidclare has joined #openstack-trove22:04
esmuteif you use an admin account, you should be able to see inactive datastore as well22:04
johnmaamrith: it completed and it looks like there was no error but there wasnt anything that said it was successful either22:04
*** michael-yu has quit IRC22:05
*** grapex has joined #openstack-trove22:05
esmuteif you dont see the datastore in the mysql table, the kick-start command probably didnt succeed. Can you gist the output of it?22:06
*** grapex_ has quit IRC22:09
*** juantwo has joined #openstack-trove22:09
*** juantwo has quit IRC22:09
*** juantwo has joined #openstack-trove22:10
*** yidclare has quit IRC22:14
*** michael-yu has joined #openstack-trove22:16
*** robertmyers has quit IRC22:23
*** Yogesh has quit IRC22:26
*** Yogesh has joined #openstack-trove22:34
*** iccha has quit IRC22:39
*** jcru has quit IRC22:47
*** kevinconway has quit IRC22:48
*** amytron has quit IRC22:48
*** rhodgin has quit IRC22:48
SlickNikjohnma: if the command completed, you should have a mysql_ubuntu image in your glance catalog as well. Can you check the output of nova image-list to see if that image exists?22:49
*** tvoran has quit IRC22:52
openstackgerritSteve Leon proposed a change to openstack/trove: Enable trove to specify cinder volume_type when creating a volume  https://review.openstack.org/10437022:54
amrithjohnma, I have to assume that kick-start didnt' complete.23:01
amritha mysql ubuntu image is created and installed as part of this.23:01
amrithso I have a question for SlickNik ... did your DIB changes get in?23:02
*** mattgriffin has quit IRC23:02
SlickNikamrith: Yes, they did.23:02
amrithremember that I had the same problem with building the image on a fresh trove-integration a couple of weeks ago?23:02
SlickNikwhy do you ask?23:02
SlickNikYes, I recall.23:02
*** iccha has joined #openstack-trove23:02
amrithI had to make some change to trove-integration to make this work23:02
amrithwhat was it ...23:02
amrithpage fault23:02
amrithpage fault23:02
amrithpage fault23:02
icchaSlickNik: amrith around?23:02
* amrith runs away23:03
SlickNikThat change in trove-integration merged as well.23:03
SlickNikSo if you get a fresh copy of trove-integration, you should be good.23:03
amrithso that isn't johnma's problem23:03
amrithI wonder then what it is23:03
amrithhi iccha23:03
SlickNikiccha: Am here.23:03
amrithSlickNik, I'm running review/nikhil_manchanda/bug/1329068 still. I should probably get to master23:04
icchaso just to be clear I am not against using capabilities for volume supprt :)23:04
*** amcrn has quit IRC23:04
amrithyup23:04
amrithi figured that23:04
*** saurabhs has quit IRC23:04
amrithmy question is this23:05
amrithfor what you are looking for, you want to know whether a particular datastore_version has volume support or not, is that right?23:05
icchabut it doesnt help that we do not have a clear plan for onboarding capabilities and two is that volume support is a special use case as well with an existing config value23:05
*** amcrn has joined #openstack-trove23:05
amrithor are you looking for a toggle at the datastore level?23:05
icchafor rackspace it is sufficient to toggle at datastore level23:06
amrithfor the present use-case envisaged23:06
amrithI assume23:06
icchayes23:07
amrithyes?23:07
amrithok.23:07
amrithwe said yes at the same time23:07
amrithOK, SlickNik ... I'm caught up23:07
icchalol yes23:07
amrithit is apparent that capabilities isn't checked in and ready right now23:08
amrithoh, before I wander off23:08
*** grapex has quit IRC23:08
amrithI assume that use-case #1 is [redis], yes?23:08
icchayes that is right amrith23:08
*** saurabhs has joined #openstack-trove23:09
SlickNikiccha: right, so if you add in the toggle in the config at the datastore level — there's nothing that precludes a "capabilities fallback" (when implemented) to make this discoverable via the API, and override it at a database level if needed, right?23:09
icchaif we do decide this to be a part of capabilities in future(which we did), we could still do that, it is just a queestion of where it would load the config value from23:09
amrithI guess I see a couple of issues.23:10
amrith1. where will you load value from today?23:10
amrith2. where will the value be loaded from in the future?23:10
icchayes thats right SlickNik23:10
amrith3. what is the migration strategy from 1 -> 223:10
amrith4. There is code change required, who will do that?23:10
iccha1. from config file [mysql]volume_support . (wiki page for example)23:10
iccha2. from capabilities database, if value not present there will default to config value23:11
iccha3. there is no need for migration, since database will be the first look up, only if value is not present will the config value be used23:11
amrith<waiting for you to finish>23:12
iccha4. it would be more of code addition, based on what we decide as a community to be our capabiltieis addition strategy23:12
icchawhy i say that is because we want the capability names to be consistent across deployers23:12
icchago ahead amrith23:12
amrithre: 1. would you be implementing code for all datastores? or just the one you want in this case <will wait for answer>23:12
iccha1. it would be for all datastores . every [datastore] would have this config value volume_Support. if not present will default to global config value trove_volume_support23:13
icchawe will load it in as config[datastore].volume_support23:14
*** Yogesh has quit IRC23:14
amrithif I may, then the view is that in the future you wouldn't move this to capabilities as you'd assume the fallback. (2 and 3)23:15
amrithwould that mean that config[datastore].volume_support must first read capabilities and then config?23:15
amrith<eot>23:15
SlickNikamrith: That actually depends on how capabilities is actually implemented. There was some talk at the mid-cycle meetup of extending the CONF object to check if a capability exists in the DB and return that, and only fallback to the CONF if a DB value doesn't exist.23:16
icchaSlickNik: was there any discussion on how to add have consistency of capability names across deployers23:17
amrithSlickNik, that was effectively my question. Was iccha assuming this implementation.23:17
icchaamrith: i did not even know about this implementation till SlickNik mentioned it in today's meeting23:17
amrithI'm trying at some level to disentangle configurations from capabilities (call them feature 1 and feature 2 because the names are confusing)23:17
icchai did not find any documentation in the wiki about this plan23:17
icchaamrith: SlickNik did yall have a chance to take a look at how i envisioned capabilties without the config stuff in the wiki?23:18
amrithso iccha you are correct, I've been reading about this over the past couple of days and it is clear that the bp needs some work.23:18
SlickNikiccha: I looked as well, and the documentation is lagging behind the discussions we had :(23:19
amrithiccha, please clarify question. what you mean, is there a specific doc you refer to ...23:19
SlickNikiccha: Nope been in meetings and haven't had a chance to look that over.23:19
SlickNikCan you link it here?23:19
icchaamrith: SlickNik its a small read the capabilities section in this https://wiki.openstack.org/wiki/Trove/trove-per-datastore-volume-support23:20
amrithA quick read of this gives me some concern(s). let me type them out here ... there are a couple.23:21
amrithfirst, it is prescriptive in its interpretation of how capabilities should work, such as the fact that migration should add a row to a table. what if a row doesn't exist, how should code behave?23:22
amrithsecond, is there a list of capabilities and adding one that isn't on the list is a cardinal sin?23:22
icchayes its totally wrong, i am not saying we implement it23:22
amriththird, that calls made by operators/deployers to add a version overrides a "table", whatever that happens to be ;)23:22
icchai am trying to highlight the consistency across deployers23:23
icchabecause u are going to be checking for that capability name in the code23:23
icchathere in no protocol23:23
icchathat is a concern23:23
icchahence we need a fall back23:23
amrithok, iccha let me ask this then.23:23
icchalike the config value23:23
*** saurabhs has quit IRC23:24
amriththe way a value gets in a config value (in a file) is either (i) it is in the standard template or (ii) someone types it in. These are the exact same ways in which something gets into capabilities. Either they are in a migration script or someone types them in. What new risks have we added in this process? I see none.23:24
amrith<over>23:25
openstackgerritSteve Leon proposed a change to openstack/trove: Make storage strategy available for trove API and TM  https://review.openstack.org/8624223:25
icchaok fair enough, but is there any harm in trying to be more robust or having defaults?23:26
iccha<over> :p23:26
amrithhey, I'm a ham radio operator, I do this over thing in morse code regularly ...23:27
amrithbut, no, there's nothing wrong23:27
amrithI just highlight the fact that capabilities are not inherently more risky in terms of a missing protocol than a config file23:27
amrithand therefore the discussion of more robust should be had in that context, not of improvement of one over the other but overall improvement.23:28
amrithde k1ann23:28
amrith<over>23:28
vipulif you're going to fallback to reading the capability from a Conf, it seems like you're restricted in the capability name regardless, you have to know what the 'key' is going to be when you look in the conf.  So it seems to me that it needs to be introduced as a 'key' in the Conf, and then deployers have the choice of "promoting" it to a capability, hence exposing its value over an API23:29
SlickNikvipul, either that, or having a mapping in the capability itself mapping it to a conf value for fallback.23:29
icchayes we need some standardization23:30
vipulYea you could do that.. i guess i don't see what value there would be in mapping a CFG entry to another key23:30
vipulso if we have volume_support as the cfg item in a conf file.. the capability better be named 'volume_support' as well in the DB23:30
*** thedodd has quit IRC23:31
SlickNikSo I think, the capabilities bp as it stands today is a bit over-engineered for my liking. I'd totally be fine with a v1 API that just discovers the value of a cfg param through the API, and I suspect this would suffice for the horizon requirement.23:31
amrithSlickNik, yes and no23:32
iccha+1 about the over engineering23:32
amrithso here's why I'm opposed to config files as a "repository of truth". You have many machines each with a config file and pretty soon you have a management nightmare. A single point (database) is a better solution. No, I don't think we should implement file rsync as a mechanism to keep config files synchronized in trove ;)23:33
amrithat a high level, a datastore [redis] could have many datastore_version entries.23:34
amrithsome may want volume support, others may not23:34
SlickNikamrith: Sometimes you do want different components files on different machines to have different configs.23:34
amrithmy concern is that in the drive to get this done for volume_support, we are not implementing a solution that should be adopted across the board.23:34
amrithSlickNik, tying difference in files to a specific machine is a sure way to get divergent files and not something which scales horizontally in a large configuration. I'd bet that if a large deployment had two machines with a different configuration file, they'd call these two machines "differetn flavors".23:36
icchaamrith: thats why we have puppet and chef to help with config deployments23:36
amrithiccha, that's not a solution that is "product friendly", unfortunately.23:37
icchathats a bigger question to tackle config vs database values23:37
SlickNikamrith: And the way configs are handled across OpenStack are through config files and not thought a config database (not saying right or wrong just stating how it is today across different OpenStack components).23:37
amrithso what do you folks suggest?23:38
amrithhow should we proceed?23:38
amrithit is certain to me that the capabilities BP needs rework23:38
icchaI think we should not hold up current features  because we are still trying to figure out capabilities23:38
amrithit is also unclear how people would adopt it from the perspective of "standardization" unless we can mandate that the CONFIG API wrap capabilities.23:38
amrithiccha, that's a slippery slope and I'd rather not use taht particular phraseology for a bunch of reasons.23:39
amrithbut be that as it might23:39
amriththere is a desire to implement volume_support23:40
icchawhich phrase amrith ?23:40
amriththe phrase "holding up current features because we are trying to figure out capabilities".23:40
amrithor that sentiment23:40
amrithanyway, moving past that23:40
amriththere is a desire to implement volume_support23:40
amrithand there is no clear indication whether there is support for capabilities23:41
amrithI thought there was, but that appears to be somewhat questionable at this point.23:41
amrithso what do you folks suggest, how should we proceed?23:41
amrithOK, no takers on a plan?23:42
amrithI'll even say <over>23:43
amrith<over>23:43
* SlickNik is furiously typing23:43
icchaI suggest we add them to config values per datastore for now as a starting poiny23:43
amrithI'm happy to offer one23:43
* iccha waits for SlickNik23:43
vipulI wouldn't want to say this feature must be implemented as a capability, especially since it doesn't exist.  I think this exercise of going through and talking about whehther it could be implmented by capabilities.. was meaningful -- and it seems that if we go with a conf based fallback -- it would naturally fit in once that fallback is implemented23:43
* amrith runs to refrigrator23:43
SlickNikI think that it's fair to suggest that folks who need to extend the conf be allowed to do so.23:44
SlickNikAnd that when we implement capabilities, we do so in such a way that there is a path allowing "promotion" of a config value to a capability (either seamlessly, or by adding code).23:44
SlickNikThen the onus of whether a config option should be a capability by default (or not) can be tackled specifically depending on whether it makes sense to do so — and whether deployers actually want to promote it.23:44
iccha+123:44
vipulyep, i'm good with that SlickNik23:44
amrithso I'm not23:45
amrithand here's the other side of it.23:45
amrithwhen the product (trove) is shipped, or downloaded, what does it expect in a database and what does it expect in a configuration file?23:45
amrithit is fine and dandy for operator A to go stick volume_support in a file and say it is all done.23:46
amrithBut what of the user who downloads the product?23:46
vipulI think it's the same problem as datastores..23:46
amrithif I were to follow SlickNik's path down the road there would be furious cries of resistance if I were to decide that a migration script to add a value for volume_support into the database!23:46
vipula deployer today has to go in and add the datastores that they want to support23:46
vipulimo, it's a documentation exercise.. if you want to expose conf params, promote them23:47
vipulif we want to be nice -- we can have a migration script that seeds the initial 'we all agree upon' items23:47
amrithso in effect, the flaw in SlickNik's logic is the fact that by allowing the present "extension", you have effectively precluded a product default (through a capability) for the value specified in this "extension". And I see vipul say this is a "documentation exercise", sorry, that won't scale!23:47
esmuteamrith: Isnt a user who downloads the product also be an operator? I mean, that user would have to know how to config trove propertly to work23:47
amrithesmute, yes, it could be an operator. My question is this, what are the "defaults" for the system?23:48
amrithor are you stipulating that Trove shall ship with NO, NONE, ZERO, ZIP, NADA defaults23:48
vipulthe defaults exist in the conf23:49
amrithand the user or operator has to configure them all, each and every one23:49
icchaamrith: is that not an issue with any of the current config values?23:49
SlickNikamrith: So a default exists, and it's in the config file. If you as a deployer want to programmatically change the default via the API, go ahead and enable it as a capability by all means.23:49
icchawhat about trove_support_volume?23:49
esmuteshouldnt the default be the config values that we are currently testing in our CI... eg trove_volume_support enabled23:49
amrithiccha, yes it is. Hence the issue of migration and capabilities. If we're opposed to the notion of migration to capabilities, we may as well kill capabilities and do everything in conf files!23:49
icchawe could default the volume_support to the global config value/default23:49
icchaof trove_support_Volume23:49
amrithiccha, SlickNik, esmute ... I think you are all talking past my point, let me try and illustrate again.23:50
amrithcase #123:50
amritha system that currently is configured with a particular "value" in a configuration file.23:51
amriththis is a good and well known "value" and default is established.23:51
amrithMost people agree with the default, some tweak it.23:51
amrithBut, it is in a configuration file.23:51
amrithAlong comes the new capabilities feature23:51
amrithA new trove is created23:51
openstackgerritAnna Shen proposed a change to openstack/trove-integration: Add support for a neutron-based install  https://review.openstack.org/7812323:51
amrithit ships with two things now, a sample config file and a database script to see initial values.23:52
amrithwhere would this new trove put the default value for "value"?23:52
SlickNikamrith: I'm saying that it wouldn't need a database script.23:52
amrithquestion #2 related to this, how does a migration handle a configuration file.23:52
vipulIf we're seeding the databse.. then obviously the database would ge the value23:52
amrithdoes it pick it up from the config file and jam it in a database or not?23:52
amrithCase #2 a brand new system23:53
amrithWhat's it's default23:53
SlickNikamrith: We don't need to do that (and really shouldn't) if we fall back to the config file.23:53
amrithwhere does the default come from? a config file or a database23:53
esmutei think we should not have any value in the database... because it will fallback on the config..23:53
*** shayneburgess has quit IRC23:53
esmuteconfig file23:53
amrithso esmute you decree that it is the user's (operator or end user) responsibility to make sure that in a multi-machine configuration that the right configuration files move to each machine.23:54
vipulSo when capabiliies are implemented, we can choose to have a migration script that seeds the 'initial' capabilties that we think all deployers should support.. that might include volume_support among other things23:54
vipulif we do that -- then it solves both cases, there will be default values in the database, regardless if it's a new trove, or exisiting23:54
amrithit was one of the things that I thought to be the goal of the capabilities project ... to avoid this file sync'ing problem.23:55
amrithno vipul, it doesn't solve it23:55
esmutecorrect me if im wrong but i think when a brand new trove is deployed, the database (capabilities) is empty.. and trove will get its config from the config file.... The user can set his/her capabilities in the DB23:55
amrithbecause if I put default volume_support = true, iccha will be unhappy ;)23:55
vipulamrith: it's a default.. if she's unhappy, she can change the default in the db23:56
*** saurabhs has joined #openstack-trove23:56
vipulsame as what you'd have to do if it was a conf file23:56
esmuteiccha is a she?23:56
icchayeah the deployer needs to be aware of whats going in a release23:57
esmute:p23:57
SlickNikSo if a deployer wants to change the value in the config file, two scenarios exist.23:57
SlickNik1. He wants to do it once and has access to the config file: He updates the config file, restarts the service - done.23:57
SlickNik2. He wants to be able to programmatically update the value via the API whenever makes sense: Create an override value for the config in the database, and trove picks that value over the config file value.23:57
amrithSlickNik, you are prescribing that defaults shall not be distributed through a database script.23:57
amrithin effect, you are advocating what esmute said23:58
amrithand not what vipul said23:58
icchaSlickNik: i like that! and can further override it with capabiltites override23:58
amrithvipul said ... "there will be default values in the database, regardless if it's a new trove, or exisiting"23:58
vipulI think it's probably sane to seed initial capabilities.. and this would be part of the capabilities implementation23:58
amrithvipul, where?23:58
amrithin conf or in db?23:58
vipulin the DB.. seed = db migration23:59
icchato insert a row23:59
icchasimilar to what was in docs i had23:59
esmutethe initial values for capabilities should be what is in the config then? Maybe i dont see the point of seeding capabilities23:59
icchayes esmute !23:59
amrithso SlickNik maybe I should summarize (as I'm going to be pointing dougshelley66 at this in the AM)23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!