Thursday, 2014-02-06

grapexSee everyone tomorrow00:00
*** grapex has quit IRC00:01
*** jcru has quit IRC00:08
*** yogesh has joined #openstack-trove00:11
*** cweid has quit IRC00:18
*** demorris has joined #openstack-trove00:19
*** matsuhashi has joined #openstack-trove00:20
*** jmontemayor has quit IRC00:22
*** yogesh has quit IRC00:34
openstackgerritA change was merged to openstack/trove: Fixes resizes for volumes attached to active Nova servers  https://review.openstack.org/6536500:45
*** demorris has quit IRC00:47
*** esp has left #openstack-trove00:52
*** grapex has joined #openstack-trove00:53
*** nosnos has joined #openstack-trove00:56
*** grapex has quit IRC01:09
*** igor has joined #openstack-trove01:15
*** igor____ has quit IRC01:16
*** esmute has quit IRC01:22
*** tanisdl has quit IRC01:23
*** saurabhs has quit IRC01:33
*** freyes has joined #openstack-trove01:33
*** amcrn has quit IRC01:43
*** saurabhs has joined #openstack-trove01:43
*** michael-yu has quit IRC01:49
*** grapex has joined #openstack-trove01:57
*** grapex has quit IRC02:02
*** amytron has joined #openstack-trove02:03
*** saurabhs has quit IRC02:12
*** michael-yu has joined #openstack-trove02:12
*** amrith has quit IRC02:14
*** amrith has joined #openstack-trove02:15
*** michael-yu has quit IRC02:30
*** erkules has quit IRC02:34
*** esp has joined #openstack-trove02:35
*** harlowja has quit IRC02:44
*** erkules has joined #openstack-trove02:48
*** SushilKM has quit IRC02:52
*** grapex has joined #openstack-trove02:53
*** harlowja has joined #openstack-trove02:55
*** freyes has quit IRC02:57
*** doug_shelley66 has quit IRC03:00
*** yogesh has joined #openstack-trove03:20
*** yogesh has quit IRC03:25
openstackgerritCraig Vyvial proposed a change to openstack/trove: adding configuration group support  https://review.openstack.org/5316803:28
*** amrith has quit IRC04:03
openstackgerritMat Lowery proposed a change to openstack/trove: Get service endpoints from catalog  https://review.openstack.org/6801504:14
*** jcooley_ has quit IRC04:43
openstackgerritCraig Vyvial proposed a change to openstack/trove: adding configuration group support  https://review.openstack.org/5316804:47
*** michael-yu has joined #openstack-trove04:49
*** doug_shelley66 has joined #openstack-trove04:57
*** doug_shelley66 has quit IRC05:01
*** nosnos_ has joined #openstack-trove05:02
*** harlowja has quit IRC05:05
*** nosnos has quit IRC05:06
*** harlowja has joined #openstack-trove05:14
*** ViswaV has quit IRC05:26
*** edmund1 has quit IRC05:29
*** jcooley_ has joined #openstack-trove05:49
*** denis_makogon has joined #openstack-trove06:00
*** amytron has quit IRC06:03
*** matsuhashi has quit IRC06:07
*** matsuhashi has joined #openstack-trove06:07
*** matsuhas_ has joined #openstack-trove06:09
*** matsuhashi has quit IRC06:09
*** jcooley_ has quit IRC06:11
*** igor has quit IRC06:18
*** igor has joined #openstack-trove06:18
*** grapex has quit IRC06:24
*** jcooley_ has joined #openstack-trove06:24
*** denis_makogon_ has joined #openstack-trove06:24
*** denis_makogon has quit IRC06:26
*** krow has quit IRC06:39
*** nosnos has joined #openstack-trove06:40
*** yogesh has joined #openstack-trove06:42
*** nosnos_ has quit IRC06:42
*** krow has joined #openstack-trove06:50
*** krow has quit IRC06:54
*** michael-yu_ has joined #openstack-trove06:56
*** krow has joined #openstack-trove06:56
*** michael-yu has quit IRC06:57
*** michael-yu_ is now known as michael-yu06:57
*** grapex has joined #openstack-trove06:59
*** krow has quit IRC07:00
*** krow has joined #openstack-trove07:01
*** yogesh has quit IRC07:03
*** krow1 has joined #openstack-trove07:03
*** grapex has quit IRC07:04
*** esmute has joined #openstack-trove07:04
*** krow has quit IRC07:06
*** PradeepChandani_ has quit IRC07:17
*** PradeepChandani_ has joined #openstack-trove07:17
*** harlowja is now known as harlowja_away07:23
*** flaper87|afk is now known as flaper8707:39
*** denis_makogon_ has quit IRC07:55
*** grapex has joined #openstack-trove08:00
*** grapex has quit IRC08:04
*** grapex has joined #openstack-trove09:00
*** grapex has quit IRC09:05
*** igor_ has joined #openstack-trove09:30
*** igor has quit IRC09:32
*** jcooley_ has quit IRC09:32
*** michael-yu has quit IRC09:42
*** michael-yu has joined #openstack-trove09:47
*** michael-yu has quit IRC09:48
*** grapex has joined #openstack-trove10:01
*** krow1 has quit IRC10:03
*** grapex has quit IRC10:05
*** krow has joined #openstack-trove10:14
*** krow has quit IRC10:19
*** krow has joined #openstack-trove10:20
*** krow1 has joined #openstack-trove10:24
*** krow has quit IRC10:24
*** denis_makogon has joined #openstack-trove10:46
*** PradeepChandani_ has quit IRC11:01
*** grapex has joined #openstack-trove11:01
*** grapex has quit IRC11:06
*** krow1 has quit IRC11:10
*** AndroUser has joined #openstack-trove11:21
*** AndroUser has quit IRC11:55
*** AndroUser has joined #openstack-trove11:56
*** AndroUser has quit IRC11:56
*** SnowDust has joined #openstack-trove11:57
*** AndroUser has joined #openstack-trove12:01
*** grapex has joined #openstack-trove12:02
*** doug_shelley66 has joined #openstack-trove12:04
*** grapex has quit IRC12:06
*** amrith has joined #openstack-trove12:08
*** AndroUser has quit IRC12:20
*** AndroUser has joined #openstack-trove12:21
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094412:25
*** robertmy_ has joined #openstack-trove12:25
*** robertmyers has quit IRC12:25
*** jcooley_ has joined #openstack-trove12:26
*** SnowDust has quit IRC12:28
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094412:29
openstackgerritDenis M. proposed a change to openstack/trove-integration: Add support for minimal MongoDB testing  https://review.openstack.org/5337812:30
*** jcooley_ has quit IRC12:31
*** AndroUser has quit IRC12:40
*** AndroUser has joined #openstack-trove12:40
*** jcru has joined #openstack-trove12:44
*** igor has joined #openstack-trove12:45
*** igor_ has quit IRC12:46
*** SnowDust has joined #openstack-trove12:52
openstackgerritDenis M. proposed a change to openstack/trove: Allow db instance conditional logging  https://review.openstack.org/6378913:01
*** grapex has joined #openstack-trove13:03
*** pdmars has joined #openstack-trove13:04
*** freyes has joined #openstack-trove13:06
*** grapex has quit IRC13:07
denis_makogonhttp://vk.com/makphotos?w=wall-36488060_23713:08
*** AndroUser has quit IRC13:09
*** jimbobhickville has joined #openstack-trove13:10
*** amrith has quit IRC13:15
*** freyes has quit IRC13:16
openstackgerritshivam shukla proposed a change to openstack/trove: Tests for heat based instance workflow  https://review.openstack.org/6649913:29
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094413:46
openstackgerritDenis M. proposed a change to openstack/trove: Track security group provisioned by heat  https://review.openstack.org/7104013:47
*** SnowDust has quit IRC13:50
*** doug_shelley66 has quit IRC13:50
*** yidclare has quit IRC13:54
denis_makogonsorry for link above, wrong chat13:55
*** jcooley_ has joined #openstack-trove13:57
*** jcooley_ has quit IRC14:03
*** grapex has joined #openstack-trove14:03
*** robertmy_ has quit IRC14:03
*** grapex has quit IRC14:08
*** SnowDust has joined #openstack-trove14:08
*** edmund has joined #openstack-trove14:12
*** demorris has joined #openstack-trove14:15
openstackgerritDenis M. proposed a change to openstack/trove: Allow db instance conditional logging  https://review.openstack.org/6378914:16
*** michael-yu has joined #openstack-trove14:29
*** Barker has joined #openstack-trove14:29
*** robertmyers has joined #openstack-trove14:31
*** edmund has quit IRC14:32
*** edmund has joined #openstack-trove14:35
*** doug_shelley66 has joined #openstack-trove14:52
*** amrith has joined #openstack-trove14:58
*** amrith has quit IRC15:02
*** Barker has quit IRC15:03
*** amrith has joined #openstack-trove15:03
*** grapex has joined #openstack-trove15:04
*** SnowDust has quit IRC15:08
*** ViswaV has joined #openstack-trove15:15
*** matsuhas_ has quit IRC15:17
*** nosnos has quit IRC15:21
*** kevinconway has joined #openstack-trove15:22
*** ViswaV has quit IRC15:24
*** datsun180b has joined #openstack-trove15:33
*** Barker has joined #openstack-trove15:38
*** tanisdl has joined #openstack-trove15:40
*** jcooley_ has joined #openstack-trove15:46
*** jcooley_ has quit IRC15:53
*** michael-yu has quit IRC15:54
*** shakayumi has joined #openstack-trove15:54
*** michael-yu has joined #openstack-trove15:59
*** doug_shelley66 has quit IRC16:04
*** plodronio_ has joined #openstack-trove16:05
*** ViswaV has joined #openstack-trove16:05
*** doug_shelley66 has joined #openstack-trove16:06
*** plodronio has quit IRC16:06
*** plodronio_ is now known as plodronio16:06
*** ViswaV has quit IRC16:06
*** ViswaV has joined #openstack-trove16:06
*** ViswaV has quit IRC16:09
*** ViswaV_ has joined #openstack-trove16:09
*** ViswaV_ has quit IRC16:10
*** ViswaV has joined #openstack-trove16:10
*** jmontemayor has joined #openstack-trove16:13
*** jmontemayor has quit IRC16:14
*** shakayumi has quit IRC16:14
*** jmontemayor has joined #openstack-trove16:15
*** jcooley_ has joined #openstack-trove16:30
*** jasonb365 has joined #openstack-trove16:30
*** amrith has quit IRC16:42
*** michael-yu has quit IRC16:48
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094416:50
*** jcooley_ has quit IRC16:56
denis_makogonmat-lowery, ping16:56
mat-loweryhello denis_makogon16:57
denis_makogonmat-lowery, hi16:57
*** jcooley_ has joined #openstack-trove16:57
denis_makogonlast patch landed, and i suppose, that this one is the last16:57
denis_makogonmat-lowery, btw, just letting you know TroveError object doesn't contain status code attribute16:58
denis_makogonmat-lowery, there's a policy for exceptions, dictated by oslo-incubator(OpenStackException)16:59
*** jmontemayor has quit IRC17:00
*** jmontemayor has joined #openstack-trove17:00
*** michael-yu has joined #openstack-trove17:01
*** freyes has joined #openstack-trove17:03
mat-lowerydenis_makogon: Just saw your comments. I was proposing a status code in the new MalformedSecurityGroupRuleError as a compromise between two extremes: one MalformedSecurityGroupRuleError class everywhere with different error messages vs. Error class per fine-grained problem (in the case of above patch set: 3 Error classes). This compromise keeps the class count down while avoiding the parsing of error messages in tests. If17:04
mat-lowery OpenStackException forbids status codes, then that's another story.17:04
denis_makogonmat-lowery, as i said not so long ago, populating error classes - bad idea17:06
denis_makogonwe need to keep everything simple and fast17:07
denis_makogonmat-lowery, its tests only, you run it once, no big deal17:07
*** kiall has quit IRC17:08
mat-lowerydenis_makogon: My point is only that ideally, changing an error message shouldn't break tests. And if by "populating error classes" you mean an explosion in the number of exception classes, then that is precisely what a status code is meant to address. My two cents. Thanks for the feedback!17:11
denis_makogonmat-lowery, ideally, we need to have separate class for taskmanager exception, api exception, guest exceptions17:12
denis_makogonError message are what we need17:13
mat-lowerydenis_makogon: gotcha. thanks17:15
*** krow has joined #openstack-trove17:15
denis_makogonmat-lowery, thanks for keeping eye on patches17:16
*** michael-yu has quit IRC17:17
*** Barker has quit IRC17:26
*** doug_shelley66 has quit IRC17:27
*** krow has quit IRC17:28
*** doug_shelley66 has joined #openstack-trove17:37
*** krow has joined #openstack-trove17:38
*** jcooley_ has quit IRC17:41
*** jcooley_ has joined #openstack-trove17:42
*** krow1 has joined #openstack-trove17:43
*** krow has quit IRC17:44
*** jmontemayor has quit IRC17:57
*** harlowja_away is now known as harlowja17:59
*** jasonb365 has quit IRC17:59
*** jmontemayor has joined #openstack-trove18:02
*** jasonb365 has joined #openstack-trove18:03
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094418:05
*** amcrn has joined #openstack-trove18:06
*** Barker has joined #openstack-trove18:08
juiceeh hem (https://review.openstack.org/#/c/66063/)18:17
juicehub_cap, grapex ^  ^18:17
hub_caphey juice i need to spend a day focused on fixing my email client18:18
hub_capso im layin low on reviews till this evernin18:18
hub_capdenis_makogon: hey dude18:18
juiceokie doke18:18
juicethis patch may need to be rebased based on pdmars recently merged patch18:18
hub_capi coudlnt get the trove-integration code to publish the glance image last night, i rebased your trove-integration c* review too18:19
hub_capcan u look into it?18:19
hub_capill try again this afternoon denis_makogon18:19
*** amrith has joined #openstack-trove18:20
*** jcooley_ has quit IRC18:21
openstackgerritDenis M. proposed a change to openstack/trove-integration: Initial support for single instance Cassandra Database  https://review.openstack.org/5266618:24
denis_makogonhub_cap, ok, i changed commit description18:24
openstackgerritDenis M. proposed a change to openstack/trove-integration: Initial support for single instance Cassandra Database  https://review.openstack.org/5266618:25
*** yogesh has joined #openstack-trove18:32
*** igor has quit IRC18:40
*** yidclare has joined #openstack-trove18:41
*** igor has joined #openstack-trove18:44
*** Ranjitha has joined #openstack-trove18:53
*** tanisdl has quit IRC18:55
*** jcooley_ has joined #openstack-trove18:58
*** kiall has joined #openstack-trove19:24
openstackgerritCraig Vyvial proposed a change to openstack/trove: adding configuration group support  https://review.openstack.org/5316819:29
*** tanisdl has joined #openstack-trove19:31
*** jcooley_ has quit IRC19:35
*** jcooley_ has joined #openstack-trove19:36
*** jcooley_ has quit IRC19:40
*** jcooley_ has joined #openstack-trove19:41
*** SushilKM has joined #openstack-trove19:42
SushilKMhey19:43
SushilKMwas luking into root-show api and ..... I think that though it says that is_root_enabled but it means actually checking any historical root enablements ....19:44
*** jcooley_ has quit IRC19:45
SushilKMalso guestagent_api.is_root_enabled is not called anywhere to decide root enable status19:47
SushilKMso wisely, would we like to add a date to confirm that historical root enabled, hw do we see that ....19:49
*** jcooley_ has joined #openstack-trove19:50
hub_capSushilKM: im not sure what you are proposing, but it cannot break the current api :)19:54
* hub_cap goes back to setting up gnus19:54
SushilKMlet me expalin a bit19:54
*** jcooley_ has quit IRC19:56
SushilKMroot-show api uses https://github.com/openstack/trove/blob/master/trove/extensions/mysql/models.py#L189 to find root has been enabled or not19:56
SushilKMthis checks basically in the root-history if root was ever enabled19:57
*** jcooley_ has joined #openstack-trove19:57
SushilKMbecause if someone enables it and then deletes the root user from system, root-show wud still show as true, I agree that behind the scens before deleting the root user the user must have done something to make his way19:58
SushilKMso it seems we want to show using root-show api is if root was ever enabled on this instance20:00
SushilKMin history20:00
*** jasonb365 has quit IRC20:02
denis_makogonhub_cap, i hope, cassandra and mongo would reach codebase soon20:04
*** jmontemayor has quit IRC20:04
*** jasonb365 has joined #openstack-trove20:05
*** Barker has quit IRC20:05
denis_makogonguys, i'm out, gonna be reachable soon, in 1-2h20:05
*** demorris has quit IRC20:07
*** jasonb365 has quit IRC20:09
*** jmontemayor has joined #openstack-trove20:12
*** jcooley_ has quit IRC20:12
*** michael-yu has joined #openstack-trove20:12
*** jcooley_ has joined #openstack-trove20:12
SushilKMhow do u see that hub_cap20:14
*** Barker has joined #openstack-trove20:15
hub_capdenis_makogon: once i get things working well it will be merged :)20:15
datsun180bis_root_enabled is did_i_find_at_least_one_instance_of_the_user_enabling_root20:16
*** grapex_ has joined #openstack-trove20:17
SushilKMso,  how do u see if we show a date to when was it enabled last20:17
hub_capim not sure it matters20:18
datsun180bi forget but i thought the mgmt api gave it in higher detail20:18
hub_capit does datsun180b20:18
hub_capit gives the date as well20:18
datsun180bso there you go20:18
SushilKMoh really20:18
hub_capi dont think weve had any users who have asked when they had it enabled tho20:18
datsun180bthe purpose was to function like a tamper-proof seal for support purposes20:19
SushilKMyeah, but i was doing it the way that i enabled root then dropped root user back in database, and whn i used root-show it was still showing me root is enabled20:19
SushilKMand i was complaininng for that20:19
*** demorris has joined #openstack-trove20:19
datsun180bright, if you open a jar of pickles once you can't hermetically seal the jar again unless you own a pickle factory20:19
SushilKMthen i found it was to show my historical root enable ....20:19
*** grapex has quit IRC20:20
datsun180bif you enable root and then erase all trace of ever having enabled root it makes it difficult to support an instance20:20
SushilKMso, wat i wanted to was to add a date for last enable so that i do not complain it ....20:20
datsun180biirc "Never" was the default20:21
datsun180band "Nobody" to go with it20:21
datsun180bsorry, would you explain what you meant with that last bit?20:21
SushilKMi meant when we use show-root it shows is_root_enable = true20:22
datsun180boh so you just want to muck with the return type for that method?20:23
datsun180bweeeeell i wonder if it doesn't count as violating the contract if you return _more_ than what is stated20:24
datsun180bso if you returned {enabled: True, when=<some date>} i can't see any client exploding for that20:24
SushilKMcool, so shall i make that20:25
datsun180bi'm working on a similar change to user access/grant/revoke20:25
*** grapex_ has quit IRC20:25
datsun180band you probably want core to lean in on that to make sure before you start20:25
SushilKMso cores, how do u see that20:25
*** grapex has joined #openstack-trove20:26
SushilKMhttp://paste.openstack.org/show/62872/ is what i wanna do20:29
SushilKMplease suggest, if that looks good to go ahead20:29
*** krast has quit IRC20:30
*** freyes has quit IRC20:31
datsun180bhow would that look in json? do we have any other examples of cli output in three columns?20:32
SushilKMdid not checked that20:33
SushilKMbut research cud be mad20:33
hub_capyea cli output is generally not what i want to see when talking about api changes20:33
hub_capfwiw, i think we all know yer talking about adding a field to the root call20:34
SushilKMhuh20:34
datsun180bit's really the api's schema we have the contract with20:34
hub_capto show the enabled date20:34
datsun180bthe cli can do whatever we like20:34
hub_capexactly20:34
SushilKMor if column does not works with then we can think to add in form of a row, my first idea is to have a date20:35
datsun180bso when do we start talking about the next version of the api so i can take a chainsaw to the users methods20:35
hub_capdatsun180b: :D20:35
datsun180bSushilKM: how about {'enabled': True, 'when': <ten minutes ago>}20:35
hub_capSushilKM: http://docs.rackspace.com/cdb/api/v1.0/cdb-devguide/content/GET_isRootEnabled__version___accountId__instances__instanceId__root_Database_Instances.html20:36
hub_caplook at the examples there20:36
hub_capwe do not discuss thigns in terms of how the cli outputs it20:36
hub_capwe show like how datsun180b is displaying it20:36
hub_capi guess i dont see any harm in adding the date20:36
hub_capand calling it, say, 'enabled'20:37
hub_capbut we shoudl get buyin from other people as well :)20:37
datsun180bwell if the date's there then clearly it's been enabled20:37
datsun180bsimilar to 'created' fields elsewhere20:37
hub_capsure but lets say for audit purposes20:37
hub_caplike if a user wants to know when his admin enabled it...?20:37
hub_capi dunno20:37
datsun180bwell in that case we better add a "by" field20:38
datsun180beven if it was done on behalf of another user20:38
datsun180band on that note why not slide all the way down the slippery slope and keep the user-agent, and i'm being serious btw20:38
hub_capdatsun180b: we already have the date yo, we can display that :)20:39
datsun180bwell if you want to go full audit20:39
hub_capand we dont allow trusts / impersonation20:39
hub_capso we cant do 'by'20:39
datsun180b_yet_20:39
hub_capi think keystone v3 can20:39
SushilKMwe have the dates in the tables20:39
datsun180bthat's true20:39
hub_capbut i dont kjnwo fo sure20:39
hub_capi tend to not kjnwo things, in general20:39
datsun180bone must first unkjnwo everying before one can truly begin to kjnwo oneself20:40
datsun180btypos abound20:40
datsun180bwell unless i'm mistaken SushilKM the rule i've seen so far is you can't remove anything from a response or add new requirements to a request20:41
SushilKMhey hub_cap r u playing with ur kjnwoledge :P20:41
datsun180bcompatibility is the concern20:43
ViswaVSushilKM: the data is there in the table, the mgmt api returns it, are you only asking whether to enhance to cli output to also show an extra column with the date information  (to know when it was enabled on? ) ?20:44
ViswaVfor examples of CLI showing more than two columns look at "nova list" output.20:44
ViswaVIt shows 6 columns20:44
openstackgerritPaul Lodronio proposed a change to openstack/trove: Adding additional datastore tests  https://review.openstack.org/7029620:45
datsun180bcool, there you go20:46
SushilKMi wud say yes @VishwaV, it could be column or a row but wanted to see the date as a user ....20:47
ViswaVSushilKM:  The second part of your concern (which is why you want to show this 'enabled on' information) is because you wiped out the root user by logging into DB in the background….and the trove root-show does not reflect that.  Not sure if that is a valid thing to 'sync' up to trove DB.  We do report back service status…. but root user status… probably not.  The same thing probably applies for DB … you can "trove database-create"  and20:49
ViswaV then in the background go behind the scenes and delete the db from mysql. I don't think "trove database-list" will probably still show you that db which no longer exists in the mysql now. Should it reflect the accurate state for operations done outside the context of Trove? I donno...20:49
ViswaVSushilKM:  It should be a column since it is 'peer' field to the others coming from the same table.20:50
datsun180bdbs and users and grants are all pulled from the instance, we don't store them in a second place20:50
datsun180bif you delete a user or db you delete it20:50
SushilKMur point about databases create-delete-list is fine ... but with root what happens is i can do anything in background and do a cleanup, but the provider needs to ensure and suggest that root was enabled20:51
SushilKMwhich currently show root api does20:51
datsun180bthe root history is kept as a table on the host specifically to prevent someone from enabling root, mucking about, and then 'disabling' root20:51
SushilKMwanted it to show the date also about when was it enabled20:52
ViswaVdatsun180b:  makes sense about the databases, users.20:52
*** demorris has quit IRC20:52
*** Barker has quit IRC20:54
*** mattgriffin has quit IRC20:54
ViswaVOn contrary example to SushilKM's situation…… if someone accidentally (or purposefully) enabled root user after directly logged into DB instance and not using trove… the trove root-show I am guessing would not reflect that fact and give out false info (that it is not enabled) , thusly not giving a key insight to DB admins on a critical hole that was left open (accidentally or willfully) on their DB instance.20:55
*** jimbobhickville has quit IRC20:55
datsun180bsorry, got to take off. you guys sound like you've got a handle on things20:56
*** datsun180b has quit IRC20:56
ViswaVShould the guest agent status monitoring , actively monitor all root users and report them back on a periodic basis?20:56
amcrnthere's already been discussions on having a true root enabled history (multiple rows vs. updating a single), and there's also been discussion on unifying created/updated/deleted_at across the tables to provide a consistent experience20:56
amcrnnot sure if they made it into bps/issues though20:56
*** Ranjitha has quit IRC20:57
SushilKMone cannot enable directly the root user20:57
SushilKMi suppose that20:57
*** ViswaV has quit IRC20:57
*** ViswaV has joined #openstack-trove20:58
ViswaVamcrn:  what about active monitoring of root users (by the guest agents) to monitor/detect root (or other) user creations not done via trove… is there any value in such a feature?20:58
*** demorris has joined #openstack-trove20:58
amcrnViswaV: i don't see any, but i haven't heard anyone ask for it20:59
ViswaVok20:59
*** amytron has joined #openstack-trove20:59
*** denis_makogon_ has joined #openstack-trove21:00
*** ViswaV has quit IRC21:00
*** denis_makogon has quit IRC21:01
*** denis_makogon_ is now known as denis_makogon21:01
denis_makogoni'm in21:01
*** ViswaV has joined #openstack-trove21:01
*** dmakogon_ has joined #openstack-trove21:01
*** ViswaV has quit IRC21:02
*** amrith has quit IRC21:02
*** ViswaV has joined #openstack-trove21:03
*** amrith has joined #openstack-trove21:03
denis_makogonvipul, SlickNik , ping, i'd like to talk about https://review.openstack.org/#/c/70773/21:04
*** Barker has joined #openstack-trove21:05
denis_makogonimsplitbit, ping21:06
vipuldenis_makogon21:06
vipuldenis_makogon: what's up21:06
denis_makogongoodday21:06
denis_makogonnice 2 see you here21:06
vipullikewise denis_makogon :)21:06
denis_makogonvipul, i hope you read last comments21:06
SlickNikdenis_makogon: Sure, let me check the review.21:07
denis_makogonyes, sure21:07
SlickNikSo denis_makogon: I'm trying to understand what's driving the requirement for these validators.21:08
*** mattgriffin has joined #openstack-trove21:09
denis_makogonSlickNik, basicaly validation based upon mysql models21:09
denis_makogonlike User21:10
denis_makogonSchema21:10
SlickNikYou're adding validators for redis; but then they're not really needed or implemented for redis. (All they are doing is returning None).21:10
denis_makogonYes21:11
*** amytron has quit IRC21:11
SlickNikSo then I'm not entirely sure what the point of the change is.21:11
vipulI still feel like this sort of datastore specific validation should not be a concern of the Trove API -- leaving it further down at the guest allows a deployer to override what is considered valid21:11
denis_makogonredis doesnt support users/schemes21:11
*** mattgriffin has quit IRC21:11
denis_makogonvipul, as i remember we decided to keep guest simple21:11
SlickNikdenis_makogon: If redis doesn't support it, why add an artificial construct (validators) for it?21:12
denis_makogonSlickNik, before capabilities, users are allowed to pass any data to API service21:12
vipulsure but the sort of validation that we do at the API layer should be json schema based.. nothing more21:12
*** ViswaV has quit IRC21:12
vipulif you want to make a change to the json schema, then i might be ok with that21:13
denis_makogonand without pluggablity create call would fail21:13
*** ViswaV has joined #openstack-trove21:13
vipulbut we need to provide an easy way to extend what is considered valid21:13
denis_makogonif there's incorrect format for users/schemes21:13
SlickNikSure, and the datastore can decide to honor the extension args or not depending on whether it supports it or not.21:13
denis_makogonthat is why i made such change, basicaly redis validation will pass in any way, even if data is malformed'21:14
denis_makogonSlickNik, unfortunately, capabilities is far-far away from now21:14
denis_makogonnot even in I release21:15
SlickNikdenis_makogon: How would you consider this malformed data. It would be an extra, unsupported argument, but that hardly constitutes malformed data.21:15
*** jasonb365 has joined #openstack-trove21:15
SlickNikVipul, I tend to agree with you in that I think the datastore should decide whether it needs to do anything with this information or not. It's probably overkill to have a separate extension decide which arguments are supported for which datastores.21:18
denis_makogonSlickNik, each datastore will have a set of validators for ingress data21:18
SlickNikdenis_makogon: Why?21:19
denis_makogonSlickNik, because mysql already have them21:19
denis_makogonSlickNik, mysql validators will be the problem for mongo, postgressql users/schemes21:21
denis_makogonSlickNik, in general this topic came from unflexible extenstions21:21
denis_makogonusers/schemes21:21
denis_makogonhow is that possible to work with mongo users through mysql service21:22
denis_makogonsame problem with mysql validation/population on prepare call21:23
denis_makogoni mean create call21:23
SlickNikWe can cross that when we need to do mongo validation. I don't see a mongo validator in that changeset.21:23
vipulhow about refactoring this code to not validate at the API layer21:23
SlickNikRight now, redis doesn't _need_ validation, so this doesn't buy us anything.21:23
denis_makogonvipul, how ?21:24
vipulit's actually pretty bad right now.. the extensions.mysql.common.populate_validated_databases() uses the guest agent models to validate user name21:24
vipulwhich means that once guest is split out.. this code will need to be duplicated21:24
vipulso let's not validate the username at the API layer.. and let's defer the validation to the Guest..21:24
SlickNikYeah, I agree vipul. I think we need to think about how to support this per datastore and not as extensions (common across datastores).21:25
SlickNikAnd the easiest way to support this per datastore is to actually have the datastore (guestagent) pieces do the validation.21:25
denis_makogonSlickNik, so, you mean to pass data from cli through api, taskmanager to guest without any validations ?21:26
vipulSlickNik, denis_makogon: the only side effect is on the create all-in-one call where we might fail to create due to invalid names21:26
vipulshould that be an error or just partially provisioned21:27
hub_capthis is why we should just remove users21:27
hub_cap:)21:27
denis_makogonseems like it should be partially provisioned21:27
*** jcooley_ has quit IRC21:28
denis_makogonhub_cap, and schemes =)21:28
hub_cap:)21:28
hub_capbut that cant happen for a while21:28
hub_capwe just wont put em in the v2 api i think heh21:28
denis_makogonyeah21:28
denis_makogonal least 2 release cycles21:28
denis_makogonhub_cap, i agree21:29
*** jcooley_ has joined #openstack-trove21:29
denis_makogonit would be easier to drop them from guest21:29
denis_makogoni know we talked about this topic in general, but what do  you think about this one https://review.openstack.org/#/c/70742/ ?21:30
denis_makogonwithout taking into account future capabilities21:31
denis_makogonthis two reviews are related to heat stuff in trove - https://review.openstack.org/#/c/67873/ |||| https://review.openstack.org/#/c/71040/21:32
hub_capwell denis_makogon i wonder, why should we continue to develop on the extensions if we all know we are removing it?21:32
hub_capaka, shoudl we ever have a c* /users or a mongo /users21:32
hub_capespecially if we are going to remove future functionality21:32
denis_makogonhub_cap, c* would never have users =)21:33
denis_makogonhub_cap, but it's in future21:33
kevinconwaydenis_makogon: cassandra has user/pass auth21:33
denis_makogonbut now it would cause error21:33
denis_makogonkevinconway, have you tried to register a user in cassandra ?21:33
kevinconwayyou mean edit YAML?21:33
hub_capdenis_makogon: thats why im saying to u, if nothing else has users, why make it pluggable?21:34
*** Ranjitha has joined #openstack-trove21:34
hub_capthats just more code to make something we will never use21:34
denis_makogonkevinconway, not yaml, access.properties, security.properties21:34
kevinconwayits a flat file with USER=PASS21:34
kevinconwayjust curious why you don't use it is all21:35
denis_makogonkevinconway, after each addition server _must_ be restarted21:35
kevinconwayso it's not that cassandra doesn't *have* users. you just don't want to use them?21:35
denis_makogonkevinconway, in production cassandra ACL organized with LDAP, EC2, Trusts21:35
*** amrith has quit IRC21:36
denis_makogonkevinconway, have you ever seen production cassandra cluster deployment ? downtime is not acceptable21:36
denis_makogonand access.properties should be updated on each node21:36
denis_makogonsuppose you have 1k nodes21:37
kevinconwaydenis_makogon: easy, restart them all at once21:37
denis_makogonGossip protocol works only with data21:37
kevinconwaylike removing a bandage21:37
denis_makogonkevinconway, lol, this is not production way at all21:37
denis_makogondowntime is huge, data migration, version management will take a lot time21:38
*** amrith has joined #openstack-trove21:38
kevinconwayso it's that the user/pass auth is not used for cassandra except for testing21:38
denis_makogonyes21:38
denis_makogonsimple auth never used in production21:39
kevinconwaywhat is the default auth system then?21:39
kevinconwayif i created a trove cassandra, how would i get in?21:39
denis_makogonit accepts all connections21:39
kevinconwaywow, so *no* auth21:39
denis_makogonuse LDAP21:40
denis_makogonthats all21:40
kevinconwayso is it fair to say that cassandra can't have users at all?21:40
kevinconwaywhat if i really wanted it and made the user calls pull from and save to LDAP?21:40
denis_makogonanyway, production grade cluster deployment doesn't use cassandra ACL, because it bad21:43
denis_makogonproduction also accepts firewall based access21:44
denis_makogonhub_cap, so, you say leave it as it is before it dropped ?21:45
hub_capdenis_makogon: the extensions stuff?21:45
denis_makogonhub_cap, yeag21:45
denis_makogonyeah21:45
hub_capid rather it _fixed_ to be like other extensions21:45
hub_capaka21:45
hub_capfix the common code21:45
hub_capthat runs / exposes / turns on/off extensions21:46
hub_capnova/cinder/etc.. have a good plugin model21:46
hub_capbut i dont want to really tackle that before other teams have tackled wsme21:46
kevinconwayare db calls an extension like users?21:46
denis_makogonyes21:47
hub_capya21:47
kevinconwayand our plan is to keep users and db extensions?21:47
kevinconwaynot make them part of the core api?21:47
denis_makogonkevinconway, yes, until API v221:47
denis_makogonkevinconway, no, they are extensions21:47
denis_makogonkevinconway, DBaaS should not deal with users/schemes21:48
denis_makogonkevinconway, take a look at RDS21:48
denis_makogonand take a look at DynamoDB21:48
kevinconwayhub_cap: i'm trying really hard not to talk about this21:48
hub_capkevinconway: i know :)21:48
hub_caplets go w/ dont toucn anything till v21:48
hub_capv221:48
hub_capwe can discuss it all in the future :)21:48
kevinconwayyeah i've got no complain with extensions in v121:49
denis_makogonbut the future is far away =)21:49
denis_makogonit means that i need to abandon this patches, sad =(21:49
denis_makogonhub_cap, any luck with mongo/cassandra testing ?21:51
amcrndenis_makogon: i'm seeing prepare() finish, but it's still flipping to error for Cassandra21:51
denis_makogonand how about enabling gating for test group21:51
denis_makogonamcrn, link ?21:51
denis_makogonamcrn, could you please post a log file21:52
denis_makogonamcrn, which flavor did you used ?21:53
amcrnhttps://gist.github.com/anonymous/f49a27fc75adfb682d2921:55
amcrnmy first hunch is the timeout is the problem21:55
denis_makogonamcrn, no21:55
denis_makogonplease post /var/log/cassandra/system21:56
denis_makogon/var/log/cassandra/system.log21:56
*** demorris has quit IRC21:57
*** doug_shelley66 has quit IRC21:57
denis_makogonamcrn, so ?21:59
denis_makogondue to slow env, cassandra service getting up slowly21:59
denis_makogonhow many RAM did you reserve for redstack VM ?22:00
amcrnsee my truncated reply to the original gist, cassandra came up just fine22:00
denis_makogoninstance should be ACTIVE22:00
denis_makogonthere's no stacktraces, guest didn't marked instance with ERROR22:01
denis_makogonexec timeout doesn't causes exceptions, it's only timeout22:02
denis_makogoni'd suggest to reserv for redstack VM at leat 8GB RAM or above22:03
denis_makogonwith 2 CPU cores22:03
hub_caphttp://developer.rackspace.com/blog/welcome-to-performance-cloud-servers-have-some-benchmarks.html22:04
hub_capi use Performance1-8 denis_makogon22:04
hub_capthas good eh? 8gb, 8 vcpu22:04
vgnbkrSorry, just catching up, but thought I'd throw in my $0.02 about the user thing.22:05
*** shakayumi has joined #openstack-trove22:05
hub_capvgnbkr: shoot :)22:05
vgnbkrSeems like a lot of the friction is because the issue isn't really about users.  Users can be managed by third party tools.22:05
* hub_cap runs, arms flailing22:05
kevinconway...22:05
hub_capfor sure vgnbkr22:05
vgnbkrThe real issue is about access control.  For mysql, access may be controlled by users, but for other databases, other access methods are required.22:06
denis_makogonvgnbkr, agreed22:06
hub_capso the bigger issue22:06
hub_capis22:06
hub_caphow do we allow a managed service by just giving out _root_ users22:06
hub_capaka its hard to provide a SLA22:06
hub_capnow im on you guy's side, but that will be the arguement to overcome22:07
vgnbkrTrove would need a mechanism to prevent a Cassandra db from being "open to the public" upon creation.22:07
hub_capthats the higest level arguement, aka, how do we provide a sla and a managed datastore giving root access22:07
hub_capsure but if i give u root mysql, u can screw things up and make, say, automated backup stop working22:07
*** michael-yu has quit IRC22:07
hub_capso u end up having a hard to support sla22:07
hub_capagain, im w/ you but im arguing the _other_ side ;)22:07
vgnbkrCould it be that for mysql, trove just manages root and leaves it to the dba to manage users.  For some dbs, trove might manage by controlling security group access?22:09
*** pdmars has quit IRC22:09
denis_makogonvgnbkr, security groups already managed by trove22:10
hub_capvgnbkr: sure, thats what ive proposed before22:11
hub_capand some agree w me, and some dont :)22:11
vgnbkrdenis_makogon: trove "manages" security groups, or allows one to be attached to the nova instance?22:11
vgnbkr(and I'm not saying one is right, just asking)22:11
denis_makogonvgnbkr, it creates and attaches to instances22:11
*** shakayumi has quit IRC22:11
denis_makogonvgnbkr, we call it association22:12
kevinconway(-_-)22:12
vgnbkrdenis_makogon: so how does trove know (at present) who to restrict access to?22:12
denis_makogonvgnbkr, cidr and ports22:13
vgnbkrBut, anyways, it sounds like I'm rehashing something that was covered before.  Didn't mean to do that.  Sorry all.22:13
*** jcru has quit IRC22:15
denis_makogonhub_cap, let me know with the results of testing, please22:15
hub_capyup ill test again tonight denis_makogon22:18
vgnbkrWas just chatting with the guys around the office.  When is the last time that anyone ever saw a database with more than one user (i.e., the one that the web server connects to)?22:27
vgnbkrFor DBaaS as databases are used in modern deployments (ORM typically), are users even relevant any more?22:29
hub_capvgnbkr: a TON22:31
hub_capread only users for reportin22:31
hub_capor access to only certian tables for non priv'd users22:31
vgnbkrI couldn't remember seeing users used for many years.  Asked around the office - all our customers just had one account.22:32
*** Ranjitha has quit IRC22:32
vgnbkrFor access to certain tables, is it in the trove plan to add access controls by table?22:33
denis_makogonvgnbkr, no, this is not DBaaS functionality22:33
*** doug_shelley66 has joined #openstack-trove22:34
denis_makogonvgnbkr, maybe you need to search for OpenStack MangetoDB22:34
denis_makogonit's NoSQL key-value storage22:34
denis_makogonwith HTTP interface22:35
denis_makogonits almost the same as Amazon DynamoDB22:35
vgnbkrThe point that I was getting at is that if the objective is to offer a certain SLA, there must be a path.  Does support for multiple users need to be on that path?22:36
kevinconwaydenis_makogon: there you go the the "A" word again22:36
*** Ranjitha has joined #openstack-trove22:36
denis_makogonkevinconway, yes, i could use kumu logic example22:36
vgnbkrAren't most people using a cloud DBaaS just going to point their Apache/PHP at it?  Are multiple users necessary for that use case?22:38
denis_makogonkevinconway, AWS is the greates stack of cloud services, we need to keep an eye on it, all the time22:38
denis_makogonvgnbkr, it depens on how application interracts with DB22:38
vgnbkrAbsolutely.22:39
denis_makogonvgnbkr, but mostly, no22:39
*** michael-yu has joined #openstack-trove22:39
vgnbkrBut if we're not going to provide access to access controls, what would people do with separate users?22:39
denis_makogonvgnbkr, twitter is a good example22:40
*** Barker has quit IRC22:40
vgnbkrdenis_makogon: can you provide a short description of why twitter is a good example (I don't know what you're getting at).22:41
kevinconwaytwitter uses a database22:41
denis_makogoni mean single user access22:41
kevinconwayQED22:41
vgnbkrAh, sorry, I thought you meant twitter used multiple users.22:42
*** jasonb365 has quit IRC22:42
denis_makogonbackend is driver driven22:42
kevinconwayvgnbkr: multiple users is common in reporting/analytics databases22:42
*** jasonb365 has joined #openstack-trove22:43
vgnbkrkevinconway: is that because the reporting apps are given read only access?22:44
vipuleven for mysql I think that multiple users with potentially different grants is totally valid22:44
kevinconwaywell a lot of analytics that leverage RDBMs don't start with an app22:44
kevinconwayyou test/discover in sql22:45
kevinconwaythen move your findings over into a reporting app22:45
vipulyou may have a read-only slave you want to grant access to to a different app potentially22:45
kevinconwaydepending on the scope of the db you may have multiple reporting groups that need access to different subsets of data22:45
vgnbkrkevinconway: sure, but at that point wouldn't the dba have to open root access and go in and muck with grants anyways?22:46
vipulare we talking about reasons to keep user management in Trove or to remove it22:46
kevinconwayvipul: neither. just talking about use cases22:46
kevinconwayvgnbkr: you may also have multiple writers to the db that need write to only their portion22:46
kevinconwaylike using a trove instance to run an openstack deploy22:47
kevinconwaynova writes to nova schema while keystone writes to keystone schema22:47
vgnbkrkevinconway: agreed, but is that something that trove would ever be able to configure?22:47
kevinconwaysame db instance22:47
kevinconwayit does now22:47
vipulalso i would hesistate to go with 'let the DBA do it' type of cases, because the value add of a managed service like DBaaS is that you don't necessarily need DBAs to figure this stuff out22:47
openstackgerritA change was merged to openstack/python-troveclient: adds support for configurations management  https://review.openstack.org/5316922:48
kevinconwayoh neat, config mgmt is in22:48
vgnbkrI was just thinking about hub_cap's SLA comment, which is solid.  What if trove gave you just a write connect string and a read connect string by default with a high SLA.22:54
vgnbkrYou could click "Allow Root Access" and do whatever you needed, but the SLA dropped accordingly.22:55
hub_capvgnbkr: i think scenarios like that are worth exploring22:56
hub_capwhen we start gettin into v222:56
vgnbkrWould that unify the appearance of disparate dbs from a management perspective?22:56
*** mattgriffin has joined #openstack-trove22:57
vgnbkrOK, np.22:58
*** amrith has quit IRC22:59
cp16nethub_cap: btw i see that trove config group is approved it will require the trove-integration as well23:01
cp16netclient is merged already :)23:01
*** amrith has joined #openstack-trove23:02
*** amcrn has quit IRC23:03
*** amcrn has joined #openstack-trove23:06
hub_capcp16net: link23:16
hub_capvgnbkr: fwiw, i think thats a decent idea23:16
cp16nethub_cap: tim just approved23:18
cp16neti got +1123:18
cp16neti think thats a record23:18
SlickNikcp16net: nice23:19
SlickNikAre all pieces merged?23:19
SlickNikJust making sure rdjenkins doesn't keel over.23:19
cp16netSlickNik: they are about to be merged23:21
SlickNiksweet.23:22
openstackgerritA change was merged to openstack/trove-integration: changes to support configuration groups  https://review.openstack.org/5844523:22
cp16netOMG23:22
cp16netthere it is23:22
hub_cap:P23:22
hub_capwoop23:22
cp16netthat was fast23:22
cp16neti thought the merge took a while23:22
*** robertmyers has quit IRC23:25
*** jasonb365 has quit IRC23:25
SlickNikcp16net: trove-integration merges are super fast.23:32
SlickNikYou'll probably have to wait a little longer for the other patch. :)23:33
hub_capyea there is only a no-op gate for t-i23:33
hub_caplets just call it t-i23:33
hub_capor ti23:33
openstackgerritA change was merged to openstack/trove: adding configuration group support  https://review.openstack.org/5316823:33
hub_capt-i i think works23:33
*** kevinconway has quit IRC23:34
hub_capthoughts?23:34
SlickNikI'm down with that.23:34
*** jmontemayor has quit IRC23:35
*** plodronio has quit IRC23:35
*** jmontemayor has joined #openstack-trove23:35
*** yogesh has quit IRC23:36
*** jmontemayor has quit IRC23:39
hub_capword23:41
hub_caplets do it23:41
hub_caplets make it a thing23:41
*** denis_makogon has quit IRC23:41
hub_capt-i is how we refer to trove-integration from now on23:41
hub_capyeesh, another fresh sync of offlineimap... /me crys23:42
hub_capand leaves for ~6 hrs23:42
hub_capheh23:42
SlickNikheh, I know that feeling23:42
*** tanisdl has quit IRC23:47
*** amrith has quit IRC23:48
*** Barker has joined #openstack-trove23:49
*** Barker has quit IRC23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!