Monday, 2014-05-19

« Sunday, 2014-05-18 Index Tuesday, 2014-05-20 »
*** lifeless has joined #openstack-trove00:07
*** eghobo has quit IRC00:37
*** erkules_ has joined #openstack-trove01:04
*** erkules has quit IRC01:06
*** nosnos has joined #openstack-trove01:41
*** achampion has joined #openstack-trove01:58
*** ohms has joined #openstack-trove02:01
*** lifeless has quit IRC02:16
*** matsuhashi has joined #openstack-trove02:17
*** lifeless has joined #openstack-trove02:24
*** jasonb365 has joined #openstack-trove02:31
*** timfreun1 is now known as timfreund02:54
*** ohms has quit IRC02:55
*** ohms has joined #openstack-trove02:56
*** ramishra has joined #openstack-trove02:57
*** ohms has left #openstack-trove03:02
*** mrsnivvel has joined #openstack-trove03:15
*** eghobo has joined #openstack-trove03:19
*** lnxnut has joined #openstack-trove03:30
*** coolsvap|afk is now known as coolsvap03:32
*** shalini_ has quit IRC03:38
*** eghobo has quit IRC03:39
*** nosnos has quit IRC03:51
*** lnxnut has quit IRC03:57
*** jasonb365 has quit IRC04:03
*** haomaiwa_ has joined #openstack-trove04:09
*** eghobo has joined #openstack-trove04:20
*** nosnos has joined #openstack-trove04:32
*** ramishra has quit IRC04:38
*** isviridov has joined #openstack-trove04:43
*** achampion has quit IRC04:57
*** isviridov is now known as isviridov_away05:12
*** yogeshmehra has joined #openstack-trove05:14
*** ramishra has joined #openstack-trove05:15
*** ramishra has quit IRC05:29
*** ramishra has joined #openstack-trove05:30
*** haomai___ has joined #openstack-trove05:30
*** haomaiwa_ has quit IRC05:33
*** ramishra has quit IRC05:34
*** yogeshmehra has quit IRC05:41
*** yogeshmehra has joined #openstack-trove05:52
*** achampion has joined #openstack-trove05:53
*** yogeshmehra has quit IRC05:55
openstackgerritShalini khandelwal proposed a change to openstack/trove: Initial support for Vertica Datastore in trove  https://review.openstack.org/9176105:56
*** yogeshmehra has joined #openstack-trove05:57
*** achampion has quit IRC05:58
*** yogeshmehra has quit IRC06:02
*** yogeshmehra has joined #openstack-trove06:08
*** flaper87|afk is now known as flaper8706:10
*** yogesh has joined #openstack-trove06:15
*** yogesh has quit IRC06:21
*** matsuhashi has quit IRC06:25
*** matsuhashi has joined #openstack-trove06:28
*** john3213 has joined #openstack-trove06:29
openstackgerritOpenStack Proposal Bot proposed a change to openstack/trove: Imported Translations from Transifex  https://review.openstack.org/9321906:30
*** Longgeek has joined #openstack-trove06:33
*** john3213 has left #openstack-trove06:34
openstackgerritPradeep Kumar Chandani proposed a change to openstack/trove-integration: Initial support for Vertica Datastore in trove  https://review.openstack.org/8980406:39
*** eghobo has quit IRC06:40
*** eghobo has joined #openstack-trove06:40
*** denis_makogon has joined #openstack-trove06:44
*** eguz has joined #openstack-trove06:57
*** eghobo has quit IRC06:57
*** eguz has quit IRC06:59
*** erkules_ is now known as erkules07:29
*** ramishra has joined #openstack-trove07:39
*** ramishra has quit IRC07:57
openstackgerritDenis M. proposed a change to openstack/python-troveclient: Fix shell view for secgroup-list  https://review.openstack.org/8531407:59
*** yogeshmehra has quit IRC08:29
*** Longgeek has quit IRC08:40
*** ramishra has joined #openstack-trove08:50
*** GoT has joined #openstack-trove08:59
*** Longgeek has joined #openstack-trove09:10
*** Longgeek has quit IRC09:13
*** Longgeek has joined #openstack-trove09:42
*** matsuhashi has quit IRC09:50
*** ramishra has quit IRC10:03
*** coolsvap is now known as coolsvap|afk10:16
*** flaper87 is now known as flaper87|afk11:04
*** flaper87|afk is now known as flaper8711:05
*** lnxnut has joined #openstack-trove11:13
*** nosnos has quit IRC11:21
*** lnxnut has quit IRC11:24
Longgeekhi, morning.11:25
*** pdmars has joined #openstack-trove12:15
*** miqui_ has joined #openstack-trove12:21
*** kevinconway has joined #openstack-trove12:30
*** Barker has joined #openstack-trove12:34
*** sgotliv has joined #openstack-trove12:36
*** isviridov_away is now known as isviridov12:36
*** Barker has quit IRC12:39
*** Barker has joined #openstack-trove12:42
*** haomai___ has quit IRC12:46
*** haomaiwang has joined #openstack-trove12:46
*** radez_g0n3 is now known as radez13:10
*** jcru has joined #openstack-trove13:19
openstackgerritDoug Shelley proposed a change to openstack/trove: Make config attach/detach language consistent  https://review.openstack.org/9121913:27
*** imsplitbit has joined #openstack-trove13:38
*** robertmy_ has joined #openstack-trove13:43
*** robertmyers has joined #openstack-trove13:47
*** robertmy_ has quit IRC13:48
*** robertmyers has quit IRC13:52
*** Barker has quit IRC13:56
*** achampion has joined #openstack-trove13:58
*** robertmyers has joined #openstack-trove14:01
*** rwsu has joined #openstack-trove14:06
*** lnxnut has joined #openstack-trove14:14
*** mattgriffin has joined #openstack-trove14:16
*** ramishra has joined #openstack-trove14:27
denis_makogonhi 2 all. i'm back and ready to do some magic =)14:33
*** amytron has joined #openstack-trove14:35
*** grapex has joined #openstack-trove14:41
*** lnxnut is now known as hipster14:45
*** Barker has joined #openstack-trove14:47
*** Barker has quit IRC14:54
*** thedodd has joined #openstack-trove14:56
*** Barker has joined #openstack-trove14:58
miqui_hi 2 all, who is current ptl?15:08
openstackgerriticcha-sethi proposed a change to openstack/trove: Include datastore version details in datastore calls  https://review.openstack.org/9166515:08
*** hipster has quit IRC15:08
*** mattgriffin has quit IRC15:10
*** mattgriffin has joined #openstack-trove15:12
iccha1woohoo, hope u had a good trip back denis_makogon15:15
iccha1miqui_: SlickNik is the ptl15:15
miqui_iccha1: thanks...15:15
*** ramishra has quit IRC15:17
denis_makogoniccha1, hey-hey, yeah, i arrived this moring15:18
denis_makogoniccha1, it was god-damn-long-way-home15:18
denis_makogoniccha1, http://cs616416.vk.me/v616416215/d78b/ct0jNit3UTE.jpg15:19
cp16netnice15:21
denis_makogoncp16net, hey =)15:23
cp16netdenis_makogon: glad to hear you made it back15:23
denis_makogonit took like 23h flight and 8h travel from Kiev to Kharkiv15:23
*** ramishra has joined #openstack-trove15:23
openstackgerritChristian Berendt proposed a change to openstack/python-troveclient: use logging function parameters instead of string format arguments  https://review.openstack.org/9420915:24
openstackgerriticcha-sethi proposed a change to openstack/trove: Allow users the ability to update the instance name  https://review.openstack.org/9270115:30
*** sgotliv has quit IRC15:32
openstackgerritChristian Berendt proposed a change to openstack/python-troveclient: replace string format arguments with function parameters  https://review.openstack.org/9420915:34
iccha1hey dougshelley66 based on your feedback i updated the blueprint and the wiki to include that PATCH can change configuration as well https://blueprints.launchpad.net/trove/+spec/update-instance-name15:34
*** ramishra has quit IRC15:36
openstackgerritChristian Berendt proposed a change to openstack/python-troveclient: replace string format arguments with function parameters  https://review.openstack.org/9420915:37
*** igor_ has joined #openstack-trove15:37
*** denis_makogon has quit IRC15:49
*** dmakogon has joined #openstack-trove15:49
*** dmakogon is now known as denis_makogon15:49
denis_makogonvgnbkr, ping15:50
amrithdenis_makogon, it is a holiday in canada today ...15:51
denis_makogonamrith, thanks15:51
openstackgerritChristian Berendt proposed a change to openstack/trove: replace string format arguments with function parameters  https://review.openstack.org/9421415:56
*** eghobo has joined #openstack-trove15:57
*** Barker has quit IRC16:03
*** ramishra has joined #openstack-trove16:06
*** jmontemayor has joined #openstack-trove16:07
*** Barker has joined #openstack-trove16:07
*** jasonb365 has joined #openstack-trove16:07
*** jmontemayor_ has joined #openstack-trove16:08
*** jmontemayor has quit IRC16:11
*** jasonb365 has quit IRC16:12
*** jasonb365 has joined #openstack-trove16:12
*** Barker has quit IRC16:16
*** ramishra has quit IRC16:16
*** hipster has joined #openstack-trove16:18
*** Barker has joined #openstack-trove16:20
*** ViswaV has joined #openstack-trove16:23
openstackgerriticcha-sethi proposed a change to openstack/trove: Include datastore version details in datastore calls Implements: bp list-datastore-type-and-versions  https://review.openstack.org/9166516:25
*** ViswaV_ has joined #openstack-trove16:25
denis_makogoniccha1, ping16:26
iccha1hey denis_makogon16:27
denis_makogoniccha1, as i can recall, "Implements:" section should be placed right after commit message, and "bp" should extended into "blueprint"16:27
*** ViswaV has quit IRC16:28
denis_makogoniccha1, something like that https://wiki.openstack.org/wiki/GitCommitMessages#Example_1_216:28
openstackgerriticcha-sethi proposed a change to openstack/trove: Include datastore version details in datastore calls  https://review.openstack.org/9166516:29
openstackgerritCraig Vyvial proposed a change to openstack/trove: Consider datastore version when generating configs  https://review.openstack.org/9155616:29
denis_makogoniccha1, thanks =)16:30
iccha1anytime!16:31
cp16netdenis_makogon: btw i dont think it really matter where the the blueprint comes in the commit message as long as it shows it linked in gerrit16:36
denis_makogoncp16net, yeah, i know that, but since there's some kind of policy shouldn't we follow that ?16:37
cp16netdenis_makogon: usually it comes toward the bottom but the most important thing about the commit message and gerrit is showing it linked to launchpad16:37
cp16netdenis_makogon: i dont think we need to mandate it in a certain area since there is not a way to validate it other than by sight16:39
cp16netwe talked about that in the review chat we had16:39
denis_makogoncp16net, i remember that16:40
denis_makogonthat's why i asked about changing commit message body without any comments at review and -1 it16:42
*** igor_ has quit IRC16:45
*** igor_ has joined #openstack-trove16:45
*** jasonb365 has quit IRC16:46
*** jasonb365 has joined #openstack-trove16:48
*** harlowja has joined #openstack-trove16:48
*** igor_ has quit IRC16:50
*** Barker has quit IRC16:50
*** jasonb365 has quit IRC16:51
*** jmontemayor_ has quit IRC16:51
*** haomaiwang has quit IRC17:02
mat-loweryForgive me if this has already been answered a hundred times but what is the state of Tempest? I see there are three tests run and one unmerged patch set. None of them handle instance creation. What are the prerequisites to adding some instance-related tests there?17:04
*** ramashri has joined #openstack-trove17:04
vipulmat-lowery: https://etherpad.openstack.org/p/JDS-Trove-TestingTrove17:05
vipulmat-lowery: we had a session about this at the summit, a couple of patches to build a guest image are things we are waiting on17:06
SlickNikmat-lowery: These are the patches in question:17:07
SlickNik    - https://review.openstack.org/#/c/92755/17:07
SlickNik    - https://review.openstack.org/#/c/91487/17:07
mat-loweryThanks vipul and SlickNik.17:09
*** igor_ has joined #openstack-trove17:16
*** ramishra has joined #openstack-trove17:17
openstackgerriticcha-sethi proposed a change to openstack/trove: Include datastore version details in datastore calls  https://review.openstack.org/9166517:18
*** ramishra has quit IRC17:18
*** Longgeek has quit IRC17:19
*** igor_ has quit IRC17:21
*** jasonb365 has joined #openstack-trove17:21
*** amcrn has joined #openstack-trove17:26
*** Barker has joined #openstack-trove17:27
*** yogeshmehra has joined #openstack-trove17:28
*** thedodd has quit IRC17:29
denis_makogonSlickNik, hey, do we have a BP meeting today?17:30
SlickNikdenis_makogon: Yes, we do. In a half hour.17:31
denis_makogonSlickNik, thanks17:31
*** Barker has quit IRC17:42
*** Barker has joined #openstack-trove17:44
*** michael-yu has joined #openstack-trove17:49
*** jmontemayor has joined #openstack-trove17:49
*** jmontemayor has quit IRC17:49
*** jmontemayor has joined #openstack-trove17:49
*** saurabhs has joined #openstack-trove17:50
*** harlowja has quit IRC17:50
*** harlowja has joined #openstack-trove17:50
*** jmontemayor_ has joined #openstack-trove17:52
*** jmontemayor has quit IRC17:56
SlickNik#startmeeting trove-bp-review18:00
openstackMeeting started Mon May 19 18:00:03 2014 UTC and is due to finish in 60 minutes.  The chair is SlickNik. Information about MeetBot at http://wiki.debian.org/MeetBot.18:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:00
*** harlowja has quit IRC18:00
openstackThe meeting name has been set to 'trove_bp_review'18:00
*** harlowja has joined #openstack-trove18:00
iccha1o/18:00
SlickNikGiving folks a few minutes to trickle in.18:01
amrith........ o/18:01
vipul\o/18:01
denis_makogono/18:01
SlickNikAgenda at:18:01
amcrno/18:01
SlickNik#link https://wiki.openstack.org/wiki/Meetings/TroveBPMeeting18:01
grapexo/18:01
robertmyerso/18:01
kevinconwayo/18:02
SlickNik#topic Trove client for cross-region-backup18:02
amriththis bp is marked as approved18:02
*** yidclare has joined #openstack-trove18:02
SlickNikesmute: around?18:02
SlickNikamrith: Yes, this was approved earlier.18:03
SlickNikI was talking to esmute about why he added it to the bp queue.18:03
amcrnSlickNik: i had asked him to add it the queue prior to our clustering agreement at the summit; it was mostly pertaining to how region-awareness would work18:04
cp16netto make sure we are using the catalog to look up the endpoints?18:04
SlickNikamcrn: Yup, that's what he mentioned.18:04
amcrnthe concern was around whether "region" as a field would be the strategy we'd be moving forward with (vs. say namespacing)18:04
amcrnbut we're all aligned on that now, so it should be good to go18:05
juiceo/18:05
vipulhttps://wiki.openstack.org/wiki/Trove/Replication-And-Clustering-With-Nodes-518:05
vipulseems consistent with what esmute is doing18:05
SlickNikokay, amcrn. I don't see him around atm. I'll fill him in when he gets back.18:05
amcrnvipul: yep, so i think we can move onto the next agenda item18:06
SlickNikLet's move on.18:06
SlickNik#topic Add visibility filter to datastores18:06
denis_makogonseems very logical, as for me18:06
SlickNik#link https://blueprints.launchpad.net/trove/+spec/datastore-visibility18:06
iccha1Currently there is no way to hide datastores while keeping them active18:06
denis_makogonone question18:07
iccha1yes18:07
denis_makogonhow do you plan to hide one datastore from user A and show it to user B18:07
amcrndenis_makogon: it's binary: admin can see it, but user can't18:07
iccha1what amcrn saif18:07
iccha1*said18:07
vipuldo we plan to at some point do what glance does with images and make it visible to tenants?18:08
denis_makogonvipul, ++18:08
cp16netdoes the admin view show the extra details if the datastore is visible or not?18:08
iccha1yes the admin view shows everything18:08
iccha1and admin can change visibility18:08
denis_makogonthats actually i as asking for18:08
*** thedodd has joined #openstack-trove18:08
iccha1so this model can be later extednded to have members18:09
amrithis the intent to make the datastore only usable by the admin and not by other users?18:09
esmuteim here... reading18:09
iccha1here the datastore has no concept of ownership18:09
cp16netno its just to make the datastore "hidden" but usable if you know the uuid of the version18:09
cp16netto be used in a sort of "beta" stage18:10
iccha1the get call will still shwo the store18:10
amrithi guess I'm trying to understand why this is being implemented.18:10
amrithwhat problem are we solving, for whom?18:10
iccha1that way if u want only certain users to be able to access the datastore you can provide them with the uuid18:10
grapexTo have a "secret menu" of datastore types.18:10
amcrnamrith: one example why i'd really like this feature: i can deploy a new datastore (or version), and use my admin role to do a production smoke-test18:10
vipulyea, doesn't it seem better to introduce datastore visibility per tenant instead of simply hiding it?18:10
grapexLike ordering the skinless fried chicken at PopEyes.18:10
iccha1amrith: for exampkle you have a new datastore u want to test in production, but dont really want all the users to be able to access it yet18:10
denis_makogonvipul, ++18:11
amcrni'd vote for tenant as well18:11
amrithso is there a reason we are implementing this particular solution instead of a proper acl mechanism for tenants?18:11
amrithis expediency the reason?18:11
iccha1yes18:11
amrithwith the longer term intent being tenant based acls?18:11
denis_makogonit seems that we can extend admin role to use passive datastores for provisioning18:11
grapexamrith: I guess we could do it either way. In our experience if there's a feature that's merely hidden but not acl'd, no one will get made at you if they use it and it isn't perfect.18:11
denis_makogonno need to add another flag18:11
amrithok. how much harder would the cadilac be?18:12
vipulgrapex: the problem with this approach is if that ID got 'leaked' then anyone could potentially use it18:12
SlickNikIt depends on the use case.18:12
vipulwe could prevent usage with tenant based acl approach18:12
robertmyersvipul: +118:12
kevinconwayae70b2b0-1af3-4ad6-8a0d-112e2cb15a3718:12
grapexSlickNik: Right. For Rax as you can all tell we'd be ok, but sounds like the other parties here would run into problems18:12
kevinconwayoops sorry guys18:12
grapexkevinconway: DEAR GOD NO!18:13
kevinconwaydont use that uuid18:13
iccha1lol18:13
robertmyershahahaha18:13
denis_makogonwhy can't we just extend current implementation, that based upon passive/active datastores for admin tenant ?18:13
*** NehaV has joined #openstack-trove18:13
iccha1so we dont want to add tenant id for every datastore18:13
iccha1it becomes harder to add new customers18:13
iccha1in images, we had image members because the owner was resposible for the sharing18:14
kevinconwayyeah the datastores aren't user content though. they don't "own" datastores18:14
*** ranjitha has joined #openstack-trove18:14
denis_makogoniccha1, it seems that same approach is applicable here18:14
kevinconwayaren't we also missing a "role" concept here that would actually make ACL sane?18:15
vipulwe could take the galnce approach by implementing is_public, by default it is public.  Then we also add membership that manages non-public datastore ACL18:15
grapexkevinconway iccha1: good point18:15
iccha1denis_makogon: noone owns the datastore, then the admin has to add every sinfle tenant18:15
saurabhswe can do what nova flavor does, if a particular datastore is public it will be visible to everybody but if its private then you need to add tenant access explicitly18:15
iccha1yeah that makes sense18:15
grapexsaurabhs: Sounds like a good compromise18:15
denis_makogonsaurabhs, ++18:15
*** hipster has quit IRC18:15
denis_makogonsome sort of the black list18:16
iccha1white list :)18:16
vipuliccha1: +118:16
saurabhsand until you want to run that datastore as private keep it that way and once you are ready to go make it public and then nothing needs to be done more for every tenant18:16
cp16net+=118:16
robertmyers+118:16
amcrn+118:16
grapexcp16net: Are you now called cp17net?18:16
cp16netlol18:16
iccha1lol18:16
SlickNikI like that approach as well.18:16
*** igor_ has joined #openstack-trove18:16
grapexOr would that be cp16neu?18:17
SlickNikiccha1: Can you update the bp with details using this approach?18:17
iccha1will do SlickNik18:17
denis_makogonok, if it gonna be easier to maintain at production, then i'm up for the suggestion18:17
SlickNikiccha1: Once that's done, ping me / another core and we can go over it and approve.18:18
amrithso what was the decision? to use the approach of is_public and private?18:18
amrithlike glance?18:18
iccha1sure SlickNik . the concensus is public is vosible to all. for private u need to explicitly add tenant18:18
amriththanks for the clarification.18:19
SlickNikamrith: Yes, if it's private, you need to specify a tenant white list for access. If it's public, it's visible to all.18:19
amrith+118:19
amriththx18:19
SlickNikOkay, let's move on.18:19
SlickNik#topic Database log files manipulations18:19
SlickNik#link https://blueprints.launchpad.net/trove/+spec/dbinstance-log18:20
denis_makogonstage one was proposed, wiki was cleaned-up18:20
SlickNikdenis_makogon: I see that.18:21
juicedenis_makogon: should "allowed" be replaced with "enabled"18:21
denis_makogonStage 1 will cover pushing specific log file from a guest to Swift18:21
*** igor_ has quit IRC18:21
SlickNikdenis_makogon: I still have a couple of questions around some rough edges in the spec.18:22
denis_makogonSlickNik, which?18:22
SlickNikdenis_makogon: "datastore_log_files": "general_log, log_slow_queries, log-error"18:22
SlickNikWhy are the first two underscore, and the last one hyphen?18:22
juicedenis_makogon: never mind that is configuration is for something else18:22
denis_makogonSlickNik, it is a misspell (re-mark)18:23
esmutedenis_makogon: will the logs in swift be automatic deleted when instance gets deleted?18:23
SlickNikAlso can we have some better association with the log names, (use the default log filenames, perhaps?) rather than using arbitrary strings?18:23
*** jasonb365 has quit IRC18:24
denis_makogonSlickNik, everything should be underscore18:24
*** jmontemayor_ has quit IRC18:24
*** Barker has quit IRC18:24
amrithdenis_makogon, I would like to know how this feature you are implementing works with logrotate?18:24
denis_makogonamrith, log rotate is out of the stage 118:24
amrithok, is there a bp that lists the various stages?18:24
denis_makogonamrith, yes18:25
vipuldenis_makogon: so at the time when POST is received.. we upload just the current log file ?18:25
denis_makogonamrith, current BP describes Stage 118:25
denis_makogonvipul, yes18:25
amcrnthe last time this blueprint was brought up, there was quite a bit of concern surrounding the fact that the user will have no idea what timerange the current log contains18:25
denis_makogonSlickNik, what do you mean?18:25
amrithi echo the comment by amcrn (though I wasn't at the last review)18:26
amrithwhen you turn on general query logging, you could get a very short interval on a busy system18:26
amrithand that's not of much use18:27
amrithsimilar issues will exist with high freq logging on other data stores18:27
denis_makogonamcrn, its pretty hard to find out to which time range does the log responsive18:27
vipuli don't know what we could do about it though18:27
amrithI understand multiple iterations but do others feel that this limited v1 is useful enough to implement by itself18:27
vipuldo you want to inspect the first line.. and the last line and add it to the filename scheme or something?18:27
robertmyersit sure would be nice to have some way to view the logs and this seems like a good start18:28
vipulrobertmyers: +118:28
amrithvipul, not all files list date in the message, sometimes continuation lines won't have timestamps18:28
vipulour service is a black-box.. and this gives some visibility to users18:28
denis_makogonrobertmyers, +118:28
amrithrobertmyers, thx18:28
amcrnvipul: true, but it just seems odd that as a user you'll execute a request to get the log(s), hoping that they contain a certain time interval. not only that, the user will have no idea when it's been rotated.18:29
vipulamrith: good point.. another reason why we can't determin time range18:29
denis_makogonamrith, unfortunately with huge logs it's pretty hard to discover the actual time stamp18:29
amcrnin my opinion, there needs to be some sort of indication that the file has rotated18:29
*** eghobo has quit IRC18:29
amrithdenis_makogon, vipul ... not true18:29
kevinconwayshould the backup include all rolls of the same log file?18:29
amrithlogrotate can give you that information if you ask it nicely ;)18:29
cp16netyeah otherwise you will have a file with 0 lines in the worst case18:29
vipulI think in a phase 2 or something.. we could look at something like incremental log file uploads.. you provide the timestamp.. and we get you everything from that to now18:30
amrithso out of curiosity18:30
amrithwhy aren't we doing like RDS?18:30
amrithand exposing data in a table?18:30
kevinconwaydroppin' A bombs18:30
denis_makogonvipul, agredd18:30
denis_makogon*agreed18:30
amrithand for nosql stores exposing as a collection18:30
vipulamrith: can all datastores do that? write lines to a table instead?18:31
esmuteis the idea to display the log in a horizon interface, or just a simple file download from swift?18:31
amrithhttp://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_LogAccess.Concepts.MySQL.html18:31
amrithvipul, the link abov eis for mysql18:31
amrithsimilar for other RDBMS'18:31
denis_makogonesmute, simple download, since we're not going to use them inside Trove18:31
amrithfor nosql stores the data is exposed using a collection of some sort18:32
amrithme looking for a link18:32
* amrith looking for a link18:32
vipulamrith: that doesn't sound like they are just writing to a table..18:32
esmutedenis_makogon: how would you access them if the instance is deleted?18:32
robertmyersamrith: looks like you can do both ways18:32
robertmyersdownload file and view in a table18:33
denis_makogonesmute, you can go to swift panel and download them18:33
amrithwell, NoSQL stores have no tables. didn't you hear about the Oracle guy who went into the NoSQL bar in Atlanta and walked out because there were no tables?18:33
saurabhshow about we don't push anything to swift we keep it on the machine locally and let user read that with API and let user deal with taking the backup of the log if needed18:33
kevinconwayso what was wrong with just scooping up everything in the log dir included rolls?18:33
saurabhswe provide the API which allows user to read number of lines specified from the file18:33
vipulsaurabhs: that's a lot of crud to pump through our api18:33
SlickNikkevinconway: I think that's exactly what RDS does.18:33
amcrnspeaking of, since these are truly configuration parameters, why are parameters like long_query_time being handled outside of a configuration-group?18:33
iccha1the op maybe too huge18:33
denis_makogonvipul, ++18:33
saurabhsvipul: you can control how many lines you want to allow to be read at one time18:34
SlickNikkevinconway: example http://docs.aws.amazon.com/AmazonRDS/latest/APIReference//API_DescribeDBLogFiles.html18:34
vipulsaurabhs: sure.. but the first person to say give me 1 million.. will probably be worse than if they were to download the same object using swift18:34
cp16netand having a marker to tell where in the file you want to grab would be nice18:35
denis_makogonvipul, agreed, log pulling will be possible only through Swift storage18:35
cp16netbut not nessesary for first pass18:35
SlickNikSo here's my 2c on this.18:36
amrithdenis_makogon, I think I got the answers to my questions. and as robertmyers and vipul say this may be a good start. I do however agree with amcrn that this may be a little hard to use and should use configuration groups. <EOF>18:36
SlickNikI can definitely see this as valuable.18:36
kevinconwayi think we should avoid anything that requires us to write a log parsing agent and stream results through rabbit18:36
denis_makogonkevinconway, totally agree18:36
robertmyerskevinconway: +118:36
kevinconwayso does the first pass cover only the active log file or all log rolls in the directory as well?18:36
*** cweid has joined #openstack-trove18:37
SlickNikHowever, the current API details in the spec seem rather simplistic and don't address the logrotate issue.18:37
vipulkevinconway: we might as well zip everything up and upload all18:37
SlickNikSo do we want v1 to address the logrotated artifacts, or not?18:37
denis_makogonSlickNik, no, log rotation is for Stage 218:37
amcrnSlickNik: why not just have a file_created timestamp, that will at least hint towards a rotate, and it's good enough for a v118:37
robertmyersSlickNik: if we do the whole folder wont we get that?18:37
iccha1do all instances have log rotate set up?18:37
iccha1is this available to trove users?18:38
denis_makogoniccha1, for now - no18:38
vipulsome datastores do it automatically.. otherwise its up to the deployer18:38
SlickNikamcrn: +1 on a file created / last modified timestamp.18:38
denis_makogoniccha1, https://wiki.openstack.org/wiki/Trove/DBInstanceLogOperationV218:39
amcrnif we add the timestamps, then my only remaining concern is: why are we not using configuration-groups for configuration parameters18:39
denis_makogonSlickNik, seems valid to have those timestamps18:39
vipulamcrn: i don't get it18:39
SlickNikamcrn: which config params?18:40
denis_makogonvipul, i guess, amcrn meant: static configuration VS. configuration-groups18:40
vipulamcrn: oh i think i just got it.. to enable disable logs18:40
vipuli'm slow18:40
SlickNikvipul: thanks, that makes two of us.18:40
amcrnex: http://dev.mysql.com/doc/refman/5.5/en/server-system-variables.html#sysvar_long_query_time18:40
amcrnthis could technically be handled using configuration-groups18:40
kevinconwaywhich is sadly one second minimum…18:41
amrithSlickNik, ... is this review for v1 or v2? I just read the v2 spec and there are problems with the way logrotate is being proposed to be used.18:41
SlickNikamrith: This is for v1.18:41
denis_makogonamrith, this is V118:41
kevinconwayyeah lets just stick to the first draft18:41
amriththx, I'll hold off18:41
cp16neti think we are in agreement now?18:42
grapexQuick tangent: This is kind of a minute issue with the API get call for the list of logging files: seems like right now the datastore_log_files argument is a single string containing multiple things with commas, maybe that should be an array?18:42
grapex"datastore_log_files": "general_log, log_slow_queries, log-error" s/b "datastore_log_files": ["general_log", "log_slow_queries", "log-error"]18:42
denis_makogongrapex, it can be, it's still up to us to decide actual types18:43
vipulgrapex: +1 probably just an oversight18:43
vipulit should be an array denis_makogon18:43
cp16nettru18:43
denis_makogonvipul, get it18:43
kevinconwaybah, just add .split(',') on the guest. what could go wrong?18:43
cp16netkevinconway: forgot the .trim()18:44
cp16netDOH...18:44
denis_makogonfor the first iteration i would suggest to use static configuration against conf. groups18:44
kevinconwaydoh!18:44
SlickNikSo here's the summary I have. This BP needs to:18:44
SlickNik1.  be updated withcreated/modified timestamps18:44
SlickNik2. use existing config groups18:44
SlickNik3. include slight API modifications (underscore consistency, array of params)18:44
SlickNikdenis_makogon: Can you update the bp with this feedback?18:45
amrithSlickNik, would you elaborate on #1 please18:45
vipulfor #1 is that an API param?18:45
denis_makogonvipul, no, the part of the response18:45
SlickNikvipul / amrith: The actual created / modified time of the log as part of the response.18:45
SlickNiknot a param to the request.18:46
amrithSlickNik, that may be very hard to do.18:46
vipulit's already in the filename18:46
vipul         "locationURL" : "http://somewhere.com:PORT/dblogcontainer/{instance_id}/filename.timestamp"18:46
denis_makogonwhat about configuration files rendering ?18:46
kevinconwayyou mean the posix create/touch times?18:46
denis_makogonkevinconway, yes18:46
amcrnkevinconway: when i brought it up, that's what i meant, yes18:46
SlickNikamrith / vipul: something like the LastWritten here http://docs.aws.amazon.com/AmazonRDS/latest/APIReference//API_DescribeDBLogFiles.html18:46
amrithOh, not the timestamps on messages or the file on the trove system18:46
amrithok18:47
SlickNikkevinconway: yes18:47
*** hipster has joined #openstack-trove18:47
denis_makogonso, last words on that18:47
amrithwell, lastwritten will be hard but if he can do it, that would be nice18:47
denis_makogon#218:47
kevinconwaydo we need all those timestamps if we just grab the entire log dir?18:47
vipulamrith, SlickNik that's a request param..18:48
denis_makogonyou're saying that we should look over assigned conf group and look for the log entries in that ?18:48
vipuloh never mind.. it's in the example18:48
SlickNikyes, I meant the example.18:48
denis_makogonand then response to a user that there are some (or none) of the logs available for user ?18:48
denis_makogonwhy we can't just exclude log attributes from configuration groups ?18:49
vipulknock-knock.. this thing still on?18:49
SlickNikdenis_makogon: Sorry, I don't understand the question.18:49
denis_makogonSlickNik, could you please elaborate #2 ?18:49
SlickNikdenis_makogon: Let's chat about #2 immediately after the meeting.18:50
denis_makogonok18:50
denis_makogonlet's move on18:51
SlickNikdenis_makogon: I'd like to get another bp looked at here if possible.18:51
SlickNikThanks18:51
SlickNik#topic Pluggable conductor manager18:51
*** hipster has quit IRC18:51
SlickNikboden, around?18:51
grapexThis one seemed so simple too...18:51
amrithI'll email him and let him know about this meeting18:52
SlickNikgrapex: lol18:52
robertmyersI thought it already was pluggable?18:52
grapexSlickNik: Seriously we should just +1. :p18:52
robertmyersyou run a separate daemon18:53
denis_makogonrobertmyers, nope, manager is hardcoded inside the trove-conductor script18:53
SlickNikrobertmyers: I don't think that it is.18:53
robertmyersit can be anything18:53
vipulyes it seems liek what's in the BP should be min-bar for all future 'managers'18:53
grapexrobermyers: i kind of agree18:53
kevinconwayis there a way to _not_ run conductor to make room for a custom daemon?18:53
grapexBut I also see vipul's point. Its inconsistent to offer a Trove daemon without a pluggable manager18:53
grapexall the other managers in Trove and Nova seem to be pluggable18:53
grapexthough it is kind of overkill18:53
robertmyerskevinconway: yes, just write your own18:53
robertmyersand run it in place of the trove onw18:54
kevinconwayno, i mean is there a way to disable it18:54
cp16netyep18:54
robertmyerskevinconway: make a noop conductor18:55
robertmyersand run it18:55
grapexboden needs to show up for these and follow better blueprint conventions18:55
robertmyersdone18:55
vipuli think we should provide the plumbing in Trove to allow the actual thing to be swapped18:55
grapexI don't think there's a wiki for this18:55
vipulyes you can do it without even needing Trove.. but that's beyond the point18:55
iccha1it says i dont have permission to view it18:55
kevinconwayrobertmyers: the BP is because you can't do that18:55
* amrith takes action to send email to boden18:55
grapexthough it is incredibly simple and was easy to read.18:55
robertmyerswhere is the link?18:55
SlickNikrobertmyers: Yes, but then you have to write a whole new thing. As opposed to being able to write an impl that overrides only some of the functionality.18:55
grapexvipul SlickNik: +118:55
cp16net+118:56
SlickNik#link https://blueprints.launchpad.net/trove/+spec/pluggable-conductor-manager18:56
robertmyersSlickNik: -118:56
robertmyers:)18:56
cp16netlolz18:56
SlickNikI'm not saying we should do it.18:56
vipuli think we should just approve this one.. others disagree?18:56
SlickNikThis is an interesting point of view as well http://lists.openstack.org/pipermail/openstack-dev/2014-April/033898.html18:56
SlickNikvipul: I'd like to only do it once it has a sponsor (i.e. someone to commit on doing the work).18:57
vipulSlickNik: fair enough18:57
SlickNikSo I'm inclined to table it until when boden is actually around.18:57
denis_makogonit's a pretty simple task-to-do18:57
amrithSlickNik, ... email sent ...18:58
denis_makogonlike 10 mins18:58
amcrndenis_makogon: although simple, it set's a precedent that we might not want to18:58
vipuldenis_makogon: nothing takes just 10 minutes :P18:58
SlickNikOkay, I think that's all for today.18:58
SlickNikThanks all!18:58
SlickNik#endmeeting18:58
openstackMeeting ended Mon May 19 18:58:42 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:58
openstackMinutes:        http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-05-19-18.00.html18:58
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-05-19-18.00.txt18:58
openstackLog:            http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-05-19-18.00.log.html18:58
amrithlots of things take less than 10m to do and regret for a lifetime after ;)18:58
grapexThanks Slick!18:58
iccha1thanks SlickNik !18:58
amcrnthanks everyone18:58
cp16netthanks SlickNik18:58
vipulamrith: LOL18:58
denis_makogonSlickNik, can you please explain #2 ?18:59
*** eghobo has joined #openstack-trove18:59
SlickNikdenis_makogon: yes. So the idea was to tie in with config groups and see if the logs are actually available to download for the instance.19:00
SlickNikdenis_makogon: Since you can actually turn off logging / change the log-file locations through config-groups.19:00
denis_makogonSlickNik, seems valid19:01
SlickNikI take it that this was what amcrn was suggesting as well.19:01
*** ranjitha has quit IRC19:01
openstackgerritSaurabh Surana proposed a change to openstack/trove-integration: updating sources list as part of percona elements  https://review.openstack.org/9079119:01
amcrnSlickNik: correct19:01
denis_makogonSlickNik, do i need to add BP to another review, or i can ping any of cores to review and make a decision ?19:01
denis_makogon*after updating wiki page ?19:02
SlickNikdenis_makogon: ping me when you have updated the wiki. I'll bring it up to a couple of cores, and if it looks good / non-controversial we should be okay. If not, I'll add it to the BP meeting with the points to discuss. Sound good?19:03
denis_makogonSlickNik, sound like a good plan, thanks19:03
SlickNikdenis_makogon: Thank you!19:03
openstackgerritSaurabh Surana proposed a change to openstack/trove-integration: updating sources list as part of percona elements  https://review.openstack.org/9079119:04
*** ranjitha has joined #openstack-trove19:04
denis_makogonSlickNik, i'll try to do that until Thursday19:04
SlickNikdenis_makogon: Sounds good. Ping me on IRC once it's done.19:11
denis_makogonSlickNik, ok19:11
*** ranjitha has quit IRC19:17
*** igor_ has joined #openstack-trove19:17
*** hipster has joined #openstack-trove19:18
*** igor_ has quit IRC19:22
*** hipster has quit IRC19:23
iccha1SlickNik: updated https://blueprints.launchpad.net/trove/+spec/datastore-visibility19:28
iccha1cp16net: ^19:28
*** yidclare has quit IRC19:29
*** robertmy_ has joined #openstack-trove19:30
openstackgerritRamashri Umale proposed a change to openstack/trove: Fix prepare call for redis guest agent  https://review.openstack.org/8486319:31
*** robertmyers has quit IRC19:33
*** eguz has joined #openstack-trove19:37
*** eghobo has quit IRC19:41
*** radez is now known as radez_g0n319:43
*** michael-yu has quit IRC19:47
*** hipster has joined #openstack-trove19:47
*** hipster has quit IRC19:52
*** esp has quit IRC19:52
*** esp has joined #openstack-trove19:53
*** amcrn has quit IRC19:54
*** cp16net has quit IRC19:56
openstackgerritMat Lowery proposed a change to openstack/trove: Added support of resize-flavor to Redis datastore  https://review.openstack.org/8870919:57
*** amcrn has joined #openstack-trove20:00
*** harlowja has quit IRC20:01
*** cp16net has joined #openstack-trove20:01
*** harlowja has joined #openstack-trove20:02
*** Barker has joined #openstack-trove20:04
*** ViswaV_ has quit IRC20:05
*** jmontemayor has joined #openstack-trove20:06
openstackgerritAnna Shen proposed a change to openstack/trove-integration: Add neutron switch for int tests  https://review.openstack.org/8785620:07
*** jasonb365 has joined #openstack-trove20:11
*** yidclare has joined #openstack-trove20:14
*** yidclare has quit IRC20:17
*** igor_ has joined #openstack-trove20:18
*** amytron_ has joined #openstack-trove20:20
*** michael-yu has joined #openstack-trove20:21
*** amytron has quit IRC20:21
*** amytron_ is now known as amytron20:21
*** igor_ has quit IRC20:23
esmuteHi everyone. Can you guys take a look at https://review.openstack.org/#/c/90462 and https://review.openstack.org/#/c/89972/. Thanks20:27
esmutehttps://review.openstack.org/#/c/89474/20:28
espesmute: sure.  only if you look at these though :) https://review.openstack.org/#/c/81410/  and  https://review.openstack.org/#/c/81682/  and https://review.openstack.org/#/c/85225/20:28
esmutethere is no such things as free lunches lol. Sure thing esp!20:29
espesmute: hehe, nope20:29
*** Barker has quit IRC20:29
*** yogeshmehra has quit IRC20:30
openstackgerritAnna Shen proposed a change to openstack/trove: Add neutron support  https://review.openstack.org/8834920:32
*** michael-yu has quit IRC20:32
*** amcrn has quit IRC20:36
*** grapex has quit IRC20:37
*** ramashri has quit IRC20:37
*** grapex has joined #openstack-trove20:37
*** michael-yu has joined #openstack-trove20:39
*** ViswaV has joined #openstack-trove20:41
*** amcrn has joined #openstack-trove20:42
*** yidclare has joined #openstack-trove20:42
*** Barker has joined #openstack-trove20:46
*** hipster has joined #openstack-trove20:47
*** robertmy_ has quit IRC20:49
*** robertmyers has joined #openstack-trove20:49
*** amcrn has quit IRC20:51
*** hipster has quit IRC20:52
iccha1vipul: forgot to tag you as well https://blueprints.launchpad.net/trove/+spec/datastore-visibility20:54
vipuliccha1: ok thanks.  I'll look soon20:55
*** NehaV1 has joined #openstack-trove20:56
*** NehaV has quit IRC20:57
*** pdmars has quit IRC20:59
denis_makogonSlickNik, cp16net, vipul, hub_cap: https://wiki.openstack.org/wiki/Trove/DBInstanceLogOperationV1 - updated according give suggestions21:05
vipuliccha1: you may want to call out, that if visibility = private, and user is a not added as a member, a create instance with that ID should fail21:07
*** kevinconway has quit IRC21:09
iccha1okie dokie, will add that in wiki vipul21:09
iccha1vipul: added it in the questions and comments section21:13
cp16neticcha1: i think the crud operations for the admin api to add/remove members should be outlined in the REST api section of the wiki page21:13
iccha1good point cp16net21:14
*** yogeshmehra has joined #openstack-trove21:15
*** igor_ has joined #openstack-trove21:19
*** grapex has quit IRC21:19
*** mattgriffin has quit IRC21:22
*** igor_ has quit IRC21:23
*** harlowja has quit IRC21:32
*** yidclare has quit IRC21:33
*** harlowja has joined #openstack-trove21:33
*** Barker has quit IRC21:33
*** NehaV1 has quit IRC21:41
iccha1cp16net: updated it, and ftr i hate the syntax formatting in the wiki21:45
denis_makogoniccha1, yeah, nobody likes it =|21:46
cp16neticcha1: the uri should include mgmt21:46
cp16netafaik its /mgmt/...21:47
*** hipster has joined #openstack-trove21:47
iccha1cp16net: got an example? ya i was looking for that i didnt find it in common/api21:47
denis_makogoniccha1, search at extension/routes21:48
cp16net '{tenant_id}/mgmt/instances'21:49
iccha1thanks denis_makogon21:49
cp16netyeah thats where it is21:49
iccha1thanks cp16net21:49
iccha1why is it an extension?21:49
iccha1we anyways check for is admin on normal api calls21:49
denis_makogoniccha1, good question =)21:49
denis_makogoniccha1, i guess MGMT API will become *core* part of API when Trove will migrate to Pecan+ WSME21:50
iccha1thanks for pointing it out cp16net ,  I included it in wiki21:51
iccha1gotcha thanks denis_makogon21:51
*** hipster has quit IRC21:52
cp16neticcha1: that json formatting is terrible in the wiki page21:54
cp16net:-P21:54
iccha1i knowwww21:54
iccha1its so lame21:54
iccha1its like you use a space to introduce a block21:54
iccha1wtf right21:54
*** yogeshmehra has quit IRC21:54
*** yogeshmehra has joined #openstack-trove21:54
*** mattgriffin has joined #openstack-trove21:55
*** sgotliv has joined #openstack-trove21:55
*** igor_ has joined #openstack-trove21:58
*** jcru has quit IRC22:02
*** igor_ has quit IRC22:03
*** achampion has quit IRC22:04
*** jasonb365 has quit IRC22:05
*** robertmyers has quit IRC22:06
*** ViswaV has quit IRC22:06
*** yidclare has joined #openstack-trove22:10
*** isviridov is now known as isviridov|away22:15
*** sgotliv has quit IRC22:15
*** peoplemerge has joined #openstack-trove22:20
*** yogeshmehra has quit IRC22:26
*** yogeshmehra has joined #openstack-trove22:27
*** sgotliv has joined #openstack-trove22:28
*** yogeshmehra has quit IRC22:29
*** sgotliv has quit IRC22:31
*** sgotliv has joined #openstack-trove22:31
*** thedodd has quit IRC22:38
*** hipster has joined #openstack-trove22:42
*** hipster_ has joined #openstack-trove22:44
*** yidclare has quit IRC22:46
*** hipster has quit IRC22:47
*** hipster has joined #openstack-trove22:47
*** hipster_ has quit IRC22:49
*** yogeshmehra has joined #openstack-trove22:49
*** hipster has quit IRC22:52
*** flaper87 is now known as flaper87|afk22:53
*** ViswaV has joined #openstack-trove22:55
*** ramashri has joined #openstack-trove22:56
*** igor_ has joined #openstack-trove22:59
*** michael-yu has quit IRC22:59
*** igor_ has quit IRC23:03
*** yidclare has joined #openstack-trove23:08
*** yogeshmehra has quit IRC23:09
*** amcrn has joined #openstack-trove23:11
sgotlivdenis_makogon, ping23:11
denis_makogonsgotliv, hello Sergey23:11
*** ramashri has quit IRC23:14
*** sgotliv has quit IRC23:17
*** michael-yu has joined #openstack-trove23:20
*** denis_makogon has quit IRC23:21
*** matsuhashi has joined #openstack-trove23:27
*** amytron has quit IRC23:27
*** mattgriffin has quit IRC23:28
*** yidclare has quit IRC23:30
*** mattgriffin has joined #openstack-trove23:34
*** hipster has joined #openstack-trove23:47
*** hipster has quit IRC23:52
« Sunday, 2014-05-18 Index Tuesday, 2014-05-20 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!