Friday, 2014-02-14

*** amrith has joined #openstack-trove00:00
*** flaper87 is now known as flaper87|afk00:07
*** jcru has quit IRC00:08
*** yidclare has quit IRC00:27
*** cweid has quit IRC00:37
*** plodronio has joined #openstack-trove00:39
*** plodronio has left #openstack-trove00:40
*** yidclare has joined #openstack-trove00:40
*** tanisdl has quit IRC00:41
*** grapex has quit IRC00:57
*** yidclare has quit IRC00:57
*** edmund has quit IRC01:00
*** achampion has joined #openstack-trove01:18
*** ViswaV has quit IRC01:32
*** nosnos has joined #openstack-trove01:39
*** demorris has joined #openstack-trove01:44
*** demorris has quit IRC02:11
*** demorris has joined #openstack-trove02:12
*** grapex has joined #openstack-trove02:12
*** demorris has quit IRC02:12
*** grapex has joined #openstack-trove02:12
*** erkules_ has joined #openstack-trove02:23
*** michael-yu has joined #openstack-trove02:24
*** mattgriffin has quit IRC02:24
*** erkules has quit IRC02:26
*** rongze has joined #openstack-trove02:28
*** robertmyers has joined #openstack-trove02:39
*** krow has quit IRC02:40
*** krow has joined #openstack-trove02:45
*** krow has quit IRC02:50
*** krow has joined #openstack-trove02:50
*** rongze has quit IRC02:52
*** jasonb365 has joined #openstack-trove02:54
*** krow has quit IRC02:55
*** krow has joined #openstack-trove02:56
*** khyati_ has quit IRC03:01
*** michael-yu has quit IRC03:05
*** michael-yu has joined #openstack-trove03:08
*** SushilKM has quit IRC03:13
*** krow has quit IRC03:20
*** krow has joined #openstack-trove03:25
*** jcooley_ has joined #openstack-trove03:26
*** krow1 has joined #openstack-trove03:29
*** krow has quit IRC03:30
*** jasonb365 has quit IRC03:32
*** michael-yu has quit IRC03:39
*** krow1 has quit IRC03:41
*** krow has joined #openstack-trove03:46
*** flaper87|afk has quit IRC03:48
*** flaper87|afk has joined #openstack-trove03:50
*** flaper87|afk is now known as flaper8703:51
*** krow has quit IRC03:51
*** mattgriffin has joined #openstack-trove03:53
*** edmund has joined #openstack-trove03:59
*** robertmyers has quit IRC04:03
*** krow has joined #openstack-trove04:05
*** mattgriffin has quit IRC04:07
*** mattgriffin has joined #openstack-trove04:08
*** jasonb365 has joined #openstack-trove04:08
*** amcrn_ has quit IRC04:08
*** amcrn has joined #openstack-trove04:12
*** jcooley_ has quit IRC04:24
*** harlowja_ is now known as harlowja_away04:31
*** amcrn has quit IRC04:37
*** amcrn has joined #openstack-trove04:38
*** saju_m has joined #openstack-trove04:39
*** krow has quit IRC04:39
*** krow has joined #openstack-trove04:44
*** radez is now known as radez_g0n304:48
*** krow has quit IRC04:48
*** krow has joined #openstack-trove04:49
*** demorris has joined #openstack-trove04:50
*** jasonb365 has quit IRC04:53
*** SushilKM has joined #openstack-trove05:03
*** jcooley_ has joined #openstack-trove05:13
*** demorris has quit IRC05:13
*** krow1 has joined #openstack-trove05:20
*** krow has quit IRC05:21
*** SushilKM has quit IRC05:22
*** krow1 has quit IRC05:25
*** krow has joined #openstack-trove05:26
*** krow1 has joined #openstack-trove05:29
*** krow has quit IRC05:31
*** mattgriffin has quit IRC05:51
*** SushilKM has joined #openstack-trove05:54
*** mattgriffin has joined #openstack-trove05:57
*** saju_m has quit IRC05:58
*** krow1 has quit IRC06:00
*** krow has joined #openstack-trove06:07
*** sballe has quit IRC06:11
*** jcooley_ has quit IRC06:23
*** yogesh has joined #openstack-trove06:33
*** grapex has quit IRC06:35
*** mattgriffin has quit IRC06:39
*** michael-yu has joined #openstack-trove06:44
*** mattgriffin has joined #openstack-trove06:45
*** michael-yu has quit IRC06:49
*** michael-yu has joined #openstack-trove06:49
*** yogesh_ has joined #openstack-trove06:49
*** yogesh has quit IRC06:52
*** yogesh_ has quit IRC06:54
*** grapex has joined #openstack-trove07:06
shivamshuklas07:07
*** krow has quit IRC07:08
*** shivamshukla has quit IRC07:08
*** grapex has quit IRC07:15
*** sballe has joined #openstack-trove07:24
*** saju_m has joined #openstack-trove07:25
*** denis_makogon has joined #openstack-trove07:33
*** narmitag has quit IRC07:38
*** grapex has joined #openstack-trove07:41
*** grapex has quit IRC07:45
*** yogesh has joined #openstack-trove07:54
*** michael-yu has quit IRC07:54
*** yogesh_ has joined #openstack-trove08:02
*** tattabbum has joined #openstack-trove08:04
*** yogesh has quit IRC08:04
tattabbumHi all, I'm trying to install manually TROVE following this unique guide: http://docs.openstack.org/developer/trove/dev/manual_install.html08:07
tattabbumWhen I run this command: #trove-manage --config-file=<PathToTroveConf> db_wipe trove_test.sqlite mysql fake08:08
tattabbum(where --config-file=/root/trove/etc/trove/trove.conf.sample)08:08
tattabbumI obtain this output: usage: trove-manage [-h] [--config-dir DIR] [--config-file PATH] [--debug]                     [--log-config-append PATH] [--log-date-format DATE_FORMAT]                     [--log-dir LOG_DIR] [--log-file PATH]                     [--log-format FORMAT] [--nodebug] [--nouse-syslog]                     [--noverbose] [--s08:09
tattabbum{db_sync,db_upgrade,db_downgrade,datastore_update,datastore_version_update,db_wipe}08:10
tattabbumtrove-manage: error: unrecognized arguments: mysql fake08:10
tattabbumSo, if trove-manage doesn't manage 'mysql' and 'fake' arguments, there is something of wrong in the guide.08:12
*** flaper87 has quit IRC08:18
*** flaper87 has joined #openstack-trove08:18
*** tattabbum has quit IRC08:41
*** grapex has joined #openstack-trove08:41
*** tattabum has joined #openstack-trove08:42
*** grapex has quit IRC08:46
*** tattabum has quit IRC08:48
*** SushilKM has quit IRC08:55
*** tattabbum has joined #openstack-trove08:58
tattabbumCan someone  suggest to me a valid guide to install and configure correctly Trove?08:58
tattabbumThis guide (http://docs.openstack.org/developer/trove/dev/manual_install.html#) seems to be wrong :-(09:04
denis_makogontattabbum, https://github.com/openstack/trove-integration here you can see trove manuals09:31
denis_makogontattabbum, about that manual, its been outdated since big changes in trove codebase09:31
*** amcrn has quit IRC09:34
denis_makogontattabbum, if you would need any help, ping me and i'll try to help you09:34
tattabbumdenis_makogon, is this guide (https://github.com/openstack/trove-integration) useful to install TROVE in a DEVSTACK environment?09:35
denis_makogonfollow guide at trove-integration page09:35
denis_makogonspin up the VM09:36
denis_makogonadd user ubuntu09:36
denis_makogonadd to visudo09:36
tattabbumdenis_makogon, I would install TROVE in an existing OpenStack (HAVANA) environment..09:36
denis_makogonlog in as ubuntu user09:36
denis_makogonyes09:36
denis_makogoni get it09:37
tattabbumok...09:37
denis_makogontattabbum, https://github.com/openstack-dev/devstack/blob/master/lib/trove09:37
denis_makogonthere you would find required parameters for each Trove service to integrate it into env09:38
denis_makogonbut, if you are using clean devstack installation09:38
denis_makogoni would suggest you to use trove-integration manual09:39
tattabbumI have an Openstack environment in which I have installed every single service manually, by means of this guide http://docs.openstack.org/trunk/install-guide/install/apt/content/09:41
tattabbumAnd now I want to add the service TROVE09:41
*** grapex has joined #openstack-trove09:42
tattabbumdenis_makogon, I have an Openstack environment in which I have installed every single service manually, by means of this guide http://docs.openstack.org/trunk/install-guide/install/apt/content/09:45
tattabbumdenis_makogon, and now I want to add the service TROVE09:45
tattabbumSo, do you say to use this (https://github.com/openstack/trove-integration) guide?09:46
*** grapex has quit IRC09:47
denis_makogonyes09:47
denis_makogonits easiest way09:47
tattabbumdenis_makogon, but that guide installs all services other than TROVE!09:48
tattabbum*other than --> in addition to09:50
*** saju_m has quit IRC09:51
denis_makogonit installs devstack and integrates trove into it09:51
denis_makogonbut if you need just trove09:52
denis_makogoni would suggest to install trove virtualenv, add required parameters to trove-taskmanager.conf, trove.conf, trove-conductor.conf, trove-guestagent.conf09:53
tattabbumdenis_makogon, using the trove virtualenv guide (http://docs.openstack.org/developer/trove/dev/manual_install.html#) I obtain errors when I try to run the trove-manage command:09:54
tattabbumin these steps: http://docs.openstack.org/developer/trove/dev/manual_install.html#prepare-database09:55
denis_makogontrove-manage until was udated09:55
denis_makogon*updated09:55
*** ikhudoshyn has joined #openstack-trove09:55
denis_makogontake a look at redstack script at trove-integration09:56
denis_makogonand search for rd_manager09:56
denis_makogonthen you'll see how to work with trove-manage util09:56
tattabbumdenis_makogon, OK. However here (http://www.gossamer-threads.com/lists/openstack/dev/35860?page=last) you can see an emails that I have posted related to this problem10:00
*** denis_makogon has quit IRC10:03
*** nosnos has quit IRC10:21
*** yogesh_ has quit IRC10:26
*** yogesh has joined #openstack-trove10:27
*** yogesh has quit IRC10:31
*** grapex has joined #openstack-trove10:42
*** grapex has quit IRC10:48
*** dmakogon_ is now known as denis_makogon10:51
tattabbum10:53
denis_makogontattabbum, i saw your mail, i'll take a look at manual and i'll try to update in asap10:57
tattabbumWow! Thank you denis!11:00
tattabbumI suggest to say in the new manual that the virtualenv installation is optional11:01
tattabbumdenis_makogon, can you send me an email when you will have finished the manual review?11:04
denis_makogontattabbum, yes, of course11:06
*** Barker has quit IRC11:40
*** grapex has joined #openstack-trove11:43
*** grapex has quit IRC11:48
*** radez_g0n3 is now known as radez12:41
*** Barker has joined #openstack-trove12:43
*** grapex has joined #openstack-trove12:43
*** grapex has quit IRC12:48
*** Barker has quit IRC12:49
*** pdmars has joined #openstack-trove13:16
openstackgerritDenis M. proposed a change to openstack/trove: WIP: Cassandra backup/restore  https://review.openstack.org/7336513:27
*** radez is now known as radez_g0n313:36
*** grapex has joined #openstack-trove13:44
*** grapex has quit IRC13:48
*** achampion has quit IRC13:58
*** jimbobhickville has joined #openstack-trove14:01
*** demorris has joined #openstack-trove14:15
*** kevinconway has joined #openstack-trove14:20
*** radez_g0n3 is now known as radez14:20
*** jcru has joined #openstack-trove14:26
denis_makogonGate is broken due to broken Cinder inside the DevStack14:38
denis_makogonhttps://gist.github.com/denismakogon/900210814:41
*** michael-yu has joined #openstack-trove14:43
*** achampion has joined #openstack-trove14:48
*** grapex has joined #openstack-trove14:56
*** edmund has quit IRC14:58
*** citizengrey has joined #openstack-trove15:01
*** michael-yu has quit IRC15:04
*** erkules_ is now known as erkules15:14
*** grapex has quit IRC15:18
*** grapex has joined #openstack-trove15:18
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/5094415:19
*** robertmyers has joined #openstack-trove15:24
*** jmontemayor has joined #openstack-trove15:24
*** jmontemayor has quit IRC15:25
*** jmontemayor has joined #openstack-trove15:26
*** Ranjitha has quit IRC15:30
*** datsun180b has joined #openstack-trove15:34
*** amytron has joined #openstack-trove15:42
hub_caphey tattabbum, guiseppe, ya?15:43
demorrishub_cap: did you see my question last night about python-troveclient pypi?15:43
hub_captattabbum: are you trying to develop against an existing cluster, or are you trying to install for productionish use15:43
hub_capdemorris: you didnt post anythign to this channel15:44
demorriswondering how ofter that gets updated.  Seems like the last time it was updated was in Oct of 201315:44
demorrisyeah, it was ST message cause I did not see you in the channel15:44
hub_capwe will push an update for icehouse15:44
hub_capim always in the channel :)15:44
hub_capjust not here sometimes hehe15:44
demorriswell…not always, but close15:45
hub_capso ya, the openstack's clis are not updated a ton15:45
hub_caponly if there is a problem15:45
hub_capbut again, they have full features in a v2 api :)15:45
*** tattabbum has quit IRC15:45
*** kevinconway has quit IRC15:45
hub_capwe will likely push 1x or 2x for icehouse and we can chat about the relesae cadance for that at the mid cycle sprint nxt wk15:45
demorrisright, I was just trying to get access to some of the types and versions stuff, I can just pull from github though15:46
demorrisfor the latest15:46
*** ViswaV has joined #openstack-trove15:47
hub_capyea id _always_ recommend a git clone / sudo python setup.py develop/install (whichever u want)15:47
*** ViswaV_ has joined #openstack-trove15:50
*** ViswaV has quit IRC15:52
*** thedodd has joined #openstack-trove15:56
*** ViswaV_ is now known as ViswaV15:57
*** edmund has joined #openstack-trove16:00
*** kevinconway has joined #openstack-trove16:03
*** ikhudoshyn has left #openstack-trove16:03
*** dukhlov__ has quit IRC16:07
denis_makogonhub_cap, nice to see you here16:08
denis_makogonhub_cap, gate is failing due to cinder stuff16:09
denis_makogonhub_cap, and could you please take a look at mongo patches16:10
hub_capdenis_makogon: im not here yet really :)16:11
hub_capstill makin coffee16:11
denis_makogonhub_cap, ok16:11
hub_cap:)16:12
denis_makogoni'm gonna be out for a while, ping me, please if you'll need me16:12
*** jasonb365 has joined #openstack-trove16:12
denis_makogonbtw, do you know normal (free or paid) IRC client for an iPad ?16:12
datsun180bdenis_makogon: ssh to a decent machine running irssi in a screen session16:15
*** russellb is now known as rustlebee16:16
hub_capdenis_makogon: haha ssh on ipad?!?!?16:18
hub_caponly konetzed does that16:18
hub_capid try colloquy or linkinus denis_makogon16:18
hub_capu will have to do sasl16:18
*** jcru has quit IRC16:21
*** krow has joined #openstack-trove16:21
*** jcru has joined #openstack-trove16:22
*** demorris_ has joined #openstack-trove16:31
*** demorris has quit IRC16:33
*** demorris_ is now known as demorris16:33
*** mrsnivvel has quit IRC16:34
*** tanisdl has joined #openstack-trove16:36
*** jasonb365_ has joined #openstack-trove16:37
*** jasonb365 has quit IRC16:37
*** jasonb365_ is now known as jasonb36516:37
cp16netdatsun180b: are you looking at my setup?16:38
ViswaVGood morning all.  Is there a sure fire way of getting the trove guest agent's root path  (wherever it is installed on the guest VM….eg   /home/<user>/trove)  programmatically from within , say a method inside manager.py or backup_impl.py  ?16:39
datsun180bcp16net: i'd do it too if i wasn't lazy16:39
cp16netlol16:39
cp16netits easy as well16:39
*** tanisdl has quit IRC16:39
cp16neti type ssh irc and then screen -x16:39
datsun180bcp16net: isn't configuring irssi like a huge pain? i remember it was when i was an intern that once i had it done i never wanted to do it again16:40
cp16netnope16:40
imsplitbitnah it's super easy16:40
cp16netdatsun180b: hub_cap passed me his config and i just roll with it16:40
cp16netthere are just a few things to configure16:40
cp16netbring up a small cs and install it16:40
datsun180bugh16:40
*** tanisdl has joined #openstack-trove16:41
ViswaVI was planning on using  "/home/"+getpass.getuser()+"/trove"   …… Is there a better way?16:41
datsun180bbut what about the learning experience?16:41
datsun180bViswaV: does ~ not expand properly?16:41
hub_capdatsun180b: u will have enough to learn to use it well :)16:41
hub_capim running mine on a 512m server16:42
hub_capand its more than enough16:42
ViswaVdatsun180b: Have to give that a try.16:42
datsun180bhub_cap: says the guy who just snagged all of tim pope's vim configs before you started16:42
kevinconwaydatsun180b: ViswaV: http://docs.python.org/2/library/os.path.html#os.path.expanduser16:43
*** michael-yu has joined #openstack-trove16:43
cp16netlolz16:43
datsun180bwait, do we install the guest agent in anyone's home? i thought it was /trove/bin/16:44
datsun180bor something like that16:44
kevinconwaytilde expansion should give you the home of the user that ran the agent16:44
ViswaVkevinconway: thx.16:45
datsun180bbut he's looking for the ga's root path, not man-about-town's home dir16:45
datsun180bor so i thought16:45
ViswaVdatsun180b:  redstack still seems to install it on /home/<user> …. Has this changed recently?16:45
hub_capi think u mean says the guy who traded in tpopes stuff for some emacs-fu16:45
hub_capdatsun180b: ^ ^16:45
datsun180bhub_cap: you did both, i'm surprised tpope didn't have you excommunicated16:45
hub_capand hey, the way i figure it, is if i used to host a ruby meetup that tpope came to, i could steal his configs :)16:45
datsun180bViswaV: you're probably right if you've got it running right in front of you16:46
kevinconwayif you want the path to the agent then you should be able to use some combination of os.realpath(__file__) and os.dirname or os.split16:46
kevinconwayshould get you close to the path of the file from which the code is being called16:46
datsun180bsee i keep trying to go to bash and i'm thinking "which nova-guest" would suffice16:46
cp16netit rsyncs the trove driectory to the home folder in the guest instance16:47
cp16netpart of the firstboot script before apt-get update and starting the service16:47
datsun180byeah i'm thinking of my dev vm, not an instance itself16:47
cp16netoh yeah with your vagrant script. :)16:47
ViswaVkevinconway: I think the os.realpath(__file__)  is probably more reliable …and agnostic of where trove guest agent will be installed (home dir or /trove or whatever). I am leaning towards that too.16:48
datsun180bhey vagrant's save me boats of time16:48
kevinconwayViswaV: what are you doing that you need the location of the agent vs the location of a datastore?16:49
cp16netViswaV: hmm why do you need the path? i might have missed that part of this convo?16:49
datsun180bkevinconway ViswaV yeah i was trying to word that question without sounding like a detective16:49
ViswaVkevinconway:  was gonna just explain that .. :) here it is..16:49
ViswaVI need to get to a file/script that will be bundled within the trove guestagent code.  Specifically a wrapper backup/restore script I am creating for mongo backup/restore ...16:50
ViswaVthe default mongodump, mongorestore do not work with streams properly… and the swift backup/restore strategies seem to work nicely with stream…at least thats how I see mysql backup/restore implemented16:50
cp16netoh so you want to call a bash script for example to run your backup16:51
ViswaVye16:51
cp16netgotcha16:51
datsun180bneat16:51
kevinconwayi think you could do that with a custom backup manager16:51
kevinconwaythey should be interchangeable in the config for the agent16:51
cp16netumm i think robertmyers did something similar with the mysl backup16:51
ViswaVkevinconway:  it is a custom backup manager… just like the mysql_impl.py …. But eventually it has to call mongodump ….and not directly since mongodump has some deficiencies around working with streams...16:52
robertmyersViswaV: you can create the backup then tar -czf the results which can be streams16:52
ViswaVIt's a bit more than tar -czf16:53
robertmyerswell, yes16:53
robertmyersjust saying tar can do streaming16:53
kevinconwayViswaV: could you not simply implement this property: https://github.com/openstack/trove/blob/master/trove/guestagent/strategies/backup/mysql_impl.py#L3016:54
*** saju_m has joined #openstack-trove16:54
ViswaVYes.. that is the plan.  I want to be able to set that cmd to  "sudo  <path to my custom script>  <options> "  where the custom script is something like16:55
ViswaVhttps://gist.github.com/vvutharkar/900471116:55
kevinconwayok cool. i guess i just misunderstood something16:56
kevinconwayit sounded like you wanted to do some magic loading of something using the agent path16:56
robertmyersViswaV: you could still do most of that in python16:56
robertmyersbasically you need a pre_dump cmd16:57
robertmyersand put that logic there16:57
*** michael-yu has quit IRC16:57
robertmyersthen the 'dump' command will be tar16:57
robertmyerspost_dump can be the cleanup16:57
ViswaVrobertmyers: That is definitely worth exploring, if I can get away from embedding a wrapper script. Thx. Will think in that angle.   I did notice that the base backup class does not have pre_backup & post_backup  methods  like the base restore has pre and post restore  methods which allow to do some prep and cleanup …  I can explore adding those to the base class.16:59
robertmyerssee the restore classes for examples16:59
ViswaVYup16:59
robertmyersyeah, that would be good to add those hooks16:59
robertmyersfor exactly this reason16:59
ViswaVYes.17:00
robertmyersbasically the run method should call pre, dump, post17:01
robertmyerswhere by default pre and post are pass17:01
ViswaVexactly what i was thinking… and the mongo_impl can override those to do what I plan to do in that wrapper script17:02
robertmyerscool17:02
*** jasonb365_ has joined #openstack-trove17:03
ViswaVThanks for all the pointers, guys! Off to a good start today morning ! Hopefully I can wrap up the day faster and go grab some flowers/chocolates for my wife :)17:03
robertmyersnice17:04
*** jasonb365 has quit IRC17:04
*** jasonb365_ is now known as jasonb36517:04
robertmyershttp://www.nbc.com/saturday-night-live/video/valentines-day-commercial/n4581417:05
*** datsun180b has quit IRC17:09
*** citizengrey has quit IRC17:09
cp16netrobertmyers: hahaha yeah its pretty funny17:09
ViswaVrobertmyers:  LOL !17:10
robertmyersI have to run ;) ... to cvs guys17:10
*** datsun180b has joined #openstack-trove17:10
cp16netyeah i can stop by on the way home :_P17:10
*** citizengrey has joined #openstack-trove17:14
ViswaVIf only it were ok to send a lovely valentine message to wife in a gist rather than a hallmark card, i would save enough be able to buy all those items from CVS !17:14
cp16netlolz17:15
datsun180bmy wife and i observe holidays like valentine's on a one-week offset either way so restaurants are easier to get into17:15
ViswaVnice strategy!17:16
ViswaVbut how did you convince your wife? !17:16
datsun180bwe are both practical and analytical people to a fault17:18
jimbobhickvilleI have a similar situation, although not one-week, just a day somewhere nearby that is more convenient for us.17:18
robertmyerswell, all the cool kids are heading out tonight17:19
* robertmyers is cool17:19
hub_caphah my wife said to me17:26
hub_capdo NOT get me flowers17:26
hub_capcuz i do like every other year, and she explicitly told me this yer not to ;)17:26
hub_capmy valentise day? packing for austin17:26
*** amytron has quit IRC17:30
kevinconwayhub_cap: it's a trap17:31
kevinconwayshe totally wants flowers17:31
*** shivamshukla_ has joined #openstack-trove17:37
ViswaV(https://github.com/openstack/trove/blob/master/trove/guestagent/backup/backupagent.py#L160   versus   https://github.com/openstack/trove/blob/master/trove/guestagent/backup/backupagent.py#L160  )   ,  The  'storage' strategy passed is into restore_runner, which keeps the implementation much cleaner in my opinion and the logic flow contained is within restore_runner class which allows for clean sequencing of pre_restore, restore &17:45
ViswaV post_restore.17:45
ViswaVWhereas in the case of backup_runner  the concerns of storage leak into the backup agent class,  so the runner is not completely in control of sequencing pre_backup, backup, post_backup .17:46
hub_capkevinconway: hehe, shes not in to vday :)17:46
hub_capnever has been, corporate holiday and all that17:47
ViswaV(is passed   .. is contained …. mistyped the words)17:47
ViswaVThere is no pre_Backup, post_backup yet…but I plan on implementing those since mongo might require those.17:48
ViswaVThe way backupagent.py logic intertwines with the backup strategy base class (and impl class),  it is a bit messy to find the correct insertion points for pre_backup() and post_backup()…. restore logic is much cleaner.17:49
*** michael-yu has joined #openstack-trove17:52
*** yidclare has joined #openstack-trove17:55
*** datsun180b has quit IRC18:04
*** yidclare has quit IRC18:06
ViswaVquick question guys: May be I am not looking in the right place… but I don't see a trove CLI for restore.18:08
ViswaVtrove --help does not show any restore command…18:09
*** michael-yu has quit IRC18:11
*** shivamshukla_ has quit IRC18:12
*** michael-yu has joined #openstack-trove18:15
*** SushilKM has joined #openstack-trove18:27
cp16netViswaV: restore requires a new instance to be created18:31
cp16netso its under create and there is an option to pass the backup_id18:32
ViswaVcp16net:  thx. hub_cap pointed me to the same.18:33
*** yidclare has joined #openstack-trove18:41
*** thedodd has quit IRC18:46
cp16netnp18:48
*** michael-yu has quit IRC18:53
*** yogesh has joined #openstack-trove18:53
*** arborism has joined #openstack-trove19:06
*** michael-yu has joined #openstack-trove19:08
openstackgerritGreg Hill proposed a change to openstack/python-troveclient: add scheduled tasks  https://review.openstack.org/7369319:08
*** saju_m has quit IRC19:11
jimbobhickvilleanyone else get a problem with config.template blowing up a rebase?19:11
*** krow has quit IRC19:12
jimbobhickvilleit's odd because I didn't modify that file at all locally19:12
*** SushilKM has quit IRC19:13
*** datsun180b has joined #openstack-trove19:13
*** krow has joined #openstack-trove19:14
jimbobhickvillesomething with "Externalization of heat template" - denis_makogon, that was you right?19:18
*** amcrn_ has joined #openstack-trove19:18
*** amcrn_ is now known as amcrn19:18
*** arborism has quit IRC19:19
demorrishub_cap: u there?19:29
*** thedodd has joined #openstack-trove19:32
*** tanisdl has quit IRC19:35
*** michael-yu has quit IRC19:39
demorrisfyi I just registered a new BP for modifying an instance name.  Heard it was pulled out of the Configuration Edits work, which is fine, but we need the ability to rename instances - https://blueprints.launchpad.net/trove/+spec/modify-instance-name19:39
demorriscp16net: already added an instance PUT call with the config edits work, so should be relatively straightforward to add an instance change command19:42
*** michael-yu has joined #openstack-trove19:44
*** krow has quit IRC19:45
*** radez is now known as radez_g0n319:47
*** krow has joined #openstack-trove19:50
*** denis_makogon_ has joined #openstack-trove19:50
*** yidclare has quit IRC19:51
openstackgerritA change was merged to openstack/trove: Raises BadRequest for grant_access on ignore_dbs  https://review.openstack.org/7259519:51
*** datsun180b has quit IRC19:52
*** denis_makogon has quit IRC19:52
*** denis_makogon_ is now known as denis_makogon19:52
*** dmakogon_ has joined #openstack-trove19:52
openstackgerritGreg Hill proposed a change to openstack/trove: Add scheduled tasks to the API  https://review.openstack.org/7370219:53
*** krow1 has joined #openstack-trove19:54
*** krow has quit IRC19:54
*** datsun180b has joined #openstack-trove19:55
denis_makogonViswaV, ping19:55
ViswaVHi denis_makogon19:56
denis_makogonViswaV, about mongo backup/restore - ikhudoshyn doint this task19:56
denis_makogonViswaV, i wrote it in your BP19:56
denis_makogonViswaV, so, please talk to him, and then decide who will do this19:57
denis_makogonViswaV, since this task booked on ikhudoshyn19:57
ViswaVOh.. didn't notice that. I am half way through it… I thought I assigned that BP to my self… let me check19:57
denis_makogonViswaV, i pretty much sure that its not the good idea to steal tasks =(19:58
hub_capdenis_makogon: no one knew ilya was working on it but u19:58
hub_capso its not fair to say that19:58
denis_makogonhub_cap, blueprint about mongo says that19:58
hub_capplz be nice ot our new friends :)19:58
hub_caplink?19:58
hub_capif u mean the _original_ blueprint, then thats not a strong arguement19:59
denis_makogonhttps://blueprints.launchpad.net/trove/+spec/single-instance-mongodb-ga19:59
hub_capdude thas the same blueprint19:59
hub_capas soon as we merge mongo19:59
hub_capthat blueprint is done19:59
hub_capthats why his code says "implements blueprint ..."19:59
hub_capu cant say that he will contineu to wokr on everything forever for one blueprint20:00
denis_makogonso, you say that this task now assigned to ViswaV ?20:00
ViswaVdenis_makogon:  https://review.openstack.org/#/c/50597/  ,  it specifically says that it implements  https://blueprints.launchpad.net/trove/+spec/single-instance-mongodb-ga  and that only CRUD is being implemented.20:00
hub_capyup ViswaV20:01
ViswaVHence I created https://blueprints.launchpad.net/trove/+spec/backups-single-instance-mongodb  and assigned to myself...20:01
denis_makogonViswaV, last few words20:01
hub_capstill, you and ilya should talk ViswaV20:01
denis_makogonWill use mongodump/mongorestore for backup20:01
hub_capbut its not like u did anythign wrong20:01
hub_capso dont think u did ViswaV :)20:01
ViswaVhub_cap: Thx. Will definitely talk to ilya.20:02
hub_capword20:02
* hub_cap dissapears again20:02
denis_makogoni thought that mongo and cassandra features stays for me and Illya20:02
hub_capdenis_makogon: if you are owrking on a feature20:04
hub_capu first blueprint it20:04
demorrisprobably more than enough work to do on those to have tasks/bp's shared around20:04
hub_capu dont finish the feature and then put up a bp20:04
hub_capif u put up a blueprint for c* backups20:04
hub_capand assing to yourself, then u are working on it20:04
hub_capu cant say ill alwaus work on every c* feature20:05
hub_capif datastax caomes in and says hey, we wanna help, im not denying them ;)20:05
denis_makogonget it20:05
demorrishub_cap: and they just might20:05
hub_capso yes denis_makogon u can work on c* as long as u want20:06
hub_capjust bp things first :) tell ilya to do the same.. thems the rules, since we are so distributed20:06
denis_makogoni thinks, after chatting with Illya we'll came into common agreement that'll satisfy all of us20:06
hub_capcool thx denis_makogon20:06
* hub_cap dissapears for real20:07
ViswaVdenis_makogon: That would be best. Thx. I don't see Illya online here. Do you want me to send him an email or you will sort out and let us know?20:07
*** michael-yu has quit IRC20:08
denis_makogonViswaV, would be better to talk via emails - mine, dmakogon@mirantis.com, Illya's ikhudoshyn@mirantis.com20:08
denis_makogonemails would be better, since we are in different timezones20:08
*** michael-yu has joined #openstack-trove20:09
denis_makogonhub_cap, so, what about mongo initial patch ?20:10
denis_makogonViswaV, sorry about doing hidden work with mongo, probably, it's my falt.20:12
*** krow1 has quit IRC20:12
hub_capdenis_makogon: dont worry about it, we will get it squared away20:13
denis_makogonViswaV, now it'll be widely open as hell20:13
hub_capwrt the work20:13
hub_capwrt the patch, i have to test it, but im packing for austin, so itll be tested tonight or weekend20:13
kevinconwaydenis_makogon: that is very open20:13
hub_capif it runs wel im sure itll be merged b4 the trove mid cycle sprint20:13
hub_capand i know amcrn has tested it a ton20:14
hub_capso im confident ill be good to go soon denis_makogon20:14
*** amcrn has quit IRC20:15
*** krow has joined #openstack-trove20:15
denis_makogoni submitted final patch for mongo, now it does everything correctly20:15
denis_makogonViswaV, about your questions (setting strategy to guest conf) and sending it to the VM20:16
ViswaVdenis_makogon: No problem.  but yeah I too would like your guest agent code (https://review.openstack.org/#/c/50597/)  to be merged as well So I can test the whole thing without having to cherry pick your changes first.20:16
*** amcrn has joined #openstack-trove20:16
denis_makogonViswaV, i'm working on patch that'll give an ability to keep all backup strategies in guest conf20:17
denis_makogonViswaV, you can see how i did it here https://review.openstack.org/#/c/73365/20:17
ViswaVdenis_makogon: Yes, I guess that would be done in the prepare() method of the mongodb manager…right? I am not touching that part yet.20:17
ViswaVI will take a look at that 73365 as well.20:18
denis_makogoni simply added oslo groups, that allows to separate option sets20:25
denis_makogoneach group maned as datastore_manager20:25
denis_makogon[mysql], [cassandra], [redis], etc20:26
denis_makogonViswaV, https://review.openstack.org/#/c/73365/2/trove/guestagent/backup/backupagent.py20:26
denis_makogonvipul, SlickNik, grapex, amcrn hub_cap, what do you think about updating defaults in trove, but not in devstack20:28
SlickNikdenis_makogon: not sure I understand your question.20:29
SlickNikDefaults for what?20:29
denis_makogonSlickNik, https://review.openstack.org/#/c/71870/20:29
denis_makogonsorry, forgot the link20:29
amcrni agree with sean20:29
denis_makogonamcrn, so, you that this changes shoud be set in trove, right ?20:30
demorrisanyone got a sec for a question on the configuration edits code?20:31
denis_makogonamcrn, and if we'll set update_status_on_fail = True in cfg.py, it would mean that this feature should not be optional at all20:31
amcrnwell, let me explain: using devstack as a means to set values so that something *works* (in the case of the review above, increasing timeouts so cassandra doesn't init fail) is a lackluster option, because the sample confs should generally be a good guide for how to get trove up and running.20:31
SlickNikdenis_makogon: The set of defaults in Trove should give you a working installation.20:31
denis_makogonSlickNik, it will keep it as it is, almost20:32
denis_makogonSlickNik, just will increase timeout and allow always mark instance with ERROR if timeout20:33
denis_makogonhapped20:33
SlickNikamcrn: +120:33
demorrisgiven that we are now keeping track of changes to the configuration via config options, does it still make sense to maintain a configuration template (for defaults)?20:34
denis_makogonso, i'll make some changes in cfg.py and will add the descripion in taskmanager.conf.sample where i'll say that this option should have at least _this_ value to support this feature20:35
amcrndemorris: are you referring to https://github.com/openstack/trove/blob/master/trove/templates/mysql/config.template (as an example)?20:35
SlickNikdenis_makogon: There's a bigger issue here, I think. What might be a good timeout for one datastore, might not be good for another.20:35
denis_makogonSlickNik, timeout per datastore ?20:36
demorrisamcrn: yeah20:36
denis_makogonSlickNik, ok, i'll take a look at it20:37
amcrndemorris: so cp16net can do a better job at elaborating on this, but those templates are moving to a db table20:37
demorriswhy would we not just store these defaults in the db per flavor size and pull from there...20:37
demorrisoh20:37
demorrisI thought that was for the available parameters20:37
amcrnand to explain the defaults: there are still some situations in which we (as trove) want to have a default value for a parameter that differs from a vanilla-install, but we don't want to allow users to manipulate/set it20:37
demorrisnot the defaults20:38
amcrnthat's why defaults still has to exist, and as far as i know, that's moving to a table as well20:38
demorrisamcrn: right so wouldn't you just flag those in the db with a  boolean value such as "configurable"20:38
amcrnsomething to that effect, yes20:38
demorrisadditionally you could add "visible"20:38
demorrisso you could hide once you don't want the user to see20:38
amcrnright20:39
demorrisright now it just seems like things are a bit disparate, so with the current impl you have to do some merging to see 1) what are the defaults 2) what can I configure20:39
amcrnagreed, so once it moves to the table, the general picture of (1) what is available, and (2) what is configurable, should become crystal clear20:40
amcrnhopefully ;)20:40
*** radez_g0n3 is now known as radez20:40
demorrisamcrn: okay cool, as long as were thinking about it :)20:40
demorristhe original BP had this concept of storing the default and configurable fields20:41
demorrisbut it did not make it in to the final deliverable20:41
amcrnSlickNik denis_makogon: agreed on usage_timeout and usage_sleep_time per datastore20:41
denis_makogonamcrn, actually it was your idea (while cassandra testing), so, thanks20:42
amcrnnp20:42
SlickNikWhat does this do: "update status on FAIL"?20:42
SlickNikAnd why do we need it?20:42
amcrnSlickNik: in short, if something goes wrong in the workflow (i.e. security-group creation fails, volume creation fails, etc.), the status is flipped to ERROR and the assets are cleaned up20:43
amcrn(after a timeout)20:44
denis_makogonSlickNik, before that instance will stuck in BUILD status20:44
SlickNikgotcha, it's for a cleanup of previously allocated resources on failure/error.20:46
denis_makogonamcrn, SlickNik, take a look at https://review.openstack.org/#/c/50944/20:46
denis_makogoni rewrote it20:46
denis_makogonunfortunalety, gate is broken due to cinder, so rd posted -120:47
denis_makogonhub_cap, what about releasing new client version ?20:47
*** michael-yu has quit IRC20:55
*** michael-yu has joined #openstack-trove20:57
*** michael-yu has quit IRC20:58
*** datsun180b has quit IRC21:00
*** datsun180b has joined #openstack-trove21:02
*** yidclare has joined #openstack-trove21:06
*** jimbobhickville has quit IRC21:06
*** denis_makogon has quit IRC21:13
mat-loweryquestion regarding trove-gate is anyone is around21:24
mat-loweryDo we know why it's breaking? Does the investigation need assistance?21:25
*** Barker has joined #openstack-trove21:26
mat-lowerydenis_makogon said, "gate is broken due to cinder". How did we arrive at this conclusion? (I'm trying to learn for future debugging purposes.)21:33
*** Barker has quit IRC21:48
cp16netmat-lowery: i'd say either by looking at the console output in the rdkenkins run21:50
cp16netmat-lowery: or by creating a new vm and running through the tests again21:51
mat-lowerycp16net: Thanks. Regarding the console output from Jenkins, the STDERR BEGIN lines (for example here: https://rdjenkins.dyndns.org/job/Trove-Gate/2529/console) don't seem helpful...in fact, it looks like a bug in the test configuration that it's echo'ing like that.21:52
mat-loweryRegarding a new VM, you mean a personal VM? Or do you mean some parameter in Jenkins?21:53
cp16netpersonal vm21:55
cp16netmat-lowery: check out at the top there is a link to *Full Log*21:55
cp16nethttps://rdjenkins.dyndns.org/job/Trove-Gate/2529/consoleFull21:55
cp16netor you can goto the [raw] link which show just the file21:56
*** edmund1 has joined #openstack-trove21:58
*** edmund has quit IRC22:00
cp16netmat-lowery: i've used vagrant with much success in replicating these issues22:00
cp16netalthough i have not run into an issue today22:00
mat-loweryI can get a clean run (provided I extend the timeouts on a testcase) on a local VM.22:01
cp16netLOL22:01
cp16netsounds like me too :-P22:01
*** robertmyers has quit IRC22:06
*** SushilKM has joined #openstack-trove22:10
SushilKMfound that in guestagent\api.py some db calls are going asynchronous and others are synchronous, any specifics about that distinction22:10
cp16netSushilKM: if the api needs feedback from the guest is usually the distinction22:11
cp16netmost calls like create user/database its just cast22:12
SushilKMhow do we decide on the need of feedback22:12
cp16netusually depends on the api call being made22:12
*** achampion has quit IRC22:12
cp16netcreates/deletes shouldnt need it22:12
cp16netbut gets might22:12
SushilKMand about grant/revoke22:13
cp16netunless its data stored in the trove database and not the guest instance's db22:13
SushilKMof-course api calls are hitting the guest db22:13
cp16netwe've tried to avoid doing too many calls that make sync calls to the db because it could take a while to respond from the api side of things22:14
SushilKMbut does not the async call deprives user of seeing an error message from guest db22:14
cp16netdepends on what the call is22:16
*** edmund1 has quit IRC22:16
*** khyati_ has joined #openstack-trove22:16
SushilKM"what the call is" means ...22:16
cp16netfor create user for example we do validation to make sure its as "valid" as possible for sending it22:16
SushilKMrequest may be valid, but say if database crashes during the request22:17
datsun180bthe thinking is that creates and grants for example take nonzero time and it's not fair to ask for the api user to stay on the line while we build a response22:17
SushilKMso does create and delete users and dbs ... do they take much time ....22:17
datsun180bin practice they don't take very long22:18
SushilKMwat i saw was create and delete are async with cast method but grant & revoke are using call method22:18
SushilKMnot able to figure out distinction between y we have difference22:18
datsun180bgrant & revoke are calls? that's a surprise, i thought they were casts, too22:19
SushilKMyep they are calls22:19
SushilKMhttps://github.com/openstack/trove/blob/master/trove/guestagent/api.py#L14622:20
SushilKMhttps://github.com/openstack/trove/blob/master/trove/guestagent/api.py#L15222:20
SushilKMgrant & revoke respectively22:20
* cp16net shruggs why thats the case22:20
datsun180bwell https://github.com/openstack/trove/blob/master/trove/guestagent/datastore/mysql/service.py#L378 is returning None22:20
SushilKMso thats wat i was questioning too, y do we decide that22:21
cp16netlolz22:21
SushilKMhe he he22:21
datsun180bI'm guessing it's because of the validation?22:21
cp16netno clue22:21
datsun180bthat is, the guest might just throw an explode at you if you try some shenanigans22:21
*** yidclare has quit IRC22:22
SushilKMso everyone shud be equal ....22:22
SushilKMi mean create/delete/grant/revoke22:22
cp16netdatsun180b: the guest likes to throw a wrench in to your party22:22
cp16netlol22:22
datsun180bcp16net: the trick is to catch the wrench and throw it back22:22
SushilKMto throw it back we shud first have it22:22
SushilKMand create/delete does not gives the wrench to u22:23
SushilKM;)22:23
SushilKMgrant & revoke provides u wid the toool22:23
datsun180bwell, we do appear to want the guest to do some validation22:23
datsun180bwell what's the worst that can happen if you put up a review to change them all to one or the other, except getting shot down by hub_cap's i3 cannons22:24
SushilKMso, call does not supports the validation22:24
datsun180bwell if it's a call and it explodes we won't hear about it22:25
datsun180ber wait, other way around22:25
SushilKMyep hub_cap is good at shooting ... have few experiences waiting in my queue ...22:25
datsun180bfor casts you just throw it into the ocean and hope it gets there22:25
SushilKMit its a call, and if something bad happened, one wud get an info, for cast nothing happens22:26
datsun180bright22:26
SushilKMwe are on with validations only ......22:26
datsun180bif a cast fails the only way you'll know is you don't see the changes you asked for made22:26
SushilKMyep22:26
SushilKMbut if i was on with a script making multiple requests for an application, its all garbage, that i wud get back22:27
datsun180bfamous last words but "What's the worst that could happen?"22:27
*** demorris has quit IRC22:29
kevinconwaydatsun180b: famous last words "Snarf."22:29
*** rwsu has quit IRC22:34
*** radez is now known as radez_g0n322:34
*** jasonb365 has quit IRC22:35
SushilKMthe worst could i could disturb my database .....22:41
*** jmontemayor has quit IRC22:43
*** jmontemayor has joined #openstack-trove22:44
mat-loweryAnyone know who has access to trove-gate? Can I look at the config?22:49
*** pdmars has quit IRC22:50
datsun180byou mean https://rdjenkins.dyndns.org/job/Trove-Gate/? ?22:52
datsun180byou need to be in the group reddwarf-drivers to retrigger jobs22:52
datsun180beven then i can't view the configs for that job22:53
mat-lowerydatsun180b: thanks22:53
datsun180bdo you need anything retriggered, because i can do that22:54
*** tanisdl has joined #openstack-trove22:54
mat-lowerydatsun180b: thanks. I wanted to see about archiving some logs as part of the job...and understanding some of the confusing output that I assume comes from the job itself22:57
datsun180byeah, you'd probably have to configure the jobs to do that, though they do hold onto their output for a while22:58
mat-loweryok thanks22:58
datsun180bhttps://rdjenkins.dyndns.org/job/Trove-Gate/1/console their archives go all the way back22:59
mat-lowerydatsun180b: Thanks.23:00
*** kevinconway has quit IRC23:01
*** michael-yu has joined #openstack-trove23:03
*** rwsu has joined #openstack-trove23:04
*** jcru has quit IRC23:07
*** datsun180b has quit IRC23:11
*** thedodd has quit IRC23:12
*** yogesh has quit IRC23:13
*** yogesh has joined #openstack-trove23:14
*** citizengrey has quit IRC23:14
*** citizengrey has joined #openstack-trove23:15
*** citizengrey has left #openstack-trove23:15
*** yogesh has quit IRC23:19
*** amytron has joined #openstack-trove23:19
*** rwsu has quit IRC23:22
openstackgerritMat Lowery proposed a change to openstack/trove: Test restore full and restore incremental  https://review.openstack.org/7373623:31
*** achampion has joined #openstack-trove23:39

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!