Wednesday, 2014-04-23

*** sbfox has quit IRC00:08
*** ramashri has joined #openstack-trove00:15
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522500:17
*** ramashri has quit IRC00:22
*** ranjitha has quit IRC00:27
*** matsuhashi has joined #openstack-trove00:29
*** achampion has joined #openstack-trove00:45
*** rueb7363 has quit IRC00:50
*** matsuhashi has quit IRC00:59
*** matsuhashi has joined #openstack-trove01:01
*** ViswaV has joined #openstack-trove01:03
*** eguz has joined #openstack-trove01:20
*** eguz has quit IRC01:20
SlickNikravikumar_hp: That bp's not for the infra team. That's for us to track our progress on the Tempest Tests.01:21
*** sbfox has joined #openstack-trove01:22
*** eghobo has quit IRC01:24
*** achampio1 has joined #openstack-trove01:26
*** lawltoad has joined #openstack-trove01:26
openstackgerritSteve Leon proposed a change to openstack/trove: Add datastore version to backups  https://review.openstack.org/8947401:28
*** achampion has quit IRC01:28
*** sbfox has quit IRC01:29
*** erkules_ has joined #openstack-trove01:29
*** erkules has quit IRC01:31
openstackgerritSteve Leon proposed a change to openstack/trove: Fix datastore tests so that they pass in live mode  https://review.openstack.org/8971701:32
*** lawltoad has left #openstack-trove01:34
*** sbfox has joined #openstack-trove01:34
openstackgerritSteve Leon proposed a change to openstack/trove: Add datastore version to backups  https://review.openstack.org/8947401:35
*** grapex has joined #openstack-trove01:38
*** grapex has joined #openstack-trove01:39
*** nosnos has joined #openstack-trove01:41
*** achampion has joined #openstack-trove01:47
*** achampio1 has quit IRC01:49
*** sbfox has quit IRC01:50
*** rueb7363 has joined #openstack-trove01:54
*** erkules_ is now known as erkules01:54
*** rueb7363 has quit IRC01:59
*** sbfox has joined #openstack-trove02:13
*** coolsvap|afk is now known as coolsvap02:33
*** ViswaV_ has joined #openstack-trove02:37
*** ViswaV has quit IRC02:40
*** harlowja is now known as harlowja_away02:43
*** haomaiw__ has quit IRC02:52
*** grapex has quit IRC02:52
*** haomaiwang has joined #openstack-trove02:52
*** sbfox has quit IRC03:01
*** openstackgerrit has quit IRC03:04
*** openstackgerrit has joined #openstack-trove03:04
*** matsuhashi has quit IRC03:14
*** matsuhashi has joined #openstack-trove03:15
*** matsuhashi has quit IRC03:19
*** nosnos has quit IRC03:29
*** ramishra has joined #openstack-trove03:36
*** sbfox has joined #openstack-trove03:42
*** eghobo has joined #openstack-trove03:48
*** rwsu has quit IRC03:50
*** mattgriffin has joined #openstack-trove03:52
*** mattgriffin has quit IRC03:53
*** ViswaV_ has quit IRC03:57
*** mattgriffin has joined #openstack-trove03:59
*** eghobo has quit IRC04:10
*** eghobo has joined #openstack-trove04:10
*** eguz has joined #openstack-trove04:13
*** sbfox has quit IRC04:15
*** eghobo has quit IRC04:17
*** matsuhashi has joined #openstack-trove04:19
*** nosnos has joined #openstack-trove04:22
*** ramishra has quit IRC04:28
*** ramishra_ has joined #openstack-trove04:30
*** coolsvap is now known as coolsvap|afk04:45
openstackgerritShalini khandelwal proposed a change to openstack/trove-integration: Tests for heat based instance workflow  https://review.openstack.org/6650004:52
*** mattgriffin has quit IRC04:54
*** coolsvap|afk is now known as coolsvap04:57
*** haomaiwang has quit IRC05:03
*** haomaiwa_ has joined #openstack-trove05:07
*** shakamunyi has quit IRC05:14
*** sbfox has joined #openstack-trove05:20
*** sgotliv has joined #openstack-trove05:23
*** coolsvap is now known as coolsvap|afk05:28
*** coolsvap|afk is now known as coolsvap05:36
*** matsuhashi has quit IRC05:37
*** matsuhashi has joined #openstack-trove05:37
*** matsuhashi has quit IRC05:43
*** matsuhashi has joined #openstack-trove05:44
*** matsuhas_ has joined #openstack-trove05:50
*** SushillKM has joined #openstack-trove05:51
*** matsuhashi has quit IRC05:53
*** matsuhas_ has quit IRC05:58
*** matsuhashi has joined #openstack-trove05:58
*** sbfox has quit IRC06:29
*** sbfox has joined #openstack-trove06:29
*** eguz has quit IRC06:42
*** achampio1 has joined #openstack-trove06:43
*** achampion has quit IRC06:45
*** flaper87|afk is now known as flaper8707:01
*** shashank-GL has joined #openstack-trove07:08
*** sbfox has quit IRC07:24
*** ViswaV has joined #openstack-trove07:58
*** ViswaV has quit IRC08:03
*** haomaiwa_ has quit IRC08:05
*** haomaiwang has joined #openstack-trove08:06
*** SnowDust has joined #openstack-trove08:09
*** SushillKM has quit IRC08:14
*** ashishsnigam has joined #openstack-trove08:18
*** SnowDust has quit IRC08:23
*** matsuhashi has quit IRC08:27
*** ramishra_ has quit IRC08:32
*** ramishra has joined #openstack-trove08:32
*** matsuhashi has joined #openstack-trove08:34
*** ramishra has quit IRC08:37
*** ramishra has joined #openstack-trove08:51
*** sgotliv has quit IRC08:56
*** sgotliv has joined #openstack-trove09:01
*** haomaiw__ has joined #openstack-trove09:12
*** haomaiwang has quit IRC09:15
*** denis_makogon has joined #openstack-trove10:08
*** matsuhashi has quit IRC10:16
*** matsuhashi has joined #openstack-trove10:23
*** TomasR_ has joined #openstack-trove10:35
TomasR_Hi, guys. I'm trying to use Trove for the first time. In the http://docs.openstack.org/developer/trove/dev/manual_install.html it says, that: The following information about existing environment is required:10:37
TomasR_Keystone host and port(s) OpenStack administrator’s username, tenant and password Nova compute URL Cinder URL Swift URL RabbitMQ URL, user Id, password Trove’s MySQL connection string10:38
*** coolsvap is now known as coolsvap|afk10:38
TomasR_Can someone tell me, why Swift is required (and not enough to have just Cinder) ?10:38
denis_makogonTomasR_, because Swift is used as backup storage10:53
TomasR_Thanks. Is it an optional component or a must? Say if my goal is to set MySQL and play with it and then destroy it . Do I still need to have Swift just to set Trove with MySQL?10:55
denis_makogonTomasR_, Swift is required10:56
denis_makogonTomasR_, only if you need to do backup/restores via Trove API10:56
TomasR_I see, thanks. I'll set Swift first then and after back onto Trove :)10:56
TomasR_Denis, Oh I only now saw your second line. OK, I'll try to get Trove and MySQL created without Swift first and add Swift when I want to play with backup/restore10:57
denis_makogonTomasR_, ok, ping me if you will need some help10:58
denis_makogonTomasR_, btw, we have plans to make swift optional for backup/restore process10:58
denis_makogonTomasR_, but, as i konw Cinder stores its volume backups/snapshots at Swift10:59
TomasR_Thanks, Denis, I will if I get stuck. I have maybe 10 hours to play with Trove, so I'll see how far I get in that time frame.11:00
denis_makogonTomasR_, ok =011:00
denis_makogon=)11:00
*** matsuhashi has quit IRC11:04
amrithhub_cap, it would've been too late for snowdust. now it is too early for you. what's an mbp?11:16
*** SnowDust has joined #openstack-trove11:52
SnowDustamrith: hi11:52
SnowDustsry! busy with some meetings11:52
SnowDustwhats up ?11:52
amrithSnowDust, good afternoon/evening11:52
amrithday before yesterday, hub_cap and I wanted to find a time when you were online as well so we could discuss our joint blueprint, the code changes he was making etc.,11:53
amrithwanted to do it before the next meeting (next monday)11:53
SnowDustyeah ..11:53
SnowDustlets do that11:53
SnowDustanytime today is fine i will stay upto it :)11:53
amrithok, now let's wait for hub_cap to wake up ;)11:54
*** coolsvap|afk is now known as coolsvap12:01
*** ramishra_ has joined #openstack-trove12:02
*** ramishra has quit IRC12:03
*** achampio1 has quit IRC12:10
*** pdmars has joined #openstack-trove12:10
*** nosnos has quit IRC12:10
*** pdmars has quit IRC12:10
*** pdmars has joined #openstack-trove12:11
denis_makogonamrith, ping12:27
openstackgerritDenis M. proposed a change to openstack/trove: Refactoring strategies implementation  https://review.openstack.org/7789912:29
openstackgerritDenis M. proposed a change to openstack/trove: Support full backup/restore for Cassandra  https://review.openstack.org/7755112:29
openstackgerritDenis M. proposed a change to openstack/trove: Support full backup/restore for Cassandra  https://review.openstack.org/7755112:33
openstackgerritShashank Gupta proposed a change to openstack/trove: Corrected the assertion message in test_dbaas.py file  https://review.openstack.org/8981512:36
*** casanch1 has joined #openstack-trove12:51
*** achampion has joined #openstack-trove12:52
*** casanch1 has quit IRC12:53
*** casanch1 has joined #openstack-trove12:54
SnowDustamrith, will join back in two hours .. bye 4 now !13:03
*** SnowDust has quit IRC13:03
*** ashishsnigam has quit IRC13:04
TomasR_Hi, Denis, is it normal that after 2nd step in this document: http://docs.openstack.org/icehouse/install-guide/install/apt/content/trove-install.html, I have /etc/trove empty? Document says edit: trove.conf, trove-taskmanager.conf, trove-conductor.conf files, but only trove-taskmanager.conf exists. Shall I create other conf files from scratch?13:09
TomasR_P.S. I'm doing it on Ubuntu 14.04 LTS \n \l13:16
dougshelley66TomasR_: there is an open bug to the packagers at Ubuntu regarding that issue13:17
dougshelley66https://bugs.launchpad.net/ubuntu/+source/openstack-trove/+bug/130854313:17
dougshelley66also that installation document was just created last week so we are still working thru a complete validation of it13:18
*** ramishra_ has quit IRC13:18
TomasR_OK, thanks13:20
*** jcru has joined #openstack-trove13:20
openstackgerritDenis M. proposed a change to openstack/trove: Add heat.template for Percona datastore  https://review.openstack.org/7653613:27
openstackgerritDenis M. proposed a change to openstack/trove: Add heat.template for Percona datastore  https://review.openstack.org/7653613:28
*** mattgriffin has joined #openstack-trove13:29
*** robertmyers has joined #openstack-trove13:38
amrithdenis_makogon, pong ...13:48
*** ramishra has joined #openstack-trove13:55
*** rwsu has joined #openstack-trove14:14
*** rueb7363 has joined #openstack-trove14:20
denis_makogonamrith, i want to talk about https://review.openstack.org/#/c/63789/14:22
*** thedodd has joined #openstack-trove14:22
*** grapex has joined #openstack-trove14:23
*** freyes has joined #openstack-trove14:24
*** kevinconway has joined #openstack-trove14:25
*** kevinconway has quit IRC14:26
*** kevinconway has joined #openstack-trove14:47
*** sbfox has joined #openstack-trove14:54
openstackgerritDenis M. proposed a change to openstack/python-troveclient: Add mgmt API for datastores  https://review.openstack.org/8986814:56
TomasR_Guys, I need more help. Because of the bug 1308543, I used these configuration files as a template: https://github.com/openstack/trove/tree/master/etc/trove/  I then was able to successfully create trove mysql database. But when I wanted to initialise the database - nothing happened. I ran this: trove-manage --config-file=/etc/trove/trove_nolog.conf db_sync14:56
TomasR_mysql> show databases     -> ; +--------------------+ | Database           | +--------------------+ | information_schema | | cinder             | | glance             | | heat               | | keystone           | | mysql              | | neutron            | | nova               | | performance_schema | | trove              | +--------------------+ 10 rows in set (0.00 sec)  mysql> use trove; Database changed mysql> show t14:56
fifieldtcheck your sql_connection settings in /etc/trove/trove_nolog.conf14:58
fifieldtalso look for a trove_test.sqlite and remove it if you find one14:58
*** sbfox has quit IRC14:59
TomasR_I noticed that parameter in the documentation uses : [database] connection = mysql://trove:TROVE_DBPASS@controller/trove and not sql_connection14:59
TomasR_I'll try sql_connection instead of connection14:59
fifieldtand if you get a moment, please comment on the ubuntu bug report so the ubuntu guys do things to fix it :D14:59
denis_makogonTomasR_, trove relays at sql_connection15:00
TomasR_cool, I'll give sql_connection a go15:00
fifieldtin the future it will use [database]/connection, but yes - right now sql_connection :)15:00
fifieldtthe mistake is mine15:00
fifieldtso, apologies15:00
fifieldtbut there's a patch in to fix that :)15:01
fifieldt(https://review.openstack.org/#/c/88225/ is waiting to merge)15:01
*** shakamunyi has joined #openstack-trove15:01
fifieldtbut you can use http://docs-draft.openstack.org/25/88225/4/check/gate-openstack-manuals-tox-doc-publish-checkbuild/6819c34/publish-docs/ for the latest15:02
TomasR_no worries :) I realise that all code and doc is quite fresh. There is some fun in going via path that is new15:02
*** shakamunyi has quit IRC15:02
*** shakamunyi has joined #openstack-trove15:03
TomasR_fifieldt, thanks for the link15:04
hub_capamrith: looks like SnowDust is gone?15:06
hub_capand im barely awake, configuring my debian macbook :P15:06
*** erik508_ is now known as erik_x115:07
*** keymon has joined #openstack-trove15:07
amrithhub_cap, go back to bed. debian on a macbook? really? please let me know how it goes, I'm considering some new hardware. and yes, it does look like snowdust is awol. but he said he'd be back15:08
hub_capyea ive got x runnin rigth now on it15:09
hub_capif yer considering new hw tho, u might go the x1 carbon route :)15:09
hub_capworks pretty well w/ ubuntu, and im sure debian will catch up15:09
openstackgerritDenis M. proposed a change to openstack/trove: Add mgmt API for datastores  https://review.openstack.org/8987315:14
*** demorris has joined #openstack-trove15:15
*** jmontemayor has joined #openstack-trove15:15
*** keymon has quit IRC15:17
*** SushillKM has joined #openstack-trove15:21
amrithhub_cap, I was thinking dell ;)15:24
*** sgotliv has quit IRC15:24
*** amrith is now known as amrith-is-awol15:25
*** ViswaV has joined #openstack-trove15:39
openstackgerritDan Nguyen proposed a change to openstack/trove: Added route for Admin API to support guest upgrade  https://review.openstack.org/8141015:40
*** ViswaV_ has joined #openstack-trove15:40
*** freyes has quit IRC15:42
openstackgerritTim Simpson proposed a change to openstack/trove: Make sure eventlet starts correctly  https://review.openstack.org/8942515:43
*** ViswaV has quit IRC15:44
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168215:45
*** SushillKM has quit IRC15:52
*** eghobo has joined #openstack-trove15:55
*** shakamunyi has quit IRC16:03
*** shakamunyi has joined #openstack-trove16:05
*** sbfox has joined #openstack-trove16:09
*** mattgriffin has quit IRC16:09
*** mattgriffin has joined #openstack-trove16:14
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522516:16
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522516:24
TomasR_fifieldt, in the latest draft, of the installation document: http://docs-draft.openstack.org/25/88225/4/check/gate-openstack-manuals-tox-doc-publish-checkbuild/6819c34/publish-docs/trunk/install-guide/install/apt/content/trove-install.html, there is a line sudo su -s /bin/sh -c "trove-manage db_sync" trove. In the non-draft it's this command: trove-manage --config-file=/etc/trove/trove_nolog.conf db_sync16:26
SlickNikTomasR_: Is that causing an issue?16:26
TomasR_I tried to use from the draft document, but it appears to be creating sqlite database. Does it mean it's not it using sqllite by default?16:27
SlickNikTomasR_: Have you made sure you are setting the sql_connection=<connection string> parameter in your trove conf?16:27
TomasR_If I want to populate mysql database with tables do I actually have to specify config file or config dir?16:27
TomasR_cat /etc/trove/trove.conf | grep sql_connection | grep -v \# sql_connection = mysql://trove:trove@controller/trove16:29
SlickNikTomasR_: In my experience, I didn't have to explicitly specify the config file, but had to have the sql_connection parameter set in the DEFAULT section of the config file.16:29
TomasR_cat /etc/trove/trove_nolog.conf | grep sql_connection | grep -v \# sql_connection = mysql://trove:trove@controller/trove16:29
*** freyes has joined #openstack-trove16:29
SlickNikTomasR_: Does that connection string work? i.e. does controller resolve to your mysql_server, and does there exist a 'trove' user that can connect using that password?16:30
*** demorris has quit IRC16:31
TomasR_mysql -u trove -ptrove connects file16:32
TomasR_I mean: connects fine16:33
*** demorris has joined #openstack-trove16:33
SlickNikOh, there's also a ubuntu packaging bug where the directories for the log files are not writeable.16:34
SlickNikTomasR_: I think that's probably what's causing the issue.16:34
SlickNik(Maybe?)16:34
TomasR_We fixed the permissions issue - it was a problem16:34
TomasR_now log files get created16:34
*** radez_g0n3 is now known as radez16:36
SlickNikOkay. Please try running:16:36
SlickNiksudo su -s /bin/sh -c "trove-manage —config-file=/etc/trove/trove.conf db_sync" trove16:36
TomasR_OK, let me try with providing a config file16:36
SlickNikAnd see if that does the right thing.16:36
SlickNikThere may be a bug with the db_sync command that requires an explicit path to the conf.16:37
TomasR_Oh, actually sql_connection is not in the DEFAULT section of the configuration file. It was in the [database] section. I'm moving this line to DEFAULT section and I'll execute again without specifying config file16:37
SlickNikcool TomasR_. Thanks for double checking.16:38
TomasR_Cool - 20 tables got created in MySQL trove DB.16:40
TomasR_The problem was that sql_connection parameter was not in the DEFAULT section. Moving to the next step! :)16:40
SlickNikNo worries.16:41
*** sbfox has quit IRC16:41
*** amcrn has joined #openstack-trove16:47
*** mattgriffin has quit IRC16:47
*** sbfox has joined #openstack-trove16:48
*** SushillKM has joined #openstack-trove16:52
openstackgerritAnna Shen proposed a change to openstack/trove: Add neutron support (WORKINPROGRESS)  https://review.openstack.org/8834916:54
*** mattgriffin has joined #openstack-trove16:55
*** SushillKM has quit IRC16:56
*** ramishra has quit IRC16:57
*** ramishra has joined #openstack-trove16:57
*** zuqiang has joined #openstack-trove17:01
*** demorris has quit IRC17:02
*** ramishra has quit IRC17:02
*** ashishsnigam has joined #openstack-trove17:02
*** demorris has joined #openstack-trove17:03
*** harlowja_away is now known as harlowja17:06
*** spligak has joined #openstack-trove17:09
*** demorris has quit IRC17:10
*** amrith-is-awol is now known as amrith17:12
amrithdenis_makogon, you there?17:13
denis_makogonamrith, yes17:13
amrithaha17:13
denis_makogonamrith, hope last my answer covered all your questions17:13
amrithwassup? you were looking for me some time back? some part of me is back here now (the rest is still in a pub some miles away)17:13
amrithhmmmmmmm17:14
amrith63789?17:14
denis_makogonamrith, https://review.openstack.org/#/c/63789/24/trove/common/cfg.py17:14
*** ranjitha has joined #openstack-trove17:14
*** eghobo has quit IRC17:17
*** ramashri has joined #openstack-trove17:17
amrithok, denis_makogon ...17:18
amrithlet me begin with the following disclaimer17:18
amrithI don't know much about trove17:18
amrithand I don't know much about the code base17:18
amrithand I don't know much about a lot of things17:18
amrithbut ...17:18
*** eghobo has joined #openstack-trove17:19
amrithtake a look at line 156 in the same file cfg.py17:19
amrithit reads17:19
amrithcfg.StrOpt('backup_strategy', default='InnoBackupEx',156    cfg.StrOpt('backup_strategy', default='InnoBackupEx',17:19
amrith157               help='Default strategy to perform backups.'),17:19
*** eghobo has quit IRC17:20
amriththis is a common opt which is then over-riden by each implementation?17:20
*** eghobo has joined #openstack-trove17:20
amrithWhy do you want to add allow_database_logging=False in 6 places instead of just one?17:20
robertmyersamrith: cause the old cfg assumed there was only one datastore17:21
robertmyersnow we need to support N17:21
robertmyersthat is a hold over from the dark ages17:21
amrithrobertmyers, hello17:23
amrithhub_cap and I are chatting about a related thing17:23
hub_capwe are? ;)17:23
amrithand the fact that we've got gobs of code that is cut-and-pasted around the place17:23
hub_capim just tring to get my microphone to work on my mbp17:23
amrithhub_cap, we were supposed to be bug SnowDust isn't here, remember?17:24
amrithhub_cap, yes? no?17:24
robertmyersamrith: I agree there is room for cutting out the duplication17:25
robertmyersbut for configs each datastore needs its own17:25
amrithrobertmyers, (and hub_cap if his macbook with debian works again), I'm wondering why we need six blocks of code that basically say foo=False17:25
robertmyerswe need a good way to set it up tho17:25
denis_makogonamrith, not so long ago, trove had only one datastore - mysql, now it has alot, i suppose17:25
robertmyersamrith: technically these are 6 different config options not lines of code17:26
robertmyersthey are copies now, but you could have mongo=true mysql=false17:27
denis_makogonamrith, i agree with robertmyers, each duplicate acts like totally different config attribute, very specific to the datastore option group17:28
amrithrobertmyers, I'm fine with the "technical" interpretation, just seems like a less than optimal way to code something that is called the same thing in all places. And we've got a lot of these "technically" different options, like "root_on..."17:28
robertmyersamrith: that is the only way to do it with olso.config17:28
denis_makogonamrith, we cannot reduce them17:28
denis_makogonamrith, again agreed with robertmyers17:28
*** demorris has joined #openstack-trove17:29
amrithso, who reads common_opts?17:29
amrithline 34 in same file?17:30
amrithasking this because I don't have a source tree handy17:30
amrithelse I'd look17:30
*** ranjitha has quit IRC17:30
amrithand where's hub_cap? hello hello ;)17:32
*** denis_makogon has quit IRC17:32
*** shakayumi has joined #openstack-trove17:32
*** shakamunyi has quit IRC17:32
*** denis_makogon has joined #openstack-trove17:33
hub_capummm hello?17:33
amrithhub_cap, this was part of what we were to discuss, the BP to combine common code for multiple datastores etc.17:34
hub_capim kinda off/on due to the install17:34
hub_capi swear im installing a new machine like every wk these days17:35
amrithhub_cap, ok. will catch u later then17:35
hub_capmy chromebook 2x, the x1c, and now this mbp17:35
amrithhub_cap, you should try this cloud thing. you get machines (preconfigured) with OS and all. have you heard about openstack NOVA? it's cool ;)17:35
hub_capbah17:35
hub_capi have terrible latency to my free cloud17:35
amrithhub_cap, for a fee, I'll get you lower latency.17:36
hub_caplol, i prefer my fees to have R's in them17:36
*** denis_makogon has quit IRC17:36
*** yogeshmehra has joined #openstack-trove17:36
amrithyou lost me there, I'll claim that it was the slumbrew tripel17:36
hub_capfRees ;)17:36
dougshelley66i thought is was R for Rackspace :)17:37
hub_capit is for me, fR(ackspace)ee cloud17:37
amrithdougshelley66, ++17:37
amrithoh, free as in speech, not free as in beer?17:38
openstackgerritDan Nguyen proposed a change to openstack/trove: Added route for Admin API to support guest upgrade  https://review.openstack.org/8141017:38
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168217:38
amrithah well, so much for the conversation with robertmyers and denis_makogon; denis is now awol ;)17:39
amrithrobertmyers, ... my concern is this. if we can have common_opts (as in line 34) which are shared across all data stores and database logging is of that same ilk, why not make it a common option?17:39
*** shakayumi has quit IRC17:40
amrithif what you are telling me is that oslo has only one namespace, then lets make a namespace for cross-datastore options; if possible.17:40
*** sriram_ has joined #openstack-trove17:40
amrithand believe me when I say it, I speak from profound ignorance.17:40
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522517:45
robertmyersamrith: I think that the idea is that this is *not* common accross datastores17:45
robertmyersif we want a common option we just use the default global group17:46
*** NehaV has joined #openstack-trove17:46
*** yogeshmehra has quit IRC17:47
*** sbfox has quit IRC17:48
SlickNikreminder: Trove meeting in 5 in #openstack-meeting-alt17:53
*** sgotliv has joined #openstack-trove17:56
SlickNikIt's time :)17:59
*** saurabhs has joined #openstack-trove18:00
amrith\0/18:00
*** eguz has joined #openstack-trove18:01
*** atomic77 has joined #openstack-trove18:01
*** ranjitha has joined #openstack-trove18:04
*** michael-yu has joined #openstack-trove18:04
*** SnowDust has joined #openstack-trove18:05
*** eghobo has quit IRC18:05
*** ranjitha has quit IRC18:07
*** ranjitha has joined #openstack-trove18:08
*** Barker has joined #openstack-trove18:08
*** casanch1 has quit IRC18:09
*** michael-yu has quit IRC18:11
*** shakamunyi has joined #openstack-trove18:19
*** atomic77 has quit IRC18:31
*** yogeshmehra has joined #openstack-trove18:32
amrithhub_cap, SnowDust looks like both of you are here ...18:34
SnowDusthi amrith18:34
amrithhi SnowDust ... hub_cap is trying to fix his PC so let's give him a couple of minutes18:34
SnowDustsure18:35
SnowDustwill hang around18:35
hub_caphey i can chat18:35
*** sgotliv has quit IRC18:35
amrithhey! looks like we're all here18:35
hub_capso what do yall want to chat about :)18:35
amrithdo we want to go to a quiet corner or stay in #openstack-trove?18:35
hub_caphere18:36
hub_capalways here18:36
amrithno "hush hush backroom deals"?18:36
hub_capexactly18:36
hub_capand this is logged18:36
hub_capso we can point peopl here18:37
amriththis is no fun ;) I like intrigue ...18:37
hub_cap:)18:39
hub_capso what we talkin about?18:39
hub_capi wanted to mention that snowdust's approach of the options.py is ok for now18:39
hub_capbut that i want us to load the list of datstores from the database, rather than a config value18:39
hub_capsince yer already configuring that in the database18:39
hub_capSnowDust: sound reasonable?18:40
SnowDust:) let me understand .. it first18:40
amrithwhat're we talking about ... one part of it is SnowDust's code. the other is a BP I wrote18:40
hub_capright18:40
hub_caplets start w/ SnowDust 's code18:40
SnowDusthub_cap : list of datastores from database  ( do u mean the default ones ? )18:42
openstackgerritAnna Shen proposed a change to openstack/trove: Add integration test for Neutron support  https://review.openstack.org/8267318:42
hub_capSnowDust: we have a datastores/types table18:45
hub_capin order for u to allow a customer to choose a type18:45
hub_capit has to be in there18:45
hub_capso instead of having to do that _and_ also configure it in the config file18:45
hub_capjust pull the list of datastores from that table18:46
hub_capand autoload them18:46
SnowDustok .. got it .. so idea is to do management commands .. for the external store .. and then code follows from there.18:46
SnowDustby autoloading18:46
SnowDustyes .. sounds good18:46
hub_capwell u have to do that anywya18:46
hub_capto allow a customer to use18:46
hub_capthen u dont have to edit the table _and_ the config file18:46
hub_capor forget one18:46
hub_capand have a system you are confused about :)18:46
SnowDusthehe .. i got the optimisation you are saying ..18:47
yogeshmehrahub_cap: this sure makes sense18:47
SnowDustwill change the code .. to reflect this18:47
*** pdmars has quit IRC18:47
hub_capyogeshmehra: thx :)18:47
hub_capSnowDust: awessome18:47
SnowDustbut but but ..18:47
hub_capok so someone link me amrith 's blueprint18:47
hub_cap???18:47
*** sgotliv has joined #openstack-trove18:47
SnowDuststill thinking .. if we have the db connection working .. before the cfg load ?18:48
amrithsorry, I wandered away18:49
grapexjuice: Are you still rocking vmware-fusion?18:49
hub_capyou can load them after that somewhre SnowDust, id think18:49
hub_capjust figure it out :)18:49
SnowDustOK :-)18:50
hub_capcuz u will have a config loaded before someone calls POST /instances18:50
amrithwhere the heck is my bp ;(18:50
hub_capamrith: SlickNik pruned a bunch18:50
hub_caphe prolly just nuked it18:50
amrithit had deep thoughts ;)18:50
hub_capim pretty sure he amn amcrn were just killing all BPs reg'd by you18:50
amrithfound it18:51
SnowDusthttps://blueprints.launchpad.net/trove/+spec/trove-unify-common-code-for-config-of-guest-agent-variants18:51
SnowDusthere u go !18:51
amriththey didn't do a good job (clearly)18:51
hub_caplol18:51
amrithso here's the summary18:51
amrithwe have options for the generic datastore18:51
amriththen we have options for the generic MySQL datastore18:51
amriththen we have options for the generic Percona flavor of MySQL datastore18:52
hub_capso amrith fwiw, i tlaked to SlickNik vipul amcrn and we considered, for now, just nuking the percona bits18:52
amrithand then we have options for the percona version 5.5 of the MySQL datastore18:52
hub_capcuz its simple as changing the package you install right?18:52
amriththat's just an example18:52
amrithif it isn't percona, it's something else18:52
amrithstay with me for a second18:52
hub_capsure but in this case its mysql18:52
amrithso there's mysql18:52
hub_capin its many variants, or mongo/toku18:52
amriththere is at least the issue of the generic datastore and the MySQL (under it there may be others)18:53
amrithsimilarly there is mongo/toku18:53
amrithright now trove/common/cfg.py is a pig-sty18:53
amrithmaybe this is because of oslo.config18:53
amrithrobertmyers and I were discussing this earlier in the context of another review18:54
amrithbut we're duplicating code at a furious rate18:54
amrithand the idea was to see if we could either (a) split cfg.py or (b) consolidate duplicate code18:54
amrithnow (in fairness) robertmyers convinced me that in the review we were discussing18:54
amrithwe were not duplicating code18:54
amrithbut there's still a ton of identical lines of code18:55
amrithbecause of the way oslo.config works18:55
amrithand I'd like to avoid that18:55
hub_capso whats the split yer referring to?18:55
amrithone option is to make a config file with all the common configuration options and a per datastore set of overrides18:56
hub_capthe way cfg works is, if you have say, 5 places you need to grab value X from, i tneeds to go into acommon place18:56
*** NehaV has quit IRC18:56
hub_capbut the files themselves vs the cfg.py are orthoginal18:56
amrithor (b) having just one file and having consoldiation in there18:56
hub_capu can have 100 files18:56
hub_capand one cfg.py18:56
*** sbfox has joined #openstack-trove18:56
hub_capor one file and 100 cfg.py's18:56
hub_capthe behavior in the code should be as follows18:56
hub_capif you use it only in example: tasmgr/api.py18:57
amriththis is the one we were discussing18:57
amrithhttps://review.openstack.org/#/c/63789/18:57
hub_capput the config value in the top of apy.py18:57
hub_capif u need it in, say, 10 files18:57
hub_capu put it in cfg.py18:57
amrithwhy on earth should we have 6 copies of allow_database_logging?18:57
hub_capamrith: if the value will differe per datastore18:57
hub_capthen we need X copies18:57
hub_capif u are thinking that allow18:57
juicegrapex: yes18:58
hub_capthat allow_datastore_logging will be configured site wide18:58
hub_capthen it shouldnt be in those optgrps18:58
juicegrapex: most of us here are using vmware-fusion18:58
juicegrapex: with the help of datsun180b I have vagrant spinning up devstacks left and right18:58
grapexjuice: cp16net and I are seeing an issue18:59
grapexdevstack is building an egg from trove then chowin'ing it18:59
cp16netye18:59
grapexjuice: Sound familar?18:59
grapexjuice: We're using redstack install19:00
SnowDusthub_cap : many options are not even there ... what about default charset ? storage engine ? etc .19:00
cp16netgrapex: https://github.com/openstack-dev/devstack/blob/master/functions-common#L130519:00
juicegrapex: that is possible that I saw it but I have since switched over to using rsync'd folders19:00
cp16netthats the line thats causing us problems19:00
cp16netjuice: oh... that might be better...19:00
hub_capSnowDust: that migth be a bug then ;)19:01
juicecp16net, grapex: since i am usually experimenting with stuff in my dev env on my host machine, I usually want that to be my trove source rather than github etc.  so rsync-ing (even better rsync_auto) is the path I went down19:02
amrithhub_cap, backing up a second ... are you saying that we should have configs only for a generic MySQL, a generic <other datastore name here> etc?19:02
juicecp16net, grapex, but yes, I think that chown statement was causing problems earlier19:02
amrithwhat does a dweeb who wants some other flavor of the generic datastore do?19:02
amrithsorry, is it PC to call openstack users <dweebs>?19:03
openstackgerritA change was merged to openstack/trove: Fix Couchbase Kill Command  https://review.openstack.org/8780619:03
cp16netjuice: yea thats exactly our problem19:03
juicecp16net, grapex: in fact using the default sync mechanism was problematic, but type: "rsync" is mucho better19:03
openstackgerritA change was merged to openstack/trove: changing conductor logging levels  https://review.openstack.org/8702519:03
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168219:03
grapexjuice: Is 'rsync' a vagrant option?19:04
*** NehaV has joined #openstack-trove19:04
cp16netyeah19:04
juicegrapex: yes on syncedfolder19:04
cp16neti see ...19:04
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168219:04
cp16netgrapex: http://docs.vagrantup.com/v2/synced-folders/rsync.html19:04
juicegrapex: cp16net config.vm.synced_folder "/Users/jhopper/workspace/trove-integration", "/home/vagrant/trove-integration", create: true, type: "rsync_auto"19:05
cp16netjust need to add the type: "rsync"19:05
*** demorris has quit IRC19:05
juicethe excludes is also handy19:05
juiceconfig.vm.synced_folder "/Users/jhopper/workspace/trove", "/opt/stack/trove", create: true, type: "rsync", rsync__exclude: [".tox/","trovetest.log"]19:05
cp16netoh.. the type rsync_auto works...19:05
cp16netnice19:05
juicecp16net: I thinks so :)19:06
juicenot sure If I have built a vm since adding that19:06
cp16netso you dont use auto on all trove/trove-integration/python-troveclient?19:06
cp16neti'll make that change to our vagrant script19:06
cp16netand ask datsun for admin rights to that repo19:07
cp16netoh juice i think that needs to be a little differnt..19:08
cp16netrysnc__auto: True19:08
hub_capamrith: the thing that scares me is test covereage, going back to the matrix of mysqls19:08
hub_capcuz we have mysql 5.1 5.5 5.6, percona 5.5 5.6, maria 5.5 10.019:08
hub_capor we have mysql 5.1, 5.5, 5.6 (evantually)19:09
hub_capand less things to test19:09
grapexjuice: That sounds good, but I'm kind of confused why rsync would ever be more convient since you have to set up rsync-auto or remember to sync19:09
hub_capthe only other actual deployment of trove uses percona under the mysql type :)19:09
*** ashishsnigam has quit IRC19:10
amrithmy point exactly19:10
cp16netgrapex: auto will detect the changes and sync them19:10
amrithso the more common code you have, the less your test matrix is19:10
amrithand there is going to be a ton of common config19:10
SnowDusthub_cap .. mariadb is a drop in replacement for mysql .. not the other way .. so a similarity implementation will cut down mariadb in features19:10
amrithbut not the way we're going now ;)19:10
cp16netgrapex: i'm testing it now19:11
hub_capSnowDust: user facing features?19:11
SnowDuststorage engine ..19:11
hub_caphow does that affect our api SnowDust ?19:11
hub_capa user can log in and use whatever engine they want19:12
SnowDusti am saying .. if we just implement commonality .. mariadb full implementation never happens19:12
hub_capamrith: the common config is the easiest thing to test19:12
hub_capim more worried about the backend guest impls19:12
hub_capand just spinning them up to test19:12
hub_capit is costly from a gate perspective19:12
amrithso I'm wondering whether we need to really duplicate the code the way we do19:12
hub_capif we have 800 datastores itll take 10 days to test it all19:13
hub_capand we become the biggest gate offender ever19:13
hub_capeventually otehr projects will gate on us19:13
amrithwhen we have 800 datastores, then we'll have the resources to test them19:13
hub_capamrith: youd think so right?19:13
amrithright now, we have 5 but only one user of each19:13
hub_capthen why did the gate slow down to 2+ days last time19:13
hub_capgo read the emaisl about it, it was almost never capacity19:13
amrithwhat was it then?19:13
hub_capthe testing infra19:14
hub_capand the sheer number of reviews19:14
hub_capnow add our 9 datastores to it, including versions19:14
hub_capto every review19:14
amrithyes, the number of reviews and the time is more because that is more related to lines of code change ;)19:14
hub_capand we double review time19:14
hub_capbut in the end they all must pass the gate19:14
amrithI'm looking to reduce the number of lines changing even as the number of datastores goes up19:14
*** pdmars has joined #openstack-trove19:14
hub_capbut youre solving the config issue, which is note really that much of an issue19:14
*** pdmars has quit IRC19:15
hub_capthe bigger issue is why do we have mysql, percon, and maria19:15
hub_caprather than saying we work w/ mysql19:15
hub_capif u wanna plug in maria, go for it19:15
*** pdmars has joined #openstack-trove19:15
SnowDusthub_cap right ..19:15
SnowDustwhy we have a "common" concept19:15
SnowDustkilling .. "optimum features" that are datastore specific19:16
hub_caplike what SnowDust19:16
hub_capwhat can u not do if u plug in maria19:16
hub_capu have root if u need it19:16
hub_capu can do anuything u want19:16
hub_capthats not the point19:16
hub_captrove+percona works today19:17
hub_capand hp uses it as their "mysql"19:17
hub_capnot as "percona"19:17
hub_capand they see no loss in features19:17
amrithhmmm ...19:18
robertmyersyeah so we only need one manager for mysql like dbs19:21
robertmyersbut you can have N mysql variants in datastores using the same manager19:22
cp16netye19:22
cp16net+119:22
robertmyersso each manager should have an opt group in cfg19:22
robertmyersand those options should live in the manager.py file19:23
robertmyersdone19:23
hub_caprobertmyers: yup its not a ton of work19:23
hub_capmysql opts live in one place19:23
hub_capbut the problem w/ the opts is that they span just the guest19:24
hub_caplike taskmgr needs to know if root on create is enabled for creates19:24
hub_capand i managed to move all that to the guest19:24
robertmyerslame19:24
hub_capbut the code was _just as ugly_ (tm)19:24
*** ViswaV_ has quit IRC19:24
hub_capand added rpc calls19:24
hub_capand frankly the guest never needed them19:24
hub_caphehe19:24
SnowDust:)19:25
hub_capso im ok w/ the select * from datastores ; autoload those files19:25
amrithOK, I'll +1 on that19:25
* hub_cap grabs a wrench19:25
amrithand robertmyers I think that addresses our earlier conversation as well19:25
*** sbfox has quit IRC19:26
robertmyershub_cap: so would root on create be set in capabilities?19:26
robertmyersthat could fix the common taskmanager issues19:26
*** sbfox has joined #openstack-trove19:26
* amrith grins from ear to ear19:26
robertmyersand reduce cut and paste code19:27
amrithrobertmyers example can be used as a template for several others as well ...19:28
hub_caprobertmyers: all of the issues i had was due to not having capabilities yet19:30
hub_capbut we cant just keep saying that19:30
hub_capwe have to do the work (aka review/merge it)19:30
hub_capthats part of the reason i stopped coding it19:31
hub_capbut the ports are not capabilites19:31
hub_capso the answer is yes adn no, depending on the value19:31
robertmyersok19:33
robertmyerswell, lets merge it then19:33
robertmyers+219:34
hub_capLOL19:34
cp16netgrapex: hey i got it to work better now :)19:37
*** rueb7363 has quit IRC19:38
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522519:43
*** zuqiang has quit IRC19:47
openstackgerritDan Nguyen proposed a change to openstack/trove: Added route for Admin API to support guest upgrade  https://review.openstack.org/8141019:48
*** SnowDust has quit IRC19:50
*** rueb7363 has joined #openstack-trove19:52
*** rueb7363 has quit IRC19:59
openstackgerritA change was merged to openstack/database-api: Updated from global requirements  https://review.openstack.org/8871819:59
*** ViswaV has joined #openstack-trove20:00
*** rueb7363 has joined #openstack-trove20:11
openstackgerritDaniel Salinas proposed a change to openstack/trove: Add instance metadata functionality to trove  https://review.openstack.org/8212320:15
*** NehaV has quit IRC20:17
*** eguz has quit IRC20:19
*** eghobo has joined #openstack-trove20:20
*** NehaV has joined #openstack-trove20:21
*** sbfox has quit IRC20:23
*** khyati_ has joined #openstack-trove20:26
*** achampio1 has joined #openstack-trove20:33
openstackgerritPeter Stachowski proposed a change to openstack/python-troveclient: Changed Trove CLI list headers to match Nova CLI  https://review.openstack.org/8993020:34
*** achampion has quit IRC20:34
*** michael-yu has joined #openstack-trove20:35
*** harlowja is now known as harlowja_away20:44
*** sriram_ has quit IRC20:46
*** NehaV has quit IRC20:52
*** harlowja_away is now known as harlowja21:05
*** shakamunyi has quit IRC21:17
*** achampio1 has quit IRC21:20
*** radez is now known as radez_g0n321:21
*** casanch1 has joined #openstack-trove21:23
dougshelley66any chance i could get some reviewer eyes on https://review.openstack.org/#/c/88591/21:25
*** Barker has quit IRC21:29
*** fifieldt has quit IRC21:32
*** fifieldt has joined #openstack-trove21:33
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168221:33
*** jmontemayor has quit IRC21:34
*** casanch1_ has joined #openstack-trove21:34
*** casanch1 has quit IRC21:36
*** casanch1_ has quit IRC21:39
openstackgerritSteve Leon proposed a change to openstack/trove: Unmounting ephemeral if it has already been mounted  https://review.openstack.org/8137921:45
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522521:47
*** TomasR_ has quit IRC21:50
*** robertmyers has quit IRC21:52
*** robertmyers has joined #openstack-trove21:52
*** yidclare has quit IRC21:56
*** robertmyers has quit IRC21:58
*** yogeshmehra has quit IRC22:02
*** pdmars has quit IRC22:02
*** sbfox has joined #openstack-trove22:04
*** sbfox1 has joined #openstack-trove22:08
*** sbfox has quit IRC22:09
openstackgerritPeter Stachowski proposed a change to openstack/python-troveclient: Changed Trove CLI list headers to match Nova CLI  https://review.openstack.org/8993022:10
*** harlowja has quit IRC22:14
*** yogeshmehra has joined #openstack-trove22:23
openstackgerritAnna Shen proposed a change to openstack/trove-integration: Add neutron switch for int tests  https://review.openstack.org/8785622:28
*** sgotliv has quit IRC22:30
*** amcrn has quit IRC22:34
*** sbfox1 has quit IRC22:34
*** yidclare has joined #openstack-trove22:35
*** thedodd has quit IRC22:36
*** shakamunyi has joined #openstack-trove22:39
*** sbfox has joined #openstack-trove22:39
openstackgerritDan Nguyen proposed a change to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168222:43
openstackgerritDan Nguyen proposed a change to openstack/trove: Partially implements guest agent upgrade strategy  https://review.openstack.org/8522522:43
*** shakamunyi has quit IRC22:52
*** rueb7363 has quit IRC22:54
*** achampion has joined #openstack-trove22:56
*** shakamunyi has joined #openstack-trove22:59
*** grapex has quit IRC23:01
*** flaper87 is now known as flaper87|afk23:05
*** NehaV has joined #openstack-trove23:06
*** ranjitha has quit IRC23:09
*** NehaV has quit IRC23:18
*** sbfox has quit IRC23:22
*** kevinconway has quit IRC23:24
*** Barker has joined #openstack-trove23:27
*** kevinconway has joined #openstack-trove23:28
*** yogeshmehra has quit IRC23:31
*** ranjitha has joined #openstack-trove23:31
*** sbfox has joined #openstack-trove23:31
*** kevinconway has quit IRC23:43
*** michael-yu has quit IRC23:43
*** jcru has quit IRC23:47
openstackgerritSteve Leon proposed a change to openstack/python-troveclient: Adding command for copying backups  https://review.openstack.org/8997223:47
*** ramashri has quit IRC23:48
*** ramashri has joined #openstack-trove23:49
*** michael-yu has joined #openstack-trove23:51
*** ramashri has quit IRC23:54
*** sbfox has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!