Wednesday, 2014-06-11

*** michael-yu has quit IRC00:08
*** iccha_ has joined #openstack-trove00:10
*** iccha has quit IRC00:13
openstackgerritDan Nguyen proposed a change to openstack/trove: Added route for Admin API to support guest upgrade  https://review.openstack.org/8141000:20
*** annashe__ has quit IRC00:24
*** yidclare has quit IRC00:25
*** iccha_ has quit IRC00:26
*** matsuhashi has joined #openstack-trove00:28
*** yidclare has joined #openstack-trove00:32
*** yidclare has quit IRC00:36
*** grapex has joined #openstack-trove00:44
*** achampion has joined #openstack-trove00:51
*** ramishra has joined #openstack-trove01:09
*** sbfox has joined #openstack-trove01:15
openstackgerritOpenStack Proposal Bot proposed a change to openstack/python-troveclient: Updated from global requirements  https://review.openstack.org/9909501:37
openstackgerritOpenStack Proposal Bot proposed a change to openstack/trove: Updated from global requirements  https://review.openstack.org/9627501:38
*** annashe__ has joined #openstack-trove01:41
*** nosnos has joined #openstack-trove01:46
*** robertmyers has joined #openstack-trove01:47
*** miqui has joined #openstack-trove01:48
*** robertmyers has quit IRC01:49
*** robertmyers has joined #openstack-trove01:49
*** ramishra has quit IRC02:04
*** sbfox has quit IRC02:05
openstackgerritA change was merged to openstack/trove: Add a new column and indexes to agent_heartbeats  https://review.openstack.org/8168202:07
*** ramashri_ has quit IRC02:22
*** ramishra has joined #openstack-trove02:25
*** cweid has quit IRC02:42
*** demorris has joined #openstack-trove03:01
*** sbfox has joined #openstack-trove03:10
*** sbfox has quit IRC03:12
*** demorris has quit IRC03:25
*** haomaiwang has joined #openstack-trove03:28
*** haomai___ has joined #openstack-trove03:30
*** haomai___ has quit IRC03:32
*** haomaiwang has quit IRC03:32
*** haomaiwang has joined #openstack-trove03:33
*** nosnos has quit IRC03:33
*** jasonb365 has joined #openstack-trove04:02
*** robertmyers has quit IRC04:03
*** annashe__ has quit IRC04:05
*** michael-yu has joined #openstack-trove04:06
*** Longgeek has joined #openstack-trove04:10
*** nosnos has joined #openstack-trove04:15
*** matsuhashi has quit IRC04:19
*** matsuhashi has joined #openstack-trove04:19
*** sbfox has joined #openstack-trove04:20
openstackgerritA change was merged to openstack/python-troveclient: Overwrite HelpFormatter constructur to extend argument column  https://review.openstack.org/9788604:22
openstackgerritShalini khandelwal proposed a change to openstack/trove-integration: Added datastore type and version in test.conf  https://review.openstack.org/8496404:23
*** matsuhashi has quit IRC04:23
*** matsuhashi has joined #openstack-trove04:27
*** michael-yu has quit IRC04:31
*** haomaiwang has quit IRC04:34
*** haomaiwang has joined #openstack-trove04:34
*** coolsvap|afk is now known as coolsvap04:36
*** michael-yu has joined #openstack-trove04:36
*** sgotliv_ has joined #openstack-trove04:37
*** michael-yu has quit IRC04:38
*** sbfox has quit IRC04:44
*** coolsvap is now known as coolsvap|afk04:46
*** coolsvap|afk is now known as coolsvap04:53
*** grapex has quit IRC04:58
openstackgerritShuichiro MAKIGAKI proposed a change to openstack/trove: Add warnings when a path for api_extensions_path does not exist  https://review.openstack.org/9900105:14
*** denis_makogon has joined #openstack-trove05:14
*** jasonb365 has quit IRC05:15
*** sgotliv_ has quit IRC05:15
*** sbfox has joined #openstack-trove05:20
*** SushilKM has joined #openstack-trove05:32
denis_makogonSushilKM, ping05:36
SushilKMyep denis_makogon05:38
SushilKMGood Morning05:38
openstackgerritA change was merged to openstack/python-troveclient: Added optional marker/limit to list command  https://review.openstack.org/9793605:42
*** michael-yu has joined #openstack-trove05:43
denis_makogonSushilKM, could you please find Shalini, i need to talk to him05:53
SushilKMshe is not yet logged into IRC05:57
*** Longgeek has quit IRC05:59
*** yogeshmehra has joined #openstack-trove06:01
*** michael-yu has quit IRC06:06
openstackgerritOpenStack Proposal Bot proposed a change to openstack/trove: Imported Translations from Transifex  https://review.openstack.org/9700806:06
*** global_ has joined #openstack-trove06:09
*** global_ is now known as shalini_06:09
openstackgerritShalini khandelwal proposed a change to openstack/trove-integration: Added datastore type and version in test.conf  https://review.openstack.org/8496406:10
denis_makogonshalini_, thanks for updating patch06:14
openstackgerritSteve Leon proposed a change to openstack/trove: Add datastore version to backups  https://review.openstack.org/8947406:14
shalini_denis_makogon :)06:15
*** grapex has joined #openstack-trove06:17
*** grapex has quit IRC06:21
*** denis_makogon has quit IRC06:22
*** cp16net_ has joined #openstack-trove06:26
*** Longgeek has joined #openstack-trove06:30
*** cp16net_ has quit IRC06:30
*** cp16net_ has joined #openstack-trove06:30
*** Longgeek has quit IRC06:35
*** cp16net__ has joined #openstack-trove06:40
*** cp16net__ has quit IRC06:40
*** cp16net_ has quit IRC06:40
*** cp16net_ has joined #openstack-trove06:41
*** julienvey has joined #openstack-trove06:42
*** matsuhashi has quit IRC06:42
*** matsuhashi has joined #openstack-trove06:43
*** cp16net_ has quit IRC06:46
*** matsuhashi has quit IRC06:47
*** SnowDust has joined #openstack-trove06:49
*** matsuhashi has joined #openstack-trove06:50
*** iccha has joined #openstack-trove07:01
*** Longgeek has joined #openstack-trove07:01
*** matsuhashi has quit IRC07:02
*** matsuhashi has joined #openstack-trove07:03
*** matsuhashi has quit IRC07:04
*** matsuhashi has joined #openstack-trove07:04
*** Longgeek has quit IRC07:05
*** julienvey has quit IRC07:05
*** iccha has quit IRC07:07
*** ramishra has quit IRC07:13
openstackgerritDenis M. proposed a change to openstack/trove: Remove redundant heat templates from codebase  https://review.openstack.org/9900007:16
*** Longgeek has joined #openstack-trove07:17
*** Longgeek has quit IRC07:22
*** sgotliv has joined #openstack-trove07:24
*** flaper87|afk is now known as flaper8707:25
*** isviridov|away is now known as isviridov07:27
*** haomaiwang has quit IRC07:50
*** haomaiwang has joined #openstack-trove07:51
*** ekarlso has joined #openstack-trove07:55
*** yogeshmehra has quit IRC07:57
*** sbfox has quit IRC07:59
*** melodous has quit IRC08:11
*** julienvey has joined #openstack-trove08:17
*** SushilKM has quit IRC08:19
*** SushilKM has joined #openstack-trove08:30
*** SushilKM has quit IRC08:35
*** Isotopp has joined #openstack-trove08:47
openstackgerritShuichiro MAKIGAKI proposed a change to openstack/trove: Add sample admin_{user,tenant_name,password} to api-paste.ini  https://review.openstack.org/9929608:52
*** Longgeek has joined #openstack-trove09:00
*** matsuhashi has quit IRC09:00
*** matsuhashi has joined #openstack-trove09:01
*** Longgeek_ has joined #openstack-trove09:25
*** Longgeek has quit IRC09:29
*** coolsvap is now known as coolsvap|afk09:50
SlickNikFYI folks. Looks like the rdjenkins builds are failing since the last few hours.09:53
SlickNikthe issue seems to be related to the cloud-init datasource passed to the guest image09:53
SlickNikhttps://gist.github.com/anonymous/1cbeadc132736670c41c09:54
*** julienvey has quit IRC09:58
*** matsuhashi has quit IRC10:05
*** matsuhashi has joined #openstack-trove10:06
*** matsuhashi has quit IRC10:06
*** matsuhashi has joined #openstack-trove10:06
*** Longgeek_ has quit IRC10:30
*** Longgeek has joined #openstack-trove10:31
*** matsuhashi has quit IRC10:45
*** sgotliv has quit IRC10:46
openstackgerritDenis M. proposed a change to openstack/trove: Add datatore/version name into configuration response  https://review.openstack.org/9898510:52
*** SnowDust has quit IRC10:53
*** demorris has joined #openstack-trove11:00
*** SnowDust has joined #openstack-trove11:05
*** PeterSchwaller has joined #openstack-trove11:08
*** rwsu_ has joined #openstack-trove11:12
*** PeterSchwaller_ has quit IRC11:14
*** rwsu has quit IRC11:14
openstackgerritDenis M. proposed a change to openstack/trove: Fix updated timestamp for SecurityGroup model  https://review.openstack.org/9751011:15
*** julienvey has joined #openstack-trove11:16
openstackgerritDenis M. proposed a change to openstack/python-troveclient: Add datatore/version name into configuration view  https://review.openstack.org/9898811:17
IsotoppI am reading whatever is present as documentation about trove and have a bunch of questions11:28
Isotoppin fact, I hardly know where to start11:28
Isotoppmaybe: what is trove trying to be?11:28
Isotoppbecause in some things it is very database specific, in others it tries to be agnostic, and in others again, it simply doesn't make sense at all.11:29
Isotoppis trove a mysql thing? does it try to be specific database things for different databases, that is, is there a trove-mysql, trove-cassandra etc? or does it try to abstract away database differences?11:29
openstackgerritDenis M. proposed a change to openstack/trove: Fix updated timestamp for SecurityGroup model  https://review.openstack.org/9751011:30
*** dmakogon_ is now known as denis_makogon11:30
denis_makogonIsotopp, now, Trove isn't mysql specific thing11:31
denis_makogonIsotopp, we're working on different databases, such as mongo, cassandra, couchbase, redis11:31
Isotoppok11:31
Isotoppso is there trove-mysql, a trove-redis and so on?11:31
denis_makogonIsotopp, no, all databases are integrated in Trove11:32
denis_makogonit;s all-in-one11:32
Isotopphow does that work?11:32
Isotoppaccess permissions, replication and so on11:32
denis_makogonhttps://github.com/openstack/trove/tree/master/trove/guestagent/datastore11:32
Isotoppthese are all very different things in these different systems11:32
denis_makogonIsotopp, fow now Trove can deploy only single instance of a database11:33
Isotoppthat is not a bad thing, i can have many small virtual machines, one for each database.11:33
denis_makogonIsotopp, we've been working on replication/clustering for a long time11:33
Isotoppyes, i am reading https://wiki.openstack.org/wiki/Trove-Replication-And-Clustering-API at the moment11:33
Isotoppin fact I just grepped that page and did not find the terms11:34
Isotoppbinlog, position or stream anywhere in that page11:34
denis_makogonIsotopp, it is generic doc11:34
Isotoppand for example for mysql i wonder how one can talk about replication without using any of these words, ever11:34
Isotoppbut any replication does have a stream of changes,11:34
Isotoppand a position in that stream11:34
Isotoppi see nowhere mention of that as a concept anywhere.11:35
Isotoppyou talk about links,11:35
Isotoppbetween nodes,11:35
Isotoppbut i see no data-flow or words that relate to flow of data and positions11:35
Isotoppi am sorry, i am very new to this (but not to databases)11:35
Isotoppso it may be that my reading and grepping is quite cursory11:36
Isotoppand superficial,11:36
denis_makogonwe're not re-implementing replication or clustering, we're using native tools/methods to organize it11:36
Isotoppbut i have ideas about databases and replication and i am trying to map these dba concepts to the trove terminilogy11:36
Isotoppdenis_makogon: i think i got that. but 'organizing' does surely include setting up new nodes,11:36
Isotoppso snapshotting them, spinning them up in new instances and conencting them to your replication topology11:37
*** SushilKM has joined #openstack-trove11:37
Isotoppfor this to happen, for example your snapshot or even a backup need to be able to know from 'when' it is,11:37
Isotoppthat is, at which position in a succession of states of the datastore it exists11:37
Isotoppin order to be able to roll forward11:37
denis_makogonIsotopp, that's why we have Backup models that are visible for instances11:37
denis_makogonand we use Swift as backup storage11:38
*** demorris has quit IRC11:38
Isotoppand you do associate what mysql calls a binlog position with backups then?11:38
denis_makogon"when" - timestamps11:38
denis_makogoni guess, yes11:38
Isotopptimestamp is a generic term that in the mysql case relates to a binlog position?11:38
Isotoppbecause if a timestamp is a clock, no matter how finely granular it is, it is not a single position on a multicore machine11:39
denis_makogonIsotopp, not at all, we have our own timestamps for backups11:39
denis_makogonIsotopp, and, again, it's up to backuping/restoring tools11:40
Isotoppsorry, that fails my mysql based bullshit detection11:40
Isotoppdo you actually successfully create instances already, that is make new slaves?11:40
Isotoppor is that at a concept stage at the moment?11:40
denis_makogonyes, Trove can deploy single instances at this moment, and replication/clustering design was approved and now is under development11:41
denis_makogonTesora guys are working on replication11:42
denis_makogonmysql-specific, for now11:42
IsotoppI see11:42
IsotoppI think I would like to have a look at that. I joined MySQL AB as a consultant in 2005 and worked for them until 2008. I started as a database architect at Booking.com in Amsterdam in 2008 and worked for them until April this year. We grew our installation by a factor of 100 in these years, and there have been about 2000 database servers (bare-metal) in about three dozen replication hierarchies by then. I did the scaleout ...11:44
Isotopp... concepts and stuff there.11:44
IsotoppI am working now for a company in berlin, and am looking into openstack11:44
Isotoppbut at the moment I am having trouble how what I would like to see from a DBaaS thing and what Trove does go together.11:44
IsotoppSo I am trying to wrap my head around what you do and how, and how that matches my MySQL, Hadoop, Redis, Postgres and MongoDB vocabularies11:45
denis_makogonIsotopp, we're not going to work with hadoop =)11:46
denis_makogonIsotopp, we're trying to build a dozen of sub-frameworks that are suitable for all databases that would be integrated in Trove11:46
denis_makogonIsotopp, and of course, it's not the easiest thing11:47
Isotoppin my experience that won't work well without a lot of specialization. I may have overlooked something, but there appears to be something like 'trove user-create' at the moment, but apprently i can only assign per-database rights to the mysql users that creates.11:48
Isotoppand not per table or per column permissions.11:48
Isotoppalso, there appears to be something like trove-guestagent, which seems to have the task of installing database packages and the actual data into an instance, so that's like a bad attempt at trying to recreate puppet, badly11:49
Isotoppalso, there seems to be a configuration management with database configuration parameters, but11:49
*** sgotliv has joined #openstack-trove11:49
Isotoppthese seem to be all static, so that I cannot for example set innodb_buffer_pool_size to 80% of whatever the current memory size of the vm is11:49
denis_makogonIsotopp, Trove permissions works according to OpenStack patterns11:49
Isotopp(puppet with a my.ini.erb would be able to do that)11:50
denis_makogonIsotopp, you can have a VMs per users11:50
denis_makogonnot tables or columns11:50
Isotoppdenis_makogon: but i have a pci and a BSI security audit whenever I process persistent data, and they have a minimum-rights requirement11:50
Isotoppdenis_makogon: I won't ever be able to pass such an audit with rights-per-database.11:50
denis_makogonIsotopp, you can work with configurations in Amazon-RDS style11:50
Isotoppback to the config management, there appears also no facility to trigger maintenance procedures on config value changes. for example some parameters require server restarts when changes, and others even more complicated things, for example an innodb_log_file_size change is a specific procedure that requires some steps between stop and restart11:52
denis_makogonIsotopp, yes, you cannot do this for Trove, at least, for nearest 3-4 releases, because right now we're focused on implementing replications/clustering for different databases11:52
Isotopp*sigh*11:52
denis_makogonIsotopp, we already did that11:52
Isotoppwhat, specifically?11:52
Isotoppsorry, too many topics at once, sorry for thayt11:52
Isotoppthat11:52
denis_makogonIsotopp, https://github.com/openstack/trove/blob/master/trove/templates/mysql/validation-rules.json11:53
denis_makogonthere are mysql options with markers( require_restart )11:53
Isotoppah, good11:53
Isotoppinnodb_log_file_size is absent11:54
*** lathiat has joined #openstack-trove11:54
denis_makogonyes, we have several bug reported about missing options11:54
Isotoppalso, version numbers are absent (a lot of things that required a restart in older versions of MySQL and MariaDB are dynamic in newer versions)11:54
Isotopp(it was part of the vendor relations part of my job at booking.com to pressure both oracle and SkySQL/Monty Program to work toward that goal)11:55
*** lathiat_ has quit IRC11:55
Isotoppanother question: when i tried the trove command line client, trove help lists a lot of backups.11:56
Isotopphow do i restore a backup?11:56
IsotoppI see that trove create has a --backup option, but I didn't see docs11:56
denis_makogonyou are right, create cmd has --backup option11:57
denis_makogonthat takes a backup UUID11:57
*** sgotliv has quit IRC11:57
Isotoppi see11:57
denis_makogonbackups for databases are made by native tools11:58
denis_makogonlike xtrabackup11:58
denis_makogonfor mysql-based databases11:58
denis_makogonfor mongo - mongodump, etc.11:58
*** anteaya has quit IRC11:58
Isotopphttps://github.com/openstack/trove is current?12:00
denis_makogonнуы12:00
denis_makogonyes12:00
Isotoppbecause I find a mysql_impl there, but12:00
Isotoppnone for mongo for example12:00
denis_makogonyes, it's true12:00
denis_makogonIsotopp, it's on the review12:00
denis_makogonsame for cassandra12:00
Isotoppah12:01
Isotoppso i need to look elsewhere12:01
denis_makogonwe have huge queue of new features on the review12:01
Isotoppfor current state12:01
denis_makogonoh, ok12:01
Isotoppwhere do i actually look12:01
denis_makogonhave you looked at Trove architecture ?12:01
IsotoppI have a checkout of openstack/trove on the disk and am going through the things in there atm12:02
Isotoppit's a bit scary. are you talking to people at SkySQL and Oracle about this?12:03
*** Robe has joined #openstack-trove12:03
*** achampion has quit IRC12:03
IsotoppBecause there are best practices, and I probably have a few comments here.12:03
Robetestest12:03
openstackgerritDenis M. proposed a change to openstack/trove: Add datatore/version name into configuration response  https://review.openstack.org/9898512:03
Isotoppthanks for that ^^12:03
denis_makogonIsotopp, we've been cooperating with Percona guys from time to time12:04
Isotopphm12:04
denis_makogonIsotopp, i'd really suggest to read about trove architecture first12:04
Isotoppi could probably get a PO from Oracle MySQL, and some people from MySQL @Facebook and from Monty Program AB to look into what you do12:05
Isotoppdenis_makogon: URL?12:05
denis_makogonIsotopp, http://www.mirantis.com/search/Trove12:05
denis_makogonIsotopp, those posts are all mine, if you have question feel free to ask me =)12:05
Isotoppwill do12:06
denis_makogonIsotopp, it would be great we are open for new contributors and Smart Big Guys =)12:06
IsotoppI wish you wouldn't try to unify away database specifics with the trove concepts, because in my experience that never works.12:06
Isotoppyou could later on try to unify what really is identical,12:06
Isotoppbut that is a very late step in the process.12:07
Isotoppnot just replication, also permission and many other things12:07
Isotopphah12:07
Isotopp./trove/tests/unittests/guestagent/test_backups.py:        bkup = RunnerClass(12345, extra_opts="--events --routines --triggers")12:07
Isotoppso you do know about proper extra_opts for a backup to make it complete12:07
IsotoppI was looking at the backuprunner at first, and that just had the placeholder and a mysqldump statement that as is is broken12:08
IsotoppI wonder why you don't make the default complete.12:08
Isotoppthat will really increase chances of endusers that are not certified mysql dbas to make a backup that won't lose all interesting things12:08
denis_makogonIsotopp, it's up to deployer, he knows what options to add for runner12:09
*** ihrachyshka has joined #openstack-trove12:09
ihrachyshkahey all. I assume you're aware your stable checks are broken due to missing tox environs used by infra? as in https://review.openstack.org/#/c/98902/12:09
Isotoppmechanism is fine, but should not be dispensed without a proper policy sample.12:09
denis_makogonIsotopp, policy sample is a man for xtrabackup/mysqldump12:10
Isotoppyou wish.12:10
Isotoppi made good money as a consultant with manual reading services12:10
Isotoppi mean, having a MySQLDump backup runner as is is fine12:11
Isotoppand very flexible. adding a convenience class on top of that which does the right things by default and promoting that as the recommended way12:11
Isotoppwould be even better, and does cut you off from nothing.12:11
denis_makogonto be honest, i'm not actually working with mysqldump, only xtrabackup12:12
IsotoppMySQLDumpDefaultPolicy class, for example.12:12
IsotoppI usually make lvm snapshots.12:12
Isotoppusing http://www.lenzg.net/archives/201-mylvmbackup-0.9-has-been-released.html12:12
denis_makogonIsotopp, yes, we also working on adding another way to do backups12:12
Isotopphttps://launchpad.net/mylvmbackup/12:12
*** sgotliv has joined #openstack-trove12:12
denis_makogonIsotopp, like snapshotting volumes through Cinder API12:13
Isotoppdespite the name it also does zfs12:13
Isotoppi never tried xtrabackup, actually, only innobackup, the propietary predecessor tool12:13
Isotoppthat did actually not properly copy myisam tables such as the mysql.* database12:13
Isotoppi also never checked how it handles making backups of a replication slave12:14
Isotoppbecause those backups are broken if you do not stop replication when Slave_open_temp_tables is zero12:14
Isotoppmysql unfortunately has connection scoped state, and that includes temporary tables such as CREATE TEMPORARY TABLE creaqted tables.12:15
Isotoppthese tables are autodeleted when a connection is lost, and in replication that means when the server is being bounced.12:15
Isotopprestoring from a backup counts as server restart12:15
Isotoppso when you make a backup from anything that is Slave_open_temp_tables > 012:15
Isotoppyou end up with a server state that contains temporary tables that will be deleted on restore,12:16
Isotoppbut in the binlog are very likely statements that expect that table to be there.12:16
denis_makogonihrachyshka, thanks, i will take a look at probably will backport required things to stable IceHouse12:16
Isotoppthe backup will be invalid and not useful for point-in-time recovery or slave-clone12:16
IsotoppI never tested that with xtrabackup, but it breaks mylvmsnapshots for sure.12:16
Isotoppi.e. i lost slave instances that way12:17
denis_makogonIsotopp, it would be nice if you'll do that for us, so we'd be able to improve our backup/restore framework12:17
Isotoppat the moment I am at a stage where I try to get contrail to work.12:17
Isotoppand where I need to solve my storage strategy, i.e. filer vs. ceph vs. whatever else.12:18
Isotoppthen I will have a deep look at aaS things,12:18
Isotoppbut at the moment trove does not address any of the needs I have at all,12:18
Isotoppin part because it tries to be generic instead of being good at specific things,12:18
Isotoppi would have expected trove to handle databases-as-a-service in a way that would allow me to leverage hardware nodes with fusion-io or ssd,12:19
Isotoppin a way that solves the node-failure-problem.12:19
Isotoppbut i see instances that mount cinder volumes,12:19
denis_makogonFor now, we're only the in-VM databases12:19
Isotoppso likely volumes from some kind of network storage.12:19
Isotoppas a replication slave which executes sql_thread commands sequentially, i will never see more than 2000 queries/sec from tyhe sql thread that way12:20
Isotoppbut if i were to run on local disk, I can see much more, if the local disk is flash, up to 10x more.12:20
denis_makogonabout volumes, we're using simple Cinder API to deliver volumes, and we're not handling what type of driver Cinder is using right now12:20
Isotoppbut if the hardware node dies, i have problems touching the data, so i have a lot of tradeoffs related to asynch replication vs semi-synch vs drbd underneath in a, b and c mode and so n12:21
denis_makogonthat why we would be able to deploy nodes in AA mode12:21
Isotoppi would have expected that trove 'as a service' encapsulates these concepts and helps me to specify things like 'i want a database with these properties and deployment models'12:22
Isotoppbecause that kind of stuff is hard to get right even on bare metal you own12:22
denis_makogonyes, agreed12:22
Isotoppand impossible to do with openstack constraints on top12:22
denis_makogonyes12:22
Isotoppto the 'aaS' idea in my mind would package that, mechanism layer underneath, policy that is nonbroken and convenient on top12:22
denis_makogonwe're working on making Trove better, we're doing a lot of things, but we're young, we have a lot to do in future12:26
IsotoppI will eventually try to help, once I have some installation here. :-)12:26
denis_makogonIsotopp, try this one https://github.com/openstack/trove-integration12:28
denis_makogonIsotopp, it's a DevStack with integrated Trove in it(images, datastores, etc.)12:28
openstackgerritDenis M. proposed a change to openstack/trove: Reverting deleted tests  https://review.openstack.org/9935312:30
Isotoppdenis_makogon: i can see how xtrabackup keeps track of the binlog position as part of the backup,m because that is what it would do. but the mysqldump method does not seem to do that, at all.12:31
Isotoppi'd have expected a --master-data=2 or something somewhere12:32
Isotoppin order to preserve the binlog position of the backup _somewhere_.12:33
Isotoppyou'll need that if you want to do anything remotely useful with a backup, ever.12:33
IsotoppI mean, what's the purpose of a backup?12:33
Isotopp1. build a new slave12:33
Isotopp2. recover as part of a pit recovery12:33
Isotoppin both cases you'll need the binlog posn either for a change master comment or for a mysqlbinlog command to roll forward.12:34
Isotopp(also, do you push binlog to swift? if not, the my.ini expire_logs_days and the automatic expiry of old backups are probably related, because a backup that is older than your oldest binlog is pretty much useless)12:34
Isotoppit's a snapshot of an old database from some point in history that can never be connected to the present.12:35
*** nosnos has quit IRC12:36
IsotoppRobe: trove and postgres - interested?12:37
*** anteaya has joined #openstack-trove12:40
*** nosnos has joined #openstack-trove12:43
*** pdmars has joined #openstack-trove12:44
*** tvoran has joined #openstack-trove12:46
*** nosnos has quit IRC12:47
*** Robe has quit IRC12:54
*** Robe has joined #openstack-trove12:55
*** ramishra has joined #openstack-trove13:05
*** iccha has joined #openstack-trove13:08
amrithIsotopp, you there?13:09
*** radez_g0n3 is now known as radez13:09
*** ramashri has joined #openstack-trove13:10
IsotoppI am busy in a different screen but I am reading here13:10
Isotoppslow to respond13:10
RobeIsotopp: first have to understand what trove tries to solve ;)13:10
*** ramishra_ has joined #openstack-trove13:11
*** ramishra has quit IRC13:12
IsotoppRobe: I still have no idea what it tries to solve, but I have a very good idea of the shape of actual database problems in mysql land :)13:12
Isotopptalking to ivan zoratti atm13:12
Robeand I have a somewhat current overview of the postgres challenges ;)13:13
*** achampion has joined #openstack-trove13:14
*** ramishra has joined #openstack-trove13:15
*** ramishra_ has quit IRC13:15
*** robertmyers has joined #openstack-trove13:18
*** ramishra_ has joined #openstack-trove13:20
*** robertmyers has quit IRC13:20
*** ramashri_ has joined #openstack-trove13:20
*** robertmyers has joined #openstack-trove13:21
*** ramashri has quit IRC13:21
*** ramishra has quit IRC13:21
*** robertmy_ has joined #openstack-trove13:22
*** robertmyers has quit IRC13:23
*** robertmyers has joined #openstack-trove13:23
*** robertmy_ has quit IRC13:23
*** ramishra_ has quit IRC13:23
*** ramishra has joined #openstack-trove13:27
*** robertmyers has quit IRC13:28
*** shakayumi has joined #openstack-trove13:28
*** shakayumi has quit IRC13:28
*** robertmyers has joined #openstack-trove13:31
*** jasonb365 has joined #openstack-trove13:31
*** jcru has joined #openstack-trove13:32
*** jcru has quit IRC13:32
*** jcru has joined #openstack-trove13:33
*** coolsvap|afk is now known as coolsvap13:38
*** grapex has joined #openstack-trove13:43
ihrachyshkahub_cap: vipul: SlickNik: grapex: hey. since stable/havana branch for trove is unmaintained, can we consider its removal?13:49
*** sgotliv has quit IRC13:51
denis_makogonihrachyshka, we can backport testing env to stable13:54
ihrachyshkadenis_makogon: I've tried it several months ago, it required lots of patches merged in single one13:55
ihrachyshkadenis_makogon: and to be clear, I'm speaking about stable/havana, not icehouse13:55
ihrachyshkaicehouse is ok13:55
*** sgotliv has joined #openstack-trove13:55
ihrachyshkahavana is failing in multiple ways13:55
denis_makogoni see13:55
denis_makogonihrachyshka, so, you suggest to drop havana stable brunch?13:56
ihrachyshkadenis_makogon: I would suggest for trove people to either fix the branch or drop it. In current state, people sometimes try to cherry-pick fixes there just to realise that it's completely broken13:58
ihrachyshkaactually, I've had a review for this13:59
ihrachyshkahttps://review.openstack.org/#/c/75386/13:59
ihrachyshka(in March)13:59
ihrachyshkaI can try to restore it13:59
denis_makogonihrachyshka, i'd suggest to restore and rebase it, and let's see if it'll fix all thinhs14:00
denis_makogon*things14:00
ihrachyshkadenis_makogon: done, it's already rebased (no patches since then merged anyway)14:03
denis_makogonihrachyshka, requirements ?14:03
denis_makogonand tox.ini14:03
ihrachyshkadenis_makogon: what's about that requirements?14:05
denis_makogonihrachyshka, i guess they were changed since march14:05
ihrachyshkadenis_makogon: ah, indeed, got it14:06
denis_makogonihrachyshka, requirements.txt and tox.init14:06
denis_makogon*.ini14:06
ihrachyshkafor tox.ini, I just disabled a check, haven't synced it completely14:06
openstackgerritDenis M. proposed a change to openstack/trove: Reverting deleted tests  https://review.openstack.org/9935314:09
*** jasonb365_ has joined #openstack-trove14:09
ihrachyshkadenis_makogon: I actually think we should not sync requirements as I did at that time14:10
ihrachyshkadenis_makogon: now I would sync just that pbr requirement14:10
denis_makogonihrachyshka, in this case requirements job will fail14:10
ihrachyshkadenis_makogon: yeah, indeed, that was the case14:10
ihrachyshka:)14:10
denis_makogonihrachyshka, i see =)14:10
denis_makogonlooks like a bottleneck14:10
ihrachyshkaI've lost that knowledge these late months since touching it14:11
*** amytron has joined #openstack-trove14:11
*** jasonb365 has quit IRC14:11
*** jasonb365_ is now known as jasonb36514:11
*** demorris has joined #openstack-trove14:11
openstackgerritDenis M. proposed a change to openstack/trove: Fix inheritance for ConfigurationParameterDeleted  https://review.openstack.org/9939114:16
*** SushilKM has quit IRC14:18
*** pdmars has quit IRC14:21
*** pdmars has joined #openstack-trove14:22
denis_makogonihrachyshka, let's wait for cores and speak with them to see how to deal with this issue14:28
*** grapex has quit IRC14:29
*** cp16net_ has joined #openstack-trove14:37
*** cp16net_ has quit IRC14:38
*** jasonb365 has quit IRC14:38
*** jasonb365_ has joined #openstack-trove14:38
*** jmontemayor has joined #openstack-trove14:40
*** jmontemayor has quit IRC14:41
*** jmontemayor has joined #openstack-trove14:41
*** cp16net_ has joined #openstack-trove14:42
*** cp16net has quit IRC14:45
*** cp16net_ is now known as cp16net14:47
*** grapex has joined #openstack-trove14:50
*** grapex_ has joined #openstack-trove14:51
*** grapex has quit IRC14:51
*** grapex_ has quit IRC14:52
*** grapex has joined #openstack-trove14:52
*** jasonb365_ has quit IRC14:53
*** demorris has quit IRC15:03
*** ramashri_ has quit IRC15:07
*** sbfox has joined #openstack-trove15:09
*** achampion has quit IRC15:13
*** kevinconway has joined #openstack-trove15:13
*** jasonb365 has joined #openstack-trove15:13
*** achampion has joined #openstack-trove15:16
*** Longgeek has quit IRC15:22
*** ramashri has joined #openstack-trove15:23
*** ihrachyshka_ has joined #openstack-trove15:31
*** ihrachyshka_ has quit IRC15:32
*** haomaiwang has quit IRC15:32
*** haomaiwang has joined #openstack-trove15:33
*** ihrachyshka has quit IRC15:35
openstackgerritTheron Voran proposed a change to openstack/trove: Add timestamps and instance count to configs  https://review.openstack.org/9940715:37
*** demorris has joined #openstack-trove15:45
*** edmund has joined #openstack-trove15:45
*** edmund has quit IRC15:48
*** Gordon has joined #openstack-trove15:52
*** Gordon is now known as Guest999115:53
*** edmund has joined #openstack-trove15:54
*** sbfox has quit IRC15:54
*** Guest9991 has quit IRC15:55
*** demorris has quit IRC15:57
*** ramishra has quit IRC16:08
*** ramishra_ has joined #openstack-trove16:09
openstackgerritTheron Voran proposed a change to openstack/trove: Add timestamps and instance count to config groups  https://review.openstack.org/9940716:12
*** haomaiwang has quit IRC16:14
*** haomaiwang has joined #openstack-trove16:14
*** jasonb365 has quit IRC16:18
*** ramishra_ has quit IRC16:20
sgotlivdougshelley66, ping16:27
*** julienvey has quit IRC16:32
openstackgerritDenis M. proposed a change to openstack/trove: Fix assertion while waiting for ACTIVE status  https://review.openstack.org/9942416:33
openstackgerritDenis M. proposed a change to openstack/python-troveclient: Fix shell view for secgroup-* commands  https://review.openstack.org/8531416:34
*** SnowDust has quit IRC16:53
*** zuqiang has joined #openstack-trove17:00
*** jmontemayor has quit IRC17:02
*** jasonb365 has joined #openstack-trove17:04
*** denis_makogon has quit IRC17:04
*** SnowDust has joined #openstack-trove17:05
*** yidclare has joined #openstack-trove17:06
*** thedodd has joined #openstack-trove17:10
*** sgotliv has quit IRC17:12
*** jmontemayor has joined #openstack-trove17:14
*** amcrn has joined #openstack-trove17:14
*** demorris has joined #openstack-trove17:16
*** PeterSchwaller_ has joined #openstack-trove17:17
*** tvoran has quit IRC17:17
*** PeterSchwaller has quit IRC17:19
*** zuqiang has quit IRC17:19
openstackgerritAnna Shen proposed a change to openstack/trove: Add neutron support  https://review.openstack.org/8834917:21
*** eghobo has joined #openstack-trove17:25
*** radez is now known as radez_g0n317:28
*** eguz has joined #openstack-trove17:28
*** eguz has quit IRC17:29
*** saurabhs has joined #openstack-trove17:29
*** eguz has joined #openstack-trove17:29
*** eghobo has quit IRC17:33
*** cweid has joined #openstack-trove17:35
*** tvoran has joined #openstack-trove17:37
*** SushilKM has joined #openstack-trove17:41
*** radez_g0n3 is now known as radez17:41
*** eguz has quit IRC17:46
*** eghobo has joined #openstack-trove17:47
*** eguz has joined #openstack-trove17:48
*** michael-yu has joined #openstack-trove17:48
*** eghobo has quit IRC17:52
*** rueben has joined #openstack-trove17:53
*** SushilKM has quit IRC17:54
*** demorris has quit IRC17:55
*** thedodd has quit IRC17:56
*** thedodd has joined #openstack-trove17:58
SlickNikReminder: Trove weekly meeting in #openstack-meeting-alt17:58
SlickNikin a couple of minutes17:58
*** denis_makogon has joined #openstack-trove17:58
*** SushilKM has joined #openstack-trove17:59
*** ramashri has quit IRC18:00
*** ramashri has joined #openstack-trove18:01
*** radez is now known as radez_g0n318:03
*** NehaV has joined #openstack-trove18:04
*** jasonb365 has quit IRC18:06
*** iccha has quit IRC18:12
*** iccha has joined #openstack-trove18:13
*** demorris has joined #openstack-trove18:14
*** demorris has quit IRC18:20
*** shayneburgess has joined #openstack-trove18:22
*** SushilKM has quit IRC18:26
*** amytron has quit IRC18:28
*** SushilKM has joined #openstack-trove18:29
*** shayneburgess has left #openstack-trove18:29
*** shayneburgess has joined #openstack-trove18:30
*** amytron has joined #openstack-trove18:31
*** eguz has quit IRC18:35
*** eghobo has joined #openstack-trove18:35
*** PeterSchwaller has joined #openstack-trove18:48
*** PeterSchwaller_ has quit IRC18:51
*** SushilKM has quit IRC18:53
*** sbfox has joined #openstack-trove18:54
*** jasonb365 has joined #openstack-trove18:58
openstackgerritA change was merged to openstack/trove: Added an int-test for user-update-attributes  https://review.openstack.org/9795218:59
*** sbfox has quit IRC18:59
*** sbfox has joined #openstack-trove18:59
denis_makogoncp16net, ping19:01
denis_makogoncp16net, hope you're there, could you please take a look at https://review.openstack.org/#/c/85314/, i've updated commit message19:02
openstackgerritDan Nguyen proposed a change to openstack/trove: Updates RPC API to use oslo.messaging  https://review.openstack.org/9448419:03
cp16netok thx19:07
*** grapex has quit IRC19:07
*** grapex has joined #openstack-trove19:08
*** grapex_ has joined #openstack-trove19:11
*** ramashri has quit IRC19:11
*** yidclare has quit IRC19:12
*** grapex has quit IRC19:13
*** ramashri has joined #openstack-trove19:14
*** shayneburgess has quit IRC19:15
*** rueben has quit IRC19:18
*** rueben has joined #openstack-trove19:23
*** sbfox has quit IRC19:28
*** ramashri has quit IRC19:29
*** denis_makogon has quit IRC19:32
*** grapex has joined #openstack-trove19:34
*** grapex_ has quit IRC19:34
*** ramashri has joined #openstack-trove19:34
cp16netden19:37
*** jasonb365 has quit IRC19:42
*** coolsvap is now known as coolsvap|afk19:43
*** achampio1 has joined #openstack-trove19:46
*** achampion has quit IRC19:47
*** ramashri has quit IRC19:49
*** letterj has joined #openstack-trove19:57
*** pdmars has quit IRC20:02
*** sbfox1 has joined #openstack-trove20:03
*** ramashri has joined #openstack-trove20:10
*** rueben has quit IRC20:17
*** sgotliv has joined #openstack-trove20:25
letterjgreetings20:30
letterjlooking at trove-integration is anyone currently having a problem with devstack?20:31
*** flaper87 is now known as flaper87|afk20:32
SlickNikletterj: Yes, there's a problem with building guest images that we're looking into a fix for.20:32
*** shayneburgess has joined #openstack-trove20:33
letterjok thanks.20:33
*** laurelm has quit IRC20:39
*** esp has quit IRC20:39
*** number80 has quit IRC20:39
*** peterstac has quit IRC20:39
*** esp has joined #openstack-trove20:40
*** laurelm has joined #openstack-trove20:40
*** peterstac has joined #openstack-trove20:40
*** number80 has joined #openstack-trove20:41
*** yidclare has joined #openstack-trove20:55
*** sbfox1 has quit IRC20:58
*** NehaV has quit IRC21:10
*** jasonb365 has joined #openstack-trove21:10
*** amcrn has quit IRC21:10
openstackgerritDan Nguyen proposed a change to openstack/trove: Updates RPC API to use oslo.messaging  https://review.openstack.org/9448421:10
openstackgerritNikhil Manchanda proposed a change to openstack/trove-integration: Fix image build to set DIB_CLOUD_INIT_DATASOURCES  https://review.openstack.org/9948221:11
*** shayneburgess has quit IRC21:11
*** NehaV has joined #openstack-trove21:12
*** NehaV has quit IRC21:14
*** SnowDust has quit IRC21:17
*** SlickNik has quit IRC21:18
*** mat-lowery has quit IRC21:18
*** mat-lowery has joined #openstack-trove21:18
*** SlickNik has joined #openstack-trove21:18
*** shayneburgess has joined #openstack-trove21:19
*** amcrn has joined #openstack-trove21:24
*** amytron has quit IRC21:26
*** jasonb365 has quit IRC21:28
*** amytron has joined #openstack-trove21:29
*** grapex has quit IRC21:29
*** grapex has joined #openstack-trove21:30
*** jasonb365 has joined #openstack-trove21:32
*** sbfox has joined #openstack-trove21:33
*** kevinconway has quit IRC21:37
openstackgerritDan Nguyen proposed a change to openstack/trove: Updates RPC API to use oslo.messaging  https://review.openstack.org/9448421:39
*** ramashri has quit IRC21:39
*** rwsu_ has quit IRC21:39
*** rwsu has joined #openstack-trove21:42
*** letterj has quit IRC21:43
*** jasonb365 has quit IRC21:45
*** michael-yu has quit IRC21:49
*** shayneburgess has quit IRC21:49
*** michael-yu has joined #openstack-trove21:53
*** achampio1 has quit IRC21:58
*** amcrn has quit IRC22:05
*** shayneburgess has joined #openstack-trove22:14
*** robertmyers has quit IRC22:19
*** sgotliv has quit IRC22:22
*** sbfox1 has joined #openstack-trove22:29
*** edmund has quit IRC22:29
*** sbfox has quit IRC22:30
*** shayneburgess has quit IRC22:36
*** shayneburgess has joined #openstack-trove22:39
*** iccha_ has joined #openstack-trove22:49
*** jcru has quit IRC22:50
*** PeterSchwaller_ has joined #openstack-trove22:51
*** iccha has quit IRC22:53
*** iccha_ has quit IRC22:54
*** PeterSchwaller has quit IRC22:54
*** tvoran has quit IRC23:01
*** michael-yu has quit IRC23:01
*** michael-yu has joined #openstack-trove23:04
*** cp16net has quit IRC23:05
*** iccha1 has quit IRC23:15
*** thedodd has quit IRC23:21
*** sbfox1 has quit IRC23:26
*** jmontemayor has quit IRC23:28
*** amytron_ has joined #openstack-trove23:29
*** amytron has quit IRC23:32
*** amytron_ is now known as amytron23:32
*** shayneburgess has quit IRC23:37
*** sbfox has joined #openstack-trove23:43
*** amytron has quit IRC23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!