Wednesday, 2013-11-20

*** vipul-away is now known as vipul00:16
*** harlowja has quit IRC00:16
openstackgerritA change was merged to openstack/trove: Add a hook for backup processes to check if successful.  https://review.openstack.org/5531100:17
*** grapex has quit IRC00:22
*** grapex has joined #openstack-trove00:22
*** demorris has joined #openstack-trove00:24
*** demorris has quit IRC00:25
*** grapex has quit IRC00:27
*** matsuhashi has joined #openstack-trove00:29
*** coolsvap has quit IRC00:30
*** ashestakov has quit IRC00:35
*** matsuhashi has quit IRC00:48
*** matsuhashi has joined #openstack-trove00:49
*** matsuhashi has quit IRC00:53
*** jcooley_ has quit IRC00:55
*** jcooley_ has joined #openstack-trove00:55
*** yogesh has joined #openstack-trove00:55
*** jcooley_ has quit IRC01:00
*** amcrn has quit IRC01:05
*** matsuhashi has joined #openstack-trove01:08
*** haomaiwang has joined #openstack-trove01:08
*** nosnos has joined #openstack-trove01:09
*** yidclare has quit IRC01:13
*** shakayumi has joined #openstack-trove01:20
*** adrian_otto has quit IRC01:20
*** yogesh has quit IRC01:33
*** yogesh has joined #openstack-trove01:33
*** matsuhashi has quit IRC01:34
*** matsuhashi has joined #openstack-trove01:35
*** yogesh has quit IRC01:38
*** matsuhashi has quit IRC01:40
*** matsuhashi has joined #openstack-trove01:43
*** harlowja has joined #openstack-trove01:51
*** jcooley_ has joined #openstack-trove01:54
*** Barker has joined #openstack-trove01:56
*** shakayumi has quit IRC02:06
*** demorris has joined #openstack-trove02:09
*** erkules_ has joined #openstack-trove02:17
*** erkules has quit IRC02:19
*** david-lyle has quit IRC02:30
*** david-lyle has joined #openstack-trove02:31
*** haomaiwang has quit IRC03:18
*** Barker has quit IRC03:23
*** Barker has joined #openstack-trove03:26
*** Barker has quit IRC03:28
*** Barker has joined #openstack-trove03:31
*** matsuhashi has quit IRC03:31
*** matsuhashi has joined #openstack-trove03:31
*** matsuhashi has quit IRC03:36
*** Barker has quit IRC03:38
*** matsuhashi has joined #openstack-trove03:41
openstackgerritA change was merged to openstack/trove: Add support of datastore types  https://review.openstack.org/4793403:47
hub_capvictory ^^03:54
*** jcooley_ has quit IRC03:57
*** shalini has quit IRC04:00
*** coolsvap has joined #openstack-trove04:16
*** jcooley_ has joined #openstack-trove04:33
*** jcooley_ has quit IRC04:38
*** SushilKM__ has joined #openstack-trove04:49
*** SushilKM__ has quit IRC04:56
*** demorris has quit IRC05:08
*** jcooley_ has joined #openstack-trove05:14
*** jcooley_ has quit IRC05:19
*** tanisdl has quit IRC05:33
*** coolsvap has quit IRC05:39
*** harlowja has quit IRC05:52
*** vipul has quit IRC05:56
*** vipul has joined #openstack-trove05:56
*** coolsvap has joined #openstack-trove05:58
*** matsuhashi has quit IRC06:08
*** yogesh has joined #openstack-trove06:08
*** matsuhashi has joined #openstack-trove06:08
*** ashestakov has joined #openstack-trove06:09
*** matsuhashi has quit IRC06:13
*** yogesh has quit IRC06:16
*** yogesh has joined #openstack-trove06:17
*** yogesh has quit IRC06:17
*** yogesh has joined #openstack-trove06:18
*** jcooley_ has joined #openstack-trove06:21
*** jcooley_ has quit IRC06:24
*** nosnos_ has joined #openstack-trove06:25
*** nosnos has quit IRC06:29
*** matsuhashi has joined #openstack-trove06:29
*** vipul is now known as vipul-away06:34
*** yogesh has quit IRC06:35
*** jcooley_ has joined #openstack-trove06:35
*** yogesh has joined #openstack-trove06:35
*** ashestakov has quit IRC06:38
*** yogesh has quit IRC06:40
*** adrian_otto has joined #openstack-trove06:42
*** yogesh has joined #openstack-trove06:42
*** adrian_otto has quit IRC06:48
*** adrian_otto has joined #openstack-trove06:49
*** jcooley_ has quit IRC06:51
*** jcooley_ has joined #openstack-trove07:03
*** nosnos_ has quit IRC07:05
*** nosnos has joined #openstack-trove07:05
*** vipul-away is now known as vipul07:07
*** yogesh has quit IRC07:09
*** yogesh has joined #openstack-trove07:09
*** jcooley_ has quit IRC07:10
*** yogesh_ has joined #openstack-trove07:13
*** isviridov_ has joined #openstack-trove07:15
*** yogesh has quit IRC07:16
*** denis_makogon has joined #openstack-trove07:21
*** matsuhashi has quit IRC07:22
*** matsuhashi has joined #openstack-trove07:23
*** matsuhas_ has joined #openstack-trove07:30
*** matsuhashi has quit IRC07:34
*** erkules_ is now known as erkules08:04
*** ashestakov has joined #openstack-trove08:06
*** ashestakov has quit IRC08:06
*** jcooley_ has joined #openstack-trove08:11
*** matsuhas_ has quit IRC08:18
*** matsuhashi has joined #openstack-trove08:19
*** isviridov_ has quit IRC08:22
*** matsuhashi has quit IRC08:24
*** matsuhashi has joined #openstack-trove08:31
*** denis_makogon has quit IRC08:43
*** jcooley_ has quit IRC08:45
*** haomaiwang has joined #openstack-trove08:45
*** haomaiwang has quit IRC08:52
*** yogesh_ has quit IRC09:00
*** yogesh has joined #openstack-trove09:00
*** yogesh has quit IRC09:02
*** yogeshmehra has joined #openstack-trove09:04
*** haomaiwang has joined #openstack-trove09:14
*** ashestakov has joined #openstack-trove09:25
*** yogeshmehra has quit IRC09:29
*** ashestakov has quit IRC09:29
*** jcooley_ has joined #openstack-trove09:41
*** jcooley_ has quit IRC09:47
*** kevinconway_ has joined #openstack-trove09:52
openstackgerritDenis M. proposed a change to openstack/trove: Allow secure/insecure sql query logging  https://review.openstack.org/5740809:56
*** ikhudoshyn has quit IRC09:57
*** SushilKM__ has joined #openstack-trove10:03
*** matsuhashi has quit IRC10:14
*** adrian_otto has quit IRC10:27
*** SnowDust has joined #openstack-trove10:28
*** ikhudoshyn has joined #openstack-trove10:32
*** ashestakov has joined #openstack-trove10:32
*** ashestakov has quit IRC10:33
dmakogon_SnowDust, ping10:40
*** dmakogon_ is now known as denis_makogon10:41
SnowDusthello dmakogon_10:41
SnowDusthi denis_makogon10:41
denis_makogonSnowDust, have you abandon your draft review ?10:41
SnowDustthe pluggable extentions ?10:41
SnowDustextensions?10:41
denis_makogonSnowDust, no10:41
SnowDustthen ?10:41
denis_makogonSnowDust, templates10:41
SnowDustlemme see10:42
denis_makogonhttps://review.openstack.org/#/c/51836/10:42
*** jcooley_ has joined #openstack-trove10:43
SnowDustdenis_makogon: done10:46
SnowDustthx !10:46
denis_makogonSnowDust, thanks10:46
openstackgerritDenis M. proposed a change to openstack/trove: Allow secure/insecure sql query logging  https://review.openstack.org/5740810:52
*** coolsvap has quit IRC10:57
*** jcooley_ has quit IRC11:17
openstackgerritSushil Kumar proposed a change to openstack/trove: Remove radmin credentials from create_heat_client  https://review.openstack.org/5637311:34
*** SushilKM__ has quit IRC11:41
*** nosnos_ has joined #openstack-trove12:09
*** nosnos has quit IRC12:12
*** jcooley_ has joined #openstack-trove12:13
*** nosnos_ has quit IRC12:14
*** jcooley_ has quit IRC12:19
*** kevinconway_ has quit IRC12:43
*** pdmars has joined #openstack-trove12:45
*** SnowDust has quit IRC13:14
*** jcooley_ has joined #openstack-trove13:15
*** SushilKM__ has joined #openstack-trove13:29
*** jcru has joined #openstack-trove13:47
*** jcooley_ has quit IRC13:49
*** demorris has joined #openstack-trove13:56
*** PradeepChandani has quit IRC14:30
*** shivamshukla has quit IRC14:31
*** Barker has joined #openstack-trove14:31
*** PradeepChandani has joined #openstack-trove14:33
*** shivamshukla has joined #openstack-trove14:35
*** robertmy_ has joined #openstack-trove14:44
*** amytron has joined #openstack-trove14:50
*** adrian_otto has joined #openstack-trove14:51
*** radez_g0n3 is now known as radez14:58
*** grapex has joined #openstack-trove15:03
*** grapex has quit IRC15:03
*** grapex has joined #openstack-trove15:04
*** amytron has quit IRC15:06
*** amytron has joined #openstack-trove15:06
*** SushilKM__ has quit IRC15:11
*** Barker has quit IRC15:17
*** coolsvap has joined #openstack-trove15:17
*** robertmy_ has quit IRC15:22
*** robertmyers has joined #openstack-trove15:22
*** cweid has joined #openstack-trove15:24
*** tanisdl has joined #openstack-trove15:36
*** datsun180b has joined #openstack-trove15:39
*** rnirmal has joined #openstack-trove15:41
*** jcooley_ has joined #openstack-trove16:04
*** plodronio has joined #openstack-trove16:09
*** yidclare has joined #openstack-trove16:11
*** jmontemayor has joined #openstack-trove16:12
*** adrian_otto has quit IRC16:20
*** TheRealBill has joined #openstack-trove16:20
*** jcooley_ has quit IRC16:22
*** coolsvap has quit IRC16:29
*** PradeepChandani has quit IRC16:40
*** shivamshukla has quit IRC16:41
openstackgerritIllia Khudoshyn proposed a change to openstack/trove: Initial support for single instance MongoDB support  https://review.openstack.org/5059716:41
*** shivamshukla has joined #openstack-trove16:42
*** ashestakov has joined #openstack-trove16:43
openstackgerritAndrey Shestakov proposed a change to openstack/trove: Documentation for datastore types  https://review.openstack.org/5492116:43
*** coolsvap has joined #openstack-trove16:48
*** coolsvap has quit IRC16:49
*** coolsvap has joined #openstack-trove16:52
*** jcooley_ has joined #openstack-trove16:53
*** plodronio has quit IRC16:54
*** cweid has quit IRC16:57
*** radez is now known as radez_g0n317:01
*** adrian_otto has joined #openstack-trove17:02
*** jmontemayor has quit IRC17:03
*** jmontemayor has joined #openstack-trove17:06
*** tanisdl has quit IRC17:07
*** jcooley_ has quit IRC17:10
*** SushilKM__ has joined #openstack-trove17:20
openstackgerritEd Cranford proposed a change to openstack/trove: Conductor proxies host db access for guests  https://review.openstack.org/4511617:39
datsun180bputting "merge conflict resolution" on my resume17:41
*** isviridov_ has joined #openstack-trove17:58
*** isviridov_ has quit IRC18:00
hub_cap*new* meeting time18:01
*** harlowja has joined #openstack-trove18:02
*** yogesh has joined #openstack-trove18:02
*** SushilKM__ has quit IRC18:03
redthruxdenis_makogon: around? ikhudoshyn? isviridov? meeting time18:04
*** adrian_otto has quit IRC18:14
openstackgerritSteve Leon proposed a change to openstack/trove: Adding designate dns support to trove  https://review.openstack.org/5441218:15
*** isviridov_ has joined #openstack-trove18:15
juiceTrove Watchdog "We've got you covered"18:21
hub_capWhats that urine smell? Security...18:22
*** SushilKM__ has joined #openstack-trove18:25
juiceWhahahaha18:25
*** jasonb365 has joined #openstack-trove18:28
*** yidclare has quit IRC18:29
*** amcrn has joined #openstack-trove18:33
hub_capspeak18:37
hub_caphere18:37
hub_capnow18:37
hub_cap10:37 AM vipul demorris: So maybe a PATCH on instance is what we need to implement18:38
demorrisso I think that it is key that we expose the ability to allow users to self upgrade18:38
hub_capok cu guys.. ther is a break in the rain so im bookin in :)18:38
kevinconwaydemorris: if it's only minor patches and security updates why make that a user accessible thing?18:38
grapexdemorris: Won't that make them go blind?18:38
kevinconwayisn't that more on the service provider?18:38
SlickNiklater hub_cap18:38
vipulsounds like a modification to Instance resource should do it18:38
redthruxLOL grapex18:38
demorrisso it could be...18:38
demorristhat is where maintenance windows came in to the discussion18:39
demorrisif it is the provider18:39
demorrisyou have to have a way to allow the user to specify when such and update would occur because it is disruptive18:39
kevinconwaydemorris: so you need some way to prevent API calls for a time?18:39
demorrisa restart must occur in the case of MySQL18:39
amcrnmost cloud providers will release a new version of a package, and allow users to opt-in if they so choose (with strong wording suggesting that it's brand new and relatively not battle tested), only forcing an automatic migration many days/weeks/months later18:39
redthruxdemorris - lets ask ourselves  What Does Amazon Do18:39
kevinconwayredthrux: +118:40
demorrisredthrux: lets not do that :)18:40
*** jcru has quit IRC18:40
*** isviridov_ has quit IRC18:40
*** SushilKM__ has quit IRC18:40
demorrisamazon is a bit brutal with this stuff18:40
demorrisi mean, they send you eviction notices...18:40
redthrux+1 on brutal18:40
demorrisnot something i ncecessarily wanting to replicate that18:40
SlickNikamcrn: I tend to agree with that. I can see users opting-in or not, depending on what they're using the said instance for.18:41
demorrisso amazon has maintenance windows18:41
demorrisin practice this is not a bad idea18:41
demorristhey know that things need to be kept updated18:41
*** NehaV has joined #openstack-trove18:41
vipulhow about we start with a user-initiated call first.. that gets someone from 5.5.10 -> 5.5.1118:41
SlickNikI'd be much more risk-averse to opting in for an instance running my production server, than say for an instance that I'm using for testing my deployments.18:41
demorrisso they let the user choose a window when those things could be applied18:41
vipulthat can always be rolled into an automated thing base on a window18:41
demorrisI like the idea of starting with allowing a user to choose to update first18:42
demorrisand coupling that with some way to allow the provider to manage instances that need to be updated18:42
demorristhere will be security holes in DBMS's that you will then force updates on users18:42
kevinconwaydemorris: even if it requires a restart?18:43
demorrisyes18:43
vipulSure, i think that's fair -- the user can be notified, and an admin can initiate the update on their behalf18:43
datsun180bwell shoot, conductor failed after my rebase18:43
demorrishence the concept of a maintenance window - a period of time when updates could be applied with some disruption (the provider would define what that means)18:43
datsun180bback to the drawing board18:43
SlickNikdemorris: Is what's driving this primarily a security thing (version old.1 has a vulnerability that needs to be patched) or a convenience thing (version new.2 has a feature that users might want)?18:44
demorrisnot just security18:44
demorriscould be a feature, could be a general bug fix18:44
demorrisperformance improvement18:44
demorristhese things are not static, they are constantly being updated…more so on newer revisions like 5.618:45
demorrisin Trove, I propose that we expose a way for users to 1) self manage updates 2) a framework for providers to manage updates on behalf of the user18:45
demorristhat's it at a high level18:46
demorrisfor use case 1, you have different paths18:46
demorrissome users don't care what version it is, they just want to be on the latest18:46
demorrisothers might care what version they are on, and "may" want to select a specific version18:46
demorrisI envision the API exposing several pieces of data to enable this.  1) are updates available (true/false) 2) current version 3) available versions18:47
demorrisand any other meta-data we have about those versions such as what is included in them (security fix, bug fix, etc.)18:48
kevinconwaydemorris: doesn't the datastore/type api already cover that?18:48
kevinconwayin terms of letting you know what versions there are18:49
vipulkevinconway: +1 i think most of these are derivable18:49
amcrnkevinconway: somewhat, you can list versions and types, and i believe it will also tell you what the default version is for each type, but it will not tell you what's the "latest"18:49
amcrnassuming monotonically increasing version schemes however, that's derivable18:49
kevinconwayamcrn: did the available_date stuff not make it in?18:49
amcrnnope18:49
demorrisI care less about where this exists, if it exists in versions / types, great, or if it just a modification to it to support it, great as well18:50
demorriseven if it did, it would take some level of work to package it up18:50
kevinconwaydemorris: package it up?18:50
demorrisis it right to just give the API user current and available versions and force them to diff it?18:51
demorrisrather than just tell them true|false if a new version is available?18:51
kevinconwaythe API isn't meant to be directly consumed. it's for building applications. The application should tell you.18:51
kevinconwayso the client or GUI18:51
demorriskevinconway: I don't get that statment18:52
demorristhe API is directly consumed by many different users18:52
amcrnyou'll need more than latest, you'll need the concept of "certified" because the latest version might be available for use, but the recommended/supported/certified version is a major version below18:52
amcrnor some permutation thereof18:52
kevinconwaydemorris: i'm saying this might be something we can put into the trove-client18:52
SlickNikso another question: even if the list of versions is available in the datastore api, an upgrade is not always possible from one version to another. How do we surface which  version upgrades we do support, and which ones we don't?18:53
demorrisSlickNik: imho that needs to be left up to the operator18:53
amcrn+118:54
kevinconwaySlickNik: i think the provider is in control over which versions are available through the version/type api18:54
demorrisbut you are right that you would need some rough policies to define what is possible in your deployment18:54
SlickNikkevinconway: Yes, but I might want to make a mysql 6 available for new instances when it comes out; and yet an upgrade from mysql 5.1 to 6 might not be possible.18:56
kevinconwaySlickNik: i think those have to be separate data stores. or we have to talk about major upgrades. right now we're just on minors18:56
demorrisso am I right in assuming that there is general agreement that my 2 use cases proposed are valid and belong in Trove in some capacity?18:56
kevinconway5.1.1 to 5.1.2 or 5.2.018:56
amcrni think we'll need to amend the datastore tables to have the concept of "upgrade_from" and "upgrade_to"18:56
demorrisimplementation details to be worked out of course...18:56
demorrisjust want to make sure we have agreement on the proposed use cases we are solving for18:57
*** konetzed has joined #openstack-trove18:57
kevinconwaydemorris: your major concern in all this is downtime for the owner of the db right?18:57
demorrisI'll repost - demorris: in Trove, I propose that we expose a way for users to 1) self manage updates 2) a framework for providers to manage updates on behalf of the user18:58
amcrnin that chronological order, i agree18:58
demorrisyes, updates and upgrades are disruptive18:58
demorrisamcrn: okay cool18:58
demorrisand we can break use case 1 down further18:58
demorrislets get synced on terminology18:59
amcrnhave to bounce to a meeting, will read chatlog once i return19:00
demorrisspecifically on versioning…major.minor.[build[.revision]]19:00
*** amcrn is now known as [a]mcrn19:00
konetzeddemorris: that only works for project following gnu version control19:00
demorrisokay, well work with me here, what other versioning types are there?19:01
kevinconwaysemantic versioning19:01
demorrisfor the various DBMS's19:01
kevinconwaymajor.minor.patch19:01
konetzedkevinconway: thats still following gnu19:01
kevinconwaywell we can use mysql as an exception19:01
konetzedim talking more about like solaris style that openstack uses19:02
kevinconway5.5 is a major rev up from 5.119:02
demorrisat least major.minor is the same19:02
konetzedkevinconway: its still following gnu rules, there it nothing that says minor revs have to be compatable19:03
kevinconwaykonetzed: there is in semantic versioning19:03
kevinconwayminors can't be backwards incompatible19:03
kevinconwayonly majors19:03
demorrisdoes MySQL consider 5.X to be major?19:03
konetzeddoing like 2013.1 is a complete break from gnu19:03
kevinconwaydoes gnu really allow for backwards incompatible minors? or is it only within a window of X minors?19:04
konetzedi dont know or care, i was talking about just breaking from x.y.z19:04
kevinconwaydemorris: i would consider it major if they have incompatible changes19:04
kevinconwaymeaning schema changes are required to do the update19:04
kevinconwayor major commands change19:05
konetzeddemorris: i made things confusing and this got out of hand19:05
*** rnirmal has quit IRC19:06
demorriskonetzed: a little :)19:06
konetzedwhat i was trying to get at is you were talking about gnu versioning, how the packages are versioned really doesnt matter19:06
kevinconwaywhat i'm trying to point out is that major and minor updates can't be inferred from the version number19:06
kevinconwaymajor/minor in terms of impact that is19:06
demorrisyeah, I think it is going to come down to specific policies for each DBMS and how they are handled19:06
konetzeddemorris: i dont think you really do19:07
demorriseach one will potentially treat it different;y19:07
konetzedin the end it only matters to the packaging system your using19:07
konetzedand how your software lifecycle is19:07
konetzedif your using openstack versioning19:07
konetzed"2013.1" it doesnt matter as long as the package manager your using has the correct information to know its a update19:08
demorrisi see19:08
kevinconwaykonetzed: we're not really worried about the package managers19:08
konetzedkevinconway: i have no clue what your worried about19:08
konetzedi know in the end how the system will deal with it19:08
kevinconwaywe're talking about updating trove databases19:08
demorrisI care more about the user experience of a user managing their updates and the provider managing them on behalf of the user19:09
konetzedthe trove database or customer instances?19:09
kevinconwayinstances19:09
demorriswe nee dot be able to communicate when updates are available, and what is supported, be it major or minor only19:09
konetzedthen unless your going to rebuild the package mangers on the instances you care about the package mangers19:09
demorristhe system needs to supper that and potentially handle rules/policies on what is allowed differently across types (MySQL vs Cassandra vs. PostgreSQL)19:10
konetzeddemorris: I think you make it flexable enough so that you can import the correct strings in your self19:10
konetzedbecause depending on how someone does their packages it could not follow any standards19:11
konetzedsomeone could decide to give them all codenames to show up, be a pain to sync up with an opensource project but there is nothing stopping someone19:11
demorrisyeah19:12
kevinconwaykonetzed: we just merged the datastore type and version stuff so what shows up to the user is what we put in it19:12
demorrisi need to run19:12
demorrisgood discussion, hoping someone will pick this up19:12
demorrisdon't all jump at once :)19:12
konetzedkevinconway: i propose all mysql versions now be used in code names, because well im a hoster and thats what i want19:12
konetzedkevinconway: so i just made up my own versioning19:12
kevinconwaykonetzed: i'm not sure we're having the same conversation19:13
konetzedwhat i am saying is stop worring about the versioning its doing and build a system that can be told19:13
konetzedyou have mysql version fuzzy and zebra is a nupdate19:13
konetzedan update19:13
kevinconwaykonetzed: we doo19:13
konetzedthen why do you care what versioning they are using?19:13
kevinconwaythe question is how to present an available upgrade to users19:13
kevinconwayand when they can perform updates that cause downtime19:14
kevinconwaydemorris: brought up versioning schemes19:14
kevinconwayi was saying they can't be trusted to determine what is major or minor in terms of impact to product or effort to update19:14
konetzedi think that has to be controled by the manager of the system19:15
kevinconwayas the provider we would be in control over how versions are presented to users19:15
konetzedyeas19:15
konetzedyes19:15
kevinconwayquestion is how to tell them a newer version is available19:15
konetzedsorry i have really bad lag today19:15
kevinconwayor how to let them initiate the update19:16
konetzedi think you just go you have "blah" and "foo" is out19:16
kevinconwaywell, major impact updates might require a lot more than just "package-manager update mydb"19:16
kevinconwayso you couldn't go from mysql 4.0 to 5.5 without pain19:17
konetzedand to me thats up to the provider to decide19:17
konetzedits probably not a good idea to update minor revs of mysql w/o having a whole process in place19:17
kevinconwayso let's start with this example19:18
kevinconwayi'm a provider who offers mysql 5.119:18
kevinconwayi want to allow my customers the option to update to 5.519:19
kevinconwaythere are backwards incompatible changes between those two versions19:19
*** jcru has joined #openstack-trove19:19
kevinconwayi'm not even sure you can "package-manager update" for that19:19
kevinconwayi just think there's a whole lot more to doing an update than running a package manager19:21
kevinconwaythe db configs change, the schema options change, the db api changes19:21
konetzedkevinconway: i get what your sayign but that would probably be a way more complicated change then just updating mysql anyways19:22
konetzednow you could have a rule engine that says if you want to go from 5.1 to 5.6 you must dump db, upgrade19:22
konetzeddo full restore19:22
kevinconwayright, so there is a distinction between minor impact and major impact updates19:23
kevinconwaymajor impact updates probably require a backup and restore19:23
kevinconwayso demorris question was how do we present to users the option to perform minor impact updates that may still require downtime19:23
konetzedkevinconway: i guess i was saying you need a way of saying that but not tying it to major minor19:26
*** Barker has joined #openstack-trove19:33
*** adrian_otto has joined #openstack-trove19:37
*** adrian_otto has quit IRC19:37
*** adrian_otto has joined #openstack-trove19:43
*** ashestakov has quit IRC19:44
*** adrian_otto has quit IRC19:54
*** adrian_otto has joined #openstack-trove19:57
*** Barker has quit IRC19:59
*** yogesh has quit IRC20:01
*** yogesh has joined #openstack-trove20:02
*** plodronio has joined #openstack-trove20:02
*** tanisdl has joined #openstack-trove20:04
*** yogesh has quit IRC20:06
*** [a]mcrn is now known as amcrn20:06
*** jasonb365 has quit IRC20:07
*** Barker has joined #openstack-trove20:14
*** adrian_otto has quit IRC20:15
vipulwho knows heat?20:15
vipulquestion about auth tokens - is it possible to have heat present the original token to other components such as Nova20:16
*** adrian_otto has joined #openstack-trove20:16
*** NehaV has quit IRC20:16
vipulor does Heat have to always generate a new token and have some sort of Trust configured20:16
*** jasonb365 has joined #openstack-trove20:19
*** vipul is now known as vipul-away20:19
*** vipul-away is now known as vipul20:19
*** NehaV has joined #openstack-trove20:30
*** adrian_otto has quit IRC20:32
*** jasonb365 has quit IRC20:32
*** jasonb365 has joined #openstack-trove20:39
amcrnkevinconway konetzed demorris: going back to the version upgrade discussion, wouldn't https://gist.github.com/amcrn/dfd493200fcdfdb61a23 suffice?20:45
*** vipul is now known as vipul-away20:48
*** ashestakov has joined #openstack-trove20:48
*** Barker has quit IRC20:51
*** vipul-away is now known as vipul20:51
*** yogesh has joined #openstack-trove20:52
*** cweid has joined #openstack-trove20:53
demorrisamcrn: how would the user determine if an upgrade was available?20:55
demorrisactually, given that this is trove-manage, I assume this to solve use case 2, where the Trove operator does it, not the end user20:56
demorrisso this does not solve use case 1, but I like it for the second use case20:56
konetzedamcrn: i think this works fine but it would be nice if it was a little more dynamic20:57
*** Barker has joined #openstack-trove20:57
konetzedthere is no point in storing the upgrade info somwhere when you could just query for version the instance has and the current version of that update stream20:57
konetzedamcrn: unless i have something wrong with this something would have to constantly be updating those relationships to make sure the data wasnt out of date20:58
demorriskonetzed: which relationships?20:58
amcrnwell, this is merely the bookeeping table that determines whether one version is upgradeable to another, and what class/manager is responsible for the logic20:58
amcrnhow this information is surfaced to the user, that's another story20:59
demorrisyep20:59
*** jasonb365_ has joined #openstack-trove20:59
konetzeddemorris: in amcrn example your managing relationships using foreignkeys to a version table, as soon as you published a new version you would have to update the relationships20:59
amcrnthis is the backbone to support user-initiated upgrades, and provider-initiated upgrades, and automated upgrades20:59
demorrisI like the manager approach because then the manager can be tasked with handling both minor, major, etc. upgrades on a per type basis21:00
konetzedamcrn: so your just saying all this is a mapping saying x is upgradable to y21:00
*** jasonb365 has quit IRC21:00
*** jasonb365_ is now known as jasonb36521:00
demorriskonetzed: yeah I understand it to be you want to upgrade from x to y and the manager would enforce if that is possible and how it does it21:00
amcrn"as soon as you published a new version you would have to update the relationships" => i consider this a feature, not a detractor21:01
*** yidclare has joined #openstack-trove21:01
konetzeddemorris: ok i think thats was my problem i thought this was like the version an instance had to what it could be upgraded to21:01
konetzedamcrn: ^^^^^21:01
amcrnoh21:01
konetzedthis is saying if your running mysql 5.1.1 you could upgrade to 5.1.221:02
amcrncorrect, this would be the global table of truth of which versions are allowed to upgrade to what21:02
konetzedand there could be entries for each of the versions higher than 5.1.1 that followed that upgrade path21:02
konetzedamcrn: yes then your correct having to build the relationships by hand would be a feature not a detractor, sorry for my confusion21:03
amcrnno worries, my gist is fairly barebones, i could have prefaced it a bit better21:03
openstackgerritEd Cranford proposed a change to openstack/trove: Conductor proxies host db access for guests  https://review.openstack.org/4511621:03
konetzedamcrn: I like this because it completely ignores the the versioning of the packages, it is completely up to the provider to set those strings21:04
amcrnyep :)21:04
amcrnwe tend to avoid upgrades in certain environments, whereas in others we let users play fast and loose with fate, so this level of configurability will work nicely for us21:05
konetzedand with this model you could actually have differnt upgrade versions active21:05
konetzedamcrn: i think i missed something what is "upgrade_manager"?21:07
amcrnit's a logical mapping between a key and a class name21:07
amcrnthe pattern exists already at https://github.com/openstack/trove/blob/1cceaa11dfc4d4ae6cd68da61e0c71fc6180a515/trove/guestagent/dbaas.py#L36-L3921:07
amcrnthe general idea is to protect against a refactoring breaking your datamodel21:07
datsun180bwtf unit tests21:08
konetzedinteresting, so this could be extened to handle cases of upgrading from mysql 5.1 to 5.5 which could require complex steps outside of normal package manager updates21:09
amcrnso in this particular scenario, upgrade_manager could be "mysql-5.5.x-to-mysql-5.6.x", which in the code you'd have a dict of "mysql-5.5.x-to-mysql-5.6.x' => trove…..something.upgrade.Manager21:09
konetzedamcrn: ^^^^21:09
konetzedlol21:09
*** NehaV has quit IRC21:09
konetzedamcrn: sounds perfect IMO21:09
konetzedthe idea at least21:09
amcrnah shucks21:10
* amcrn kicks a rock and blushes21:10
konetzedamcrn: i wonder if there could be another field added, like something about risk21:10
amcrn100% with you on that21:10
konetzedno risk in going from mysql 5.1.1 to 5.1.2 but high risk going for 5.1.1 to 5.6.121:11
demorrisI'd like to see us add more meta-data to the the available versions as well21:11
demorrisso that when you do upgrade you can see what was actually in it21:11
konetzeddemorris: maybe a json blob to be stored with required and optional attributes21:11
amcrni'm still pondering how to assess risk, how to message whether a package might be beta, whether it's supported (by the provider), etc.21:11
demorrisperhaps that could just be a link to some package manifest21:11
demorrisamcrn: I had a model for this in the original types/versions BP21:12
konetzedlike a cve only not21:12
demorrisrather than just active/inactive21:12
amcrndemorris: link?21:12
demorristhere was a state field, and the idea was to have SUPPORTED, DEPRECATED, BETA, etc.21:12
konetzeddemorris: amcrn what about adding a external url link so a provider if they wanted could include a cve type information21:12
demorrisamcrn: it may have been clobbered in the changes to the current spec of types..21:13
demorrislet me see if I can dig it up21:13
konetzedthat could hold all the metadata you wanted along with lists of feature/bug/security for that update21:13
amcrnkonetzed: interesting, that's a clever idea21:13
konetzedi hate refering to it as a CVE but i figure everyone knows what those are21:14
amcrni like the decoupling of the information from the actual database, because the folks writing the release notes don't need to be added to ACLs21:14
konetzedthat is nice21:16
amcrnvery awesome idea the more i think about it21:17
*** jmontemayor has quit IRC21:17
*** NehaV has joined #openstack-trove21:18
amcrndemorris: in terms of state (at least along the lines of SUPPORTED, DEPRECATED, etc.), i think there are two places where this has value. (1) is that a version itself can have a state, and (2) the migration path can have a state21:19
demorrisyeah that makes sense21:19
demorriswhat about also if you want to put types into production but don't want to expose them to users yet?21:19
demorrisis there a way to have hidden types?21:20
*** vipul is now known as vipul-away21:20
*** vipul-away is now known as vipul21:20
*** jasonb365 has quit IRC21:20
amcrnwell, you can protect against the upgrade by not inserting a row into datastore_upgrade, but to be able to hide the version completely, all that's available right now is the ACTIVE in datastore_versions21:20
amcrnwhich isn't quite the same, because i'm imaging you'd want HIDDEN to technically be "active" in the sense it can be used by anyone, it's just hidden from Horizon + API for non-admin roles, yes?21:21
amcrnimaging = imagining*21:21
*** jasonb365 has joined #openstack-trove21:21
demorrisyeah, I was talking more just about the base types / versions support moreso than the upgrade process21:21
demorrisamcrn: correct, basically, they are there in the system, accessible only of you know about them and can access them21:21
amcrni like it, makes sense to me21:21
demorrisI guess another fieled would need to be added to the database to support that21:22
demorris"hidden" - false by default21:22
amcrnthat would likely be helpful in scenarios in which you want to deprecate an old version, but you have an extremely valuable client that you've made an exception for21:23
demorrisI like the thoughts here...21:23
demorrisyeah21:23
demorrisgood discussion, I need to run...21:24
amcrntake it easy21:24
demorriswho is going to run with this?21:24
amcrni'll update the gist, and push it to the mailing list?21:24
demorrisjust want to make sure someone wants to pick it up, my usefulness stops at ideas… :)21:24
demorrisyeah, sounds like a good plan21:25
demorrisget discussion going on ML21:25
demorristalk to y'all soon21:25
demorrislater21:25
*** adrian_otto has joined #openstack-trove21:34
*** adrian_otto has quit IRC21:34
*** coolsvap has quit IRC21:37
*** demorris has quit IRC21:41
*** plodronio has quit IRC21:45
*** jasonb365 has quit IRC21:48
*** NehaV has quit IRC21:50
*** plodronio has joined #openstack-trove21:52
openstackgerritEd Cranford proposed a change to openstack/trove: Conductor proxies host db access for guests  https://review.openstack.org/4511621:53
datsun180bthese unit-tests are being goofy22:00
datsun180btestr is caching something22:01
cp16nettox does not work for me because i end up being rate limited22:03
cp16netbecause the instance doesnt get out of build...22:03
datsun180band for some reason testr wants my password, what is going on there22:05
datsun180band i just had a failure locally because TWO random UUID4s COLLIDED.22:06
cp16neti notcied something about that as well22:06
cp16netwhen i ran through the first time22:06
datsun180bi swear something's being cached and i think it has to do with the db22:06
*** pdmars has quit IRC22:06
cp16neti just reverted to master and running the same test there22:06
cp16netwondering if something slipped through22:07
datsun180bi swear something's being cached with a timer attached22:07
cp16netdatsun180b: maybes it wants your password to `sudo get_me_a_sandwich`22:08
cp16net:)(22:08
datsun180bSomething is busted in my unit tests and I don't know why. All of a sudden I'm not allowed to create DBBackup entries, but only in one test, and not consistently22:12
datsun180band no idea about this "service was not discovered" business22:12
datsun180bhttps://gist.github.com/ed-/e04d6bf6c4c910b12d30 what22:14
amcrnit looks like a teardown isn't cleaning up22:17
*** NehaV has joined #openstack-trove22:17
cp16netoh nos22:17
cp16neteven master has the same issue22:17
amcrnthe thing is, this might have been going on for awhile, but we might have not noticed due to tox being broken for a week+ due to the dependency issue22:18
datsun180bi thought these unit tests were supposed to start green-field every time22:25
datsun180bif they're reusing resource between runs we should stop that22:25
datsun180bi'm just rerunning tox -epy26 on trove over and over again and not getting consistent results22:26
*** yogesh has quit IRC22:34
datsun180bcp16net: did you say master has the same problem as my gist?22:39
*** yogesh has joined #openstack-trove22:39
*** yogesh has quit IRC22:41
*** yogesh_ has joined #openstack-trove22:46
*** NehaV has quit IRC22:46
*** ashestakov has quit IRC22:47
datsun180bfffffff22:47
cp16netdatsun180b: i ddidnt see that issue but the rate limit issue i saw before22:53
datsun180bI'm getting the same problems in fresh code too22:54
datsun180b"UnboundLocalError: local variable 'mysqld_bin' referenced before assignment" OH BOY22:54
esmuteyeah datsun180b. Im getting the same22:56
esmutewith fresh code22:57
datsun180bfixing that and rerunning seems to be okay22:57
esmutewondering how it got past our gate22:57
datsun180btry https://gist.github.com/ed-/1f14b6b2a802d01e2989 this esmute22:57
datsun180bI'm getting other goofy testr problems, and to make things weirder, the results change if I do "sudo ls" before I rerun the tox tests23:00
*** robertmyers has quit IRC23:00
datsun180bsomething is asking for my root password during the testr tests23:00
esmuteThese are the testr errors im getting23:05
esmutehttps://gist.github.com/kokhang/757282723:05
*** yogesh_ has quit IRC23:06
*** yogesh has joined #openstack-trove23:06
*** yogesh has quit IRC23:06
datsun180bYES! you're getting the not discovered problem too23:06
datsun180bvindication!23:06
clarkbone of those looks like an unquoted string23:10
*** Barker has quit IRC23:10
datsun180bclarkb: where do you see that?23:16
clarkbdatsun180b: https://gist.github.com/kokhang/7572827 line 9, but now I see it is actually a variable that didn't get a value assigned to it23:17
datsun180bgotcha, yeah. i have a fix for that one, i should just submit it23:18
openstackgerritEd Cranford proposed a change to openstack/trove: Add default case for mysqld_bin  https://review.openstack.org/5755523:19
esmutedatsun180b: I added the path where mysql lives in the candidate list. https://github.com/openstack/trove/blob/master/trove/guestagent/datastore/mysql/service.py#L4223:19
esmuteSince im running tox in a macbook, the location of my mysql is different than the one in the candidate list23:20
datsun180bi'm on a mac too, i think i like your fix better23:20
SlickNikWas just talking to esmute about this. Seems silly to have a "candidate list".23:20
esmuteIt was SlickNik who recommended after i went to bug him23:21
SlickNikAs mysql could be installed in quite a few different locations, depending on os / architecture...23:21
openstackgerritTim Simpson proposed a change to openstack/trove: Fixing typos in _create_server_volume.  https://review.openstack.org/5755623:22
esmuteBut im still getting the second error23:22
esmutehttps://gist.github.com/kokhang/757282723:22
grapexSlickNik vipul hub_cap: Please fast track this- some recent commits broke things at Rax: https://review.openstack.org/#/c/57556/23:22
datsun180bso am i after addressing the mysqld_bin thing23:22
*** kevinconway has quit IRC23:22
SlickNikgrapex: wow.23:24
grapexSlickNik: Found it in fake mode in a few seconds by changing the test conf.23:25
grapexWe should consider adding a few more permeatations of the test conf to the tox runs, since the fake mode integration tests run in seven seconds and are perfect adept at finding stuff like this.23:25
grapexWe could have another run that disabled volume support entirely.23:25
grapexSlickNik: Actually, do you guys still use that flag?23:26
esmuteit is trying to stop a mysql instance that doesnt exist in my environment23:27
SlickNikYes, we run with volume support disabled.23:27
grapexSlickNik: Well, for seven more seconds a tox run we could determine if anything in that path failed.23:27
SlickNikI think that's totally worth it.23:28
esmuteSlickNik: +123:28
grapexSlickNik: I'll look into whipping up a pull request for it then.23:28
SlickNikgrazie. And thanks for finding this...23:28
*** datsun180b has quit IRC23:29
grapexSlickNik: No problem. You can also show your gratitude by instantly approving it. :)23:29
SlickNikAm just doing that. :)23:29
SlickNik<3 <323:30
grapexSlickNik: Thanks!23:30
hub_capgrapex: what, u want that code to work?!?!23:30
SlickNiklol23:31
SlickNiktoo much to ask?23:31
hub_capi am back from my treacherous, waterlogged trip to sfo23:31
SlickNikwaterlogged?23:31
SlickNikdid you swim?23:31
hub_capmy feet swam SlickNik23:32
hub_capthey held me up as i walked across the water23:32
hub_capit was nasty this am, but we need the rain so i cant complain23:33
hub_capmaybe the 52% of the state thats not on fire will turn green again23:33
esmutei can picture mysql kayaking down that crooked street in San Francisco23:33
esmute*myself*23:33
hub_capok that makes way more sense23:33
SlickNikmysql is a dolphin, it needs no kayak...23:33
openstackgerritA change was merged to openstack/trove: Fixing typos in _create_server_volume.  https://review.openstack.org/5755623:33
esmutedamn autocomplete feature by my fingers23:34
hub_capi tried to take my wifes family down lombard, but my niece wasnt feeling well and puked on the way up so we canned the idea23:34
* hub_cap was sad23:34
esmutehub_cap: That must have been so embarrassing for her. That place is full of tourists23:35
hub_capheh ya it was in the car in a bag23:35
hub_capgood times23:35
esmuteahh ok.. inside the car..23:36
hub_capya even better!23:36
esmutei feel bad for people living in those houses. They probably take a good 15 minutes to get out or come home with all the tourists there23:37
* hub_cap does a little dance, its review time23:37
hub_capdoes anyone know if datsun solved his woes in review 4511623:40
hub_capSlickNik: where is your hubot fork living? id like to add a "give me a link / info to review X"23:41
hub_capesmute: i bet they dont drive :)23:41
hub_capdoes anyone know if datsun solved his woes w/ review 4511623:43
hub_caplol i wrote that 2x ^ ^23:46
hub_capdoes anyone know if datsun solved his woes wrt review 4511623:46
SlickNikhub_cap: it's in one of my repos on github.23:54
SlickNikone sec23:54
SlickNikhttps://github.com/SlickNik/extrovert23:55
hub_capsweet SlickNik thx23:55
hub_caphe seems to be gone though23:55
SlickNikIf you push the changes to it, I can do an update to the bot.23:56
SlickNikoh, I can check on him23:56
*** extrovert has joined #openstack-trove23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!