Monday, 2013-10-07

*** vipul is now known as vipul-away00:20
*** mmcdaris has quit IRC00:37
*** vipul-away is now known as vipul00:41
*** matsuhashi has joined #openstack-trove00:54
*** nosnos has joined #openstack-trove01:00
*** robertmyers has joined #openstack-trove01:16
*** erkules_ has joined #openstack-trove01:24
*** erkules has quit IRC01:27
*** erkules_ has quit IRC01:46
*** erkules_ has joined #openstack-trove01:47
*** fandikurnia01 has joined #openstack-trove01:50
*** fandikurnia01 has quit IRC02:07
*** vipul has quit IRC02:12
*** vipul has joined #openstack-trove02:13
*** vipul is now known as vipul-away02:28
*** robertmyers has quit IRC02:51
*** vipul-away is now known as vipul02:53
*** fandikurnia01 has joined #openstack-trove03:05
*** vipul is now known as vipul-away03:09
*** Kapil has joined #openstack-trove04:29
*** SushilKM__ has joined #openstack-trove04:58
*** adrian_otto has joined #openstack-trove05:08
*** adrian_otto has quit IRC05:08
*** redthrux has quit IRC05:21
*** kevinconway has quit IRC05:21
*** Nate3 has quit IRC05:21
*** Nate1 has joined #openstack-trove05:22
*** kevinconway has joined #openstack-trove05:22
*** redthrux has joined #openstack-trove05:24
*** vipul-away is now known as vipul05:36
*** nosnos has quit IRC05:36
*** nosnos_ has joined #openstack-trove05:36
*** matsuhashi has quit IRC05:56
*** erkules_ is now known as erkules06:02
*** vipul is now known as vipul-away06:05
*** vipul-away is now known as vipul06:24
*** dafter has quit IRC06:26
*** dafter has joined #openstack-trove06:26
*** matsuhashi has joined #openstack-trove06:30
*** dafter has quit IRC06:30
*** vipul is now known as vipul-away06:40
*** mmcdaris has joined #openstack-trove06:41
*** vipul-away is now known as vipul06:43
*** matsuhashi has quit IRC06:51
*** matsuhashi has joined #openstack-trove06:54
*** vipul is now known as vipul-away07:00
*** matsuhas_ has joined #openstack-trove07:01
*** matsuhashi has quit IRC07:01
*** nosnos has joined #openstack-trove07:02
*** nosnos_ has quit IRC07:02
*** vipul-away is now known as vipul07:04
*** nosnos has quit IRC07:19
*** nosnos has joined #openstack-trove07:20
*** vipul is now known as vipul-away07:25
*** vipul-away is now known as vipul07:27
*** vipul is now known as vipul-away07:43
*** vipul-away is now known as vipul07:52
*** mmcdaris has quit IRC07:55
*** SnowDust has joined #openstack-trove08:42
SnowDusthello all .. !08:42
*** ashestakov_ has joined #openstack-trove08:46
*** ashestakov_ has quit IRC08:48
dmakogonhi08:56
SnowDusthello dmakogon09:27
dmakogonSnowDust: whaazzzzzzzzzzzzaaaaaaaaaaaaaaaap09:27
SnowDustnothing new .. bloated ..09:27
SnowDustshare something xciting !09:27
dmakogonwhat do you want to see ?09:28
dmakogondo you want me to do knock-knock jokes ?09:28
*** ppenjoy has joined #openstack-trove09:31
SnowDustno .. may be .. ur code ..09:32
SnowDusteven that does charm me !09:32
dmakogonoh, i'm just updating my last reviews09:33
dmakogonto get finally +109:33
dmakogon+209:33
SnowDustyeah .. some brilliant ones .. need the world to catchup with them .. :)09:33
SnowDustbut a +2 on your code quality09:34
SnowDustalways !09:34
SnowDustenvy u !09:34
SnowDust;)09:34
*** ashestakov_ has joined #openstack-trove09:35
dmakogonso, any news ?09:37
dmakogonhow was you weekend ?09:37
SnowDustkind .. of .. wrecked :)09:38
SnowDustam salvaging it .. :)09:38
openstackgerritDenis M. proposed a change to openstack/trove: Update statuses on GA timeout  https://review.openstack.org/4572309:44
*** ppenjoy has left #openstack-trove10:32
*** SushilKM__ has quit IRC10:32
*** fandikurnia01 has quit IRC10:59
*** fandikurnia01 has joined #openstack-trove11:00
*** SushilKM has joined #openstack-trove11:00
*** SushilKM has quit IRC11:04
*** fandikurnia01 has quit IRC11:04
*** fandikurnia01 has joined #openstack-trove11:05
openstackgerritDenis M. proposed a change to openstack/trove: PEP8. E125, F811, F401, H703  https://review.openstack.org/4830511:08
*** ikhudoshyn_ has joined #openstack-trove11:28
*** ikhudoshyn has quit IRC11:28
*** dukhlov has quit IRC11:37
*** dukhlov has joined #openstack-trove11:39
*** fandikurnia01 has quit IRC11:59
*** SushilKM has joined #openstack-trove11:59
*** pdmars has joined #openstack-trove12:03
*** matsuhas_ has quit IRC12:04
*** matsuhashi has joined #openstack-trove12:06
*** matsuhashi has quit IRC12:10
*** matsuhashi has joined #openstack-trove12:11
*** Kapil has quit IRC12:14
*** rushiagr has joined #openstack-trove12:21
*** fandikurnia01 has joined #openstack-trove12:24
*** SnowDust has quit IRC12:36
*** nosnos has quit IRC12:47
*** rustlebee is now known as russellb12:54
*** matsuhashi has quit IRC12:55
*** matsuhashi has joined #openstack-trove12:56
*** matsuhashi has quit IRC13:00
*** matsuhashi has joined #openstack-trove13:01
*** jlucci has joined #openstack-trove13:07
*** matsuhashi has quit IRC13:13
*** matsuhashi has joined #openstack-trove13:14
*** matsuhashi has quit IRC13:18
*** robertmyers has joined #openstack-trove13:19
openstackgerritPradeep Kumar Chandani proposed a change to openstack/trove: Service Registration using conf file  https://review.openstack.org/4105513:32
*** jmontemayor has joined #openstack-trove13:41
ikhudoshyn_PradeepChandani: Hi! There is a consideration about ur review13:50
ikhudoshyn_Looks like defaults in cfg.py have higher priority than user configured service type registry. Is it intended?13:53
*** rushiagr has quit IRC13:57
*** jcru has joined #openstack-trove13:59
*** dafter has joined #openstack-trove14:01
*** Barker has joined #openstack-trove14:02
*** kevinconway has quit IRC14:06
*** dafter has quit IRC14:15
*** dukhlov has quit IRC14:37
*** dukhlov has joined #openstack-trove14:37
openstackgerritPradeep Kumar Chandani proposed a change to openstack/trove: Service Registration using conf file  https://review.openstack.org/4105514:39
*** kevinconway has joined #openstack-trove14:46
*** Kapil has joined #openstack-trove14:49
*** amytron has joined #openstack-trove15:03
*** SushilKM has quit IRC15:03
*** rnirmal has joined #openstack-trove15:06
*** tanisdl has joined #openstack-trove15:09
*** adrian_otto has joined #openstack-trove15:10
*** adrian_otto has quit IRC15:18
*** paul_lodronio has joined #openstack-trove15:20
*** yidclare has joined #openstack-trove15:25
*** Barker has quit IRC15:30
*** Barker has joined #openstack-trove15:34
*** erkules_ has joined #openstack-trove15:37
*** Kapil has quit IRC15:39
*** erkules has quit IRC15:39
*** Nate1 has quit IRC16:02
dmakogonanybody home ?16:02
*** Nate1 has joined #openstack-trove16:05
*** adrian_otto has joined #openstack-trove16:14
*** dukhlov has quit IRC16:19
*** dukhlov has joined #openstack-trove16:20
*** rushiagr has joined #openstack-trove16:32
*** adrian_otto has quit IRC16:34
*** mmcdaris has joined #openstack-trove16:41
*** mmcdaris has quit IRC16:46
*** mmcdaris has joined #openstack-trove16:48
*** mmcdaris has quit IRC16:52
*** Nate1 has quit IRC16:54
*** mmcdaris has joined #openstack-trove16:56
*** adrian_otto has joined #openstack-trove16:57
esmuteHi dmakogon16:58
hub_caplol dmakogon16:58
dmakogonhi16:58
dmakogonmy nick is normal16:59
dmakogonuntil i connect from home)))16:59
hub_capikhudoshyn_: thx for catching that, user configured should override it PradeepChandani16:59
hub_capdmakogon: set up a bouncer or irssi proxy!! ;)16:59
hub_capim on my irssi server right now chatting with you but behind my terminal window i have my irc client, logged in as me too (to the irssi proxy)17:00
kevinconwayi connect to irc using TOR via my wristwatch17:01
kevinconwayand type messages by making funny facial gestures17:01
isvirido`kevinconway, i would like to see it17:02
*** SnowDust has joined #openstack-trove17:02
*** yidclare has quit IRC17:02
hub_capkevinconway: omg lol17:04
hub_capisvirido`: by wristwatch he means http://www.jeremyblum.com/wp-content/uploads/2013/05/2013-05-26-09.15.45-e1369896493547.jpg17:05
isvirido`poor, kevinconway ...17:07
*** SushilKM has joined #openstack-trove17:08
hub_cap:P17:10
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/4570817:12
SnowDustisvirido:  have u tried shell scripting from heat ?17:12
*** rushiagr has quit IRC17:13
dmakogonhub_cap: https://review.openstack.org/#/c/48305/17:13
dmakogonhub_cap: https://review.openstack.org/#/c/45723/17:13
dmakogonhub_cap: just as i promise17:13
hub_cap:)17:13
*** tvb has joined #openstack-trove17:14
*** SushilKM has quit IRC17:15
*** SushilKM__ has joined #openstack-trove17:15
*** tvb is now known as dafter17:15
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/4570817:15
SnowDustisvirido`: gone ?????17:16
dmakogonforgot to ask tox if my code is beautiful17:16
dmakogonSnowDust: a bit17:16
*** mmcdaris has quit IRC17:16
SnowDustisvirido` do` do` da` di` du` de` di`17:19
vipuldmakogon: https://review.openstack.org/#/c/45723/14/trove/common/instance.py17:20
dmakogonvipul: look at patch 2117:21
dmakogonvipul: or i'm missing something ?17:23
hub_capdmakogon: what do u use to code? ide ?17:25
vipuldmakogon: Nope, I just question intorducing a new status17:25
vipuldmakogon: I am not sure if we've already discussed this, if so, let me know17:26
dmakogonhub_cap: PyCharm17:26
hub_capPyCharm should have flake8 integration, id think17:26
dmakogonvipul: i think this status is needed17:26
dmakogonvipul: and yes, we've discussed it already17:27
dmakogonhub_cap: yes, but not restricted, or sometimes i'm missing it17:27
dmakogonhub_cap: sorry for flooding17:27
hub_capah dmakogon, no worries. u will learn to run tox before u push :)17:29
*** harlowja has joined #openstack-trove17:29
dmakogonhub_cap: i already know that, but i forgot it, tired =(17:30
hub_cap:P17:30
hub_capdmakogon: u can set up post commit hooks too17:30
hub_capthat just run it for u17:30
hub_capthen no matter how tired u are!17:30
hub_capitll run!!17:30
*** mmcdaris has joined #openstack-trove17:31
*** yogesh has joined #openstack-trove17:32
dmakogonhub_cap: ok17:33
hub_capjust a thought... i havent done it but hey, it might be fun to do17:34
*** arborism has joined #openstack-trove17:35
dmakogonhub_cap: what do you mean ?17:36
hub_capit might be fun to add post commit hooks17:38
hub_capto run tox17:38
hub_capthen blog about it so others can do it :)17:38
dmakogononly tox -epep817:38
hub_capya17:39
dmakogonbut idea is really cool17:39
*** arborism is now known as amrcn17:39
*** amrcn is now known as amcrn17:39
dmakogonguys, i have and idea for jenkins random falls17:42
*** dafter has quit IRC17:42
dmakogonwhat about using soft asserts ?17:42
*** dafter has joined #openstack-trove17:42
*** dafter has quit IRC17:42
*** dafter has joined #openstack-trove17:42
dmakogonsuppose we have assert AssertionError: 2013-10-07T17:41:09Z != 2013-10-07T17:41:08Z, what if we would use something like assert.AlmostEquals ?17:45
hub_capif we have time bugs dmakogon, those are bugs17:45
hub_capthats definitely a bug, weve fixed like ~3 of those already17:46
*** dafter has quit IRC17:46
*** dafter has joined #openstack-trove17:48
*** dafter has quit IRC17:48
*** dafter has joined #openstack-trove17:48
*** mmcdaris_ has joined #openstack-trove17:49
*** mmcdaris has quit IRC17:49
*** mmcdaris_ is now known as mmcdaris17:49
*** tvb|afk has joined #openstack-trove17:49
*** tvb|afk has quit IRC17:49
*** tvb|afk has joined #openstack-trove17:49
*** adrian_otto has quit IRC17:51
*** dafter has quit IRC17:53
openstackgerritDenis M. proposed a change to openstack/trove: Security groups workflow update  https://review.openstack.org/4570817:53
*** tvb|afk has quit IRC17:53
*** yidclare has joined #openstack-trove17:54
*** dafter has joined #openstack-trove17:55
*** tvb|afk has joined #openstack-trove17:59
*** dafter has quit IRC18:01
*** jlucci has quit IRC18:06
*** dafter has joined #openstack-trove18:09
*** tvb|afk has quit IRC18:12
dmakogonvipul: https://review.openstack.org/#/c/45708/18:16
vipulSlickNik: https://review.openstack.org/#/c/45238/ Please review.. The int-tests seem to fail on Queue Delete.. is there something missed in this patch?18:17
openstackgerritA change was merged to openstack/trove: PEP8. E125, F811, F401, H703  https://review.openstack.org/4830518:20
juicehub_cap: grapex: datsun180b: I know a lot is on your plate however, this review is a fix for a "critical" bug for us.  It impacts our billing process.  https://review.openstack.org/#/c/49855/18:23
SlickNikvipul / dukhlov: Yes, will take a look. On first glance, there definitely seems to be an issue with the patch, and not with the tests.18:23
hub_capjuice: cry me a river18:24
hub_capJKJKJKJK18:24
SlickNikjuice: you said "done" to one of the comments. Are you planning to upload a new patch-set for that?18:25
hub_caphahah18:25
hub_capjuice: u do win for the ugliest import ever18:26
hub_capfrom trove.tests.api.instances import GROUP as INSTANCE_GROUP, instance_info18:26
hub_capfix that shit18:26
juiceI was just following by example :)18:27
juiceI hit git review but didn't notice that it came back with a rebase error18:27
hub_capHAHA18:27
hub_capoopsies18:27
hub_capgood18:27
hub_capthen it wouldnt have merged anyway18:27
juicebtw - can we discuss our "import" statement styles in the near future18:27
hub_capso yer getting 2 birds stoned at once18:27
SlickNikheh18:27
hub_capyes juice for sure18:28
hub_capwe can name it the juice rule18:28
*** Nate1 has joined #openstack-trove18:29
dukhlovHi!18:30
juicehub_cap: classic18:30
hub_cap:P18:30
hub_capdukhlov: hello18:30
*** demorris has joined #openstack-trove18:30
hub_capraiders game went till midnight last night18:31
hub_cap:o18:31
*** grapex has joined #openstack-trove18:31
dukhlovregarding this18:31
dukhlovhttps://review.openstack.org/#/c/45238/18:31
dukhlovI've tested on my local VM18:32
openstackgerritJustin Hopper proposed a change to openstack/trove: Fix User ID in Context and Notifications  https://review.openstack.org/4985518:32
amcrnhub_cap: they beat my chargers :/18:32
dukhlovand got the same problem18:32
*** SnowDust has quit IRC18:32
juiceok - the import statement is fixed18:32
dukhlovso now I'm trying to find out problem in code18:32
hub_capamcrn: :)18:33
hub_capwe were on the bart yest going to bluegrass festival and i met a texan...... i could tell cuz he was teh only rider going to candlestick w/o a 9ers shirt on.. he was in full texans garb18:34
*** SnowDust has joined #openstack-trove18:34
hub_capso one might say i made a dumb decision18:35
hub_capi fly back from hong kong and the next day im flying to vegas for my wifes bday18:35
juicenot really your jet lag should play nicely with the vegas night life18:36
juicesleep all day - play all night18:36
juicethough I just had the image of you drooling in a half-comatose state during your nice romantic steak dinner and you wife glaring at you with this "Really?!" expression on her face18:37
hub_caplol steak.. hardly18:37
hub_capmore like raw bar18:37
hub_caplast bday was king crab and martinis :)18:38
hub_capin vegas that is...18:38
amcrnNo Joel Robuchon? Pft.18:38
hub_caplet me try to find18:38
hub_capit was some chef place18:39
hub_capbut we just got king crap and pomegranite martinis and some other raw bar stuff18:39
hub_cap*crab lol18:40
hub_captwas still great18:40
hub_capi cant believe i can get to/from vegas for < 200/pp .. its crazy amytron18:43
hub_capamcrn: ^ ^18:43
hub_caplol @ pinging amytron TAB FAIL18:43
openstackgerritA change was merged to openstack/trove: Service Registration using conf file  https://review.openstack.org/4105518:44
amytronwell. for what's it worth, i can't believe that either, hub_cap18:44
amytronwhat it's*18:45
hub_capright?18:45
amcrncan someone co-sign on a concept real quick? I want to do image building for trove on a completely different box, but I find that keystone/glance are hardcoded to localhost. I'll submit a patch (so it can be assigned via an rc), but I want to first confirm my intentions aren't bizarre.18:46
hub_capgrapex: around?18:46
grapexhub_cap: Yes.18:46
grapexI just got back on.18:46
grapexOn a loaner Mac18:46
amcrnin general, I don't want to have to build images on the same box the api/service is running on, I don't see why the coupling is necessary.18:46
hub_capso youre saying that dib depends on them?18:47
hub_capor our redstack code depends on them being localhost?18:47
amcrnlatter18:47
hub_capso here the deal from my perspective18:48
hub_capand im w/ you ripping it apart18:48
hub_capimho, redstack is for _local_ dev only18:48
hub_capas in, dev/testing18:48
hub_capbuilding a multi node env or a actualy env for running this should be left to things that arent a crappy bash script18:48
hub_capso im cool w/ you changing it to optionally be off the node youre building18:49
hub_capbut i caution you to not rely on redstack lol18:49
amcrnYou read my mind anyway, I was asking from the vantage point of the script, but I'm puppet'izing it ;)18:49
hub_cap:)18:50
hub_capoh and dude puppet is so last wk18:50
hub_capits salt now ;)18:50
amcrnyou're telling me18:50
amcrnpuppet and i are far from friends, let me leave it at that18:51
*** vipul is now known as vipul-away18:53
hub_caplol amcrn18:53
*** grapex has quit IRC18:53
*** grapex has joined #openstack-trove18:54
*** SnowDust has quit IRC18:54
*** amytron has quit IRC18:55
*** amytron has joined #openstack-trove18:55
*** SnowDust has joined #openstack-trove18:56
*** mmcdaris has quit IRC19:02
*** vipul-away is now known as vipul19:04
dukhlovAs I understood now trove is a part of devstack. Is it correct?19:07
dukhlovAnd problem with integration tests connected to this code migration19:08
dukhlov?19:08
hub_capno dukhlov19:08
hub_capwe made sure of no issues19:08
*** SushilKM__ has quit IRC19:08
hub_caphttps://rdjenkins.dyndns.org/job/Trove-Gate/ <-- see the green19:08
hub_capthere was an issue last wk that we fixed in redstack though19:09
hub_caphttps://github.com/openstack/trove-integration/commit/82df245073429cf5b4747841494f46b75119f2ec19:09
openstackgerritJustin Hopper proposed a change to openstack/trove: Fix User ID in Context and Notifications  https://review.openstack.org/4985519:11
*** shivamshukla_ has joined #openstack-trove19:17
*** dafter has quit IRC19:18
juicedmakogon: I have a fix for the intermittent timestamp error in tests19:20
juiceputting together a patch now19:20
*** amcrn has quit IRC19:21
*** adrian_otto has joined #openstack-trove19:26
openstackgerritMichael Basnight proposed a change to openstack/python-troveclient: Massive refactoring to the troveclient. - WIP until further notice.  https://review.openstack.org/4857619:35
*** dafter has joined #openstack-trove19:35
*** dafter has quit IRC19:35
*** dafter has joined #openstack-trove19:35
*** mmcdaris has joined #openstack-trove19:35
hub_capkevinconway: around?19:37
kevinconwayhub_cap: yeah, i'm here. whats up?19:39
hub_capwas wondering if u could see tim... i know where he is now (or isint lol)19:40
*** mmcdaris has quit IRC19:40
*** Nate1 has quit IRC19:45
*** tanisdl has quit IRC19:46
*** mmcdaris has joined #openstack-trove19:49
*** tanisdl has joined #openstack-trove19:49
*** Nate1 has joined #openstack-trove19:50
*** Nate1 has quit IRC19:50
*** Nate1 has joined #openstack-trove19:50
*** dmakogon_ipod has joined #openstack-trove19:50
*** yogesh has quit IRC19:51
*** dukhlov has quit IRC19:56
SlickNikamcrn: have you tried setting the SERVICE_HOST parameter?19:57
dmakogon_ipodamcrn: i have posted few comment on statuses update review.20:00
*** yogesh has joined #openstack-trove20:00
dmakogon_ipodyogesh: hi20:01
dmakogon_ipodwhat's you nick at launchpad ?20:01
dmakogon_ipodyogesh:i'd like to reassign my BP on you20:01
yogeshyogesh-mehra20:02
yogeshhey...20:02
imsplitbitvipul: yt?20:03
dmakogon_ipodyogesh: done20:03
imsplitbitvipul: ICMP ECHO20:03
imsplitbitvipul: SYN20:03
imsplitbitvipul: SYN20:03
imsplitbit:)20:03
hub_capyour packets are dropping20:03
imsplitbitI can see that20:03
hub_capwatchout vipul imsplitbit is trying to ddos you20:04
vipulimsplitbit: ELHO20:04
imsplitbitsweet20:04
vipulwhat's up20:04
imsplitbitok lets talk replication20:04
imsplitbithttps://etherpad.openstack.org/TroveClusteringAPI-WIP20:05
imsplitbithub_cap and I have been discussing the replication capability of a service type20:05
imsplitbitand how to represent it20:05
hub_capoh dont bring me into this20:05
imsplitbitlol20:05
imsplitbityou weren't discussing it with me?20:05
imsplitbitdid I completely imagine this?20:05
imsplitbitSHUT IT!20:06
vipulhas that page been updated since last?20:06
hub_caplol imsplitbit20:06
imsplitbitno but just in case you needed a refresher on what you and hub_cap talked about20:06
imsplitbitI just linked it for context20:06
imsplitbitand for others wanting to participate20:06
dmakogon_ipodhub_cap: hi, again20:06
hub_caphi dmakogon_ipod20:07
imsplitbitso the conclusion drawn was that while replication is a *capability* of a service type, it would be represented just as a cluster is represented20:07
imsplitbitand I'm not in agreement with that statement20:07
imsplitbitso I would love to discuss with you20:07
imsplitbitmy contention is that for anything other than simple master/slave relationship this representation of the data is not clear.20:08
imsplitbiti.e. using "nodes" to represent the instances that are a part of the cluster20:08
imsplitbitfor example: if you want to make a slave of a slave20:09
imsplitbitthis then makes the metadata structure a hot mess20:09
imsplitbitor rather lets say you want to have 1 master with 5 slaves and each of those 5 slaves has a few slaves20:09
dmakogon_ipodi'd like you, all, to take a look at this review https://review.openstack.org/#/c/45708/20:09
dmakogon_ipodimsplitbit: mongo db with sharding is a good example20:10
vipulSure.. if you are implying a hiearchy that's n levels deep.. then it will break down20:10
imsplitbitrepresenting that data in a nested object within the metatdata of the instance object doesn't seem to be the cleanest way to represent it20:10
imsplitbitright20:10
vipulBut say you are doing a master-master-master setup20:10
vipulhow is that represented? why can't it be represented as a cluster20:11
imsplitbitI was proposing to keep instnaces that are replicated separate with metadata representing what their relationship is to one another in their individual metadata20:11
vipulYea so keep it one level20:11
imsplitbitwhat if you want a read only slave from that master*3 setup? for reporting20:11
imsplitbitright20:11
imsplitbiteach master would be it's own instnace20:11
imsplitbitwith metadata that says "hey, I'm a slave of another instance and here is it's ref20:12
vipulBut if you only do multi-master.. than you can have one instance20:12
imsplitbitI wouldn't disagree with that except that then you have an inconsistency in how the data is represented20:12
imsplitbitwhere are the rules that define what is what?20:13
imsplitbitif masters > 1 then represent it as a single instance?20:13
vipulSo how about this.. why can't nodes be elevated to instances or consider them interchangeable20:13
vipulIn the event you add a new slave node20:14
vipulyou can referece the Master as a Node instead of an instance20:14
imsplitbitwell but then what's the value of adding nodes to the api?20:14
imsplitbitif they're just instances?20:14
vipulThey are represented as 'nodes' still..20:14
vipuljust that there are scnearios that allow you to group something to other Instances.. or in the case of replication.. other nodes20:15
imsplitbitbut where is a clean line of separation between when something gets displayed as an instance with node subresources and when the instances are displayed separately?20:15
vipulI think we can say that we always have node subresources20:16
vipulAn instance just becomes a container that groups nodes20:16
imsplitbitso every instance would have at least 1 node that is itself?20:16
*** isvirido` has quit IRC20:16
vipulyes20:16
*** SnowDust has quit IRC20:16
vipulthere is no Physical instance.. an instance is just a collection maybe of one20:16
* imsplitbit is pondering heavily20:16
imsplitbitlet me sketch this out20:17
vipulThat allows you to configure at the Node level.. which then makes the replication use case the same as cluster20:17
imsplitbitI'm doing this on the etherpad if you want to follow/edit20:17
vipulSure..20:17
vipulThe only differnce is with Repication.. you may have depth of N20:18
vipulwhich likely you wouldn't have with a cluster20:18
vipulActually you could if you wanted to.. like set up slaves for every Galera node20:18
hub_capright but u can rep that as replication20:18
hub_capeither w separate instances or not20:18
vipulsure.. SO you have 1 instance representing a 3 node cluster.. and 3 other separate instances that are slaves.. which replicate from a 'node' in a cluster'20:21
imsplitbitsee I would see that as different instances20:21
imsplitbit1 representing the clsuter20:21
imsplitbitcluster20:21
imsplitbitdamnit I can't type today20:21
imsplitbitand each slave is it's own instance because it isn't necessarily part of that cluster20:22
hub_capu suck imsplitbit20:22
imsplitbitit's just a replicated copy of that clustered data20:22
hub_cap;)20:22
imsplitbitlol20:22
imsplitbitI know20:22
imsplitbitmy dad used to tell me that all growing up while he beat me20:22
imsplitbitnow do you feel bad?20:22
imsplitbitnone of that really happened20:22
imsplitbitI just wanted to make you feel bad20:22
imsplitbitmoving on20:22
imsplitbitso I don't dislike the idea of every instance being an arbitrary thing that has at least one sub resource20:23
imsplitbitbut we still get into issues of nested relationships20:23
imsplitbitWRT replication20:23
vipulYea, it also becomes much like the cluster API we had20:27
vipulbut what I don't really like at this point is why/how it's different20:27
vipulI mean what is it about clusters that makes it a differnt API than master/slave20:28
*** amcrn has joined #openstack-trove20:28
vipulI don't think it's a single endpoint type of thing.. I think that would be a good distinction if it was20:28
vipulbut it seems like we have cases where we ant to know the IP of every 'node'20:28
imsplitbitagreed20:29
yogeshcluster is a single unit i guess, to be packaged as an instance......but replication is not...20:29
vipulthe other distinction could be homogenious flavors20:29
imsplitbityogesh: correct20:29
yogeshbut there is another point of view...20:29
yogeshin essence it still is a single db instance getting provisioned..20:29
imsplitbitwell... not necessarily20:30
imsplitbitbut the base case it is20:30
yogeshwhat cases, it is not?20:30
yogeshif there are such cases then probably god food for thought...20:30
imsplitbitI have a 2GB master that is replicating it's data to a 8GB slave that I also use for 50 other databases20:31
imsplitbitI see clustering different20:31
imsplitbitreplication is *ONLY* a way of making sure data in one location also exists in another20:31
yogeshagree..20:31
imsplitbitit shouldn't prescribe use case thoug20:31
imsplitbitthough20:31
hub_capya u might only want to replicate _a_ table eh?20:32
hub_capor replicating a single db in teh instance...20:33
imsplitbitthe power we'll give our users is in saying "given that the service type you are provisioning has the replication capability enabled, you can now do some super cool stuff and we aren't gonna tell you how to do it"20:33
imsplitbitright hub_cap20:33
yogeshthis is actually cross boundary replication...20:33
yogeshwithin the self contained group of nodes...if there is intra group replication that is mostly like clustering but inter-group configurations are not20:34
imsplitbitdon't get me wrong, I don't dislike the sub resource node thing.  but I don't think it lends itself to being open for doing interesting things with replication20:34
imsplitbitand I may be only representing the mysql pov here so please logic check me but I've seen some really interesting things done with replication that don't fit into a simple master-slave or master-master model20:35
imsplitbitI mean at their base, all relationships in mysql replication are master-slave, I would argue that all replication boils down to that20:36
imsplitbitbut I want to make sure we represent that in the most concise way to our users20:36
*** shivamshukla_ has quit IRC20:37
imsplitbitand what governs this top level instance thing that may be one or more nodes?20:37
imsplitbitdoesn't this break our current instance models?20:37
yogeshhow abot not really decorating it as a cluster or replication20:37
yogeshleaving it at the group-of-nodes level20:38
yogeshfrom trove perspective20:38
yogeshand C or R as some kind of extensions...20:39
*** dmakogon_ipod has quit IRC20:40
*** giulivo has joined #openstack-trove20:40
*** giulivo has left #openstack-trove20:40
kevinconwayimsplitbit: what if i want to do slave-slave-slave replication20:40
*** ioggstream has joined #openstack-trove20:40
kevinconwaywhere nothing ever gets written but everything is replicated20:40
ioggstreamhi@all20:40
* imsplitbit /ignores kevinconway20:40
imsplitbit:)20:40
kevinconwayimsplitbit: i agree that primary-secondary or primary-primary hits 99% of all scenarios20:41
imsplitbitwell even primary-primary is just primary-secondary bidirectionally20:41
*** dmakogon_ipod has joined #openstack-trove20:42
imsplitbiteach one is a secondary to the other20:42
kevinconwaytrue20:42
imsplitbitI just take issue with representing a group of N instances that are replicating to or from one another as one single thing with node subresources because representing the relationships difficult, which are paramount in replication20:43
imsplitbitand I'm sure thats because I haven't really seen how we would propose to represent the relationships this way20:43
imsplitbitwithout doing a ton of nasty nesting20:44
dmakogon_ipodvipul: ping ?20:44
vipulsorry here but in another meeting20:44
kevinconwayyeah, i feel like we talked a lot about how to model the replica sets without deciding anything substantial20:45
imsplitbitok well vipul and all, please ponder this.  I'm writing up a new spec here https://wiki.openstack.org/wiki/Trove-Replication-And-Clustering-API20:45
imsplitbitkevinconway: I agree20:46
imsplitbitI think it makes sense 100% to represent clusters this way20:46
kevinconwayi was fond of the idea of having instances as instances and adding a new resource to manage their relationships20:46
imsplitbitbecause they have a singular function.  unlike replication which may or may not be a tool of just shuffling off copies of data here or there20:46
imsplitbitwell I agree though that it makes the api look cleaner to keep everything an instance20:47
imsplitbitand ideally represent replication as a capability of a service type without hanging a whole other api path off of our default api20:47
imsplitbitthen the only thing necessary to pull off replication is to extend the instance object with metadata to represent what it is and what it's relationship is20:48
dmakogon_ipodimsplitbit: could you make some short conclusion about storing models for clustering api20:49
imsplitbitwhere things fall apart is when you say I've got this replication thing that could grow into 4 tiers or more of parent-child relationships20:49
imsplitbitdmakogon_ipod: my proposal was to leave an instance an instance and add a metadata attribute to the returned ref that contains 2 things20:50
imsplitbit1. replication_type: master-slave, master-master20:50
dmakogon_ipodimsplitbit: seems logicaly, almost the same as it was planned20:50
imsplitbit2. replication_data: (maybe a bad name, config) relationship, i.e. where is it's master20:51
imsplitbitdmakogon_ipod: yes but I think the previous plan was to represent clusters and replication this way20:51
imsplitbitand I think making clusters into an instance with subresources is a cleaner way of displaying that20:51
dmakogon_ipodbtw, how master-master replication organized ?20:51
imsplitbitwell the logic there is really that it's just a master-slave relationship with multiple nodes replicating to one another20:52
dmakogon_ipodok, than please add new replication type20:52
dmakogon_ipodfor cassandra20:53
imsplitbitso you could probably simplify it by returning metadata that just says "replication_config: "master-ref""20:53
imsplitbitsure20:53
dmakogon_ipodthanks20:54
dmakogon_ipodlast question20:54
imsplitbitI've got about 20 minutes and I need to go pick up my daughter from school but I can continue this discussion later and/or tomorrow morning20:54
dmakogon_ipoddoes  metadata would be extendable ?20:54
imsplitbitthat is the intention20:55
imsplitbitwe discussed this some time ago.20:55
imsplitbitand it seems to me that metadata should be useful for more than just replication20:55
imsplitbitand I would hate to extend the instance object with a different attribute for every possible capability of each service type20:56
imsplitbitthe metatdata structure seems ideal for that20:56
*** Barker has quit IRC20:56
imsplitbitwhat are you thoughts on that dmakogon_ipod20:56
imsplitbit?20:56
yogeshsorry, i missed some conversation but meanwhile was thinking about a topology with both clustering and replication...thoughts...20:56
dmakogon_ipodimsplitbit: i'm thinking about adding some service type related info20:57
imsplitbitdmakogon_ipod: like?20:57
dmakogon_ipoddo not know what it is yet, but i'll try to bring something20:57
imsplitbityogesh: I think cassandra has some very real use cases for describing topology in clustering20:57
imsplitbitmysql doesn't really need it20:57
imsplitbitcool dmakogon_ipod20:58
imsplitbitI think we need to really look at that20:58
dmakogon_ipodtopology in very important20:58
imsplitbitbecause what we're proposing here is to change clusters to be represented as an instance with sub resources called nodes which are containers/vms in the background20:58
imsplitbitdmakogon_ipod: as I understand it with cassandra toplogy is very important20:59
dmakogon_ipodbut in cassandra we could change it really easy, but what about mysql ?20:59
dmakogon_ipodimsplitbit: yes20:59
dmakogon_ipodimsplitbit: topology describes data flows between nodes in cluster20:59
imsplitbitwell we'll just say that topology wrt clustering in mysql isn't too important to disply but is important for configuration.  users may want to know but don't necessarily need to know21:00
imsplitbitbut unfortunately for all of us mysql has several ways of being clustered21:00
dmakogon_ipodimsplitbit: so it could be optional))21:00
imsplitbitpossibly21:00
imsplitbithaving been a DBA for several years I find topology VERY important no matter what I'm doing21:01
*** Nate1 has quit IRC21:01
*** tanisdl has quit IRC21:01
imsplitbitregarding what my data is being stored on21:01
imsplitbitdmakogon_ipod: please contribute usecases for cassandra to our open discussion on the etherpad.  especially where topology requirements are different from mysql or redis21:02
dmakogon_ipodimsplitbit: you should go, your daughter waitinig for you))21:02
imsplitbithttps://etherpad.openstack.org/TroveClusteringAPI-WIP21:02
dmakogon_ipodok, i'll do21:02
imsplitbitI've got about 10 minutes before I have to leave21:02
dmakogon_ipodimsplitbit: could i do it tomorrow ?21:03
ioggstreamhow long will it take to define these clustering api?21:03
hub_capioggstream: we are trying to define it now :)21:03
imsplitbitdmakogon_ipod: sure21:03
hub_capwe are pretty close though21:03
imsplitbitI'd like to discuss this more tomorrow and come to a conclusion pretty soon21:03
dmakogon_ipodimsplitbit: thanks21:03
*** erkules_ is now known as erkules21:04
imsplitbitbecause it either means that I need to completely stop work on the current impl of the clustering api and switch gears or get back to it and scrap all these new discussions21:04
dmakogon_ipodhub_cap: i have something to tell about current heat template21:04
ioggstreamI just stumbled upon trove and guessing how much work will it take to make it production-ready21:04
imsplitbitioggstream: depending on your definition it is21:04
imsplitbitwe are running it in production already :)21:04
dmakogon_ipodimsplitbit: with something above it)))21:05
ioggstreamimsplitbit: good to know!21:05
dmakogon_ipodhub_cap: ?21:05
ioggstreamcan you point me with some reference?21:05
dmakogon_ipodioggstream: what do you want to see ?21:06
ioggstreamgiving reasons to my boss to let me develop on trove ;)21:06
hub_capioggstream: welcome!21:07
imsplitbitioggstream: it's running here for sure http://www.rackspace.com/cloud/databases/21:07
imsplitbit:)21:07
ioggstreamI have some experience with python, mysql and ndb21:07
yogeshdmakogon: imsplitbit: so, if i define a cluster and i also want a replicated node (not as a part of the cluster) but separate...does it exist the part of the INSTANCE...if yes...how does it get handled in our design...21:07
dmakogon_ipodioggstream: reason is very easy, developing Trove (OS DBaaS) is rather cheap than Amazon RDBS21:07
*** adrian_otto has quit IRC21:07
ioggstreamdmakogon_ipod: I played with amz and its' interface is quite simple21:07
dmakogon_ipodioggstream: but you can't still go deeper in it21:08
dmakogon_ipodioggstream: only API21:08
*** Nate1 has joined #openstack-trove21:08
ioggstreamdmakogon_ipod:  yes, for some people it's a plus21:08
dmakogon_ipodyogesh: not clear to me, example ?21:08
dmakogon_ipodioggstream: housewifes ?21:09
imsplitbityogesh: I am not sure in the instance model if that works.  replication is a capability of a service type so if you deploy galera cluster with 5 nodes you would have to replicate to another instance of service type galera cluster no?  hub_cap chime in here21:09
imsplitbitI'm very sorry but I have to leave for a bit21:09
dmakogon_ipodk21:09
imsplitbitI'll log back in once I get home to continute this discussion21:09
dmakogon_ipodgood converastion21:09
ioggstreamdmakogon_ipod: don't underestimate housewifes21:09
imsplitbitvery21:09
ioggstreamimsplitbit: thx for your hints21:10
*** pdmars has quit IRC21:10
ioggstreamso boys, it's 23.10 here in Italy, see you tomorrow: I'll try the https://wiki.openstack.org/wiki/Trove/installation21:11
yogeshdmakogon: if i want to create a cluster and want one of the nodes in the cluster to be the master of the replication group with one single slave for an instance...does that sound like a use case...21:11
yogeshand should we have trove define this combination of cluster/replication group21:11
dmakogon_ipodyogesh: seems like not so easy task to change cluster into replication group21:12
ioggstreamnite21:13
yogeshlemme write something in detail...21:13
yogeshwill post..21:13
yogesha gist...21:13
dmakogon_ipodok, seems like i'm missing something21:13
dmakogon_ipodsorry21:13
yogeshdmakogon: not really...i myself am thinking aloud...21:14
yogeshpretty abstract,,,21:14
yogeshlet me get my act together... ;-)21:14
dmakogon_ipodщл21:15
dmakogon_ipodok21:15
dmakogon_ipodyogesh: btw, what's the status of templates ?21:16
*** amcrn has quit IRC21:17
*** ioggstream has quit IRC21:17
yogeshstarted...u should see something to review pretty soon21:17
*** adrian_otto has joined #openstack-trove21:17
dmakogon_ipodyogesh:with love)))21:19
dmakogon_ipodyogesh: i've got some plans for extending basic mysql template dynamically21:19
dmakogon_ipodvolumes, security groups21:19
dmakogon_ipodfloating ips21:19
yogeshdmakogon: dynamically?21:19
*** mmcdaris has quit IRC21:20
*** fandikurnia01 has quit IRC21:20
dmakogon_ipodyogesh: yes21:21
dmakogon_ipodif support is unabled: add specific part21:21
dmakogon_ipodshould be easy21:21
yogeshok...wud luv to see a tiny example21:21
dmakogon_ipodno problem21:22
dmakogon_ipodi could post it right now21:22
yogeshthanks much21:22
dmakogon_ipodhttps://github.com/openstack/trove/blob/master/trove/common/template.py - basic template21:22
dmakogon_ipodparsable by yaml lib21:23
yogeshok21:23
*** jasonb365 has joined #openstack-trove21:23
dmakogon_ipodsecurity group as extension: https://github.com/openstack/heat-templates/blob/master/cfn/deb/MultiNode_DevStack.yaml#L96-L10421:24
yogeshso u mean abstracting the security groups out and pushing them into the template at run time...21:25
yogeshyeah thats fine..21:26
dmakogon_ipodнуы21:26
dmakogon_ipodyes!21:26
yogeshbut template in itself is dynamic strategy..21:26
yogeshwhy to touch it at runtime..21:26
yogeshlet it be created at design time, full and consumable..21:27
*** isviridov has joined #openstack-trove21:27
*** mmcdaris has joined #openstack-trove21:27
dmakogon_ipodfloating ip: https://github.com/openstack/heat-templates/blob/a2ad92fa5897fb54645c7f572cd3467b3c31ff9e/cfn/F17/WordPress_2_Instances_With_EBS_EIP.template#L103-L10921:27
dmakogon_ipodif to stay tottaly honest: https://github.com/openstack/heat-templates/blob/a2ad92fa5897fb54645c7f572cd3467b3c31ff9e/cfn/F17/WordPress_2_Instances_With_EBS_EIP.template#L98-L10921:28
dmakogon_ipodyogesh: but i suppose you are ok with it21:28
yogeshwell..21:30
yogeshyeah...it depends21:31
dmakogon_ipodyogesh: depends on what ?21:32
yogeshdmakogon: on what exactly do we want to make dynamic...may be case to case...21:33
dmakogon_ipodyogesh: does heat is integrated to devstack ?21:33
yogeshyes21:33
*** isviridov has quit IRC21:33
*** ashestakov_ has quit IRC21:33
yogeshhttps://wiki.openstack.org/wiki/Heat/GettingStartedUsingDevstack21:33
yogesh:-) i did not get the question...21:34
dmakogon_ipodyogesh: i'm gonna do this because there is a unfilled gap between heat provisioning and nova provisioning in trove21:34
*** Nate1 has quit IRC21:34
yogeshoh ok...21:34
*** openstackgerrit has quit IRC21:34
yogeshi got u..21:34
dmakogon_ipodlet me show an example21:35
yogeshso u want to handle the case when heat is not enabled...21:35
dmakogon_ipodyes21:35
yogeshhmm21:35
yogeshyeah, sure...an example..21:35
yogeshthanks21:35
*** tanisdl has joined #openstack-trove21:36
*** djohnstone has joined #openstack-trove21:36
dmakogon_ipoduser creating instance, request comes into trove-api (security group is created and assigned to trove-instance)21:36
dmakogon_ipodthan, request comes to taskmanager, and going to heat provisioning func21:37
dmakogon_ipodstack, resources are created21:37
*** amcrn has joined #openstack-trove21:37
dmakogon_ipodbut (!!!) security not assigned to compute instance21:37
dmakogon_ipodeven security group parameter doesn't used21:38
dmakogon_ipodso, SG is a gap #121:38
*** jlucci has joined #openstack-trove21:39
yogeshagreed...21:39
dmakogon_ipodso, here comes a bug21:39
dmakogon_ipodtrove-cli security group delete with heat support would cause an exception21:40
*** jlucci has quit IRC21:40
yogeshmakes sense...21:40
dmakogon_ipodoh, no21:40
dmakogon_ipodit wouldn't21:40
yogeshit would be a bug but wont cause exception21:41
*** isviridov has joined #openstack-trove21:41
dmakogon_ipodbecause security groups are deleting directly with novaclient.security_groups.delete(...)21:42
*** demorris has quit IRC21:42
yogeshi wanted to figure if trove has security-group management apis..21:42
yogeshit hasn't21:43
dmakogon_ipodmanagement? - np21:43
dmakogon_ipodonly user API21:43
dmakogon_ipodin some way it is strange to me21:43
dmakogon_ipodif i am trove user and i want only a database why should a be able to manage that kind of resource ?21:44
yogeshyeah21:45
yogeshdmkogon: need to leave for a bit21:46
yogeshwill be back in few minutes21:46
dmakogon_ipodi'm going to sleep21:47
yogeshdidn't rezlize its late for u21:47
yogeshrealize*21:48
*** yogeshmehra has joined #openstack-trove21:48
*** yogeshmehra has left #openstack-trove21:49
*** haomaiwa_ has joined #openstack-trove21:49
*** haomaiwang has quit IRC21:49
*** yogesh has quit IRC21:52
hub_caphaha yup21:55
*** grapex has quit IRC21:58
*** dmakogon_ipod has quit IRC22:00
*** yogesh has joined #openstack-trove22:00
*** yogeshmehra has joined #openstack-trove22:05
*** yogeshmehra has quit IRC22:10
*** amytron has quit IRC22:15
*** adrian_otto has quit IRC22:16
*** robertmyers has quit IRC22:17
*** jcru has quit IRC22:24
*** jlucci has joined #openstack-trove22:24
*** jlucci has quit IRC22:25
*** yogesh has quit IRC22:25
*** amytron has joined #openstack-trove22:28
*** jasonb365 has quit IRC22:29
*** jlucci has joined #openstack-trove22:29
*** amytron has quit IRC22:31
*** rnirmal has quit IRC22:32
*** amytron has joined #openstack-trove22:45
*** mmcdaris has quit IRC22:50
*** jlucci has quit IRC22:59
*** openstackgerrit has joined #openstack-trove23:01
*** jlucci has joined #openstack-trove23:03
*** dafter has quit IRC23:05
*** tanisdl has quit IRC23:09
*** tanisdl has joined #openstack-trove23:09
*** paul_lodronio has quit IRC23:11
openstackgerritJustin Hopper proposed a change to openstack/trove: Fix Timestamps for Resize Usage Events  https://review.openstack.org/5019223:23
*** mmcdaris has joined #openstack-trove23:24
*** jlucci has quit IRC23:27
*** amytron has quit IRC23:29
*** adrian_otto has joined #openstack-trove23:31
juicehub_cap: this patch (^ ^) will fix the intermittent false negative build failures23:37
*** adrian_otto has quit IRC23:37
hub_cap++23:38
hub_caphaha juice youve done this before ;)23:38
juiceoh yes I have23:39
juicebut I missed the resize event the last time23:39
hub_caplulz23:39
juiceI think we have it all covered now23:39
hub_caponce the robots +1 have vipul or SlickNik review it23:39
juicegood riddance I say - good riddance23:39
hub_capSlickNik: lol at you +1'ing the 'reap' thing in nova super fast23:39
hub_capjuice: are u shaking your fist?23:40
hub_caphttps://wiki.openstack.org/wiki/Testr#Debugging_.28pdb.29_Tests23:40
hub_cap^ ^ so nice23:40
SlickNikhahah, can you tell I've been bitten by it :P23:40
hub_capwouldve NEVER guessed23:40
hub_cap:P23:40
juicewith esp and slicknik as my witnesses23:40
hub_capim so glad i can pdb my shit now23:40
hub_caplol juice23:40
*** tanisdl has quit IRC23:41
hub_capsweet found my bug thanks to pdb23:45
*** djohnstone has quit IRC23:53
hub_capok im out for the day23:56
hub_capl8r all23:57
juicec ya hub_cap23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!