Monday, 2014-09-22

*** boden has quit IRC00:00
*** ViswaV has quit IRC00:42
*** prasoon has joined #openstack-trove00:54
*** prasoon has quit IRC00:55
*** boden has joined #openstack-trove00:56
*** boden has quit IRC01:01
*** Longgeek has joined #openstack-trove01:04
*** vkmc has quit IRC01:08
*** IanGovett has joined #openstack-trove01:09
*** prasoon has joined #openstack-trove01:16
*** prasoon has quit IRC01:20
*** ViswaV has joined #openstack-trove01:47
*** ViswaV_ has joined #openstack-trove01:50
iccha2SlickNik: can you take a look at some of the replication reviews when free01:50
*** ViswaV has quit IRC01:52
*** boden has joined #openstack-trove01:57
*** boden has quit IRC02:02
*** miqui has quit IRC02:06
*** IanGovett has quit IRC02:12
*** IanGovett has joined #openstack-trove02:13
*** amrith is now known as _amrith_02:16
*** IanGovett has quit IRC02:17
*** _amrith_ is now known as amrith02:18
*** ViswaV_ has quit IRC02:21
*** tomblank has joined #openstack-trove02:21
*** amrith is now known as _amrith_02:36
*** haomaiwang has joined #openstack-trove02:38
*** haomaiwang has quit IRC02:38
*** haomaiwang has joined #openstack-trove02:39
*** haomaiw__ has joined #openstack-trove02:46
*** ramishra has joined #openstack-trove02:48
*** haomaiwang has quit IRC02:50
*** Riddhi has joined #openstack-trove02:53
*** ViswaV has joined #openstack-trove02:53
*** ViswaV_ has joined #openstack-trove02:54
*** ViswaV__ has joined #openstack-trove02:58
*** ViswaV has quit IRC02:58
*** ViswaV_ has quit IRC02:58
*** boden has joined #openstack-trove02:58
*** _amrith_ is now known as amrith03:02
*** boden has quit IRC03:03
*** ramishra has quit IRC03:10
*** ViswaV__ has quit IRC03:14
*** ViswaV has joined #openstack-trove03:14
*** ViswaV has quit IRC03:16
*** prasoon has joined #openstack-trove03:17
*** Riddhi has quit IRC03:21
*** prasoon has quit IRC03:22
*** ramishra has joined #openstack-trove03:24
*** shakamunyi has joined #openstack-trove03:24
*** prasoon has joined #openstack-trove03:29
*** boden has joined #openstack-trove03:59
*** shakamunyi has quit IRC04:00
*** boden has quit IRC04:03
*** prasoon has quit IRC04:05
*** ramishra has quit IRC04:35
*** ramishra has joined #openstack-trove04:35
*** rushiagr_away is now known as rushiagr04:40
*** robertmyers has quit IRC04:40
coolsvapSlickNik, hi04:51
*** boden has joined #openstack-trove05:00
*** boden has quit IRC05:04
*** Longgeek has quit IRC05:07
*** ViswaV has joined #openstack-trove05:13
*** tomblank has quit IRC05:20
*** Longgeek has joined #openstack-trove05:22
*** ViswaV has quit IRC05:23
*** ViswaV has joined #openstack-trove05:23
*** ajayaa has joined #openstack-trove05:24
*** ajayaa has quit IRC05:41
*** ajayaa has joined #openstack-trove05:54
*** boden has joined #openstack-trove06:00
*** flaper87 has quit IRC06:05
*** flaper87 has joined #openstack-trove06:05
*** boden has quit IRC06:05
*** k4n0 has joined #openstack-trove06:20
SlickNikcoolsvap: hey06:26
coolsvapSlickNik, hi, i had a query about the ubuntu_mysql image06:27
coolsvapSlickNik, do you have some time to discuss?06:27
SlickNikSure, what was the question?06:28
coolsvapSlickNik, I am trying to create the instance with the default ubuntu_mysql image with mysql5.5 datastore, but the instance remains in build state06:29
coolsvapthe logs show the polling timeout issue06:29
SlickNikIs the nova instance active?06:30
coolsvapyes06:30
SlickNikCan you ssh to that instance, and check the guestagent logs?06:30
coolsvapI am trying to get access from console, one basic question, how to add the ssh-key to the instance, the horizon dashboard does not provide that facility06:33
coolsvapSlickNik, you thre?06:43
SlickNikyes: but missed your message.06:44
SlickNikcoolsvap: Are you using devstack?06:44
coolsvapSlickNik, yes06:44
*** vigneshvar has joined #openstack-trove06:45
coolsvapSlickNik, what is the recommended dev env for trove, redstack?06:45
SlickNikAnd did you build the ubuntu-mysql image using the trove elements?06:45
SlickNikdevstack is good.06:45
coolsvapSlickNik, the image is downloaded as part of devstack, I did not manually build it06:46
SlickNikAh, okay.06:46
SlickNikYou can use the dev key to ssh into the image then.06:46
SlickNikcoolsvap: https://github.com/openstack/trove-integration/tree/master/scripts/files/keys06:47
SlickNikthat key is baked into the image for debugging06:48
SlickNikAlso, you need to add that public-key to your authorized_keys file for the trove guest to be able to rsync the guest agent code from your devstack host.06:49
SlickNik(If you haven't done that, it probably explains why your instance didn't go active)06:51
coolsvapSlickNik, let me add the public key to authorized hosts06:52
coolsvapand create new instance06:52
*** ankush has joined #openstack-trove07:00
*** boden has joined #openstack-trove07:01
*** boden has quit IRC07:06
coolsvapSlickNik, no succes after adding the public-key in authorized_keys07:10
coolsvapsuccess*07:11
*** PeterSchwaller has joined #openstack-trove07:33
*** PeterS has quit IRC07:35
*** Longgeek has quit IRC07:40
*** Longgeek has joined #openstack-trove08:01
*** boblebauce has joined #openstack-trove08:03
*** iartarisi has joined #openstack-trove08:09
*** sgotliv_ has joined #openstack-trove08:09
*** ViswaV has quit IRC08:18
*** boden has joined #openstack-trove08:27
*** ajayaa has quit IRC08:32
*** k4n0 has quit IRC08:33
*** ViswaV has joined #openstack-trove08:41
*** rushiagr is now known as rushiagr_away08:44
*** sgotliv_ has quit IRC08:45
*** rushiagr_away is now known as rushiagr08:45
*** ajayaa has joined #openstack-trove08:48
*** ramishra has quit IRC08:48
*** k4n0 has joined #openstack-trove08:50
*** rushiagr is now known as rushiagr_away08:56
*** sgotliv_ has joined #openstack-trove09:01
*** Longgeek has quit IRC09:08
*** sgotliv_ has quit IRC09:08
*** ramishra has joined #openstack-trove09:09
*** sgotliv_ has joined #openstack-trove09:13
*** Longgeek has joined #openstack-trove09:17
*** rushiagr_away is now known as rushiagr09:23
*** sgotliv_ has quit IRC09:28
*** boblebauce has quit IRC09:40
*** k4n0 has quit IRC09:44
*** ViswaV has quit IRC09:44
*** boblebauce has joined #openstack-trove09:48
*** ajayaa has quit IRC09:50
ankushHi Friends, I am trying to launch a db instance 'mysql' based on ubuntu image on Icehouse instance. But I am getting the below error message10:01
ankushtrove.common.exception [req-82a2aab0-9280-49fb-aaca-991ee411d677 admin services - - -] Cannot find compute instanc e None for instance 60bfc46c-2ae5-4605-8fd2-7c19cd4f31f0. 2014-09-22 15:31:34.726 20999 ERROR trove.extensions.mgmt.instances.models [req-82a2aab0-9280-49fb-aaca-991ee411d677 admin services - - -] Resource 60 bfc46c-2ae5-4605-8fd2-7c19cd4f31f0 can not be retrieved10:01
ankushAlso see thi s -> DEBUG trove.instance.views [req-b8f064a8-d3e4-4ade-9736-2591a5e86e7b a8fd484ee6e048d699ba98c8159948dc d2780c405b5640829b547c96a1a75e80 - - -] {'status': 'BUILD', 'name': u'ok', 'links': [{'href': u'https://172.31.31.205:8779/v1.0/d2780c405b5640829b547c96a1a75e80/instances/60bfc46c-2ae5-4605-8fd2-7c19cd4f31f0', 'rel': 'self'}, {'href': 'https://172.31.31.205:8779/instances/60bfc46c-2ae5-4605-8fd2-7c19cd4f31f0'10:02
ankushwhy trove-api is trying to use https where auth_protocol=http is defined10:02
*** ajayaa has joined #openstack-trove10:02
ankushi am able to launch a normal instance on this openstack without any issue10:02
*** iartarisi has left #openstack-trove10:04
*** Longgeek has quit IRC10:16
*** Longgeek has joined #openstack-trove10:20
ankushrebooting the box fixed the problem. the original problem of host not getting assigned to any db instance is still there10:27
*** k4n0 has joined #openstack-trove10:29
*** juantwo_ has joined #openstack-trove10:45
*** juantwo has quit IRC10:48
*** zigo has quit IRC10:50
*** zigo has joined #openstack-trove10:52
*** amrith is now known as _amrith_10:54
*** sgotliv_ has joined #openstack-trove10:56
*** vkmc has joined #openstack-trove11:09
*** shakamunyi has joined #openstack-trove11:17
*** shakamunyi has quit IRC11:20
*** IanGovett has joined #openstack-trove11:26
blippankush: check if you are able to launch a normal instance with the exact same flavor as Trove uses for the datastore you use. And maybe the volume is too big?11:45
*** IanGovett has quit IRC11:51
*** IanGovett has joined #openstack-trove11:53
*** juantwo_ has quit IRC11:53
*** juantwo has joined #openstack-trove11:54
*** achampion has quit IRC11:58
*** marzif__ has quit IRC12:02
*** openstackgerrit has joined #openstack-trove12:14
*** jcru has joined #openstack-trove12:22
*** boden has quit IRC12:30
*** boden has joined #openstack-trove12:30
*** tomblank has joined #openstack-trove12:31
*** isviridov is now known as isviridov_away12:34
*** rushiagr is now known as rushiagr_away12:35
openstackgerritDenis M. proposed a change to openstack/trove: Add instance ID validation stage while creating incremental backup  https://review.openstack.org/10810112:36
*** ajayaa has quit IRC12:45
*** pboros has joined #openstack-trove12:46
*** pboros has quit IRC12:46
*** pboros has joined #openstack-trove12:48
*** ramishra has quit IRC12:51
*** vigneshvar has quit IRC12:54
*** todd_dsm has joined #openstack-trove12:58
*** ankush has quit IRC12:59
*** miqui has joined #openstack-trove13:00
*** todd_dsm has quit IRC13:00
*** todd_dsm has joined #openstack-trove13:01
*** jasonb365 has joined #openstack-trove13:03
openstackgerritDenis M. proposed a change to openstack/trove: Fix master status validation while replica provisioning  https://review.openstack.org/11977013:05
*** achampion has joined #openstack-trove13:08
openstackgerritDenis M. proposed a change to openstack/trove: Add datastore and version validation step for replica provisioning  https://review.openstack.org/11907913:11
*** tkatarki has joined #openstack-trove13:11
openstackgerritDenis M. proposed a change to openstack/trove: Forbid replica provisioning from replica site  https://review.openstack.org/11977113:16
*** radez_g0n3 is now known as radez13:19
*** IanGovett has quit IRC13:20
*** newb has joined #openstack-trove13:20
*** Barker has joined #openstack-trove13:22
*** denis_makogon has quit IRC13:34
*** ramishra has joined #openstack-trove14:02
*** jcooley has quit IRC14:19
*** k4n0 has quit IRC14:19
*** ruebenramirez has joined #openstack-trove14:20
*** todd_dsm has quit IRC14:20
*** todd_dsm has joined #openstack-trove14:21
*** jcooley has joined #openstack-trove14:24
*** julienvey has joined #openstack-trove14:36
*** mattgriffin has joined #openstack-trove14:39
*** kevinconway has joined #openstack-trove14:43
*** Riddhi has joined #openstack-trove14:46
*** grapex has joined #openstack-trove14:47
*** tkatarki has quit IRC14:55
openstackgerritSimon Chang proposed a change to openstack/trove: Move the Trove Guest Agent to its own module  https://review.openstack.org/11942514:58
*** tkatarki has joined #openstack-trove14:58
*** IanGovett has joined #openstack-trove15:05
*** tomblank has quit IRC15:09
*** tomblank_ has joined #openstack-trove15:09
*** jmontemayor has joined #openstack-trove15:11
*** tkatarki has quit IRC15:12
*** todd_dsm has quit IRC15:16
*** tkatarki has joined #openstack-trove15:16
*** ViswaV has joined #openstack-trove15:17
*** tkatarki has quit IRC15:18
*** tkatarki has joined #openstack-trove15:18
*** ViswaV has quit IRC15:18
*** Longgeek_ has joined #openstack-trove15:19
*** Longgeek has quit IRC15:22
iccha2grapex: https://review.openstack.org/#/c/119169/15:29
iccha2grapex: https://review.openstack.org/#/c/122275/15:31
openstackgerritA change was merged to openstack/trove: Updated from global requirements  https://review.openstack.org/11981815:37
*** todd_dsm has joined #openstack-trove15:40
*** tkatarki has quit IRC15:47
*** tkatarki has joined #openstack-trove15:47
*** sgotliv_ has quit IRC15:52
*** Longgeek_ has quit IRC15:55
*** tkatarki has quit IRC15:57
*** tkatarki has joined #openstack-trove15:57
*** ViswaV has joined #openstack-trove15:57
*** ViswaV_ has joined #openstack-trove15:58
*** cweid has joined #openstack-trove15:59
*** redthrux1 has joined #openstack-trove15:59
*** denis_makogon has joined #openstack-trove16:00
*** tkatarki has quit IRC16:01
openstackgerritZhi Yan Liu proposed a change to openstack/trove: Integrate OSprofiler and Trove  https://review.openstack.org/11665316:01
*** ViswaV has quit IRC16:02
*** tkatarki has joined #openstack-trove16:04
*** jasonb365 has quit IRC16:04
denis_makogonHey, cores, could someone +2 it https://review.openstack.org/#/c/122793/ so we can proceed on testing guestagent among different platforms, such as fedora/centos/rhel/oel/oevm16:08
*** redthrux1 has left #openstack-trove16:09
*** jasonb365 has joined #openstack-trove16:14
denis_makogonHey, could someone from cores take a look at docs patch please, https://bugs.launchpad.net/trove/+bug/134269716:15
openstackgerritZhi Yan Liu proposed a change to openstack/python-troveclient: Add profiling support to Trove client  https://review.openstack.org/11665416:16
*** ViswaV_ has quit IRC16:24
*** julienvey has quit IRC16:27
*** julienvey has joined #openstack-trove16:27
*** boblebauce has quit IRC16:32
*** julienvey has quit IRC16:32
*** ViswaV has joined #openstack-trove16:35
*** saurabhs has joined #openstack-trove16:38
*** ViswaV_ has joined #openstack-trove16:44
*** ViswaV has quit IRC16:44
iccha2the master branch tests for failing in trove for me, is it the same for anyone else?16:48
SlickNikiccha2: Do you know which tests are failing? I haven't looked in a couple of days.16:50
SlickNikiccha2: Are you using the cached image, or are you building the guest image from the elements?16:51
iccha2SlickNik: test_index_host_list_single16:51
*** Barker has quit IRC16:51
iccha2SlickNik: i am running fake mode tests in tox16:51
iccha2git clone of repo16:51
*** Barker has joined #openstack-trove16:52
SlickNikiccha2: Ah — the tox tests. Looks like a change just merged this morning (https://review.openstack.org/#/c/119818/) so they seem to be running fine.16:53
iccha2getting some rate limit and quota errors16:53
SlickNikI suspect it's something specific to your environment — can you clone afresh, and try running them?16:54
iccha2SlickNik: i ll reclone and try thanks Nikhil16:55
openstackgerriticcha-sethi proposed a change to openstack/trove: Add templates for replica and replica source  https://review.openstack.org/12227516:56
*** Barker has quit IRC16:56
denis_makogonSlickNik, could you please review it again https://review.openstack.org/#/c/122793/ ?16:57
openstackgerritTristan Cacqueray proposed a change to openstack/trove: Sync latest process and str utils from oslo  https://review.openstack.org/12141717:00
*** juantwo_ has joined #openstack-trove17:00
zigoHi guys! I'd like to understand why I'm still getting these unit test errors in the Debian package: https://bugs.launchpad.net/trove/+bug/130278417:00
zigoIs Greg Lucas around?17:00
zigoI'd really love to have this fixed in both the Icehouse and Juno packages ...17:01
zigoI feel bad to upload packages in Debian with this issue.17:01
zigohub_cap: ^17:02
*** juantwo has quit IRC17:03
*** Barker has joined #openstack-trove17:05
*** eghobo has joined #openstack-trove17:09
*** _amrith_ is now known as amrith17:14
*** ViswaV_ has quit IRC17:15
*** todd_dsm has quit IRC17:20
*** ramishra has quit IRC17:20
*** harlowja_away is now known as harlowja17:21
*** eghobo has quit IRC17:25
SlickNikzigo: One sec — let me pull up how you'd need to initialize those test datastore.17:29
SlickNikdatastores*17:29
zigoAh, cool! :)17:29
denis_makogonzigo, could you please tell how you're launching unit tests? would be nice to see exact command17:30
denis_makogonzigo, is it "tox" or "tox -epy2x" ?17:31
zigodenis_makogon: No tox involved, just: python setup.py testr --slowest --testr-args='--subunit  '17:32
zigoThough I think I'd better use testr directly like I do in other packages.17:32
denis_makogonzigo, sure, we would try to help you asap17:33
zigoI *never* run tox for unit testing at package build, that's not the way to go for distributions.17:33
denis_makogonSlickNik, zigo, i know why this tests are failing, i would try to submit patch tomorrow, if that's ok ?17:34
zigodenis_makogon: Sure! :) Could you please add me to the review then?17:34
zigoAdd "Thomas Goirand" in gerrit ...17:35
denis_makogonzigo, thanks17:35
denis_makogonSlickNik, can i assign it to me?17:35
SlickNikzigo: https://github.com/openstack/trove-integration/blob/master/scripts/redstack#L532-58217:35
SlickNikis what the trove-int scripts do to set things up.17:36
SlickNikdenis_makogon: sure, since I don't know how much progress glucas has made with the patch. Keep us posted!17:37
denis_makogonSlickNik, sure, i will write steps-to-fix this bug at bug-report17:38
denis_makogonSlickNik, should we assign this bug-report to j-RC1 ?17:41
denis_makogonzigo, SlickNik i left comment that describes needed steps to fix an issue.17:46
*** amcrn has joined #openstack-trove17:50
*** todd_dsm has joined #openstack-trove17:50
denis_makogonamcrn, could you please add final +2 to this one https://review.openstack.org/#/c/122793/ ?17:54
*** Barker has quit IRC17:56
SlickNikdenis_makogon: Please work with zigo to figure out a timeline that works for packaging.17:59
denis_makogonSlickNik, sure, will do17:59
zigoThanks a lot! :)17:59
zigoI have to admit that I'm not sure what to do.17:59
zigoJust setup a sqlite db and do the INSERT statements?17:59
openstackgerritA change was merged to openstack/trove-integration: Added dib-utils install at install_prep_packages function  https://review.openstack.org/12279318:00
*** juantwo_ has quit IRC18:01
denis_makogonzigo, it may work, but we need something, as you said, that may leave at upstream18:01
openstackgerritDenis M. proposed a change to openstack/trove-integration: Fix post_install.d for Fedora distribution  https://review.openstack.org/12273018:01
*** juantwo has joined #openstack-trove18:01
zhiyanHey folks, do we have a bp meeting this week?18:01
denis_makogonamcrn, thanks18:01
amrithzhiyan, I thought we were18:01
SlickNikzhiyan: Yes we do18:01
zhiyanSlickNik: amrith nice =)18:02
SlickNik#startmeeting trove-bp-review18:02
openstackMeeting started Mon Sep 22 18:02:03 2014 UTC and is due to finish in 60 minutes.  The chair is SlickNik. Information about MeetBot at http://wiki.debian.org/MeetBot.18:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:02
openstackThe meeting name has been set to 'trove_bp_review'18:02
*** Barker has joined #openstack-trove18:02
SlickNikJust giving folks a couple of minutes to trickle in.18:02
zigodenis_makogon: Ok, cool. I'll wait for your patch then.18:02
amrith./18:02
denis_makogono/18:02
zhiyanSlickNik: sorry again, last week I didn't attend the meeting.18:02
*** annashen has joined #openstack-trove18:03
esmuteo/18:03
SlickNikzhiyan: no worries — you're here this week.18:03
zhiyano/18:03
annasheno/18:03
grapexo/18:03
SlickNikAgenda at:18:03
schango/18:03
SlickNik#link https://wiki.openstack.org/wiki/Meetings/TroveBPMeeting18:03
SlickNik#topic Cassandra Clustering18:05
SlickNik#link https://blueprints.launchpad.net/trove/+spec/cassandra-cluster18:05
*** harlowja has quit IRC18:05
*** harlowja_ has joined #openstack-trove18:05
denis_makogoni wrote spec at trove-specs as was requested, add details (with respect to mongodb clustering spec)18:05
dougshelley66o/18:06
peterstaco/18:07
SlickNikdenis_makogon: It looks to me like the spec is still pretty rough around the edges — it seems very similar to the Mongo spec (referring to shards — which I don't think exist in Cassandra).18:08
denis_makogonSlickNik, please leave comments where i've wrote about sharding in C*18:09
SlickNikOkay will do.18:10
amrithSlickNik, I've already annotated that particular point.18:10
amrithdenis_makogon, is this intended to be Cassandra clustering (v1) or Cassandra Clustering (everything)18:11
SlickNikdenis_makogon: I had a couple of comments from last week — "Are we planning on doing replication? How are Snitches handled?"18:11
denis_makogonamrith, with respect to you, most of comment, because of links with INFO weren't reviewed18:11
amrithI don't follow the comment18:11
denis_makogonSlickNik, you can't setup replication for Cassandra, it's done by the default, you can only use clustering option, ideal snitching mechanis was enabled in cassandra by the default, see snitch links at spec18:12
*** sriram_tesora has joined #openstack-trove18:13
*** jmontemayor_ has joined #openstack-trove18:13
denis_makogonamrith, most of you comments that were left at the spec were made because you didn't look at links that i've provided for each section18:13
amrithactually I did.18:14
*** jmontemayor has quit IRC18:14
*** jmontema_ has joined #openstack-trove18:14
SlickNikhrm: denis_makogon — the replicas in the cassandra cluster use a replica placement strategy, and afaik that needs to be configured.18:15
amrithSlickNik, you are correct.18:15
denis_makogonSlickNik, it depends on how many instances are being deployed18:15
amrithI think they let you choose not just strategies but also factors.18:16
SlickNikAnyhow denis_makogon: I think we need to put a lot more thought and work into this spec — so this is still heavily work in progress, correct?18:17
SlickNikI will put some of my comments into the spec rst as well.18:17
denis_makogonsure18:17
SlickNikOkay. Thanks!18:18
*** jmontemayor_ has quit IRC18:18
SlickNikzhiyan: around?18:18
zhiyanSlickNik: yes18:18
SlickNik#topic OSProfiler integration18:19
SlickNik#link https://review.openstack.org/#/c/103825/18:19
zhiyanfirst of first, OSProfiler is an OpenStack cross-project profiling library: https://github.com/stackforge/osprofiler18:19
zhiyanboris-42 prepared the common BP in oslo-spec due to integration change is similar to all projects.18:20
zhiyanCurrently there are 2 other projects are using osprofiler: Glance & Cinder, and some others are working in progress, e.g. the one for heat https://review.openstack.org/#/c/118115/18:20
zhiyanthere's a doc to introduce heat one http://ahsalkeld.wordpress.com/2014/09/04/how-to-profile-heat-using-osprofile/ , ify18:21
SlickNikzhiyan: looks like good stuff.18:22
zhiyanI really like to see Trove has this capability as well, so weeks ago, I had prepared two changes for trove and troveclient https://review.openstack.org/#/c/116653/ , https://review.openstack.org/#/c/116654/18:22
SlickNikzhiyan: I'm a bit concerned about why the spec hasn't merged in oslo yet — can you speak to that?18:23
zhiyanSlickNik: absolutely, I'm sure it is.18:23
zhiyanSlickNik: most people are on the same page now, but a few folks just worried on the program itself. afaik18:24
zhiyanSlickNik: I didn't keep eye to keep look on the comment up-to-date.18:25
SlickNikzhiyan: Yes, reading through the comments it looks like most folks are concerned about whether oslo is the right spot for cross-project specs.18:25
zhiyanSlickNik: =) . There's a clear result page as an example, http://boris-42.github.io/ngk.html18:26
zhiyanwith my above two changes, Trove could provides it to operator/developer as well =)18:27
zhiyanand we could add more trace point as we needed in near feature. I can do that as well if needed.18:27
amrithSlickNik, I have some questions, ... will wait ...18:28
SlickNikamrith: go for it.18:28
amriththx, you addressed part of my first question re: oslo. The other half is this, how do we get 'changes' from osprofiler, is it just the dependency? or is there an oslo style code copying thing that we have to do from time to time?18:29
zhiyanamrith: depdency18:29
zhiyanamrith: https://github.com/openstack/requirements/blob/master/global-requirements.txt#L6418:30
amrithok., what other projects do we become dependent upon? for example, the spec says that data is written into ceilometer. is this the only dependency?18:30
*** esp has joined #openstack-trove18:30
zhiyanamrith: good question. osprofiler support different 'backend' to store trace data.18:31
amrithplease elaborate.18:31
zhiyannow there's (only) one built-in implementation, it's ceilometer..18:31
zhiyanhttps://github.com/stackforge/osprofiler/tree/master/osprofiler/_notifiers18:32
zhiyanand https://github.com/stackforge/osprofiler/tree/master/osprofiler/parsers (for result showing stuff)18:32
amrithzhiyan, maybe I should restate my question.18:33
amriththe links you shared don't establish a dependency on ceilometer for the trove project18:33
amrithi.e. if I don't want to enable osprofiler, I'm not obligated to run ceilometer18:33
amrithhowever, if I want to use profiler, I must use ceilometer (now), is that correct?18:33
zhiyanamrith: so for the question: now ceilometer is a 'soft' dependency if we enabled profiling in Trove. (and trigger it)18:33
denis_makogonamrith, correct, you just need to have queue for traces18:34
denis_makogonthat a;;18:34
denis_makogonall18:34
amrithzhiyan, is there a dependency on oslo.messaging?18:34
SlickNikzhiyan: what do you mean by 'soft dependency'?18:34
zhiyanamrith: there's no dependency on oslo.messaging.18:34
*** ViswaV has joined #openstack-trove18:35
zhiyanok, sorry. SlickNik 'soft' mean, if we enabled profiling in Trove, and trigger it with a request, then Trove will send trace data to ceilometer as 'backend'.18:35
*** ViswaV_ has joined #openstack-trove18:36
boris-42zhiyan hi there18:36
zhiyandue to currently osprofiler could only drive ceilometer backend18:36
zhiyanboris-42: hey =)18:36
amrithzhiyan, what is the overhead of this code, when it is disabled? I see that it instruments every API call with a call to osprofiler.profiler.get().18:36
boris-42zhiyan btw as soon as I know there will be support for stacktach as well18:36
boris-42amrith there is no overhead18:37
amrithsorry, will wait till boris-42 and you address previus question18:37
zhiyanboris-42: good to know. yes, there's no overhead if we disabled it18:37
amrithI'll buy "little overhead" but "NO overhead" seems hard to comprehend.18:37
boris-42amrith so basically there is no overhead even if profiler is turned on (but not triggered)18:37
boris-42amrith so every call will be sometihine like "if not None"18:37
boris-42amrith in my world it's no overhead18:38
amrithconsidering this is a profiler, I assumed that Heisenberg would be remembered ;)18:38
amrithanyhow, there was a mention of tracepoints and you mention "triggering", how does that work?18:38
amrithis there something more that one needs to do to utilize this?18:38
amrithwhich brings up the question of how to document this profiler for trove18:39
boris-42amrith so18:39
amrithwhich is a service unlike others18:39
boris-42amrith so18:39
boris-42amrith please read this18:39
amrithwe have a set of 'services' on the control side and one on the guestagent side.18:39
*** ViswaV has quit IRC18:39
amrith<waiting>18:39
boris-42amrith https://github.com/stackforge/osprofiler/blob/master/README.rst18:39
amrith<thx>18:39
boris-42amrith I am not sure that I will be able to describe it better then here18:39
boris-42amrith espeically in IRC18:39
amrithnp, I will read this link. thanks!18:40
boris-42amrith if you have any questions about this README just ping me18:40
amrithwilco18:40
boris-42amrith great18:40
boris-42amrith basically triggering happens when you run "profiler.init()"18:40
amrithSlickNik, I'm done. I have homework18:40
boris-42amrith this happens inside wsgie middleware18:40
zhiyanfor http calls18:40
boris-42amrith https://github.com/stackforge/osprofiler/blob/master/osprofiler/web.py#L10818:40
boris-42amrith is if there is specially harder, that is signed by key that is specified in api-paste.ini18:41
boris-42amrith then profiler.init() will happen18:41
*** jmontema_ has quit IRC18:41
boris-42amrith and profiler is triggered and it will create overhead=)18:41
boris-42amrith otherwise no overhead18:41
SlickNikSounds good just a couple of implementation related clarifications: So the part that's actually sending the trace data over is the osprofiler dependency? And the ceilometer endpoint is configured there?18:42
SlickNikSo is all that's exposed in trove a couple of switches to turn profiling on / off?18:42
boris-42SlickNik hm about "backend" for osprofiler18:42
boris-42SlickNik it can be everything, but we decided to use ceilometer as a first implementation18:43
boris-42SlickNik cause it's simplest way to get this working in gates18:43
boris-42SlickNik and by devstack18:43
boris-42SlickNik about turning off / on you can turn it off by a lot of ways18:43
zhiyanbtw, I prepared a change for devstack as well, to help setup things for Trove osprofiler.18:43
SlickNikzhiyan, link please?18:44
boris-42SlickNik you can do it from code, from api-paste.ini18:44
zhiyanin the change #116653, I added an option fro Trove.18:44
zhiyanSlickNik: https://review.openstack.org/#/c/116671/18:44
SlickNikboris-42: Okay, got it.18:44
zhiyanSlickNik: actually i mentioned all related patches in #116653 commit msg =)18:45
boris-42SlickNik so actually the idea is to have production ready profiler18:45
boris-42SlickNik e..g. if something went wrong in production, you are able (as a admin) to trigger it and analyze what works slow18:45
*** Barker has quit IRC18:45
SlickNikSo definitely think this is something useful.18:45
boris-42SlickNik ya and it's cross service project18:46
boris-42SlickNik so you can get something like http://boris-42.github.io/ngk.html18:46
boris-42SlickNik nova glance keystone18:46
SlickNikI'm not too excited about the soft dependency on a single backend, but given that this is something that you guys are working on, I'm okay with18:46
SlickNikit.18:46
zhiyanSlickNik: yep, we will integrate more project, to give operator a 'whole' trace picture18:46
SlickNikOther cores around who would like to weigh in?18:47
zhiyanSlickNik: agreed, we'd like do. boris-42 ^18:47
amrithone more question ...18:47
*** sgotliv_ has joined #openstack-trove18:47
amrithdo we have to implement triggers (in various places in the code) to benefit from this?18:47
boris-42SlickNik so yep we will depend only for first time on ceilometer18:47
zhiyanI have one question about schedule..will wait.18:47
*** jmontemayor has joined #openstack-trove18:47
zhiyanamrith: yes18:48
boris-42amrith so you can put in any place18:48
boris-42amrith that you think is interesting18:48
boris-42amrith points18:48
zhiyanamrith: #116653 is a initial patches. we can add more trace point in code as needed18:48
amrithso this isn't the complete implementation, this is just the beginning of the integration (if you will)18:48
boris-42amrith you are not limited by amount, cause they creates overhead only in case if profiler is trigered18:48
boris-42amrith ya you guys should help us a bit=)18:48
amrithover time we will have people adding profile trace points like we have debugging messages18:48
boris-42amrith ya18:48
boris-42amrith exactly18:49
amrithyikes!18:49
zhiyanamrith: but, for db/sql stuff osprofiler could trace all of them automatically now.18:49
amrithyes but a lot of what we do is executing commands18:50
amrithand in my observation, the db stuff is fast18:51
zhiyanSlickNik: my minor schedule question is that do you think we still have chance to done this in Juno?18:51
amrithsome of the commands take a lot longer18:51
boris-42amrith so basically you can trace whole classes18:53
boris-42amrith and so on18:53
SlickNikzhiyan: Probably not — right now the juno train has passed. :(18:53
boris-42amrith and avoid adding too much of pointins18:53
georgelorchoops o/ :)18:53
SlickNikzhiyan: Only RC1 bugfixes to the project at this point.18:53
zhiyanSlickNik: ok. fine.18:53
*** jasonb365 has quit IRC18:53
SlickNikzhiyan: So Kilo-1 is what were looking at.18:53
*** openstack has joined #openstack-trove18:55
SlickNikWill approve the BP for K1. Thanks for putting this together zhiyan, and boris-4218:55
amrithboris-42, zhiyan ... the sooner there is a non ceilometer backend the more useful it will become (just saying ;))18:55
zhiyanSlickNik: thanks!18:55
zhiyanamrith: reasonable ;)18:55
SlickNikOkay — and we're almost out of time.18:56
*** Barker has quit IRC18:56
SlickNikThe last BP on the agenda will take more than 5 minutes, so I'd recommend that folks take a look at the spec, and post your comments there.18:56
SlickNikSo we can hit the ground running next meeting.18:57
denis_makogonthat'll be awesome18:57
*** jmontemayor has quit IRC18:57
SlickNik#link https://blueprints.launchpad.net/trove/+spec/oracle-db-over-fedora-2018:57
*** jasonb365 has joined #openstack-trove18:57
SlickNikThat's all for today, folks.18:57
SlickNik#endmeeting18:57
openstackMeeting ended Mon Sep 22 18:57:48 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)18:57
SlickNikThanks all!18:57
amriththx SlickNik18:57
openstackMinutes:        http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-09-22-18.02.html18:57
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-09-22-18.02.txt18:57
openstackLog:            http://eavesdrop.openstack.org/meetings/trove_bp_review/2014/trove_bp_review.2014-09-22-18.02.log.html18:57
*** Barker has joined #openstack-trove19:00
*** Barker has quit IRC19:02
*** Barker has joined #openstack-trove19:04
iccha2anyone remember whats the command to rerun tests after the patch has been approved? https://review.openstack.org/#/c/119169/19:09
*** rwsu has joined #openstack-trove19:10
denis_makogoniccha2, "reverify bug xxxxx", but already did it =)19:11
denis_makogoniccha2, gate queue is full, so it might take awhile to run tests again19:12
denis_makogonSlickNik, about Cassandra replication and its factors, you might take a look http://jonathanhui.com/cassandra-cluster-and-replication19:13
iccha2thanks denis_makogon19:13
denis_makogonSlickNik, replication term in Cassandra can be used only with keyspaces, but not with clusters19:14
*** ViswaV_ has quit IRC19:15
denis_makogonSlickNik, amcrn, amrith, could you please approve this one? https://review.openstack.org/#/c/122730/ (rdjenkins is happy https://rdjenkins.dyndns.org/job/Trove-Integration-Gate/847/console)19:16
openstackgerritRamashri Umale proposed a change to openstack/trove: Discover config file for mongodb  https://review.openstack.org/12094519:16
RiddhiSlickNik - can you please approve this one too - https://review.openstack.org/#/c/92701/19:17
Riddhiyou had given it a +2 earlier...I have fixed rdjenkins post the rebase as well..19:18
amcrnlet's please avoid asking for approvals in the channel and in private pms, thanks.19:20
iccha2amcrn: then any other suggestions to draw attention to reviews due for juno ?19:21
denis_makogonamcrn, sure, but there's a list of show-stoppers, that may be concidered to merge in rc1 since they are blockers for specific tasks19:22
amcrniccha2: if it's marked against juno in launchpad, we're keeping an eye on it.19:22
denis_makogoniccha2, +119:22
iccha2amcrn:  ok cool as long someones keeping an eye on it19:22
*** ruebenramirez has quit IRC19:22
amrithiccha2, that's one of the reasons I've been wandering around -2'ing things that are not in juno19:23
amrithnot to offend the person working on it19:23
amrithbut just to help focus on the juno stuff for now.19:23
iccha2amrith: can u also target this for juno https://bugs.launchpad.net/trove/+bug/137012519:24
denis_makogonamrith, -2 is a bad thing, use Workflow-1 for those things that are not in juno19:24
*** tomblank_ has quit IRC19:24
denis_makogonamrith, for example there's no milestone rc1 for trove-integration project, https://bugs.launchpad.net/trove-integration/+bug/137121019:25
amrithas for attaching milestones to bugs, I believe that this is something that Nikhil, and before him hub_cap used to do. the whole bug triage thing. So iccha2 I'd defer to Nikhil on that. He takes a drive through bugs in general.19:27
*** ViswaV has joined #openstack-trove19:27
*** rushiagr_away is now known as rushiagr19:28
openstackgerritmariam john proposed a change to openstack/trove: Rename attrs_exist() to contains_allowed_attrs()  https://review.openstack.org/12101819:29
denis_makogonamrith, could you please add final +2 here https://review.openstack.org/#/c/122730 ?19:32
dougshelley66wasn't the intention that the higher priority replication bugs identified at mid-cycle would be fixed for juno?19:32
dougshelley66because, at this point, not all of them are triaged into RC119:33
denis_makogondougshelley66, +119:37
*** ViswaV has quit IRC19:37
*** vigneshvar has joined #openstack-trove19:41
*** jmontemayor_ has quit IRC19:41
*** Barker has quit IRC19:43
*** todd_dsm has quit IRC19:44
*** Barker has joined #openstack-trove19:46
*** todd_dsm has joined #openstack-trove19:49
*** sgotliv_ has quit IRC19:53
*** boblebauce has joined #openstack-trove19:55
*** sgotliv_ has joined #openstack-trove19:55
*** shakamunyi has joined #openstack-trove19:57
cp16netvgnbkr: how is building a vm for you?20:00
*** jmontemayor has joined #openstack-trove20:01
*** rushiagr is now known as rushiagr_away20:05
*** amrith is now known as _amrith_20:07
*** boden has quit IRC20:11
*** jmontemayor has quit IRC20:11
*** Barker has quit IRC20:14
*** julienvey has joined #openstack-trove20:17
*** Barker has joined #openstack-trove20:18
vgnbkrcp16net: not sure what you're asking...20:22
SlickNikdougshelley66: Yes, the intent was for all the high priority replication bugs to be marked for Juno RC1. If there are bugs that we identified as high priority that aren't, please let me know and I will correct.20:23
SlickNikPlus: I'm doing a quick bug sweep right now to make sure that all critical fixes that we want in RC1 are targeted appropriately.20:24
*** ViswaV has joined #openstack-trove20:24
*** annashen has quit IRC20:24
SlickNikI'll drop the channel a message once I'm done. If after that there is a bug not marked RC1, and you feel like it should be marked RC1, please let me or another trove core know so we can look and triage appropriately.20:25
*** IanGovett has quit IRC20:28
*** jmontemayor has joined #openstack-trove20:32
*** miqui has quit IRC20:34
*** ViswaV has quit IRC20:41
*** sgotliv_ has quit IRC20:42
*** todd_dsm has quit IRC20:52
boris-42SlickNik hey there20:52
SlickNikhey boris-4220:53
SlickNikwhat's up?20:53
cp16netvgnbkr: sorry some context... i'm having problems bringing up a new environment because the image build is failing20:53
boris-42SlickNik so guys are you interested in benchmarking trove?20:53
cp16netvgnbkr: have you had any issues?20:53
denis_makogoncp16net, due to which error?20:54
*** Barker has quit IRC20:54
SlickNikboris-42: That seems like a loaded question. :) Of course we are.20:55
*** vigneshvar has quit IRC20:56
boris-42SlickNik so I am working on Rally20:56
boris-42SlickNik so I can help to teach how to catch fish=)20:56
cp16neti think /opt/stack/diskimage-builder/bin/../lib/common-functions: line 200: dib-run-parts: command not found20:57
denis_makogoncp16net, pull new trove-integration, recent fix was merged20:57
SlickNikboris-42: In the middle of something right now, but would love to learn how to fish in that regard.20:57
cp16netdenis_makogon: in the last 6 hours?20:57
vgnbkrcp16net: I've just been doing kick-start mysql off of master:HEAD without issue.  You do need to "sudo pip install dib-utils" before running kick-start.20:57
cp16netor less?20:57
boris-42SlickNik so be free to ping me, and I'll help you =)20:58
SlickNikboris-42: Is there a rally room where I can pop-by and chat with you guys sometime?20:58
denis_makogoncp16net, much less20:58
denis_makogoncp16net, like 1h20:58
cp16netoh damn20:58
cp16netok20:58
cp16netcool20:58
boris-42SlickNik openstack-rally20:58
denis_makogoncp16net, np20:58
SlickNikboris-42: Sounds good, will do. Thanks!20:58
boris-42SlickNik ok great=)20:58
denis_makogoncp16net, https://review.openstack.org/#/c/122793/20:58
boris-42SlickNik actually rally + osprofiler will provide you benchmark + profiling in gates together20:58
boris-42SlickNik like create load that you need + add points that you need and get nice report20:59
denis_makogoncp16net, btw, could you do me a favor, could you please hit final +2 here https://review.openstack.org/#/c/122730/ ?20:59
*** todd_dsm has joined #openstack-trove21:03
*** Barker has joined #openstack-trove21:04
denis_makogoncp16net, thanks, man21:04
*** boblebauce has quit IRC21:08
*** boblebauce has joined #openstack-trove21:09
*** boblebauce has quit IRC21:09
cp16netnp21:11
cp16netdenis_makogon: are you running fedora?21:11
denis_makogoncp16net, i've planned to bring fedora/rhel/centos onto infra gate21:12
*** boden has joined #openstack-trove21:12
denis_makogoncp16net, but for now - yes, i'm trying to verify that all datastores supported by Trove are working properly not only on ubuntu LTS21:12
denis_makogonSlickNik, ping21:12
*** flaper87 is now known as flaper87|afk21:13
denis_makogonSlickNik, i've got response from sahara team, they've been running integration testing with clusters from 5 up to 7 instances per each pluging21:13
*** radez is now known as radez_g0n321:14
denis_makogonSlickNik, mirantis CI runs, iirc, 6 test suits for plugins at the same time21:15
SergeyLukjanovdenis_makogon, I think, I've already responsed about it in this channel :)21:15
SergeyLukjanovI'm in CA till mid October, so, we could discuss the way we're testing sahara21:16
denis_makogonSergeyLukjanov, sory for duplication21:16
*** _amrith_ is now known as amrith21:16
*** boden has quit IRC21:16
SergeyLukjanovdenis_makogon, duplication is good to make sure answer delivered ;)21:17
denis_makogonSergeyLukjanov, true, thanks21:17
SergeyLukjanovI'm just offering the ability to chat online about it if you guys need21:17
cp16netdenis_makogon: nice that got the image building :)21:17
denis_makogoncp16net, word!21:17
openstackgerritA change was merged to openstack/trove-integration: Fix post_install.d for Fedora distribution  https://review.openstack.org/12273021:33
*** amcrn has quit IRC21:36
*** denis_makogon has quit IRC21:38
cp16netweird the first instance doesnt go active but the second one does...21:39
cp16netlame...21:40
cp16net{"message": "No valid host was found. ", "code": 500, "created": "2014-09-22T21:29:51Z"}21:40
cp16netgot that from nova21:40
*** mattgriffin has quit IRC21:40
*** harlowja_ has quit IRC21:49
*** harlowja has joined #openstack-trove21:49
openstackgerritSteve Leon proposed a change to openstack/trove: Move cluster strategies to strategies/cluster  https://review.openstack.org/12325421:54
*** amcrn has joined #openstack-trove21:58
*** jcru has quit IRC22:04
*** Barker has quit IRC22:06
*** annashen has joined #openstack-trove22:09
*** boden has joined #openstack-trove22:13
*** sriram_tesora has quit IRC22:15
*** boden has quit IRC22:17
*** annashen has quit IRC22:18
*** jasonb365 has quit IRC22:32
*** annashen has joined #openstack-trove22:34
*** todd_dsm has quit IRC22:45
*** annashen has quit IRC22:49
*** annashen has joined #openstack-trove22:57
*** IanGovett has joined #openstack-trove22:59
*** amcrn has quit IRC23:00
*** jmontemayor has quit IRC23:06
*** annashen has quit IRC23:09
*** boden has joined #openstack-trove23:13
openstackgerritSteve Leon proposed a change to openstack/trove: Move cluster strategies to strategies/cluster  https://review.openstack.org/12325423:16
*** boden has quit IRC23:18
*** kevinconway has quit IRC23:27
*** Riddhi has quit IRC23:27
*** Riddhi has joined #openstack-trove23:28
openstackgerritRamashri Umale proposed a change to openstack/trove: Discover config file for mongodb  https://review.openstack.org/12094523:48

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!