Friday, 2016-04-22

*** tqtran has quit IRC00:23
*** itlinux has quit IRC00:43
*** mingdang1 has joined #openstack-trove00:45
*** jinxing has joined #openstack-trove00:51
*** cheneydc has joined #openstack-trove00:54
*** itlinux has joined #openstack-trove00:54
*** imandhan has quit IRC00:56
*** haomaiwang has joined #openstack-trove01:04
*** can8dnSix has quit IRC01:06
*** tellesnobrega_af is now known as tellesnobrega01:07
*** haomaiwang has quit IRC01:09
*** itlinux has quit IRC01:13
*** jinxing has quit IRC01:23
*** jinxing has joined #openstack-trove01:24
*** itlinux has joined #openstack-trove01:25
*** haomaiwang has joined #openstack-trove01:25
*** mingdang1 has quit IRC01:28
*** itlinux has quit IRC01:28
*** haomaiwang has quit IRC01:30
*** rmevans has joined #openstack-trove01:42
*** nikhil has quit IRC01:49
*** nikhil has joined #openstack-trove01:49
openstackgerritWilliam Criswell proposed openstack/trove: Make timeouts datastore specific  https://review.openstack.org/30367101:54
*** jinxing has quit IRC02:12
*** itlinux has joined #openstack-trove02:20
*** amrith is now known as _amrith_02:30
*** jinxing has joined #openstack-trove02:31
*** sgotliv has quit IRC02:33
*** tellesnobrega is now known as tellesnobrega_af03:36
*** davideagnello has quit IRC03:45
*** mingdang1 has joined #openstack-trove04:02
*** ozialiendoze has quit IRC04:05
*** ozialien has joined #openstack-trove04:06
*** ozialien has quit IRC04:10
*** ozialien10 has joined #openstack-trove04:11
*** sgotliv has joined #openstack-trove04:11
*** haomaiwang has joined #openstack-trove04:26
*** ozialien10 has quit IRC04:28
*** haomaiwang has quit IRC04:31
*** haomaiwang has joined #openstack-trove04:45
*** haomaiwang has quit IRC04:46
*** haomaiwang has joined #openstack-trove04:46
*** rmevans has quit IRC04:52
*** jinxing has quit IRC05:00
*** rcernin has joined #openstack-trove05:03
*** jinxing has joined #openstack-trove05:08
*** haomaiwa_ has joined #openstack-trove05:13
*** haomaiwang has quit IRC05:14
*** mingdang1 has quit IRC05:18
*** amit213 has quit IRC05:27
*** amit213 has joined #openstack-trove05:27
*** haomaiwa_ has quit IRC05:34
*** imandhan has joined #openstack-trove05:49
*** david-lyle has quit IRC06:16
*** sgotliv has quit IRC06:28
openstackgerritAndreas Jaeger proposed openstack/trove-dashboard: Fix periodic translation job  https://review.openstack.org/30927506:30
*** mingdang1 has joined #openstack-trove06:38
*** itlinux has quit IRC06:42
*** tesseract has joined #openstack-trove06:43
*** tesseract is now known as Guest8301606:43
*** Guest83016 has quit IRC06:48
*** sgotliv has joined #openstack-trove06:49
*** haomaiwang has joined #openstack-trove06:53
*** haomaiwang has quit IRC06:57
*** tesseract- has joined #openstack-trove07:02
*** mingdang1 has quit IRC07:21
*** imandhan has quit IRC07:24
-openstackstatus- NOTICE: Logs are failing to be uploaded causing jobs to be marked as UNSTABLE. We are working on repairing the log filesystem and will update when ready. Please do not recheck before then.07:31
*** ChanServ changes topic to "Logs are failing to be uploaded causing jobs to be marked as UNSTABLE. We are working on repairing the log filesystem and will update when ready. Please do not recheck before then."07:31
*** mingdang1 has joined #openstack-trove08:21
*** sgotliv has quit IRC08:22
*** mingdang1 has quit IRC08:26
*** haomaiwang has joined #openstack-trove08:26
*** haomaiwang has quit IRC08:30
*** haomaiwang has joined #openstack-trove08:55
*** haomaiwa_ has joined #openstack-trove08:57
*** haomaiwang has quit IRC09:00
*** haomaiwang has joined #openstack-trove09:00
*** haomaiwa_ has quit IRC09:02
*** haomaiwang has quit IRC09:07
*** haomaiwang has joined #openstack-trove09:08
*** haomaiwang has quit IRC09:13
*** openstackstatus has quit IRC09:24
*** openstackstatus has joined #openstack-trove09:26
*** ChanServ sets mode: +v openstackstatus09:26
*** david-lyle has joined #openstack-trove09:28
*** haomaiwang has joined #openstack-trove09:38
*** tosky has joined #openstack-trove09:40
*** haomaiwang has quit IRC09:43
*** haomaiwang has joined #openstack-trove09:53
*** haomaiwang has quit IRC09:58
*** v12aml has quit IRC09:59
*** cheneydc has quit IRC09:59
*** v12aml has joined #openstack-trove10:05
*** haomaiwang has joined #openstack-trove10:07
*** haomaiwang has quit IRC10:11
*** krotscheck_dcm is now known as krotscheck10:19
openstackgerritFlavio Percoco proposed openstack/trove-specs: Extend Trove to allow for other compute backends  https://review.openstack.org/30788310:22
*** haomaiwang has joined #openstack-trove10:24
*** haomaiwang has quit IRC10:28
openstackgerritFlavio Percoco proposed openstack/trove-specs: Extend Trove to allow for other compute backends  https://review.openstack.org/30788310:32
*** _amrith_ is now known as amrith10:32
*** haomaiwang has joined #openstack-trove10:41
*** haomaiwa_ has joined #openstack-trove10:45
*** haomaiwang has quit IRC10:45
*** haomaiwa_ has quit IRC10:49
-openstackstatus- NOTICE: Log server has been repaired and jobs are stable again. If necessary please recheck changes that have 'UNSTABLE' results.10:54
*** jinxing has quit IRC11:05
*** arist1 has quit IRC11:08
*** arist has joined #openstack-trove11:08
*** haomaiwang has joined #openstack-trove11:14
*** haomaiwang has quit IRC11:18
*** miqui has joined #openstack-trove11:55
*** haomaiwang has joined #openstack-trove11:59
*** haomaiwang has quit IRC11:59
*** haomaiwang has joined #openstack-trove12:00
*** AJaeger has joined #openstack-trove12:02
AJaegertrove-dashboard team, your import from the translation server fails due to broken tox venv environment. Please review and merge https://review.openstack.org/30927512:03
*** flwang has quit IRC12:07
*** mingdang1 has joined #openstack-trove12:09
*** pmackinn has joined #openstack-trove12:23
*** tellesnobrega_af is now known as tellesnobrega12:23
*** amrith is now known as _amrith_12:33
*** flwang has joined #openstack-trove12:35
*** haomaiwang has quit IRC12:59
*** mingdang1 has quit IRC13:02
*** mingdang1 has joined #openstack-trove13:13
*** _amrith_ is now known as amrith13:29
*** nikhil_ has joined #openstack-trove13:40
*** nikhil_ is now known as Guest501513:40
*** Guest5015 is now known as nikhil_k13:40
*** tellesnobrega is now known as tellesnobrega_af13:43
openstackgerritMerged openstack/trove-dashboard: Fix periodic translation job  https://review.openstack.org/30927513:44
openstackgerritamrith proposed openstack/trove: Reuse Cassandra connections  https://review.openstack.org/30431613:53
*** AJaeger has left #openstack-trove13:55
*** shakamunyi has joined #openstack-trove14:03
openstackgerritamrith proposed openstack/trove: Cleaned guestagent config for data_registry_ext  https://review.openstack.org/28443414:07
*** shakamunyi has quit IRC14:15
openstackgerritamrith proposed openstack/python-troveclient: configuration-* cli allow name of configuration group entered  https://review.openstack.org/23399814:18
*** shakamunyi has joined #openstack-trove14:29
*** mingdang1 has quit IRC14:43
*** itlinux has joined #openstack-trove14:57
*** itlinux has quit IRC14:59
*** haomaiwang has joined #openstack-trove15:01
-openstackstatus- NOTICE: Log server was repaired as of 10:50 UTC and jobs have been stable since. If necessary, please recheck changes that have 'UNSTABLE' results.15:02
*** nikhil has quit IRC15:08
*** tesseract- has quit IRC15:09
*** stewie925 has joined #openstack-trove15:15
*** openstack has joined #openstack-trove15:25
*** haomaiwang has quit IRC15:34
*** barra204 has joined #openstack-trove15:37
pmackinnanyone know why we don't fork mongod in the overrides? http://bit.ly/1Sozidc15:45
pmackinnpmalik, ? ^^15:47
amrithpmackinn, problem on some distributions?15:56
amriththat is typically the case, you let something like upstart or systemd manage the daemonization15:59
amrithyou need that so the service control managers can get the right process PID16:00
amrithmy recollection from way back16:01
pmackinnamrith, it actually blocks systemd16:05
*** davideagnello has joined #openstack-trove16:06
pmackinnmongod 3 will write out its pid and as long as that agrees with the init.d script, bob is your uncle16:07
amrithwhat vesion of mongodb?16:07
pmackinn3+16:07
amrith>2.6.3?16:07
pmackinnwhat's in trove-int16:07
pmackinnand master really16:08
amrithinteresting, I just a training with master (on Monday) and used MongoDB ...16:08
amrithwonder how that worked16:09
pmackinntraining on...?16:09
amrithmysql and mongo with trove16:09
*** itisha has joined #openstack-trove16:09
pmackinngo on16:09
amrithperconalive 2016, santa clar16:09
pmackinnwhat distro?16:09
amrithmaster/ubuntu16:09
* pmackinn drops the mic16:09
pmackinntrusty i assume?16:10
amrithI'm very trusty16:10
amrithwhat's trusty now? 14.04?16:10
pmackinnyes16:10
amrithyes, 14.04 lts16:10
pmackinnsysvinit16:10
amrithi dunno, I'm marketing16:11
pmackinnlol16:11
amriththat's all geek stuff16:11
amrithI run trove create16:11
pmackinnsure it is16:11
amrithyou should check out trove, it's this dbaas thing16:11
amrithand it takes the complexity out of running a plurality of databases in your private cloud.16:11
pmackinnUbuntu DBaaS16:11
amrithsupports a variety of databases and operating systems16:11
pmackinnas long as those OS are ubuntu16:12
amrithor windows16:13
amrithor aix16:13
amrithor vms16:13
amrithare there even other os's?16:13
amrithseriously thoug16:13
amriththought16:13
amriththough16:13
* pmackinn must have missed the windows branch upstream 16:13
amriththere are a bunch of mongod bugs about failure to launch16:14
amrithoh, it is python. you should check that out, it is os agnostic programming language that delivers maximum portability16:14
pmackinni look forward to slapping you in person next week16:14
amrithsssssh, that's secret16:15
amrithI'll bring all the 'gear'16:15
pmackinnjust got weird16:15
amrithserves you right :)16:15
amrithso back to serious16:15
pmackinngo16:15
amriththere are a bunch of mongodb bugs about systemd issues16:15
amrithon start16:15
amrithlooking at https://jira.mongodb.org/browse/SERVER-728516:15
amrithfor example16:16
amriththis one is closed in 3.3.216:16
amrithfor fedora and rhel16:16
pmackinnthe vendor doesn't make proper systemd scripts, relies on translation of init.d relics16:16
amrithcould this be what you are encountering?16:17
openstackgerritMerged openstack/trove: Update the root scenario tests  https://review.openstack.org/28375416:17
amrithor https://jira.mongodb.org/browse/SERVER-1621916:18
amrithwhich is open16:18
amriththis is neat :)16:19
amrithhttps://review.openstack.org/#/c/137230/16:19
*** tosky has quit IRC16:19
*** rcernin has quit IRC16:19
amrithanyway, safe travels. see ya monday16:19
pmackinnprocessManagement.fork: true -> just works (tm)16:21
*** nikhil has joined #openstack-trove16:40
openstackgerritPetr Malik proposed openstack/trove: Create default datastore options  https://review.openstack.org/30812616:44
*** imandhan has joined #openstack-trove16:49
amrithyo pmackinn ...16:52
*** haomaiwang has joined #openstack-trove16:53
*** haomaiwa_ has joined #openstack-trove16:56
*** haomaiwang has quit IRC16:58
*** haomaiwa_ has quit IRC17:01
*** pmackinn has quit IRC17:11
*** pmackinn has joined #openstack-trove17:12
*** barclaac has quit IRC17:12
amrithflaper87, tellesnobrega_af you there?17:18
*** barclaac has joined #openstack-trove17:20
stewie925hello all - I am working on a bug fix for https://bugs.launchpad.net/trove/+bug/154120217:22
openstackLaunchpad bug 1541202 in OpenStack DBaaS (Trove) "config parameter was changes from cluster_member_count to min_cluster_member_count" [Low,In progress] - Assigned to STEW TY (stewie925)17:22
stewie925and I tried to run tox -e py27, pep8 - but I am getting a few FAILs with a common denominator: oslo_config.cfg.NoSuchOptError: no such option in group vertica: cluster_member_count17:24
*** johnma has quit IRC17:25
stewie925i did change the existing vertica cfg.int_opt of  "cluster_member_count" to "min_cluster_member_count"17:26
*** tellesnobrega_af is now known as tellesnobrega17:27
stewie925and I added a deprecated_name='cluster_member_count' so it can still be referenced in the same cfg.int_opt17:28
*** kfox1111 has joined #openstack-trove17:31
kfox1111trove question. Just upgraded from kilo to liberty.17:31
kfox1111have some existing db's.17:31
kfox1111doing a trove user-list on one returns: TypeError: __init__() got an unexpected keyword argument 'resource_uuid'17:32
kfox1111do I have to upgrade all the db's guest agent's too?17:32
amrithkfox1111, one second17:32
amrithI've seen that before, it had to do with oslo.context, I think.17:33
* amrith runs to find some notes17:34
kfox1111thx. :)17:34
amrithkevin, you do have to first update the guests agents17:36
amriththe issue is that there was a change in oslo.context at some point that added this new field17:36
kfox1111ok. thanks.17:37
amrithand you have therefore got a controller with the newer oslo.context and a guest without17:37
dougshelley66kfox1111 in liberty trove moved from using context incubator to official oslo.context.17:37
dougshelley66the incubator context had "instance_uuid". oslo.context has resource_uuid17:37
kfox1111ah.17:37
kfox1111hmm.. so I'm going to have to prepare new images with the right bits in, and then go fix up all the old ones.17:38
kfox1111amrith: this is what I was suggesting with using seperate docker containers for db and guest agent. This sort of thing would be easier in that case. :)17:39
amrithkfox1111, yes, we're talking about that; not specifically about docker containers but for vms and bare metal as well17:39
kfox1111you could just docker pull the new gest agent container and restart it.17:39
amriththere's a session called 'superconductor' that would have this discussion17:40
amrithand I think it would be particularly useful for containers17:40
kfox1111I think the containers could really help with vm's and bare metal too.17:40
amrithsince many db vendors provide docker images.17:40
kfox1111I've been using kubernete's 'kube' agent in stand alone mode.17:40
kfox1111you just drop a yaml file in /etc/kubernetes/manifests, and it ensures the containers are running the versions/config you specify.17:40
kfox1111would be really easy to do containers without the overhead of a whole COE. while just needing nova.17:41
kfox1111upgrading the guest agent then on it would simply be: sed -i 's/kilo/liberty/' /etc/kubernetes/manifests17:42
*** tqtran has joined #openstack-trove17:43
kfox1111tqtran: hi. :)17:43
tqtrankfox1111: hey kevin17:43
*** haomaiwang has joined #openstack-trove17:45
*** sgotliv has joined #openstack-trove17:46
*** haomaiwang has quit IRC17:49
kfox1111hmm... so, most of these db's are Ubuntu 15.04 at the moment. and I can't blow them out...17:52
kfox1111sudo add-apt-repository cloud-archive:liberty fails...17:54
kfox1111can I just sed -ri 's/instance_uuid/resource_uuid/g' /usr/lib/python2.7/dist-packages/trove/ ?17:56
kfox1111hehe. yeah. looks like that works.17:59
*** haomaiwang has joined #openstack-trove17:59
kfox1111so, I'll just throw that workaround into the template for now, and then work on getting an updated distro image going.17:59
*** imandhan has quit IRC18:02
kfox1111is there any liberty mysql clustering instructions anywhere?18:04
*** haomaiwang has quit IRC18:04
*** rmevans has joined #openstack-trove18:04
dougshelley66kfox1111 i'm assuming your guests still have the old trove/openstack/common/context.py in which case i believe the sed fix you describe should work18:05
*** shakamunyi has quit IRC18:05
*** barra204 has quit IRC18:05
kfox1111yeah.18:06
*** shakamunyi has joined #openstack-trove18:06
kfox1111works ok at least for user-list18:06
dougshelley66kfox1111 i believe the "mysql" clustering in liberty was the implementation of percona xtradb cluster18:06
dougshelley66using the "pxc" manager18:06
*** rmevans has quit IRC18:07
*** barra204 has joined #openstack-trove18:07
amrithyes, that's correct.18:07
amrithI believe that you need a pxc guest18:07
amrithother than that, I think it is largely like mongo except that instances are similar, unlike mongodb where they are specialized.18:08
kfox1111is there any examples of how to set that up?18:13
kfox1111or do I just register an image and see what breaks?18:14
kfox1111I had to do quite a complicated cloudinit script to get just a basic mysql to work with kilo.18:14
*** SlickNik has quit IRC18:16
*** SlickNik has joined #openstack-trove18:17
*** vipuls has joined #openstack-trove18:18
*** vipul has quit IRC18:18
stewie925hello I have a trove question - am fixing a bug to change config parameter but when I ran I am getting a NoSuchOptError18:31
stewie925the error detailsa are in http://paste.openstack.org/show/495185/18:31
*** haomaiwang has joined #openstack-trove18:35
stewie925i changed a config parameter in vertica from 'cluster_member_count' to 'min_cluster_member_count', but kept the 'cluster_member_count'  by setting it  as a deprecated_name so it can be backward referenced18:36
amrithstewie925, did you push your change upstream?18:36
stewie925hi amrith yes I did18:37
amrithhttps://review.openstack.org/#/c/308693/ ?18:38
stewie925yes that is correct18:38
amrithstewie925, so here's what happened.18:39
amrithfirst, in your change, you changed trove/common/cfg.py and there are a number of issues with the formatting.18:40
amrithwhat I suggest you do is run tox on your system before you push the change up, it'll be much easier to debug there.18:40
amrithso you could run18:40
amrithtox -e pep818:40
amrithand it'll tell you that the line you added has indentation and formatting issues. spaces and tabs, things like that18:40
amriththen there's the other half of this ...18:40
amrithyou changed a paramter name but the old parameter is used all over the code, in many places18:41
*** haomaiwang has quit IRC18:41
amrithso you will have to go and change all of those.18:41
stewie925oh I see - thank you amrith - let me try running the tox test you just suggested18:41
stewie925oh18:41
stewie925many thanks!18:41
amrithI can see about a dozen places18:41
amriththen there's a sample configuration file that you should update18:41
amrithand then the tests18:41
*** barra204 has quit IRC18:41
*** shakamunyi has quit IRC18:41
*** shakamunyi has joined #openstack-trove18:42
*** barra204 has joined #openstack-trove18:42
amrithand before you push up changes, run tox on your local machine18:42
amrithlike18:42
amrithtox -e pep818:42
amrithtox -e py2718:42
amrithtox -e py3418:42
amrithor whatever tests you want to run18:42
amrithor just run18:43
amrithtox18:43
amrithand it'll do them all18:43
stewie925appreciate your valiable input - am running the pep8 test as we speak18:43
amrithgreat18:43
*** imandhan has joined #openstack-trove19:04
*** itisha has quit IRC19:09
*** haomaiwa_ has joined #openstack-trove19:13
*** haomaiwa_ has quit IRC19:22
openstackgerritPetr Malik proposed openstack/trove: Make 'default_password_length' datastore-specific  https://review.openstack.org/30793919:33
openstackgerritPetr Malik proposed openstack/trove: Make 'default_password_length' datastore-specific  https://review.openstack.org/30793919:34
*** twm2016 has joined #openstack-trove19:42
kfox1111been a long time since I played with adding datastores... is there an example out there?19:50
*** amrith is now known as _amrith_19:53
stewie925hello amrith19:54
stewie925my pep8 test is now a success (made some indentation changes), but i have the sam issue(s) with the py27 test19:55
stewie925there's a bunch of fails, but they are all related to the 'oslo_config.cfg.NoSuchOptError: no such option in group vertica: cluster_member_count' error19:56
*** itisha has joined #openstack-trove20:12
openstackgerritPeter Stachowski proposed openstack/trove: Add variables for quota configuration  https://review.openstack.org/27487220:13
*** tellesnobrega is now known as tellesnobrega_af20:14
openstackgerritPeter Stachowski proposed openstack/trove: Refactor scenario tests to facilitate multi-group  https://review.openstack.org/30919020:18
*** tellesnobrega_af is now known as tellesnobrega20:38
openstackgerritPetr Malik proposed openstack/trove: Add db-models and RootController for Postgres  https://review.openstack.org/27804420:44
openstackgerritPetr Malik proposed openstack/trove: Cleanup guestagent models  https://review.openstack.org/27807420:44
*** rmevans has joined #openstack-trove20:46
kfox1111so, do you create percona as a datastore version or as its own datastore?20:57
*** haomaiwang has joined #openstack-trove21:00
openstackgerritPetr Malik proposed openstack/trove: Postgresql Incremental Backup and Restore  https://review.openstack.org/25916721:02
openstackgerritPetr Malik proposed openstack/trove: Postgresql Streaming Replication  https://review.openstack.org/28871221:02
*** haomaiwang has quit IRC21:04
*** davideagnello has quit IRC21:06
*** imandhan has quit IRC21:10
*** _amrith_ is now known as amrith21:19
stewie925hi guys - would there be a reason why py27 test fails whereas py34 test is successful?21:20
*** haomaiwang has joined #openstack-trove21:29
*** sgotliv has quit IRC21:30
*** haomaiwang has quit IRC21:34
kfox1111ok, so, I created a percona datastore type and added a version. but it does not show up under create new cluster in horizon.21:35
kfox1111any ideas?21:35
amrithpercona or pxc kfox111121:47
amrithstewie925, because py34 has way fewer tests than py2721:47
*** stewie925_ has joined #openstack-trove21:47
kfox1111I did that I think.21:47
amrithkfox1111, you said percona. I'm saying percona and pxc are different.21:48
*** stewie925 has quit IRC21:48
amrithif you did pxc, then, ... lets see21:48
kfox1111oh.21:48
kfox1111the data store needs to be named 'pxc'?21:48
amrithyes21:48
kfox1111ah. gotcha.21:48
kfox1111is the plugin pxc then too?21:49
amrithlet me check21:49
amrithso for pxc, you have a config option min_cluster_member_count which should be set to 221:49
kfox1111ok. so....21:50
amriththen, how do you register the datastore ....21:50
* amrith looking21:50
kfox1111trove-manage datastore_update 'pxc' ''21:50
kfox1111trove-manage datastore_version_update pxc 'pxc-5.5' pxc 1c7163d9-bfc2-4c3c-9e60-0155c09d9d00 '' 121:50
amrithso I'm seeing 5.621:51
kfox1111I saw a ticket that said 5.6 wasn't supported in liberty.21:51
amrithoh, liberty21:51
amrithone second21:51
kfox1111and min_cluster_member_count is under [pxe] in trove.conf? or one of the others?21:52
amrithtrove-manage datastore_update pxc21:52
amriththat would be [pxc]21:52
amrithtrove-manage datastore_version_update pxc 'pxc-version' pxc <image-id> '' 121:52
amrithtrove-manage datastore_update pxc 'pxc-version'21:53
amriththat should be it21:53
amrithbbiab21:55
kfox1111ok. thanks for the help. :)21:56
kfox1111So, then:21:57
kfox1111trove cluster-create test-db-cluster pxc pxc-5.5 --instance flavor=m1.small,volume=1 --instance flavor=m1.small,volume=1 --instance flavor=m1.small,volume=121:57
kfox1111fails on quota...21:57
kfox1111though instance count in nova looks fine.21:57
stewie925_hi guys, wondering if anyone can shed more light on 'deprecate_name'?22:04
*** rmevans has quit IRC22:05
stewie925_i mean 'deprecated_name'22:05
stewie925_what i understand is deprecated_name contains the name of the old config parameter22:08
amrithkfox1111, sorry about the 222:08
amrithi think changing min_cluster_count to 2 is something I had just to get around the size of the cluster and my laptop22:08
amrithso leaving it at the default is fine22:08
kfox1111oh, its not liking m1.small. it wants '2'.22:08
amrithnow, it doesn't launch ...22:08
kfox1111ah. ok. I was thinking that might be the case.22:09
amrithso the default pxc size is 3 (quorum). you can't do quorum consensus with 222:09
amrithwhat do you mean it wants 2?22:09
kfox1111sorry. flavor=2.22:10
kfox1111its wanting flavor id's, not flavors.22:10
amriththe help says it should take either22:10
amrithmumble mumble22:10
kfox1111yeah. I see it fail in nova-api's logs. :/22:10
kfox1111but it stopped complaining when I put the flavor id 2 in it.22:11
amrithare the nova instances launched?22:11
kfox1111no. same error. its complaing about quota.22:11
amrithquota on instances?22:11
kfox1111but it was when it was a nova flavor id error...22:11
kfox1111yeah.22:11
amrithnova is complaining?22:12
amriththat's out of trove's control then22:12
kfox1111no. nothing in the logs.22:12
amrithwho is complaining about quota?22:12
kfox1111trove cluster-create test-db-cluster pxc pxc-5.5 --instance flavor=2,volume=1 --instance flavor=2,volume=1 --instance flavor=2,volume=122:12
kfox1111ERROR: Quota exceeded for resources: ['instances']. (HTTP 413)22:12
twm2016stewie925_: Try asking your question in #openstack-oslo22:12
kfox1111if I go into the dashboard though, say launch nova instance, select the same flavor, and hit 3 instances, it says there is pleanty of quota.22:13
stewie925_thanks Trevor22:13
kfox1111I also have quota for 20 cinder volumes and currently have 8 allocated.22:13
kfox1111so I'm not sure which quota its talking about.22:13
amrithstewie925_, https://review.openstack.org/#/c/307939/ may give you some indication about deprecation22:13
kfox1111it said it was a quota problem too when flavor was m1.small, so I think it may be saying quota when it may not be.22:14
amrithanything in trove API or taskmanager logs?22:14
kfox1111I"m going to crank up debugging on trove and see if it says anything more.22:14
amrithwell quota is an error22:14
amrithso if you see nothing in the trove logs as it is, I'd look in Nova's logs22:14
amrithor cinders22:14
amrithor neutrons22:14
amrithwonder why the log doesn't say who ran out of quota22:14
amrithtrove must at least bitch about the resource creation failing or timing out22:15
amrithif it was nova or something else22:15
kfox1111nothing in nova cinder or neutron. :/22:15
kfox1111let me crank up some debugging....22:15
kfox1111ah. for some reason the trove logs are only going to journald... at least I'm seeing them now...22:16
kfox1111weird... very unclear.. let me get a pastebin going...22:17
kfox1111http://pastebin.com/vK8inxsH22:18
kfox1111its in trove/quota/quota.py22:19
amrithlooking22:20
amrithso you have enough quota with nova and not enough with Trove?22:21
kfox1111seems like it?22:21
amriththat's weird22:22
amrithlooking at what it's up to ...22:22
kfox1111I only see logs in nova's api at the time....22:22
amrithso I suspect it is launching one instance or two instances and failing on the third22:23
amrithso how about a trove cluster-list22:23
kfox11114 calls to /v2/dd1e905f59564454b1d89792888d12df/flavors/2 HTTP/1.1" status: 20022:23
kfox1111nothing else.22:23
kfox1111I don't see any instance creates.22:24
amrithok22:24
amrithtrove list22:24
amrithhow many do you have?22:24
kfox1111and a nova flavor show does the same api call. nova flavor-show 2 works.22:25
kfox11113. but nothing related to the cluster I'm trying to create.22:25
kfox1111is there a trove quota itself? or does it just use the other projects quota's?22:26
amrithno, trove has a quota22:26
amrithits own quotas22:26
amrithi.e. you have a nova quota22:26
amrithand a trove instance quota22:26
amrithsimilarly a cinder quota22:26
amrithand a trove volume quota22:26
kfox1111ah. where are those set?22:26
amrithand I can never remeber where we store it :)22:26
*** imandhan has joined #openstack-trove22:27
kfox1111trove help | grep quota and trove-manage -h | grep quota are blank.22:27
kfox1111so is grep -ri quota /etc/trove/22:27
amrithyes, there are management apis for it22:30
kfox1111the quotas table is blank. there are entries in quota_usages;22:31
amrithand do the entries in quota_usages match your existing instances22:31
kfox1111I haven't counted closely, but it looks like it.22:32
kfox1111so it may just not be allowing any new things to be launched.22:32
kfox1111I'm guessing db quota might have been added in liberty?22:33
kfox1111so they pre date having any quota records?22:33
amrithso the default22:33
amrithfor instances22:33
amrithcomes from your config22:33
kfox1111where would the default be?22:33
amrithfor max_instances_per_user22:33
kfox1111ok.22:33
amriththe default is 522:33
amrithwhich isn't enough22:33
kfox1111I don't have anything set there I think.22:33
kfox1111ah. ok.22:33
amriththat's right22:33
amriththe default is 522:33
kfox1111so I need to up the default.22:33
kfox1111know what the key is?22:33
amrithyes, sending it to you in the paste22:33
kfox1111ok. thanks.22:34
amrithcan't do that22:34
amrithsee https://gist.github.com/amrith/4da5fd06b3149f799ede45f588e6585a22:34
amrithyou want to change this in your trove taskmanager config file22:34
amrithand restart the taskmanager22:34
kfox1111ah. ok. thanks.22:35
amrithone second kevin22:35
amrithlet me confirm that it isn't trove API config file22:35
amrithok, to be sure put it in trove.conf as well22:36
amrithI think it should be just one22:36
amrithbut I don't want to waste your time restarting and trying22:36
amrithso put it in both please22:36
amrithtrove.conf and trove-taskmanager.conf22:36
amrithand restart both services22:36
amrithI'll confirm which it is in paralle22:36
amrithparallel22:36
kfox1111there we go... the max backups one is newer then liberty.22:38
kfox1111ok. got taskman restarted... testing...22:39
*** davideagnello has joined #openstack-trove22:39
kfox1111no, crashed again... NoSuchOptError: no such option: max_volumes_per_user22:39
kfox1111removing that one too...22:39
amrithwait22:39
amrithlet me check the section22:39
amrithit is global22:40
kfox1111Default section?22:40
amrithdid you put at end of file?22:40
amrithyes22:40
amrithcommon options22:40
kfox1111yeah, I put it at the begining under the default section.22:40
kfox1111it didn't like the volume options, but took the rest.22:40
kfox1111but still complaining.22:40
amrithall 3 are in liberty22:41
kfox1111the quota error is showing in the trove-api logs. should I just move it to trove.conf?22:42
amrithyes plz22:42
amrithi coulve sworn it would be tm22:42
kfox1111oh. I had comma's on the end of the two that it was complaining about.22:43
amrithand it is same parser for all 322:43
kfox1111there we go.22:43
kfox1111in trove.conf, restarted api and taskman. then it at least took it. returned a cluster id.22:43
amrithwhats nova say?22:44
kfox11113 vm's launched.22:44
amrithgood22:44
kfox1111so, while this is going...22:45
kfox1111its working now on the cli.22:45
kfox1111in horizon though, I cant select a datastore. no entries.22:45
amrithlmc22:45
amrithoh liberty ...22:46
kfox1111sorry to keep throwing that monkey rench at you. we missed mitaka on our last upgrade window by like 3 days. :/22:47
kfox1111now we gota wait 6 months till our next window. :/22:47
amrith2m bb22:48
kfox1111k22:48
amrithok, am back22:52
*** twm2016 has quit IRC22:53
amrithsorry, was informed that 'i can't have any pudding if I don't ...'22:53
amrithdid it work kevin?22:54
kfox1111lol. sorry about the pudding. :)22:55
kfox1111no. I think somethings wrong with the guest agent now.22:55
kfox1111I don't see connections in list_connections22:55
dougshelley66trove list --include-clustered22:58
kfox1111oh.. I think I need to slide port 22 into the security group to get in....22:58
amrithah, not able to catch up with the speedy rabbit22:58
kfox1111ah. they are showing up errored in include-clustered22:58
amrithok, time to get port 22 warmed up22:59
amrithwait a second22:59
*** itisha has quit IRC22:59
amrithwhat version of oslo.context did you use there :)22:59
amrithon the guest?23:00
amrithdid it by some chance get the latest latest latest23:00
kfox1111I was lazy, and grabbed from http://tarballs.openstack.org/trove/images/ubuntu/23:00
amrithok, that has the new oslo.context23:00
kfox1111which, we should have another conversation about.... we should add those to apps.openstack.org. :)23:00
amrithand you sed -i on the host, no?23:00
amrith:)23:00
amrithlet's chat in austin23:01
kfox1111no. on the vm's. so they should work.23:01
kfox1111kk. :)23:01
amrithwell, these vm's should have the right stuff23:01
amrithso something else broke23:01
kfox1111I've got a one click installer for glance images in horizon now as part of apps.openstack.org. :)23:01
kfox1111yeah. I updated the security group. I'm going in. :)23:01
kfox1111hmmm.. but its not my cloud key.23:02
amrithyes23:02
amriththose images23:02
amrithuse a different key23:02
amrithhere's what you do23:02
amrithclone openstack/trove-integration23:02
amriththen waltz over to trove-integration/scripts/files/keys23:03
kfox1111ci-info: | ssh-rsa | 99:ac:87:91:22:12:a1:88:5d:26:9b:63:94:f9:44:0d |    -    | trove@devstack |23:03
amrithand grab the private key there23:03
amrithyes23:03
kfox1111oh..23:03
kfox1111k.23:03
amriththe private key for that is on trove-integration's source tree23:03
kfox1111yup. I'm in.23:05
kfox1111weird...23:06
kfox1111dpkg -l | grep trove23:06
kfox1111blank.23:06
amriththat's true23:06
amriththis is trove integration23:06
amrithOH CRAP23:06
amriththese elements are for dev and devstack use23:06
amriththey have no trove23:06
amriththey'll scp them over from the host23:06
amrithat launch time :)23:06
amriththese elements are trove-integration elements generated with redstack23:07
kfox1111no curl...23:07
amrithso they'll (at runtime) scp the guest code from the host23:07
amrithat 10.0.0.123:07
amrithor 10.0.0.223:07
amrithso yes, there's no guest there23:07
kfox1111oh.. ok.23:07
amriththat's why you get no rabbit connection coz there's no guest23:07
kfox1111maybe I should just drop these images then, and go back to cloudinit for this.23:07
kfox1111I was hoping it would have all the pxc stuff loaded. but I can figure that out via cloudinit I think.23:08
amrithis that how you do it?23:08
amrithfor mysql?23:08
kfox1111yeah.23:11
amrithwe should talk23:12
kfox1111I'd prefer to do it with heat instead, but last I tried it wasn't entirely stable.23:12
amriththere's a whole presentation about making guest images for trove23:12
amrithpresentation/work session ...23:12
kfox1111yeah. we use dib to build our root images.23:12
kfox1111but its still kind of manual to sync the images, so the more we have, the more work it is.23:13
kfox1111we need to automate that pipeline.23:13
kfox1111we were hoping glance would get multiversion support at some point, but that spawned into glare and then seemingly backburnered. :/23:13
kfox1111kind of hoping the whole thing gets rekergiggered around with docker containers. :)23:14
amrithyes, that's what we use too (dib)23:14
kfox1111then we can use versioin X of the db container, and version Y of the guest agent that matches our cloud, all running on our base images.23:14
amrithwe're doing something like that (planning) in the session on 'superconductor'. bad name actually but would be much better for image making23:15
kfox1111but I'm guessing thats not a 6 month thing. :/23:15
amriththat is23:15
kfox1111let me double check my schedule and see if I can make it.23:15
kfox1111remember the time/date?23:15
amritheven if you can't make the session, i'd like to chat with you23:15
amrithi'll pm you my phone number; I won't be able to IRC from my phone but if you are able, we can coordinate by text/email.23:16
kfox1111Yeah. that would be good.23:16
kfox1111yeah. I can text/email.23:16
*** stewie925_ has quit IRC23:25
openstackgerritMerged openstack/trove-integration: Fix "trove_volume_size" test prop type  https://review.openstack.org/28857023:29
*** nikhil has quit IRC23:58
*** nikhil_k is now known as nikhil23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!