Monday, 2015-01-26

*** vigneshvar has quit IRC00:06
*** atomic77 has quit IRC00:08
*** IanGovett has joined #openstack-trove01:07
*** annashen has joined #openstack-trove01:08
*** pmackinn has quit IRC01:11
*** IanGovett has quit IRC01:35
*** annashen has quit IRC01:49
*** newb_ has quit IRC02:01
*** annashen has joined #openstack-trove02:19
*** haomaiwa_ has joined #openstack-trove02:22
*** erkules_ has joined #openstack-trove02:24
*** erkules has quit IRC02:27
*** annashen has quit IRC02:36
*** annashen has joined #openstack-trove03:02
*** grapex has joined #openstack-trove03:32
*** annashen has quit IRC04:05
*** mattgriffin has joined #openstack-trove04:23
*** Longgeek has joined #openstack-trove04:24
*** mattgriffin has quit IRC04:26
*** Longgeek_ has joined #openstack-trove04:47
*** Longgeek has quit IRC04:50
*** haomaiwa_ has quit IRC04:58
*** haomaiwa_ has joined #openstack-trove04:58
*** grapex has joined #openstack-trove05:03
*** grapex has quit IRC05:08
*** sgotliv_ has joined #openstack-trove05:56
*** grapex has joined #openstack-trove06:03
*** grapex has quit IRC06:08
*** Kieleth has joined #openstack-trove06:21
*** vigneshvar has joined #openstack-trove06:22
*** rwsu has joined #openstack-trove06:54
*** rwsu is now known as rwsu-afk06:54
*** grapex has joined #openstack-trove07:04
*** grapex has quit IRC07:08
*** exploreshaifali has joined #openstack-trove07:25
*** sgotliv_ has quit IRC07:42
*** grapex has joined #openstack-trove08:05
*** grapex has quit IRC08:09
*** erkules_ is now known as erkules08:22
*** vigneshvar has quit IRC08:31
*** pboros has joined #openstack-trove08:32
*** f13o has joined #openstack-trove08:37
*** vigneshvar has joined #openstack-trove08:45
*** romainh has joined #openstack-trove08:53
*** grapex has joined #openstack-trove09:05
*** grapex has quit IRC09:09
*** boblebauce has joined #openstack-trove09:16
*** pboros has quit IRC09:18
*** pboros has joined #openstack-trove09:18
*** Guest66252 is now known as d0ugal09:22
*** d0ugal has quit IRC09:23
*** d0ugal has joined #openstack-trove09:23
*** Longgeek has joined #openstack-trove09:30
*** Longgeek_ has quit IRC09:33
*** vigneshvar has quit IRC09:51
*** atomic77 has joined #openstack-trove09:58
*** exploreshaifali has quit IRC10:00
openstackgerritOpenStack Proposal Bot proposed openstack/python-troveclient: Updated from global requirements  https://review.openstack.org/14998110:34
openstackgerritOpenStack Proposal Bot proposed openstack/trove: Updated from global requirements  https://review.openstack.org/14998510:35
*** vigneshvar has joined #openstack-trove10:37
*** sgotliv_ has joined #openstack-trove10:48
*** sgotliv_ has quit IRC10:55
*** haomaiwa_ has quit IRC11:06
*** grapex has joined #openstack-trove11:06
*** atomic77 has quit IRC11:08
*** sgotliv_ has joined #openstack-trove11:10
*** romainh has left #openstack-trove11:10
*** grapex has quit IRC11:11
*** atomic77 has joined #openstack-trove11:22
*** tlashchova has joined #openstack-trove11:32
*** denis_makogon has joined #openstack-trove11:32
*** atomic77 has quit IRC11:41
*** grapex has joined #openstack-trove12:07
*** grapex has quit IRC12:11
*** newb has joined #openstack-trove12:38
*** jcooley has quit IRC12:51
*** SergeyLukjanov has quit IRC12:51
*** romainh has joined #openstack-trove12:51
*** romainh has left #openstack-trove12:52
*** SergeyLukjanov has joined #openstack-trove12:52
*** tlashchova has quit IRC12:52
*** exploreshaifali has joined #openstack-trove12:52
*** tlashchova has joined #openstack-trove12:53
*** jcooley has joined #openstack-trove12:53
*** IanGovett has joined #openstack-trove12:57
*** sgotliv_ has quit IRC13:21
*** sgotliv has joined #openstack-trove13:21
*** robertmyers has quit IRC13:23
*** exploreshaifali has quit IRC13:33
*** amrith is now known as _amrith_13:39
*** jcru has joined #openstack-trove14:03
*** pmackinn has joined #openstack-trove14:10
*** pmackinn has quit IRC14:12
*** pmackinn has joined #openstack-trove14:15
*** vigneshvar has quit IRC14:25
*** mattgriffin has joined #openstack-trove14:38
*** johnma has joined #openstack-trove14:38
*** exploreshaifali has joined #openstack-trove14:50
*** _amrith_ is now known as amrith14:59
*** radez_g0n3 is now known as radez15:00
*** jcru_ has joined #openstack-trove15:01
*** jcru has quit IRC15:02
*** robertmyers has joined #openstack-trove15:05
*** robertmyers has quit IRC15:05
*** Longgeek has quit IRC15:13
*** Barker has joined #openstack-trove15:16
*** bhunter71 has joined #openstack-trove15:20
*** shayneburgess has quit IRC15:22
*** johnma_ has joined #openstack-trove15:33
*** johnma has quit IRC15:33
*** johnma_ is now known as johnma15:33
*** jcru_ has quit IRC15:36
*** robertmyers has joined #openstack-trove15:37
*** jcru has joined #openstack-trove15:43
*** jcru has quit IRC15:45
*** jcru has joined #openstack-trove15:45
*** Barker has quit IRC16:08
*** sgotliv has quit IRC16:13
*** vigneshvar has joined #openstack-trove16:17
*** shayneburgess has joined #openstack-trove16:20
*** denis_makogon has quit IRC16:21
*** Riddhi has joined #openstack-trove16:24
*** boblebauce has quit IRC16:25
*** david-ly_ is now known as david-lyle16:33
*** vigneshvar has quit IRC16:36
*** pmackinn has quit IRC16:36
*** rwsu-afk is now known as rwsu16:38
*** Barker has joined #openstack-trove16:40
*** shayneburgess has quit IRC16:47
*** vigneshvar has joined #openstack-trove16:50
*** amrith is now known as _amrith_17:00
*** eghobo has joined #openstack-trove17:21
*** sgotliv has joined #openstack-trove17:23
*** cweid has joined #openstack-trove17:26
*** _amrith_ is now known as amrith17:29
* jcru hub_cap17:33
jcruoops17:34
*** serverascode has quit IRC17:35
*** serverascode has joined #openstack-trove17:36
*** thedodd has joined #openstack-trove17:39
*** amrith is now known as _amrith_17:40
*** Barker has quit IRC17:51
*** eghobo has quit IRC17:55
*** exploreshaifali has quit IRC17:57
dougshelley66For anyone following the Mysql datadir review - I've posted some comments that I was hoping to get some feedback on - https://review.openstack.org/#/c/147908/417:59
*** Barker has joined #openstack-trove17:59
*** pmackinn has joined #openstack-trove18:08
*** annashen has joined #openstack-trove18:09
*** sbfox has joined #openstack-trove18:19
*** amcrn has joined #openstack-trove18:20
*** zhiyan has quit IRC18:40
*** zhiyan has joined #openstack-trove18:40
*** pboros has quit IRC18:44
*** pboros has joined #openstack-trove18:47
openstackgerritNirav Shah proposed openstack/trove: Fix PostgreSQL volume definitions  https://review.openstack.org/14950118:49
*** thedodd has quit IRC18:53
*** sriram_tesora has joined #openstack-trove18:54
thansenI've got trove semi setup using RDO19:05
thansenI don't see when/how the 'setup' occurs after an instance has been brought up19:05
thansenit appears trove will automatically add the os_admin user and set some permissions etc etc19:06
* thansen not seeing that happen19:06
thansenwhich makes the UI not work out the box19:06
SlickNikthansen: I haven't set up trove using RDO, so I'm not sure what issue you're exactly running into.19:15
*** david-lyle is now known as david-lyle_afk19:15
SlickNikthansen: Were you able to create a trove instance and have it come ACTIVE?19:16
sgotlivSlickNik, thansen is using RDO, our community bits :-)19:23
sgotlivour === RH19:23
SlickNiksgotliv: Yes, that's what I thought. Was trying to see if I could help with the issue he's facing.19:25
sgotlivSlickNik, you welcome!19:25
sgotlivSlickNik, I mean you definitely can and capable, I am going offline :-)19:25
SlickNiksgotliv: Not a problem. See you around.19:26
*** thedodd has joined #openstack-trove19:42
openstackgerritPetr Malik proposed openstack/trove: MySQL restore wait for shutdown before killing  https://review.openstack.org/14988219:42
esmute_amrith_, SlickNik: Can you guys quickly look at https://review.openstack.org/#/c/123254. It should be a quick review19:46
*** radez is now known as radez_g0n319:46
*** thedodd has quit IRC19:51
*** Barker has quit IRC19:52
*** thedodd has joined #openstack-trove19:53
*** Barker has joined #openstack-trove19:57
openstackgerritAnna Shen proposed openstack/trove: Add limit stanzas for mongos.  https://review.openstack.org/15013120:07
*** vigneshvar has quit IRC20:20
*** sbfox has quit IRC20:26
*** radez_g0n3 is now known as radez20:29
*** exploreshaifali has joined #openstack-trove20:29
*** annashen has quit IRC20:31
*** vigneshvar has joined #openstack-trove20:37
*** sbfox has joined #openstack-trove20:38
openstackgerritPete MacKinnon proposed openstack/trove-integration: readme clarifications for new developers using redstack  https://review.openstack.org/15014020:57
thansenSlickNik, sgotliv: sorry I took off for a bit20:58
thansenSlickNik: I think I'm hitting this for one: https://bugs.launchpad.net/trove/+bug/128910120:59
thansenbut I'm also unclear how much stuff trove actually does on an instance20:59
thansenlike, does it handle mounting the volume for the datastore for example?20:59
thansenor should that be part of cloudinit21:00
thansenalso, all the (mysql) setup doesn't appear to happen for me21:00
thansenie, setting up os_admin user with permissions etc21:00
thansenI see code to do this but I'm not really sure how/what is supposed to kick it off21:01
thansensgotliv: from an RDO perspective, one issue I needed to square away was the systemd startup21:01
thansensgotliv: I needed to add a wants/after mariadb for openstack-trove-{api,conductor,taskmanager} otherwise they failed upon a reboot21:02
thansenthey would start up immediately if I tried them again, but during reboot was a no go21:02
thansensgotliv: also, the bug mentioned above may be affecting some of my issues so RDO may want to get a patch out for that in the repo for Juno21:04
*** annashen has joined #openstack-trove21:07
SlickNikthansen: Trove does handle mounting the volume for the datastore as part of the prepare call (i.e. the first message the trove-guestagent receives once it connects to rabbitmq).21:09
SlickNikthansen: the initial prepare call is also what handles the creation of the os_admin user and securing the mysql database.21:09
thansenSlickNik: so it partitions/formats it and mounts it?21:09
thansenok, so something is pretty messed up for me then21:10
SlickNikthansen: yes — one sec, let me get you a link which might make it clearer.21:10
SlickNikthansen: Do you have the guest agent logs from the trove-guest?21:11
thansenthanks, I did quite a bit of digging21:11
thansennot right this second, but I can get them certainly21:11
SlickNikthansen: https://github.com/openstack/trove/blob/master/trove/guestagent/datastore/mysql/manager.py#L112-15921:12
*** tylerhannan has quit IRC21:12
SlickNikthansen: That's the prepare call that should run on the guest-agent initially when it receives the first message from AMQP21:13
*** exploreshaifali has quit IRC21:15
thansenSlickNik: sec, got someone in my office..21:15
*** bhunter71 has quit IRC21:22
thansenSlickNik: ok, so the proper scope of the cloudinit stuff is to simply get mysql installed?21:24
thansennot started, added to default runlevels, etc?21:24
thansenI'm certain none of that is getting kicked off in my scenario here for some reason21:30
thansenI did find that code and wondered21:31
thansenalso, to answer the earlier question (which makes this all seem very weird) I do get a status of active21:32
*** tylerhannan has joined #openstack-trove21:34
*** bhunter71 has joined #openstack-trove21:37
*** _amrith_ is now known as amrith21:39
*** david-lyle_afk is now known as david-lyle21:40
*** pmackinn has quit IRC21:40
*** annashen has quit IRC21:43
*** annashen has joined #openstack-trove21:43
thansenSlickNik: ok, I'm vpn'd to my home datacenter so I can review any logs if you get time21:47
amrithesmute, will do that this evening21:49
*** pboros has quit IRC21:51
*** sbfox1 has joined #openstack-trove21:52
*** sbfox has quit IRC21:54
openstackgerritAnna Shen proposed openstack/trove: Add limit stanzas for mongos  https://review.openstack.org/15013121:55
openstackgerritPetr Malik proposed openstack/trove: MySQL restore wait for shutdown before killing  https://review.openstack.org/14988222:07
*** radez is now known as radez_g0n322:22
*** sriram_tesora has quit IRC22:24
*** pmalik has joined #openstack-trove22:28
sgotlivthansen, yt?22:28
*** robertmyers has quit IRC22:30
*** Barker has quit IRC22:33
SlickNikthansen: Can you upload the trove-guest log somewhere (or paste/gist it) and send me a link?22:34
thansensgotliv: huh?22:35
thansenSlickNik: yes, give me a moment and I'll respin a brand new instance22:35
thansenSlickNik: as an FYI due (apparently) to the previously mentioned but I get this on the taskmanager: TRACE trove.openstack.common.periodic_task Unauthorized: The request you have made requires authentication. (HTTP 401)22:38
thansens/but/bug22:38
SlickNikthansen: Can you paste / gist me the taskmanager log as well — to look into the other issue.22:40
thansenSlickNik: yeah, I'll capture the whole thing and send it your way22:41
SlickNikthansen: Thanks! Much appreciated.22:41
*** eghobo has joined #openstack-trove22:42
vkmcSlickNik, hey there! :) do you have a moment?22:43
vkmcSlickNik, is it possible to have the same datastore for different distros in Trove?22:44
thansenSlickNik: http://pastebin.com/uxdZSqiE22:45
thansenSlickNik: gonna take me a minute to rebuild the setup actually, forgot I dropped the DB and rebuilt22:45
SlickNikvkmc: Sure thing — not sure I completely understand what you mean by 'same datastore for different distros' completely. Can you explain?22:46
SlickNikvkmc: The first thing that comes to my mind is that the images for the datastores need to be different for different distros.22:47
SlickNikvkmc: But the trove code that runs for the guest-agent can be the same across distros, if that's what you mean.22:47
vkmcSlickNik, sure... for example... I spin off a Ubuntu image with mysql 5.5 and a Fedora image with mysql 5.522:47
vkmcSlickNik, IIRC, you upload those images to Glance and then update the datastore (e.g. mysql 5.5 is this image with image-id)22:48
vkmcSlickNik, so when you do trove create... that image is used22:48
SlickNikYes, you could have both those in the same trove install.22:48
vkmcSlickNik, and how do you differenciate?22:48
SlickNikYou'd probably want to name the datastore appropriately so that customers would have enough information to identify the datastore and the distro22:49
sgotlivSlickNik, thansen let's talk a little bit about thansen's issues22:49
vkmcoic22:49
vkmccool22:49
sgotlivvkmc, join us22:49
SlickNikso for example you'd have "mysql-ubuntu" 5.5, and "mysql-fedora" 5.522:49
SlickNikAnd those can have different images published to glance.22:49
vkmcSlickNik, cool, so... you simply identify the pair distro + storage backend with a name22:50
vkmcSlickNik, makes sense, thanks22:50
vkmcsgotliv, sure22:51
sgotlivSlickNik, why we need "publish_exists_event"?22:51
sgotlivI tried to read a patch but it doesn't provide much info22:52
openstackgerritPetr Malik proposed openstack/trove: MySQL restore wait for shutdown before killing  https://review.openstack.org/14988222:52
sgotlivthansen, in your case it seems like taskmanager is not properly configured22:52
thansenSlickNik: is the owner of the image preferred to be services or admin (no trove tenant on RDO)?22:53
SlickNiksgotliv: It's used for metering. When trove creates (or deletes) an instance, it can be set up to publish metering events to an AMQP exchange (for billing or what you may).22:54
thansensgotliv: I just have what RDO setup basically, but this appears to be the issue: https://bugs.launchpad.net/trove/+bug/128910122:54
SlickNiksgotliv: Similarly, it can be set up to publish "exists" messages to the AMQP exchange in case a creation or deletion message gets missed.22:54
sgotlivthansen, SlickNik I disagree, at least partially22:55
sgotlivI know that bug22:55
* thansen nods22:55
sgotlivI actually really invested in review of the fix22:55
SlickNikthansen / sgotliv: I believe you can turn off these metering messages using a conf setting.22:55
sgotlivexactly22:55
thansenI'm a newbie to openstack really so I'm shooting in the dark22:55
sgotlivSlickNik, thansen the annoying thing about these events is that you have to configure nova url and admin credentials in conf file22:56
sgotlivit barely makes sense22:56
sgotlivI don't want to stick my Trove with particular Nova instance22:56
thansenyes, I do have metering stuff activated in my RDO answers file22:57
sgotlivthansen, I know that you have :-), RDO is our backyard22:57
sgotlivcan I see your taskmanager conf file?22:57
thansenyeah, give me a quick sec..22:58
SlickNikthansen / sgotliv: Set "exists_notification_transformer = None" to turn this off.22:58
SlickNikor simply don't set that in your config file.22:58
sgotlivSlickNik, transformer is another thing that doesn't make sense to me :-)22:58
SlickNik(better to be explicit, imo)22:58
sgotlivit requires nova url to be configured in the conf!22:59
*** thedodd has quit IRC22:59
*** amrith is now known as _amrith_22:59
*** Riddhi has quit IRC23:00
SlickNiksgotliv: Yes, it does — I believe you don't want to charge the customer for their DB instance unless it's up and ACTIVE in nova.23:02
sgotlivSlickNik, agree, but assumption is that Trove works with only one Nova? Is that true?23:03
sgotlivsounds weird to me23:03
vkmcsgotliv, I think that is the case23:03
sgotlivvkmc, this is the case!23:03
SlickNiksgotliv: Yes, currently trove only supports a single nova endpoint for a single trove installation.23:03
vkmcconsidering how is Trove archutecture23:03
vkmcTrove is tighly coupled to Nova23:04
sgotlivSlickNik, vkmc HA is one of the issues on my desk23:04
thansensgotliv: http://pastebin.com/7Kzm9Bqp23:04
vkmcarchitecture*23:04
thansensgotliv: just removed the password and that has nova_proxy_admin_tenant_id added as well23:05
sgotlivthansen, I will review it23:05
SlickNikthansen: change "exists_notification_transformer = trove.extensions.mgmt.instances.models.NovaNotificationTransformer" to "exists_notification_transformer =None" to turn off the metering events.23:05
thansenotherwise it's what packstack generated23:05
sgotlivthansen, do you use master or stable juno?23:05
thansensgotliv: probably stable23:06
sgotlivbecause I don't think we have a Trove support in juno23:06
sgotlivcan you check your yum repos23:06
thansenI'm sure I used the quickstart to pull in the initial rpm for the repo23:06
sgotlivso --allinone installed everything for you?23:06
thansensgotliv: I didn't use allinone, I created an answer file and then hacked it manually23:07
sgotlivthansen, I see :-)23:08
*** flaper87 has joined #openstack-trove23:08
sgotlivthansen, I wonder if "trove list" works for you?23:08
*** newb has quit IRC23:08
sgotlivfrom cmd23:08
thansensgotliv: yeah, that works, but I'm working on getting an image reuploaded etc23:09
thansenCONFIG_TROVE_INSTALL=y23:09
sgotlivthansen, I am missing nova_compute_url in your conf23:10
vkmchttp://pastebin.com/7Kzm9Bqp L69 here should be uncommented23:10
sgotlivfor taskmanager23:10
thansenthat's all I did..it's *not* in an experimental section in my answer file23:10
vkmcwell... uncommented and updated with the actual url23:10
sgotlivvkmc, thanks! you are right23:10
thansensgotliv: which problem is that supposed to resolve for me?23:14
thansenSlickNik: you want me to disable the notification now before testing again?23:16
sgotlivthansen, or configure that url :-)23:16
SlickNikthansen: Yes, depends on whether you want trove to publish metering events or not. :)23:16
sgotlivthansen, that event doesn't work without nova url - a long story23:16
SlickNikthansen: If you don't care about publishing metering events (eg. used for billing), feel free to disable those exists events.23:17
thansenok, let me see if that resolves that issue *before* firing up a new instance23:17
SlickNikIf you _do_ want metering events, then as sgotliv mentions, you need to make sure you point it to a correct nova endpoint URL, and configure it with credentials that let it query that nova endpoint for instance status.23:19
thansenSlickNik: ok, I'm going to let the thing 'tick' down and see what I get at this point23:20
thansenthen we'll step into the other issues23:20
*** pmalik has quit IRC23:20
sgotlivthansen, I am going to sleep, hope to see you back tomorrow with the good news23:20
sgotlivSlickNik, vkmc thanks for the help23:20
*** flaper87 has left #openstack-trove23:21
vkmcsgotliv, thanks for jumping in :)23:21
vkmcthansen, let us know what happens with those changes... I'll be around for a couple more hours23:22
thansensgotliv: thanks for the help23:22
sgotlivthansen, you welcome, ping me or vkmc if you need something23:23
thansenyeah, may want to consider having packstack set that up for people assuming it works23:23
sgotlivthansen, you read my mind :-).23:25
sgotlivI am trying to do the same since yesterday, but then this dependency on particular Nova just caught my eye23:25
sgotlivI can't stop thinking about it, stopped eating and sleeping :-)23:26
thansensgotliv: hah23:28
thansenvkmc: looks like that didn't help23:29
thansensgotliv: so I'll disable that for the time being23:30
thansenerr, SlickNik23:30
thansenthen I can test a new machine coming up23:30
sgotlivthansen, take my advise and configure Nova's url, it will be faster23:31
vkmcthansen, remember to change localhost for the actual endpoint23:31
thansensgotliv: I did23:31
thansenvkmc: yes, I did23:31
vkmchmm23:31
*** david-lyle is now known as david-lyle_afk23:31
thansenhttp://172.29.2.1:8774/v223:31
sgotlivmay I see your config now?23:31
thansensame as it was with just this.. nova_compute_url = http://172.29.2.1:8774/v223:32
sgotlivand where did you do that? which conf file?23:32
vkmctrove-taskmanager23:32
thansenyes23:32
thansenthen restarted service23:33
sgotlivthansen, what is the error?23:34
vkmcthansen, did you add keystone auth details in the conf files?23:34
thansensgotliv: http://pastebin.com/uxdZSqiE23:35
vkmcthansen, http://paste.openstack.org/show/162444/23:35
vkmcthat should be in trove-taskmanager.conf23:36
vkmcwith your credentials23:36
thansenvkmc: that config block isn't in the file23:37
sgotlivthansen, nova_proxy_admin_pass =23:37
thansenyes, I have those23:37
thansenand yes, they are correct23:37
*** IanGovett has quit IRC23:37
vkmcthansen, I know, you have to add it23:39
thansenvkmc: ok, just so I'm clear you want the nova_compute_url in the [DEFAULT] block23:40
thansenthen *create* a new block at the bottom of the file and *add* the content from the pastebin?23:40
vkmcthansen, yeah, the nova_compute_url should correspond to your endpoint... you already have that23:41
vkmcthansen, and the keystone_auth configuration... simply add the block at the bottom of the file23:41
thansenSlickNik: in the meantime the event setting to None is a no go23:42
thansenvkmc: ok, so this is all new, I assume in a standard setup 35357 is the right endpoint?23:44
thansenfor both auth and identity23:44
vkmcthansen, you can make sure simply by listing the endpoints with 'keystone endpoint-list'23:46
vkmcthansen, you need the admin creds to perform that23:46
*** johnma has quit IRC23:50
*** johnma has joined #openstack-trove23:51
thansenvkmc: ok, still failed :(23:51
vkmc:( boo23:52
vkmcthansen, same output?23:52
thansenvkmc: yes23:52
thansenbrb23:52
*** chlong has joined #openstack-trove23:55
*** vigneshvar has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!