| *** gregragenet has joined #openstack-trove | 00:49 | |
| thetrav | hmm | 00:50 |
|---|---|---|
| thetrav | so from debugging it appears that something in trove-taskmanager appends /v2.0 to the trove_auth_url conf element | 00:51 |
| gregragenet | for posterity... you'll also get 'DB server is not installed' if guest_id is not set in the trove config for a guestagent... | 00:52 |
| thetrav | argl | 00:54 |
| thetrav | yeah so this thing is broken and hard | 00:54 |
| thetrav | specifying the service endpoints directly is getting me 401's | 00:54 |
| thetrav | specifying the service types is getting me "empty catalog" | 00:55 |
| thetrav | is there a known right way of doing it? or any docs on how I'm supposed to set it up / debug it? | 00:58 |
| thetrav | when I'm specifying endpoints should I be specifying public, internal or admin? | 00:59 |
| openstackgerrit | Merged openstack/python-troveclient: Updated from global requirements https://review.openstack.org/348685 | 00:59 |
| openstackgerrit | Merged openstack/trove: Updated from global requirements https://review.openstack.org/348696 | 01:01 |
| thetrav | trove/taskmanager/manager.py", line 407, in publish_exists_event | 01:01 |
| gregragenet | which brings me to my question; what are the functional ways that guest_id gets injected into the guest? I've gotten far enough along with cloud-init that I have everything working except I can't figure out how guest_id gets injected. is it available somewhere via the 169.254.169.254 metadata address? | 01:02 |
| gregragenet | btw, I couldn't figure out if the keystone v3 was part of my problems getting trove to work, so I enabled v2 on my keystone server. dono if that's a possibility for you or not. | 01:04 |
| *** imandhan has quit IRC | 01:08 | |
| *** imandhan has joined #openstack-trove | 01:08 | |
| *** imandhan has quit IRC | 01:12 | |
| *** gouthamr has joined #openstack-trove | 01:19 | |
| *** thetrav has quit IRC | 01:23 | |
| *** thetrav_ has joined #openstack-trove | 01:24 | |
| thetrav_ | v2 is enabled on my server | 01:24 |
| *** thetrav_ is now known as thetrav | 01:25 | |
| thetrav | gregragenet: so you're trying to install trove into your own openstack deployment? | 01:26 |
| gregragenet | yes. | 01:26 |
| thetrav | I'm running mitaka on ubuntu's packaging (not juju) | 01:26 |
| thetrav | my guest is the mongodb image from: http://tarballs.openstack.org/trove/images/ubuntu/ | 01:27 |
| thetrav | did you use one of those images? or have you created your own? | 01:28 |
| thetrav | I have two threads I'm currently pursuing. First is whether i can get ssh into that image | 01:28 |
| thetrav | second is the stack trace around Manager.publish_exists_event | 01:29 |
| gregragenet | so I'm >this< close to having working guest images via cloud-init. I'm just using the off-the-shelf Ubuntu Trusty cloud-image, and I have cloud-init install mitaka guestagent and mysql-server. Everything works except getting the guest_id passed in. when I login and put it in the config the DB goes available in trove. | 01:30 |
| thetrav | are you following a doc? or have you just sort of, worked it out? | 01:34 |
| thetrav | if you're following a doc I'll try to go through the same process | 01:37 |
| thetrav | then we can have two eyes looking at it | 01:37 |
| thetrav | I assume if you look at your log for trove-taskmanager you don't have regular Authentication errors? | 01:37 |
| *** gouthamr has quit IRC | 01:41 | |
| gregragenet | so, the things I beat my head against for the last week to get this far - enable v2 auth in keystone by setting default_domain_id to the *TENANT* id for 'default'.. | 01:42 |
| *** tqtran_ has quit IRC | 01:42 | |
| *** gouthamr has joined #openstack-trove | 01:42 | |
| gregragenet | removed 'notification_transformer' from trove configs, as it just generates false positive errors | 01:42 |
| gregragenet | stopped trying to get the trove webui to launch instances, and instead did command-line | 01:43 |
| thetrav | ok, that notification_transformer thing appears to be what my problem is | 01:44 |
| gregragenet | tried/failed to create images from scratch; tried/failed to modify & upload an existing image; finally settled on using cloudinit with a vanilla image. | 01:44 |
| thetrav | when you say "using cloudinit with a vanilla image" | 01:45 |
| thetrav | you mean what they say for "Guest Agent Code Installed at Run Time" ? | 01:45 |
| thetrav | I assume you're not working on devstack/redstack/something like that? | 01:46 |
| gregragenet | changed network_label_regex to .* cause I'm using neutron. not sure if it had any effect | 01:46 |
| thetrav | that definantely has an impact, however I think it's more for the case where you want your openstack user to select the network | 01:46 |
| thetrav | I'm just using the default network so all users share it | 01:46 |
| gregragenet | yeah, so I just use the ubuntu-14-4 image, cause that's what it looks like is most tested, and stick this into /etc/trove/cloudinit/mysql.cloudinit https://gist.github.com/gregretkowski/eb3f14a11113bc332421e6438f799e05 | 01:51 |
| thetrav | cheers! | 01:52 |
| thetrav | umm... | 01:52 |
| thetrav | so hang on | 01:52 |
| thetrav | you stick that in when you start the image? | 01:52 |
| * thetrav hasn't built an image for openstack before | 01:53 | |
| gregragenet | trove sticks it in when a user does 'trove create' | 01:53 |
| thetrav | ok, so there's a way to pass cloudinit config to trove | 01:54 |
| gregragenet | the image is just the ubuntu 14.04 cloud image. https://cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img | 01:54 |
| gregragenet | the config key 'cloudinit_location' defines what dir that file goes in. the format is {{datastore_name}}.cloudinit | 01:55 |
| gregragenet | i.e. /etc/trove/cloudinit/mysql.cloudinit | 01:55 |
| openstackgerrit | Masaki Matsushita proposed openstack/python-troveclient: Add vCPUs to flavor-list https://review.openstack.org/337533 | 01:58 |
| *** thetrav has quit IRC | 02:09 | |
| gregragenet | well I'm good - I wrote a change to taskmanager to template out values for guest_id, tenant_id and datastore_manager in cloudconfig's - allowing trove to use generic images and a basic cloudinit to create working guests; w/o needing Heat or configdrive. If someone can shepherd my change through the openstack change process hit me up and I'll send you what I have. | 02:30 |
| gregragenet | I finally got trove db's launching :) | 02:30 |
| *** dkehn_ has quit IRC | 02:31 | |
| *** dkehn has quit IRC | 02:32 | |
| *** gregragenet has left #openstack-trove | 02:33 | |
| *** dkehn has joined #openstack-trove | 02:39 | |
| *** thetrav has joined #openstack-trove | 02:42 | |
| *** dkehn_ has joined #openstack-trove | 02:43 | |
| *** thetrav has quit IRC | 02:48 | |
| *** gouthamr has quit IRC | 02:51 | |
| *** itlinux has quit IRC | 02:54 | |
| *** itlinux has joined #openstack-trove | 02:56 | |
| *** khushbu_ has joined #openstack-trove | 03:32 | |
| *** links has joined #openstack-trove | 04:28 | |
| *** tqtran has joined #openstack-trove | 04:42 | |
| *** tqtran has quit IRC | 04:46 | |
| *** thetrav has joined #openstack-trove | 04:50 | |
| openstackgerrit | Masaki Matsushita proposed openstack/trove: Introduce "icmp" option for security group rule https://review.openstack.org/214056 | 04:59 |
| *** jraju has joined #openstack-trove | 05:04 | |
| *** imandhan has joined #openstack-trove | 05:04 | |
| *** links has quit IRC | 05:06 | |
| *** rcernin has joined #openstack-trove | 05:16 | |
| *** khushbu_ has quit IRC | 05:27 | |
| openstackgerrit | zhangyanxian proposed openstack/trove: Update the home-page info with the developer documentation https://review.openstack.org/351001 | 06:09 |
| openstackgerrit | zhangyanxian proposed openstack/trove: Update the home-page info with the developer documentation https://review.openstack.org/351001 | 06:09 |
| *** itisha has quit IRC | 06:10 | |
| *** pcaruana has joined #openstack-trove | 06:10 | |
| *** Ravikiran_K has joined #openstack-trove | 06:12 | |
| *** mfisch has quit IRC | 06:29 | |
| *** mfisch has joined #openstack-trove | 06:34 | |
| *** mfisch has quit IRC | 06:34 | |
| *** mfisch has joined #openstack-trove | 06:34 | |
| *** tqtran has joined #openstack-trove | 06:42 | |
| *** tqtran has quit IRC | 06:47 | |
| *** tesseract- has joined #openstack-trove | 06:53 | |
| *** openstackgerrit has quit IRC | 07:33 | |
| *** openstackgerrit has joined #openstack-trove | 07:33 | |
| *** imandhan has quit IRC | 08:04 | |
| *** tqtran has joined #openstack-trove | 08:44 | |
| *** tqtran has quit IRC | 08:49 | |
| *** thetrav has quit IRC | 08:51 | |
| *** ubuntu_ has joined #openstack-trove | 08:54 | |
| *** spilla has quit IRC | 09:28 | |
| *** ubuntu_ has quit IRC | 09:43 | |
| *** songjian has joined #openstack-trove | 09:43 | |
| *** spilla has joined #openstack-trove | 10:01 | |
| *** chlong has quit IRC | 10:28 | |
| *** tosky has joined #openstack-trove | 10:31 | |
| *** chlong has joined #openstack-trove | 10:41 | |
| *** Ravikiran_K has quit IRC | 11:04 | |
| *** chlong has quit IRC | 11:27 | |
| *** chlong has joined #openstack-trove | 11:27 | |
| *** gouthamr has joined #openstack-trove | 12:01 | |
| *** pmackinn has joined #openstack-trove | 12:19 | |
| *** tqtran has joined #openstack-trove | 12:45 | |
| *** tqtran has quit IRC | 12:50 | |
| *** songjian has quit IRC | 13:01 | |
| *** jraju has quit IRC | 13:46 | |
| *** cdelatte has joined #openstack-trove | 13:51 | |
| *** cleong has joined #openstack-trove | 14:31 | |
| *** catintheroof has joined #openstack-trove | 14:32 | |
| openstackgerrit | Samuel Pilla proposed openstack/trove: Refactor test_dbaas.py https://review.openstack.org/349713 | 14:32 |
| *** rcernin has quit IRC | 15:09 | |
| *** catintheroof has quit IRC | 15:25 | |
| *** johnma has quit IRC | 15:43 | |
| *** kro_focused is now known as krotscheck | 16:32 | |
| *** tqtran has joined #openstack-trove | 16:47 | |
| *** itisha has joined #openstack-trove | 16:51 | |
| *** tqtran has quit IRC | 16:51 | |
| *** david-lyle has quit IRC | 16:53 | |
| *** david-lyle has joined #openstack-trove | 16:53 | |
| *** tosky has quit IRC | 16:55 | |
| *** flaper87 has quit IRC | 17:03 | |
| *** gregragenet has joined #openstack-trove | 17:31 | |
| *** arist has quit IRC | 17:45 | |
| *** arist has joined #openstack-trove | 17:45 | |
| *** tesseract- has quit IRC | 17:53 | |
| *** tqtran has joined #openstack-trove | 18:17 | |
| *** miqui has joined #openstack-trove | 19:04 | |
| *** imandhan has joined #openstack-trove | 19:04 | |
| *** fifieldt has quit IRC | 19:07 | |
| *** fifieldt has joined #openstack-trove | 19:18 | |
| openstackgerrit | Shaik Apsar proposed openstack/trove: Fix for 'Client' object has no attribute 'tenants' https://review.openstack.org/340022 | 19:18 |
| *** ShaikApsar has joined #openstack-trove | 19:39 | |
| openstackgerrit | Greg Retkowski proposed openstack/trove: cloudconfig templates - support guest_id injection https://review.openstack.org/351364 | 19:51 |
| *** trevormc has joined #openstack-trove | 20:02 | |
| *** ShaikApsar has quit IRC | 20:12 | |
| *** catintheroof has joined #openstack-trove | 20:30 | |
| *** peter-os has joined #openstack-trove | 21:04 | |
| *** trevormc has quit IRC | 21:11 | |
| *** mariusv has quit IRC | 21:16 | |
| *** mariusv has joined #openstack-trove | 21:18 | |
| *** mariusv has quit IRC | 21:18 | |
| *** mariusv has joined #openstack-trove | 21:18 | |
| *** cdelatte has quit IRC | 21:41 | |
| *** cleong has quit IRC | 21:46 | |
| peter-os | Is anyone using trove guests with centos 7 and mysql 5.7? Mine seem to have a lot of trouble initializing. | 21:47 |
| gregragenet | Do you get 'DB server is not installed' ? | 21:50 |
| peter-os | No, the guestagent is doing a few things and then when it tries to start mysqld it won't start because "--initialize was used and the data dir is not empty." | 21:53 |
| gregragenet | Ah ok. I'm curious, what mechanism are you using to get the guest_info / guest_id onto the instance? the docs are lacking in this area. | 21:54 |
| peter-os | Yes, they are. /cry I've been poking at this thing for days. | 21:55 |
| gregragenet | and.. I elected to use ubuntu-14-04 for my guest instances, as that's what it looks like gets the most thorough testing for trove guestagents. | 21:56 |
| peter-os | But, for what it's worth, I'm using OpenStack Mitaka and trove seems to be droping those files in place automatically. | 21:56 |
| peter-os | Though I had to make some changes to the systemd service file for guestagent | 21:56 |
| peter-os | Eg: According to trove-taskmanager.conf the default location for those files is now /etc/trove/conf.d/, but the service file created by the rpm still looks for them in /etc/trove/ | 21:58 |
| gregragenet | the source of my 'DB server is not installed' is that the guest_id was not injected into the guestagent VM.. for you that works? I'm on Mitaka/EL7, and guest_id didn't appear to get injected on my system. do the files get injected straight into /etc/trove for you? you have any special nova config that facilitates file injection? | 21:58 |
| peter-os | yeah, I was having that problem until I discovered they were there, just not in the "right" place. | 21:59 |
| peter-os | Were you able to confirm they are not actually on the guest system anywhere? It could be that they are just somewhere else. | 21:59 |
| peter-os | I've been trying to get this going for so long. I'm very close, I think. | 22:01 |
| gregragenet | i'm gonna grep through the system for them now. | 22:01 |
| *** miqui has quit IRC | 22:03 | |
| peter-os | If I have anything special in nova for insertion, I don't remember doing it specifically. | 22:04 |
| peter-os | I'm pretty new to OpenStack. I installed it via RDO packstack. | 22:04 |
| *** gouthamr has quit IRC | 22:05 | |
| *** gouthamr has joined #openstack-trove | 22:05 | |
| gregragenet | the only occurrence I have of guest_id in /etc is the one I put there. | 22:06 |
| peter-os | Do you have cloud-init installed on the guest? | 22:09 |
| peter-os | That's the only thing I can think of that could be doing it. | 22:10 |
| gregragenet | yes, I do. and ultimately I make a change to the cloudinit code in trove to inject the guest_id based on templated variables in a cloudinit file. https://review.openstack.org/351364 | 22:11 |
| peter-os | Interesting. I wish I knew how those files were getting there, but I'm getting guest-info.conf and trove-guestagent.conf straight from the controller. It's nice. | 22:13 |
| gregragenet | I couldn't figure it out, and I looked all over and can't find any documentation on how it happens - so I opened a bug to get it documented. https://bugs.launchpad.net/trove/+bug/1609915 - and hopefully get the misleading 'DB server is not installed' error message changed when its the guest_id missing causing the failure. | 22:15 |
| openstack | Launchpad bug 1609915 in OpenStack DBaaS (Trove) "guest_id injection in guest is undocumented" [Undecided,New] | 22:15 |
| gregragenet | I think Heat and ConfigDrive can place files - but it isn't clear to me that they'd place them in /etc . Also nova could do file injection via libvirt, but reading through nova docs that method is deprecated. | 22:18 |
| peter-os | yeah, there seems to be a lot of undocument "features" with trove so far. If I can get it figured out I hope to help some with new docs. | 22:19 |
| peter-os | I am using libvirt, so maybe that's it. | 22:19 |
| peter-os | There's even a config setting in trove-taskmanager.conf where to drop the files. | 22:20 |
| gregragenet | It also seems really terrible to me how painful it is to create a guestagent image. It seems like doing it via cloudinit and an off-the-shelf image will make it much easier for people to deploy trove. | 22:22 |
| peter-os | I agree. The standard way seems to be to use disk image builder, but from what I can see that supports only fedora and ubuntu. | 22:24 |
| gregragenet | yes.. but I don't think the average person deploying should have to have a full blown openstack development environment to deploy trove. | 22:25 |
| gregragenet | For Sahara, which has a similar requirement for guest images, there's a set of downloadable guest images available - which people can download and use in their deployments. | 22:27 |
| gregragenet | rather than having every end-user build the images from scratch. | 22:27 |
| gregragenet | And I imagine there's some valid reasons why to not provide images directly for Trove.. But there must be some middle-ground method for end-users to deploy trove w/o needing a full-on developer's environment. | 22:28 |
| peter-os | From what I've seen so far, it's theoretically possible to create trove images from nova instance snapshots, you just have to have the trove-guestagent installed and a repo setup for the DB in question. The guestagent should do the rest for you. | 22:30 |
| peter-os | But it my case, it seems to need some tweaking to handle el7 and mysql 5.7 properly | 22:30 |
| peter-os | But it's close. | 22:30 |
| gregragenet | yes - but that method isn't in the mainline documentation. | 22:32 |
| peter-os | Right. | 22:33 |
| peter-os | Well, I must go, but thanks for responding. :) This is the most communication I've seen on this channel in several days. | 22:35 |
| *** peter-os has left #openstack-trove | 22:35 | |
| *** gregragenet has quit IRC | 22:41 | |
| *** catintheroof has quit IRC | 23:13 | |
| *** catintheroof has joined #openstack-trove | 23:46 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!