Monday, 2015-06-01

*** pmackinn has joined #openstack-trove00:23
*** pmackinn has quit IRC00:26
*** ashleighfarnham has joined #openstack-trove00:41
*** WonChon has joined #openstack-trove00:46
*** WonChon has quit IRC00:47
*** WonChon has joined #openstack-trove00:47
*** pmackinn has joined #openstack-trove00:49
*** WonChon_ has joined #openstack-trove01:02
*** WonChon has quit IRC01:02
*** pmackinn has quit IRC01:05
*** ashleighfarnham has quit IRC01:15
*** tobe has joined #openstack-trove01:30
*** erkules_ has joined #openstack-trove01:42
*** erkules has quit IRC01:44
*** pmackinn has joined #openstack-trove02:07
*** pmackinn has quit IRC02:15
*** Longgeek has joined #openstack-trove02:42
*** Longgeek has quit IRC02:45
*** Longgeek has joined #openstack-trove02:53
*** ashleighfarnham has joined #openstack-trove02:59
*** ashleighfarnham has quit IRC03:34
*** haomaiw__ has joined #openstack-trove03:47
*** haomaiwang has quit IRC03:49
*** sgotliv has joined #openstack-trove03:51
*** haomaiw__ has quit IRC03:59
*** haomaiwang has joined #openstack-trove04:02
*** tobe has quit IRC05:01
*** tobe has joined #openstack-trove05:07
*** ashleighfarnham has joined #openstack-trove05:18
*** tobe has quit IRC05:44
*** ashleighfarnham has quit IRC05:51
openstackgerritMayuri Ganguly proposed openstack/trove: Associate flavor types with datastore versions  https://review.openstack.org/10982406:01
*** tobe has joined #openstack-trove06:03
*** sgotliv has quit IRC06:17
*** Longgeek has quit IRC06:34
*** Longgeek has joined #openstack-trove06:34
*** k4n0 has joined #openstack-trove06:48
*** haomaiw__ has joined #openstack-trove07:24
*** haomaiwang has quit IRC07:27
*** ashleighfarnham has joined #openstack-trove07:36
*** tobe has quit IRC07:37
*** tobe has joined #openstack-trove07:39
*** chlong has quit IRC07:45
*** ashleighfarnham has quit IRC08:09
*** sgotliv has joined #openstack-trove08:12
*** john_f_ has joined #openstack-trove08:16
*** erkules_ is now known as erkules08:20
*** erkules has joined #openstack-trove08:20
*** tobe has quit IRC08:22
*** sgotliv has quit IRC08:22
*** sgotliv has joined #openstack-trove08:22
*** tobe has joined #openstack-trove08:23
*** tosky has joined #openstack-trove08:30
*** sgotliv has quit IRC08:41
*** sgotliv has joined #openstack-trove08:45
*** Longgeek has quit IRC08:50
*** Longgeek has joined #openstack-trove08:56
*** IanGovett has joined #openstack-trove09:23
*** ashleighfarnham has joined #openstack-trove09:54
*** blinky_ghost has joined #openstack-trove10:09
blinky_ghosthi all, can anybody explain me this error: ERROR trove.openstack.common.periodic_task [req-32e54674-83c7-46ae-bd49-bd9ae18cf9e8 admin services - - -] Error during Manager.publish_exists_event: The request you have made requires authentication. (HTTP 401). This happens in taskmanager.log when the instance is building, thanks10:10
vkmcblinky_ghost, you have to make sure you have the right auth params in taskmanager.conf :)10:14
vkmcand auth with that user/tenant combination10:14
blinky_ghostvkmc: nova_proxy_admin_pass/nova_proxy_admin_tenant_name?10:15
vkmcblinky_ghost, yes, and _user10:15
*** openstackstatus has quit IRC10:20
*** openstack has quit IRC10:20
*** openstack has joined #openstack-trove10:25
*** openstackstatus has joined #openstack-trove10:26
*** ChanServ sets mode: +v openstackstatus10:26
*** ashleighfarnham has quit IRC10:26
blinky_ghostvkmc: so I put the back the user that was before: nova_proxy_admin_user = admin, and it advanced that part but eventually I will hit the 401 error10:31
vkmcblinky_ghost, are you identified as an admin?10:36
vkmcyou have to source keystone_admin file10:37
vkmcif you are doing that10:37
blinky_ghostvkmc I'm doing it from horizon10:38
vkmcblinky_ghost, which user and tenant are you logged on with?10:38
blinky_ghostvkmc: on horizon I'm using  admin10:39
vkmcblinky_ghost, which tenant?10:39
blinky_ghostvkmc: can you check the logs? http://paste.openstack.org/show/252479/10:39
blinky_ghostvkmc: admin also10:39
vkmcsure10:39
vkmcblinky_ghost, have you restarted openstack-trove-taskmanager service when you made the changes to the conf file?10:40
vkmcnow, that's a different issue10:40
vkmcdid you try launching an instance and testing the connectivity?10:40
blinky_ghostvkmc: yes I restarted everything10:41
*** georgelorch2 has joined #openstack-trove10:41
blinky_ghostvkmc: can I show you my conf files? to see if something's wrong?10:42
vkmcblinky_ghost, sure10:42
vkmcblinky_ghost, but I'd like you to try launching a nova instance and pinging to the controller10:42
vkmcas well10:42
blinky_ghostvkmc: Ok, a sec10:42
vkmcsure10:42
*** amrith has quit IRC10:42
*** amrith has joined #openstack-trove10:42
blinky_ghostvkmc: trove.conf http://paste.openstack.org/show/252484/10:43
*** georgelorch has quit IRC10:43
blinky_ghostvkmc: trove-conductor.conf http://paste.openstack.org/show/252485/10:44
blinky_ghostvkmc: trove-taskmanager.conf         http://paste.openstack.org/show/252489/10:46
blinky_ghostvkmc: I can the controller10:53
blinky_ghostreach*10:53
vkmcblinky_ghost, conf files look fine10:54
vkmcblinky_ghost, it must be something with the image you used to launch the instance10:55
vkmcblinky_ghost, you created your own image, someone provide it to you...?10:55
blinky_ghostvkmc: Yes I think so, because I created the image using this info https://openstack.redhat.com/forum/discussion/1010/creation-of-trove-compatible-images-for-rdo/p1 and there's seems to be a bug10:55
vkmcblinky_ghost, k k, that's my script so I can help you there10:56
blinky_ghosttrove-guest is not starting because of systemd https://bugzilla.redhat.com/show_bug.cgi?id=121906910:56
openstackbugzilla.redhat.com bug 1219069 in distribution "trove-guestagent systemd unit file uses incorrect path for guest_info" [Unspecified,Assigned] - Assigned to vimartin10:56
vkmcblinky_ghost, which distro and datastore combination did you use?10:56
blinky_ghostcentos7 mysql10:56
blinky_ghostmysql5.510:57
vkmcI see, good10:57
vkmcok, so there is a bug there and I'm working on a fix for it10:57
vkmcin the meantime I can provide you with a working image10:57
blinky_ghostvkmc: OK, thanks.10:59
vkmcblinky_ghost, cool, give me a min10:59
blinky_ghostvkmc: ok sure, something I don't understand is that when you create the image using your script, you'll get a default conf like rabbit_host=10.0.0.1, how do I force to use the correct ip? Cloud.init?11:04
vkmcblinky_ghost, no, that is handled by trove-taskmanager when the image is launched11:05
vkmcblinky_ghost, that information is retrieved for the controller and injected on the host11:05
blinky_ghostvkmc: I'm looking into the VM that was launched when I tried to deploy the DB. It has rabbit_host=10.0.0.1, does this means that the controller wasn't able to configure the guest correctly?11:07
vkmcblinky_ghost, for some reason its taking the private network within packstack11:08
vkmcblinky_ghost, I hit that one before as well11:09
blinky_ghostok thanks11:09
*** pmackinn has joined #openstack-trove11:24
*** tobe has quit IRC11:25
*** pmackinn has quit IRC11:59
*** pmackinn has joined #openstack-trove12:01
*** ashleighfarnham has joined #openstack-trove12:12
*** IanGovett1 has joined #openstack-trove12:39
*** freyes has joined #openstack-trove12:40
*** IanGovett has quit IRC12:41
*** ashleighfarnham has quit IRC12:45
*** chlong has joined #openstack-trove12:49
*** bhunter71 has joined #openstack-trove12:50
*** pmackinn has quit IRC12:56
*** sgotliv_ has joined #openstack-trove12:59
*** sgotliv has quit IRC13:00
*** pmackinn has joined #openstack-trove13:02
*** tosky_ has quit IRC13:03
*** pmackinn_ has joined #openstack-trove13:05
*** pmackinn has quit IRC13:07
*** radez_g0n3 is now known as radez13:18
*** amrith is now known as _amrith_13:32
*** bhunter71 has quit IRC13:36
*** dhellmann has left #openstack-trove13:44
*** blinky_ghost_ has joined #openstack-trove13:51
*** blinky_ghost has quit IRC13:51
blinky_ghost_vkmc: do you think I'll can test today your updated script?13:51
*** bhunter71 has joined #openstack-trove13:52
*** csoukup has joined #openstack-trove14:05
*** ashleighfarnham has joined #openstack-trove14:29
*** johnma has joined #openstack-trove14:30
openstackgerritMatthew Van Dijk proposed openstack/trove-integration: redstack failing if /opt/stack is deleted  https://review.openstack.org/18681614:32
*** tomblank has joined #openstack-trove14:35
*** _amrith_ is now known as amrith14:43
*** radez is now known as radez_g0n314:47
*** ashleighfarnham has quit IRC14:50
*** radez_g0n3 is now known as radez14:51
*** cp16net has joined #openstack-trove15:02
cp16netwhat up yall15:06
*** georgelorch2 is now known as georgelorch15:07
openstackgerritMatthew Van Dijk proposed openstack/trove-integration: redstack failing if /opt/stack is deleted  https://review.openstack.org/18681615:13
*** david-ly_ is now known as david-lyle15:21
blinky_ghost_hi can anybody explain me what this error means: "InstanceServiceStatus Not Found"? Does it mean it could reach guest_info?15:29
blinky_ghost_*couldn't15:29
*** johnma has quit IRC15:32
cp16netblinky_ghost_: i havnt seen that in a while but it sounds like that might mean that there is no servicestatus record in the db for the instance15:37
blinky_ghost_cp16net: and what could be the cause? trove guest starts on my vm, I can reach rabbit, it just stays "build" on my controller until time out15:39
cp16netblinky_ghost_: can the guest get to rabbit?15:40
blinky_ghost_cp16net: yes15:41
cp16netif you look at the guest logs?15:41
cp16netso it gets the prepare message and preps the instance15:41
cp16netwithout errors?15:41
blinky_ghost_cp16net: let me check the logs on the VM, it doesn't have debug turned on.15:42
cp16neti'd expect an error in the guest logs some where or in conductor then15:42
*** ashleighfarnham has joined #openstack-trove15:43
blinky_ghost_cp16net in the guest I see this: 015-06-01 15:46:52.792 1763 DEBUG oslo_messaging._drivers.amqp [-] Pool creating new connection create /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqp.py:9215:47
blinky_ghost_2015-06-01 15:46:52.809 1763 INFO oslo_messaging._drivers.impl_rabbit [-] Connecting to AMQP server on 192.168.1.176:567215:47
blinky_ghost_it seems OK in the guest15:47
cp16netyeah15:47
*** amrith is now known as _amrith_15:47
blinky_ghost_cp16net: Connected to AMQP server on 192.168.1.176:567215:47
blinky_ghost_cp16net: in the taskmanager 015-06-01 15:27:23.394 24023 TRACE trove.taskmanager.models     raise e15:48
blinky_ghost_2015-06-01 15:27:23.394 24023 TRACE trove.taskmanager.models Unauthorized: Unauthorized (HTTP 401) (Request-ID: req-02af59a4-8e66-4771-b505-85bc53976fb1)15:48
blinky_ghost_cp16net: in the conductor, 2015-06-01 15:48:52.874 24303 TRACE oslo_messaging.rpc.dispatcher ModelNotFoundError: InstanceServiceStatus Not Found15:49
blinky_ghost_2015-06-01 15:48:52.874 24303 TRACE oslo_messaging.rpc.dispatcher15:49
cp16netso it could be an error sending the prepare message to the guest15:50
cp16neti'd say try again and see if the same thing happens again15:51
cp16netsorry i'm not much help at the moment15:51
blinky_ghost_cp16net I've tried so many times :) been struggling 3 days with this, thanks anyway15:52
cp16neti just havnt seen that sort of error in a long time15:52
cp16net:-P15:52
blinky_ghost_cp16net: it seems I've not the only one: https://ask.openstack.org/en/question/52637/trove-instance-stuck-on-build-status/15:53
cp16neti need to fire up a fresh setup sometime soon to get back aquainted with things15:53
cp16netwell the problem is that there are about 50 different reasons an instance can get stuck in build15:53
cp16netfigure out which one is all the fun :-p15:54
*** sriram_tesora has joined #openstack-trove15:56
*** ashleighfarnham has quit IRC15:58
*** ashleighfarnham has joined #openstack-trove16:00
*** Longgeek has quit IRC16:02
*** Longgeek has joined #openstack-trove16:02
*** cp16net has quit IRC16:05
*** johnma has joined #openstack-trove16:08
*** cp16net has joined #openstack-trove16:08
*** ashleighfarnham has quit IRC16:08
*** _amrith_ is now known as amrith16:09
*** shayneburgess has joined #openstack-trove16:13
blinky_ghost_cp16net should the file guest_info be injected from the controller on the VM? How does that work?16:17
cp16netyeah that should be injected on boot of the instance16:17
blinky_ghost_cp16net with the ID from nova, right?16:18
cp16netit happens with the nova boot16:18
cp16netno it should be the instance id from trove16:18
cp16netits how the guest knows what instance it is16:18
blinky_ghost_cp16net ok so I think that's the issue because I don't see that file being changed16:18
blinky_ghost_on the guest16:18
cp16netto communicate back to conductor16:18
*** ashleighfarnham has joined #openstack-trove16:19
blinky_ghost_cp16net so that file is empty, is not being changed, what do I have to change to that happen?16:20
cp16netso i think its using a template from etc/trove/conf.d/guest_info.conf16:22
blinky_ghost_cp16net on the guest or in the controller?16:23
*** ashleighfarnham has quit IRC16:23
cp16nethappens in the controllr16:24
cp16netso on the host16:24
blinky_ghost_cp16net: OK, I see it the guest and that file is being filled with correct ID16:24
blinky_ghost_cp16net: on the controller it doesn't exist16:24
cp16nethttps://github.com/openstack/trove/blob/master/trove/taskmanager/models.py#L315-32016:27
cp16netthats what the file should look like16:27
blinky_ghost_cp16net I see that file on the guest but not in the controller16:29
*** ashleighfarnham has joined #openstack-trove16:29
cp16netok look slike its creates it16:30
blinky_ghost_cp16net I have this on my conf16:33
blinky_ghost_guest_config = /etc/trove/trove-guestagent.conf16:33
blinky_ghost_guest_info = /etc/trove/guest_info16:33
blinky_ghost_injected_config_location = /etc/trove/conf.d16:33
blinky_ghost_cloudinit_location = /etc/trove/cloudinit16:33
cp16netthose look fine16:34
blinky_ghost_cp16net but should I have conf.d/guest_info.conf on my controller also?16:38
cp16netno doesnt look like it matters16:39
cp16netit generates the file to be injected16:39
vkmcblinky_ghost_, you have to change injected_config_location to /etc/trove16:41
vkmcand put all that section in [DEFAULT]16:41
*** sriram_ has joined #openstack-trove16:41
blinky_ghost_vkmc ok let me try16:42
vkmcblinky_ghost_, I'm creating the image for you, I'm making sure its working as expected16:42
blinky_ghost_vkmc ok thanks :)16:42
cp16netvkmc: so the guest doesnt use the conf.d path it sounds like?16:43
vkmccp16net, not in RHEL-based distros16:44
vkmccp16net, right now that is a bug for Fedora/CentOS, the guestagent is fixing those locations there16:44
*** sriram_tesora has quit IRC16:45
cp16nethmm.. ok that makes sense. i've been using debian for so long i forgot about other distros :-P16:45
*** tomblank has quit IRC16:48
*** cweid has joined #openstack-trove16:50
*** tomblank has joined #openstack-trove16:52
*** sgotliv_ has quit IRC17:04
*** radez is now known as radez_g0n317:16
*** shayneburgess has quit IRC17:25
*** shayneburgess has joined #openstack-trove17:25
*** shayneburgess has quit IRC17:26
*** shayneburgess has joined #openstack-trove17:38
*** shayneburgess has quit IRC17:40
*** shayneburgess has joined #openstack-trove17:40
*** tomblank has quit IRC17:45
*** cweid has quit IRC17:46
*** tomblank has joined #openstack-trove17:46
*** johnma has quit IRC17:55
*** cweid has joined #openstack-trove18:08
*** johnma has joined #openstack-trove18:10
*** IanGovett1 has quit IRC18:14
*** radez_g0n3 is now known as radez18:24
*** johnma has quit IRC18:25
amrithcp16net, cp16net ... i remember that name. from long long ago ;)18:37
amrithhowdy mate!18:37
amrithgood to hear from you again18:37
cp16netamrith: amrith i recall that name as well :-P18:38
cp16nethowdy howdy18:38
amrithI think we met in an airport or something ;)18:39
amrithor maybe it was some pub somewhere.18:39
amrithnice to meet you again my dear sir18:39
cp16netprobably a pub :-P18:44
*** blinky_ghost_ has quit IRC18:54
*** cweid has quit IRC19:05
*** cweid has joined #openstack-trove19:32
*** tomblank has quit IRC19:44
*** tomblank has joined #openstack-trove19:46
*** radez is now known as radez_g0n319:47
*** Longgeek has quit IRC19:50
*** tomblank_ has joined #openstack-trove20:02
*** tomblank has quit IRC20:05
*** tomblank_ is now known as tomblank20:05
*** amrith is now known as _amrith_20:07
*** shayneburgess has quit IRC20:21
*** johnma has joined #openstack-trove20:32
*** shayneburgess has joined #openstack-trove20:35
*** radez_g0n3 is now known as radez20:35
*** danritchie has joined #openstack-trove20:47
*** mattgriffin has joined #openstack-trove20:54
*** tomblank has quit IRC21:04
*** shayneburgess has quit IRC21:06
*** crobertsrh is now known as _crobertsrh21:07
*** vkmc has quit IRC21:08
*** mattgriffin has quit IRC21:08
*** vkmc has joined #openstack-trove21:12
*** mattgriffin has joined #openstack-trove21:27
*** vkmc_ has joined #openstack-trove21:40
*** jaredrohe has joined #openstack-trove22:04
*** jaredrohe has quit IRC22:05
*** sriram_ has quit IRC22:06
*** openstackgerrit has quit IRC22:07
*** openstackgerrit has joined #openstack-trove22:07
*** PeterSchwaller has quit IRC22:11
*** tosky_ has joined #openstack-trove22:16
*** chlong has quit IRC22:18
*** openstackgerrit has quit IRC22:51
*** openstackgerrit has joined #openstack-trove22:51
*** csoukup has quit IRC22:52
*** csoukup has joined #openstack-trove23:09
*** tosky_ has quit IRC23:13
*** csoukup has quit IRC23:14
*** vkmc has quit IRC23:18
*** vkmc_ is now known as vkmc23:18
*** mattgriffin has quit IRC23:18
openstackgerritMerged openstack/trove: Fixes hacking rules  https://review.openstack.org/18460623:29
*** chlong has joined #openstack-trove23:41
*** ashleighfarnham has quit IRC23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!