*** mattgriffin has quit IRC | 00:01 | |
*** X019 has quit IRC | 00:14 | |
*** X019_ has joined #openstack-trove | 00:28 | |
*** david-lyle is now known as david-lyle_afk | 00:59 | |
jodah | Are stacktraces from agent failures intended to show up on the CLI? Seems inappropriate | 01:08 |
---|---|---|
dougshelley66 | jodah, I would agree - can you provide some more details? | 01:18 |
jodah | yea, here's an example: | 01:20 |
jodah | (openstack)aurora:venvs jonathan$ trove root-enable 6daab9a5-4484-4a42-9cca-478bf8682e07 | 01:20 |
jodah | ERROR: An error occurred communicating with the guest: not enough arguments for format string | 01:20 |
jodah | Traceback (most recent call last): | 01:20 |
jodah | File "/home/ubuntu/trove/trove/openstack/common/rpc/amqp.py", line 440, in _process_data | 01:20 |
jodah | **args) | 01:20 |
jodah | File "/home/ubuntu/trove/trove/openstack/common/rpc/dispatcher.py", line 172, in dispatch | 01:20 |
jodah | result = getattr(proxyobj, method)(ctxt, **kwargs) | 01:20 |
jodah | i'm not sure if there are certain agent calls that result in stacktraces printing out on the CLI | 01:20 |
jodah | i mean, could potentially | 01:21 |
jodah | ideally the CLI should print an error code which could be correlated to an entry in a log, similar to how API errors are handled | 01:21 |
dougshelley66 | I agree but would need to investigate to understand why this is happening | 01:23 |
dougshelley66 | jodah, btw, in this specific case, what type of datastore is it | 01:24 |
jodah | i'm wondering if any of the guestagent code that raises RuntimeError could result in the error being sent back across the wire and printed | 01:25 |
jodah | at least the guest agent "service" calls | 01:25 |
*** annashen_ has joined #openstack-trove | 01:33 | |
*** annashen_ has quit IRC | 01:38 | |
*** chlong has quit IRC | 01:40 | |
*** annashen has quit IRC | 01:40 | |
*** chlong has joined #openstack-trove | 01:41 | |
*** annashen has joined #openstack-trove | 01:42 | |
*** IanGovett has quit IRC | 01:51 | |
*** pmalik has quit IRC | 01:54 | |
*** amcrn has quit IRC | 01:54 | |
*** annashen has quit IRC | 01:55 | |
*** ramishra_ has joined #openstack-trove | 02:03 | |
*** erkules_ has joined #openstack-trove | 02:25 | |
*** ramishra_ has quit IRC | 02:26 | |
*** erkules has quit IRC | 02:28 | |
*** ramishra_ has joined #openstack-trove | 02:34 | |
*** pmackinn has quit IRC | 02:42 | |
*** robertmyers has joined #openstack-trove | 02:43 | |
*** ianbrown has joined #openstack-trove | 02:49 | |
*** robertmyers has quit IRC | 02:50 | |
peterstac | edmondk: I though it might be a heat/neutron interaction | 02:50 |
*** robertmyers has joined #openstack-trove | 02:51 | |
peterstac | so when I found a heatclient patchset that failed, I kicked it off again | 02:51 |
peterstac | https://review.openstack.org/#/c/147763/ | 02:51 |
peterstac | unfortunately it then passed | 02:51 |
peterstac | so no smoking gun :( | 02:51 |
peterstac | maybe I'll post a question on openstack-neutron, see if anyone there can shed some light | 02:53 |
*** ramishra_ has quit IRC | 02:53 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/trove: Updated from global requirements https://review.openstack.org/156759 | 03:08 |
*** jcru has quit IRC | 03:10 | |
*** ramishra_ has joined #openstack-trove | 03:10 | |
edmondk | peterstac, ya posting on there may help | 03:11 |
*** coolsvap_ is now known as coolsvap | 03:15 | |
*** ramishra_ has quit IRC | 03:25 | |
*** Riddhi has quit IRC | 03:31 | |
*** coolsvap is now known as coolsvap_ | 03:34 | |
*** annashen has joined #openstack-trove | 03:35 | |
*** annashen has quit IRC | 03:39 | |
SlickNik | peterstac / edmondk: Just got to looking into the failing gate. Looks like the failing tests are in heat, and not in neutron — digging deeper. | 03:40 |
*** ianbrown has quit IRC | 03:41 | |
SlickNik | peterstac / edmondk: The heat engine is not running — "ERROR: No template format plugins registered" | 03:42 |
SlickNik | http://logs.openstack.org/86/155786/2/check/gate-tempest-dsvm-neutron-src-python-troveclient-juno/27359a7/logs/screen-h-eng.txt.gz | 03:42 |
*** coolsvap_ is now known as coolsvap | 03:43 | |
SlickNik | The issue seems to be in a requirements change | 03:43 |
SlickNik | "Could not load AWSTemplateFormatVersion.2010-09-09: (python-troveclient 1.0.8.post27 (/opt/stack/new/python-troveclient), Requirement.parse('python-troveclient<=1.0.8,>=1.0.4'))" | 03:43 |
peterstac | SlickNik: so it can't determine that 1.0.8.post27 <= 1.0.8 ? | 03:52 |
SlickNik | hmmm… I'm not sure where that requirement is coming from | 03:52 |
*** annashen has joined #openstack-trove | 03:52 | |
SlickNik | also peterstac — yes :) | 03:52 |
peterstac | SlickNik: I thought the current 'requirement' for python-troveclient is 1.0.7 ... | 03:53 |
peterstac | I'm getting that from: https://raw.githubusercontent.com/openstack/requirements/master/global-requirements.txt | 03:54 |
peterstac | Not sure what the 'official' list says (or where it's located) | 03:54 |
SlickNik | So this is a juno job — so it's running the current troveclient repo against the a devstack running the juno (stable) version of the openstack services. | 03:54 |
SlickNik | The requirements for troveclient in the juno branch for heat that currently see is requirements.txt:python-troveclient>=1.0.4 | 03:55 |
SlickNik | https://github.com/openstack/heat/blob/stable/juno/requirements.txt | 03:56 |
SlickNik | I'm not sure where it's picking up the <=1.0.8 part from. | 03:56 |
peterstac | SlickNik: What I'm not getting is that nothing has changed in python-troveclient (obviously, since we can't get the test to pass) | 03:58 |
peterstac | And I can't find anything that's changed in heat in between Feb3-12 in stable/juno | 03:58 |
SlickNik | It's probably something in the way that devstack is installing the client, perhaps? | 03:59 |
peterstac | Yeah, possibly | 04:00 |
SlickNik | Still digging :) | 04:00 |
peterstac | SlickNik: Do you think this is related? | 04:02 |
peterstac | https://github.com/openstack-dev/devstack/commit/cb247b60bae17571dcedad2c1ef28237a30a8806 | 04:02 |
SlickNik | I don't think that change is related. | 04:04 |
peterstac | SlickNik: There are only 4 changes to devstack stable/juno between Feb3-12 | 04:13 |
*** robertmyers has quit IRC | 04:13 | |
SlickNik | Yeah, doesn't look like any of those are responsible. | 04:15 |
*** ramishra_ has joined #openstack-trove | 04:15 | |
SlickNik | looks like a stevedore failure when loading one of the entrypoints. | 04:17 |
SlickNik | What I'm not sure of, is what requirement is being checked when that entrypoint is being loaded. | 04:18 |
SlickNik | Checking to see if dhellman is around to help | 04:18 |
peterstac | I noticed that tempest (master) doesn't have a requirement for python-troveclient | 04:21 |
peterstac | https://github.com/openstack/tempest/blob/master/requirements.txt | 04:21 |
SlickNik | asked in #openstack-oslo | 04:26 |
SlickNik | Be back in a bit. | 04:27 |
peterstac | ok | 04:30 |
openstackgerrit | Peter Stachowski proposed openstack/trove-integration: Refactor redstack to use local.conf https://review.openstack.org/155913 | 04:35 |
*** bhunter71 has quit IRC | 04:36 | |
*** coolsvap is now known as coolsvap_ | 04:41 | |
*** chandankumar has joined #openstack-trove | 04:45 | |
*** coolsvap_ is now known as coolsvap | 04:48 | |
*** annashen has quit IRC | 04:51 | |
openstackgerrit | Peter Stachowski proposed openstack/trove-integration: Refactor redstack to use local.conf https://review.openstack.org/155913 | 04:57 |
*** ramishra_ has quit IRC | 05:06 | |
*** annashen has joined #openstack-trove | 05:20 | |
*** annashen has quit IRC | 05:48 | |
*** annashen has joined #openstack-trove | 05:55 | |
*** chandankumar has quit IRC | 06:14 | |
*** ramishra_ has joined #openstack-trove | 06:15 | |
peterstac | SlickNik: I came across this - https://bugs.launchpad.net/trove/+bug/1416120 | 06:16 |
openstack | Launchpad bug 1416120 in Trove "AuthSystemNotFound when using --bypass-url with python-troveclient 1.0.8" [High,Triaged] - Assigned to Nikhil Manchanda (slicknik) | 06:16 |
peterstac | I wonder if that caused some mucking around with version requirements ... | 06:18 |
*** ramishra_ has quit IRC | 06:32 | |
*** chandankumar has joined #openstack-trove | 06:40 | |
*** ramishra_ has joined #openstack-trove | 06:42 | |
*** miqui has joined #openstack-trove | 06:45 | |
*** ramishra_ has quit IRC | 06:54 | |
*** annashen has quit IRC | 06:54 | |
peterstac | I think I may have found it | 07:04 |
peterstac | Read the last comment on this: https://review.openstack.org/#/c/157606/ | 07:04 |
*** ramishra_ has joined #openstack-trove | 07:06 | |
peterstac | And then check out the requirements for python-troveclient in stable/juno: https://github.com/openstack/requirements/blob/stable/juno/global-requirements.txt | 07:06 |
*** annashen has joined #openstack-trove | 07:07 | |
peterstac | python-openstackclient doesn't have python-troveclient specified, but I'm guessing something else is causing the latest version to be installed | 07:15 |
peterstac | that's conflicting with the capped version specified in global-requirements for stable/juno | 07:16 |
peterstac | Ok, maybe haven't found it yet ;) but getting closer I think | 07:17 |
peterstac | Ok, that's definitely the problem | 07:24 |
peterstac | The global-requirements for stable/juno was changed on Feb 11 | 07:24 |
peterstac | https://github.com/openstack/requirements/commit/499db6b64071c2afa16390ad2bc024e6a96db4ff | 07:24 |
peterstac | I can't find the date on the commit (just the authored date and that's useless) | 07:28 |
peterstac | you can see it here though on Feb 11: https://github.com/openstack/requirements/commits/stable/juno | 07:28 |
peterstac | -python-troveclient>=1.0.4 | 07:30 |
peterstac | +python-troveclient>=1.0.4,<=1.0.8 | 07:30 |
*** annashen has quit IRC | 07:30 | |
*** annashen has joined #openstack-trove | 07:51 | |
*** miqui has quit IRC | 07:52 | |
*** ramishra_ has quit IRC | 07:57 | |
*** annashen has quit IRC | 07:59 | |
*** exploreshaifali has joined #openstack-trove | 08:15 | |
SlickNik | peterstac: Yup, it looks like https://github.com/openstack/requirements/commit/499db6b64071c2afa16390ad2bc024e6a96db4ff is the culprit with the explicit cap. | 08:20 |
*** coolsvap is now known as coolsvap_ | 08:29 | |
*** coolsvap_ is now known as coolsvap | 08:35 | |
*** coolsvap is now known as coolsvap_ | 08:35 | |
*** eghobo has joined #openstack-trove | 08:44 | |
peterstac | SlickNik: Unfortunately, I don't know if they're going to want to roll that back ... | 09:06 |
*** ramishra_ has joined #openstack-trove | 09:08 | |
SlickNik | peterstac: I don't think we need to cap the version of python-troveclient in juno. I've left a message in openstack-oslo asking about it — I'd be fine with lifting the trove-client cap in stable/juno | 09:08 |
SlickNik | Will discuss it when folks are around. | 09:09 |
peterstac | SlickNik: ok, fyi they're having the same issue in stable/icehouse | 09:10 |
peterstac | https://review.openstack.org/#/c/157654/2 | 09:10 |
peterstac | (similar issue ... I think this is the proposed fix to the novaclient prob) | 09:12 |
*** ramishra_ has quit IRC | 09:12 | |
openstackgerrit | Peter Stachowski proposed openstack/trove-integration: Refactor redstack to use local.conf https://review.openstack.org/155913 | 09:21 |
*** eghobo has quit IRC | 09:29 | |
*** ramishra_ has joined #openstack-trove | 09:40 | |
*** ramishra_ has quit IRC | 09:51 | |
*** exploreshaifali has quit IRC | 10:22 | |
*** tosky has joined #openstack-trove | 10:24 | |
*** MasterPiece has joined #openstack-trove | 10:30 | |
*** openstack has joined #openstack-trove | 20:22 | |
*** mattgriffin has quit IRC | 20:24 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!