*** rajinir has quit IRC | 00:36 | |
openstackgerrit | Merged openstack/python-troveclient: move old apiclient code out of openstack/common https://review.openstack.org/396267 | 00:54 |
---|---|---|
openstackgerrit | OpenStack Proposal Bot proposed openstack/python-troveclient: Updated from global requirements https://review.openstack.org/392831 | 00:56 |
*** robertmyers has joined #openstack-trove | 01:24 | |
*** kfox1111 is now known as kfox1111_away | 01:51 | |
*** gcb has joined #openstack-trove | 02:00 | |
*** nshah has joined #openstack-trove | 02:22 | |
*** nshah has left #openstack-trove | 02:24 | |
*** tqtran has quit IRC | 02:48 | |
*** links has joined #openstack-trove | 02:49 | |
openstackgerrit | Merged openstack/python-troveclient: Updated from global requirements https://review.openstack.org/392831 | 03:13 |
*** robertmyers has quit IRC | 03:19 | |
openstackgerrit | Cao Xuan Hoang proposed openstack/trove: Using assertIsNotNone() instead of assertNotEqual(None) https://review.openstack.org/397523 | 04:42 |
openstackgerrit | Merged openstack/trove: trovestack clean doesn't delete secgroups https://review.openstack.org/393233 | 05:27 |
*** tqtran has joined #openstack-trove | 05:48 | |
*** tqtran has quit IRC | 05:52 | |
*** chhavi has joined #openstack-trove | 06:51 | |
*** drifterza has joined #openstack-trove | 07:22 | |
*** rcernin has quit IRC | 07:23 | |
*** chhavi has quit IRC | 08:05 | |
*** pcaruana has joined #openstack-trove | 08:22 | |
*** chhavi has joined #openstack-trove | 08:24 | |
openstackgerrit | Cao Xuan Hoang proposed openstack/trove-integration: Add Apache 2.0 license to source file https://review.openstack.org/397574 | 08:37 |
*** khushbu_ has joined #openstack-trove | 08:42 | |
*** gouthamr has joined #openstack-trove | 08:58 | |
*** gouthamr has quit IRC | 09:03 | |
openstackgerrit | Cao Xuan Hoang proposed openstack/trove-integration: Docstrings should not start with a space https://review.openstack.org/397594 | 09:03 |
*** gouthamr has joined #openstack-trove | 09:08 | |
*** khushbu_ has quit IRC | 09:11 | |
*** gouthamr_ has joined #openstack-trove | 09:15 | |
*** openstackgerrit has quit IRC | 09:18 | |
*** openstackgerrit has joined #openstack-trove | 09:18 | |
*** gouthamr has quit IRC | 09:18 | |
*** chhavi has quit IRC | 09:25 | |
*** gouthamr_ has quit IRC | 09:33 | |
*** gouthamr has joined #openstack-trove | 09:35 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/trove: Updated from global requirements https://review.openstack.org/395393 | 09:49 |
*** gouthamr has quit IRC | 10:05 | |
*** gouthamr has joined #openstack-trove | 10:06 | |
*** khushbu_ has joined #openstack-trove | 10:17 | |
*** gouthamr has quit IRC | 10:20 | |
*** gouthamr has joined #openstack-trove | 10:24 | |
openstackgerrit | Béla Vancsics proposed openstack/trove: Reduce code duplication https://review.openstack.org/347398 | 10:26 |
*** khushbu_ has quit IRC | 10:26 | |
openstackgerrit | Béla Vancsics proposed openstack/trove: Reduce code duplication https://review.openstack.org/347398 | 10:31 |
*** zhubingbing has joined #openstack-trove | 10:33 | |
zhubingbing | hi | 10:33 |
zhubingbing | i have a problem | 10:33 |
zhubingbing | who can help me | 10:34 |
*** gouthamr has quit IRC | 10:34 | |
zhubingbing | trove support keystone v3 ? | 10:35 |
*** gouthamr has joined #openstack-trove | 10:44 | |
*** gouthamr_ has joined #openstack-trove | 10:47 | |
*** gouthamr has quit IRC | 10:50 | |
*** tosky has joined #openstack-trove | 10:51 | |
*** chhavi has joined #openstack-trove | 10:58 | |
*** gouthamr_ has quit IRC | 10:58 | |
*** khushbu_ has joined #openstack-trove | 11:19 | |
*** gouthamr has joined #openstack-trove | 11:25 | |
*** gouthamr has quit IRC | 11:31 | |
zhubingbing | trove support keystone v3 ? | 11:34 |
zhubingbing | do you know ? | 11:34 |
zhubingbing | who know ? | 11:34 |
*** links has quit IRC | 11:43 | |
*** khushbu_ has quit IRC | 11:52 | |
*** khushbu_ has joined #openstack-trove | 12:03 | |
*** gcb has quit IRC | 12:19 | |
*** arist has quit IRC | 12:28 | |
*** arist has joined #openstack-trove | 12:29 | |
*** khushbu_ has quit IRC | 12:37 | |
*** gouthamr has joined #openstack-trove | 12:42 | |
*** pmackinn_ has joined #openstack-trove | 12:43 | |
*** pmackinn has quit IRC | 12:43 | |
*** khushbu_ has joined #openstack-trove | 12:50 | |
*** khushbu_ has quit IRC | 12:55 | |
*** zhubingbing has quit IRC | 12:56 | |
*** drifterza has quit IRC | 12:58 | |
*** chhavi has quit IRC | 12:59 | |
*** gouthamr has quit IRC | 12:59 | |
*** drifterza has joined #openstack-trove | 13:02 | |
*** gnuoy has quit IRC | 13:19 | |
*** gouthamr has joined #openstack-trove | 13:31 | |
*** chhavi has joined #openstack-trove | 13:32 | |
*** zhubingbing_ has joined #openstack-trove | 13:37 | |
*** diga has joined #openstack-trove | 13:51 | |
*** zhubingbing_ has quit IRC | 13:53 | |
*** drifterza has quit IRC | 13:55 | |
*** pcaruana has quit IRC | 14:13 | |
*** gouthamr has quit IRC | 14:15 | |
*** gouthamr has joined #openstack-trove | 14:40 | |
*** khushbu_ has joined #openstack-trove | 14:48 | |
*** tqtran has joined #openstack-trove | 14:53 | |
*** robertmyers has joined #openstack-trove | 14:53 | |
*** tqtran has quit IRC | 14:57 | |
*** drifterza has joined #openstack-trove | 15:02 | |
*** khushbu_ has quit IRC | 15:04 | |
*** hongbin has joined #openstack-trove | 15:14 | |
*** gouthamr has quit IRC | 15:16 | |
*** chhavi has quit IRC | 15:22 | |
*** khushbu_ has joined #openstack-trove | 15:46 | |
*** openstackgerrit has quit IRC | 15:48 | |
*** openstackgerrit has joined #openstack-trove | 15:48 | |
*** gouthamr has joined #openstack-trove | 15:51 | |
*** khushbu_ has quit IRC | 15:55 | |
*** gouthamr has quit IRC | 16:00 | |
*** rajinir has joined #openstack-trove | 16:00 | |
*** pcaruana has joined #openstack-trove | 16:02 | |
*** drifterza has quit IRC | 16:04 | |
*** gouthamr has joined #openstack-trove | 16:07 | |
openstackgerrit | Peter Stachowski proposed openstack/trove: Fix module apply https://review.openstack.org/394765 | 16:07 |
*** gouthamr_ has joined #openstack-trove | 16:10 | |
*** gouthamr_ has quit IRC | 16:11 | |
*** gouthamr_ has joined #openstack-trove | 16:11 | |
*** gouthamr has quit IRC | 16:11 | |
*** kfox1111_away is now known as kfox1111 | 16:28 | |
openstackgerrit | Petr Malik proposed openstack/trove-specs: Implement couchbase cluster provisioning https://review.openstack.org/392990 | 16:36 |
*** tqtran has joined #openstack-trove | 16:52 | |
*** chhavi has joined #openstack-trove | 16:59 | |
*** haplo37_ has quit IRC | 17:03 | |
*** robertmy_ has joined #openstack-trove | 17:03 | |
*** robertmyers has quit IRC | 17:06 | |
*** chhavi has quit IRC | 17:12 | |
*** johnma has joined #openstack-trove | 17:20 | |
*** haplo37 has joined #openstack-trove | 17:44 | |
*** spilla has joined #openstack-trove | 18:11 | |
*** diga has quit IRC | 18:14 | |
*** tosky has quit IRC | 18:35 | |
*** harlowja has quit IRC | 18:38 | |
*** rcernin has joined #openstack-trove | 19:02 | |
*** harlowja has joined #openstack-trove | 19:06 | |
openstackgerrit | Peter Stachowski proposed openstack/trove: (fix gate) Create net/subnet for alt_demo tenant https://review.openstack.org/356701 | 19:08 |
openstackgerrit | Peter Stachowski proposed openstack/trove: (fix gate) Create net/subnet for alt_demo tenant https://review.openstack.org/356701 | 19:16 |
openstackgerrit | Peter Stachowski proposed openstack/trove: (fix gate) Create net/subnet for alt_demo tenant https://review.openstack.org/356701 | 19:31 |
*** robertmy_ has quit IRC | 19:57 | |
*** robertmyers has joined #openstack-trove | 19:58 | |
*** robertmy_ has joined #openstack-trove | 20:01 | |
*** robertmyers has quit IRC | 20:04 | |
*** gouthamr_ has quit IRC | 20:14 | |
openstackgerrit | amrith proposed openstack/trove: DNM: This is a test https://review.openstack.org/397335 | 20:18 |
*** spilla has quit IRC | 20:36 | |
*** pcaruana has quit IRC | 21:32 | |
openstackgerrit | amrith proposed openstack/trove: DNM: This is a test https://review.openstack.org/397335 | 21:37 |
openstackgerrit | Merged openstack/trove: Files with no code must be left completely empty https://review.openstack.org/395458 | 21:43 |
amrith | jroll ... | 21:44 |
*** jroll has joined #openstack-trove | 21:44 | |
amrith | ok, there you are | 21:44 |
jroll | hey amrith | 21:44 |
amrith | so, here's what we're seeing, which may be a bit different from other projects. | 21:44 |
amrith | for us, there's the added complication of spinning up a guest | 21:45 |
amrith | so the control plane is the standard devstack control plane | 21:45 |
amrith | and then we launch a VM | 21:45 |
amrith | and that VM has to talk back to rabbit on the control plane | 21:45 |
jroll | aha, right | 21:45 |
amrith | my hunch (and I hit this a long time ago but not in the gate) was that with neutron, that link from the guest to the control plane fails. | 21:45 |
amrith | so when you say it is not a subnet issue, I'm not entirely sure you are seeing all the logs | 21:45 |
amrith | because the logs that are missing | 21:46 |
jroll | yeah, that would be my guess | 21:46 |
amrith | are on the guest that wa uncerimoniously shot when the test failed. | 21:46 |
amrith | peterstac ^^ | 21:46 |
jroll | well, when I said that, the typical issue with subnetpools is 'oh noez I have no internet' | 21:46 |
jroll | which clearly isn't the thing here | 21:46 |
amrith | well, I suspect that the guest has no internet | 21:46 |
jroll | but! subnetpools could be an issue | 21:46 |
jroll | I mean the devstack host has no internet | 21:47 |
peterstac | amrith, that might be a problem, but we're not getting that far yet | 21:47 |
jroll | what I'm thinking you're seeing is something like | 21:47 |
jroll | the guest is on a tenant network | 21:47 |
jroll | that cannot reach the control plane | 21:47 |
jroll | as that is 'normal' for nova | 21:47 |
jroll | iirc | 21:47 |
amrith | peterstac makes an interesting point, the guest isn't yet coming up | 21:47 |
peterstac | the nova instance isn't spinning up at all, because it can't get the glance image | 21:47 |
amrith | nova is failing | 21:47 |
amrith | that's what he's seeing | 21:47 |
jroll | aha | 21:47 |
amrith | and it says no valid host found | 21:47 |
peterstac | nova fail is here: http://logs.openstack.org/01/356701/19/check/gate-trove-scenario-functional-dsvm-redis/1d8dd13/logs/screen-n-cpu.txt.gz#_2016-11-15_20_02_03_279 | 21:48 |
amrith | but nothing amiss in the scheduler log | 21:48 |
jroll | well that I don't know if I can help you, hm | 21:48 |
amrith | this be different ... | 21:48 |
jroll | so 'no valid host' is a weird thing | 21:48 |
peterstac | The glance failure seems to be this one: http://logs.openstack.org/01/356701/19/check/gate-trove-scenario-functional-dsvm-redis/1d8dd13/logs/screen-g-api.txt.gz#_2016-11-15_20_01_32_101 | 21:48 |
jroll | which may mean scheduler problems | 21:48 |
jroll | but nova will also try to build (by default) 3 times | 21:48 |
jroll | if all builds fail it decides no host can build that instance | 21:48 |
jroll | and returns the same error | 21:48 |
jroll | this is the RetryFilter in the scheudler | 21:49 |
amrith | so, let's try this | 21:49 |
amrith | how do I do this no subnet pool thing and see if it moves the ball further? | 21:49 |
amrith | let's see if it gets us 10 yards | 21:49 |
jroll | amrith: USE_SUBNETPOOL=False | 21:49 |
jroll | is a devstack setting, so either in project-config, or quicker in your-devstack-plugin/settings | 21:50 |
amrith | in the CI job? | 21:50 |
amrith | sure, I have a devstack-gate change | 21:50 |
jroll | that works too | 21:50 |
amrith | let me put it there and depend on it | 21:50 |
jroll | cool | 21:50 |
jroll | for the glance errors.... no idea | 21:51 |
peterstac | About the glance errors | 21:52 |
amrith | jroll #1: https://review.openstack.org/397964 | 21:52 |
peterstac | SERVICE_HOST is set to 127.0.0.1 but glance seems to be trying to talk to 10.1.0.1 | 21:52 |
peterstac | that's the NETWORK_GATEWAY for the VM's, not the control plane, no? | 21:53 |
*** dkehn__ has joined #openstack-trove | 21:53 | |
jroll | interesting | 21:53 |
jroll | 127.0.0.1 is also used in service catalog http://logs.openstack.org/01/356701/19/check/gate-trove-scenario-functional-dsvm-redis/1d8dd13/logs/devstacklog.txt.gz#_2016-11-15_19_46_46_388 | 21:55 |
*** harlowja has quit IRC | 21:55 | |
*** dkehn_ has quit IRC | 21:55 | |
openstackgerrit | amrith proposed openstack/trove: DNM - testing subnetpool fix https://review.openstack.org/397966 | 21:55 |
jroll | and in n-cpu config http://logs.openstack.org/01/356701/19/check/gate-trove-scenario-functional-dsvm-redis/1d8dd13/logs/screen-n-cpu.txt.gz#_2016-11-15_19_52_20_113 | 21:55 |
jroll | odd | 21:55 |
peterstac | the glance api server seems to be responding on that ip, but when it requests the image it tries to talk to 10.1.0.1 | 21:56 |
jroll | maybe it thinks swift is at 10.1.0.1? (looks like the images are in swift) | 21:59 |
peterstac | but swift is also set up with 127.0.0.1 | 22:01 |
peterstac | http://logs.openstack.org/01/356701/19/check/gate-trove-scenario-functional-dsvm-redis/1d8dd13/logs/devstacklog.txt.gz#_2016-11-15_19_48_00_350 | 22:01 |
jroll | yeah, but is glance configured to use that properly? | 22:04 |
peterstac | well, I don't believe we do anything special with glance (wrt config) | 22:05 |
peterstac | we do load our images - let me check that part of the logs | 22:06 |
*** harlowja has joined #openstack-trove | 22:13 | |
peterstac | I think I might have found the problem ... | 22:14 |
*** gouthamr_ has joined #openstack-trove | 22:19 | |
openstackgerrit | Peter Stachowski proposed openstack/trove: (fix gate) Create net/subnet for alt_demo tenant https://review.openstack.org/356701 | 22:20 |
*** robertmy_ has quit IRC | 22:21 | |
*** gouthamr_ has quit IRC | 22:26 | |
amrith | good luck! | 22:36 |
amrith | what did you find? | 22:38 |
amrith | are you sure $ENABLE_NEUTRON = false is right? | 22:40 |
amrith | oh, I see ... that's what you did :) | 22:41 |
*** rcernin has quit IRC | 22:42 | |
openstackgerrit | Merged openstack/trove: Remove unused parameters https://review.openstack.org/365956 | 23:52 |
openstackgerrit | Merged openstack/trove: [api-ref] configure LogABug feature https://review.openstack.org/377751 | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!