| *** tosky has quit IRC | 00:04 | |
| *** slaweq has quit IRC | 00:56 | |
| *** openstackgerrit has quit IRC | 02:22 | |
| *** openstackgerrit has joined #openstack-sdks | 02:41 | |
| openstackgerrit | Yang JianFeng proposed openstack/openstacksdk master: Add support for octavia's resuorces quota https://review.openstack.org/590193 | 02:41 |
|---|---|---|
| openstackgerrit | zhouxinyong proposed openstack/oaktree master: Optimizing the safety of the http link site in HACKING.rst https://review.openstack.org/618424 | 03:41 |
| *** Luzi has joined #openstack-sdks | 07:15 | |
| *** e0ne has joined #openstack-sdks | 07:15 | |
| *** dayou_ has quit IRC | 07:16 | |
| *** dayou_ has joined #openstack-sdks | 07:16 | |
| amito | hey, anyone here this time of day? :) | 07:20 |
| *** slaweq has joined #openstack-sdks | 07:35 | |
| *** slaweq has quit IRC | 07:47 | |
| *** slaweq has joined #openstack-sdks | 07:49 | |
| *** dayou_ has quit IRC | 08:26 | |
| *** dayou has joined #openstack-sdks | 08:27 | |
| *** e0ne has quit IRC | 08:28 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** slaweq has quit IRC | 08:46 | |
| *** jpich has joined #openstack-sdks | 08:51 | |
| *** tosky has joined #openstack-sdks | 08:57 | |
| openstackgerrit | Yang JianFeng proposed openstack/openstacksdk master: Add support for octavia's resuorces quota https://review.openstack.org/590193 | 09:19 |
| openstackgerrit | Artem Goncharov proposed openstack/openstacksdk master: implement block-storage backup resource https://review.openstack.org/591445 | 09:21 |
| *** dtantsur|afk is now known as dtantsur | 09:41 | |
| *** dave-mccowan has joined #openstack-sdks | 09:46 | |
| *** dave-mccowan has quit IRC | 09:50 | |
| *** openstackgerrit has quit IRC | 09:52 | |
| *** irclogbot_2 has quit IRC | 09:53 | |
| *** gtema has joined #openstack-sdks | 09:58 | |
| *** irclogbot_2 has joined #openstack-sdks | 10:03 | |
| *** dtantsur is now known as dtantsur|afk | 10:10 | |
| *** openstackgerrit has joined #openstack-sdks | 11:31 | |
| openstackgerrit | Yang JianFeng proposed openstack/openstacksdk master: Add support for octavia's resuorces quota https://review.openstack.org/590193 | 11:31 |
| *** dtantsur|afk is now known as dtantsur | 11:37 | |
| *** gtema has quit IRC | 11:48 | |
| *** slaweq has joined #openstack-sdks | 12:19 | |
| *** jpena is now known as jpena|lunch | 12:29 | |
| *** gtema has joined #openstack-sdks | 12:32 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/openstacksdk master: _make_proxy attempts to referenced undefined variable api_version https://review.openstack.org/618519 | 12:44 |
| gtema | dtansur, are you here? | 12:45 |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/openstacksdk master: _make_proxy attempts to referenced undefined variable api_version https://review.openstack.org/618519 | 12:49 |
| *** jpich has quit IRC | 12:50 | |
| *** mordred has quit IRC | 12:55 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/openstacksdk master: several errors in _make_proxy https://review.openstack.org/618519 | 13:04 |
| *** jpena|lunch is now known as jpena | 13:37 | |
| openstackgerrit | Lars Kellogg-Stedman proposed openstack/openstacksdk master: several errors in _make_proxy https://review.openstack.org/618519 | 13:48 |
| *** dtantsur is now known as dtantsur|afk | 13:50 | |
| *** pbourke has quit IRC | 14:04 | |
| *** pbourke has joined #openstack-sdks | 14:04 | |
| *** Luzi has quit IRC | 14:56 | |
| *** larsks has joined #openstack-sdks | 14:59 | |
| larsks | Hey folks. I'm running into a variety of problems with ansible's os_loadbalancer module, and it looks like it's tripping over problems in openstack/service_description.py. There appears to be a ton of untested code there (e.g., it's trying to raise exceptions.UnsupportedVersionWarning all over the place, but that exception doesn't seem to exist). | 15:02 |
| larsks | ...but it's doing that because it doesn't seem to be able to determine the api version for the octavia service, and I'm wondering if someone here has thoughts on what might be going on. The openstack cli works fine. | 15:03 |
| frickler | larsks: I fear lots of folks are still recovering from the summit, I'm off for the weekend now, too. probably best create a story at https://storyboard.openstack.org/#!/project/openstack/openstacksdk , include some error logs and mention the story here | 15:05 |
| larsks | Curses! But sure, I'll do that. | 15:06 |
| frickler | usually mordred might want to take a look, but he also seems to be busy recovering ;) | 15:06 |
| gtema | larsks: what's your endpoint url for octavia? Do you also set/change octavia api version in your clouds.yaml? | 15:33 |
| gtema | UnsupportedVersionWarning should be either created in exceptions.py or replaced with UnsupportedServiceVersion. Not sure what mordred would prefer | 15:36 |
| larsks | gtema: The endpoint url does not hav a version (https://my.public.hostname:13876). I did try setting load_balancer_api_version: 2 in the clouds.yaml file but that didn't appear to resolve the issue. | 15:36 |
| gtema | under "cli" you mean octaviaclient, right? | 15:38 |
| larsks | gtema: I mean "openstack loadbalancer ...", which uses octaviaclient, yes. | 15:39 |
| gtema | ok | 15:39 |
| johnsom | larsks What version of Octavia do you have deployed? | 15:41 |
| larsks | johnsom: 'octavia-api --version' tells me 2.0.2.dev42 | 15:42 |
| johnsom | Queens. Ok, you should be good with the API versioning. It's v2. If you do an "openstack versions show" you should see lines like this: | 15:44 |
| johnsom | https://www.irccloud.com/pastebin/uQXXdGAU/ | 15:44 |
| larsks | johnsom: ah, there's a problem. The same command here shows: http://termbin.com/8rlw | 15:46 |
| larsks | If I curl the endpointa address I get: http://termbin.com/om4q | 15:46 |
| johnsom | Hmm, yeah, I have more versions because I'm running Rocky, but I'm not sure why they aren't being listed with the queens version that has one v2 | 15:48 |
| larsks | johnsom: apparently 'openstack versions' doesn't like the output from octavia? http://termbin.com/bc0i | 15:51 |
| johnsom | Ah, yeah, ok. Queens doesn't have the "links" stuff, so that openstack versions show is correct. It still shows the v2 API though, so you should be good to go. As you saw with the OpenStack client | 15:52 |
| larsks | johnsom: here is the specific behavior I see: http://termbin.com/mlid | 15:53 |
| amito | Hey all, I'm working on the integration for manila (shared file systems) and openstack SDK. It's in progress and I guess a patch will be uploaded sometime in the next few weeks. | 15:57 |
| gtema | amito: cool | 15:57 |
| gtema | larsks: isn't it working further? the proxy should be fine, it seems to just throw a warning | 15:59 |
| gtema | can you add `conn.load_balancer.load_balancers()` | 15:59 |
| larsks | gtema: the os_loadbalancer attempts to call cloud.load_balancer.find_load_balancer, which fails, since that's not a REST pass-through. | 15:59 |
| gtema | larsks: how it fails? | 16:00 |
| larsks | gtema: re: your question, AttributeError: 'Proxy' object has no attribute 'load_balancers' | 16:00 |
| larsks | And the attempt to use find_load_balancer fails the same way. | 16:00 |
| gtema | ok, so empty proxy | 16:00 |
| johnsom | larsks I know a bunch of changes were made to API version discovery around that time in openstacksdk. I would try adding an explicit version "v2.0" to your cloud definition for the load-balancer service. | 16:01 |
| larsks | johnsom: like this? load_balancer_api_version: "v2.0" | 16:02 |
| johnsom | It might be v2 though. load-balancer_api_version I think | 16:02 |
| johnsom | The service type has a hyphen in it | 16:03 |
| larsks | I'm pretty sure that all "-" get convereted to "_" for use as keys, but I can put both in. | 16:03 |
| larsks | johnsom: I've tried this: http://termbin.com/byhkv I've set the api version to "2", "2.0", "v2", and "v2.0", all seem to result in the same error. | 16:06 |
| gtema | larsks: would you try adding `openstack.enable_logging(debug=True, http_debug=True)` into your test to see which requests are being sent? I'm extending SDK with own services, which also do not properly support discovery but I have not faced such behaviour so far | 16:10 |
| larsks | gtema: sure, just a second. | 16:11 |
| larsks | gtema: there are a bunch of "Skipping invalid version data. Missing links" in the debug output: http://termbin.com/tgff | 16:13 |
| gtema | larsks: hmm. The version discovery response is certanly bad. In each version item there should be "links" attribute | 16:20 |
| gtema | larsks: i guess if no response would have been sent - it would be better than that. To tell the truth - I have no clue so far. Parsing of this document is not done in SDK, but keystoneauth1 (I guess) | 16:21 |
| gtema | but I would rather ask - why is this response wrong? | 16:22 |
| gtema | https://wiki.openstack.org/wiki/VersionDiscovery#links | 16:22 |
| larsks | As far as I know, that's just what this version of octavia spits out. | 16:22 |
| larsks | johnsom: ^^^^ is that correct? | 16:23 |
| gtema | sure, but I mean why is it spitting this out | 16:23 |
| gtema | there might be bug in octavia (this version) or configuration. Since I do not have Octavia - I do not know for sure | 16:24 |
| larsks | That I don't know. I just wish there were some way to skip the version discovery and *tell* openstacksdk what to use. | 16:24 |
| johnsom | Well, the version discovery in openstacksdk changed, this is why octavia changed and added the links in a later version. Still, openstacksdk can use Octavia, it's how the CLI and horizon dashboard work. We just have some configuration issue in openstacksdk that is causing it to not be happy for some reason. | 16:25 |
| johnsom | Yeah, there definitely is a way to tell the SDK to use a specific version, but you tried the way I know. Sadly, I haven't spent much time with openstacksdk in over a year. | 16:26 |
| gtema | there is a way, but just temporarily - `openstacksdk:openstack.load_balancer.v2._proxy.Proxy.skip_discovery = True` | 16:26 |
| gtema | but you will not get it landed in SDK | 16:27 |
| *** d0ugal has quit IRC | 16:27 | |
| *** d0ugal has joined #openstack-sdks | 16:27 | |
| gtema | johnsom: the problem is that octavia in this case does not return a valid version discovery doc, so I might try to process this correctly. But the root should be fixed | 16:28 |
| johnsom | gtema It returned a valid discovery doc for the Queens timeframe | 16:29 |
| johnsom | gtema He is running Queens | 16:29 |
| gtema | are you sure links was not mandatory field? I am using Mitaka and services return this attribute | 16:29 |
| johnsom | Since the CLI is working, the SDK works against the queens Octavia API | 16:30 |
| johnsom | Yep, it was not required until later | 16:30 |
| gtema | CLI is working because octaviaclient is not using SDK (I guess) | 16:30 |
| gtema | yesm octaviaclient is not using SDK as of now | 16:31 |
| johnsom | Ah, it was just octavia-dashboard that used the SDK at that time | 16:32 |
| larsks | Bleargh. | 16:32 |
| larsks | Okay, I'm going to punt on this right now and just right my playbook using the openstack cli rather than os_loadbalancer for now. | 16:33 |
| johnsom | We just need monty or someone that knows about that version discovery change to tell us what the configuration magic is for the SDK | 16:33 |
| larsks | I'm going to spend a little time stepping through the code with pdb and see if maybe it's obvious... | 16:34 |
| gtema | I know that you can disable version discovery per service (from the code, not configurable), but I am quite sure for Octavia it will not be switched off that easy | 16:34 |
| gtema | `openstack.load_balancer.v2._proxy.Proxy.skip_discovery = True` | 16:34 |
| larsks | gtema: isn't that at the wrong place? The problem right now is that it doesn't know to use the load_balancer.v2 proxy because of the version discovery issue... | 16:35 |
| gtema | larsks: if the discovery is skipped - it should not even try to get it and return a "proper" proxy | 16:36 |
| johnsom | larsks Try one more thing, looking at the code it bypasses that if both the version and the endpoint of overriden in the config | 16:37 |
| larsks | gtema: setting openstack.load_balancer.v2._proxy.Proxy.skip_discovery=True doesn't seem to impact the issue. | 16:38 |
| larsks | johnsom: let me try that... | 16:38 |
| johnsom | Since you are using the old port way of doing endpoints, append "/v2" to what you have in keystone and try that as an override | 16:38 |
| larsks | Actually, what's the syntax for that...load_balanacer_endpoint? | 16:38 |
| larsks | ...but spelled correctly. | 16:38 |
| johnsom | my "openstack endpoints" gives http://10.21.21.53/load-balancer and uses "http://10.21.21.53/load-balancer/v2" for the sdk endpoint. | 16:39 |
| larsks | johnsom: success! | 16:40 |
| gtema | great | 16:40 |
| larsks | (although apparently octavia lives at /v2.0) | 16:41 |
| johnsom | Yeah, so something might have changed in the newer sdk that broke the old funky stuff that was happening in queens. Monty did a ton of work here to fix the SDK version discovery stuff. | 16:41 |
| gtema | api-ref says /v2.0 would be an alias to /v2 | 16:41 |
| johnsom | Yeah, /v2.0 is good and will work | 16:42 |
| larsks | Aaaaand now os_loadbalancer is happy, and I can rewind my stack back a couple of hours and continue :). Thanks johnsom , gtema ! | 16:42 |
| gtema | larsks: congrats for "funny" friday ;-) | 16:43 |
| *** mordred has joined #openstack-sdks | 17:20 | |
| gtema | mordred: have you arrived already? | 17:21 |
| gtema | mordred or anyone else who might know: all latest pathes fail in `bifrost-integration-tinyipa-ubuntu-xenial` with `Unable to establish connection to http://127.0.0.1:5050: HTTPConnectionPool(host='127.0.0.1', port=5050): Max retries exceeded with url` | 17:24 |
| gtema | I was not able to figure out the reason yet | 17:24 |
| *** gtema has quit IRC | 17:35 | |
| *** jpena is now known as jpena|off | 17:46 | |
| frickler | gtema: TheJulia: ^^ that looks like something in ironic may have broken http://logs.openstack.org/98/618198/1/check/bifrost-integration-tinyipa-ubuntu-xenial/14c183a/logs/ironic-inspector.log | 18:18 |
| *** e0ne has joined #openstack-sdks | 19:20 | |
| *** e0ne has quit IRC | 19:49 | |
| *** bobh has joined #openstack-sdks | 21:50 | |
| *** bobh has quit IRC | 22:11 | |
| *** bobh has joined #openstack-sdks | 22:28 | |
| *** bobh has quit IRC | 22:33 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!