openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: WIP Replace TaskManager with a semaphore and lock https://review.openstack.org/604926 | 00:02 |
---|---|---|
*** zigo has quit IRC | 00:05 | |
*** zigo has joined #openstack-sdks | 00:09 | |
*** mriedem_away has quit IRC | 00:10 | |
*** gildub has joined #openstack-sdks | 00:39 | |
*** dayou_ has joined #openstack-sdks | 00:40 | |
*** dayou_ has quit IRC | 00:43 | |
*** chenyb4 has joined #openstack-sdks | 01:35 | |
*** dave-mccowan has quit IRC | 02:29 | |
*** gildub has quit IRC | 02:40 | |
*** imacdonn has quit IRC | 02:50 | |
*** imacdonn has joined #openstack-sdks | 02:50 | |
*** dave-mccowan has joined #openstack-sdks | 02:50 | |
*** edisonxiang has joined #openstack-sdks | 03:20 | |
*** e0ne has joined #openstack-sdks | 04:28 | |
*** dayou has quit IRC | 04:36 | |
*** dayou has joined #openstack-sdks | 04:36 | |
*** e0ne has quit IRC | 04:51 | |
*** e0ne has joined #openstack-sdks | 05:09 | |
*** e0ne has quit IRC | 05:10 | |
*** lbragstad has quit IRC | 05:18 | |
*** chenyb4 has quit IRC | 05:50 | |
*** slaweq has joined #openstack-sdks | 06:18 | |
*** chenyb4 has joined #openstack-sdks | 06:31 | |
*** Luzi has joined #openstack-sdks | 06:53 | |
*** slaweq has quit IRC | 06:58 | |
openstackgerrit | Merged openstack/keystoneauth master: Cache root urls with and without trailing slashes https://review.openstack.org/604635 | 07:03 |
*** slaweq has joined #openstack-sdks | 07:11 | |
Horrorcat | mordred, I was about to report it as a bug, but I’m totally lost on the storyboard thing. Is there a primer on how to use it to report issues? | 07:11 |
*** slaweq has quit IRC | 07:16 | |
*** gildub has joined #openstack-sdks | 07:35 | |
*** e0ne has joined #openstack-sdks | 07:52 | |
*** e0ne has quit IRC | 07:53 | |
*** tosky has joined #openstack-sdks | 07:54 | |
*** ttsiouts has joined #openstack-sdks | 08:27 | |
*** chenyb4 has quit IRC | 08:30 | |
*** dtantsur|afk is now known as dtantsur | 08:38 | |
*** ttsiouts has quit IRC | 08:46 | |
*** ttsiouts has joined #openstack-sdks | 08:47 | |
*** slaweq has joined #openstack-sdks | 08:48 | |
*** ttsiouts has quit IRC | 08:51 | |
*** e0ne has joined #openstack-sdks | 08:59 | |
*** ttsiouts has joined #openstack-sdks | 09:07 | |
*** ttsiouts has quit IRC | 09:10 | |
*** ttsiouts has joined #openstack-sdks | 09:10 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get object https://review.openstack.org/597198 | 09:48 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Remove profile https://review.openstack.org/604414 | 10:08 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Set endpoint_override from endpoint with noauth https://review.openstack.org/604415 | 10:08 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Use discovery instead of config to create proxies https://review.openstack.org/600292 | 10:08 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Remove api version default values https://review.openstack.org/600330 | 10:08 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Special case network and use it in openstack.cloud https://review.openstack.org/604645 | 10:08 |
*** e0ne has quit IRC | 10:12 | |
*** ttsiouts has quit IRC | 10:35 | |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK https://review.openstack.org/592303 | 10:43 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: WIP Replace TaskManager with a semaphore and lock https://review.openstack.org/604926 | 10:44 |
*** stephenfin_ is now known as stephenfin | 10:48 | |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods. https://review.openstack.org/604811 | 10:53 |
*** e0ne has joined #openstack-sdks | 10:59 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get object https://review.openstack.org/597198 | 10:59 |
*** ttsiouts has joined #openstack-sdks | 11:04 | |
*** e0ne_ has joined #openstack-sdks | 11:22 | |
openstackgerrit | Monty Taylor proposed openstack/keystoneauth master: Reformat Adapter docstring https://review.openstack.org/605042 | 11:24 |
openstackgerrit | Monty Taylor proposed openstack/keystoneauth master: Add support for client-side rate limiting https://review.openstack.org/605043 | 11:24 |
*** e0ne has quit IRC | 11:25 | |
*** dtantsur is now known as dtantsur|bbl | 11:25 | |
openstackgerrit | tianhui proposed openstack/python-openstackclient master: Add NODE and HOST parameters in "server create" help text https://review.openstack.org/591944 | 11:42 |
*** ttsiouts has quit IRC | 12:09 | |
samueldmq | morning sdk | 12:15 |
samueldmq | mordred: o/ | 12:15 |
samueldmq | mordred: I'm not getting what you're saying here https://review.openstack.org/#/c/596546 | 12:15 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove the task manager https://review.openstack.org/605052 | 12:19 |
mordred | morning samueldmq ! thanks for all the great patches you've been working on | 12:20 |
mordred | samueldmq: oh - what I'm saying is that we don't need get_container to return a munch of its contents - there is another call that does that already, it's list_objects | 12:21 |
samueldmq | mordred: my pleasure :-) | 12:21 |
mordred | (containers and objects are ... weird) | 12:21 |
*** ttsiouts has joined #openstack-sdks | 12:21 | |
mordred | so get_container returns the information about the container object itself - which is the stuff returned in the headers | 12:23 |
samueldmq | in the get_container too.. | 12:23 |
samueldmq | I just want to return 'bytes', 'count', 'last_modified', 'location', 'name', 'properties' | 12:24 |
mordred | yes - I think that's a great idea ... but I think you can normalize that from the headers that are already being fetched | 12:27 |
mordred | (and then obviously you'll need to leave the old ugly header names in if strict=False) | 12:28 |
mordred | samueldmq: storage_policy looks like another good one to have | 12:28 |
*** gildub has quit IRC | 12:30 | |
mordred | samueldmq: http://paste.openstack.org/show/730697/ there's a payload from a container we have for infra for logs | 12:32 |
openstackgerrit | Pavlo Shchelokovskyy proposed openstack/python-openstackclient master: Add --name-lookup-one-by-one option to server list https://review.openstack.org/568345 | 12:36 |
samueldmq | mordred: hmm sure, so perhaps I can leverage all that from the headers... | 12:41 |
samueldmq | mordred: so I'm doing /account/ to list containers and /account/container to list objects | 12:41 |
samueldmq | perhps I can do just HEAD on hte container and object and normalize what I get, instead of always listing everything to get one | 12:42 |
mordred | samueldmq: yes - I think for swift this is a good idea | 12:42 |
samueldmq | mordred: kk I've validated sdk against vexxhost, ecs, switchengines, ormuco, catalyst and devstack (pretty obvious but ok for my msc) | 12:43 |
mordred | samueldmq: neat! | 12:44 |
samueldmq | mordred: it's behaving all fine, except glance v1 which is entirely broken in sdk | 12:44 |
mordred | samueldmq: oh golly, really? | 12:44 |
samueldmq | we're passing info in the req body, when glance v1 expects things in the headers | 12:44 |
samueldmq | e.g disk_format | 12:44 |
samueldmq | mordred: yes :-) | 12:44 |
samueldmq | interesting part was to figure it out, since even docs for glance v1 are hard to find | 12:45 |
mordred | samueldmq: I see us setting headers in _update_image_properties_v1 ... | 12:45 |
samueldmq | mordred: but not for the upload using put v1 | 12:46 |
mordred | oh - you are so right! | 12:46 |
samueldmq | mordred: https://github.com/openstack/openstacksdk/blob/master/openstack/cloud/openstackcloud.py#L4831 | 12:46 |
mordred | yup | 12:47 |
samueldmq | mordred: that was a good catch | 12:48 |
mordred | ++ ... testing against real things is important :) | 12:48 |
mordred | samueldmq: did you find any clouds with glance v1 still? | 12:48 |
samueldmq | mordred: ah, besides all that, I have patches for normalizing network/subnet container and objects | 12:48 |
samueldmq | so they have a location and properties fields in it | 12:48 |
mordred | yes! I saw these and am excited by them (haven't fully looked at them yet, but will try to today) | 12:49 |
samueldmq | and look the same regarless what cloud is underneath | 12:49 |
samueldmq | mordred: they're not passing local tests yet, because unitt tests were not expecting too many fields | 12:49 |
samueldmq | normalize is important to everyhting... but for now I focused on these in my scope :( | 12:50 |
samueldmq | mordred: glance v1 was interesting.. nobody runs it by default, but some still have, e.g catalyst | 12:50 |
samueldmq | I had to set image_endpoint explicitly i nthe clouds.yml | 12:50 |
samueldmq | so it uses endpoint_override (iirc) | 12:50 |
mordred | well - good to hear nobody is using it by default :) | 12:54 |
samueldmq | hehe no ... | 12:54 |
mordred | samueldmq: so - when you're ready to really poke yourself in the eye ... | 12:54 |
samueldmq | btw I'll update vendor _support later on | 12:55 |
mordred | samueldmq: one of the things on the todo list, which is very similar to your normalize work | 12:56 |
mordred | samueldmq: is to get the shade layer to start using the underlying sdk layer - the sdk Resource objects are the equiv of the _normalize methods in the shade layer | 12:57 |
openstackgerrit | Merged openstack/openstacksdk master: Update the URL in doc https://review.openstack.org/604738 | 12:57 |
mordred | samueldmq: it's a very hand wavey project - tons of questions about what it wants to look like and whatnot | 12:57 |
samueldmq | mordred: well, yes but I think there might be a few differences between shade normalize and the resource objs | 12:58 |
mordred | and like - taking image for example - I think we might want to move the _v1 methods into openstack/image/v1/_proxy and the _v2 methods into openstack/image/v2/_proxy.py - and then make sure both proxy classes have a create_image method that takes the same arguments - and then we can just have the shade layer create_image method call self.image.create_image(*args, **kwargs) | 12:58 |
samueldmq | I don't remember an exemp out of my head but I think I've taken a look into that | 12:58 |
samueldmq | but definitely something to do | 12:59 |
mordred | samueldmq: yes - there definitely are | 12:59 |
mordred | samueldmq: it's also possible that the upload_image example I just wrote about might be a TERRIBLE way to go about doing things :) | 12:59 |
samueldmq | mordred: nice (image eg.) | 12:59 |
*** lbragstad has joined #openstack-sdks | 12:59 | |
mordred | so - there's certainly some exploration to do :) | 12:59 |
samueldmq | hehe but I got the idea | 12:59 |
mordred | \o/ | 13:00 |
mordred | man, I need more coffee already this morning | 13:00 |
samueldmq | mordred: I want to have functional tests running against real clouds | 13:00 |
samueldmq | like in a period job running once a day or somehting | 13:00 |
samueldmq | I do'nt need to say only testing against devstack is very biased :-) | 13:01 |
samueldmq | mordred: ++ more coffee is always a good idea | 13:02 |
*** bobh has joined #openstack-sdks | 13:03 | |
*** lbragstad has quit IRC | 13:09 | |
*** lbragstad has joined #openstack-sdks | 13:23 | |
*** lbragstad has quit IRC | 13:24 | |
*** lbragstad has joined #openstack-sdks | 13:24 | |
*** lbragstad has quit IRC | 13:26 | |
*** lbragstad_ has joined #openstack-sdks | 13:26 | |
*** lbragstad_ has quit IRC | 13:26 | |
*** lbragstad has joined #openstack-sdks | 13:27 | |
*** ttsiouts has quit IRC | 13:27 | |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK https://review.openstack.org/592303 | 13:28 |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods. https://review.openstack.org/604811 | 13:28 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Fix location region field in docs https://review.openstack.org/605081 | 13:59 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Fix location region field in docs https://review.openstack.org/605081 | 14:00 |
*** dtantsur|bbl is now known as dtantsur | 14:04 | |
*** ttsiouts has joined #openstack-sdks | 14:05 | |
*** e0ne_ has quit IRC | 14:10 | |
*** e0ne has joined #openstack-sdks | 14:10 | |
*** mriedem has joined #openstack-sdks | 14:26 | |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Add support for per-service rate limits https://review.openstack.org/604521 | 14:27 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Replace TaskManager with a semaphore and lock https://review.openstack.org/604926 | 14:27 |
*** Luzi has quit IRC | 14:33 | |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Import rate limiting TaskManager from nodepool https://review.openstack.org/574285 | 14:41 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Make RateLimitingTaskManager the TaskManager https://review.openstack.org/604520 | 14:41 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Add support for per-service rate limits https://review.openstack.org/604521 | 14:41 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Replace TaskManager with a semaphore and lock https://review.openstack.org/604926 | 14:41 |
*** hwoarang has left #openstack-sdks | 14:51 | |
*** ttsiouts has quit IRC | 15:08 | |
*** ttsiouts has joined #openstack-sdks | 15:10 | |
*** dave-mccowan has quit IRC | 15:14 | |
*** dave-mccowan has joined #openstack-sdks | 15:36 | |
*** Leo_m has joined #openstack-sdks | 15:36 | |
*** e0ne has quit IRC | 15:37 | |
*** ttsiouts has quit IRC | 15:40 | |
*** ttsiouts has joined #openstack-sdks | 15:43 | |
*** bobh_ has joined #openstack-sdks | 16:03 | |
openstackgerrit | Merged openstack/openstacksdk master: Allow search on containers https://review.openstack.org/600680 | 16:04 |
*** bobh has quit IRC | 16:06 | |
*** dave-mccowan has quit IRC | 16:13 | |
openstackgerrit | Merged openstack/openstacksdk master: Normalize image when using PUT on Glance v2 https://review.openstack.org/602031 | 16:17 |
openstackgerrit | Merged openstack/openstacksdk master: Run all tasks through the threadpool https://review.openstack.org/603739 | 16:17 |
*** ttsiouts has quit IRC | 16:20 | |
*** ttsiouts has joined #openstack-sdks | 16:20 | |
*** ttsiouts has quit IRC | 16:25 | |
samueldmq | fwiw https://review.openstack.org/#/c/605081/ is a really quick review/merge | 16:40 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize network resources https://review.openstack.org/602218 | 16:40 |
*** dtantsur is now known as dtantsur|afk | 16:45 | |
mordred | samueldmq: why yes it is! | 16:50 |
samueldmq | mordred: \o/ | 16:50 |
*** dtantsur|afk has quit IRC | 16:51 | |
timburke | mordred: samueldmq: fyi on the container headers sample -- looks like that's coming from radosgw; i wouldn't rely on there being a X-Container-Bytes-Used-Actual header | 16:52 |
timburke | up to you whether to expose it to users anyway, but it's not something swift would respond with | 16:53 |
samueldmq | timburke: hmm but X-Container-Bytes-Used should be there right? | 16:53 |
timburke | yup! | 16:53 |
mordred | timburke: thanks! yeah - I'd like the sdk interface be things swift sends | 16:53 |
samueldmq | kk we wont rely on radosgw. it is not even 100% compatible | 16:53 |
samueldmq | it returns me 200 OK when I do get on an object that does not exist | 16:54 |
timburke | hmm... :-/ | 16:54 |
mordred | that seems like an unfortunate life choice for it | 16:54 |
samueldmq | I will open a bug on that project | 16:54 |
timburke | i've got my own beef with some of our choices of response code, but that's pretty bad | 16:55 |
samueldmq | but it's hard to say you're compatible with an api that you don't run that api's funcional tests | 16:55 |
samueldmq | especially in a big and dynamic project like opesntack :-) | 16:55 |
mordred | that said - some amount of compat code in sdk to work around such things on behalf of users is in-bounds for sdk I think - we work around some weird life choices in rax publiccloud, for instance - but we should definitely keep the interface to be what's in swift | 16:55 |
samueldmq | mordred: agreed. we should try to keep it within openstack world | 16:56 |
mordred | ++ | 16:56 |
samueldmq | in a few days someone runs openstack api's with amazon underneath | 16:56 |
samueldmq | and we don't need to make shade work with that all | 16:56 |
*** dtantsur has joined #openstack-sdks | 16:57 | |
mordred | yeah ... I don't have much personal desire for that thing to have success | 16:57 |
samueldmq | :-) | 16:58 |
*** dtantsur is now known as dtantsur|afk | 16:58 | |
openstackgerrit | Merged openstack/openstacksdk master: Fix location region field in docs https://review.openstack.org/605081 | 16:59 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize subnet resources https://review.openstack.org/602228 | 17:30 |
*** edisonxiang has quit IRC | 17:30 | |
samueldmq | mordred: on the get container convo ... | 17:42 |
samueldmq | if I look up the headers and create an object including storage_policy | 17:42 |
samueldmq | an entity returned by get_container would be different than one returned by list_containers | 17:43 |
samueldmq | because the one from get would have more attrs (e.g storage_policy) | 17:43 |
samueldmq | which is a bit weird | 17:43 |
samueldmq | or is it okay if a GET returns more details than a list do? | 17:50 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get container https://review.openstack.org/596546 | 18:16 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize container resources https://review.openstack.org/602233 | 18:18 |
Shrews | mordred: comment on https://review.openstack.org/#/c/604521/6/openstack/connection.py | 18:31 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize object resources https://review.openstack.org/602234 | 18:34 |
mordred | Shrews: your comment is correct | 18:36 |
Shrews | well that's a first | 18:37 |
openstackgerrit | Merged openstack/keystoneauth master: Reformat Adapter docstring https://review.openstack.org/605042 | 18:41 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Trim away the cover and py35 jobs https://review.openstack.org/605168 | 18:49 |
*** gouthamr has quit IRC | 18:52 | |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Clean up python3 test and remove duplicate jobs https://review.openstack.org/604517 | 18:52 |
*** dmellado has quit IRC | 18:53 | |
*** bobh_ has quit IRC | 18:55 | |
*** bobh has joined #openstack-sdks | 18:56 | |
*** bobh has quit IRC | 19:01 | |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Clean up python3 test and remove duplicate jobs https://review.openstack.org/604517 | 19:01 |
openstackgerrit | Monty Taylor proposed openstack/openstacksdk master: Restore timeout_scaling_factor https://review.openstack.org/604628 | 19:05 |
*** bobh has joined #openstack-sdks | 19:11 | |
*** bobh has quit IRC | 19:15 | |
*** Leo_m has quit IRC | 19:18 | |
*** Leo_m has joined #openstack-sdks | 19:19 | |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK https://review.openstack.org/592303 | 19:34 |
openstackgerrit | Matthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods. https://review.openstack.org/604811 | 19:34 |
*** e0ne has joined #openstack-sdks | 19:41 | |
*** bobh has joined #openstack-sdks | 19:44 | |
*** gouthamr_ has joined #openstack-sdks | 20:05 | |
*** e0ne has quit IRC | 20:05 | |
*** dmellado has joined #openstack-sdks | 20:07 | |
*** e0ne has joined #openstack-sdks | 20:19 | |
*** gouthamr_ is now known as gouthamr | 20:39 | |
*** e0ne has quit IRC | 20:43 | |
*** ttsiouts has joined #openstack-sdks | 20:53 | |
*** Qiming has quit IRC | 21:05 | |
*** Qiming has joined #openstack-sdks | 21:06 | |
*** slaweq has quit IRC | 21:27 | |
*** slaweq has joined #openstack-sdks | 21:27 | |
*** bobh has quit IRC | 21:31 | |
*** Qiming has quit IRC | 21:40 | |
*** Qiming has joined #openstack-sdks | 21:43 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for catalyst https://review.openstack.org/605245 | 22:05 |
*** ttsiouts has quit IRC | 22:05 | |
*** ttsiouts has joined #openstack-sdks | 22:06 | |
*** mriedem has quit IRC | 22:10 | |
*** ttsiouts has quit IRC | 22:10 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for ecs https://review.openstack.org/605248 | 22:11 |
*** gildub has joined #openstack-sdks | 22:15 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for switchengines https://review.openstack.org/605249 | 22:16 |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for vexxhost https://review.openstack.org/605252 | 22:22 |
*** bobh has joined #openstack-sdks | 22:23 | |
*** Qiming has quit IRC | 22:23 | |
*** Qiming has joined #openstack-sdks | 22:26 | |
openstackgerrit | Samuel de Medeiros Queiroz proposed openstack/openstacksdk master: Add compute API info and fix provider names https://review.openstack.org/605253 | 22:30 |
samueldmq | these 5 are very neat too ^ just updating the vendor-support info | 22:31 |
*** Qiming has quit IRC | 22:33 | |
*** Qiming has joined #openstack-sdks | 22:42 | |
*** Leo_m has quit IRC | 22:43 | |
*** bobh has quit IRC | 23:08 | |
openstackgerrit | Merged openstack/openstacksdk master: Allow search on objects https://review.openstack.org/600683 | 23:08 |
*** tosky has quit IRC | 23:11 | |
*** dave-mccowan has joined #openstack-sdks | 23:19 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!