Tuesday, 2018-09-25

openstackgerritMonty Taylor proposed openstack/openstacksdk master: WIP Replace TaskManager with a semaphore and lock  https://review.openstack.org/60492600:02
*** zigo has quit IRC00:05
*** zigo has joined #openstack-sdks00:09
*** mriedem_away has quit IRC00:10
*** gildub has joined #openstack-sdks00:39
*** dayou_ has joined #openstack-sdks00:40
*** dayou_ has quit IRC00:43
*** chenyb4 has joined #openstack-sdks01:35
*** dave-mccowan has quit IRC02:29
*** gildub has quit IRC02:40
*** imacdonn has quit IRC02:50
*** imacdonn has joined #openstack-sdks02:50
*** dave-mccowan has joined #openstack-sdks02:50
*** edisonxiang has joined #openstack-sdks03:20
*** e0ne has joined #openstack-sdks04:28
*** dayou has quit IRC04:36
*** dayou has joined #openstack-sdks04:36
*** e0ne has quit IRC04:51
*** e0ne has joined #openstack-sdks05:09
*** e0ne has quit IRC05:10
*** lbragstad has quit IRC05:18
*** chenyb4 has quit IRC05:50
*** slaweq has joined #openstack-sdks06:18
*** chenyb4 has joined #openstack-sdks06:31
*** Luzi has joined #openstack-sdks06:53
*** slaweq has quit IRC06:58
openstackgerritMerged openstack/keystoneauth master: Cache root urls with and without trailing slashes  https://review.openstack.org/60463507:03
*** slaweq has joined #openstack-sdks07:11
Horrorcatmordred, I was about to report it as a bug, but I’m totally lost on the storyboard thing. Is there a primer on how to use it to report issues?07:11
*** slaweq has quit IRC07:16
*** gildub has joined #openstack-sdks07:35
*** e0ne has joined #openstack-sdks07:52
*** e0ne has quit IRC07:53
*** tosky has joined #openstack-sdks07:54
*** ttsiouts has joined #openstack-sdks08:27
*** chenyb4 has quit IRC08:30
*** dtantsur|afk is now known as dtantsur08:38
*** ttsiouts has quit IRC08:46
*** ttsiouts has joined #openstack-sdks08:47
*** slaweq has joined #openstack-sdks08:48
*** ttsiouts has quit IRC08:51
*** e0ne has joined #openstack-sdks08:59
*** ttsiouts has joined #openstack-sdks09:07
*** ttsiouts has quit IRC09:10
*** ttsiouts has joined #openstack-sdks09:10
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get object  https://review.openstack.org/59719809:48
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Remove profile  https://review.openstack.org/60441410:08
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Set endpoint_override from endpoint with noauth  https://review.openstack.org/60441510:08
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Use discovery instead of config to create proxies  https://review.openstack.org/60029210:08
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Remove api version default values  https://review.openstack.org/60033010:08
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Special case network and use it in openstack.cloud  https://review.openstack.org/60464510:08
*** e0ne has quit IRC10:12
*** ttsiouts has quit IRC10:35
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK  https://review.openstack.org/59230310:43
openstackgerritMonty Taylor proposed openstack/openstacksdk master: WIP Replace TaskManager with a semaphore and lock  https://review.openstack.org/60492610:44
*** stephenfin_ is now known as stephenfin10:48
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods.  https://review.openstack.org/60481110:53
*** e0ne has joined #openstack-sdks10:59
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get object  https://review.openstack.org/59719810:59
*** ttsiouts has joined #openstack-sdks11:04
*** e0ne_ has joined #openstack-sdks11:22
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Reformat Adapter docstring  https://review.openstack.org/60504211:24
openstackgerritMonty Taylor proposed openstack/keystoneauth master: Add support for client-side rate limiting  https://review.openstack.org/60504311:24
*** e0ne has quit IRC11:25
*** dtantsur is now known as dtantsur|bbl11:25
openstackgerrittianhui proposed openstack/python-openstackclient master: Add NODE and HOST parameters in "server create" help text  https://review.openstack.org/59194411:42
*** ttsiouts has quit IRC12:09
samueldmqmorning sdk12:15
samueldmqmordred: o/12:15
samueldmqmordred: I'm not getting what you're saying here https://review.openstack.org/#/c/59654612:15
openstackgerritMonty Taylor proposed openstack-infra/shade master: Remove the task manager  https://review.openstack.org/60505212:19
mordredmorning samueldmq ! thanks for all the great patches you've been working on12:20
mordredsamueldmq: oh - what I'm saying is that we don't need get_container to return a munch of its contents - there is another call that does that already, it's list_objects12:21
samueldmqmordred: my pleasure :-)12:21
mordred(containers and objects are ... weird)12:21
*** ttsiouts has joined #openstack-sdks12:21
mordredso get_container returns the information about the container object itself - which is the stuff returned in the headers12:23
samueldmqin the get_container too..12:23
samueldmqI just want to return 'bytes', 'count', 'last_modified', 'location', 'name', 'properties'12:24
mordredyes - I think that's a great idea ... but I think you can normalize that from the headers that are already being fetched12:27
mordred(and then obviously you'll need to leave the old ugly header names in if strict=False)12:28
mordredsamueldmq: storage_policy looks like another good one to have12:28
*** gildub has quit IRC12:30
mordredsamueldmq: http://paste.openstack.org/show/730697/ there's a payload from a container we have for infra for logs12:32
openstackgerritPavlo Shchelokovskyy proposed openstack/python-openstackclient master: Add --name-lookup-one-by-one option to server list  https://review.openstack.org/56834512:36
samueldmqmordred: hmm sure, so perhaps I can leverage all that from the headers...12:41
samueldmqmordred: so I'm doing /account/ to list containers and /account/container to list objects12:41
samueldmqperhps I can do just HEAD on hte container and object and normalize what I get, instead of always listing everything to get one12:42
mordredsamueldmq: yes - I think for swift this is a good idea12:42
samueldmqmordred: kk I've validated sdk against vexxhost, ecs, switchengines, ormuco, catalyst and devstack (pretty obvious but ok for my msc)12:43
mordredsamueldmq: neat!12:44
samueldmqmordred: it's behaving all fine, except glance v1 which is entirely broken in sdk12:44
mordredsamueldmq: oh golly, really?12:44
samueldmqwe're passing info in the req body, when glance v1 expects things in the headers12:44
samueldmqe.g disk_format12:44
samueldmqmordred: yes :-)12:44
samueldmqinteresting part was to figure it out, since even docs for glance v1 are hard to find12:45
mordredsamueldmq: I see us setting headers in _update_image_properties_v1 ...12:45
samueldmqmordred: but not for the upload using put v112:46
mordredoh - you are so right!12:46
samueldmqmordred: https://github.com/openstack/openstacksdk/blob/master/openstack/cloud/openstackcloud.py#L483112:46
mordredyup12:47
samueldmqmordred: that was a good catch12:48
mordred++ ... testing against real things is important :)12:48
mordredsamueldmq: did you find any clouds with glance v1 still?12:48
samueldmqmordred: ah, besides all that, I have patches for normalizing network/subnet container and objects12:48
samueldmqso they have a location and properties fields in it12:48
mordredyes! I saw these and am excited by them (haven't fully looked at them yet, but will try to today)12:49
samueldmqand look the same regarless what cloud is  underneath12:49
samueldmqmordred: they're not passing local tests yet, because unitt tests were not expecting too many fields12:49
samueldmqnormalize is important to everyhting... but for now I focused on these in my scope :(12:50
samueldmqmordred: glance v1 was interesting.. nobody runs it by default, but some still have, e.g catalyst12:50
samueldmqI had to set image_endpoint explicitly i nthe clouds.yml12:50
samueldmqso it uses endpoint_override (iirc)12:50
mordredwell - good to hear nobody is using it by default :)12:54
samueldmqhehe no ...12:54
mordredsamueldmq: so - when you're ready to really poke yourself in the eye ...12:54
samueldmqbtw I'll update vendor _support later on12:55
mordredsamueldmq: one of the things on the todo list, which is very similar to your normalize work12:56
mordredsamueldmq: is to get the shade layer to start using the underlying sdk layer - the sdk Resource objects are the equiv of the _normalize methods in the shade layer12:57
openstackgerritMerged openstack/openstacksdk master: Update the URL in doc  https://review.openstack.org/60473812:57
mordredsamueldmq: it's a very hand wavey project - tons of questions about what it wants to look like and whatnot12:57
samueldmqmordred: well, yes but I think there might be a few differences between shade normalize and the resource objs12:58
mordredand like - taking image for example - I think we might want to move the _v1 methods into openstack/image/v1/_proxy and the _v2 methods into openstack/image/v2/_proxy.py - and then make sure both proxy classes have a create_image method that takes the same arguments - and then we can just have the shade layer create_image method call self.image.create_image(*args, **kwargs)12:58
samueldmqI don't remember an exemp out of my head but I think I've taken a look into that12:58
samueldmqbut definitely something to do12:59
mordredsamueldmq: yes - there definitely are12:59
mordredsamueldmq: it's also possible that the upload_image example I just wrote about might be a TERRIBLE way to go about doing things :)12:59
samueldmqmordred: nice (image eg.)12:59
*** lbragstad has joined #openstack-sdks12:59
mordredso - there's certainly some exploration to do :)12:59
samueldmqhehe but I got the idea12:59
mordred\o/13:00
mordredman, I need more coffee already this morning13:00
samueldmqmordred: I want to have functional tests running against real clouds13:00
samueldmqlike in a period job running once a day or somehting13:00
samueldmqI do'nt need to say only testing against devstack is very biased :-)13:01
samueldmqmordred: ++ more coffee is always a good idea13:02
*** bobh has joined #openstack-sdks13:03
*** lbragstad has quit IRC13:09
*** lbragstad has joined #openstack-sdks13:23
*** lbragstad has quit IRC13:24
*** lbragstad has joined #openstack-sdks13:24
*** lbragstad has quit IRC13:26
*** lbragstad_ has joined #openstack-sdks13:26
*** lbragstad_ has quit IRC13:26
*** lbragstad has joined #openstack-sdks13:27
*** ttsiouts has quit IRC13:27
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK  https://review.openstack.org/59230313:28
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods.  https://review.openstack.org/60481113:28
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Fix location region field in docs  https://review.openstack.org/60508113:59
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Fix location region field in docs  https://review.openstack.org/60508114:00
*** dtantsur|bbl is now known as dtantsur14:04
*** ttsiouts has joined #openstack-sdks14:05
*** e0ne_ has quit IRC14:10
*** e0ne has joined #openstack-sdks14:10
*** mriedem has joined #openstack-sdks14:26
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Add support for per-service rate limits  https://review.openstack.org/60452114:27
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Replace TaskManager with a semaphore and lock  https://review.openstack.org/60492614:27
*** Luzi has quit IRC14:33
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Import rate limiting TaskManager from nodepool  https://review.openstack.org/57428514:41
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Make RateLimitingTaskManager the TaskManager  https://review.openstack.org/60452014:41
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Add support for per-service rate limits  https://review.openstack.org/60452114:41
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Replace TaskManager with a semaphore and lock  https://review.openstack.org/60492614:41
*** hwoarang has left #openstack-sdks14:51
*** ttsiouts has quit IRC15:08
*** ttsiouts has joined #openstack-sdks15:10
*** dave-mccowan has quit IRC15:14
*** dave-mccowan has joined #openstack-sdks15:36
*** Leo_m has joined #openstack-sdks15:36
*** e0ne has quit IRC15:37
*** ttsiouts has quit IRC15:40
*** ttsiouts has joined #openstack-sdks15:43
*** bobh_ has joined #openstack-sdks16:03
openstackgerritMerged openstack/openstacksdk master: Allow search on containers  https://review.openstack.org/60068016:04
*** bobh has quit IRC16:06
*** dave-mccowan has quit IRC16:13
openstackgerritMerged openstack/openstacksdk master: Normalize image when using PUT on Glance v2  https://review.openstack.org/60203116:17
openstackgerritMerged openstack/openstacksdk master: Run all tasks through the threadpool  https://review.openstack.org/60373916:17
*** ttsiouts has quit IRC16:20
*** ttsiouts has joined #openstack-sdks16:20
*** ttsiouts has quit IRC16:25
samueldmqfwiw https://review.openstack.org/#/c/605081/ is a really quick review/merge16:40
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize network resources  https://review.openstack.org/60221816:40
*** dtantsur is now known as dtantsur|afk16:45
mordredsamueldmq: why yes it is!16:50
samueldmqmordred: \o/16:50
*** dtantsur|afk has quit IRC16:51
timburkemordred: samueldmq: fyi on the container headers sample -- looks like that's coming from radosgw; i wouldn't rely on there being a X-Container-Bytes-Used-Actual header16:52
timburkeup to you whether to expose it to users anyway, but it's not something swift would respond with16:53
samueldmqtimburke: hmm but X-Container-Bytes-Used should be there right?16:53
timburkeyup!16:53
mordredtimburke: thanks! yeah - I'd like the sdk interface be things swift sends16:53
samueldmqkk we wont rely on radosgw. it is not even 100% compatible16:53
samueldmqit returns me 200 OK when I do get on an object that does not exist16:54
timburkehmm... :-/16:54
mordredthat seems like an unfortunate life choice for it16:54
samueldmqI will open a bug on that project16:54
timburkei've got my own beef with some of our choices of response code, but that's pretty bad16:55
samueldmqbut it's hard to say you're compatible with an api that you don't run that api's funcional tests16:55
samueldmqespecially in a big and dynamic project like opesntack :-)16:55
mordredthat said - some amount of compat code in sdk to work around such things on behalf of users is in-bounds for sdk I think - we work around some weird life choices in rax publiccloud, for instance - but we should definitely keep the interface to be what's in swift16:55
samueldmqmordred: agreed. we should try to keep it within openstack world16:56
mordred++16:56
samueldmqin a few days someone runs openstack api's with amazon underneath16:56
samueldmqand we don't need to make shade work with that all16:56
*** dtantsur has joined #openstack-sdks16:57
mordredyeah ... I don't have much personal desire for that thing to have success16:57
samueldmq:-)16:58
*** dtantsur is now known as dtantsur|afk16:58
openstackgerritMerged openstack/openstacksdk master: Fix location region field in docs  https://review.openstack.org/60508116:59
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize subnet resources  https://review.openstack.org/60222817:30
*** edisonxiang has quit IRC17:30
samueldmqmordred: on the get container convo ...17:42
samueldmqif I look up the headers and create an object including storage_policy17:42
samueldmqan entity returned by get_container would be different than one returned by list_containers17:43
samueldmqbecause the one from get would have more attrs (e.g storage_policy)17:43
samueldmqwhich is a bit weird17:43
samueldmqor is it okay if a GET returns more details than a list do?17:50
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Allow returning munch on create and get container  https://review.openstack.org/59654618:16
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize container resources  https://review.openstack.org/60223318:18
Shrewsmordred: comment on https://review.openstack.org/#/c/604521/6/openstack/connection.py18:31
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Normalize object resources  https://review.openstack.org/60223418:34
mordredShrews: your comment is correct18:36
Shrewswell that's a first18:37
openstackgerritMerged openstack/keystoneauth master: Reformat Adapter docstring  https://review.openstack.org/60504218:41
openstackgerritMonty Taylor proposed openstack-infra/shade master: Trim away the cover and py35 jobs  https://review.openstack.org/60516818:49
*** gouthamr has quit IRC18:52
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Clean up python3 test and remove duplicate jobs  https://review.openstack.org/60451718:52
*** dmellado has quit IRC18:53
*** bobh_ has quit IRC18:55
*** bobh has joined #openstack-sdks18:56
*** bobh has quit IRC19:01
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Clean up python3 test and remove duplicate jobs  https://review.openstack.org/60451719:01
openstackgerritMonty Taylor proposed openstack/openstacksdk master: Restore timeout_scaling_factor  https://review.openstack.org/60462819:05
*** bobh has joined #openstack-sdks19:11
*** bobh has quit IRC19:15
*** Leo_m has quit IRC19:18
*** Leo_m has joined #openstack-sdks19:19
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: Support firewall service for SDK  https://review.openstack.org/59230319:34
openstackgerritMatthias Lisin proposed openstack/openstacksdk master: openstackcloud.py: Implement FWaaS wrapper methods.  https://review.openstack.org/60481119:34
*** e0ne has joined #openstack-sdks19:41
*** bobh has joined #openstack-sdks19:44
*** gouthamr_ has joined #openstack-sdks20:05
*** e0ne has quit IRC20:05
*** dmellado has joined #openstack-sdks20:07
*** e0ne has joined #openstack-sdks20:19
*** gouthamr_ is now known as gouthamr20:39
*** e0ne has quit IRC20:43
*** ttsiouts has joined #openstack-sdks20:53
*** Qiming has quit IRC21:05
*** Qiming has joined #openstack-sdks21:06
*** slaweq has quit IRC21:27
*** slaweq has joined #openstack-sdks21:27
*** bobh has quit IRC21:31
*** Qiming has quit IRC21:40
*** Qiming has joined #openstack-sdks21:43
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for catalyst  https://review.openstack.org/60524522:05
*** ttsiouts has quit IRC22:05
*** ttsiouts has joined #openstack-sdks22:06
*** mriedem has quit IRC22:10
*** ttsiouts has quit IRC22:10
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for ecs  https://review.openstack.org/60524822:11
*** gildub has joined #openstack-sdks22:15
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for switchengines  https://review.openstack.org/60524922:16
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Update vendor support info for vexxhost  https://review.openstack.org/60525222:22
*** bobh has joined #openstack-sdks22:23
*** Qiming has quit IRC22:23
*** Qiming has joined #openstack-sdks22:26
openstackgerritSamuel de Medeiros Queiroz proposed openstack/openstacksdk master: Add compute API info and fix provider names  https://review.openstack.org/60525322:30
samueldmqthese 5 are very neat too ^ just updating the vendor-support info22:31
*** Qiming has quit IRC22:33
*** Qiming has joined #openstack-sdks22:42
*** Leo_m has quit IRC22:43
*** bobh has quit IRC23:08
openstackgerritMerged openstack/openstacksdk master: Allow search on objects  https://review.openstack.org/60068323:08
*** tosky has quit IRC23:11
*** dave-mccowan has joined #openstack-sdks23:19

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!