Monday, 2020-06-15

*** dasp_ has joined #openstack-swift00:28
*** dasp has quit IRC00:29
*** m75abrams has joined #openstack-swift04:19
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-swift04:33
*** irclogbot_1 has quit IRC06:05
*** irclogbot_0 has joined #openstack-swift06:07
*** psachin has joined #openstack-swift07:26
*** dosaboy has joined #openstack-swift07:43
-openstackstatus- NOTICE: uWSGI made a new release that breaks devstack, please refrain from rechecking until a devstack fix is merged.07:44
*** rpittau|afk is now known as rpittau08:00
*** ccamacho has joined #openstack-swift08:36
*** mvkr has joined #openstack-swift09:48
*** rpittau is now known as rpittau|bbl10:03
*** ccamacho has quit IRC10:20
*** rcernin has joined #openstack-swift10:44
*** rcernin has quit IRC10:54
*** ccamacho has joined #openstack-swift10:56
*** rpittau|bbl is now known as rpittau12:04
*** psachin has quit IRC13:15
*** jv__ has joined #openstack-swift13:52
*** jv__ has quit IRC13:57
*** jv__ has joined #openstack-swift13:57
*** jv has joined #openstack-swift13:58
*** gyee has joined #openstack-swift16:03
openstackgerritTim Burke proposed openstack/swift master: py3: Fix expirer container generation  https://review.opendev.org/73526216:11
timburkeso i got a nudge last week about doing a stable release for train -- and i realized that there are a couple py3 issues in flight that we probably ought to backport16:12
timburkethat's one ^^^ -- the other is https://review.opendev.org/#/c/734721/ (though it maybe needs tests -- there's some exercising of it with the tests added by https://review.opendev.org/#/c/685455/ at least)16:13
patchbotpatch 734721 - swift - py3: (Better) fix percentages in configs - 4 patch sets16:13
patchbotpatch 685455 - swift - py3: Allow percentages in configs (MERGED) - 1 patch set16:13
*** rpittau is now known as rpittau|afk16:17
openstackgerritTim Burke proposed openstack/swift master: Get rid of memcache attr on proxy-server app  https://review.opendev.org/73548416:50
timburkei can't help but feel like https://review.opendev.org/#/c/30481/ went a bit too far in trying to have clear_info_cache call into set_info_cache :-/17:08
patchbotpatch 30481 - swift - get_info - removes duplicate code (Take 3) (MERGED) - 17 patch sets17:08
openstackgerritTim Burke proposed openstack/swift master: proxy: Stop killing memcache entries on 5xx responses  https://review.opendev.org/73535918:19
claygdo any of our s3api experts know anything about this decorator: https://github.com/openstack/swift/blob/master/swift/common/middleware/s3api/controllers/multi_upload.py#L13418:26
claygit seems to fire off a for-realzy-to-disk HEAD request to the container DB for every part upload 🤷‍♂️18:27
timburkeclayg, yeah, it tries to do it as a get_container_info call, but since we haven't done auth yet to translate to a for-realzy swift path, that basically doesn't work -- which is part of what prompted me to do https://review.opendev.org/#/c/668064/18:38
patchbotpatch 668064 - swift - Give internal clients the option of getting contai... - 5 patch sets18:38
timburkeneeds tests tho18:38
claygit's not obvious to me why "doesn't have auth yet" => "go to disk NOW then"19:00
*** m75abrams has quit IRC19:09
timburkebasically, no part of the system has the context to know both (1) the real swift path and (2) that s3api would be perfectly content to get this info from memcache19:09
timburkein s3api, we know we're happy with memcache results, and will even try to do the normal get_container_info thing if we expect that'll work (ie, if we've already made an auth'ed request)19:10
timburkebut if we haven't authed, we expect get_container_info to fail -- without a real swift path, get_container_info's gonna fail: https://github.com/openstack/swift/blob/2.25.0/swift/proxy/controllers/base.py#L337-L34019:11
timburkeso our only real option is to do a HEAD instead19:11
claygwhat about these TEST requests that the ACL stuff will do?19:12
claygis there any request besides a HEAD on the container we could throw at swift that will make it through auth and return the account name?19:12
timburkemight be a viable alternative, get us to the auth'ed state without any backend requests 🤔19:12
zaitcevI do not understand. Do you want to take AUTH_xxxxx from the container path and reverse-lookup the account name in the auth system?19:16
claygthis doens't obviously break; but I'm not sure what it's doing exactly -> https://gist.github.com/clayg/72494e96b616c92fb0ea95e062f8793d19:18
zaitceve.g. KSAU_7f80fce9f306430f87aaaebf29ec15c7 -> ksadmten19:18
claygzaitcev: I think when a s3 client wants to HEAD their bucket "foo" - we don't know (yet) what the swift path will be19:18
claygat some point somehow the bucket controller seems to figure it out - and there was "cheat" where calling get_container_info would sometimes just use a bucket HEAD19:19
zaitcevI thought that we cheated by examining the auth token. The token says the account that obtained it. Then, we assume that account as the account under which we search for a container with the same name as S3 bucket. That is what makes our buckets non-global.19:24
timburkezaitcev, we do get back an auth token from keystone and use that to map to the account, but that's down in s3token, away from the caller in s3api19:42
timburke(and of course, other auth systems do something similar but a little different)19:42
timburkeclayg, that gist seems reasonable19:43
claygit seems totally opaque to me - i do NOT understand what these TEST requests are19:43
claygbut it does avoid going to disk on part upload19:44
timburkeTEST is relying on the proxy server's handling around https://github.com/openstack/swift/blob/master/swift/proxy/server.py#L544-L54619:45
claygoh, so we expect a 405 response - seems fine to me - but it would have gone ahead and AUTH'd!?  that's *awesome*!?  right?20:03
*** evrardjp has quit IRC20:11
*** evrardjp has joined #openstack-swift20:13
timburkegotta make sure that if some middleware actually implemented a TEST method that they'd be allowed, right? ;-)20:22
*** ccamacho has quit IRC20:51
openstackgerritTim Burke proposed openstack/swift master: Get rid of memcache attr on proxy-server app  https://review.opendev.org/73548420:57
openstackgerritClay Gerrard proposed openstack/swift master: s3api: Don't do naive HEAD request for auth  https://review.opendev.org/73573821:19
*** threestrands has joined #openstack-swift21:36
*** gmann is now known as gmann_afk21:39
openstackgerritClay Gerrard proposed openstack/swift master: Clean up some proxy tests  https://review.opendev.org/73574122:18
*** rcernin has joined #openstack-swift23:16
timburkethinking about https://bugs.launchpad.net/swift/+bug/1883302 -- reaper and reconciler also use direct_client; is that desirable?23:31
openstackLaunchpad bug 1883302 in OpenStack Object Storage (swift) "container-sharder should send stat updates using replication network" [Undecided,Confirmed]23:31
timburkeexpirer, too, since it uses some reconciler machinery23:32
timburkethen there's all the uses of internal_client, too...23:34

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!