mattoliverau | morning | 00:10 |
---|---|---|
*** ianychoi_ has joined #openstack-swift | 00:18 | |
*** ianychoi has quit IRC | 00:20 | |
*** ndk_ has quit IRC | 00:39 | |
*** zaitcev has quit IRC | 01:22 | |
*** zaitcev has joined #openstack-swift | 01:35 | |
*** ChanServ sets mode: +v zaitcev | 01:35 | |
*** spsurya has joined #openstack-swift | 01:52 | |
*** itlinux has joined #openstack-swift | 01:58 | |
*** BjoernT_ has quit IRC | 02:02 | |
*** BjoernT has joined #openstack-swift | 02:02 | |
*** BjoernT has quit IRC | 02:06 | |
*** itlinux_ has joined #openstack-swift | 02:14 | |
*** itlinux has quit IRC | 02:18 | |
*** zaitcev has quit IRC | 02:31 | |
*** gkadam has quit IRC | 02:38 | |
*** gkadam has joined #openstack-swift | 02:39 | |
*** zaitcev has joined #openstack-swift | 02:43 | |
*** ChanServ sets mode: +v zaitcev | 02:43 | |
*** itlinux_ has quit IRC | 02:54 | |
zaitcev | timburke: Firefox detected a potential security threat and did not continue to storyboard-dev.openstack.org. If you visit this site, attackers could try to steal information like your passwords, emails, or credit card details. | 02:55 |
zaitcev | "The certificate is not trusted because it is self-signed. " | 02:55 |
zaitcev | In the age of Let's Encrypt, there's no reason for this | 02:56 |
*** m75abrams has joined #openstack-swift | 03:01 | |
hugokuo | morning | 03:05 |
*** psachin has joined #openstack-swift | 03:29 | |
*** m75abrams has quit IRC | 03:31 | |
*** m75abrams has joined #openstack-swift | 03:32 | |
*** itlinux has joined #openstack-swift | 03:35 | |
*** BjoernT has joined #openstack-swift | 03:36 | |
*** itlinux has quit IRC | 03:36 | |
*** zaitcev has quit IRC | 03:49 | |
*** zaitcev has joined #openstack-swift | 03:49 | |
*** ChanServ sets mode: +v zaitcev | 03:49 | |
*** BjoernT has quit IRC | 03:53 | |
*** gkadam has quit IRC | 04:01 | |
*** gkadam has joined #openstack-swift | 04:01 | |
*** zaitcev has quit IRC | 04:24 | |
kota_ | timburke: not yet for storyboard, will do. | 04:33 |
mattoliverau | timburke: I need to fly to Melbourne tomorrow. Which involves driving to the closest city to fly. So wont make tomorrows meeting. Sorry. | 04:40 |
*** pcaruana has joined #openstack-swift | 04:54 | |
*** pcaruana has quit IRC | 04:59 | |
*** gkadam has quit IRC | 05:05 | |
kota_ | timburke: oh story board, my chrome browser says NET::ERR_CERT_AUTHORITY_INVALID too, as well as zaitcev. | 05:33 |
*** e0ne has joined #openstack-swift | 05:51 | |
*** e0ne has quit IRC | 06:22 | |
*** takamatsu has quit IRC | 06:46 | |
*** pcaruana has joined #openstack-swift | 06:56 | |
zigo | kota_: I always get a 403 when trying swift with s3cmd ... :/ | 06:57 |
zigo | I don't get what I'm doing wrong. | 06:58 |
*** rdejoux has joined #openstack-swift | 07:00 | |
*** tesseract has joined #openstack-swift | 07:14 | |
*** psachin has quit IRC | 07:19 | |
*** rcernin has quit IRC | 07:22 | |
*** takamatsu has joined #openstack-swift | 07:37 | |
*** gkadam has joined #openstack-swift | 07:42 | |
*** gkadam has quit IRC | 07:50 | |
*** e0ne has joined #openstack-swift | 07:57 | |
*** ccamacho has joined #openstack-swift | 07:58 | |
*** mikecmpbll has joined #openstack-swift | 08:03 | |
*** tdasilva_ has quit IRC | 08:04 | |
*** tkajinam has quit IRC | 08:23 | |
*** takamatsu has quit IRC | 08:39 | |
*** takamatsu has joined #openstack-swift | 08:40 | |
*** m75abrams has quit IRC | 09:10 | |
*** takamatsu has quit IRC | 09:14 | |
*** mikecmpbll has quit IRC | 09:32 | |
*** mikecmpbll has joined #openstack-swift | 09:33 | |
*** takamatsu has joined #openstack-swift | 09:51 | |
*** gkadam has joined #openstack-swift | 09:53 | |
*** gkadam has quit IRC | 09:53 | |
*** takamatsu has quit IRC | 10:16 | |
*** rdejoux has quit IRC | 10:41 | |
*** takamatsu has joined #openstack-swift | 10:49 | |
*** m75abrams has joined #openstack-swift | 10:54 | |
*** joeljwright has quit IRC | 10:55 | |
*** rdejoux has joined #openstack-swift | 11:48 | |
clayg | what's the difference between a wsgi string and a native string? | 11:56 |
clayg | I thought they were both bytes on py2 and unicode on py3 | 11:57 |
clayg | it's just a quoting/encoding thing? | 11:57 |
*** baojg has joined #openstack-swift | 12:14 | |
*** joeljwright has joined #openstack-swift | 12:23 | |
*** ChanServ sets mode: +v joeljwright | 12:23 | |
*** baojg has quit IRC | 12:44 | |
*** tdasilva has joined #openstack-swift | 12:52 | |
*** ChanServ sets mode: +v tdasilva | 12:52 | |
*** BjoernT has joined #openstack-swift | 13:12 | |
*** DHE has quit IRC | 13:18 | |
*** m75abrams has quit IRC | 13:28 | |
*** pcaruana has quit IRC | 13:30 | |
*** pcaruana|afk| has joined #openstack-swift | 13:30 | |
*** gkadam has joined #openstack-swift | 14:08 | |
*** gkadam has quit IRC | 14:08 | |
*** takamatsu has quit IRC | 14:18 | |
*** ianychoi_ is now known as ianychoi | 14:22 | |
*** takamatsu has joined #openstack-swift | 14:31 | |
*** takamatsu has quit IRC | 14:38 | |
*** tdasilva has quit IRC | 14:39 | |
*** tdasilva has joined #openstack-swift | 14:40 | |
*** ChanServ sets mode: +v tdasilva | 14:40 | |
*** pcaruana|afk| has quit IRC | 15:30 | |
rledisez | timburke: i won't be at the meeting tonight, neither (at least) the 3 following meetings. I'm preparing to move to montreal. see you next month guys! | 15:54 |
tdasilva | rledisez: hope the move goes well! | 15:58 |
*** zaitcev has joined #openstack-swift | 15:58 | |
*** ChanServ sets mode: +v zaitcev | 15:58 | |
*** tdasilva has quit IRC | 15:59 | |
*** tdasilva has joined #openstack-swift | 16:00 | |
*** ChanServ sets mode: +v tdasilva | 16:00 | |
*** gyee has joined #openstack-swift | 16:03 | |
*** pcaruana|afk| has joined #openstack-swift | 16:09 | |
*** mikecmpbll has quit IRC | 16:32 | |
*** e0ne has quit IRC | 16:44 | |
*** spsurya has quit IRC | 17:19 | |
*** ianychoi has quit IRC | 17:25 | |
*** zaitcev has quit IRC | 17:28 | |
openstackgerrit | Tim Burke proposed openstack/liberasurecode master: Update .gitreview following project rename https://review.opendev.org/664984 | 17:30 |
clayg | timburke: i'm a list confused by p 664710 isn't merged yet? | 17:31 |
patchbot | https://review.opendev.org/#/c/664710/ - swift - Ensure get_*_info keys are native strings - 1 patch set | 17:31 |
*** tdasilva has quit IRC | 17:36 | |
*** tdasilva has joined #openstack-swift | 17:37 | |
*** ChanServ sets mode: +v tdasilva | 17:37 | |
*** zaitcev has joined #openstack-swift | 17:41 | |
*** ChanServ sets mode: +v zaitcev | 17:41 | |
*** zaitcev has quit IRC | 18:02 | |
*** tdasilva has quit IRC | 18:03 | |
*** rdejoux has quit IRC | 18:08 | |
openstackgerrit | Tim Burke proposed openstack/pyeclib master: Update .gitreview and playbooks following project rename https://review.opendev.org/664991 | 18:09 |
*** e0ne has joined #openstack-swift | 18:10 | |
*** e0ne has quit IRC | 18:12 | |
*** e0ne has joined #openstack-swift | 18:12 | |
timburke | clayg, on py2, bytes is native is wsgi. on py3, full unicode is native, while unicode limited to codepoints 0-255 is wsgi (so you can map one-to-one with bytes be encoding/decoding with latin1) | 18:15 |
timburke | rledisez, good luck with the move! hope it all goes well! | 18:16 |
timburke | clayg, p 664710 is chained with p 664459 which is gonna un-bust our gate | 18:16 |
patchbot | https://review.opendev.org/#/c/664710/ - swift - Ensure get_*_info keys are native strings - 1 patch set | 18:16 |
patchbot | https://review.opendev.org/#/c/664459/ - swift - Bump up minimum cryptography version - 2 patch sets | 18:16 |
*** e0ne has quit IRC | 18:17 | |
*** BjoernT has quit IRC | 18:18 | |
timburke | otherwise, swift-tox-lower-constraints would've failed like it has for every other patch that's been checked since... 4 days ago or so | 18:18 |
*** zaitcev has joined #openstack-swift | 18:18 | |
*** ChanServ sets mode: +v zaitcev | 18:18 | |
*** e0ne has joined #openstack-swift | 18:19 | |
timburke | been waiting 5 hours now for that recheck... makes me glad i woke up early :-( | 18:21 |
timburke | if yesterday's recheck is representative of what to expect from today's gate queue, it's gonna be another 4 hours... | 18:24 |
clayg | @timburke so, do I need to DO anything to get that patched merged - or just wait? | 18:27 |
timburke | just wait :-/ | 18:27 |
timburke | and maybe recheck. | 18:27 |
*** e0ne has quit IRC | 18:35 | |
timburke | oh good! things are a least a *little* better today -- jobs have started already, so should have a check result within like a half-hour or something... but there's still the gate queue, and either of those may fail for spurious reasons | 18:44 |
*** BjoernT has joined #openstack-swift | 18:45 | |
*** BjoernT_ has joined #openstack-swift | 18:50 | |
*** BjoernT has quit IRC | 18:53 | |
*** tesseract has quit IRC | 18:54 | |
openstackgerrit | Merged openstack/liberasurecode master: Update .gitreview following project rename https://review.opendev.org/664984 | 19:18 |
openstackgerrit | Merged openstack/pyeclib master: Update .gitreview and playbooks following project rename https://review.opendev.org/664991 | 19:21 |
zaitcev | all that but not the cryptography! | 19:22 |
*** e0ne has joined #openstack-swift | 19:23 | |
*** e0ne has quit IRC | 19:26 | |
timburke | yeah, i don't understand why it takes so long to get to swift's check jobs. in the gate, it makes some sense because of the integrated queue -- not sure what's blocking us on the check :-( | 19:27 |
timburke | (those were basically reverts of some changes that came in with the opendev migration, btw -- seemed ok to self-approve) | 19:28 |
zigo | timburke: Hello ! Around? | 19:39 |
timburke | zigo, hi! i hear you're having trouble with s3api | 19:39 |
zigo | Yeah. | 19:39 |
zigo | I'm currently trying to debug it. | 19:39 |
zigo | timburke: If Swift finds out the PATH_INFO thing, does that mean it's already authenticated? | 19:40 |
timburke | if PATH_INFO looks halfway valid (like, '/v1/AUTH_test/...' or '/v1/KEY_test/...' or however you've got your auth prefixes configured) then we've at least mapped from the credential to the account, which is a good sign. if i remember right, that means keystone successfully validated the signature | 19:42 |
zigo | timburke: Well, I get to that point, but my proxy still replies "The request signature we calculated does not match the signature you provided. Check your key and signing method." | 19:43 |
zigo | timburke: Is s3cmd a good enough client? | 19:43 |
timburke | yeah, should be able to work just fine | 19:44 |
zigo | timburke: I'm using a version I ported to Py3 ! :) | 19:44 |
zigo | Hopefully, running with py3 wont break it ... | 19:44 |
timburke | does the proxy respond with the document that it was expecting to have signed? | 19:44 |
timburke | running the *client* with py3, right? ;-) | 19:45 |
zigo | Yeah. | 19:45 |
timburke | i'm getting close on swift! i swear! | 19:45 |
zigo | s3cmd. | 19:45 |
zigo | Hopefully ! :) | 19:45 |
zigo | timburke: Debian Buster will be released on the 6th of July, at that point, we start removing py2 from Debian... | 19:45 |
zigo | :) | 19:45 |
zigo | timburke: To me, it goes correctly up to S3Token.__call__, then I'm not sure where to trace... :/ | 19:46 |
timburke | what do we see in keystone's log? next hop should be a POST to /v3/s3tokens or the like | 19:48 |
zigo | timburke: how may I run pdb with swift-proxy? | 19:48 |
zigo | In keystone's log, I only see some 200 reply, everything looks like working on the keystone side. | 19:48 |
zigo | It really would help if I could just run pdb on swift-proxy. | 19:49 |
zigo | Is there some kind of mode so swift-proxy could run with a single thread or something? | 19:49 |
timburke | i think it'd probably work out ok to run it directly instead of using swift-init... not sure i've ever tried that though | 19:50 |
*** hoonetorg has quit IRC | 19:51 | |
timburke | something like `swift-proxy-server -v /etc/swift/proxy-server.conf`? | 19:52 |
zigo | Right. | 19:54 |
timburke | or maybe that won't work :-( just tried it and got a traceback ending with `if self.quitting: raise BdbQuit#012BdbQuit` | 19:54 |
timburke | if you drop an early return in swift.common.utils.capture_stdio i think it'll work tho | 19:58 |
timburke | (like, as soon as we enter the function -- make the whole thing a no-op) | 19:59 |
*** hoonetorg has joined #openstack-swift | 20:03 | |
zigo | timburke: It's working for me to run swift-proxy on the shell directly, but as soon as I add a breakpoint in the code, it crashes. | 20:04 |
zigo | So I end up lamely doing some prints ... :) | 20:04 |
timburke | right, i think that's the BdbQuit i was bumping into | 20:04 |
zigo | timburke: Currently, in here: https://github.com/openstack/swift/blob/master/swift/common/middleware/s3api/s3request.py#L1335 I get status = 401 | 20:04 |
zigo | Even though self.account seems right ... | 20:05 |
zigo | timburke: Is there a special role for s3 ? | 20:06 |
zigo | Or just the normal SwiftOperator thing ... | 20:06 |
zigo | I'm admin anyways ... | 20:06 |
timburke | nope. what's your pipeline look like? i know there were some changes that needed to happen to make everything happy with keystone v3... | 20:07 |
zigo | pipeline = catch_errors healthcheck proxy-logging cache container_sync bulk ratelimit s3api s3token authtoken keystone copy container-quotas account-quotas slo dlo versioned_writes proxy-logging proxy-server | 20:08 |
zigo | My "keystone" is the same as "keystoneauth", it's just puppet that does this ... | 20:08 |
zigo | The [filter:keystone] bit is right and working ... | 20:08 |
zigo | "openstack container list" does work. | 20:08 |
timburke | try putting authtoken left of s3api | 20:09 |
zigo | Oh ... | 20:10 |
zigo | Gosh, working ... :( | 20:11 |
zigo | I mean :) | 20:11 |
timburke | i know we used to recommend that order, but there were... complications... | 20:11 |
zigo | Well, not sure if I should be super happy it works, or super sad it wasted all of my time today and yesterday ! :) | 20:11 |
zigo | timburke: In anyways, thanks a lot! | 20:11 |
timburke | fixed up swift3's docs in https://github.com/openstack/swift3/commit/c63f89c but i think the original breakage came out of https://github.com/openstack/swift3/commit/6ffcc29 and https://github.com/openstack/swift3/commit/2a48861 | 20:13 |
timburke | sorry for the wasted time, but definitely be glad that it now works! | 20:14 |
zigo | timburke: It's going to solve lots of issues for our customers now that it does work in my PoC! :) | 20:15 |
zigo | timburke: Like, QNAP users that only had keystone v2 auth ... | 20:15 |
zigo | They'll be able to use s3. | 20:15 |
timburke | yay! yeah, there's definitely a lot of good stuff that's landed :-) | 20:15 |
timburke | even beyond the auth stuff; S3 compatibility has gotten a lot better in general | 20:16 |
zigo | timburke: Have you see there's also a s4cmd ? | 20:17 |
zigo | Which one would you recommend? | 20:17 |
zigo | s4cmd is packaged in Debian, I saw. | 20:17 |
zigo | Not s3. | 20:17 |
zigo | I'm confused on which client to use. | 20:17 |
timburke | i hadn't heard of s4cmd -- so i can't really judge i'm afraid | 20:18 |
timburke | personally, i tend to use awscli -- but that's just because i like being able to use amazon's own tooling against a swift cluster :-) | 20:18 |
timburke | https://github.com/wbingli/awscli-plugin-endpoint makes the endpoint management a good bit better | 20:19 |
openstackgerrit | John Dickinson proposed openstack/swift master: WIP swift api overview https://review.opendev.org/665013 | 20:42 |
zaitcev | I have to admit, my first thought was "do we even... need something like this?" | 20:51 |
zaitcev | timburke, At a guess, the s3cmd was in Perl, which probably limited its ability to track the advancement of S3 API. Probably does not even support domain buckets, let alone v4 signatures. | 20:53 |
kota_ | morning | 20:59 |
timburke | meeting time! | 21:00 |
timburke | zaitcev, clayg ^^^ | 21:02 |
clayg | timburke: thanks | 21:03 |
*** pcaruana|afk| has quit IRC | 21:16 | |
timburke | kota_, basically, the UnicodeEncodeError at http://logs.openstack.org/24/664424/1/check/swift-tox-lower-constraints/c1489db/job-output.txt.gz#_2019-06-10_23_46_22_546976 happens because tox is trying to print out the compile failure in http://logs.openstack.org/24/664424/1/check/swift-tox-lower-constraints/c1489db/tox/lower-constraints-1.log | 21:52 |
timburke | which comes back to some const vs non-const typing between openssl and cryptography | 21:53 |
kota_ | i see. and it looks to include multi bytes char? | 21:53 |
kota_ | ah... or just using another encoding | 21:54 |
*** rcernin has joined #openstack-swift | 22:41 | |
*** tkajinam has joined #openstack-swift | 22:56 | |
*** lifeless has quit IRC | 23:05 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!