| opendevreview | ASHWIN A NAIR proposed openstack/swift master: s3api: refactor testing for checksum errors https://review.opendev.org/c/openstack/swift/+/931223 | 12:26 |
|---|---|---|
| opendevreview | Tim Burke proposed openstack/swift master: s3api: Additional checksums for MPUs https://review.opendev.org/c/openstack/swift/+/909802 | 12:27 |
| opendevreview | Tim Burke proposed openstack/swift master: logging: Add UPDATE to valid http methods https://review.opendev.org/c/openstack/swift/+/931968 | 15:19 |
| opendevreview | Chinemerem Chigbo proposed openstack/swift master: Add oldest failed async pending update stat https://review.opendev.org/c/openstack/swift/+/931979 | 17:56 |
| opendevreview | Tim Burke proposed openstack/swift master: trivial: Default value for EUCLEAN https://review.opendev.org/c/openstack/swift/+/931980 | 18:21 |
| opendevreview | Chinemerem Chigbo proposed openstack/swift master: Add oldest failed async pending update stat https://review.opendev.org/c/openstack/swift/+/931979 | 18:23 |
| opendevreview | Chinemerem Chigbo proposed openstack/swift master: Add oldest failed async pending update stat https://review.opendev.org/c/openstack/swift/+/931979 | 18:24 |
| opendevreview | Alistair Coles proposed openstack/swift feature/mpu: mpu: Cleanup MPUSession class https://review.opendev.org/c/openstack/swift/+/931516 | 18:31 |
| opendevreview | Alistair Coles proposed openstack/swift feature/mpu: mpu-auditor: audit sessions https://review.opendev.org/c/openstack/swift/+/931517 | 18:31 |
| opendevreview | Alistair Coles proposed openstack/swift feature/mpu: mpu: remove session state from metadata https://review.opendev.org/c/openstack/swift/+/931981 | 18:31 |
| opendevreview | Chinemerem Chigbo proposed openstack/swift master: Add oldest failed async pending update stat https://review.opendev.org/c/openstack/swift/+/931979 | 18:32 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Publish manylinux wheels https://review.opendev.org/c/openstack/pyeclib/+/927654 | 19:04 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Build musllinux wheels https://review.opendev.org/c/openstack/pyeclib/+/929700 | 19:04 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Build musllinux wheels https://review.opendev.org/c/openstack/pyeclib/+/929700 | 19:48 |
| opendevreview | Tim Burke proposed openstack/swift master: utils: Add crc32c function https://review.opendev.org/c/openstack/swift/+/909800 | 20:29 |
| opendevreview | Tim Burke proposed openstack/swift master: s3api: Add support for additional checksums https://review.opendev.org/c/openstack/swift/+/909801 | 20:29 |
| opendevreview | ASHWIN A NAIR proposed openstack/swift master: s3api: refactor testing for checksum errors https://review.opendev.org/c/openstack/swift/+/931223 | 20:29 |
| opendevreview | Tim Burke proposed openstack/swift master: s3api: Additional checksums for MPUs https://review.opendev.org/c/openstack/swift/+/909802 | 20:30 |
| indianwhocodes | is there an upstream meeting today ? | 21:01 |
| mattoliver | good question :) | 21:01 |
| mattoliver | timburke: you around today? | 21:03 |
| timburke | oh yeah, meeting! got distracted falling down a wheels-for-alpine rabbit hole | 21:03 |
| mattoliver | lol, sorry, I sparked that off :P | 21:04 |
| timburke | idk that there's much new to discuss, though -- or maybe i just have been too distracted by my own things :-) | 21:04 |
| mattoliver | well a quick one is ok. Just reminders about ptg and then talk about wheels and apline ;) | 21:05 |
| timburke | #startmeeting swift | 21:05 |
| opendevmeet | Meeting started Wed Oct 9 21:05:31 2024 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:05 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:05 |
| opendevmeet | The meeting name has been set to 'swift' | 21:05 |
| timburke | who's here for the swift meeting? | 21:05 |
| mattoliver | o/ | 21:05 |
| * zaitcev peeks in and out | 21:06 | |
| timburke | ok, like i was saying, not too much to bring up this week | 21:06 |
| timburke | #topic PTG | 21:06 |
| timburke | it's soon! please register if you haven't | 21:06 |
| timburke | #link https://ptg2024.openinfra.dev/ | 21:07 |
| mattoliver | I have! looking forward to it.. even if I'm up late :) | 21:07 |
| timburke | please let me know what times work well for you if you haven't (i still need to book some slots) | 21:07 |
| timburke | #link https://framadate.org/LQOsGVVWXDhXqQUw | 21:07 |
| timburke | and please add topics to the etherpad | 21:08 |
| timburke | #link https://etherpad.opendev.org/p/swift-ptg-epoxy | 21:08 |
| timburke | if you can add some descriptions, that'd be great -- i filled in one of mine that was missing but still need to do the other | 21:09 |
| timburke | and i'm sure i've got another topic or two lurking in my head that i ought to add :-) | 21:09 |
| mattoliver | kk, I still haven't adding things, I'm sure I can come up with some topics :) | 21:10 |
| timburke | even if you don't intend to add anything, please take a look at what others have added and add your nick to what you're most interested in | 21:11 |
| timburke | shortly before the PTG starts, i plan to re-order topics so the most-popular are at the top and we'll try to get to them first | 21:12 |
| mattoliver | also allows us to know who needsto be present (because they were interested) | 21:13 |
| timburke | #topic bug #2081103 | 21:14 |
| patch-bot | https://bugs.launchpad.net/swift/+bug/2081103 - s3api: Deleting the current version of an object can (sometimes?) 500 (In Progress) | 21:14 |
| timburke | fulecorafa, good news! i think i've got a fix | 21:15 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/931325 | 21:15 |
| patch-bot | patch 931325 - swift - versioning: 411 PUTs with neither content-length n... - 2 patch sets | 21:15 |
| timburke | there's *also* a separate eventlet bug, but i think we can dodge it OK with the swift change | 21:16 |
| timburke | if anyone has a moment to review, i'd appreciate it | 21:16 |
| mattoliver | oh cool | 21:16 |
| indianwhocodes | i added a topic too, yay the same one from the last one | 21:17 |
| timburke | #topic pyeclib wheels | 21:18 |
| timburke | mattoliver has been hard at work the last day or two reviewing things! thanks, mattoliver! | 21:18 |
| timburke | it's kicked up a few questions in my mind: | 21:19 |
| mattoliver | yeah, finally loaded it all up and got to diving in. | 21:19 |
| timburke | 1. mattoliver has just +2'ed -- do we want more people on board before merging? | 21:20 |
| mattoliver | alpine seems to be a different beast and wonder if vendoring actually works there. | 21:20 |
| mattoliver | I tihnk I'm happy to merge the first few, they work great. And much better then what we already have (nothing) | 21:20 |
| timburke | 2. the arm64 wheel builds tend to take a while, because there just aren't that many arm64 nodes available. should we continue to require them for every pyeclib change going forward? | 21:22 |
| timburke | 3. being able to build wheels that hopefully work is great -- but should we get something in place to actually validate the wheels that are built? the musllinux wheels caught me by surprise -- thanks for actually testing them, mattoliver | 21:23 |
| mattoliver | 2 - we could just trigger them on a release? Or on the otherhand there isn't too many pyeclib changes (at the moment) and it might be nice to test. | 21:23 |
| timburke | (actually, i know the answer to that last one. yes, yes we should. i suppose the real question is, do we want to require CI-driven wheel validation before we start publishing these wheels?) | 21:24 |
| timburke | another thought i had on 2 was to look into cross-compiling, so we could maybe build aarch64 wheels on x86_64 | 21:24 |
| mattoliver | The apline might be faily easy to test, its just a docker image. I do have that dodgy test script I was using which just creates a pyeclib driver, encodes and then decodes with a random subset of the peices. | 21:25 |
| mattoliver | To test aarch I needed to build a vm on my x86_64 box via qemu. which was fine. | 21:26 |
| mattoliver | but we do have arm ci nodes which should make testing easier :shrug: | 21:26 |
| mattoliver | even if they are already overloaded | 21:26 |
| timburke | yeah, and fortunately i already figured out how to (1) make one job wait on another completing and (2) have a dependent job grab an artifact that was built | 21:27 |
| mattoliver | oh cool, well that's a bunch of the missing peices already! | 21:27 |
| timburke | since i needed both of those for p 927654 | 21:27 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/927654 - pyeclib - Publish manylinux wheels - 10 patch sets | 21:27 |
| timburke | oh yeah, mattoliver -- i wanted to check in: does your dodgytest.py just test with liberasurecode_rs_vand, or does it do some isal, too? | 21:30 |
| mattoliver | only liberasurecode_rs_vand. but yeah I should extend it to isa_l. I'll test with that today. | 21:30 |
| timburke | 👍 | 21:31 |
| mattoliver | makes sense. it was just enough to force using the liberasurecode library to make sure the wheel was working | 21:31 |
| timburke | speaking of ec backends, i wanted to mention that there's p 908533 | 21:32 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/908533 - pyeclib - Include jerasure in manylinux wheels - 10 patch sets | 21:32 |
| timburke | ...but idk that we actually *should* include it -- seems like there are probably some patent issues we wouldn't want to mess with | 21:33 |
| mattoliver | yeah, maybe let people install that themselves to keep us out of the sticky web that is jerasure patents. | 21:34 |
| timburke | and on the musl troubles, i think the most recent version of p 929700 is fixed for liberasurecode_rs_vand at least | 21:38 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/929700 - pyeclib - Build musllinux wheels - 10 patch sets | 21:38 |
| mattoliver | ok, test script not supports isa_l_rs_vand so let's see how that goes :) | 21:38 |
| mattoliver | oh cool. I'll give it a go | 21:38 |
| timburke | there might need to be another round to get isal working right, though | 21:39 |
| timburke | all right, that's all i've got | 21:39 |
| timburke | #topic open discussion | 21:39 |
| timburke | what else should we bring up this week? | 21:39 |
| mattoliver | on a side note, I notices wget or curl from the zuul artifacts was giving me a short read of the file (giving me broken wheels). But downloading then via the browser was fine. weird stuff | 21:39 |
| mattoliver | nah, I'm good. I was on vacation last week, so still ramping up | 21:39 |
| timburke | mattoliver, i think it's due to how zuul uploads get compressed -- IME tacking on a `--compressed` helps | 21:44 |
| mattoliver | oh ok, that's great to know! | 21:44 |
| timburke | i think for wget you'd want `--compression=auto` or something | 21:45 |
| timburke | fortunately ansible's get_url does it for us so i don't have to worry about it in https://review.opendev.org/c/openstack/pyeclib/+/927654/10/tools/playbooks/release-wheel/download-artifacts.yaml | 21:47 |
| patch-bot | patch 927654 - pyeclib - Publish manylinux wheels - 10 patch sets | 21:47 |
| timburke | all right, i think i'll wrap up a little early | 21:47 |
| timburke | thank you for coming, and thank you for working on swift! | 21:47 |
| timburke | #endmeeting | 21:47 |
| opendevmeet | Meeting ended Wed Oct 9 21:47:42 2024 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:47 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2024/swift.2024-10-09-21.05.html | 21:47 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-10-09-21.05.txt | 21:47 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2024/swift.2024-10-09-21.05.log.html | 21:47 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Build musllinux wheels https://review.opendev.org/c/openstack/pyeclib/+/929700 | 21:50 |
| mattoliver | cool aarch64 testing with isa-l works fine, and here is the strace part to prove it: | 21:53 |
| mattoliver | openat(AT_FDCWD, "/root/venv/lib/python3.10/site-packages/pyeclib.libs/libisal-pyeclib.so.2", O_RDONLY|O_CLOEXEC) = 3 | 21:53 |
| timburke | :-/ p 927654 has been waiting for ~3hrs to report the failure at https://zuul.opendev.org/t/openstack/build/49b8d031d0fc46079e35369a86d4d35b | 21:54 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/927654 - pyeclib - Publish manylinux wheels - 10 patch sets | 21:54 |
| mattoliver | And x86_64 wheels work with isa-l: | 21:57 |
| mattoliver | # strace python ~/wheels/dodgytest.py 2>&1 |grep libisal... (full message at <https://matrix.org/oftc/media/v1/media/download/AXRj4Mum3nHg2iv2zAJWtR5tASU3KF1x55Jun8xTTFzHB0Rfxow1FeTLKGPcnuirCz_67eXhRN1roywJL-sfOplCeSdQDTCwAG1hdHJpeC5vcmcvQlVsU1J2WWx0VVZwSkxtQnREamNUZ2VH>) | 21:57 |
| timburke | 🎉 | 22:00 |
| timburke | oh yeah, mattoliver, i'd be curious about your thoughts on p 931832 as a follow-up to p 930171 | 22:00 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/931832 - pyeclib - Add explicit close/destroy methods - 3 patch sets | 22:00 |
| patch-bot | https://review.opendev.org/c/openstack/pyeclib/+/930171 - pyeclib - Call liberasurecode_instance_destroy in destructor - 4 patch sets | 22:00 |
| mattoliver | Oh I do like that the destroy method you created can be used by the destructor and the python close! That feels like we're covering our bases some more! | 22:14 |
| timburke | one thing i noticed, though -- if i added a __del__ to the python classes that'd call their own close, i'd start popping segfults (but IIRC, only in CI) :-/ | 22:57 |
| timburke | i guess it was something where the underlying C object already had its destructor called, then the referencing python object would get GC'd? | 22:59 |
| timburke | do we want to just squash 'em together? | 22:59 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Parse wheel metadata https://review.opendev.org/c/openstack/pyeclib/+/932002 | 23:23 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Add explicit close/destroy methods https://review.opendev.org/c/openstack/pyeclib/+/931832 | 23:27 |
| opendevreview | Tim Burke proposed openstack/swift master: slo: Support range requests for part-number queries https://review.opendev.org/c/openstack/swift/+/906391 | 23:33 |
| opendevreview | ASHWIN A NAIR proposed openstack/python-swiftclient master: support part-num in python swiftclient https://review.opendev.org/c/openstack/python-swiftclient/+/920776 | 23:34 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Parse wheel metadata https://review.opendev.org/c/openstack/pyeclib/+/932002 | 23:35 |
| timburke | yowza! https://zuul.opendev.org/t/openstack/status/pipeline/check-arm64 has patches that have been waiting for 9+ hrs! | 23:54 |
| opendevreview | Tim Burke proposed openstack/pyeclib master: Parse wheel metadata https://review.opendev.org/c/openstack/pyeclib/+/932002 | 23:57 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!