Wednesday, 2025-02-12

opendevreviewMatthew Oliver proposed openstack/swift master: ring: Introduce a v2 ring format  https://review.opendev.org/c/openstack/swift/+/83426100:12
opendevreviewMatthew Oliver proposed openstack/swift master: Add magic rules for swift rings  https://review.opendev.org/c/openstack/swift/+/94008800:12
opendevreviewMatthew Oliver proposed openstack/swift master: Ringv2: Write the serialization format to a gzip header  https://review.opendev.org/c/openstack/swift/+/94049100:12
opendevreviewMatthew Oliver proposed openstack/swift master: ring: Add a rebalance history in the ring  https://review.opendev.org/c/openstack/swift/+/83462100:12
opendevreviewMatthew Oliver proposed openstack/swift master: proxy: Use last-primaries table  https://review.opendev.org/c/openstack/swift/+/85775800:12
mattoliver^ squashed the ringbuilder version subcommand patch into parent.00:12
opendevreviewMerged openstack/swift master: Add per-container storage policy to account listing  https://review.opendev.org/c/openstack/swift/+/94060100:22
opendevreviewAlistair Coles proposed openstack/swift master: FakeSwift: more encapsulation of request properties  https://review.opendev.org/c/openstack/swift/+/94136511:54
opendevreviewAlistair Coles proposed openstack/swift master: sq? share validate_sha256 and other fixups  https://review.opendev.org/c/openstack/swift/+/94147518:56
*** timburke_ is now known as timburke20:58
timburke#startmeeting swift21:00
opendevmeetMeeting started Wed Feb 12 21:00:29 2025 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:00
opendevmeetThe meeting name has been set to 'swift'21:00
timburkewho's here for the swift meeting?21:00
boosungkim[m]Hello21:01
mattolivero/21:02
timburkei remembered to update the agenda!21:04
timburke#link https://wiki.openstack.org/wiki/Meetings/Swift21:04
timburkefirst up21:04
timburke#topic foundation news21:04
timburkelooks like OpenInfra may join the Linux Foundation!21:04
timburke#link https://lists.openinfra.org/archives/list/foundation@lists.openinfra.org/thread/3B7OWPRXB4KD2DVX7SYYSHYYRNCKVV46/21:04
timburkei'm not sure it'll have much impact on us, but thought it worth highlighting21:05
timburke(especially since the second community meeting for it will be happening in just a few hours)21:05
mattoliveryeah, that's really interesting. I wonder how it may change things. 21:06
mattoliverOh yeah.. maybe I should listen in. 21:06
timburkenext up21:06
timburke#topic 2025.2 cycle name21:06
timburkeit's official, it'll be openstack flamingo21:06
timburke#link https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/message/IMHDQ3VVI46HHNO7BTWOTT5VH53TXZCR/21:07
mattoliverflamingo, ok. why not :)21:07
timburkeaside from epoxy, i feel like they've been on an animal kick lately21:07
timburkeagain, not much to really discuss, more of an announcement in case you missed it21:08
timburke#topic boto3 breakage21:08
timburkeso we already knew about the aws-chunked trouble21:09
timburkeand the patch to address it has been making decent progress21:09
timburke#link https://review.opendev.org/c/openstack/swift/+/83675521:09
timburkebut i think i forgot to mention the *other* bit of breakage!21:09
rcmgleitekey folks, are we meeting today?21:10
timburkercmgleite, welcome! yep21:10
timburkerecently, multi-deletes started failing against s3api because boto's no longer sending a content-md5 header (presumably because they're sending one of the checksum headers instead?)21:11
mattoliveryeah, I'll take another look today, and maybe we can merge it soon21:11
mattolivermaybe today?21:11
mattoliverdepending on how others feel of course21:11
timburkethis first manifested with our ceph-s3-tests job, but also would break our internal cross-compat tests once boto3 gets upgraded21:12
timburkefortunately, we've got another fix for that already in review:21:12
timburke#link https://review.opendev.org/c/openstack/swift/+/94017221:12
timburkeand all these s3api patches leads me to...21:13
timburke#topic improving the maintainability of s3api21:13
timburke(this also ties in with what you were saying, mattoliver ;-)21:13
timburkewhile reviewing the aws-chunked patch, acoles was frustrated by the convoluted state of the s3request.py module in particular21:14
timburkei don't blame him; it's a bit of a mess. one that we keep just throwing more hacks into as issues are found or new features requested21:15
timburkei'm not entirely sure how to go about making it better, though21:16
timburkea while back, i tried to pull out just the auth-y bits with https://review.opendev.org/c/openstack/swift/+/613452 -- maybe i should make another attempt21:16
timburkei also tried to pull out some of the error-response handling in some earlier iteration of https://review.opendev.org/c/openstack/swift/+/751555 (though now it looks like it's all back in the one module again)21:19
mattoliverYeah, it's hard because one needs to load up much of the s3api in order to do some nice refactors and seperation. 21:20
timburkebut i wanted to throw this out there as a hairy problem that we might want to face -- it's easily the largest module in s3api, and it's only getting larger21:20
mattoliverAnd working on tech debt like this is super important, but also hard to justify to employers. 21:20
mattoliverthanks, we should write it down somewhere. Maybe a new catergory of the ideas page. Then we keep looking at them and maybe convince someone to help out (or if we get time)21:22
timburkeanyway, that's about all i've got this week21:24
timburke#topic open discussion21:24
timburkewhat else should we bring up?21:24
mattoliverI've squashed 2 more things into the head of ringv221:25
mattoliverclayg would think it would be easier to review if we split the head patch into some structural changes but still just support v1, then all the v2 stuff to make it easier to review.. but having it sqaushed in is easier to carry (for us). 21:26
mattoliver(or maybe we just land it) ;) 21:27
mattoliverBut we (nvidia) plan to carry the patch into our next downstream release.. so maybe it'll give everyone more confidence. 21:29
mattoliveror it'll go wrong, which it at least some more data :P 21:29
timburkeeither way, at least the patch seems unstuck -- i was disappointed that it languished so long. thanks for freshening it up, mattoliver!21:30
mattolivernps. That's really all I've been digging into. I have started looking at some of the expirer improvement patches, too. But really want to get ringv2 landed to fix device ids width. And then it opens doors for the rest of the chain which will make reconstructor rebalances better too! 21:31
timburkei think there's still at least one thing i ought to fix with it -- some bleeding together of GzipWriter and RingWriter21:31
mattoliveryeah, can't hurt, but I think the ondisk format is decided, so don't mind if thats now or a follow up. eitherway, so long as it doesn't slow down the critical path :) 21:32
timburkeoh! also, Callum027's policy-info in account listings patch landed!21:33
timburkei pushed up a follow-up to address a few nits, but the bones of it looked good to me21:34
timburke#link https://review.opendev.org/c/openstack/swift/+/94130121:34
timburkefor the follow-up21:34
mattolivernice! thanks Callum027 !!21:37
Callum027No worries, thanks for reviewing it so quickly and for the feedback timburke and mattoliver21:37
timburke👍21:38
timburkeall right, seems like we can wrap a little early21:40
timburkethank you all for coming, and thank you for working on swift!21:40
timburke#endmeeting21:40
opendevmeetMeeting ended Wed Feb 12 21:40:38 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:40
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2025/swift.2025-02-12-21.00.html21:40
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2025/swift.2025-02-12-21.00.txt21:40
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2025/swift.2025-02-12-21.00.log.html21:40
boosungkim[m]Thanks Tim!21:41
opendevreviewMerged openstack/swift master: versioning: 411 PUTs with neither content-length nor transfer-encoding  https://review.opendev.org/c/openstack/swift/+/93132522:09

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!