Wednesday, 2025-07-30

acolesanyone around for the 0700 meeting?07:02
cschwedeo/07:02
kota_hi07:02
acolescschwede: let's wait to see if mattoliver is around07:03
acoleskota_: hi!07:03
kota_acoles: o/07:03
mattoliveroh yeah, I forgot! 07:04
mattoliverhold on :)07:05
mattoliverI was reviewing ringv2  (again) and lost down rabbit holes. So didn't even get the agenda ready. But let's have a quick off the cuff meeting :) 07:05
mattoliver#startmeeting swift07:06
opendevmeetMeeting started Wed Jul 30 07:06:02 2025 UTC and is due to finish in 60 minutes.  The chair is mattoliver. Information about MeetBot at http://wiki.debian.org/MeetBot.07:06
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.07:06
opendevmeetThe meeting name has been set to 'swift'07:06
mattoliverAgenda as always (which is currently not updated) is at:07:06
mattoliver#link https://wiki.openstack.org/wiki/Meetings/Swift07:06
mattoliver#topic Bug triage07:06
mattolivercschwede: sorry to keep probing you on this every 2 weeks :P 07:07
mattoliverIt's alot of work and I think last time we talked about slowing down if you need to catch your breath (and we all should be helping you).07:07
cschwedeNo problem :) No updated bugs this time, but was wondering if we need a different approach at all. Eg. closing bugs > X years old or sth similar.07:08
cschwedeQuite a few bugs need a good amount of time to check if they are still valid07:08
mattoliveroh maybe :hmm: 07:09
mattoliverNice project for any new swift devs who want to get their swift feet wet. 07:09
cschwedeI mean - if they are open for eg 5+ years, they are likely not important at all?07:09
mattoliverie, checking bugs. 07:09
mattoliverlol, true07:10
mattolivermaybe we should get some metrics on our bugs. I mean maybe even 10years would get rid of alot :P 07:10
cschwedeWe don't want to scare new devs immediately away, do we? ;)07:10
cschwedeIndeed. Maybe we simply start with a generous time (5/10 years), close them and have a look at the impact.07:11
mattoliverTrue. I know when I've picked bugs for newbies to work on, I somestimes start with "maybe check if its still valid". But telling them to go check all bugs would be too much 07:11
mattoliverYeah +107:12
acolesis it easy to list the bugs filtered by age? perhaps we should try to at least scan the subject lines in case there are any that are obviously still valid?07:13
mattoliverI'll let timburke__ and others who'll async have a say too. But I think it sounds reasonable. 07:13
acolesI'm thinking more of the bugs that are written more as a wish for future enhancement than an immediate code problem07:14
mattoliveryeah, some of the low hanging fruit "feature requests" like bugs are still nice to have. 07:14
cschwedeMaybe exclude wishlist bugs then? Quickly looking at the oldest bugs: https://bugs.launchpad.net/swift/+bugs?orderby=datecreated&start=007:15
mattoliver#link https://bugs.launchpad.net/swift/+bugs?orderby=datecreated&start=007:16
cschwedeMaybe it's a good topic for another PTG discussion ;)07:17
mattoliverkk. I think closing old bugs should be OK. But maybe a scan of the subjects at least would be useful. And yeah maybe keeping all wishlist makes sense. 07:19
acoleshow can we see a list of in-use tags? (the first is a wishlist but is it wishlist, wish_list or ...)07:19
acolesoh there is autocomplete for existing tags07:20
acolesso *is* there a wishlist tag?07:20
mattoliverthere is things in wishlist importance07:21
acolesaha, thanks mattoliver 07:21
mattolivermaybe its time to hit up the launchpad api and do some magic. 07:21
cschwedeand a "low-hanging-fruit" tag, useful for new devs07:22
acolesanother idea might be to tag anything we look at and decide to keep with '2025' or similar, then cull anything > 5 years without '2025'07:22
mattoliverLet's wait to see what the timburke__ and co think. But I'll do an initial parse and try and point out (only from a very high level look) at things that we might want to save of anything older then 5years are we'll start there? 07:22
acoles+107:23
mattoliverkk, let's move on then07:23
mattoliverthanks cschwede !07:23
mattoliver#topic eventlet removal POC update07:24
mattolivercschwede: any time to play with this yet? 07:24
acolessome bugs impact more projects than swift but seem very stale e.g. https://bugs.launchpad.net/swift/+bug/1179009 but s07:24
cschwedeYes! Currently working on getting some tests passing for my object server POC. Another new deep rabbit hole!07:25
acolesoops sorry, we've  moved on07:25
mattoliverlol, yup, but we're really thankful for you to at least take the initial leap :P 07:27
mattoliverlol acoles that one is incomplete everywhere it seems and 12 years old 07:29
mattoliverAnyway thanks again cschwede 07:29
mattoliverSpeaking of potential PTG topics...07:29
mattoliver#topic October vPTG07:30
mattoliverJust a reminder there is another PTG coming up in october. 07:30
mattoliverOct 27-3107:30
mattoliver#link https://ptg.openinfra.org/07:30
mattoliverSeeing as we already have a topic, maybe I should go make an etherpad for it so we can start gathering ideas eariler this time :) 07:31
mattoliverthat's just an info one really07:32
mattoliverWe talked about the isa-l stuff last meeting. So probably don't have to re-hash that. 07:32
mattoliverMight was well talk ringv2 while I'm neck deep into it. :P07:33
mattoliver#ringv207:33
mattoliver#topic ringv207:33
mattoliverI had a good chat to clayg this morning (my time) about the current state of the main patch.07:33
mattoliver#link https://review.opendev.org/c/openstack/swift/+/83426107:34
mattoliverThere are some refactors in how we'll maintain the ring reader/writer classes. But nothing major format wise that needs to change07:35
mattoliverSo I think we're very close to landing what we have and leave the rest to follow ups07:35
acolesexciting07:35
mattoliverI have been working deeper in the chain to give us the old primary/history table in the ring, which I think we all want to improve reconstructor and replication smarts.07:37
mattoliverAnyway.. we have been running it in prod with no issues, so there are no worries with the current implementation. 07:38
mattoliverI think that's all I have for today, sorry for not being more organised07:38
mattoliverso 07:38
mattoliver#topic open discussion07:38
mattoliveracoles: I might have got nerdsniped on your more deterministic shard finding stuff. And testing some things out. 07:39
mattolivergot some very basic code that I plan to test on some large containers because I want to make sure it's fast enough in regards to sqlite and hitting indexes etc. 07:40
mattolivernot convinced either way yet.. and didn't get much of a chance to play too much today. Got distracted with ringv207:40
acolesok, I did think of some potential flaws but it'd be interesting to see how you go. I don't think I'll find time to explore it much for a while07:41
mattoliveryeah, I have some flaws already, but let's see. Initial shard on a container would be the hardest, when we have defined upper and lower boundries I think it might work better. 07:42
mattoliverAlso it tends to leave with more smaller shards, so less efficient in sizing.. but maybe thats ok. So long as it picks right, I don't mind if things need to shrink (once that's working better). 07:43
mattoliverI've got code for the initial shard being just out of chr bounds to my middle namespace function seems to work quite well. BUT I think it'll come down to IO speed of sqlite to be honest to see how feasible it all is.07:44
mattoliverAnyway, that's all I got07:45
mattolivercschwede: I did see you found an account_quite recurrsion error, nice and scary find :P 07:46
mattoliver#link https://review.opendev.org/c/openstack/swift/+/95586607:47
mattoliverAnd it's already merged thanks to acoles and timburke__ 07:47
cschwedeYes, I was a bit surprised too. This was actually found when writing some new tempest tests by our new QE team member07:47
mattoliverAnything else to bring up?07:47
mattoliverlol07:47
acolesnot from me07:48
mattoliverCool, thank I'm going to go make dinner for the fam. 07:50
mattoliverThanks for coming and thanks for working on swift07:50
mattoliver#endmeeting07:50
opendevmeetMeeting ended Wed Jul 30 07:50:22 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)07:50
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2025/swift.2025-07-30-07.06.html07:50
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2025/swift.2025-07-30-07.06.txt07:50
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2025/swift.2025-07-30-07.06.log.html07:50
cschwedeThanks mattoliver for running the mtg!07:51
acolesso I changed this one to 'Won't Fix' https://bugs.launchpad.net/swift/+bug/1179009 . One small step forwards!07:52
edausqhello, following this change: https://review.opendev.org/c/openstack/swift/+/940601 , I beleive we should update the api-ref. What do you think? Should I open a bug or something?13:48
zigotimburke__:  I'd like to thank you for the Sigv4-streaming patch ! It's just great to have it. Any chance to have it backported to at least Epoxy ?14:32
zigo(maybe Tim is in PTO ?)14:33
*** timburke__ is now known as timburke17:11
timburkei'm around -- sorry i forgot about the meeting last week17:12
timburkeedausq, good call! i can look at getting a patch together for it (unless you'd like to try?)17:12
timburkezigo, normally i'd hesitate to backport what's solidly feature work -- but with the recent moves by aws's clients and SDKs, it does start to feel like fixing a bug of "s3api doesn't work with boto3 out of the box". i can take a look at how bad the merge conflicts get ;-)17:14
opendevreviewASHWIN A NAIR proposed openstack/swift master: add minimal trace to get_hashes  https://review.opendev.org/c/openstack/swift/+/95437918:31
opendevreviewASHWIN A NAIR proposed openstack/swift master: replicator: Add sync_batches_per_revert option  https://review.opendev.org/c/openstack/swift/+/83964918:44
opendevreviewASHWIN A NAIR proposed openstack/swift master: add minimal trace to get_hashes  https://review.opendev.org/c/openstack/swift/+/95437918:45
opendevreviewTim Burke proposed openstack/swift master: api-ref: Document storage_policy in account listings  https://review.opendev.org/c/openstack/swift/+/95619019:55
timburkeedausq, ^^^19:56
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3request: refactor to introduce SigChecker classes  https://review.opendev.org/c/openstack/swift/+/95619120:18
opendevreviewTim Burke proposed openstack/swift stable/2025.1: Add support of Sigv4-streaming  https://review.opendev.org/c/openstack/swift/+/95619220:18
opendevreviewTim Burke proposed openstack/swift stable/2025.1: utils: Add CRCHasher and crc32c implementation  https://review.opendev.org/c/openstack/swift/+/95619320:18
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3api: Validate additional checksums on upload  https://review.opendev.org/c/openstack/swift/+/95619420:18
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3api: Add support for crc64nvme checksum calculation  https://review.opendev.org/c/openstack/swift/+/95619520:18
opendevreviewTim Burke proposed openstack/swift stable/2025.1: Add support of Sigv4-streaming  https://review.opendev.org/c/openstack/swift/+/95619220:51
opendevreviewTim Burke proposed openstack/swift stable/2025.1: utils: Add CRCHasher and crc32c implementation  https://review.opendev.org/c/openstack/swift/+/95619320:51
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3api: Validate additional checksums on upload  https://review.opendev.org/c/openstack/swift/+/95619420:51
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3api: Add support for crc64nvme checksum calculation  https://review.opendev.org/c/openstack/swift/+/95619520:51
opendevreviewTim Burke proposed openstack/swift stable/2025.1: s3request: refactor error handling while reading input  https://review.opendev.org/c/openstack/swift/+/95620020:51
opendevreviewTim Burke proposed openstack/swift master: Forward-port stable-release CHANGELOG entries  https://review.opendev.org/c/openstack/swift/+/95620121:00
timburkezigo, that turned into more backports than i was expecting... and that's after dropping some of the follow-ons. (acoles, would we want to also backport, say, https://github.com/openstack/swift/commit/1a27d1b8 or https://github.com/openstack/swift/commit/351ee727 to feel like we had the test coverage we want to support a stable release?)21:06
timburkezigo, alternatively, is the ask specifically for a *stable* release that includes aws-chunked support, or *any* release? it's been *ages* since i actually did an intermediary release; i should really get back in that habit21:08
timburkehmm... we might also want to try to get https://review.opendev.org/c/openstack/swift/+/949671 across the line... otherwise keystone users might get some random 501s :-(21:29
timburkesomewhat related to that -- i don't run with keystone for auth, but zigo, i'm assuming you do, yeah? would you agree with my premise in https://review.opendev.org/c/openstack/swift/+/951352 that trying to allow keystone users s3api access without enabling secret caching is basically setting yourself up for trouble?21:32

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!