Wednesday, 2025-05-21

opendevreviewJianjian Huo proposed openstack/swift master: s3api: more test cases for conditional writes.  https://review.opendev.org/c/openstack/swift/+/95037101:07
mattoliverI'm here this time. 07:00
cschwedeI'm around as well :)07:00
mattoliverGreat! Sorry about last time, seems I got the meeting wrong by a 24 hours :P Epic TZ file : P07:01
mattoliverLet's start the meeting then!07:02
mattoliver#startmeeting swift07:02
opendevmeetMeeting started Wed May 21 07:02:16 2025 UTC and is due to finish in 60 minutes.  The chair is mattoliver. Information about MeetBot at http://wiki.debian.org/MeetBot.07:02
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.07:02
opendevmeetThe meeting name has been set to 'swift'07:02
mattoliverWho's here for the swift meeting?07:02
kotao/07:02
cschwedeo/07:02
mattoliver\o/ first 0700 meeting in years07:03
mattoliverAgenda is at:07:03
mattoliver#link https://wiki.openstack.org/wiki/Meetings/Swift07:03
kotagood. it's healthy time for APAC07:03
mattoliverkota: yeah, much easier for us too ;)07:03
cschwedeSame for EMEA, which is nice as well :)07:03
mattoliverI've seeded some topics, and stole some from Tim more as an FYI07:04
mattoliverFirst up one I made for cschwede :P 07:04
mattoliver#topic Bug triage07:04
mattoliverHows the triage going cschwede ? we probably should all be helping you tho.07:05
cschwedeOn it. A bit slower than expected, but I'm running over bugs in NEW state atm. Updated ~10 earlier today, and will update our wiki page at  https://wiki.openstack.org/wiki/Swift/BugTriage later07:05
mattolivernice one!07:06
mattoliver#link  https://wiki.openstack.org/wiki/Swift/BugTriage07:06
mattoliver(so it links properly in logs)07:06
cschwedeNoticed a few very easy ones (like one-liner doc changes) that I might simply propose. Tagged as low-hanging fruit for now07:06
mattolivercool, yeah, if there too easy then even newbies might not be that interested in them. 07:07
mattoliverThanks so much for working through these each fortnight!07:08
cschwedeRight, at the same time i don't want to close them simply without ack'ing the time of the reporter07:08
mattoliveryeah fair enough07:08
mattoliverI see all the extra emails in my inbox. Anything we need to do on our end? Can I help by taking a look. Though sounds like your marking them as expected07:10
cschwedeI run over a couple of bugs that need more investigation. I think I will create a list of things that need a second look and share that as well07:11
mattolivercool, sounds like a plan. Happy to double check anything your need. 07:12
mattolivernext topic then07:12
cschwedeThanks Matt!07:12
mattoliver#topic eventlet removal POC update07:12
mattoliverThis is just a place holder topic, no stress on how it's going.. but curious07:13
cschwedeWorking on it, and also looked into cheroot mentioned earlier by timburke_. As expected it's a rabbit hole, but I hope to have a POC by the end of June07:13
cschwedes/hope/plan07:13
mattoliverlol, yeah huge rabbit hole07:14
mattoliverNice tho, I haven't looked at cheroot, so sounds like I might get nerdsniped :P 07:14
mattoliverI've let my manager know eventlet removal will be something that will have to happen in the future for us too, so thanks for giving at least a POC a crack so we can start moving in the right direction!07:15
cschwedeThat's great news, very much appreciated!07:16
mattoliverWant me to leave it in the meeting agenda to check in, or should I just add in every month or so?07:16
cschwedeI won't have an update in 2 weeks, but let's keep it on the agenda and we check in 4 weeks on the state.07:16
mattoliverkk07:17
mattoliver#topic SO_TIMESTAMP/SO_TIMESTAMPING patch07:17
mattoliver#link https://review.opendev.org/c/openstack/swift/+/94410307:17
mattoliverI bring this up because its one of mine :P07:17
mattoliverI think its coming along nicely, timburke_ has been reviewing it, so starting to look good.07:18
mattoliverThis patch will allow us to track the time the request hits the server, not just when we accept it. Also the time it waited on the accept queue can also be logged. 07:19
cschwedeThat's the one we discussed at the PTG, right? Is there any issue with swift-bench that needs a fix (unrelated to this patch), I see Tim mentioned that in the comments?07:19
mattoliveryup07:19
mattoliverif the client is doing pipelined requests, then the fields in the logs (if defined) will just be '-' because we already have the connection open.07:19
mattoliverAlthough, I guess I better make a test for that or something :)07:20
mattoliverWe want to alert of time spent in accept queues because this is a sign of overloading. Maybe it's interesting to others too.07:20
mattoliverespecally when a client's time a request took and differ then our logs because of the wait.07:21
cschwedeYes, definetely useful07:21
mattoliverOtherwise, not too much to report there. If anyone wants to take it for a spin or review great. :) 07:21
mattolivernext topic07:22
mattoliver#topic ringv207:22
mattoliverWe talked about this at the PTG too.. 07:22
mattoliverin fact alot of the serialisation design work happened with everyone at PTGs past07:23
cschwedeLooks like it got some updates very recently07:23
mattoliverBut it still hasn't landed :( 07:23
mattoliverBut good news is, we've been running it prod (defaulting to v1).  07:23
cschwedeThat's the case for quite some time already, isn't it?07:24
mattoliverSoak tested a few racks by running 4-byte devid rings in our biggest cluster.07:24
mattoliveryup07:24
mattoliverwhich went well.07:24
mattoliverAnd just today we've enabled ringv2 in some of our smaller clusters 07:24
mattoliver*small prod clusters07:25
cschwedeThat's great news, sounds like it is working as expected then07:25
mattolivertimburke_: responded and cleaned up some stuff, so I hope we can finally land it.07:25
mattoliverOnce it lands I want to blow the dust of my last_part_table patch, so reconstructors can find missing frags without rebuilding after a rebalance (hopefully remove the need for handoffs_only option) 07:27
mattoliverWell remove the need after a rebalance at least 07:27
mattoliverThe last few topics are really just FYIs, as they're topics in the other timed meeting. 07:28
mattoliver#topic aws-chunked07:28
mattoliverSo I went on the landing rampage a few days ago, and went and landed the first 2 patches in the chain. 07:29
mattoliverThey work great and figured people can do any more polishing in follow up patches.07:29
mattoliverThis means we finally have support for aws-chunked so latest boto should now work.07:30
mattoliverThe next patch in the chain is important tho07:30
mattoliver#link https://review.opendev.org/c/openstack/swift/+/94407307:30
mattoliverAs it actually means we actually start checking the crcs users give us :P 07:31
mattoliverSo want it to land before the next actual swift release07:31
cschwedeSupporting latest boto release and crc checking sound like very useful fixes07:31
mattoliverThere are some test requirements causing issues, so couldn't land that one yet.07:31
mattoliveryeah! 07:32
mattoliverAnd I hope we can start using more of the crcs in swift too. 07:32
mattoliverMoving on07:32
mattoliver#topic swiftclient release07:33
mattolivertimburke_ needs to cut a new swiftclient release soon. 07:33
cschwedeNice, ptetera and his fix now mentioned as author in the 4.8.0 release07:33
mattoliver\o/07:33
mattoliverFinal topic I have07:34
mattoliver#topic conditional PUTs for s3api07:34
mattoliver#link https://review.opendev.org/c/openstack/swift/+/94968007:35
mattoliverThis one we found by a user using some s3 client (as normal). 07:35
mattoliverAWS has finally added If-Match and If-None-Match support now. We've always had If-None-Match: in swift07:36
mattoliverSo that patch starting using it in s3api07:37
mattoliveroh and it's already merged, so that makes life eaier07:37
cschwede:)07:37
mattoliverThere is more work to do on it, but at least we could easily support part of it.07:38
mattoliverAnyway, that's all I got for the agenda so..07:38
mattoliver#topic open discussion07:38
mattoliverAnything else anyone wants to bring up the meeting?07:39
mattoliverhows ptetera going? 07:39
cschwedeHe's working on more patches - will meet with him later today07:40
mattolivercool!07:40
cschwedeNothing else to bring up today on my side, thx07:41
mattoliverWe're working on base OS migration stuff. Which means tracing is finally coming onto our upcoming roadmap. So tracing might finally land soon! I've been cleaning it up. Will push the rebased version (which is always a pain) tomorrow probably. 07:43
mattoliverI should probably go a rebase the vsaio branch too. 07:43
mattoliverAnyway, that's all I have07:43
cschwedeAre you using tracing to detect differences between OS releases?07:43
mattoliverI could. but more the fact so I can actually build modern python packages :P 07:44
mattoliverand therefore start actaully using otel :P 07:44
cschwede:)07:44
mattoliverCool, well I'll call it early. I might go start making dinner for the fam :) 07:45
mattoliverThanks for coming and thanks for working on swift!07:45
mattoliver#endmeeting07:45
opendevmeetMeeting ended Wed May 21 07:45:49 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)07:45
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-21-07.02.html07:45
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-21-07.02.txt07:45
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2025/swift.2025-05-21-07.02.log.html07:45
cschwedeThanks Matt, have a nice evening!07:45
mattoliverGreat to be able to meet and chat with you more regularly cschwede ! Have a great day!07:46
kotaThanks mattoliver!07:46
opendevreviewAlistair Coles proposed openstack/swift master: s3api: more test cases for conditional writes.  https://review.opendev.org/c/openstack/swift/+/95037109:28
opendevreviewMerged openstack/swift master: s3api: more test cases for conditional writes.  https://review.opendev.org/c/openstack/swift/+/95037114:46
opendevreviewClay Gerrard proposed openstack/swift master: Make part_listdir_percent configurable  https://review.opendev.org/c/openstack/swift/+/94995316:05
opendevreviewMerged openstack/swift master: Add labeled metrics to proxy-logging  https://review.opendev.org/c/openstack/swift/+/91771117:14
-opendevstatus- NOTICE: Gerrit is being updated to the latest 3.10 bugfix release as part of early prep work for an eventual 3.11 upgrade. Gerrit will be offline momentarily while it restarts on the new version.17:35
opendevreviewTim Burke proposed openstack/swift master: s3api: Validate additional checksums on upload  https://review.opendev.org/c/openstack/swift/+/94407320:03
opendevreviewTim Burke proposed openstack/swift master: s3api: Add support for crc64nvme checksum calculation  https://review.opendev.org/c/openstack/swift/+/94614120:03
opendevreviewTim Burke proposed openstack/swift master: Add labeled metrics to s3api  https://review.opendev.org/c/openstack/swift/+/93948120:03
opendevreviewShreeya Deshpande proposed openstack/swift master: Provide some s3 helper methods for other middlewares to use.  https://review.opendev.org/c/openstack/swift/+/94079120:27
opendevreviewShreeya Deshpande proposed openstack/swift master: proxy-logging: Add real-time transfer bytes counters  https://review.opendev.org/c/openstack/swift/+/93091820:45
opendevreviewTim Burke proposed openstack/swift master: Revert "Remove unused MANIFEST.in"  https://review.opendev.org/c/openstack/swift/+/95061523:49

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!