Wednesday, 2024-05-29

opendevreviewElod Illes proposed openstack/swift unmaintained/wallaby: Clean up centos-7 based jobs  https://review.opendev.org/c/openstack/swift/+/91844512:31
opendevreviewClay Gerrard proposed openstack/swift master: tests: realistic task_container names  https://review.opendev.org/c/openstack/swift/+/91963813:42
opendevreviewClay Gerrard proposed openstack/swift master: configurable object_expirer_task_container_per_day  https://review.opendev.org/c/openstack/swift/+/92045213:42
opendevreviewMerged openstack/swift unmaintained/wallaby: Clean up centos-7 based jobs  https://review.opendev.org/c/openstack/swift/+/91844515:55
opendevreviewShreeya Deshpande proposed openstack/swift master: Move StatsdClient config parsing from get_logger to get_statsd_client  https://review.opendev.org/c/openstack/swift/+/91944417:33
opendevreviewShreeya Deshpande proposed openstack/swift master: HybridMultiObjectDispatcher  https://review.opendev.org/c/openstack/swift/+/91548319:21
opendevreviewASHWIN A NAIR proposed openstack/python-swiftclient master: support part-num in python swiftclient  https://review.opendev.org/c/openstack/python-swiftclient/+/92077620:25
opendevreviewTim Burke proposed openstack/swift master: Stop using cgi.parse_header  https://review.opendev.org/c/openstack/swift/+/88790820:47
kotagood morning20:58
mattoliverMorning21:02
opendevreviewTim Burke proposed openstack/swift master: s3api: Clean up some sha256 validation/mismatch errors  https://review.opendev.org/c/openstack/swift/+/92020621:03
opendevreviewTim Burke proposed openstack/swift master: utils: Add crc32c function  https://review.opendev.org/c/openstack/swift/+/90980021:03
opendevreviewTim Burke proposed openstack/swift master: s3api: Add support for additional checksums  https://review.opendev.org/c/openstack/swift/+/90980121:03
opendevreviewTim Burke proposed openstack/swift master: s3api: Additional checksums for MPUs  https://review.opendev.org/c/openstack/swift/+/90980221:03
timburkeoh hey, meeting time!21:03
timburke#startmeeting swift21:04
opendevmeetMeeting started Wed May 29 21:04:00 2024 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:04
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:04
opendevmeetThe meeting name has been set to 'swift'21:04
timburkewho's here for the swift meeting?21:04
kotao/21:04
mattolivero/21:04
timburkei neglected to update the agenda again21:05
timburkebut we've got a few bodies of work moving forward21:05
timburke#topic cgi removal21:05
timburkei realized just today that we actually have something already in-tree that's close to what we want for a cgi.parse_header replacement21:06
timburkeso i updated p 887908 to use utils.parse_content_type21:06
patch-bothttps://review.opendev.org/c/openstack/swift/+/887908 - swift - Stop using cgi.parse_header - 4 patch sets21:06
mattoliveroh, well that's handy :) 21:07
timburkethere was one spot where it didn't work -- if the parameter had a slash in it, it'd lose everything between the slash and the next semicolon21:08
timburkei considered just allowing slashes all the time, but given the attempts to maintain RFC compliance, i figured i ought to add a `strict` arg, and only allow slashes when not strict21:10
mattoliverDo we need to think about renaming the function.  parse_content_type doesn't sound quite right in the new places21:10
timburkefair question -- i don't have strong feelings either way21:12
timburkewe can discuss more on the patch, i suppose21:13
timburkenext up21:13
mattoliveryeah, happy to move it there. I'll have a closer look and play with it first anyway :) 21:13
timburke#topic expirer21:14
timburkeclayg's been pushing in a few different directions21:14
timburke#link https://review.opendev.org/c/openstack/swift/+/91996021:14
patch-botpatch 919960 - swift - object-expirer: refactor creating InternalClient - 3 patch sets21:15
jianjianI have looked into a few of them. :-)21:15
timburke#link https://review.opendev.org/c/openstack/swift/+/91963821:15
patch-botpatch 919638 - swift - tests: realistic task_container names - 4 patch sets21:15
timburke#link https://review.opendev.org/c/openstack/swift/+/91249621:15
patch-botpatch 912496 - swift - add bytes of expiring objects to queue entry - 19 patch sets21:15
timburke#link https://review.opendev.org/c/openstack/swift/+/92045221:16
patch-botpatch 920452 - swift - configurable object_expirer_task_container_per_day - 3 patch sets21:16
mattoliverwoah, just a few different directions :P 21:16
jianjian"add bytes of expiring objects to queue entry" this one is running on prod already, maybe we should get it merged?21:17
timburkei'm still torn about how deeply to look at p 914713 when there's some hope that p 918366 will make it largely unnecessary21:17
patch-bothttps://review.opendev.org/c/openstack/swift/+/914713 - swift - DNM expirer: new options to control task iteration - 18 patch sets21:17
patch-bothttps://review.opendev.org/c/openstack/swift/+/918366 - swift - Parallel distirbuted task container iteration - 3 patch sets21:17
timburkejianjian, agreed -- it's on my list to take another look21:18
timburkethe check job failures looked like some transient mirror issues21:19
timburkemeanwhile...21:21
timburke#topic skipping inline updates21:22
jianjianI took a look at "Parallel distirbuted task container iteration" yesterday, left a few comments, I feel we could have those different strategies for users to choose from, like "legacy", "random" or "parallel". 21:22
timburkemattoliver is still pushing on p 91966721:22
patch-bothttps://review.opendev.org/c/openstack/swift/+/919667 - swift - obj: skip to async_pending when root is busy - 7 patch sets21:22
opendevreviewYan Xiao proposed openstack/swift master: tests: Check proxy-logging stats on the wire  https://review.opendev.org/c/openstack/swift/+/89696721:22
opendevreviewYan Xiao proposed openstack/swift master: stats: API for native labeled metrics  https://review.opendev.org/c/openstack/swift/+/90988221:22
mattoliveryup. refactored some annoyingly similar tests. Also used it as an example of how to gerrit for the qatar students (whom should be mostly in channel but sleeping now) :) 21:23
timburkenice!21:23
jianjian"obj: skip to async_pending when root is busy" nice work! I am going to take a look at it too.21:24
mattoliverthanks jianjian 21:25
timburkeelsewhere21:25
timburke#topic stats/logger separation21:25
timburkeshreeya's pushing on p 919444 and p 91548321:26
patch-bothttps://review.opendev.org/c/openstack/swift/+/919444 - swift - Move StatsdClient config parsing from get_logger t... - 4 patch sets21:26
patch-bothttps://review.opendev.org/c/openstack/swift/+/915483 - swift - HybridMultiObjectDispatcher - 12 patch sets21:26
timburkewhichlooks like the second one's still got some test failures, though21:27
timburkebut again, we're interested in trying to get it sorted out ahead of21:27
timburke#topic labeled metrics21:27
mattolivernice segway!21:28
timburkewhich yan's been keeping chained on top in p 896967 and p 90988221:28
patch-bothttps://review.opendev.org/c/openstack/swift/+/896967 - swift - tests: Check proxy-logging stats on the wire - 10 patch sets21:28
patch-bothttps://review.opendev.org/c/openstack/swift/+/909882 - swift - stats: API for native labeled metrics - 15 patch sets21:28
timburkenext up21:29
timburke#topic DB vacuuming21:29
timburke#link https://review.opendev.org/c/openstack/swift/+/91686121:30
patch-botpatch 916861 - swift - db_auditor: add vacuum support - 5 patch sets21:30
timburkei saw zaitcev took a look recently -- thanks! i think there's some good points there, though we might still try it out in our prod cluster and see how things go21:31
mattoliveryup, I need to loop around and respond to those. 21:31
mattoliverI personally like having 2 options/triggers at once. But still more testing is required on it.21:32
timburkeand last up21:33
mattoliverWe might (once we feel satifided) just run it with vacuum turned off to get the metrics it generates out to see "how" bad bloated dbs are. 21:33
timburke#topic aws-chunked support21:33
timburkei wrote a custom s3 client that lets me send all the invalid headers i want! i plan on using it to investigate the various failure modes of the aws-chunked protocol21:34
timburkeand it's already surfaced some differences in how we handle x-amz-content-sha256 mismatches21:35
timburke#link https://review.opendev.org/c/openstack/swift/+/92020621:35
patch-botpatch 920206 - swift - s3api: Clean up some sha256 validation/mismatch er... - 3 patch sets21:35
mattoliveroh nice21:36
timburkeand i've started to use it with the first additional-checksums patch21:36
timburke#link https://review.opendev.org/c/openstack/swift/+/90980121:36
patch-botpatch 909801 - swift - s3api: Add support for additional checksums - 15 patch sets21:36
timburkenext up, i need to refresh my memory about some of the notes i left myself in the MPU patch's commit message21:37
timburke#link https://review.opendev.org/c/openstack/swift/+/90980221:37
patch-botpatch 909802 - swift - s3api: Additional checksums for MPUs - 14 patch sets21:37
timburkethen stack up the actual aws-chunked patch and investigate those failure modes21:38
timburke#link https://review.opendev.org/c/openstack/swift/+/83675521:38
patch-botpatch 836755 - swift - Add support of Sigv4-streaming - 21 patch sets21:38
timburkei think that's all i've got21:39
timburke#topic open discussion21:39
timburkeanything else we ought to talk about?21:39
timburkethere's a *lot* of stuff everyone's working on!21:39
mattoliveryeah! great work everyone! I plan to get round and review a bunch more this week. Been a bit of a distracted with other work week (And family all got gastro which didn't help). 21:41
mattoliverBut means I don't have much to update this time round21:41
timburkeall right, i think i'll call it early then21:44
timburkethank you all for coming, and thank you for working on swift!21:44
timburke#endmeeting21:44
opendevmeetMeeting ended Wed May 29 21:44:31 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:44
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2024/swift.2024-05-29-21.04.html21:44
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2024/swift.2024-05-29-21.04.txt21:44
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2024/swift.2024-05-29-21.04.log.html21:44
zaitcevmattoliver: I'm okay with 2 options for vacuum, I just don't like confusing, redundant, and unnecessarily voluminous documentation.21:50
timburkeoh, and it looks like the most recent gate failures are the result of a known issue, and already being worked upon -- see p 92077921:57
patch-bothttps://review.opendev.org/c/openstack/project-config/+/920779 - project-config - Chown the /opt/git repo cache to zuul:zuul - 1 patch set21:57
clarkbya its a bit of a mess. We expect that to address the problem but it may be a little while until it is fully in place. Until then we've deleted the newer test node images which should get us by in the interim21:59
timburkethanks, clarkb!22:00

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!