| opendevreview | Matthew Oliver proposed openstack/python-swiftclient master: Add formpost subcommand to generate signature https://review.opendev.org/c/openstack/python-swiftclient/+/833954 | 01:10 |
|---|---|---|
| seongsoocho | Hi ! I checked the ptg schedule. Is the current schedule on the ptg website confirmed? | 01:46 |
| opendevreview | Matthew Oliver proposed openstack/swift master: db: shard up the DatabaseBroker pending files https://review.opendev.org/c/openstack/swift/+/830551 | 03:36 |
| mattoliver | seongsoocho: Tim said it was 13 UTC start everyday. So quite late for us. Though I think less late for you :) | 03:42 |
| seongsoocho | mattoliver: oh I see. thanks. 13 UTC is 22pm to me :-) | 03:44 |
| kota | mattoliver: do we find the official schedule link for the ptg schedule? It would be nice to have the schedule to me to get approval to shift my daily work time on the week. | 04:42 |
| kota | Usually, it's at https://www.openstack.org/ptg/ but not found at this time. | 04:42 |
| mattoliver | kota: official one doesn't seem to be up yet, but https://ptg.opendev.org/ptg.html seems to be correct. | 05:19 |
| kota | mattoliver: oh nice! it looks we have 3 days slot so we will need to up at night on Tue, Wed, Thu, right? | 05:22 |
| mattoliver | 4 days I see, Mon, tues, wed, thurs in UTC so Those evening for us (unless my timezone fu is off) | 05:50 |
| mattoliver | or rather over our nights | 05:51 |
| opendevreview | Tim Burke proposed openstack/swift master: CI: Run CORS tests under py3 https://review.opendev.org/c/openstack/swift/+/834363 | 06:12 |
| *** clarkb is now known as Guest106 | 07:31 | |
| kota | mattoliver: ok, thx | 09:23 |
| * kota was missing Mom starts from 13:00 UTC on the leftside | 09:24 | |
| *** Guest106 is now known as clarkb | 15:24 | |
| opendevreview | Alistair Coles proposed openstack/swift master: WIP Refactor rate-limiting helper into a class https://review.opendev.org/c/openstack/swift/+/834960 | 18:32 |
| opendevreview | Merged openstack/swift master: CI: Run CORS tests under py3 https://review.opendev.org/c/openstack/swift/+/834363 | 19:15 |
| timburke__ | almost meeting time! | 20:56 |
| kota | good morning | 20:58 |
| *** timburke__ is now known as timburke | 20:58 | |
| timburke | #startmeeting swift | 21:00 |
| opendevmeet | Meeting started Wed Mar 23 21:00:02 2022 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:00 |
| opendevmeet | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:00 |
| opendevmeet | The meeting name has been set to 'swift' | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| kota | o/ | 21:00 |
| mattoliver | o/ | 21:00 |
| timburke | as usual, the agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:02 |
| timburke | not a whole lot for this week (which is good; i've got another meeting midway through this one :P) | 21:03 |
| timburke | #topic PTG | 21:03 |
| timburke | just another reminder :-) | 21:03 |
| timburke | #link https://etherpad.opendev.org/p/swift-ptg-zed | 21:03 |
| timburke | has development topics | 21:03 |
| timburke | and if you haven't already, register at | 21:03 |
| timburke | #link https://openinfra-ptg.eventbrite.com/ | 21:03 |
| timburke | meeting times and rooms are on the etherpad now, too | 21:04 |
| mattoliver | I've convinced csmart to come and had a chat with some of our SREs and recommended they look at adding any topics they're interested in (and turn up for them). | 21:04 |
| timburke | sorry again about the times kota and mattoliver -- i figure we ought to try to front-load the time slot so you guys can get to bed and not worry about missing much | 21:05 |
| kota | no problem | 21:05 |
| timburke | but i also didn't want to invade your saturday | 21:06 |
| mattoliver | yeah no probs, I'll have an excuse for asking silly questions :P | 21:06 |
| timburke | #topic py2 support in swiftclient | 21:06 |
| timburke | it's gone! | 21:06 |
| timburke | someone's apparently been champing at the bit to clean up the cruft from a mixed py2/py3 codebase, too, so there's been a bunch of patches landing recently | 21:07 |
| mattoliver | yeah, that's been awesome | 21:08 |
| timburke | if anyone wants to look at some more of that sort of thing, i pushed up https://review.opendev.org/c/openstack/python-swiftclient/+/834751 to address some things i noticed while reviewing the other patches | 21:08 |
| mattoliver | I have to learn to stop leaning on six as a python crutch now :) | 21:09 |
| timburke | i also rebased a few old patches i had -- my hope is that dropping py2 support will make us a little more inclined to show the client some love | 21:10 |
| mattoliver | Also meant I had to rebase https://review.opendev.org/c/openstack/python-swiftclient/+/833954 already, but that's a good thing, actaully makes it cleaner, no more getattr. | 21:10 |
| timburke | \o/ | 21:10 |
| timburke | server side, i expect we'll want to wait at least a few months before doing a py2 cleanup -- all that churn will make it really difficult to cherry-pick fixes to the stable/yoga branch if anything comes up | 21:11 |
| timburke | #topic ring v2 | 21:12 |
| timburke | just a status update: i started tinkering with a new approach that brings in the index idea from last ptg | 21:13 |
| timburke | #link https://review.opendev.org/c/openstack/swift/+/834261 | 21:13 |
| mattoliver | It's an awesome implementation Tim. So easy to use. | 21:13 |
| mattoliver | I did a quick follow up that adding a few extra features, helper to write the version string/magic | 21:14 |
| timburke | mattoliver's done a great job building on top of it, too -- we'll keep working on making that chain great in time to talk about it at *this* ptg :-) | 21:14 |
| mattoliver | I've got a new last_part_table that stores index as well | 21:14 |
| timburke | that's the important thing to keep in mind: what we *really want* is a way to track some ring history so we can make replication/reconstruction smarter | 21:15 |
| mattoliver | and almost completed a new version of the reconstructor that uses it. And does so much earlier so we don't waste ssync connections. Hopefully get the first version of that up today. | 21:15 |
| mattoliver | yup +100 | 21:15 |
| mattoliver | Because I have the index at hand, I only need to check if one of the neighbours/partners happen to also be the same index. | 21:16 |
| mattoliver | and do things only then. | 21:16 |
| mattoliver | So far it's coming out much nicer (famous last words) :P | 21:17 |
| timburke | there's definitely some sneaky bits to the new format -- i do a bunch of Z_FULL_FLUSH flushes as we're writing so we can come back and just start reading, and there's this one point where i swap out the decompressor for the GzipFile so i can force it to be uncompressed so i know exactly how many bytes i'm going to write out... | 21:18 |
| timburke | but on the whole, i think i drew sane boundaries around it so we mostly don't have to think about it :-) | 21:18 |
| timburke | (speaking of famous last words...) | 21:18 |
| mattoliver | lol | 21:18 |
| mattoliver | well just so see the (de)serialize_v2 in the follow up. I think it shows it's a winner :) | 21:19 |
| mattoliver | *go | 21:19 |
| timburke | yeah, i was about to say -- if anyone wants to start loading it into their head, that patch is a great place to start so you can see how the RingWriter api is actually used | 21:20 |
| timburke | #topic storage server ratelimiting | 21:20 |
| timburke | we've been seeing issues where servers get overloaded (often trying to get one particular object) and it starts causing broader performance degradation | 21:22 |
| timburke | clayg's been playing with getting some ratelimiting in there so we can just 503 before hitting disk | 21:23 |
| opendevreview | Matthew Oliver proposed openstack/swift master: POC: Random hack to add some kind of disk stat based ratelimiting https://review.opendev.org/c/openstack/swift/+/834099 | 21:24 |
| timburke | the idea being that we want to still have the iops to be able to serve the *other* bytes that are on this poor disk | 21:24 |
| mattoliver | sorry, that got me thinking about that patch I was playing with, that I still had stuck on my laptop. | 21:25 |
| timburke | and mattoliver's been looking at how to make it so ops don't need to pick some number out of the air, but make it a little more adaptive | 21:25 |
| timburke | this reminds me of issues we've had with overloaded container-servers, too -- i think the main take-away is that we need to (and are working towards) have backend servers be more defensive and shed load | 21:27 |
| mattoliver | Yeah I should blow some dust of the adaptive code. | 21:27 |
| timburke | that's all i've got | 21:27 |
| timburke | #topic open discussion | 21:27 |
| mattoliver | speaking of container servers I'd love to have someone take a look at: https://review.opendev.org/c/openstack/swift/+/830551 | 21:27 |
| mattoliver | It seems to be a big improvement to concurrent access to the same database. | 21:28 |
| timburke | yeah! i can try to take a look this week | 21:28 |
| mattoliver | at least in my vsaio. | 21:28 |
| mattoliver | thanks. | 21:28 |
| mattoliver | Well I have another meeting to get t | 21:28 |
| mattoliver | to | 21:28 |
| mattoliver | So that's all I have.. for now :P | 21:28 |
| kota | no topics from me, thx timburke | 21:29 |
| timburke | all right | 21:29 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:29 |
| timburke | #endtopic | 21:29 |
| timburke | #endmeeting | 21:30 |
| opendevmeet | Meeting ended Wed Mar 23 21:30:12 2022 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:30 |
| opendevmeet | Minutes: https://meetings.opendev.org/meetings/swift/2022/swift.2022-03-23-21.00.html | 21:30 |
| opendevmeet | Minutes (text): https://meetings.opendev.org/meetings/swift/2022/swift.2022-03-23-21.00.txt | 21:30 |
| opendevmeet | Log: https://meetings.opendev.org/meetings/swift/2022/swift.2022-03-23-21.00.log.html | 21:30 |
| csmart | thanks mattoliverau, sorry my dog hurt his foot so was at the vet this morning.. | 21:39 |
| csmart | /reads scrollback | 21:44 |
| timburke | csmart, hope he gets better quickly! | 22:26 |
| csmart | Thanks! Looks like soft tissue damage, they gave him an anti-inflammatory shot and we'll see how he goes... | 22:36 |
| opendevreview | Tim Burke proposed openstack/swift master: probe: Make sure we know what version of python we're testing in the gate https://review.opendev.org/c/openstack/swift/+/793503 | 22:37 |
| opendevreview | Tim Burke proposed openstack/swift master: utils: Make PipeMutex marginally more robust to "Too many open files" errors https://review.opendev.org/c/openstack/swift/+/753397 | 23:16 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!