Wednesday, 2023-05-10

opendevreviewOpenStack Proposal Bot proposed openstack/swift master: Imported Translations from Zanata  https://review.opendev.org/c/openstack/swift/+/88263502:52
opendevreviewMatthew Oliver proposed openstack/swift master: tracing: More unit tests  https://review.opendev.org/c/openstack/swift/+/88091107:01
opendevreviewMerged openstack/swift master: Sharder: add timing metrics for individual steps and total time spent.  https://review.opendev.org/c/openstack/swift/+/88211307:49
opendevreviewAlistair Coles proposed openstack/swift master: WIP: memcached: handle failed incr+add+incr better  https://review.opendev.org/c/openstack/swift/+/88067709:53
opendevreviewShreeya Deshpande proposed openstack/swift master: Unit test for keepalive timeout  https://review.opendev.org/c/openstack/swift/+/88151716:02
opendevreviewJianjian Huo proposed openstack/swift master: Memcached: emit memcache timing metrics when exceptions raised  https://review.opendev.org/c/openstack/swift/+/88067620:25
opendevreviewJianjian Huo proposed openstack/swift master: Memcached: emit memcache timing metrics when exceptions raised  https://review.opendev.org/c/openstack/swift/+/88067620:28
kotagood morning20:59
timburkeoh, right!21:00
timburke#startmeeting swift21:01
opendevmeetMeeting started Wed May 10 21:01:00 2023 UTC and is due to finish in 60 minutes.  The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot.21:01
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.21:01
opendevmeetThe meeting name has been set to 'swift'21:01
timburkewho's here for the swift meeting?21:01
kotao/21:01
mattolivero/21:02
timburkei've been a bit distracted and haven't updated the agenda -- but there were a couple items from last week worth following up on21:03
timburke#topic requests-mock pytest plugin21:03
timburke#link https://review.opendev.org/c/openstack/swift/+/88210521:03
timburkethe patch still needs to get restacked -- nobody's touched it in a bit, but i should be able to do that this afternoon21:04
timburkeafter that, i think it'll be pretty straightforward to merge the dev-env fix, then look at the probe test that wants to use s3api separately21:05
timburke#topic non-ascii py2 metadata from py321:06
timburke#link https://review.opendev.org/c/openstack/swift/+/87855821:06
timburkeclayg already has a +2 on it, and mattoliver has started to take a look21:06
mattoliveryeah, it looks good, some great research went into it, thanks Tim. 21:07
mattoliverJust want to test it in my SAIO on some different py2/py3 just to make sure21:07
timburkemattoliver, you're right that the key to it all is that we can (for now, anyway) determine that meta was written by py2 vs py3 by looking for some magic string in the raw meta21:08
mattoliverkk, nice find on a unique magic string to use. 21:09
timburkei still need to get a follow-up written that would have us *not* need to rely on that going forward -- but getting all existing meta readable had to come first21:09
mattoliveryeah +121:09
mattoliveralways returning a native string or something (like you suggested in the change) does make alot of sense. 21:10
timburkei'm not sure *when* i'll get to the follow-up, though, which maybe isn't great21:11
timburkein part that's because i still need to revisit...21:12
timburke#topic ring v221:12
mattoliverthat's ok. like you said, lets get the data out now21:12
timburkeclayg has started poking at the patch some more, and noticed that it needs some work around composite rings21:13
mattoliveraround the dev_id side wasn't it21:14
mattoliver*size21:14
timburke(i actually knew about that, once upon a time, but forgot about it as the patch to focus on has changed a few times)21:14
mattolivermakes sense, it has gone through many iterations21:15
timburkeyes -- basically, if you had two builders which independently had dev ids that would fit in 1 byte (say), but together needed wider arrays, it'd blow up (i think with an OverflowError? probably)21:15
mattoliverso me need to take the new created device ids into account when creating the composit ring. 21:16
mattoliverhave you started working on it, or would you like me to have a go?21:17
mattoliver(depending on how busy you are)21:17
timburkei haven't started on it, but i think i can get that fixed up this week, and also squash down a follow-up i had to try to draw better lines on the ZlibReader api21:17
timburkethanks though, mattoliver :-)21:17
mattoliverkk, let me know when you want me to take a  look at the patch then :) 21:18
mattolivernps21:18
timburkenext up...21:18
timburke#topic CMU student summer project21:18
timburkediablo_rojo came to me recently about putting together a mentorship project for "a group of 4-5 students from mid may to mid august"21:19
mattoliveroh cool21:20
timburkei'm not sure off-hand what that good project would *be*, though...21:20
kotanice21:20
timburkethere are some brief write-ups for some other projects at https://etherpad.opendev.org/p/CM-project-proposals21:21
mattoliverhealth status command that takes in a bunch of data (recon, dispersion, ring dispersion etc)? 21:21
zaitcevProxyFS :-)21:21
mattoliverlol21:21
mattoliveranyway, nice, will do some brain storming21:22
timburkethanks -- and if anyone's interested in being one of the mentors, let me know!21:23
timburkethe health-status idea's not bad -- though it might be tricky to sort out what should and shouldn't be included :-/21:23
mattoliverthats apart of the project ;) 21:24
mattoliverI'm happy to put my hand up as a mentor, although my timezone doesn't usually help21:25
timburkebut if they have to start from there, it may require more than 3 months to figure out ;-)21:25
mattolivertrue21:25
timburkethat's all i've got21:25
timburke#topic open discussion21:25
timburkeanything else we should bring up this week?21:25
zaitcevAre you guys overloading Alistair recently? I want my dark data watcher complete dammit.21:26
zaitcevIt's even your patch, Tim.21:26
mattoliverlol21:26
timburkeyou're right, i should look at that again... sorry21:26
mattoliverAl has been away for the last week or 2. Just got back this week. I'll remind him ;) 21:26
zaitcevhttps://review.opendev.org/c/openstack/swift/+/78765621:27
zaitcevAlso21:27
zaitcevOn a completely unrelated note, I'm going to Vancouver.21:27
mattoliverLucky21:29
kotaoh great, but not me unfortunately.21:29
timburkeoh, cool! i'm not planning on going, but i know notmyname will be there :-)21:29
mattolivermy employer isn't letting people travel yet, and the cost to pay my own way probably is a little too high from Oz. 21:29
mattoliverFor me, it's same old. Got even more tracing unit tests done. Been testing some of jianjain's new sharder metrics. 21:30
mattoliverAlso after shardrange listing_v2 in memcache landed it's make my internal client get shard ranges interface more problematic.. so disucssions happening there on the best follow up approach.21:30
mattoliver*made21:31
mattoliver#link https://review.opendev.org/c/openstack/swift/+/87758421:31
mattoliverI do have a random follow up as a possible solution. 21:32
mattoliverlong term having more internal clients around in the cluster can be a little expensive, ie they load up all the rings. Al and I discussed a possible future idea of having the internal client lazy load the rings, so we only load what we end up using.21:33
mattoliverso for the sharder, it'll only ever load up the container ring, because that's all it uses.21:33
mattoliverthats a little of topic from my patch but was an interesting memory saving thought21:34
timburkeoh man, i should dust off https://review.opendev.org/c/openstack/swift/+/670674 again -- it's been a couple years since i last looked at it...21:35
timburkebut i'd love to make it so we aren't so worried about ring loading ;-)21:35
mattoliveryeah! that would work too!21:36
mattoliverA local service over a domain socket.. maybe its another idea for a group project?21:36
timburke💡21:37
zaitcevA local service to do what? Ring lookups?21:37
timburkeyup21:37
mattoliveranyway, that's all I've got21:39
timburkealright, i think i'll call it then21:40
timburkethank you all for coming, and thank you for working on swift!21:40
timburke#endmeeting21:40
opendevmeetMeeting ended Wed May 10 21:40:28 2023 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)21:40
opendevmeetMinutes:        https://meetings.opendev.org/meetings/swift/2023/swift.2023-05-10-21.01.html21:40
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/swift/2023/swift.2023-05-10-21.01.txt21:40
opendevmeetLog:            https://meetings.opendev.org/meetings/swift/2023/swift.2023-05-10-21.01.log.html21:40
opendevreviewTim Burke proposed openstack/swift master: disable requests_mock pytest plugin  https://review.opendev.org/c/openstack/swift/+/88210521:48
opendevreviewTim Burke proposed openstack/swift master: Passing probe with bad behavior  https://review.opendev.org/c/openstack/swift/+/86650821:48

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!