| *** hemna has quit IRC | 00:08 | |
| *** hemna has joined #openstack-meeting | 00:09 | |
| *** rh-jlabarre has quit IRC | 00:21 | |
| *** hemna_ has joined #openstack-meeting | 00:30 | |
| *** hemna has quit IRC | 00:30 | |
| *** moguimar has quit IRC | 01:04 | |
| *** moguimar has joined #openstack-meeting | 01:06 | |
| *** armax has quit IRC | 01:25 | |
| *** moguimar has quit IRC | 01:28 | |
| *** moguimar has joined #openstack-meeting | 01:29 | |
| *** hemna_ has quit IRC | 01:36 | |
| *** hemna has joined #openstack-meeting | 01:37 | |
| *** hemna has quit IRC | 02:11 | |
| *** armax has joined #openstack-meeting | 02:13 | |
| *** hemna has joined #openstack-meeting | 02:18 | |
| *** macz_ has joined #openstack-meeting | 02:34 | |
| *** macz_ has quit IRC | 02:38 | |
| *** rcernin has quit IRC | 02:45 | |
| *** rcernin has joined #openstack-meeting | 02:48 | |
| *** gyee has quit IRC | 02:56 | |
| *** rcernin has quit IRC | 03:01 | |
| *** rcernin has joined #openstack-meeting | 03:17 | |
| *** rcernin has quit IRC | 03:22 | |
| *** rcernin has joined #openstack-meeting | 03:23 | |
| *** psachin has joined #openstack-meeting | 03:41 | |
| *** vishalmanchanda has joined #openstack-meeting | 03:43 | |
| *** armax has quit IRC | 04:01 | |
| *** macz_ has joined #openstack-meeting | 04:22 | |
| *** yasufum has joined #openstack-meeting | 04:23 | |
| *** macz_ has quit IRC | 04:26 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-meeting | 04:33 | |
| *** ricolin_ has joined #openstack-meeting | 05:15 | |
| *** ricolin_ has quit IRC | 05:26 | |
| *** yasufum has quit IRC | 06:31 | |
| *** icey has quit IRC | 06:39 | |
| *** icey has joined #openstack-meeting | 06:41 | |
| *** icey has quit IRC | 06:45 | |
| *** icey has joined #openstack-meeting | 06:48 | |
| *** ralonsoh has joined #openstack-meeting | 06:54 | |
| *** vishalmanchanda has quit IRC | 07:02 | |
| *** icey has quit IRC | 07:04 | |
| *** slaweq has joined #openstack-meeting | 07:05 | |
| *** e0ne has joined #openstack-meeting | 07:07 | |
| *** slaweq has quit IRC | 07:09 | |
| *** haleyb has quit IRC | 07:10 | |
| *** haleyb has joined #openstack-meeting | 07:11 | |
| *** vishalmanchanda has joined #openstack-meeting | 07:11 | |
| *** slaweq has joined #openstack-meeting | 07:14 | |
| *** icey has joined #openstack-meeting | 07:18 | |
| *** gagehugo has quit IRC | 07:20 | |
| *** gagehugo has joined #openstack-meeting | 07:20 | |
| *** njohnston has quit IRC | 07:33 | |
| *** rcernin has quit IRC | 07:39 | |
| *** tosky has joined #openstack-meeting | 07:41 | |
| *** rpittau|afk is now known as rpittau | 07:41 | |
| *** ykatabam has quit IRC | 07:49 | |
| *** icey has quit IRC | 07:57 | |
| *** icey has joined #openstack-meeting | 08:00 | |
| *** tosky_ has joined #openstack-meeting | 08:12 | |
| *** tosky is now known as Guest98160 | 08:13 | |
| *** tosky_ is now known as tosky | 08:13 | |
| *** Guest98160 has quit IRC | 08:15 | |
| *** ykatabam has joined #openstack-meeting | 08:30 | |
| *** hyunsikyang has joined #openstack-meeting | 08:31 | |
| *** hyunsikyang__ has quit IRC | 08:34 | |
| *** hyunsikyang__ has joined #openstack-meeting | 08:35 | |
| *** hyunsikyang has quit IRC | 08:37 | |
| *** hyunsikyang has joined #openstack-meeting | 08:42 | |
| *** Lucas_Gray has joined #openstack-meeting | 08:43 | |
| *** hyunsikyang__ has quit IRC | 08:45 | |
| *** Lucas_Gray has quit IRC | 08:49 | |
| *** Lucas_Gray has joined #openstack-meeting | 08:51 | |
| *** manpreet has joined #openstack-meeting | 08:55 | |
| *** Lucas_Gray has quit IRC | 09:06 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:07 | |
| *** lpetrut has joined #openstack-meeting | 09:13 | |
| *** ykatabam has quit IRC | 09:13 | |
| *** hemna has quit IRC | 09:19 | |
| *** hemna has joined #openstack-meeting | 09:21 | |
| *** ociuhandu has joined #openstack-meeting | 09:24 | |
| *** ociuhandu has quit IRC | 09:29 | |
| *** Lucas_Gray has quit IRC | 09:43 | |
| *** yasufum has joined #openstack-meeting | 09:43 | |
| *** ociuhandu has joined #openstack-meeting | 09:56 | |
| *** Lucas_Gray has joined #openstack-meeting | 09:56 | |
| *** ykatabam has joined #openstack-meeting | 10:19 | |
| *** rcernin has joined #openstack-meeting | 10:21 | |
| *** yasufum has quit IRC | 10:24 | |
| *** Lucas_Gray has quit IRC | 10:34 | |
| *** Lucas_Gray has joined #openstack-meeting | 10:37 | |
| *** ykatabam has quit IRC | 10:37 | |
| *** rcernin has quit IRC | 10:37 | |
| *** oneswig has joined #openstack-meeting | 10:51 | |
| *** oneswig has quit IRC | 10:59 | |
| *** oneswig_ has joined #openstack-meeting | 10:59 | |
| oneswig_ | #startmeeting scientific-sig | 11:00 |
|---|---|---|
| openstack | Meeting started Wed Oct 7 11:00:21 2020 UTC and is due to finish in 60 minutes. The chair is oneswig_. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 11:00 |
| oneswig_ | hello o/ | 11:01 |
| *** oneswig_ has quit IRC | 11:02 | |
| *** raildo has joined #openstack-meeting | 11:04 | |
| *** Lucas_Gray has quit IRC | 11:07 | |
| *** zerozephyrum has joined #openstack-meeting | 11:09 | |
| *** Lucas_Gray has joined #openstack-meeting | 11:12 | |
| *** zerozephyrum has quit IRC | 11:18 | |
| *** belmoreira has joined #openstack-meeting | 11:22 | |
| *** njohnston_ has joined #openstack-meeting | 11:25 | |
| *** Wryhder has joined #openstack-meeting | 11:46 | |
| *** Lucas_Gray has quit IRC | 11:46 | |
| *** Wryhder is now known as Lucas_Gray | 11:47 | |
| *** masazumi-ota has quit IRC | 11:51 | |
| *** psahoo has joined #openstack-meeting | 11:52 | |
| *** rfolco has joined #openstack-meeting | 12:11 | |
| *** eharney_ is now known as eharney | 12:27 | |
| *** rf0lc0 has joined #openstack-meeting | 13:03 | |
| *** raildo_ has joined #openstack-meeting | 13:03 | |
| *** rh-jlabarre has joined #openstack-meeting | 13:03 | |
| *** rfolco has quit IRC | 13:03 | |
| *** raildo has quit IRC | 13:03 | |
| *** manpreet has quit IRC | 13:03 | |
| *** vishalmanchanda has quit IRC | 13:03 | |
| *** evrardjp has quit IRC | 13:04 | |
| *** moguimar has quit IRC | 13:04 | |
| *** jmasud has quit IRC | 13:04 | |
| *** jamesdenton has quit IRC | 13:04 | |
| *** ttx has quit IRC | 13:04 | |
| *** patrickeast has quit IRC | 13:04 | |
| *** mattoliverau has quit IRC | 13:04 | |
| *** freefood has quit IRC | 13:04 | |
| *** Lucas_Gray has quit IRC | 13:04 | |
| *** manpreet has joined #openstack-meeting | 13:04 | |
| *** vishalmanchanda has joined #openstack-meeting | 13:04 | |
| *** evrardjp has joined #openstack-meeting | 13:04 | |
| *** jmasud has joined #openstack-meeting | 13:07 | |
| *** moguimar has joined #openstack-meeting | 13:09 | |
| *** jamesdenton has joined #openstack-meeting | 13:09 | |
| *** patrickeast has joined #openstack-meeting | 13:09 | |
| *** mattoliverau has joined #openstack-meeting | 13:09 | |
| *** freefood has joined #openstack-meeting | 13:09 | |
| *** psahoo_ has joined #openstack-meeting | 13:09 | |
| *** psahoo has quit IRC | 13:12 | |
| *** ttx has joined #openstack-meeting | 13:17 | |
| *** Adri2000 has joined #openstack-meeting | 13:25 | |
| *** TrevorV has joined #openstack-meeting | 13:45 | |
| *** whoami-rajat___ has joined #openstack-meeting | 13:46 | |
| *** yasufum has joined #openstack-meeting | 14:01 | |
| *** thgcorrea has joined #openstack-meeting | 14:03 | |
| *** yasufum_ has joined #openstack-meeting | 14:04 | |
| *** yasufum has quit IRC | 14:05 | |
| *** yasufum_ is now known as yasufum | 14:05 | |
| *** macz_ has joined #openstack-meeting | 14:35 | |
| *** icey has quit IRC | 14:36 | |
| *** icey has joined #openstack-meeting | 14:36 | |
| *** macz_ has quit IRC | 14:39 | |
| *** armax has joined #openstack-meeting | 14:40 | |
| *** psahoo_ has quit IRC | 14:43 | |
| *** lpetrut has quit IRC | 14:45 | |
| *** njohnston_ is now known as njohnston | 14:52 | |
| *** priteau has joined #openstack-meeting | 14:57 | |
| *** slaweq_ has joined #openstack-meeting | 14:58 | |
| *** macz_ has joined #openstack-meeting | 14:58 | |
| *** slaweq has quit IRC | 14:58 | |
| *** mlavalle has joined #openstack-meeting | 15:05 | |
| *** yasufum has quit IRC | 15:16 | |
| *** yasufum has joined #openstack-meeting | 15:24 | |
| *** TrevorV has quit IRC | 15:33 | |
| *** TrevorV has joined #openstack-meeting | 15:34 | |
| *** Lucas_Gray has joined #openstack-meeting | 15:42 | |
| *** belmoreira has quit IRC | 15:44 | |
| *** yasufum has quit IRC | 15:45 | |
| *** rpittau is now known as rpittau|afk | 16:06 | |
| *** slaweq has joined #openstack-meeting | 16:06 | |
| *** slaweq_ has quit IRC | 16:07 | |
| *** ociuhandu has quit IRC | 16:11 | |
| *** dsariel has joined #openstack-meeting | 16:18 | |
| *** psachin has quit IRC | 16:19 | |
| *** tosky has quit IRC | 16:21 | |
| *** ociuhandu has joined #openstack-meeting | 16:43 | |
| *** ociuhandu has quit IRC | 16:49 | |
| *** Wryhder has joined #openstack-meeting | 16:55 | |
| *** Lucas_Gray has quit IRC | 16:55 | |
| *** Wryhder is now known as Lucas_Gray | 16:56 | |
| *** yasufum has joined #openstack-meeting | 17:06 | |
| *** yasufum has quit IRC | 17:09 | |
| *** ralonsoh has quit IRC | 17:12 | |
| *** ralonsoh has joined #openstack-meeting | 17:12 | |
| *** dsariel has quit IRC | 17:13 | |
| *** dsariel has joined #openstack-meeting | 17:14 | |
| *** macz_ has quit IRC | 17:14 | |
| *** macz_ has joined #openstack-meeting | 17:15 | |
| *** mahatic has quit IRC | 17:17 | |
| *** Lucas_Gray has quit IRC | 17:18 | |
| *** Lucas_Gray has joined #openstack-meeting | 17:20 | |
| *** Adri2000 has quit IRC | 17:20 | |
| *** e0ne has quit IRC | 17:23 | |
| *** Lucas_Gray has quit IRC | 17:25 | |
| *** Lucas_Gray has joined #openstack-meeting | 17:26 | |
| *** Lucas_Gray has quit IRC | 17:34 | |
| *** Lucas_Gray has joined #openstack-meeting | 17:38 | |
| *** Lucas_Gray has quit IRC | 17:48 | |
| *** mlavalle has quit IRC | 17:56 | |
| *** mlavalle has joined #openstack-meeting | 18:14 | |
| *** armstrong has joined #openstack-meeting | 18:15 | |
| *** lpetrut has joined #openstack-meeting | 18:18 | |
| *** vishalmanchanda has quit IRC | 18:22 | |
| *** lpetrut has quit IRC | 18:36 | |
| *** Adri2000 has joined #openstack-meeting | 18:43 | |
| *** priteau has quit IRC | 19:12 | |
| *** gyee has joined #openstack-meeting | 19:12 | |
| *** tosky has joined #openstack-meeting | 19:26 | |
| *** raildo_ is now known as raildo | 19:43 | |
| *** slaweq has quit IRC | 20:14 | |
| *** gmann is now known as gmann_lunch | 20:22 | |
| *** slaweq has joined #openstack-meeting | 20:23 | |
| *** hyunsikyang__ has joined #openstack-meeting | 20:30 | |
| *** ralonsoh_ has joined #openstack-meeting | 20:30 | |
| *** ralonsoh has quit IRC | 20:33 | |
| *** hyunsikyang has quit IRC | 20:33 | |
| *** ralonsoh_ has quit IRC | 20:51 | |
| *** alecuyer has joined #openstack-meeting | 20:58 | |
| *** slaweq has quit IRC | 20:58 | |
| *** TrevorV has quit IRC | 21:00 | |
| timburke | #startmeeting swift | 21:00 |
| openstack | timburke: Error: Can't start another meeting, one is in progress. Use #endmeeting first. | 21:00 |
| timburke | who's here for the swift meeting? | 21:00 |
| timburke | #endmeeting | 21:00 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:00 | |
| openstack | Meeting ended Wed Oct 7 21:00:49 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:00 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-10-07-11.00.html | 21:00 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-10-07-11.00.txt | 21:00 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2020/scientific_sig.2020-10-07-11.00.log.html | 21:00 |
| timburke | #startmeeting swift | 21:01 |
| openstack | Meeting started Wed Oct 7 21:01:01 2020 UTC and is due to finish in 60 minutes. The chair is timburke. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:01 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:01 | |
| openstack | The meeting name has been set to 'swift' | 21:01 |
| timburke | who's here for the swift meeting? | 21:01 |
| mattoliverau | o/ (mostly) | 21:01 |
| rledisez | o/ | 21:01 |
| kota_ | o/ | 21:01 |
| alecuyer | o/ | 21:01 |
| timburke | agenda's at https://wiki.openstack.org/wiki/Meetings/Swift | 21:01 |
| timburke | #topic TC election | 21:02 |
| *** openstack changes topic to "TC election (Meeting topic: swift)" | 21:02 | |
| timburke | just a reminder that there's an election currently being held! vote! | 21:02 |
| timburke | there are 7 candidates for (i believe) 4 seats | 21:03 |
| timburke | #link https://governance.openstack.org/election/ | 21:03 |
| timburke | #topic ptg | 21:03 |
| *** openstack changes topic to "ptg (Meeting topic: swift)" | 21:03 | |
| timburke | we're also just a couple weeks out from the virtual PTG! | 21:04 |
| *** whoami-rajat___ is now known as whoami-rajat__ | 21:04 | |
| *** gmann_lunch is now known as gmann | 21:04 | |
| timburke | clayg's done a good job of seeding the etherpad | 21:04 |
| timburke | #link https://etherpad.opendev.org/p/swift-ptg-wallaby | 21:04 |
| timburke | i know *i* need to add some words about ALOs | 21:05 |
| timburke | and probably some other topics | 21:05 |
| timburke | #topic stable releases | 21:06 |
| *** openstack changes topic to "stable releases (Meeting topic: swift)" | 21:06 | |
| *** zaitcev has joined #openstack-meeting | 21:06 | |
| timburke | there are a couple patches currently working their way through the gate to get changelogs for 2.25.1 and 2.23.2 | 21:07 |
| timburke | p 756166 and p 756167 | 21:07 |
| patchbot | https://review.opendev.org/#/c/756166/ - swift (stable/ussuri) - Authors/ChangeLog for 2.25.1 - 1 patch set | 21:07 |
| patchbot | https://review.opendev.org/#/c/756167/ - swift (stable/train) - ChangeLog for 2.23.2 - 1 patch set | 21:07 |
| timburke | one of the big motivations for them (i feel like) is the backported fix for the py3 crypto bug | 21:08 |
| timburke | just making sure people are aware of them and some of the great fixes they include :-) | 21:09 |
| timburke | that's about it for announcements; any questions or comments? | 21:09 |
| zaitcev | none on my side. | 21:10 |
| *** raildo has quit IRC | 21:11 | |
| timburke | all right, let's talk about some patches! | 21:11 |
| clayg | o/ | 21:11 |
| timburke | #topic replication and ring version skew | 21:11 |
| *** openstack changes topic to "replication and ring version skew (Meeting topic: swift)" | 21:12 | |
| clayg | yeah, ALOs like s3 MPU!!! 👍 | 21:12 |
| timburke | #link https://review.opendev.org/#/c/754242/ | 21:12 |
| patchbot | patch 754242 - swift - Fix a race condition in case of cross-replication - 5 patch sets | 21:12 |
| timburke | rledisez, i said i'd work on getting a dev env where i could actually repro the problem -- sorry, i haven't done that yet :-( | 21:12 |
| rledisez | so, as a reminder, this patch only fix the issue for ssync. i'm working on a patch for rsync but nothing to propose yet | 21:12 |
| clayg | tests look good - I don't think I had any specific concerns left over from last week - it might be ready to go? | 21:13 |
| rledisez | i've testing the patch on prod where we we're seing the issue on a very regular basis. so far, so good, but i'll still monitore it closely | 21:13 |
| rledisez | i'd like to share this | 21:13 |
| rledisez | #link https://dl.plik.ovh/file/OIouMcSnLK2W2kwX/v8teIwe3Gapjjl2p/handoff-lock.png | 21:13 |
| rledisez | it's a rebalance of an EC policy. we can see the patch avoided the issue many time | 21:13 |
| rledisez | the ring distribution started at 18:00 and took 30 minutes | 21:14 |
| rledisez | what bothers me is that even after the ring is distributed everywhere, we still get occurences of the reconstructor failing to lock the partition befor reverting it. I don't understand it | 21:14 |
| timburke | cool! i'm loving that visual | 21:15 |
| rledisez | what i want to try is to use a short timeout value for the reconstructor to see if it can improve perf (the rebalance without patch was taking 1h, with the patch it's 3h) | 21:16 |
| rledisez | except than that, i'm done with it i think | 21:16 |
| rledisez | waiting for reviews :) | 21:17 |
| timburke | maybe previous-and-still primaries are doing actual rebuilds to the new primary, so it needs to grab the lock, too? | 21:17 |
| timburke | that reminds me -- clayg, we need to make sure tsync is on the etherpad, too ;-) | 21:17 |
| rledisez | it should be a perfect explanation, except that in our clusters we don't rebuild partition recently moved (to avoid to reconstruct something that should be moved) | 21:17 |
| clayg | timburke: oh... yeah... | 21:18 |
| rledisez | timburke: i think you're right, it's the rebuild, but not of moving partitions, of all the other partitions. so yeah, it should be fine. i'll check that but I think you got it | 21:19 |
| timburke | alternatively, maybe there's new data landing in the partition, and the new primary's reconstructor locks it while checking in with neighbors? though you'd think that should be pretty fast | 21:20 |
| clayg | tim doesn't even see the code anymore it's just 'primary partition, revert hand-off, orphaned slo segment...' | 21:20 |
| timburke | all right, sounds like i need to do some reviews and rledisez is awesome | 21:21 |
| timburke | #topic async cleanup of slo segments | 21:21 |
| *** openstack changes topic to "async cleanup of slo segments (Meeting topic: swift)" | 21:21 | |
| timburke | i think that's about ready to go -- thanks for the review, mattoliverau, i'll check to make sure i cover the more-than-one-container case | 21:22 |
| timburke | in large part i left it on here as a segue to talking about ALOs ;-) | 21:23 |
| zaitcev | Another Large Objects? | 21:24 |
| timburke | i've been thinking "atomic", but yeah, that could work, too :P | 21:24 |
| timburke | the gist of it is, i want to have something like SLOs, but where: the client API mirrors (basically exactly) S3's, the segments are all in the reserved namespace that we introduced for object versioning, and the segments get cleaned up asynchronously after delete/overwrite | 21:25 |
| clayg | YES!! zaitcev ❤️ 🤣 | 21:25 |
| clayg | timburke: can we even make it so it's not racy and because we control the manifest names and segments even if an overwrite thinks it's just a create we still destroy the inaccessable segments at some point? | 21:27 |
| timburke | that last part may get interesting -- i'm assuming it'll need to get plumbed clear down to diskfile's cleanup_ondisk_files -- basically, before unlinking the old version, scatter a whole bunch of async_pendings to schedule the deletes | 21:27 |
| zaitcev | hopefully not an auditor plugin to clean segments hehe | 21:27 |
| clayg | interesting! I was thinking it'd mostly happen the container layer! Can't wait to discuss! | 21:27 |
| clayg | auditor plugins 😢 | 21:27 |
| timburke | hey, those are making progress! i keep seeing new patchests from david | 21:28 |
| timburke | all right, that's all i've got on the agenda | 21:29 |
| timburke | #topic open discussion | 21:29 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:29 | |
| timburke | anything else we ought to bring up today? | 21:29 |
| zaitcev | I already engaged your attention about the dark data, so I have nothing. I'm going to look at Romain's patch seriously. | 21:30 |
| clayg | timburke: i was late, so i couldn't say it when you mentioned it - but KUDOS on taking care of all those backports and stable branches man - that's really great | 21:30 |
| timburke | i may have found a new lead on https://bugs.launchpad.net/swift/+bug/1710328 -- i suspect some of the iterable/iterator cleanup in https://review.opendev.org/#/c/755639/ may address it | 21:31 |
| openstack | Launchpad bug 1710328 in OpenStack Object Storage (swift) "object server deadlocks when a worker thread logs something" [High,Fix released] - Assigned to Samuel Merritt (torgomatic) | 21:31 |
| patchbot | patch 755639 - swift - New proxy logging field for wire status - 5 patch sets | 21:31 |
| timburke | er, not *that* deadlock patch... https://bugs.launchpad.net/swift/+bug/1895739 | 21:31 |
| openstack | Launchpad bug 1895739 in OpenStack Object Storage (swift) "Proxy server sometimes deadlocks while logging client disconnect" [Undecided,In progress] | 21:31 |
| zaitcev | wow | 21:33 |
| zaitcev | BTW... I don't know if it's going to be helpful to you, but I generally found re-entrant locks to be rather harmful in kernel arena. | 21:35 |
| zaitcev | They aren't saving from deadlocks if 2 entities are present. | 21:35 |
| zaitcev | And, some people clearly have trouble considering how locks work. | 21:35 |
| zaitcev | Obviously it was the case 10 years ago and I'm sure you can think about them. I'm just saying that re-entrant locks tend to make the code harder to comprehend for mere mortals. | 21:36 |
| zaitcev | I saw it happen when someone tried to port AFS to Linux | 21:37 |
| timburke | yeah -- my hope is that if i can clean up the close() calls, we won't be punting to gc to handle the generators and i won't need to touch the _active_limbo_lock thing *at all* | 21:37 |
| zaitcev | And in drivers if an rwlock is used for re-entrancy property, it's a signal that the code is out of control and someone is band-aiding around the baggage. | 21:38 |
| zaitcev | Okay. | 21:38 |
| timburke | even when i *did* try swapping out the lock, it didn't actually fix the issue -- it'd still come up now and then, i think because of some craziness in eventlet | 21:39 |
| timburke | it was gross. | 21:39 |
| timburke | but now i've got that patch applied in the cluster where i first characterized the problem, and i'll try running the same sorts of workloads -- i guess we'll see in a month or whatever if it actually fixed it 🤮 | 21:40 |
| clayg | timburke: can you post the link to the jira again (i don't see it from the bug) | 21:40 |
| clayg | lp bug #1895739 | 21:41 |
| openstack | Launchpad bug 1895739 in OpenStack Object Storage (swift) "Proxy server sometimes deadlocks while logging client disconnect" [Undecided,In progress] https://launchpad.net/bugs/1895739 | 21:41 |
| timburke | i really wish i had a reliable repro | 21:41 |
| zaitcev | You know, I cannot see the emoji all that well. Is that face puking? | 21:41 |
| timburke | yup -- i think that was one of the first emojis where i thought, "well that *is* difficult to express without emojis (at least, while remaining as succinct)" | 21:42 |
| timburke | kota_, clayg, rledisez, mattoliverau how are we feeling about https://review.opendev.org/#/c/739164/ ? | 21:43 |
| patchbot | patch 739164 - swift - ec: Add an option to write fragments with legacy crc - 3 patch sets | 21:43 |
| timburke | https://review.opendev.org/#/c/738959/ landed -- i should cut a libec release | 21:44 |
| patchbot | patch 738959 - liberasurecode - Be willing to write fragments with legacy crc (MERGED) - 4 patch sets | 21:44 |
| *** ykatabam has joined #openstack-meeting | 21:44 | |
| timburke | (step 1: remember how we do that) | 21:44 |
| clayg | hahah | 21:45 |
| zaitcev | Yeah. I only know that it ends in tarballs.opendev.org eventually. | 21:45 |
| rledisez | timburke: it seems right | 21:45 |
| kota_ | dependency is always hard problem i'm feeling | 21:45 |
| timburke | i think we can just push a (signed) tag, but i bet tdasilva remembers | 21:45 |
| zaitcev | If we're done, I need to go. | 21:47 |
| timburke | kota_, the good news is that despite the Depends-On, the new swift code is perfectly happy working with old libec -- it'll set the env var, and nothing will actually look at it | 21:47 |
| kota_ | :P | 21:48 |
| timburke | all right, seems like we're winding down | 21:50 |
| timburke | thank you all for coming, and thank you for working on swift! | 21:50 |
| timburke | #endmeeting | 21:50 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:50 | |
| openstack | Meeting ended Wed Oct 7 21:50:51 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:50 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-10-07-21.01.html | 21:50 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-10-07-21.01.txt | 21:50 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2020/swift.2020-10-07-21.01.log.html | 21:50 |
| *** patchbot has left #openstack-meeting | 21:51 | |
| *** adrianc has quit IRC | 22:03 | |
| *** adrianc has joined #openstack-meeting | 22:04 | |
| *** njohnston has quit IRC | 22:04 | |
| *** yasufum has joined #openstack-meeting | 22:05 | |
| *** manpreet has quit IRC | 22:17 | |
| *** rcernin has joined #openstack-meeting | 22:21 | |
| *** tosky has quit IRC | 22:22 | |
| *** ociuhandu has joined #openstack-meeting | 22:32 | |
| *** ociuhandu has quit IRC | 22:36 | |
| *** yasufum has quit IRC | 22:39 | |
| *** thgcorrea has quit IRC | 22:47 | |
| *** macz_ has quit IRC | 23:02 | |
| *** zaitcev has left #openstack-meeting | 23:10 | |
| *** whoami-rajat__ has quit IRC | 23:20 | |
| *** dsariel has quit IRC | 23:20 | |
| *** dsariel has joined #openstack-meeting | 23:20 | |
| *** dsariel has quit IRC | 23:51 | |
| *** dsariel has joined #openstack-meeting | 23:51 | |
| *** yasufum has joined #openstack-meeting | 23:55 | |
| *** yasufum has quit IRC | 23:58 | |
| *** yasufum_ has joined #openstack-meeting | 23:58 | |
| *** mlavalle has quit IRC | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
