*** diablo_rojo has quit IRC | 01:56 | |
zaitcev | Guys, especially mattoliverau, do you remember how there was someone (maybe in the channel), who enabled sharding and then this generated some absurd amount of HTTP headers that overflowed something in the proxy? | 01:57 |
---|---|---|
mattoliverau | yup | 01:57 |
zaitcev | Like, in some situation, every range is a separate header, so you can have 10,000 of them. | 01:57 |
mattoliverau | We have 2 patches up to hopefully resolve it | 01:58 |
zaitcev | Ah, okay. Sorry for the noise. | 01:58 |
mattoliverau | it wasn't each range but I think it was each CleaveContext. .which should be 1 per container. | 01:58 |
mattoliverau | The problem was an error limited node so new empty containers were placed on handoffs. And then they'd try and shard.. creating a cleavecontext. | 01:59 |
mattoliverau | There is one patch to skip over empty shards (so we can get through these hand off nodes) so they don't could to shard batch size: p 675820 | 02:00 |
patchbot | https://review.opendev.org/#/c/675820/ - swift - sharder: Keep cleaving on empty shard ranges - 4 patch sets | 02:00 |
mattoliverau | And another which has already been +Aed to clean out old cleave contexts | 02:01 |
mattoliverau | p 683760 and p 681970 | 02:01 |
patchbot | https://review.opendev.org/#/c/683760/ - swift - Sharding: Use the metadata timestamp as last_modified (MERGED) - 4 patch sets | 02:01 |
patchbot | https://review.opendev.org/#/c/681970/ - swift - Sharding: Clean up old CleaveConext's during audit (MERGED) - 2 patch sets | 02:02 |
zaitcev | I'm reading just that. | 02:02 |
mattoliverau | the first being a cleanup of the latter. | 02:02 |
mattoliverau | Hopefully combined they will help people who have already hit the problem and stop it from happening (I hope) :P | 02:03 |
*** BjoernT has joined #openstack-swift | 02:04 | |
*** tkajinam has quit IRC | 04:03 | |
*** BjoernT has quit IRC | 04:07 | |
*** BjoernT has joined #openstack-swift | 04:13 | |
*** BjoernT has quit IRC | 04:29 | |
*** BjoernT has joined #openstack-swift | 04:31 | |
*** BjoernT has quit IRC | 05:17 | |
*** BjoernT_ has joined #openstack-swift | 05:17 | |
*** BjoernT_ has quit IRC | 05:17 | |
*** BjoernT has joined #openstack-swift | 05:18 | |
*** BjoernT has quit IRC | 05:18 | |
*** BjoernT_ has joined #openstack-swift | 05:18 | |
*** BjoernT_ has quit IRC | 05:19 | |
*** BjoernT has joined #openstack-swift | 05:22 | |
*** BjoernT has quit IRC | 05:23 | |
*** BjoernT_ has joined #openstack-swift | 05:23 | |
*** BjoernT_ has quit IRC | 05:24 | |
*** BjoernT has joined #openstack-swift | 05:25 | |
*** BjoernT has quit IRC | 05:25 | |
*** BjoernT_ has joined #openstack-swift | 05:28 | |
*** BjoernT_ has quit IRC | 05:29 | |
*** BjoernT has joined #openstack-swift | 05:29 | |
*** BjoernT has quit IRC | 05:30 | |
*** BjoernT_ has joined #openstack-swift | 05:30 | |
*** BjoernT has joined #openstack-swift | 05:32 | |
*** BjoernT has quit IRC | 05:32 | |
*** BjoernT has joined #openstack-swift | 05:33 | |
*** BjoernT has quit IRC | 05:33 | |
*** BjoernT has joined #openstack-swift | 05:33 | |
*** BjoernT has quit IRC | 05:34 | |
*** BjoernT_ has joined #openstack-swift | 05:34 | |
*** BjoernT_ has quit IRC | 05:35 | |
*** BjoernT has joined #openstack-swift | 05:35 | |
*** BjoernT has quit IRC | 05:37 | |
*** pcaruana has joined #openstack-swift | 06:30 | |
*** tesseract has joined #openstack-swift | 07:05 | |
*** ccamacho has joined #openstack-swift | 07:27 | |
*** FlorianFa has joined #openstack-swift | 07:52 | |
*** tesseract has quit IRC | 07:52 | |
*** tesseract has joined #openstack-swift | 07:53 | |
*** e0ne has joined #openstack-swift | 08:45 | |
*** rcernin has quit IRC | 09:08 | |
*** rcernin has joined #openstack-swift | 09:39 | |
*** tesseract has quit IRC | 09:59 | |
*** tesseract has joined #openstack-swift | 10:00 | |
*** BjoernT has joined #openstack-swift | 10:23 | |
*** pcaruana has quit IRC | 10:32 | |
*** pcaruana has joined #openstack-swift | 10:58 | |
*** BjoernT has quit IRC | 11:23 | |
*** ianychoi has quit IRC | 12:00 | |
*** ianychoi has joined #openstack-swift | 12:03 | |
*** pcaruana has quit IRC | 12:05 | |
*** pcaruana has joined #openstack-swift | 12:19 | |
*** ccamacho has quit IRC | 12:51 | |
*** BjoernT has joined #openstack-swift | 12:51 | |
*** NM has joined #openstack-swift | 13:08 | |
*** ccamacho has joined #openstack-swift | 13:33 | |
*** NM has quit IRC | 13:42 | |
*** cschwede|afk has quit IRC | 13:46 | |
*** cschwede has joined #openstack-swift | 13:52 | |
*** ChanServ sets mode: +v cschwede | 13:52 | |
*** BjoernT has quit IRC | 13:57 | |
*** BjoernT has joined #openstack-swift | 14:00 | |
*** rcernin has quit IRC | 14:06 | |
*** gyee has joined #openstack-swift | 14:53 | |
*** mvkr has quit IRC | 15:20 | |
*** mvkr has joined #openstack-swift | 15:33 | |
*** NM has joined #openstack-swift | 15:45 | |
*** diablo_rojo has joined #openstack-swift | 15:50 | |
*** diablo_rojo has quit IRC | 15:54 | |
*** diablo_rojo has joined #openstack-swift | 15:55 | |
*** diablo_rojo__ has joined #openstack-swift | 15:56 | |
*** pcaruana has quit IRC | 15:57 | |
*** diablo_rojo has quit IRC | 15:57 | |
*** diablo_rojo__ is now known as diablo_rojo | 16:03 | |
*** e0ne has quit IRC | 16:06 | |
*** baojg has joined #openstack-swift | 16:09 | |
*** baojg has quit IRC | 16:09 | |
*** baojg has joined #openstack-swift | 16:09 | |
*** baojg has quit IRC | 16:09 | |
*** baojg has joined #openstack-swift | 16:10 | |
*** baojg has quit IRC | 16:10 | |
*** baojg has joined #openstack-swift | 16:11 | |
*** baojg has quit IRC | 16:11 | |
*** baojg has joined #openstack-swift | 16:13 | |
*** baojg has quit IRC | 16:13 | |
*** baojg has joined #openstack-swift | 16:14 | |
*** baojg has quit IRC | 16:14 | |
*** baojg has joined #openstack-swift | 16:15 | |
*** baojg has quit IRC | 16:15 | |
*** baojg has joined #openstack-swift | 16:15 | |
*** baojg has quit IRC | 16:16 | |
*** baojg has joined #openstack-swift | 16:16 | |
*** baojg has quit IRC | 16:17 | |
*** baojg has joined #openstack-swift | 16:18 | |
*** tesseract has quit IRC | 16:19 | |
*** baojg has quit IRC | 16:19 | |
*** baojg has joined #openstack-swift | 16:19 | |
*** baojg has quit IRC | 16:20 | |
*** baojg has joined #openstack-swift | 16:21 | |
*** baojg has quit IRC | 16:21 | |
*** baojg has joined #openstack-swift | 16:22 | |
*** baojg has quit IRC | 16:22 | |
*** baojg has joined #openstack-swift | 16:22 | |
*** baojg has quit IRC | 16:23 | |
*** baojg has joined #openstack-swift | 16:23 | |
*** baojg has quit IRC | 16:24 | |
*** baojg has joined #openstack-swift | 16:24 | |
*** baojg has quit IRC | 16:25 | |
*** baojg has joined #openstack-swift | 16:25 | |
*** baojg has quit IRC | 16:25 | |
*** baojg has joined #openstack-swift | 16:26 | |
*** BjoernT has quit IRC | 16:26 | |
*** baojg has quit IRC | 16:26 | |
openstackgerrit | Tim Burke proposed openstack/swift master: Fix some request-smuggling vectors on py3 https://review.opendev.org/684041 | 16:28 |
*** BjoernT has joined #openstack-swift | 16:32 | |
*** NM has quit IRC | 16:56 | |
*** itlinux has quit IRC | 17:04 | |
*** henriqueof has joined #openstack-swift | 17:09 | |
*** henriqueof1 has quit IRC | 17:09 | |
*** NM has joined #openstack-swift | 17:29 | |
*** pcaruana has joined #openstack-swift | 18:04 | |
*** e0ne has joined #openstack-swift | 18:30 | |
*** pcaruana has quit IRC | 18:36 | |
*** BjoernT has quit IRC | 19:05 | |
*** BjoernT has joined #openstack-swift | 19:07 | |
*** e0ne has quit IRC | 19:25 | |
*** diablo_rojo has quit IRC | 19:48 | |
*** BjoernT_ has joined #openstack-swift | 20:04 | |
*** NM has quit IRC | 20:05 | |
*** BjoernT has quit IRC | 20:06 | |
*** e0ne has joined #openstack-swift | 20:22 | |
*** e0ne has quit IRC | 20:24 | |
*** NM has joined #openstack-swift | 20:35 | |
*** zigo_ is now known as zigo | 20:49 | |
*** ccamacho has quit IRC | 20:53 | |
*** NM has quit IRC | 21:20 | |
*** NM has joined #openstack-swift | 21:22 | |
*** NM has quit IRC | 21:28 | |
*** NM has joined #openstack-swift | 21:30 | |
*** NM has quit IRC | 22:00 | |
*** BjoernT_ has quit IRC | 22:01 | |
*** diablo_rojo has joined #openstack-swift | 22:16 | |
*** tkajinam has joined #openstack-swift | 22:57 | |
openstackgerrit | Tim Burke proposed openstack/swift master: sharder: Keep cleaving on empty shard ranges https://review.opendev.org/675820 | 23:20 |
*** rcernin has joined #openstack-swift | 23:24 | |
mattoliverau | morning | 23:42 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!