opendevreview | Shreeya Deshpande proposed openstack/swift master: Provide some s3 helper methods for other middlewares to use. https://review.opendev.org/c/openstack/swift/+/940791 | 02:12 |
---|---|---|
opendevreview | Alistair Coles proposed openstack/swift master: Add labeled metrics to s3api https://review.opendev.org/c/openstack/swift/+/939481 | 02:13 |
opendevreview | Shreeya Deshpande proposed openstack/swift master: proxy-logging: Add real-time transfer bytes counters https://review.opendev.org/c/openstack/swift/+/930918 | 02:19 |
opendevreview | Shreeya Deshpande proposed openstack/swift master: proxy-logging: Add real-time transfer bytes counters https://review.opendev.org/c/openstack/swift/+/930918 | 02:46 |
mcape | hi all – quick question about compute sizing for Swift | 04:51 |
mcape | we have ~350TB of data (~350 million small files), 3x replicated across ~150 disks (8–10TB each) | 04:51 |
mcape | currently each replica lives on a PACO server: 20-core Xeon E5-2630 v4 @ 2.20GHz with 32GB RAM | 04:51 |
mcape | cluster is ~85% full, and storage load is moderate: ~50MB/s upload and 120–150MB/s download during peaks | 04:51 |
mcape | usually we see ~60–70% CPU util, which seems ok | 04:52 |
mcape | but recently we did a few 8TB disk replacements, and we hit high iowait and brief instability – compute can't keep up | 04:52 |
mcape | so I’m wondering: are there any rules-of-thumb for how much CPU or RAM per TB of storage? | 04:52 |
mcape | mainly interested in making recovery/rebalance stable even when a disk fails | 04:52 |
mcape | any insights or examples from similar setups appreciated! | 04:52 |
opendevreview | Matthew Oliver proposed openstack/swift master: ringbuilder cli: better track different command types https://review.opendev.org/c/openstack/swift/+/955263 | 05:20 |
opendevreview | Alistair Coles proposed openstack/swift feature/mpu: merge master to feature/mpu https://review.opendev.org/c/openstack/swift/+/955272 | 09:53 |
opendevreview | Shreeya Deshpande proposed openstack/swift master: WIP s3api: add labeled version of error response metric https://review.opendev.org/c/openstack/swift/+/940535 | 14:09 |
opendevreview | Alistair Coles proposed openstack/swift master: fixups for proxy logging tests https://review.opendev.org/c/openstack/swift/+/955290 | 14:19 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!