Monday, 2021-03-08

*** benj_ has joined #openstack-swift00:54
*** benj_ has quit IRC01:01
*** benj_ has joined #openstack-swift01:02
*** rcernin has quit IRC01:12
*** rcernin_ has joined #openstack-swift01:12
*** benj_ has quit IRC01:17
*** benj_ has joined #openstack-swift01:17
*** benj_ has quit IRC02:06
*** benj_ has joined #openstack-swift02:07
*** rcernin_ has quit IRC03:14
*** rcernin_ has joined #openstack-swift03:21
*** psachin has joined #openstack-swift03:42
*** evrardjp has quit IRC05:33
*** evrardjp has joined #openstack-swift05:33
*** m75abrams has joined #openstack-swift06:36
*** timburke__ has quit IRC06:59
*** rcernin_ has quit IRC07:14
*** rpittau|afk is now known as rpittau08:23
*** mugsie__ is now known as mugsie10:11
openstackgerritAlistair Coles proposed openstack/swift master: Unify sharder and manage-shard-ranges options  https://review.opendev.org/c/openstack/swift/+/77898911:54
openstackgerritAlistair Coles proposed openstack/swift master: Add absolute values for shard shrinking config options  https://review.opendev.org/c/openstack/swift/+/77899011:54
*** psachin has quit IRC13:10
*** jv_ has quit IRC14:30
*** jv_ has joined #openstack-swift14:42
*** m75abrams has quit IRC15:50
*** gmann is now known as gmann_afk16:01
*** klamath_atx has quit IRC16:49
openstackgerritAlistair Coles proposed openstack/swift master: WIP relinker: make cleanup checks more robust  https://review.opendev.org/c/openstack/swift/+/77930817:22
*** rpittau is now known as rpittau|afk18:16
*** timburke has joined #openstack-swift18:59
*** ChanServ sets mode: +v timburke18:59
*** stand has quit IRC19:15
*** stand has joined #openstack-swift19:22
*** gmann_afk is now known as gmann19:32
openstackgerritMerged openstack/swift master: s3api: Allow lower-cased regions when making buckets  https://review.opendev.org/c/openstack/swift/+/74342520:48
*** gyee has joined #openstack-swift20:56
*** rcernin has joined #openstack-swift21:54
*** renich has joined #openstack-swift23:08
renichgood day23:09
renichSo, I have a two node cluster; with one device each. I want to take the second node offline but I want to re-balance things so that the data in that node gets copied to the first one. Is it enough to set the weight of the device to 0 and start a rebalance?23:10
renichhttps://paste.centos.org/view/f1ecabb423:11
renichIf so, is there a way to track progress? I see the network activity using iftop but I dunno how much remains23:11
*** renich_ has joined #openstack-swift23:51
renich_Sorry, I think I got disconnected. If anyone answered or mentioned me, please, repeat.23:52
*** renich has quit IRC23:52
DHEif the disk is empty, /srv/node/$DISKNAME/object will be empty, or at least devoid of directories. similar for account, container, and object-1 etc.23:53
renich_DHE: OK. So, I should check the object directory in order to see if stuff is getting moved, right? I'll do that then.23:53
DHEit's probably the simplest way, short of just running 'df' and watching the number decline over time23:54
DHEbut in terms of "when is it truly done?" I'd go with that23:54
renich_DHE: does it matter if I have only 1 replica?23:54
DHEoh my23:54
renich_yeah... :S23:54
DHEyou have have multiple replicas even with small clusters. my test lab was a single machine. it just had 30 disks in it.23:55
renich_DHE: In our case, we vae like 80 disks, all exposed via ZFS (raidz2 vdes) and... <gulp>... yeah, we have only one device exposed to swift.23:56
*** renich_ is now known as renich23:56
DHEoh I see...23:56
DHElarge objects? there's an interaction with ZFS and swift which caused my test system using that to tank the performance. but we use small, ~4 MB objects23:57
DHEI don't necessarily mean large meaning > 5 GB, just substantially larger than 4 MB23:57
renichYeah, pretty large. Satellite data. ~600 TiB of it. And, yeah, performance sucks...23:57
DHEI would recommend disabling tmpfile support. unfrotunately it's not a setting and would require a code patch. it's as simple as setting something like 'self.tmpfile = False' or such23:58
renichOK. Thank you for the recommendation.23:59
renichI just hope I did the rebalancing right.23:59
renichStuff is getting copied at ~8 Gbps per second according to iftop... but I dunno. And ZFS is super slow to update the stats.23:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!