Tuesday, 2019-04-16

openstackgerritzhufl proposed openstack/swift master: Use assertIn to check whether substring is in str  https://review.openstack.org/65258300:58
*** baojg has joined #openstack-swift01:35
*** threestrands has joined #openstack-swift01:47
*** baojg has quit IRC02:53
*** zaitcev_ has quit IRC03:49
*** zaitcev_ has joined #openstack-swift04:00
*** ChanServ sets mode: +v zaitcev_04:00
*** zaitcev__ has joined #openstack-swift04:17
*** ChanServ sets mode: +v zaitcev__04:17
*** zaitcev_ has quit IRC04:21
openstackgerritTim Burke proposed openstack/swift master: py3: port obj/reconstructor  https://review.openstack.org/65281904:44
*** e0ne has joined #openstack-swift04:53
*** e0ne has quit IRC04:56
*** gyee has quit IRC05:08
*** e0ne has joined #openstack-swift05:21
*** e0ne has quit IRC05:25
*** baojg has joined #openstack-swift05:37
*** pcaruana has joined #openstack-swift06:26
*** zaitcev_ has joined #openstack-swift06:26
*** ChanServ sets mode: +v zaitcev_06:26
*** zaitcev__ has quit IRC06:30
*** hogepodge has quit IRC06:32
*** nottrobin has quit IRC06:33
*** zaitcev_ has quit IRC06:39
*** nottrobin has joined #openstack-swift06:41
*** nottrobin has quit IRC06:45
*** zaitcev_ has joined #openstack-swift06:52
*** ChanServ sets mode: +v zaitcev_06:52
*** nottrobin has joined #openstack-swift06:53
*** hogepodge has joined #openstack-swift06:56
openstackgerritMatthew Oliver proposed openstack/swift master: py3: Port the tempurl middleware  https://review.openstack.org/65292807:01
*** e0ne has joined #openstack-swift07:06
*** e0ne has quit IRC07:09
*** rdejoux has joined #openstack-swift07:12
*** e0ne has joined #openstack-swift07:16
*** rcernin has quit IRC07:20
*** ccamacho has joined #openstack-swift07:48
*** e0ne has quit IRC07:52
*** threestrands has quit IRC07:58
*** e0ne has joined #openstack-swift07:58
*** hseipp has joined #openstack-swift07:59
*** e0ne has quit IRC07:59
*** gkadam has joined #openstack-swift08:09
*** gkadam has quit IRC08:10
*** e0ne has joined #openstack-swift08:10
*** tkajinam has quit IRC08:24
openstackgerritMerged openstack/swift master: Use assertIn to check whether substring is in str  https://review.openstack.org/65258308:25
*** zaitcev__ has joined #openstack-swift08:34
*** ChanServ sets mode: +v zaitcev__08:34
*** zaitcev_ has quit IRC08:37
*** rcernin has joined #openstack-swift10:02
*** baojg has quit IRC10:56
*** baojg has joined #openstack-swift10:57
*** baojg has quit IRC11:01
*** pcaruana has quit IRC11:17
*** baojg has joined #openstack-swift11:23
*** ccamacho has quit IRC11:34
*** zaitcev_ has joined #openstack-swift11:37
*** ChanServ sets mode: +v zaitcev_11:37
*** zaitcev__ has quit IRC11:40
*** nguyenhai has joined #openstack-swift11:47
*** nguyenhai has quit IRC11:52
*** pcaruana has joined #openstack-swift12:05
*** baojg has quit IRC12:05
*** ybunker has joined #openstack-swift12:39
ybunkerhi all, question... how can i recreate the ring files of an already running cluster?12:42
rledisezhi ybunker. what do you have now? *.builder or *.ring.gz?12:49
ybunkerrledisez: hi :-), i have both files {account|container|object}.builder and {account|container|object}.ring.gz12:50
rledisezybunker: if you have both builder and ring.gz, you have everything you need. what are you thinking you need to recreate something?12:52
rledisezs/what/why/12:52
ybunkerrledisez: because i need to manually delete some replica partitions on a 100% fully node drives :-(, so first im going to look for spare partitions, and then delete them with rm -rf on the fully node, and i read that it then needs to 'recreate' the ring so the files started to move around again, since the reference of the replicas are going to be missed12:54
*** hseipp has quit IRC13:02
*** zaitcev__ has joined #openstack-swift13:07
*** ChanServ sets mode: +v zaitcev__13:07
*** pcaruana has quit IRC13:07
*** zaitcev_ has quit IRC13:11
rledisezybunker: i don't think you really want to do that. I may not have the whole context. Do you have freespace in your cluster? If so, you can just reduce the weight of the full devices and let swift re-organize (rebalance) the data13:15
ybunkerrledisez: the problem is that we actually have a lot of free space on other nodes, but since fully drives are at 100% of used space, I have understood that 100% full drives are unable to move data out of themselves, because at a high level, they must have storage space to commit transactions and such before they can move data away from themselves. So we are like stuck at this point :-(13:17
*** ccamacho has joined #openstack-swift13:20
rledisezI would go for:13:20
rledisez1/ stop the object-server on the full devices (so that new data won't come)13:20
rledisez2/ set handoffs_first = True in the replicator configuration13:20
rledisez3/ make some free space (few MB will be ok) by removing "useless" data (eg: quarantine). otherwise, mv some data to another drive. as soon as you have freespace enought, you can restore13:20
rledisez4/ rebalance13:21
ybunkerrledisez: i've already set the handsoff_first and handsoff_delete on the fully nodes, and in fact there is 10G of free space on the drives.. but, it don't actually move anything from those drives and they are still at 100% :-(13:27
*** pcaruana has joined #openstack-swift13:33
*** thyrst has quit IRC13:42
ybunkerrledisez: also, i can't leave the object-replicator daemons running 24h because general latency of the cluster goes to the roof :-(, so I've setup to run those daemons on an 4h windows at night13:43
*** zaitcev_ has joined #openstack-swift13:44
*** ChanServ sets mode: +v zaitcev_13:44
*** thyrst has joined #openstack-swift13:44
*** zaitcev__ has quit IRC13:48
*** zaitcev_ has quit IRC13:56
*** zaitcev_ has joined #openstack-swift14:10
*** ChanServ sets mode: +v zaitcev_14:10
*** mattia has joined #openstack-swift14:22
*** rcernin has quit IRC14:27
*** baojg has joined #openstack-swift14:35
*** nottrobin has quit IRC15:03
*** nottrobin has joined #openstack-swift15:03
*** zaitcev__ has joined #openstack-swift15:20
*** ChanServ sets mode: +v zaitcev__15:20
*** zaitcev_ has quit IRC15:24
*** pcaruana has quit IRC15:27
*** pcaruana has joined #openstack-swift15:30
*** e0ne has quit IRC15:31
*** pcaruana has quit IRC15:40
*** pcaruana has joined #openstack-swift15:46
*** hseipp has joined #openstack-swift15:49
*** gyee has joined #openstack-swift15:50
*** pcaruana has quit IRC15:55
*** pcaruana has joined #openstack-swift16:02
*** hseipp has quit IRC16:06
*** ybunker has quit IRC16:07
*** pcaruana has quit IRC16:08
*** zaitcev__ has quit IRC16:09
*** hseipp has joined #openstack-swift16:10
*** zaitcev__ has joined #openstack-swift16:23
*** ChanServ sets mode: +v zaitcev__16:23
*** hseipp has quit IRC16:24
*** pcaruana has joined #openstack-swift16:36
*** ybunker has joined #openstack-swift16:39
*** ccamacho has quit IRC16:53
openstackgerritGhanshyam Mann proposed openstack/python-swiftclient master: Dropping the py35 testing  https://review.openstack.org/65304616:58
*** itlinux has joined #openstack-swift16:59
*** zaitcev__ is now known as zaitcev17:23
*** baojg has quit IRC17:24
*** e0ne has joined #openstack-swift17:32
*** e0ne has quit IRC17:49
*** zaitcev has quit IRC17:56
*** zaitcev has joined #openstack-swift18:08
*** ChanServ sets mode: +v zaitcev18:08
*** rdejoux has quit IRC18:21
*** irclogbot_1 has quit IRC18:39
*** irclogbot_2 has joined #openstack-swift18:41
*** baojg has joined #openstack-swift19:25
*** itlinux has quit IRC19:30
*** baojg has quit IRC19:30
*** itlinux has joined #openstack-swift19:34
*** zaitcev has quit IRC19:45
claygdo we really not have a helper to turn a swob.Response into a swob.HTTPException?19:50
*** ybunker has quit IRC19:53
*** zaitcev has joined #openstack-swift19:58
*** ChanServ sets mode: +v zaitcev19:58
*** pcaruana has quit IRC20:19
openstackgerritTim Burke proposed openstack/swift master: Move from py35 to py37 for gating py3 jobs  https://review.openstack.org/64948520:54
*** zaitcev_ has joined #openstack-swift21:11
*** ChanServ sets mode: +v zaitcev_21:11
*** zaitcev has quit IRC21:14
*** baojg has joined #openstack-swift21:26
*** baojg has quit IRC21:30
*** itlinux has quit IRC21:53
*** itlinux has joined #openstack-swift22:07
*** zaitcev_ has quit IRC22:38
*** rcernin has joined #openstack-swift22:38
*** zaitcev_ has joined #openstack-swift22:52
*** ChanServ sets mode: +v zaitcev_22:52
*** tkajinam has joined #openstack-swift22:54
*** guimaluf has quit IRC23:21
*** baojg has joined #openstack-swift23:27
*** baojg has quit IRC23:31
*** itlinux has quit IRC23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!