| *** gyee has quit IRC | 00:06 | |
| *** mwheckmann has joined #openstack-swift | 00:21 | |
| *** wes_dillingham has quit IRC | 00:32 | |
| kota_ | good morning | 00:38 |
|---|---|---|
| *** wes_dillingham has joined #openstack-swift | 00:41 | |
| *** tovin07_ has joined #openstack-swift | 00:47 | |
| *** mwheckmann has quit IRC | 00:57 | |
| *** kei_yama has quit IRC | 01:07 | |
| mattoliverau | kota_: morning | 01:10 |
| *** kei_yama has joined #openstack-swift | 01:10 | |
| kota_ | mattoliverau: hi | 01:10 |
| *** mwheckmann has joined #openstack-swift | 01:16 | |
| *** klrmn has quit IRC | 01:17 | |
| *** psachin has joined #openstack-swift | 01:58 | |
| *** klrmn has joined #openstack-swift | 02:16 | |
| *** wes_dillingham has quit IRC | 02:20 | |
| *** wes_dillingham has joined #openstack-swift | 02:30 | |
| openstackgerrit | Tovin Seven proposed openstack/pyeclib master: Migrate to zuulv3 - move legacy jobs to project https://review.openstack.org/514510 | 03:37 |
| *** mat128 has quit IRC | 03:39 | |
| *** klrmn has quit IRC | 03:45 | |
| *** mat128 has joined #openstack-swift | 03:52 | |
| openstackgerrit | Kien Nguyen proposed openstack/pyeclib master: Migrate to zuulv3 - move legacy jobs to project https://review.openstack.org/514510 | 03:54 |
| *** gkadam_ has joined #openstack-swift | 03:56 | |
| *** mat128 has quit IRC | 03:57 | |
| *** chsc has joined #openstack-swift | 03:58 | |
| *** bkopilov has quit IRC | 04:05 | |
| *** newmember has joined #openstack-swift | 04:07 | |
| *** chsc has quit IRC | 04:08 | |
| *** SkyRocknRoll has joined #openstack-swift | 04:31 | |
| *** mwheckmann has quit IRC | 04:35 | |
| *** SkyRocknRoll has quit IRC | 04:44 | |
| *** wes_dillingham has quit IRC | 04:46 | |
| *** mat128 has joined #openstack-swift | 04:55 | |
| *** ChubYann has quit IRC | 05:13 | |
| *** mabrams has joined #openstack-swift | 05:44 | |
| *** cshastri has joined #openstack-swift | 05:47 | |
| *** tovin07_ has quit IRC | 06:01 | |
| *** hoonetorg has quit IRC | 06:02 | |
| *** kallenp has joined #openstack-swift | 06:13 | |
| *** hoonetorg has joined #openstack-swift | 06:15 | |
| *** spectr has quit IRC | 06:20 | |
| *** mabrams has joined #openstack-swift | 06:21 | |
| *** spectr has joined #openstack-swift | 06:21 | |
| *** mabrams has quit IRC | 06:21 | |
| *** spectr has quit IRC | 06:22 | |
| *** mabrams has joined #openstack-swift | 06:22 | |
| *** spectr has joined #openstack-swift | 06:24 | |
| *** kei_yama has quit IRC | 06:26 | |
| *** kei_yama has joined #openstack-swift | 06:29 | |
| *** silor has joined #openstack-swift | 06:39 | |
| *** hseipp has joined #openstack-swift | 06:49 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:49 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:49 | |
| *** pcaruana has joined #openstack-swift | 07:02 | |
| *** bkopilov has joined #openstack-swift | 07:05 | |
| *** tesseract has joined #openstack-swift | 07:11 | |
| *** SkyRocknRoll has quit IRC | 07:12 | |
| *** SkyRocknRoll has joined #openstack-swift | 07:26 | |
| *** SkyRocknRoll has quit IRC | 07:34 | |
| *** geaaru has joined #openstack-swift | 07:43 | |
| *** SkyRocknRoll has joined #openstack-swift | 07:47 | |
| *** spectr has quit IRC | 07:48 | |
| *** spectr has joined #openstack-swift | 07:48 | |
| *** silor1 has joined #openstack-swift | 07:51 | |
| *** silor has quit IRC | 07:52 | |
| *** silor1 is now known as silor | 07:52 | |
| *** cbartz has joined #openstack-swift | 08:10 | |
| *** acoles has joined #openstack-swift | 08:19 | |
| *** ChanServ sets mode: +v acoles | 08:19 | |
| acoles | good morning | 08:19 |
| acoles | hmm, my bouncer has stopped bouncing | 08:21 |
| *** mvk has quit IRC | 08:26 | |
| *** NM has joined #openstack-swift | 08:49 | |
| *** mvk has joined #openstack-swift | 08:55 | |
| *** NM has quit IRC | 09:01 | |
| *** gkadam_ has quit IRC | 09:11 | |
| *** kallenp has quit IRC | 09:12 | |
| *** gkadam has joined #openstack-swift | 09:13 | |
| *** kallenp has joined #openstack-swift | 09:19 | |
| *** dja_ has joined #openstack-swift | 09:19 | |
| openstackgerrit | Alistair Coles proposed openstack/swift feature/deep: Shard a shard https://review.openstack.org/514406 | 09:21 |
| *** dja has quit IRC | 09:23 | |
| *** mvk has quit IRC | 09:30 | |
| *** mvk has joined #openstack-swift | 09:42 | |
| *** spectr has quit IRC | 10:10 | |
| *** spectr has joined #openstack-swift | 10:10 | |
| *** kei_yama has quit IRC | 10:12 | |
| *** bkopilov has quit IRC | 10:50 | |
| *** psachin has quit IRC | 10:51 | |
| *** psachin has joined #openstack-swift | 10:54 | |
| *** newmember has quit IRC | 11:10 | |
| *** NM has joined #openstack-swift | 11:12 | |
| *** hoonetorg has quit IRC | 12:06 | |
| *** wes_dillingham has joined #openstack-swift | 12:06 | |
| *** hoonetorg has joined #openstack-swift | 12:08 | |
| *** bkopilov has joined #openstack-swift | 12:26 | |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Replace replication_one_per_device by custom count https://review.openstack.org/390781 | 12:40 |
| *** wes_dillingham has quit IRC | 12:40 | |
| *** wes_dillingham has joined #openstack-swift | 12:44 | |
| *** NM has quit IRC | 12:49 | |
| *** NM has joined #openstack-swift | 12:52 | |
| openstackgerrit | Merged openstack/swift feature/deep: Shard a shard https://review.openstack.org/514406 | 12:58 |
| *** mjturek has joined #openstack-swift | 13:15 | |
| *** kallenp has quit IRC | 13:17 | |
| *** vint_bra has joined #openstack-swift | 13:40 | |
| *** mwheckmann has joined #openstack-swift | 13:42 | |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Cleanup replication_concurrency_per_device tests https://review.openstack.org/514682 | 13:48 |
| *** SkyRocknRoll has quit IRC | 14:09 | |
| *** sheel has joined #openstack-swift | 14:19 | |
| *** kallenp has joined #openstack-swift | 14:25 | |
| *** psachin has quit IRC | 14:30 | |
| *** cshastri has quit IRC | 14:31 | |
| *** kallenp has quit IRC | 14:47 | |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Replace replication_one_per_device by custom count https://review.openstack.org/390781 | 14:57 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Cleanup lock_path and replication_concurrency_per_device tests https://review.openstack.org/514682 | 14:57 |
| *** spectr has quit IRC | 15:00 | |
| *** mabrams has quit IRC | 15:03 | |
| *** ukaynar has joined #openstack-swift | 15:04 | |
| *** SkyRocknRoll has joined #openstack-swift | 15:04 | |
| *** klrmn has joined #openstack-swift | 15:17 | |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Replace replication_one_per_device by custom count https://review.openstack.org/390781 | 15:18 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Cleanup lock_path and replication_concurrency_per_device tests https://review.openstack.org/514682 | 15:18 |
| openstackgerrit | Alistair Coles proposed openstack/swift master: Require lock_path limit to be a positive int https://review.openstack.org/514715 | 15:18 |
| *** kallenp has joined #openstack-swift | 15:25 | |
| *** kallenp has quit IRC | 15:26 | |
| *** mabrams has joined #openstack-swift | 15:26 | |
| *** mvk has quit IRC | 15:29 | |
| acoles | rledisez: sorry for the noise on patch 390781 - tests passed on the branch but zuul was failing because it rebases on master before running tests...so a rebase was needed on the patch plus test fix. | 15:29 |
| patchbot | https://review.openstack.org/#/c/390781/ - swift - Replace replication_one_per_device by custom count | 15:29 |
| *** chsc has joined #openstack-swift | 15:30 | |
| *** chsc has joined #openstack-swift | 15:30 | |
| notmyname | good morning | 15:34 |
| *** kallenp has joined #openstack-swift | 15:35 | |
| rledisez | acoles: no problem :) | 15:39 |
| *** kallenp has quit IRC | 15:42 | |
| *** chsc has quit IRC | 15:42 | |
| *** newmember has joined #openstack-swift | 15:46 | |
| *** ukaynar has quit IRC | 15:47 | |
| *** ukaynar has joined #openstack-swift | 15:51 | |
| *** ukaynar has quit IRC | 15:51 | |
| *** ukaynar has joined #openstack-swift | 15:52 | |
| *** kallenp has joined #openstack-swift | 15:54 | |
| *** mabrams has quit IRC | 15:58 | |
| *** jeblair has quit IRC | 16:00 | |
| *** jeblair has joined #openstack-swift | 16:01 | |
| *** cbartz has quit IRC | 16:06 | |
| openstackgerrit | HCLTech-SSW proposed openstack/swift master: Add ability to undelete an account. https://review.openstack.org/507808 | 16:06 |
| *** kallenp has quit IRC | 16:09 | |
| *** chsc has joined #openstack-swift | 16:17 | |
| *** chsc has joined #openstack-swift | 16:17 | |
| *** hseipp has quit IRC | 16:21 | |
| *** tesseract has quit IRC | 16:22 | |
| timburke | good morning | 16:25 |
| *** pcaruana has quit IRC | 16:25 | |
| *** geaaru has quit IRC | 16:30 | |
| *** ukaynar has quit IRC | 16:41 | |
| *** itlinux has joined #openstack-swift | 17:02 | |
| *** oshritf_ has quit IRC | 17:16 | |
| *** chsc has quit IRC | 17:29 | |
| *** gkadam has quit IRC | 17:30 | |
| *** gyee has joined #openstack-swift | 17:36 | |
| tdasilva | earlier today I saw p 514510, do we already have something similar for swift? | 17:54 |
| patchbot | https://review.openstack.org/#/c/514510/ - pyeclib - Migrate to zuulv3 - move legacy jobs to project | 17:54 |
| *** gyee has quit IRC | 18:07 | |
| *** sheel has quit IRC | 18:08 | |
| *** spetersen has joined #openstack-swift | 18:17 | |
| spetersen | Anyone know how to resolve a drive 100% full scenario? | 18:20 |
| spetersen | /dev/mapper/Crypt-r1z1n1-d9 3.7T 3.7T 276K 100% /srv/node/r1z1n1-d9 | 18:21 |
| spetersen | /dev/mapper/Crypt-r1z1n1-d10 3.7T 3.7T 20K 100% /srv/node/r1z1n1-d10 | 18:21 |
| spetersen | We have plenty of room on the other drives. | 18:22 |
| spetersen | /dev/mapper/Crypt-r1z1n1-d31 9.1T 4.8T 4.4T 52% /srv/node/r1z1n1-d31 | 18:22 |
| spetersen | /dev/sdaf 9.1T 902G 8.3T 10% /srv/node/r1z1n1-d32 | 18:23 |
| spetersen | I lowered the weight from 4000 to 3000 prior to reaching 100% but the drives still filled up. | 18:24 |
| spetersen | Even lowering the weight to 0 is not emptying anything from what I can tell. | 18:24 |
| *** ChubYann has joined #openstack-swift | 18:30 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: Return 404 on a GET if tombstone is newer https://review.openstack.org/371150 | 18:35 |
| *** kallenp has joined #openstack-swift | 19:07 | |
| *** gyee has joined #openstack-swift | 19:07 | |
| *** gyee has quit IRC | 19:12 | |
| *** kallenp has left #openstack-swift | 19:45 | |
| notmyname | spetersen: the good news is that you can get out of it. the bad news is that it isn't easy | 19:45 |
| notmyname | spetersen: the summary is first, and most importantly, you *must* add more capacity to the cluster. after that, it's a matter of adjusting config parameters to optimize the object replication cycle. set the handoffs_only mode, adjust rsync max settings, adjust concurrency, adjust niceness, etc | 19:48 |
| notmyname | lots to monitor. lots to look at. lots to babysit | 19:48 |
| notmyname | and don't let drives get completely full ;-) | 19:48 |
| spetersen | right | 19:48 |
| spetersen | Good news is we have about 5 10TB drives in each node ready to deploy | 19:49 |
| notmyname | that is good :-) | 19:50 |
| spetersen | I can add the additional capacity now if you recommend that first. | 19:53 |
| *** wes_dillingham has quit IRC | 19:54 | |
| *** gyee has joined #openstack-swift | 20:08 | |
| *** gyee has quit IRC | 20:13 | |
| *** mwheckmann has quit IRC | 20:14 | |
| *** silor has quit IRC | 20:15 | |
| *** itlinux has quit IRC | 20:22 | |
| *** mwheckmann has joined #openstack-swift | 20:23 | |
| *** itlinux has joined #openstack-swift | 20:30 | |
| *** mvk has joined #openstack-swift | 20:34 | |
| *** NM has quit IRC | 20:59 | |
| *** itlinux has quit IRC | 21:18 | |
| *** klrmn has quit IRC | 21:25 | |
| *** klrmn has joined #openstack-swift | 21:26 | |
| *** itlinux has joined #openstack-swift | 21:26 | |
| *** zacksh has quit IRC | 21:28 | |
| *** zacksh has joined #openstack-swift | 21:28 | |
| *** wes_dillingham has joined #openstack-swift | 21:44 | |
| *** chsc has joined #openstack-swift | 21:45 | |
| *** chsc has joined #openstack-swift | 21:45 | |
| *** spetersen has quit IRC | 21:46 | |
| mattoliverau | morning | 22:08 |
| *** mvk has quit IRC | 22:12 | |
| *** mvk has joined #openstack-swift | 22:12 | |
| *** Sukhdev has joined #openstack-swift | 22:41 | |
| *** wes_dillingham has quit IRC | 22:44 | |
| *** bkopilov has quit IRC | 22:46 | |
| *** mvk has quit IRC | 22:47 | |
| *** mwheckmann has quit IRC | 22:50 | |
| *** wes_dillingham has joined #openstack-swift | 22:50 | |
| *** bkopilov has joined #openstack-swift | 22:51 | |
| *** bkopilov has quit IRC | 22:56 | |
| *** itlinux has quit IRC | 22:59 | |
| *** mvk has joined #openstack-swift | 23:02 | |
| *** wes_dillingham has quit IRC | 23:08 | |
| *** wes_dillingham has joined #openstack-swift | 23:10 | |
| *** wes_dillingham has quit IRC | 23:11 | |
| *** mjturek has quit IRC | 23:27 | |
| *** gyee has joined #openstack-swift | 23:28 | |
| *** vint_bra has quit IRC | 23:28 | |
| *** kei_yama has joined #openstack-swift | 23:30 | |
| *** dja_ has quit IRC | 23:49 | |
| *** dja has joined #openstack-swift | 23:49 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!