| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/957995 | 02:25 |
|---|---|---|
| fungi | the good news is mirror.debian moved successfully, the bad news is it's refusing to move mirror.ubuntu and mirror.ubuntu-ports claiming there's not enough space in /vicepa on afs02.dfw | 03:53 |
| fungi | not sure how to proceed, maybe we need to do some cleanup first | 03:54 |
| fungi | also no idea why having an rw volume on the server would require additional space when there's already a ro replica present there | 03:55 |
| frickler | maybe "need 10% free" is the limit? (just guessing because we seem to be at 91%) likely time to look at the bionic cleanup, then | 08:55 |
| fungi | could be, yeah | 13:23 |
| fungi | regardless, it seems we can't move these last two rw volumes to afs02.dfw until we do something. we could move them to afs01.ord instead but i expect that (and moving them back again after) would be far slower | 13:25 |
| fungi | i've approved recent mirror cleanup changes which will still require manual steps to remove corresponding content | 14:01 |
| fungi | and also the debian key addition to get mirroring back up to date for it now that its volume has successfully moved | 14:03 |
| opendevreview | Merged opendev/system-config master: Add Trixie keys to reprepro config https://review.opendev.org/c/opendev/system-config/+/958248 | 14:31 |
| opendevreview | Merged opendev/system-config master: Stop mirroring Xenial mirror content https://review.opendev.org/c/opendev/system-config/+/956114 | 14:34 |
| opendevreview | Merged opendev/system-config master: Drop Bionic ARM64 mirror content https://review.opendev.org/c/opendev/system-config/+/956115 | 14:34 |
| Clark[m] | I feel like afs01 wasn't utilizing as much disk when it had all the RW volumes? Maybe afs consumes extra space as part of the shuffling? In any case doing the cleanup of xenial and bionic arm64 does seem like a good next step | 15:52 |
| fungi | #status log Pruned /opt/backups-202010 on backup02.ca-ymq-1.vexxhost reducing volume usage from 91% to 64% | 17:07 |
| opendevstatus | fungi: finished logging | 17:08 |
| fungi | i'm following the instructions at https://docs.opendev.org/opendev/system-config/latest/reprepro.html#removing-components for the ubuntu and ubuntu-ports content cleanup | 17:12 |
| fungi | the cleanup and vos releasing of stuff seems to have gotten /vicepa utilization in sync between both afs01.dfw and afs02.dfw | 19:42 |
| fungi | ubuntu-ports cleanup is very nearly complete, then i'll try the remaining moves again | 19:42 |
| fungi | moves have been reinitiated | 20:01 |
| fungi | also, https://paste.opendev.org/show/bWxZSt3nyaG8bxa3yW54/ is the list of rw volume moves that we'll need to undo this after the afs01.dfw upgrade to noble | 20:03 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!