| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/957995 | 02:33 |
|---|---|---|
| *** jroll06 is now known as jroll0 | 09:03 | |
| fungi | it's gotten to the project.tarballs volume, just two relatively small ones to go after that finishes | 13:40 |
| fungi | it finished! | 16:14 |
| fungi | so mirror.logs needs corresponding ro replicas on afs01.dfw and afs02.dfw, while service and user just need ro replicas added to afs02.dfw | 16:18 |
| fungi | i'll work on adding those in a bit and then move the rw volumes for them | 16:19 |
| fungi | docs-old can be ignored, i think | 16:19 |
| fungi | used `vos addisite ...` to add ro replicas of mirror.logs to both servers and followed that up with a `vos release mirror.logs` | 16:23 |
| fungi | did similar to add second ro sites for service and user, now i'll move the rw volumes for all three to afs02.dfw | 16:25 |
| clarkb | looks like the weekly zuul upgrade completed overnight and that means we're running with the refactored pbr hook in zuul | 16:30 |
| clarkb | seems to still produce a working website | 16:30 |
| fungi | now we've got rw volumes for mirror.logs, service and user on afs02.dfw with ro replicas for all of those on both afs01.dfw and afs02.dfw | 16:30 |
| fungi | though it looks like the rw volume moves failed for these: mirror.debian, mirror.ubuntu, mirror.ubuntu-ports (rw volumes are still on afs01.dfw according to `vos listvldb`) | 16:33 |
| fungi | i'll try them again | 16:33 |
| clarkb | maybe that explains why debian security started so soon | 16:33 |
| fungi | mirror.debian is in progress again now | 16:34 |
| fungi | i didn't see any new kdc03 backup failures so seems likethe borg reinstall worked | 16:34 |
| fungi | hopefully mirror.debian will finish before i check out for the night and then i'll restart the other two stragglers in series | 17:28 |
| fungi | grafana says /vicepa on afs02.dfw is now slightly higher than on afs01.dfw, but only by +0.6% so i don't think the problem is space | 17:30 |
| fungi | also mirror.debian hasn't updated yet (patch for the key addition hasn't merged) meaning it's 14 days stale, so i don't think churn explains the move failure either | 17:31 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!