| clarkb | just waiting on node requests now | 00:12 |
|---|---|---|
| fungi | and meetbot showed back up, so we have logging again | 00:12 |
| fungi | for benefit of the record in case our future selves come looking, i forgot to include the acme cname for etherpad02 in my original dns addition change, so https cert installation failed and apache hasn't started. 956415 should fix that, and once it deploys i'll reenqueue 956122,8 into deploy | 00:15 |
| fungi | status notice All OpenDev IRC and Matrix bots should be back in service and logs available on the web again; there is a 20-minute gap in logging missing 23:52-00:12 UTC | 00:22 |
| fungi | i'll send that^ once we get apache running again | 00:23 |
| opendevreview | Merged opendev/zone-opendev.org master: Add LE entry for new eavesdrop02 server https://review.opendev.org/c/opendev/zone-opendev.org/+/956415 | 00:23 |
| fungi | one more successful irc bot test | 00:23 |
| fungi | 956122,8 is back in deploy now | 00:27 |
| fungi | i have some bad news... earlier when i edited the running channel log in here to redact a user's accidentally pasted password, i apparently caused meetbot to stop writing. it's only this channel that was affected, happened to notice because i was using it to gauge whether logs are working | 00:31 |
| fungi | so our 2025-08-01 log for #opendev ends at 19:29:35 utc | 00:32 |
| fungi | i'll set aside some time tomorrow to hand-restore the missing lines from my client history, there's not all that many | 00:34 |
| fungi | i can add the handful missed while meetbot was offline too, while i'm at it | 00:35 |
| fungi | *sigh* deploy failed on the base job this time | 00:35 |
| fungi | https://zuul.opendev.org/t/openstack/build/68f5106761e44da39f28acad5f718aa3 | 00:36 |
| fungi | fatal: [ze04.opendev.org]: UNREACHABLE! | 00:37 |
| fungi | oh... weekend upgrades are now in progress | 00:37 |
| Clark[m] | Ah bad timing I guess but probably safe to try try again? | 00:37 |
| fungi | up 8 min | 00:38 |
| fungi | yeah, trying yet again | 00:38 |
| Clark[m] | It's going to be a race with the other ones rebooting but maybe we get kucky | 00:38 |
| Clark[m] | *lucky | 00:38 |
| fungi | rerolled the dice | 00:38 |
| Clark[m] | Adding more jobs to zuul to chew on would slow the reboots down. Not sure if that is better or worse than speeding them up | 00:40 |
| fungi | ze08 is paused right now, so maybe we'll pass it | 00:41 |
| fungi | looks like we're probably past the danger zone now | 00:47 |
| fungi | good, infra-prod-letsencrypt worked this time | 00:54 |
| Clark[m] | And the eavesdrop job is running | 00:54 |
| fungi | we'll also need infra-prod-service-static to fix up the proxy | 00:55 |
| fungi | that's working now too | 00:58 |
| fungi | https://meetings.opendev.org/irclogs/%23opendev/latest.log.html has our conversation | 00:58 |
| fungi | #status notice All OpenDev IRC and Matrix bots should be back in service and logs available on the web again; there is a 20-minute gap in logging missing 23:52-00:12 UTC | 00:59 |
| opendevstatus | fungi: sending notice | 00:59 |
| -opendevstatus- NOTICE: All OpenDev IRC and Matrix bots should be back in service and logs available on the web again; there is a 20-minute gap in logging missing 23:52-00:12 UTC | 00:59 | |
| opendevstatus | fungi: finished sending notice | 01:03 |
| fungi | and with that, i'm going to start my weekend. i'll patch the hole in our channel log later when i get a few minutes. next week i can clean up the old eavesdrop server/dns and also the same for refstack | 01:03 |
| * fungi vanishes in a puff of logic | 01:04 | |
| Clark[m] | Thanks! Enjoy your weekend | 01:05 |
| frickler | oooh, looks like we forgot to disable openmetal for the migration? got failures with the mirror being unreachable. can't dig deeper right now, maybe later today | 11:18 |
| opendevreview | Dr. Jens Harbott proposed opendev/zuul-providers master: Disable openmetal provider https://review.opendev.org/c/opendev/zuul-providers/+/956426 | 12:10 |
| frickler | ^^ is what I found in git history | 12:11 |
| fungi | whoops, thanks! | 12:44 |
| opendevreview | Merged opendev/zuul-providers master: Disable openmetal provider https://review.opendev.org/c/opendev/zuul-providers/+/956426 | 12:45 |
| opendevreview | Dr. Jens Harbott proposed opendev/zuul-providers master: Revert "Disable openmetal provider" https://review.opendev.org/c/opendev/zuul-providers/+/956428 | 13:53 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!