| opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/952006 | 02:21 |
|---|---|---|
| frickler | ianw: would you have time to take a look at https://review.opendev.org/c/openstack/diskimage-builder/+/951469 needed for trixie builds? https://review.opendev.org/c/opendev/zuul-providers/+/951471 | 07:47 |
| opendevreview | Merged openstack/project-config master: Block broken ruamel.yaml versions https://review.opendev.org/c/openstack/project-config/+/952315 | 07:55 |
| opendevreview | Tony Breeds proposed openstack/diskimage-builder master: Add new openstack/devstack based functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/949942 | 08:02 |
| opendevreview | Tony Breeds proposed openstack/diskimage-builder master: Add new openstack/devstack based functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/949942 | 09:41 |
| opendevreview | Tony Breeds proposed openstack/diskimage-builder master: Add new openstack/devstack based functional testing https://review.opendev.org/c/openstack/diskimage-builder/+/949942 | 10:29 |
| fungi | i missed that eff ran a piece on the llm training crawler problem a couple of weeks ago | 12:55 |
| fungi | https://www.eff.org/deeplinks/2025/06/keeping-web-under-weight-ai-crawlers | 12:55 |
| fungi | i just realized statusbot stopped updating https://fosstodon.org/@opendevinfra sometime around january | 14:12 |
| corvus | 2025-06-17 22:39:51,625 ERROR statusbot.toot: Toot failed: 401 | 14:29 |
| corvus | we're using an access token; the one in the web ui does not match the one on disk and in our secrets | 14:34 |
| fungi | huh, i wonder if it got rotated | 14:35 |
| corvus | yeah, i don't see any audit logging in the web ui | 14:35 |
| corvus | there's nothing about mastodon/fosstodon in the wiki status log shortly after the last toot | 14:36 |
| corvus | seems like the most likely thing is one of us accidentally hit the "regenerate" button, or fosstodon did it for us (maybe some server-side issue or compromise?) | 14:37 |
| fungi | i agree that seems likely | 14:37 |
| corvus | i think if we're super paraniod, we should change our password and generate a new key, etc. but if we're only moderately paranoid, we should just hit the "regenerate" button again to get a new access token and then use that. | 14:38 |
| corvus | i vote "moderately paranoid" for this one | 14:38 |
| fungi | i concur, this isn't a high-security account, at worst some miscreant may take it over and impersonate us on mastodon | 14:39 |
| corvus | yep, and they haven't done that in 5 months | 14:39 |
| fungi | which does indeed point to the occam's razor explanation | 14:40 |
| corvus | #status log update fosstodon access token for statusbot | 14:42 |
| corvus | that's done on bridge, of course it'll take time for the next regular update to put it on disk, so that won't show up on fosstodon | 14:43 |
| opendevstatus | corvus: finished logging | 14:43 |
| corvus | "Threads users with Fediverse Sharing switched on can now browse a new 'Fediverse' feed! " | 14:43 |
| corvus | that's news -- i guess the threads/fediverse stuff is making (glacially slow) progress | 14:44 |
| fungi | heading out to grab lunch and run a quick errand, should be back by 16:30 utc | 15:18 |
| corvus | i'm seeing the same problem again from zl02; i'm going to shut it down and run on one launcher until i'm able to fix it. switching the other tenants over to niz is on hold until then as well. | 17:11 |
| fungi | "the same problem" being "got stuck in a loop"? | 17:13 |
| corvus | yep | 17:13 |
| corvus | it was looping trying to update zk with expired data; good that it didn't succeed; bad that we don't have a recovery path | 17:13 |
| corvus | okay, i uploaded three zuul changes to address that; one to fix the source of the problem, a second to fix the infinite loop caused by the problem, and a third to fix an issue i noticed when i shut down zl02 (that zl01 did not immediately take over its requests, it needed to be woken up first) | 18:27 |
| corvus | when those merge, i think we can turn on zl02 again and move the other tenants | 18:29 |
| fungi | the rabbit hole could have gone deeper, i suppose | 18:32 |
| fungi | that series lgtm | 18:38 |
| fungi | thanks! | 18:38 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Link Rackspace donor logo to testimonial article https://review.opendev.org/c/opendev/system-config/+/952861 | 19:25 |
| opendevreview | James E. Blair proposed opendev/base-jobs master: Enable ovh log uploads in test https://review.opendev.org/c/opendev/base-jobs/+/952873 | 22:45 |
| opendevreview | James E. Blair proposed opendev/base-jobs master: Enable ovh log uploads https://review.opendev.org/c/opendev/base-jobs/+/952874 | 22:45 |
| corvus | fungi: I reckon we should merge 873 and check it out. i also reckon that's what you were suggesting yesterday but i got it backwards. :) | 22:46 |
| opendevreview | Rubén proposed openstack/diskimage-builder master: Fix debian-systemd element for non-root user https://review.opendev.org/c/openstack/diskimage-builder/+/952875 | 22:56 |
| opendevreview | James E. Blair proposed opendev/base-jobs master: Enable ovh log uploads in test https://review.opendev.org/c/opendev/base-jobs/+/952873 | 23:04 |
| opendevreview | James E. Blair proposed opendev/base-jobs master: Enable ovh log uploads https://review.opendev.org/c/opendev/base-jobs/+/952874 | 23:04 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!