| *** ykarel__ is now known as ykarel | 03:59 | |
| stephenfin | fungi: clarkb: jfyi, the openstack-discuss archives are not loading for me (or my teammates - it's not just me I think) https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/ You might be aware of it already | 11:56 |
|---|---|---|
| stephenfin | hmm, looks like there might be a larger issue. requests to e.g. https://releases.openstack.org/constraints/upper/2025.1 are also really slow for me at least | 13:05 |
| fungi | stephenfin: yes, llm training crawlers are constantly overrunning all our servers. until the ai craze is over, we need to figure out novel ways to block them (the problematic ones lie in their user agent strings and pretend to be legitimate browser users spread out over farms of thousands of ip addresses) | 14:10 |
| *** haleyb|out is now known as haleyb | 14:24 | |
| opendevreview | Merged openstack/project-config master: Add back volvocars repos in volvocars tenant https://review.opendev.org/c/openstack/project-config/+/975154 | 14:42 |
| stephenfin | :( | 14:54 |
| *** ykarel_ is now known as ykarel | 15:00 | |
| fungi | stephenfin: i'm restarting apache on lists.o.o to free up any worker slots that might have stuck connections holding onto them, but it's only a temporary workaround while we continue to fiddle with ways to entice the bots into outing themselves and getting themselves blocked | 15:29 |
| fungi | https://review.opendev.org/974942 is a new technique i want to test | 15:30 |
| stephenfin | Ack. Can we do something similar for releases.o.o? I am getting timeouts for that also | 15:31 |
| fungi | the mailman webui is responding to me again now | 15:31 |
| fungi | i'll see what i can figure out for the releases site, though that's one common server that also hosts docs, security, governance, lots of different domains so if one of them is down then they likely all are | 15:32 |
| fungi | stephenfin: what specifically are you seeing for releases.o.o? it's responding promptly to my requests at the moment | 15:33 |
| stephenfin | fungi: https://paste.opendev.org/show/bfrIhgynghs7vZIo1fFm/ | 15:38 |
| stephenfin | timeouts with pip install | 15:38 |
| fungi | stephenfin: oh, that's not releases.openstack.org timing out, its the gitea web interface on opendev.org | 15:41 |
| fungi | i'll take a look there, thanks | 15:42 |
| fungi | releases.o.o is just hosting a redirect at the initial url pip is requesting | 15:42 |
| fungi | so whichever backend you're getting load-balanced to by haproxy is failing to return content for https://opendev.org/openstack/requirements/raw/branch/master/upper-constraints.txt apparently (but the one i'm hitting is working fine) | 15:43 |
| fungi | i'll see if i can figure out which one might be misbehaving | 15:43 |
| fungi | i think it may be gitea14, even my ssh into that one is taking a while to connect | 15:45 |
Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!