| *** ykarel_ is now known as ykarel | 04:09 | |
| sean-k-mooney | i assume the current opendev.org flakyness is related to the release | 13:33 |
|---|---|---|
| fungi | we're not sure. it seems to be related to some very excited automated crawlers though, we're working on mitigations | 13:35 |
| sean-k-mooney | for | 13:57 |
| sean-k-mooney | WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1010)'))': /openstack/requirements/raw/branch/master/upper-constraints.txt | 13:57 |
| sean-k-mooney | i can just export an env var locally and point to a local copy of the requrieme repo hwen runing tox but that and some timeout on the dashboard are what brought it to my attention | 13:58 |
| sean-k-mooney | ci shoudl be fine since its usign the zuul cloned repos anyway | 13:58 |
| sean-k-mooney | it does actully work most times if i just rerun the tox command as well | 13:59 |
| sean-k-mooney | becaise ot was the constraits file i was wondering if it was release releated but i guess that woudl not impact browsing the git repos on opendev.org | 14:00 |
| sean-k-mooney | well i guess it coudl given those are all on shared gittea instances | 14:00 |
| sean-k-mooney | fungi: i forget who was doign this but one of the ohter lerge opensouce project did a clever hack | 14:02 |
| sean-k-mooney | the set up redirect to the github mirrors for http trafic | 14:03 |
| sean-k-mooney | maybe mesa | 14:03 |
| sean-k-mooney | so all the crawler load went there instead | 14:03 |
| sean-k-mooney | https://www.phoronix.com/news/GNOME-GitHub-GitLab-Redirect | 14:04 |
| sean-k-mooney | ah it was gnome | 14:04 |
| sean-k-mooney | that may have jsut been the https clone rather hten web interface | 14:04 |
| -opendevstatus- NOTICE: The opendev.org site is currently experiencing overwhelming load adversely impacting git operations and repository browsing since 12:20 UTC today, mitigation work is in progress | 14:41 | |
| * croelandt was about to ask about the SSL issue, but y'all know about this already. thanks for working on it! | 15:30 | |
| fungi | we think we may have it somewhat under control at this point, but are still confirming | 15:30 |
| croelandt | it was still somewhat randomly failing for me when I typed my previous message :/ | 15:36 |
| croelandt | hm, seems better actually | 15:37 |
| croelandt | It used to take dozens of second for a GET call to return, now it's much quicker | 15:37 |
| fungi | yeah, we were literally in the middle of adding a new filter | 15:37 |
| fungi | when i replied | 15:37 |
| -opendevstatus- NOTICE: Load on the opendev.org Gitea backends is under control again for now, if any Zuul jobs failed with SSL errors or disconnects reaching the service they can be safely rechecked | 16:12 | |
| opendevreview | Jan Jasek proposed openstack/openstack-zuul-jobs master: [WIP]Fix get-modulename.py to read packages from pyproject.toml https://review.opendev.org/c/openstack/openstack-zuul-jobs/+/983148 | 23:44 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!