fungi | clarkb: https://gitea12.opendev.org:3000/admin/monitor/cron says "Delete old repository archives" last ran a few minutes ago and finished, if you wanted to recheck the table | 00:08 |
---|---|---|
clarkb | sure. Looks liek i have to reload keys though | 00:21 |
clarkb | fungi: the oldest file is gone as are some of the other older files. But there are still files that are too old | 00:24 |
clarkb | so it is running and it is managing to delete things but then at some point bails out or starts with an incomplete list | 00:24 |
fungi | so they get disconnected from the db records maybe? | 00:24 |
fungi | leaked basically | 00:25 |
clarkb | oh sorry the db record is gone too | 00:25 |
clarkb | so all is well when things actually delete. The problem is we keep old db records and old files on disk and leak both | 00:25 |
clarkb | in this case we appear to have jumped ahead by about 20 hours | 00:25 |
clarkb | so each day we're leaking 4 hours worth of stuff? | 00:25 |
clarkb | and that builds up over time | 00:26 |
clarkb | I wonder if we switch gitea12 to run the cron every 4 hours (or some other value less than 20 hours) if it would keep up | 00:26 |
fungi | yeah, i mean the ones not getting deleted even though they're older maybe aren't in the db? | 00:26 |
clarkb | that could be another approach we take | 00:26 |
fungi | so have become disconnected from the tracked state and essentially leaked | 00:27 |
clarkb | fungi: I haven't been able to see that. In this case the records in the db for gitea12 are far more than 24 hours old and should be deleted | 00:27 |
clarkb | it is possible that we also delete things on disk because we remove their db record but don't delete the disk contents but I haven't found evidence of that | 00:27 |
fungi | oh, okay so the older archives on disk are also still tracked in the db | 00:28 |
clarkb | yup and their timestamps are well over 24 hours old | 00:28 |
clarkb | 1702763079 is the oldest currently on gitea12 | 00:29 |
clarkb | before the latest run it was 1702690831 but that got cleaned up (and at least 9 others did I did queries limited to 10 results so not sure how many it actually removed) | 00:29 |
opendevreview | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/904884 | 02:34 |
opendevreview | Merged openstack/project-config master: [QA Acls] Allow Review-Priority for non core member also https://review.opendev.org/c/openstack/project-config/+/904809 | 07:38 |
opendevreview | Merged openstack/project-config master: Normalize projects.yaml https://review.opendev.org/c/openstack/project-config/+/904884 | 15:35 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!