| @harbott.osism.tech:regio.chat | still some out of disk failures on https://review.opendev.org/c/opendev/zuul-providers/+/984866 :( | 08:49 |
|---|---|---|
| @harbott.osism.tech:regio.chat | ok, checking some logs in more detail, 3 out of 6 were disk full, all on raxflex, where the `/opt/dib_tmp` partition was full, while `/` was only 5% used. the other three were swift upload failures with `The client was disconnected during request.` | 09:23 |
| -@gerrit:opendev.org- Michal Nasiadka proposed: [opendev/zone-opendev.org] 985938: Promote zp03 to *.zuul-preview https://review.opendev.org/c/opendev/zone-opendev.org/+/985938 | 10:52 | |
| -@gerrit:opendev.org- Michal Nasiadka proposed: [opendev/zone-opendev.org] 985939: Remove zp02.opendev.org https://review.opendev.org/c/opendev/zone-opendev.org/+/985939 | 10:53 | |
| -@gerrit:opendev.org- Michal Nasiadka proposed on behalf of Tony Breeds: [opendev/system-config] 921322: Initial dump or mediawiki role and config https://review.opendev.org/c/opendev/system-config/+/921322 | 11:25 | |
| @fungicide:matrix.org | pleasantly interesting observed behavior for jitsi-meet: if the last moderator leaves (but doesn't end) a room, another user automatically becomes moderator | 13:28 |
| -@gerrit:opendev.org- Michal Nasiadka proposed on behalf of Tony Breeds: [opendev/system-config] 921322: Initial dump or mediawiki role and config https://review.opendev.org/c/opendev/system-config/+/921322 | 13:38 | |
| -@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [opendev/project-config] 985898: Add vouched pipeline to OpenDev tenant https://review.opendev.org/c/opendev/project-config/+/985898 | 13:59 | |
| @mordred:waterwanders.com | corvus: ^^ like that? | 13:59 |
| -@gerrit:opendev.org- Monty Taylor https://matrix.to/#/@mordred:inaugust.com proposed: [opendev/project-config] 985898: Add vouched pipeline to OpenDev tenant https://review.opendev.org/c/opendev/project-config/+/985898 | 14:06 | |
| @fungicide:matrix.org | grabbing lunch, should be back shortly | 16:06 |
| @fungicide:matrix.org | if i don't return, tape a note to the door saying "missing, presumed fed" | 16:06 |
| @harbott.osism.tech:regio.chat | looks like 26.04 is officially out now https://releases.ubuntu.com/26.04/ | 16:23 |
| @dpanech:matrix.org | Hi, this job has been failing for us since Apr 16: https://zuul.opendev.org/t/openstack/builds?job_name=promote-stx-tox-docs | 16:48 |
| With errors similar to | ||
| "/afs/.openstack.org/project/starlingx.io/www/integ/.buildinfo.xJXDhR" failed: Disk quota exceeded (122) | ||
| Could someone help? | ||
| @clarkb:matrix.org | davlet: https://grafana.opendev.org/d/9871b26303/afs?orgId=1&from=now-6h&to=now&timezone=utc seems to confirm that project.starlingx is has hit its 2GB quota in AFS | 16:52 |
| @clarkb:matrix.org | I should be able to bump that up. Let me find the docs for that and figure it out | 16:53 |
| @clarkb:matrix.org | hrm fs setquota doesn't seem to take -localauth? | 16:59 |
| @clarkb:matrix.org | I see on afs01 setquota has been run in the past in root's history and I don't see aklogs in there either. But when I try to run it without localauth it says I don't have permissions | 17:00 |
| @clarkb:matrix.org | Give me a few and I can do a proper login and aklog and do it that way | 17:02 |
| @clarkb:matrix.org | davlet: ok I've doubled the quota from 2GB to 4GB. Grafana should reflect that in about 5-10 minutes and I think any jobs that run after this point should be happier | 17:05 |
| @clarkb:matrix.org | #status log Increased project.starlingx's AFS quota from 2GB to 4GB | 17:07 |
| @status:opendev.org | @clarkb:matrix.org: finished logging | 17:07 |
| @dpanech:matrix.org | Clark: thanks. This was set up before my time, I'm not really sure what this job is for. It seems to be publishing documentation/html to somewhere. I wonder if it leaves junk files behind and doesn't clean up after itself properly. Does this sound plausible ? | 17:09 |
| @clarkb:matrix.org | davlet: yes this is the job that publishes your project documentation. The documentation builds get tarballed as an artifact and then the more privileged promotion job takes that tarball and writes it to the AFS volume which has a quota. It is possible that you are orphaning unreachable data and that needs cleanup, but the consumption seems inline with others like zuul which keeps historical documentation around | 17:10 |
| @clarkb:matrix.org | davlet: if you set up openafs locally you can browser /afs/openstack.org/project/starlingx.io/www directly to see if that is happening | 17:11 |
| @clarkb:matrix.org | * davlet: if you set up openafs locally you can browse /afs/openstack.org/project/starlingx.io/www directly to see if that is happening | 17:11 |
| @dpanech:matrix.org | Clark: ok thanks | 17:13 |
| @clarkb:matrix.org | infra-root note I did the setquota and listquota now shows usage at 50%. I haven't vos released it as I figure the automated publication processes will do that for us | 17:14 |
| @fungicide:matrix.org | Clark: just because it was run in the shell doesn't mean it succeeded. i probably tried it with `-localauth` at some point before realizing i needed to do it with my kerberos account | 17:16 |
| @fungicide:matrix.org | i think the `vos` commands support `-localauth` but not the `fs` commands | 17:17 |
| @clarkb:matrix.org | ya that is what I figured | 17:17 |
| @clarkb:matrix.org | ran into the same problems I did then moved to a different auth context to make it work | 17:17 |
| @clarkb:matrix.org | and yes google says -localauth works against commands on the fileserver level so more service than internal object level | 17:18 |
| @fungicide:matrix.org | hah, forums like discourse that try to rename raw url hyperlinks based on content at the destination are definitely confused by anubis: https://discuss.python.org/t/pep-833-freezing-the-html-simple-repository-api/107051/17 | 17:37 |
| @clarkb:matrix.org | I have url previews disabled in element but I wonder if it does the same thing | 17:46 |
| @clarkb:matrix.org | The rain has mostly stopped. I'm popping out for a bike ride | 19:25 |
| @clarkb:matrix.org | fungi: https://review.opendev.org/c/opendev/system-config/+/985877 should be a quick review and fixes a bug with gitea testing if you happen to still be around this late in the day | 21:29 |
| -@gerrit:opendev.org- Clark Boylan proposed: [opendev/system-config] 985843: Upgrade etherpad to 2.7.1 https://review.opendev.org/c/opendev/system-config/+/985843 | 21:34 | |
| @clarkb:matrix.org | I half expect gitea to release 1.26.1 by the time we're ready to upgrade too | 21:34 |
| -@gerrit:opendev.org- Zuul merged on behalf of Clark Boylan: [opendev/system-config] 985877: Fix gitea selenium screenshots https://review.opendev.org/c/opendev/system-config/+/985877 | 23:52 | |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!