Thursday, 2022-04-21

opendevreviewMerged opendev/system-config master: Cleanup CentOS mirroring
ianwclarkb: ^ i'm happy to work through that stack; probably let things merge and apply then move on to the next one?00:07
Clark[m]ianw: works for me00:22
opendevreviewMerged opendev/system-config master: Cleanup debian jessie and stretch keys
opendevreviewMerged opendev/system-config master: Cleanup OpenSUSE mirroring
opendevreviewMerged opendev/system-config master: Remove isos and other images from rpm mirroring
*** ysandeep|out is now known as ysandeep03:09
*** ysandeep is now known as ysandeep|afk03:58
*** ysandeep|afk is now known as ysandeep04:38
*** pojadhav is now known as pojadhav|ruck04:55
*** luigi is now known as luigi-remote07:08
*** luigi-remote is now known as luigi07:09
*** jpena|off is now known as jpena07:11
*** ysandeep is now known as ysandeep|lunch07:52
*** pojadhav|ruck is now known as pojadhav|lunch08:07
*** ysandeep|lunch is now known as ysandeep08:36
*** pojadhav|lunch is now known as pojadhav|ruck09:21
*** ysandeep is now known as ysandeep|afk10:50
*** pojadhav|ruck is now known as pojadhav|brb11:22
*** rlandy is now known as rlandy|PTO11:51
*** pojadhav|brb is now known as pojadhav|ruck11:54
*** bhagyashris_ is now known as bhagyashris11:55
*** ysandeep|afk is now known as ysandeep12:22
*** ysandeep is now known as ysandeep|afk12:43
opendevreviewMaksim Malchuk proposed openstack/diskimage-builder master: Revert "Fallback to persistent netifs names with systemd"
*** ysandeep|afk is now known as ysandeep13:24
*** ysandeep is now known as ysandeep|afk13:41
opendevreviewMerged openstack/diskimage-builder master: Update gentoo python version to 3.9
opendevreviewDr. Jens Harbott proposed openstack/diskimage-builder master: Test building jammy
*** ysandeep|afk is now known as ysandeep15:00
fricklerkevinz_: time to refresh again if you get a chance15:05
kevinz_frickler: Sure, thanks for the reminding, will do15:05
clarkbfrickler: I think the changes to the mirror content have more than made enough room for jammy too15:13
clarkbLooks like there is one more update to the opensuse mirroring that we can alnd too15:13
clarkbfungi: if you have time for just quickly doubling checking that would be great to further trim the mirror. Otherwise I'll probably single core approve it in a bit15:14
fungisure, i'll take a peek15:14
clarkband I guess I should plan to approve the gitea upgrade once I've settled in a bit15:15
fungilgtm, thanks15:15
fungiand yeah, i just didn't want to approve gitea and go right to bed, or approve it when i was the oly one around15:15
clarkb++ I'm happy too once the tc meeting is done15:16
clarkbas I don't have anywhere to be until school pickup15:16
clarkblunch I guess. I should eat at some point :)15:16
clarkbthe mirror cleanup already cleaned up about 350GB of data.15:19
opendevreviewOleksandr Kozachenko proposed zuul/zuul-jobs master: Update promote-docker-image
opendevreviewMerged opendev/system-config master: Remove unneeded arches from opensuse updates mirror
fricklerclarkb: I was about to ask, as the 22.04 release seems to just have been made. so we simply bump the quota for the volume? I've already prepared a patch for the new mirroring15:49
clarkbfrickler: yes I think the only remaining thing is to bump the quota. On average it seems we need about 230GB per release so add that to the quota?15:50
opendevreviewOleksandr Kozachenko proposed zuul/zuul-jobs master: Update promote-docker-image
*** pojadhav|ruck is now known as pojadhav|out15:59
*** marios is now known as marios|out16:00
clarkbinfra-root we got agreement from the openstack TC to start shutting down the ELK services on our side. should be ready to go if you have time to review. I think a second core reviewer would be good simply because it affects base jobs16:00
*** ysandeep is now known as ysandeep|dinner16:07
fricklerclarkb: since the current quota is very tight, maybe start with +300 and then possibly reduce when we know how much it really is?16:08
clarkbfrickler: works for me16:08
opendevreviewDavid Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests
opendevreviewDr. Jens Harbott proposed opendev/system-config master: Start mirroring jammy
clarkbok I'm going to find breakfast, then I can approve the base job gearman removal cleanup and check jobs are still happy. Then approve the gitea upgrade and monitor that16:15
*** jpena is now known as jpena|off16:15
frickler#status log bumped AFS quota for the ubuntu volume by 300G in preparation for mirroring 22.0416:22
opendevstatusfrickler: finished logging16:22
frickleractually went from 680E6 to 990E6 which is less than 300*2^20, but I didn't want to cross the 1T line ;)16:23
fungiprobably wise16:25
clarkbok I'm approving the gearman job submission removal change now16:34
clarkb++ to being careful with the 1TB boundary. Though I think 2TB is the limit in afs so in theory that would be fine16:34
frickler"log" leaves a chunk of wood on twitter, nice idea, but not pretty obvious to parse ;)16:35
opendevreviewMerged opendev/base-jobs master: Stop submitting logstash/subunit gearman jobs
clarkbI'm watching to check ^ is happy16:48
clarkbthat jobs I was watching looks good. Any objection to approving the gitea upgrade now?16:58
funginah, everything's looking good to me, i say go for it16:59
clarkbThat last opensuse cleanup freed only about 7GB. Still in total I think that is about 350-360GB cleaned up. And I expect the new ubuntu release will be in the 230GB range so we're still ahead of where we were yesterday :)17:07
opendevreviewDavid Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests
opendevreviewDavid Wilde proposed opendev/git-review master: Bypass Java >= 17 strong encapsulation for tests
opendevreviewMerged opendev/system-config master: Upgrade Gitea to 1.16.6
*** ysandeep|dinner is now known as ysandeep18:14
clarkbthe hourly jobs are running so rpobably another 20 minutes before ^ deploys18:15
clarkbI'm keeping an eye on it18:15
*** ysandeep is now known as ysandeep|out18:20
clarkb that has updated to 1.16.6 and lgtm18:42
clarkbdo we know how to trigger the error with partial clones using pip? Our test job tests with git directly and I wonder if we should quickly check with pip if we can18:43
fricklerclarkb: iirc just pip install from a git url?18:43
clarkboh that makes sense. Pip would use a shallow clone I guess. Let me try that18:44
fungiyeah, that's where we were seeing it18:44
clarkbI'm running a focal container and will install python3, python3-venv and git. Then make a venv and have pip install something like
clarkboh I have to use as not all backends are updated yet18:47
clarkb`venv/bin/pip install -vvv git+` that worked in the focal container. Skimming logs now to see if I can see the partial clone18:48
clarkbRunning command git clone --filter=blob:none --verbose --progress /tmp/pip-req-build-3s01o5cc18:49
clarkbit ran that18:49
clarkbnow let me try the partial cloen in the foreground and ensure we don't get the warning?18:49
opendevreviewDr. Jens Harbott proposed openstack/diskimage-builder master: Add a job to test building jammy
fricklerclarkb: fungi: with ^^ and the dependency we should be ready to build jammy images18:50
clarkbya no warning which I'm pretty sure we got before "it basically said warning ignoring the blob:none flag as server doesn't support it"18:50
clarkband the config file is updated on gitea0218:51
clarkbso ya I think this is happy18:51
clarkb01-05 are upgraded at this point18:53
clarkball 8 giteas are updated. I don't see any immediate problems. Assuming the job ends successfully I will eb going to lunch (properly outside today)18:59
clarkbwhen I get back I'll review 83622819:01
clarkbyup job was a success. I'll check back in after lunch19:03
corvusi'd like to restart zuul... maybe a little faster than yesterday...19:31
corvuswould a hard-restart of executors be okay?19:32
corvus(all jobs aborted+restarted)19:32
fungilooks like it's not terribly busy, so that seems fine to me19:38
corvushard-restarting executors and mergers now19:44
corvusrestarting zuul0119:47
corvusrestarting zuul0219:55
corvus#status log restarted all of zuul on dd0135baa51cdf21a18831926c04227caa06087819:56
opendevstatuscorvus: finished logging19:56
clarkbthe jammy dib test change lgtm. I don't know if it will succeed but that seems like a good next step once we've managed to get dib building an image20:21
opendevreviewClark Boylan proposed opendev/system-config master: Remove group vars for removed services
clarkbI noticed ^ when double checking the ELK removal. ianw  I think we are ready to land the ELK removal change and I'll plan to turn off services tomorrow if you can review that change and its parent20:29
clarkbthat chang ethat tests jammy builds (simply ones for glean etc compat) passed22:36
clarkbthat is really good news. Likely means if we have trouble it will be after successfully booting (unbound, git repo caching, etc)22:37
clarkbfungi I'm trying to make heads and tails of whether or not git might get patched on bullseye to address that cve. Mostly because of the chance it will impact our image builds that run dib on bullseye more than a concern for security22:42
clarkbfungi: does <no-dsa> (minor issue) mean an update is unlikely?22:43
fungiclarkb: yeah, without a debian security advisory, a backport is not probable22:50
clarkbcool. Something to try and remember when we next update the base OS on our container images then22:51

Generated by 2.17.3 by Marius Gedminas - find it at!