Thursday, 2024-05-02

opendevreviewRadosÅ‚aw Piliszek proposed openstack/project-config master: Add new repository for NebulOuS testing data  https://review.opendev.org/c/openstack/project-config/+/91687610:56
opendevreviewRadosÅ‚aw Piliszek proposed openstack/project-config master: [NebulOuS] Add repository for SAL  https://review.opendev.org/c/openstack/project-config/+/91794311:07
clarkb#status log Added noonedeadpunk to freezer-core, freezer-tempest-core, and freezer-release to enact https://review.opendev.org/c/openstack/governance/+/91491115:40
opendevstatusclarkb: finished logging15:40
clarkb#status log Also added noonedeadpunk to freezer-stable-maint15:45
opendevstatusclarkb: finished logging15:45
tonybWhat are the requirements for hosting code on opendev?  I've been asked if opendev is an option instead of rdoproject and software-factory running theier own gerrit instances.  There are many many open questions but in theory is it a thing?15:51
clarkbtonyb: we're happy to host OSI licensed projects. The ultimate goal is to also get the involved projects to directly contribute to opendev to help make the hosting sustainable long term15:53
clarkbSo basically be open source and be willing to at the very least help yourselves in using the system but even better if you can help others too is the sort of appraoch we'd like to see15:54
tonybThanks.    For sure they're OpenSource and I like to think that at least some of the contributors would be willing to help, there's reasonable overlap at least in the RDO team/community.15:56
clarkbThe gerrit community meeting was helpful. Looks like the topic change limit should only apply to open changes and they don't think it will affect the upgrade if you have any over the limit. You just won't be able to push new changes to the topic until some changes merge/abandon/close15:57
clarkbI think I'll still try to do some lightweight testing of those assumptions but I don't anticipate problems anymore15:57
tonybOkay that's cool.  Also somewhat easy to test on a held node15:57
clarkboh and we do need to have explicit bazel targets for building without webfonts as bazel is very explicit and they didn't think there was a way to alias targets to get a release war without webfonts15:58
clarkbso I'll work on that and probably try to upstream it too so that we can just build release_webfont_free or similar15:58
tonybNice15:58
clarkbI'm going to pop out now for breakfast and parent teacher meetings. I'll be back in a couple hours probably15:59
opendevreviewTony Breeds proposed opendev/system-config master: [DNM] Force etherpad failure  https://review.opendev.org/c/opendev/system-config/+/91799016:20
fungitonyb: clarkb: i'm not really here (sitting in lga waiting for my bgr flight to board), but technically we already provide some services to rdo since our irc bots are joined to #rdo (so channel logging, status announcements, et cetera)16:50
tonybfungi: good to know.16:52
fungialso it looks like their projects are currently in a gerrit they manage, based on the rdogerrit bot i see announcing changes in their channel16:54
fungikeep in mind that moving from review.rdoproject.org to review.opendev.org would be a straight git clone import, i don't think we'd be able to retain their old reviews since the review numbers would almost certainly conflict16:56
tonybYeah.  I there would be some information loss due to that.  RDO also has it's own zuul which I guess would need to be transitioned to something more like a 3rd party.16:58
tonybI don't think there would be an option to add the rdo nodepool but it's all very much in the "I wonder if" stage.16:59
*** mordred1 is now known as Guest292017:03
tonybclarkb: 917865: Tighten permissions on Etherpad settings file | https://review.opendev.org/c/opendev/system-config/+/917865 looks good to me.  Any preference when we land it?17:06
clarkbya there are complicated methods of importing gerrit changes that people seem to always run into problems with18:15
clarkbtonyb: I'm back around now so anytime now is fine18:15
clarkber anytime after now18:15
tonybclarkb: Does UTC2000 work for you?  That probably conflicts with either/both of a bike ride and school run18:17
clarkbthats perfect. Schools out today so that parents can do the teacher meetings and I don't plan to bike ride today. Sort of annyoed that a big "winter" storm is about to roll through the next few days though18:18
clarkbit is May and driving over the mountain passes is going to be sketchy this weekend. I'm ready for spring :)18:19
tonybOkay lets call that a plan.18:19
tonybwe can land 917865 at least ... did you want to also do ertherpad 2.0.3 ?18:20
clarkbtonyb: we did 2.0.3 already18:20
clarkbthis is the followup to that from some fungi review comments18:20
clarkband thank you for double checking the container image produced the expected permissions18:21
tonybAhh okay.  I was confused by https://review.opendev.org/c/opendev/system-config/+/840972 (the hold doe the 2.0.3 upgrade) still being there.  I thought you'd done the real upgarde18:26
tonybI was very confused by the docker output.18:26
opendevreviewTony Breeds proposed opendev/system-config master: Allow overriding of meetpad PUBLIC_URL  https://review.opendev.org/c/opendev/system-config/+/90551018:46
opendevreviewTony Breeds proposed opendev/system-config master: Use group var to define letsencrypt_certs  https://review.opendev.org/c/opendev/system-config/+/90556118:46
opendevreviewTony Breeds proposed opendev/system-config master: Switch meetpad test servers to jammy  https://review.opendev.org/c/opendev/system-config/+/90518218:46
opendevreviewTony Breeds proposed opendev/system-config master: DNM: force jitsi_meet node failure for testing  https://review.opendev.org/c/opendev/system-config/+/90518318:46
opendevreviewClark Boylan proposed opendev/system-config master: Patch Gerrit's build system for webfont free war builds  https://review.opendev.org/c/opendev/system-config/+/91800819:10
clarkbThis is a half testing chagne. I want to see if I can make that generally work before proposing a change like that upstream. Ideally we wouldn't need to carry the patch at all in merged system-config git state, but we'll see19:11
clarkbnow that I've done that I half wonder if I should've just pushed it upstream first and then used a depends on. But that gets weird with wanting it to apply to both stable-3.8 and 3.9 before I'm ready to backport or ofrward port anything upstream. This is probably good for now to figure out if this is viable19:15
tonybclarkb: fair enough.  Good luck.19:49
tonybclarkb: You still okay for ~10mins to land fungi's patch?19:49
tonybI'm happy to monitor it as it lands etc so I expect you're on the hook for any problems I can't grok.19:50
clarkbyup I've finished eating lunch and am around19:56
clarkbtonyb: it should auto restart the service for us since the container image is updating19:58
clarkbthen its just a amtter of checking that it works generally19:58
tonybclarkb: Yup that was more or less my expectation.19:59
tonybclarkb: It feels low risk19:59
opendevreviewClark Boylan proposed opendev/system-config master: Patch Gerrit's build system for webfont free war builds  https://review.opendev.org/c/opendev/system-config/+/91800820:00
clarkbyup I agree20:00
tonyb# status log There will be a short etherpad outage while the service restarts to accommodate new configuration.20:03
tonybclarkb: Does ^^ looks okay?20:03
clarkbya that seems fine. Note that `log` won't report to every channel like `notice` does but I expect this to eb small enough that we don't need to spam for that20:04
tonybclarkb: Noted.20:04
tonyb#status log There will be a short etherpad outage while the service restarts to accommodate new configuration.20:04
opendevstatustonyb: finished logging20:05
tonybclarkb: I noticed that nodepool hourly prod run failed on nb02 with: ERROR: for nodepool-builder  Head "https://quay.io/v2/zuul-ci/nodepool-builder/manifests/latest": received unexpected HTTP status: 502 Bad Gateway20:23
tonybI assume that's okay to ignore until the nest run?20:23
clarkbyes I think so. Thats it trying to fetch the container image and a 500 error implies it isn't on our end20:31
opendevreviewMerged opendev/system-config master: Tighten permissions on Etherpad settings file  https://review.opendev.org/c/opendev/system-config/+/91786520:31
tonybclarkb: cool that was my realing20:31
opendevreviewClark Boylan proposed opendev/system-config master: Patch Gerrit's build system for webfont free war builds  https://review.opendev.org/c/opendev/system-config/+/91800820:31
clarkbfor whatever reason typing webfont is really difficult and it always comes out webfront20:32
tonybLOL, I read the webfont in that was webfront and was like .... "What is he talking about?"20:33
tonybI guess that means I can understand the typing problem20:33
tonybclarkb: the deploy run didn't get a new container, but the playbooks did change the ownership on the settings file20:41
clarkbhrm20:41
clarkboh i know20:41
tonybroot@etherpad02:~# ls -l /etc/etherpad/settings.json 20:41
tonyb-r--r----- 1 5001 5001 23450 May  1 16:20 /etc/etherpad/settings.json20:41
tonybroot@etherpad02:~# docker exec -it --user root etherpad-docker_etherpad_1 ls -l /opt/etherpad-lite/settings.json20:41
tonyb-r--r----- 1 etherpad 5001 23450 May  1 16:20 /opt/etherpad-lite/settings.json20:41
clarkbactually no it did run the build in check so the file matchers should be fine20:42
clarkbI think it has to do with only changing the job definition and not the dockerfiel though20:43
clarkbtonyb: maybe we should go ahead and add a rebuild comment to the dockerfile just to make sure the image rebuilds and deploys?20:43
tonybOkay.  I can see that20:43
clarkbdo you want ot push that up or should I?20:45
tonybI'll do it.20:50
opendevreviewTony Breeds proposed opendev/system-config master: Force new build of the etherpad container  https://review.opendev.org/c/opendev/system-config/+/91801120:52
tonybSo the container did build in system-config-upload-image-etherpad but it only published a change_917865_latest tag without a latest tag20:53
clarkbya because the gate jobs didn't run the test. I think maybe when we trigger jobs because they are updated that only applies to check and not gate?20:54
clarkbit is a confusing behavior if that is the case and maybe zuul should run them in the gate too20:54
clarkbcc corvus 20:54
tonybclarkb: I think I understand.  I'll watch what 918011 does to verify.20:59
tonybclarkb: FWIW: the nodepool hourly run was fine this time: https://zuul.opendev.org/t/openstack/builds?job_name=infra-prod-service-nodepool&pipeline=opendev-prod-hourly&skip=0&limit=321:11
clarkbcool just a transient problem in quay then21:13
tonybYup.21:22
tonybclarkb: I don't know if this is what you meant but, it looks like we didn't trigger the system-config-promote-image-etherpad job in the deploy pipeline because 917865 didn't touch a file that matches the files jobvar.  21:54
clarkboh yup that would explain it21:55
clarkbas you mentioend the image did end up in docker hub but since promotion didn't run we never updated the latest tag21:55
tonybYup that's my read of it.  I thought system-config-upload-image-etherpad would take care of it but I understand better now.21:57
tonybso we'll have another leaked chnage_xxx tag up there that we can cleanup at some stage.21:57
opendevreviewMerged opendev/system-config master: Force new build of the etherpad container  https://review.opendev.org/c/opendev/system-config/+/91801122:59
clarkbarg my ssh keys have expired out of the agent23:01
clarkbetherpad restarted a minute ago on the new image and says it is healthy23:02
clarkbspot checking a few etherpads they all load for me23:03
clarkbtonyb: I think this is looking happy to me23:03
tonybYup just checking it now but it's looking good23:03
tonybYup permissions are as expected \o/23:04
clarkbexcellent23:06
tonybhttps://paste.opendev.org/show/bZgfWtYFYXgixq2pIY3n/23:06
tonybI do notice that we didn't keep the old etherpad image around.  I thought we set things up so that we would for 72hours just in case23:07
opendevreviewTony Breeds proposed opendev/system-config master: Add a helper script for doing the LVM setup on mirror nodes.  https://review.opendev.org/c/opendev/system-config/+/90150423:21
opendevreviewTony Breeds proposed opendev/system-config master: Remove some old CentOS compatibility and address FIXMEs  https://review.opendev.org/c/opendev/system-config/+/91801623:21
opendevreviewMerged opendev/system-config master: Add a helper script for doing the LVM setup on mirror nodes.  https://review.opendev.org/c/opendev/system-config/+/90150423:34
tonybclarkb: I think I'm done for the day.23:35

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!