Friday, 2022-04-15

*** cloudnull3 is now known as cloudnull00:53
fungijohnsom: do you also need a constraints change for now?01:10
johnsomThat is a good question. I can propose that if we do need it.01:12
johnsomI will recheck a patch after dinner to see if we are all set.01:12
opendevreviewOpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml
fricklercentos-7 builds are failing for some time, most recent uploaded image is 9d old
opendevreviewMerged openstack/project-config master: Normalize projects.yaml
hrwwow. zuul page loads much faster when your job-output.json is 2.1MB instead of 29MB.11:33
hrwthanks folks to pointing into proper direction11:34
fungihrw: you bet. though i still think it may be a good idea to look into more efficient ways for the dashboard to handle larger build results11:57
fungireminder: we're a little over two hours out from the gerrit maintenance window. i'll disable deployments for review, storyboard and gitea servers shortly and around 14:00 utc i'll do a status notice to give folks an hour's warning12:50
fungi#status log Temporarily disabled deployments for all Gerrit, Gitea and StoryBoard servers in preparation for today's upcoming service maintenance activity13:30
opendevstatusfungi: finished logging13:30
fungi#status notice Reminder: The Gerrit service at will be offline briefly starting at 15:00 UTC (roughly an hour from now) for scheduled maintenance; see for details14:00
opendevstatusfungi: sending notice14:00
-opendevstatus- NOTICE: Reminder: The Gerrit service at will be offline briefly starting at 15:00 UTC (roughly an hour from now) for scheduled maintenance; see for details14:00
opendevstatusfungi: finished sending notice14:02
fungii'm thinking we should hold off until monday to tag bindep and git-review, so as to not make unnecessary "friday releases"14:16
fungithe week sort of got away from us after widespread disruption from the git security fix14:16
fungiseeing as how we're ~30min out, i'll work on getting the rename config in place on bridge and ready for step #5 of
fungiit's ~fungi/20220415.yaml on bridge.o.o14:31
fungichecking all the servers to make sure bridge is able to ssh into them, in order to avoid any nasty surprises later14:39
fungimade a test playbook to run uptime on gitea,review,storyboard,storyboard-dev, and ran that with ansible, all 12 ran successfully14:47
fungiso connectivity to everything the rename_repos.yaml playbook needs is working14:48
fungithough i found a typo in our docs14:48
opendevreviewJeremy Stanley proposed opendev/system-config master: Fix a trivial typo for repo renaming playbook path
fungibrown-bag fix ^14:49
fungimust have snuck in there recently14:49
fungihuh, came in 8 months ago with so i'm surprised nobody's noticed before now14:50
fungianyway, we're all set to do step #5 now and i've got the command pasted into a root screen session on bridge.o.o awaiting the appointed time14:53
fungi#status notice The Gerrit service at is going offline now for scheduled maintenance, but should be available again in a few minutes14:58
opendevstatusfungi: sending notice14:58
-opendevstatus- NOTICE: The Gerrit service at is going offline now for scheduled maintenance, but should be available again in a few minutes14:58
fungisending that a couple of minutes ahead of schedule since it takes a bit to hit all the channels14:58
fungiand running ansible now15:00
opendevstatusfungi: finished sending notice15:01
fungithe gerrit index backup task takes a while15:02
fungithere it goes, gerrit should be starting now15:02
fungiwebui is responding to me again15:03
fungireindexing has been triggered15:03
fungiplay recap says everything was successful15:04
fungii'll go ahead and merge the three changes15:05
opendevreviewMerged openstack/project-config master: Rename x/sushy-oem-idrac to openstack/sushy-oem-idrac
opendevreviewMerged openstack/project-config master: Configure renamed sushy-oem-idrac with openstack jobs
opendevreviewMerged opendev/project-config master: Record project renames happening April 15, 2022
fungionce those replicate to gitea, we should be able to proceed15:06
fungii see them all in gitea now15:07
fungiand i've removed my admin account from project bootstrappers15:08
fungi#status log Reenabled deployments for all Gerrit, Gitea and StoryBoard servers in conclusion of today's service maintenance15:10
opendevstatusfungi: finished logging15:10
fungiso we're now at step #9, waiting15:11
fungiinfra-prod-manage-projects ran successfully in the deploy pipeline for 833019,115:16
fungiinfra-prod-service-zuul for 833020,1 is the other critical piece at this point but it should hopefully get underway before the next hourly deploy ends up blocking the build15:17
fungideployment is complete for 833019,1 and i guess the infra-prod-service-zuul run for it actually took 833020,1 into account already. 833020,1 got immediately skipped once it reached the front of the queue. zuul did not report deployment for that change at all15:28
fungii this concludes another maintenance, thanks everyone, that's a wrap! enjoy your friday!15:29
fungigonna make lunch, but i'll keep an eye on irc in case anything comes up15:35
*** marios is now known as marios|out15:37
Clark[m]Thank you fungi!16:06
fungino sweat16:06
fungii went ahead and closed out the screen session i used on bridge.o.o for that16:36
Clark[m]fungi other than that small typo fix was anything not up to date in the docs?18:21
Clark[m]Figure we should capture that if there is a delta before we forget18:21
fungiClark[m]: nope, everything went fine just following the docs, minus that one minor typo19:20
clarkbnow that fedora mirroring should be happier we need to recheck the bindep changes19:33
* clarkb works on doing that have to sign into gerrit first19:33
clarkbfungi: +2 on the srv -> src fix. I noticed it didn't have check results so I rechecked it. I'm going to assume it was pushed before zuul reconnected to gerrit during the renaming process19:38
opendevreviewMerged opendev/bindep master: Fix bindep testing with distro 1.7.0 and greater
opendevreviewMerged opendev/bindep master: Add AlmaLinux support
clarkbCool we'll be ready to push releases on monday with that done19:47
clarkbfungi: looks like the typo fix has a +1 now. Not sure if you want ot just go ahead and +A it I don't thin kthat is a problem but I'm not around to debug a failed doc publishing should that happen19:49
fungiyeah i guess i pushed 838184 too close to the maintenance and the check result tried to report during the gerrit outage ~10 minutes later20:13
fungithere's no rush20:13
fungithanks for reviewing!20:13

Generated by 2.17.3 by Marius Gedminas - find it at!