19:00:06 <fungi> #startmeeting infra
19:00:06 <opendevmeet> Meeting started Tue Jul 15 19:00:06 2025 UTC and is due to finish in 60 minutes.  The chair is fungi. Information about MeetBot at http://wiki.debian.org/MeetBot.
19:00:06 <opendevmeet> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
19:00:06 <opendevmeet> The meeting name has been set to 'infra'
19:00:52 <fungi> #link https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/JNGFOCREDQHGCP3UFJQCJ2FHXL5FTLW5/ Our Agenda
19:01:08 <fungi> #topic Announcements
19:01:22 <fungi> did anybody have anything to announce that's not on the agenda?
19:02:33 <fungi> #info On July 18 we're planning to merge a change removing CLA enforcement from all remaining repositories in the OpenDev Collaboratory Gerrit
19:02:36 <fungi> #link https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/thread/GWG7G3WBMGSDOFVC72TPDCADR4VUE5N2/ Removal of CLA enforcement and configuration in Gerrit
19:02:46 <fungi> i guess that doesn't hurt to call out specifically
19:02:54 <fungi> so this friday
19:03:21 <fungi> moving on...
19:03:36 <fungi> #topic Zuul-launcher migration (corvus)
19:03:46 <fungi> i guess we're close to turning off nodepool now?
19:04:16 <corvus> yes!
19:04:36 <corvus> i'd like to merge https://review.opendev.org/954761 today
19:04:42 <corvus> er wait not
19:04:54 <corvus> i'd like to merge https://review.opendev.org/954759 today
19:05:10 <fungi> #link https://review.opendev.org/954759 Remove nodepool-nodesets file
19:05:23 <fungi> looks like i already reviewed that one
19:05:28 <corvus> 759 will start causing node_errors for ubuntu-bionic-arm64
19:05:39 <fungi> last call for reviews, but seems like the next step yes
19:05:46 <corvus> 761 will correct those errors by removing the jobs that use them
19:06:15 <corvus> from earlier discussions in #opendev my read was we're okay merging the removal and allowing those errors to happen
19:06:31 <fungi> yes, i concur, that matches my interpretation
19:06:35 <corvus> (and letting the cleanups merge as people get to it, and not blocking on it)
19:06:47 <corvus> so yeah, just wanted to bring it up here to see if there were any objections
19:07:06 <fungi> i'll give potential objectors a minute to chime in
19:07:07 <corvus> the other news is that zuul now has an option to tell it that it's running without nodepool
19:07:32 <fungi> are we running that version yet?
19:07:53 <corvus> so once 759 merges, i'll write a change to set that option for all our tenants; that will cause zuul to start producing node_error reports instead of nodepool; once that's in place we are clear to shut down the nodepool servers
19:08:23 <corvus> we should be, assuming the restart happened correctly (i haven't checked, but will certainly double check that before making the change)
19:08:28 <fungi> awesome
19:09:00 <corvus> i think that's about it then
19:09:16 <fungi> and doesn't seem like anyone has feedback about the ubuntu-bionic-arm64 removal, so we can proceed
19:09:20 <fungi> thanks corvus!
19:09:33 <fungi> #topic Gerrit 3.11 Upgrade Planning
19:09:48 <fungi> i'll parrot clark's notes from the agenda on his behalf
19:10:19 <fungi> in hopes that he's already en-route to a wonderful and well-deserved vacation, however brief
19:10:41 <fungi> #link https://www.gerritcodereview.com/3.11.html Gerrit 3.11 release notes
19:10:50 <fungi> Please check this for any concerns with the way we use Gerrit.
19:11:01 <fungi> Omnibus update to Gerrit images planned for Friday or Monday to incorporate several updates (zuul status plugin, CLA removals, and quay.io image hosting)
19:11:13 <fungi> #link https://review.opendev.org/c/opendev/system-config/+/882900 Host Gerrit images on quay.io
19:11:22 <fungi> #link https://review.opendev.org/c/opendev/system-config/+/954376 CLA file removal
19:11:31 <fungi> Needs to be done after CLA usage is removed from project ACLs
19:11:46 <fungi> Need to hold new test nodes. Perhaps that is best for after the container images move?
19:12:03 <fungi> [fungi: yes, that seems like a good order to do it in]
19:12:13 <fungi> Shutting down Gerrit can race the indexing of new changes. If this happens we can have new changes created that are not indexed leading to multiple changes with the same changeid later. To mitigate this we can/should reindex changes on Gerrit startup.
19:12:28 <fungi> #link https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade
19:12:37 <fungi> Will need to select a date once we know more about the upgrade itself.
19:12:51 <fungi> [and that concludes clark's notes on the topic]
19:13:02 <fungi> does anyone have anything else to add, or questions they'd like to raise?
19:13:17 <fungi> if not i'll move along to the rest of the agenda
19:14:16 <fungi> #topic Upgrading Old Servers
19:14:18 <fungi> #link https://etherpad.opendev.org/p/opendev-bionic-server-upgrades
19:14:20 <fungi> #link https://etherpad.opendev.org/p/opendev-focal-server-upgrades
19:14:24 <fungi> #link https://etherpad.opendev.org/p/opendev-server-replacement-sprint
19:14:27 <fungi> #link https://etherpad.opendev.org/p/opendev-mediawiki-upgrade
19:14:45 <fungi> there's also a note here saying that tonyb will look at cacti after wiki
19:15:41 <fungi> and for refstack i'm hoping to get to communications for tearing that down and retiring the associated git repositories in the next week-ish
19:15:59 <fungi> also eavesdrop needs upgrading
19:16:22 <fungi> anything else related to server upgrades?
19:16:43 <fungi> oh, also a reminder from the agenda...
19:16:45 <fungi> Remember to use launch-node's --config-drive flag when booting new Noble nodes in Rax Classic
19:17:32 <fungi> #topic Working through our TODO list
19:17:52 <fungi> #link https://etherpad.opendev.org/p/opendev-january-2025-meetup Current TODO list
19:18:11 <fungi> in case anyone needs some more ideas for what to jump on next
19:18:28 <fungi> #topic OFTC Matrix bridge no longer supporting new users
19:18:47 <fungi> this topic could probably stand to be adjusted/updated, i'm not sure this is still actually the case
19:19:26 <fungi> nevertheless, there is an associated spec that, if we execute on it, should prevent that from being a concern for us in the future!
19:19:38 <fungi> #link https://review.opendev.org/c/opendev/infra-specs/+/954826 Spec outlining the motivation and plan for Matrix trialing
19:20:23 <fungi> and huge thanks to clark for mopping up the specs repo in general, moving most of the content to the completed or help wanted sections, getting the site building again and jobs passing after years of neglect, et cetera
19:20:45 <fungi> anyway, when everyone has a chance
19:21:24 <fungi> #info Please review the proposed "Matrix for OpenDev Comms" spec
19:22:00 <fungi> i expect this will be raised for final approval in a few weeks if feedback is favorable
19:22:14 <fungi> #topic Pre PTG Planning
19:22:25 <fungi> #link https://etherpad.opendev.org/p/opendev-preptg-october-2025 Planning happening in this document
19:22:42 <fungi> remember to stick any discussion or working session ideas you might have there
19:22:53 <fungi> #topic Open discussion
19:22:58 <fungi> anyone have anything else?
19:24:52 <fungi> we had a gerrit outage for a few hours earlier today, no useful post-mortem other than finding nothing in guest-side logs to explain
19:25:26 <fungi> it was suggsted there might have been an oom event on that hypervisor host in the provider, but it hasn't been confirmed
19:25:38 <fungi> anyway, no lasting problems were identified after the server was brought back online
19:25:59 <fungi> many thanks to tonyb and frickler for fielding that while i was lazily sleeping in!
19:26:18 <fungi> seems like nobody has anything to bring up, so i'll wrap up the meeting now
19:26:33 <fungi> catch us in #opendev if you need anything else!
19:26:39 <fungi> #endmeeting