Tuesday, 2025-06-03

clarkbHello it is time for a weekly meeting19:00
clarkb#startmeeting infra19:00
opendevmeetMeeting started Tue Jun  3 19:00:26 2025 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:00
opendevmeetThe meeting name has been set to 'infra'19:00
clarkb#link https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/HZE5Z7QO6FJ4FFFH5DXQAUSRC5HYOWEK/ Our Agenda19:00
clarkbThis agenda is suspciciously similar to the one we had last week19:00
clarkbI'll admit that I ended up having a number of non infra distractions and also ran into problems with ubuntu mirrors that interrupted my goal of booting new servers19:01
clarkbBut we can dive in and figure out what updates there are19:01
clarkb#topic Announcements19:01
clarkbI will be attempting to help my brother move tomorrow so will be in and out and afk randomly19:01
corvusyou can borrow my truck19:02
clarkbI suspect both the typical start and end of my day will be the time I'm most connected. Please ping me on Matrix if anything needs urgent atetntion. I won't be far from home and can return if necessary19:02
clarkbcorvus: I'd have to start driving now and not sleep tonight to get it back in time19:03
clarkbbut I appreciate the offer :)19:03
corvus:)19:03
clarkbWas there anything else to announce?19:03
clarkb#topic Zuul-launcher image builds19:04
clarkbI think we can probably dive right in then19:04
corvussome updates here!19:04
corvusi recently observed a zuul-launcher bug in opendev, fixed in: https://review.opendev.org/95168319:05
corvusthen there's a stack of changes that's almost merged to expose nodeset request info through the web ui, and also allow us to change node state and delete nodeset requests through the api19:05
clarkb"zero division error" that laws of math must not be flouted19:05
corvusi have a todo to expose the same feature set through zuul-client for those of us who don't use keycloak19:05
corvusthose are the only things currently on my "punch list" before i'm comfortable saying we should start switching other tenants, including openstack19:06
clarkbdoes the web ui exposure that is near landing allow authenticated manipulation already?19:06
corvus(i will also propose running a second launcher)19:06
corvusyes, so those of us with keycloak accounts will immediately be able to click buttons in the web ui and make stuff happen19:07
corvusonly thing unwritten is "zuul-client delete-nodeset-request", etc19:07
clarkback. More motivation to get a keycloak account configured if you haven't yet19:07
corvusyeah, it's a much nicer experience anyway :)19:08
clarkbfrickler has also started experimenting with adding debian trixie nodes. And I think this exposes the power of zuul-launcher/nodepool in zuul19:08
corvus++19:08
clarkbthe changes to dib that enable building trixie are able to be speculatively gated in zuul-providers with all of our elements19:08
clarkband not just the minimal elements that dib tests itself against19:08
clarkba good illustration of some of the motivation behind these changes (there are other motiviations too)19:09
corvuscertainly a big one19:09
clarkbanything else zuul-launcher/nodepool in zuul related?19:10
corvusnope, just expect me to propose expanded use soon :)19:10
clarkbexciting19:11
clarkb#topic Gerrit shutdown problems19:11
clarkbLast week we basically said lets land https://review.opendev.org/c/opendev/system-config/+/950595 then do a restart using sighup to see if we hit the timeout. Then the time after that go back to using sigint to see if shorter h2 compaction time helps19:11
clarkbunfortunately I've not been in a good place where I can focus on Gerrit properly to do that19:12
clarkbLooking ahead at my week I hesitate to say I can do this Friday but that may be doable.19:12
clarkbso thats my goal we'll see if I can hit it19:12
fungii can try to help with it too19:12
clarkbthat change has the reviews I need too. its just waiting on my +A for when I can monitor so nothing really necessary from anyone else until we're ready to restart it19:12
clarkbfungi: thanks!19:12
clarkb#topic Gerrit 3.11 Upgrade Planning19:13
clarkbsimilarly I haven't been looking any closer at the Gerrit upgrade recently19:13
clarkb#link https://www.gerritcodereview.com/3.11.html19:13
clarkbstill a good idea for those with time to look over the release notes here and add any notes or concerns on our planning document19:13
clarkb#link https://etherpad.opendev.org/p/gerrit-upgrade-3.11 Planning Document for the eventual Upgrade19:14
clarkbAssuming the signal handling related restart(s) happen this week i should be able to pick this back up again next week maybe.19:14
clarkb#topic Upgrading old servers19:14
clarkbAs mentioned at the start of the meeting I did start poking at this a bit last week19:14
clarkbI landed some updates to the mirror update server and zookeeper servers that allow them to run on old and nwe ubuntu19:15
clarkbmy plan was to follow that up with booting new servers but then ubuntu mirrors were having issues and I didn't want to boot new servers that launch-node deletes due to an inability to install packages (we run some minimal ansible and also do a full system package update after the first boot)19:15
clarkbbut once I have some breathing room I'd like to start on that again as I think ubuntu mirrors are happier now ( at least I haven't seen failures recently)19:16
clarkbpretty sure there are no refstack cleanup updates but chime in if I'm wrong19:16
clarkbAny other server upgrades notes?19:17
fungi(narrator: there were not)19:19
clarkb#topic Working through our TODO list19:19
clarkb#link https://etherpad.opendev.org/p/opendev-january-2025-meetup19:19
clarkbjust our weekly reminder and a call out to any interested contributors that this etherpad has a good high level overview of stuff that needs doing19:19
clarkbI'm happy to help provide more detail and assist anyone looking into tackling items on that list19:19
clarkb#topic OFTC Matrix bridge no longer supporting new users19:19
clarkbas mentioned last week things got better but its clearly not a service that gets fixes urgently. We've had a bit of time to noodle on this more. Do we think we'd like to proceed with running an opendev matrix room as our primary synchronous comms point?19:20
clarkbI don't think I got an PMs or emails for feedback but if I missed them I apologize19:21
fungii'm indifferent but dont wish to block the wheels of progress (nor be ground beneath them)19:21
clarkbOne thing I thought I'd mention is the openstack operators group is experimenting with a matrix room that fungi set up for them19:21
clarkbthey might be good canaries for how able people who aren't use are able to make use of a matrix room?19:21
clarkbthough we have some feedback on that via zuul and there aren't major concerns there so may be overkill to wait for feedback from the openstack operators19:22
clarkbI'll admit part of my willingness to defer a bit here is simply how full my plate is suddenly with other stuff and I'm not sure Id be able to care and feed for a new channel and potential problems associated with that properly19:22
clarkbI'm hoping all of that eases up in a week or two though19:23
corvusi'm happy to help in any way19:23
corvusnot that i'm not busy too, but i am volunteering :)19:23
clarkbthanks. Proposal: given my hopes that next week will be better and we have volunteers. Maybe plan to create the new room next week and actively drive people on irc #opendev to that location?19:23
corvusand work on some announcements, messaging?19:24
clarkb++19:24
corvussgtm19:24
clarkbmaybe the order of operations is write an announcement and update the irc channel topic? create the room, start using the room and actively push people that direction19:24
* clarkb scribbles some notes so that ends up on the todo list19:25
corvusyeah.  to avoid confusion, i'd probably want to try to set a cutover timeframe for clarity19:25
clarkbmaybe next week is get ducks in a row time (write an announcement, communicate in general, create the room) then the week after is the switch in comms location?19:26
corvus++19:26
clarkbsounds like a plan. Anything else on thsi topic?19:28
clarkb#topic Enabling hashtags globally19:29
clarkb#link https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/thread/SVXT6X4WRYE6XQPB5PTWFUKUATICLO56/ Announcement that this is happening today19:29
clarkb#link https://review.opendev.org/c/opendev/system-config/+/951601 Docs update to reflect the update being made manually19:29
clarkb951601 captures the change that corvus has volunteered to make in all-projects meta config19:29
clarkbit lgtm and I think we can proceed with the actual change whenever convenient. But if others are concerend please review the docs change asap19:30
corvushappy to update it to match topic as clark mentioned... lmk19:30
clarkbI don't think we need to since the existing acls do it the way you've done it19:30
clarkb(so we know that will work, it was just odd to me that they would be in different locations when I first looked)19:31
clarkboh and ya my comment on that change links to followup cleanups that we can make to remove redundant configs from project-config/gerrit/acls19:31
corvussince we said we'd do that today...  do we wait for more +2s or do i +w it?19:32
clarkbcorvus: maybe give people until 20:00 since I think we'll finish the meeting early today and that gives anyone time to quickly reivew it they want to19:32
clarkband if not I'm good with proceeding at that point19:33
corvus++19:33
clarkbanything else on gerrit hash tags?19:33
fungisorry, reviewing now!19:34
clarkb#topic Adding CentOS 10 Stream Support to Glean, DIB, and Nodepool19:34
fungilgtm19:34
clarkbI don't have any personal updates on this topic19:34
clarkbI think the glean change is ready for review though19:35
clarkb#link https://review.opendev.org/c/opendev/glean/+/941672 Glean updates for centos 10 stream ready for review19:35
clarkbthen I saw tonyb pushed changes to test dib without nodepool19:35
clarkbhttps://review.opendev.org/c/openstack/diskimage-builder/+/949942 it is marked wip and doesn't pass yet but progress is being made on that side of the effort19:36
clarkbtonyb when you are awake maybe let us know when that change is ready for initial review19:37
clarkbbut ya if we get glean updated, dib testing updated, then we can land the centos 10 stream updates that use specific cpu options19:37
tonybI will let you know.   I expect it'll be tomorrow at this rate19:37
clarkbthen we can have a disussion over whether/how we're going boot those images in opendev19:38
clarkbtonyb: ack19:38
clarkbAnything else on this topic?19:38
clarkb#topic Open Discussion19:39
clarkbJune 13 is the open infra summit cfp deadline19:40
fungijust a heads up that we've got an assortment of changes landing soon for openstack and starlingx to switch from enforcing the old openinfra icla to signed-off-by for the dco19:41
clarkbI think they will be opening up forum session submissions too19:41
clarkbfungi: those are scheduled to land July 1?19:41
fungithe final one yes19:41
fungitooling changes and acl cleanup hopefully far sooner19:41
clarkb++ I know I reviewed some of them. Let me know if my reviews have gone stale for updates and I can rereview19:42
fungiand starlingx may switch sooner than openstack too19:42
clarkbalso I discovered that something like 15 yaers ago spearce and an android dev decided that any matching signed-of-by was sufficient signed-of-by checking in case anyone gets questions later19:42
clarkb(basically you oinly need one of author, committer, person making the change in gerrit to have a signed-of-by)19:43
clarkband I can't spell off19:43
clarkbok last call. Otherwise I'll end the meeting in a minute or two19:44
clarkbthanks everyone! We'll be back here same time and location next week. Until then thanks again for all your help working on opendev19:45
clarkb#endmeeting19:46
opendevmeetMeeting ended Tue Jun  3 19:46:02 2025 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:46
opendevmeetMinutes:        https://meetings.opendev.org/meetings/infra/2025/infra.2025-06-03-19.00.html19:46
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/infra/2025/infra.2025-06-03-19.00.txt19:46
opendevmeetLog:            https://meetings.opendev.org/meetings/infra/2025/infra.2025-06-03-19.00.log.html19:46
fungithanks clarkb!19:46

Generated by irclog2html.py 4.0.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!