Tuesday, 2024-07-23

clarkbjust about meeting time18:59
fungiwhee!18:59
clarkb#startmeeting infra19:00
opendevmeetMeeting started Tue Jul 23 19:00:06 2024 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:00
opendevmeetUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:00
opendevmeetThe meeting name has been set to 'infra'19:00
clarkb#link https://lists.opendev.org/archives/list/service-discuss@lists.opendev.org/thread/OJTZIQRSLNYPUNSKXK7SNDACXHB675U7/ Our Agenda19:00
clarkb#topic Announcements19:00
clarkbAs frickler mentioned in #opendev earlier today there are some new security patches for nova that we should be careful about and help ensure they merge in a timely manner19:00
clarkbWas there anything else to announce?19:01
clarkbsounds like no we can move on19:02
clarkbI'm actually going to go a bit out of order to get some of these shorter topics out of the way first19:02
clarkb#topic AFS Mirror Cleanups19:02
clarkbI didn't have anything new here. Most of my focus since getting back has been on gitea and reviewing other people's changes19:03
clarkbthat said if you have time to review I think topic:drop-ubuntu-xenial has changes up still. CentOS 8 stream doesn't have any changes up right now I don't think but it has been largely removed from zuul on our side of things19:03
clarkb* removed from zuul and afs19:03
clarkbI think the next step for centos 8 stream is to remove the images compeltely from nodepool /me makes a note to look into doing that today19:04
clarkbAnything else to add to this topic?19:05
clarkb#topic Testing Rackspace's New Cloud Offering19:06
clarkbSo I reached out to others at the Foundation for some advice on how to proceed given my emails didn't get a response. Long story short it sounds like july was just a bad time to try and sync up with them so far and the suggestion is to try again in a week or so19:06
clarkbSo I'll be doing that but otherwise there isn't really anything new to report on this topic19:06
clarkb#topic Drop x/* projects with config errors from zuul19:07
clarkbI sent an announcement indicating we were going to do these sorts of cleanup. It seems to have generated some feedback on the chagne and we also got x/ospurge handed over to mnaser19:08
clarkb#link https://lists.opendev.org/archives/list/service-announce@lists.opendev.org/thread/X5TM537UZFPYXF23H6TJFSKO7M6GVM2W/ Warning that was sent about these planned changes19:08
clarkb#link https://review.opendev.org/c/openstack/project-config/+/923509 Proposed cleanup of inactive x/ projects19:08
fricklerI undropped ospurge from the patch earlier today, so the remainder should be good to go19:08
clarkbthe change for cleaning things up was recently updated with a current list of project to remove and I think we can proceed with merging that as soon as we get a second review on it19:08
clarkbyup thank you for that update. We're past the date we said we would do cleanups too so if anyone else has a momeent to review that I think it is safe to merge19:09
frickleryes, that should be no risk to the nova patches either19:09
clarkb++19:10
fungiagreed19:10
clarkb#topic Gitea DB Doctoring19:10
clarkbThe gitea 1.22.1 upgrade was completed last friday. We did hit a minor snag around the formatting of a particular secret. We ended up letting gitea09 generate a new secret then propogated that out via ansible to work around the problem. Its actually a secret for a subsystem that we disable so not a huge deal for us but gitea refused to start without it being in the fomrat it19:11
clarkbwants19:11
clarkbBut that means we are now in a position to run the doctor tool19:11
clarkb#link https://etherpad.opendev.org/p/hcz4yMxUIsAWGgyoHKeZ proposed plan for db updates on each gitea node19:11
clarkbI've gone ahead and drafted up a plan for the tasks to run on each node. Considering the nova patches are inflight and gitea is used to consume them (though not merge them) I've decided I'll start on this tomorrow morning at the earliest19:12
fungii'm around as early as you want to start on it tomorrow19:12
clarkbthat also works better for my schedule as it will allow me to dedicate basically all of wednesday to the process and ensure that giteas stay as in sync as possible19:12
clarkba quick review of the plan and posting any concerns to the doc or irc would be appreciated. I think fungi has indicated that it looks good but other feedback is welcome too19:13
fungiyep, lgtm19:13
fungii couldn't think of anything else worth testing either19:14
clarkb#topic Upgrading Old Servers19:15
clarkbis tonyb awake yet?19:15
clarkbLooks like no19:16
clarkbI haven't managed to catch up on where the mediawiki effort is since I was out. I know the last statement was that things weren't quite ready for review yet but there is/was a held node to test thigns (which fungi has done and may be the most qualified to do so so thank you)19:16
clarkblooks like the mediawiki change hasn't updated since we last met in this meeting19:17
clarkbI suspect htat implies it isn't ready for review yet, but tonyb please do say otherwise if that is the case19:17
clarkboh it is also marked WIP so I think that is still the state of things19:18
clarkb#topic Reconsider queue depth for integrated gate19:18
clarkbI asked about the state of this item yesterday preparing for the meeting and frickler said there doesn't appear to be any interest in implementing the suggestion for early failure detection in openstack jobs19:19
clarkbfrickler: do you know if the idea has been proposed to the openstack qa team at all?19:19
clarkbjust thinking if that hasn't happend that would be a good next step just to be sure there isn't going to be any ofrward progress on this proposal before we fallback to other ideas like reducing the queue window floor19:20
fricklerwell essentially there is not much of a qa team, only gmann and kopecmartin, but I didn't talk to them specifically19:20
clarkbok I can volunteer to bring this up over in #openstack-qa and can probably write an initial change for the tempest base job. I probably can't drive the broader adoption across all the jobs we may want to make the change to though but I can let them know19:20
clarkbeven with the security fixes the gate doesn't seem to be overwhelmed right now so we can probably take a little time to sort these details out19:21
fricklerwell they aren't gating yet due to CI failures19:21
clarkbah the nova change in the gate is indeed unrelated19:22
fricklerbut yeah, not too urgent currently I'd agree19:22
clarkback I'll bring it up in irc over there tomorrow morning my time as I think that overlaps with kopecmartin and gmann both19:23
clarkb#topic Open Discussion19:23
clarkbThat was all for the agenda I sent out. Definitely feels liek summer :)19:24
clarkbwhen I looked at tonyb's changes for the mediawiki state I noticed that the ansible development testing update stack appears to be getting close19:24
clarkb#link https://review.opendev.org/q/topic:%22ansible-devel%2219:24
clarkbI think we are approaching service coordinator election time as well19:25
clarkbI need to look at old emails and do some date math, but I'll try to have proposals for timing of that at our next meeting19:25
clarkbJust trying to come up with any other info. I'll be out august 6-8 and then I'm traveling to the summit in korea from august 31 to september 5.19:28
clarkbOther than that I expect to be generally around through the end of summer (I may attend FOSSY as well but tahts mostly over a weekend and I haven't decided yet)19:28
clarkbI'll leave things open for a few more minutes but then we can have some time back today19:29
fricklercan we clean up https://zuul.opendev.org/t/openstack/config-errors?project=opendev%2Fbase-jobs&skip=0 or do we need to support older zuuls?19:30
fricklerI guess zuul-jobs needs to be more conservative19:31
clarkbyes we can clean those items up since opendev/base-jobs is specific to our installation19:31
clarkbfrickler: is that something you wanted to do or should someone else write the chagne?19:32
clarkb(it should be a straightforward mvoe of the playbook into the post-run list with the cleanup attribute set19:32
fricklerI would be fine with just reviewing the change if someone wants to propose it19:32
clarkbok I can write that up this afternoon. I'm going to look at the nodepool centos 8 stream stuff too19:33
fricklermainly wasn't sure if it would be blocked by external dependencies like the rdo stuff19:33
clarkbno I don't think it is since each zuul installation should curate their base jobs directly to meet their specific installation needs19:34
frickleroh, that's actually zuul-base-jobs, not zuul-jobs https://zuul.opendev.org/t/openstack/config-errors?project=zuul%2Fzuul-base-jobs&skip=019:35
fricklerso that's only for the zuul tenant in opendev and could also get updated then?19:35
clarkbyes I think so19:35
clarkbbut I'll double check that one before pushing19:36
corvusthe zuul-base-jobs repo is like zuul-jobs, but for base jobs19:36
frickleralso some more in https://zuul.opendev.org/t/zuul/config-errors that might be worth looking at19:36
corvuscan be used directly, but most people don't; more likely used as a starting point.19:36
clarkboh I see19:37
corvusregardless, zuul-base-jobs is not used by opendev19:37
clarkbcorvus: zuul-base-jobs does still produce the deprecation warning we must be loading enough config for it to generate the warning?19:37
clarkbanyway I can update opendev/base-jobs today19:37
clarkbLast call I'll end the meeting at 19:40 if we have nothing else19:38
corvusclarkb: yeah, we just don't *use* it; i think it's shadowed19:38
clarkback19:38
fungithanks clarkb!19:39
clarkband thank you to everyone working on OpenDev19:40
clarkbWe'll be back next week at the same time and location.19:40
clarkb#endmeeting19:40
opendevmeetMeeting ended Tue Jul 23 19:40:15 2024 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:40
opendevmeetMinutes:        https://meetings.opendev.org/meetings/infra/2024/infra.2024-07-23-19.00.html19:40
opendevmeetMinutes (text): https://meetings.opendev.org/meetings/infra/2024/infra.2024-07-23-19.00.txt19:40
opendevmeetLog:            https://meetings.opendev.org/meetings/infra/2024/infra.2024-07-23-19.00.log.html19:40
fungisame bat time, same bat station19:40
fricklero/19:41

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!