| frickler | fwiw I'm +1 on the switch to noble, I wouldn't even have waited that long, but it shouldn't hurt, either | 03:49 |
|---|---|---|
| frickler | corvus: clarkb: fungi: please check https://review.opendev.org/c/openstack/project-config/+/923639, I'm not sure if this could actually work from a zuul perspective | 06:16 |
| opendevreview | Merged openstack/project-config master: Migrate release-openstack-puppet to jammy https://review.opendev.org/c/openstack/project-config/+/925986 | 06:21 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Fix k8s-crio buildset registry test https://review.opendev.org/c/zuul/zuul-jobs/+/926013 | 09:22 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Update ensure-kubernetes with podman support https://review.opendev.org/c/zuul/zuul-jobs/+/924970 | 09:22 |
| opendevreview | Jens Harbott proposed openstack/project-config master: Update update-constraints job and script https://review.opendev.org/c/openstack/project-config/+/926405 | 10:23 |
| Clark[m] | frickler: yes, I think you need two different job names | 14:36 |
| fungi | i was wondering the same, pretty sure modern zuul will "deduplicate" those and just run one of them | 14:37 |
| corvus | same name, same job. that kind of construction would make sense for different branches, but they both say master. so that's just going to merge the definition and effectively only do the second thing. | 14:42 |
| Clark[m] | fungi: corvus acked 925549 if you want to approve it now. I've also got some zuul-jobs change that can be rechecked to test it after it lands. | 14:43 |
| fungi | will do | 14:43 |
| fungi | fire in the hole | 14:44 |
| Clark[m] | I've also got that Gerrit image upgrade change if we want to try and get that done soon. Other than that I'm mostly planning to keep poking at zuul quick start and prep for my zuul beginners talk for the summit | 14:44 |
| fungi | i'm semi-distracted through the rest of this week so can't promise to be around at specific times, but am generally in favor of moving ahead with that asap | 14:45 |
| opendevreview | Merged opendev/base-jobs master: More improvement to base-test cleanup and post playbooks https://review.opendev.org/c/opendev/base-jobs/+/925549 | 14:47 |
| Clark[m] | fungi: I should be around today and tomorrow if you think there is a good chance you'll have time to be a second set of eyes over these two days maybe we just go ahead and approve the image rebuilds then do a restart when convenient? | 14:52 |
| fungi | yeah, i mean any time is fine. i'm mostly just sitting here trying to get random stuff done, but don't know when i'll get interrupted or need to run errands on short notice | 14:55 |
| clarkb | https://review.opendev.org/c/opendev/system-config/+/926075 is the change in question if anyone else wants to review it (fungi already did) | 14:57 |
| clarkb | I have rechecked https://review.opendev.org/c/zuul/zuul-jobs/+/680178 to exercise the base-test updates in 925549 | 14:58 |
| clarkb | fungi: if no one else reviews it in the next hour or so I think we go ahead and approve it then do a restart when you feel is a good time and if you have to run that should be fine I'll be around | 14:59 |
| fungi | sounds good to me, yep | 14:59 |
| clarkb | https://zuul.opendev.org/t/zuul/build/801a5aeb2e94439e98218afefdcdb93e/log/job-output.txt#1690-1700 shows the debugging info collected in post | 15:27 |
| clarkb | I think this is working as expected. https://review.opendev.org/c/opendev/base-jobs/+/924787/5 is the followup to make all the changes (this last one to base-test and the previous one that ended getting revised in the last change) to base and base-minimal so it has a better overview of all the changes | 15:28 |
| clarkb | https://zuul.opendev.org/t/zuul/build/801a5aeb2e94439e98218afefdcdb93e/log/job-output.txt#1710-1711 you can also see the ssh key cleanup here since we move that into a cleanup playbook that runs prior to the post logs playbook | 15:29 |
| clarkb | so ya I think this is working as expected | 15:29 |
| fungi | awesome | 15:30 |
| fungi | agreed, lgtm | 15:30 |
| fungi | i guess that means we can go ahead with the base/base-minimal versions | 15:31 |
| clarkb | yup I think so | 15:31 |
| clarkb | fungi: should we +A https://review.opendev.org/c/opendev/base-jobs/+/924787/5 ? not sure if you wanted to wait for anything else on that | 15:45 |
| fungi | ah, yep i missed that there was another +2 on it | 15:45 |
| fungi | looks like we voted within a few seconds of one another | 15:46 |
| clarkb | oh heh I missed that | 15:46 |
| opendevreview | Merged opendev/base-jobs master: Update cleanups for base and base-minimal https://review.opendev.org/c/opendev/base-jobs/+/924787 | 15:50 |
| clarkb | now we want for a new change to be pushed to confirm we didn't break everything :) | 15:51 |
| clarkb | https://zuul.opendev.org/t/openstack/stream/c95330d59c6d448ab177ebed54d47e85?logfile=console.log and https://zuul.opendev.org/t/openstack/stream/a5c67a9b036b4079bcb7c56f9fa79dd1?logfile=console.log should use the new base job | 15:52 |
| clarkb | seems to be happy so far | 15:58 |
| clarkb | jobs are passing and logs are uploading properly and I see what I expect in the log around debug logging and ssh key removal | 15:59 |
| clarkb | I have approved the gerrit 3.9.6 image update chaneg | 16:59 |
| fungi | thanks! | 16:59 |
| clarkb | I'll let the opensatck release team know that we are likely to do a gerrit update later today | 16:59 |
| opendevreview | Merged opendev/system-config master: Update Gerrit image to 3.9.6 https://review.opendev.org/c/opendev/system-config/+/926075 | 18:07 |
| clarkb | fungi: ^ things are quiet now in zuul. I should be able to do the upgrade nowish or after lunch. Not sure what your end looks like | 18:09 |
| clarkb | image promotion completed successfully. Now just waiting on the other jobs to complete | 18:12 |
| fungi | clarkb: now looks good. i see you already mentioned it in #openstack-release too | 18:19 |
| clarkb | cool lets do it as soon as this infra-prod-service-review job ends | 18:20 |
| clarkb | I'll let them know were going to do it shortly | 18:20 |
| fungi | sounds good to me | 18:20 |
| clarkb | I've started a root screen on review02 | 18:21 |
| clarkb | job is done. I'll proceed with a docker-compose pull, docker-compose down, mv of the waiting queue then a docker-compose up -d | 18:22 |
| clarkb | opendevorg/gerrit 3.9 0ae4f36bf776 is what we are running now | 18:23 |
| clarkb | and mariadb 10.11 3a30d8fce9ce. I expect both to update as part of this update | 18:23 |
| clarkb | hrm the 3.9 image did not update | 18:24 |
| clarkb | so now I'm wondering what the promote promoted | 18:24 |
| clarkb | docker hub confirms. I think this is the issue where if you don't modify the docker file you don't get a promoted image | 18:25 |
| clarkb | and now I feel silly baceuse this isn't the first time we have run into this | 18:25 |
| * clarkb writes a new change | 18:25 | |
| clarkb | we promoted image base but not the two child images for 3.9.6 and 3.10.1 | 18:26 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Force a rebuild of Gerrit images https://review.opendev.org/c/opendev/system-config/+/926424 | 18:27 |
| clarkb | fungi: corvus ^ fyi | 18:27 |
| fungi | oh, hah | 18:27 |
| clarkb | anyway I'm still good with proceeding later today after that lands and promotes. Apologies for the extra round trip | 18:29 |
| clarkb | also note I did run docker-compose pull which updated the mariadb image. This should be fine though as other service auto update mariadb without issues | 18:29 |
| clarkb | I expect that this round of rebuilds will conclude not too long after my local lunch hour so that works out reasonably well for me | 18:34 |
| * clarkb figures out lunch while waiting | 18:39 | |
| fungi | yep, no worries, i'll probably be around | 18:40 |
| clarkb | we are about 20 minutes away from that change merging | 20:18 |
| clarkb | then a few minutes for the deploy and promotion jobs to run and we should be in a good spot to try the restart again | 20:19 |
| fungi | i'm semi-around | 20:34 |
| opendevreview | Merged opendev/system-config master: Force a rebuild of Gerrit images https://review.opendev.org/c/opendev/system-config/+/926424 | 20:41 |
| clarkb | the promote jobs list looks better this time | 20:42 |
| clarkb | https://hub.docker.com/r/opendevorg/gerrit/tags shows an updated image | 20:42 |
| clarkb | I'm going to proceed now with the same plan as before since zuul appears quiet | 20:43 |
| clarkb | opendevorg/gerrit 3.9 d78266d324d0 36 minutes ago 694MB <- that looks much better | 20:44 |
| clarkb | there is an stx/config change in the gate that should merge momentarily. I'll stop gerrit once that is out of the gate | 20:44 |
| clarkb | and that is done. proceeding now | 20:46 |
| clarkb | "Gerrit Code Review 3.9.6-1-gdd52425b9a-dirty ready" says the log | 20:48 |
| clarkb | web is loading for me but still waiting on diffs to show up | 20:48 |
| clarkb | I get diffs now | 20:50 |
| clarkb | anyone need to push a new change or a new patchset to an existing change? I think confirming that works and then also replication are the last major things I'd like to check | 20:50 |
| fungi | stepped away for a sec but back again | 20:51 |
| fungi | looking good so far | 20:51 |
| clarkb | corvus looks like you need a new ps on https://review.opendev.org/c/zuul/zuul-jobs/+/926224 ? | 20:52 |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Add build_diskimage_environment role variable https://review.opendev.org/c/zuul/zuul-jobs/+/926224 | 20:52 |
| opendevreview | James E. Blair proposed zuul/zuul-jobs master: Add a diskimage-builder job https://review.opendev.org/c/zuul/zuul-jobs/+/926225 | 20:52 |
| fungi | and there we go! | 20:52 |
| clarkb | cool now to check replications of that change | 20:52 |
| clarkb | I just have to remember how to fetch those refs first | 20:53 |
| fungi | easiest way is to just checkout the sha from the origin remote | 20:53 |
| clarkb | I did git fetch origin refs/changes/24/926224/2 and git origin is https://opendev.org/zuul/zuul-jobs. That succeeded and git show FETCH_HEAD gives me a sha that matches the one in gerrit for ps2 | 20:54 |
| corvus | clarkb: lol i was working on that and away from matrix; just reading msgs now :) | 20:54 |
| clarkb | so I think replication is also happy. corvus it was a helpful coincidence then :) | 20:55 |
| fungi | yep, replication lgtm | 20:55 |
| clarkb | I think those two patchsets confrimed the last major items I wanted to check after the update | 20:55 |
| clarkb | not hearing any complaints I'm going to go ahead and close the screne now | 22:21 |
| clarkb | *screen | 22:21 |
| fungi | thanks! | 22:54 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!