Friday, 2023-05-12

*** dmellado9 is now known as dmellado04:21
*** yoctozepto is now known as Guest122012:46
*** Guest1220 is now known as yoctozepto12:46
fungigerrit 3.7.3 on its way: https://gerrit-review.googlesource.com/c/homepage/+/373554/5/pages/site/releases/3.7.md13:11
fungijava 11.0.10 is now the minimum (not just 11)13:12
fungiupdates to jgit/bc/compress13:13
opendevreviewMerged openstack/project-config master: Add nebulous/component-template  https://review.opendev.org/c/openstack/project-config/+/88297514:41
clarkbfungi: fwiw I think 3.7.3 is available now. I think we can do an image update via existing docker hub publication if we like. I'll work on a change to update the build shortly (I still need to settle in and load ssh keys etc)15:09
fungiright, we just build from the branch so the changes are already in there if we trigger one, just pointing out the milestone15:26
opendevreviewClark Boylan proposed opendev/system-config master: Rebuild Gerrit imges for Gerrit 3.7.3.  https://review.opendev.org/c/opendev/system-config/+/88307615:29
clarkbfungi: ^ that should do it (this is still on the docker hub side of publications)15:29
clarkbykarel: any indication yet if the vexxhost nested virt nodes are happy?15:51
fungithe gerrit image rebuild seems to have succeeded, and screenshots indicate it's 3.7.316:14
fungiif we want to merge that today and restart gerrit, i'm around to do that16:22
fungiseems to be a pretty quiet friday, so i'm also going to try and take the opportunity to knock out a little yardwork while the weather's nice, but will keep an eye on things16:23
clarkbfungi: I think we can do gerrit if you want to approve the change. Worst case we restart it Monday but we'll have images ready if we merge the chagne today16:25
clarkbI'm going to see if I can make 882977 work on focal and bionic now16:26
fungisounds good. approved 88307616:40
opendevreviewClark Boylan proposed opendev/system-config master: DNM testing sideloading container images  https://review.opendev.org/c/opendev/system-config/+/88297717:01
clarkbthat is a refactor of the proof of concept into something that should look very similar to what we might merge if we go this route17:02
clarkbI'm sure it has bugs after rewriting so much of the idea though so may be a few iterations17:02
clarkbI think it doesn't end up being too hacky after codifying the process in a role17:03
clarkbfungi: there is a post failure on the gerrit image update docs job if yo uhave time to look at that17:05
fungiyep17:07
clarkbthe opendev project afs volume has plenty of room17:07
clarkbwhile I'm thinking baout it I'll push up a change to clean up fedora 37 mirroring since we won't be making images for 3717:07
clarkbit would be 38 and if we do make 38 images Id like to not mirror it17:07
opendevreviewClark Boylan proposed opendev/system-config master: Cleanup fedora mirroring  https://review.opendev.org/c/opendev/system-config/+/88308317:12
clarkbI think ^ will give us a bit of breathing room. Maybe 200GB ish?17:12
fungiclarkb: looks like the post_failure was a spontaneous ssh disconnect while pulling logs from the job node via rsync17:19
fungihttps://zuul.opendev.org/t/openstack/build/face6dd517f9492090b6eb4576882f4b/console#4/0/3/ubuntu-jammy17:20
clarkbprobably fine to recheck then17:20
fungiyeah, once it finishes the other jobs and reports17:21
fungiwill do17:21
opendevreviewClark Boylan proposed opendev/system-config master: DNM testing sideloading container images  https://review.opendev.org/c/opendev/system-config/+/88297717:28
opendevreviewClark Boylan proposed opendev/system-config master: DNM testing sideloading container images  https://review.opendev.org/c/opendev/system-config/+/88297717:52
opendevreviewClark Boylan proposed opendev/system-config master: DNM testing sideloading container images  https://review.opendev.org/c/opendev/system-config/+/88297719:15
clarkbthat fixes a few minor things and adds a bit more debugging. I think this is working but want to be sure19:15
clarkbI think I'm happy with 882977 now. Its fairly generic if we want to apply that everywhere and the extra debug info shows that it appears to do what we want19:50
fungizuul says we have another 20 minutes before the gerrit image rebuild tries to merge again19:52
fungibut at least the docs job worked this time19:52
fungiducks are coming right up to the patio where i'm resting in the shade. they don't seem to care about the rock music i'm blaring19:53
fungii think they're more concerned about the geese monopolizing the other end of the yard19:54
opendevreviewMerged opendev/system-config master: Rebuild Gerrit imges for Gerrit 3.7.3.  https://review.opendev.org/c/opendev/system-config/+/88307620:01
fungiclarkb: i got the deploy report for that ^ prior to the promote report... is that okay? deploy uses a tag that gets (re)set by promote, yeah?20:14
fungii mean, we can just pull anyway, but wondering if that's intended behavior20:14
clarkbfungi: if you look at the jobs promote does docs updates and deploy updates the images in docker hub20:15
clarkbfungi: we don't auto pull and restart gerrit on image updates because it is disruptive so we have to do it manually20:15
clarkb"we can just pull anyway" is actually what we need to do20:15
clarkb(we do image promotions in deploy to ensure order between containers promoting and the deployments updating so this is normal and expected)20:16
clarkbanyway I'm around now if you want to do the docker-compose pull and docker-compose down and docker-compose up -d20:16
clarkbremember to do it from iside the docker compose config dir as there may be configs that it loads from relative paths (I'm pretty sure gerrit doesn't but it is a good habit to form)20:17
clarkbsince replication task cleanups haven't landed we should expect a large quantity of errors at startup. This is "normal"20:18
fungioh, got it, so the uploads for these are in deploy not in gate20:36
fungiyeah, i'm back again. was wrapping up yardwork real quick20:36
fungiworking on it now20:36
* clarkb is around and watching too. But will need to step out for yard work here as well20:37
clarkbI'll wait for gerrit to be happy before doing that20:38
fungiopendevorg/gerrit   3.7       90cc4cec43ba   About an hour ago   790MB20:38
fungimariadb             10.6      73d5a1792895   22 hours ago        395MB20:38
clarkbyup both have had updates since our last pull20:38
fungithink we should status notice the blip?20:39
clarkbcan't hurt20:39
fungi#status notice The Gerrit service on review.opendev.org will be offline briefly for a patchlevel update, but should return to service in a few minutes20:39
opendevstatusfungi: sending notice20:39
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org will be offline briefly for a patchlevel update, but should return to service in a few minutes20:40
fungii'll down it in a sec once that's hit a few more channels20:40
opendevstatusfungi: finished sending notice20:42
fungidown it goes20:43
fungiand coming back up now20:43
clarkbas expected we are getting many many errors about replication tasks20:43
fungiwebui is loading for me20:43
clarkbI'm even more confident today than last time we debugged this that this is a non issue20:43
fungiPowered by Gerrit Code Review (3.7.3-2-gedf6d84f5d-dirty)20:44
clarkbI do think we should spot check replication of some sort has succeeded but otherwise I think this is looking good20:44
clarkbyup loads for me as well20:44
clarkbI'm doing a git clone against gerrit (something we ask most people not to do) and it seems to work so I Think the jgit updtes are looking ok20:49
clarkbpushing a change and checking it replicates are probably the only other things to check. I don't have any changes on tap for that unfortunately. Do you?20:50
fungii was just looking for one20:50
fungiclarkb: want to approve https://review.opendev.org/882161 maybe?20:51
fungiwe can see if that replicates on merge20:51
clarkbdone. The gitea jobs aren't quick though so will be a little bit20:52
fungiyeah, seems like we have no real urgency though20:52
clarkbok I'm going to take a break now to get outside and get some stuff done. I'll check back in later20:56
fungisounds like a good idea. i'm going to cook dinner but will keep an eye on everything20:57
opendevreviewMerged opendev/system-config master: Fix mistyped gitea screenshot image name  https://review.opendev.org/c/opendev/system-config/+/88216122:04
clarkbthat replicated. All looks well on that front22:53

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!