| opendevreview | Merged opendev/system-config master: Add Noble packages to Docker mirror https://review.opendev.org/c/opendev/system-config/+/926861 | 00:45 |
|---|---|---|
| fungi | deploy just reported success | 00:49 |
| fungi | looking at the server now | 00:49 |
| fungi | cronjob won't run again for about another 1.5 hours so i'll take the lock and run it manually | 00:51 |
| fungi | worked, no errors, i see the expected content in /afs/openstack.org/mirror/deb-docker/noble/ now, dropping my lock | 00:56 |
| fungi | i've rechecked 926864 to see if it will pass now | 00:59 |
| opendevreview | Merged opendev/system-config master: Run opendev-buildset-regitry on Noble https://review.opendev.org/c/opendev/system-config/+/926864 | 01:15 |
| opendevreview | James Page proposed openstack/project-config master: Retire unmaintained charm repositories https://review.opendev.org/c/openstack/project-config/+/926791 | 07:24 |
| opendevreview | Elod Illes proposed openstack/project-config master: [release-tool] Workaround for getting dist_name https://review.opendev.org/c/openstack/project-config/+/926885 | 09:28 |
| opendevreview | Merged openstack/project-config master: [release-tool] Workaround for getting dist_name https://review.opendev.org/c/openstack/project-config/+/926885 | 11:11 |
| frickler | infra-root: someone may want to look into the check-arm64 pipeline, it has a backlog of 22h currently | 11:52 |
| Clark[m] | frickler: Iooking at grafana we are at capacity for the remaining arm64 cloud. That couple with the large number of presumably long running Kolla jobs (that are also timing out) in particular mean our capacity is being consumed leading to backlogs. We may need to double check that we don't have any nodes in a weird state but this appears to be an issue of lack of vapacity | 14:08 |
| opendevreview | Merged zuul/zuul-jobs master: Update test-prepare-workspace-git to use a module https://review.opendev.org/c/zuul/zuul-jobs/+/925539 | 15:06 |
| clarkb | wow we had no flake8 errors in https://review.opendev.org/c/opendev/system-config/+/926863 just a few warnings. | 15:14 |
| opendevreview | Tristan Cacqueray proposed zuul/zuul-jobs master: ensure-docker: extract the restart procedure in a task file https://review.opendev.org/c/zuul/zuul-jobs/+/926931 | 15:40 |
| opendevreview | Tristan Cacqueray proposed zuul/zuul-jobs master: ensure-docker: extract the restart procedure in a task file https://review.opendev.org/c/zuul/zuul-jobs/+/926931 | 16:01 |
| opendevreview | Tristan Cacqueray proposed zuul/zuul-jobs master: ensure-docker: extract the restart procedure in a task file https://review.opendev.org/c/zuul/zuul-jobs/+/926931 | 16:36 |
| clarkb | infra-root on I've put new rax cloud region info in bridge:~clarkb/new_rax_info | 18:01 |
| fungi | thanks! | 18:02 |
| clarkb | the tldr is that they are basically building out a new generation of openstack cloud infrastructure there and our existing credentials should work. We just have to talk to a different keystone. They think we can go ahead and get started with the nodepool use case and while quota may be a bit limited to start their intent is to be able to grow that as capacity increases in the cloud | 18:02 |
| clarkb | region | 18:02 |
| clarkb | I couldn't come up with any real concerns and they are excited for our feedback | 18:03 |
| fungi | i can get the new endpoint integrated into our clouds.yaml templates, unless you're already working on that | 18:04 |
| clarkb | fungi: I was not. I think my focus is more likely to be on noble things and summit prep. I would say go for it | 18:05 |
| fungi | quick temperature check... we currently have openstackci-rax and openstackjenkins-rax, should i make the new providers opendevci-rax and opendevzuul-rax on the assumption we'll be slowly migrating to these in the future, or opendevci-raxflex and opendevzuul-raxflex to make it clear it's a different environment, or... | 18:11 |
| clarkb | fungi: I like opendev*-raxflex because the environment behaves differently to the existing rax envs | 18:11 |
| fungi | k | 18:12 |
| clarkb | I think it will be easier to logically separate the behavior differences in config that way | 18:12 |
| clarkb | heh we got a phishign email about rax stuff just a few minutes ebfore I posted this info | 18:16 |
| clarkb | for a second there I wondered if people were monitoring this channel to send that stuff but the timing doesn't work out for that | 18:17 |
| clarkb | (I didn't click on anything in that email but did read it) | 18:17 |
| frickler | fungi: did you see https://www.chiark.greenend.org.uk/~sgtatham/quasiblog/code-review-antipatterns/ ? kind of resonates with your recent mail on that topic | 18:19 |
| frickler | also nice to see something real from rax, will take a closer look tomorrow | 18:23 |
| fungi | frickler: i had not! looks like a nice and instructive bit of satire | 18:29 |
| fungi | yes, now that i'm through it, definitely worth the read. thanks for pointing it out! | 18:41 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Add Rackspace Flex to our OpenStackSDK configs https://review.opendev.org/c/opendev/system-config/+/926943 | 18:54 |
| opendevreview | Maksym Medvied proposed openstack/project-config master: Mirror charm-ceph-nfs to GitHub https://review.opendev.org/c/openstack/project-config/+/926949 | 19:18 |
| *** melwitt is now known as jgwentworth | 19:38 | |
| *** jgwentworth is now known as melwitt | 19:38 | |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Update ensure-kubernetes with podman support https://review.opendev.org/c/zuul/zuul-jobs/+/924970 | 19:41 |
| clarkb | fungi: my comment on 926943 is what I assume the problem with CI is. Also any chance you tested this yet? I guess its harmless to add then test. Mostly wondering about the insecure ssl flag and if we actually need that or not | 19:47 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Fix k8s-crio buildset registry test https://review.opendev.org/c/zuul/zuul-jobs/+/926013 | 19:49 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Update ensure-kubernetes with podman support https://review.opendev.org/c/zuul/zuul-jobs/+/924970 | 19:49 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Fix k8s-crio buildset registry test https://review.opendev.org/c/zuul/zuul-jobs/+/926013 | 19:51 |
| opendevreview | Jan Gutter proposed zuul/zuul-jobs master: Update ensure-kubernetes with podman support https://review.opendev.org/c/zuul/zuul-jobs/+/924970 | 19:51 |
| opendevreview | Tristan Cacqueray proposed zuul/zuul-jobs master: ensure-docker: extract the restart procedure in a task file https://review.opendev.org/c/zuul/zuul-jobs/+/926931 | 19:51 |
| fungi | clarkb: oh, thanks! | 20:17 |
| fungi | and yeah, i haven't tested it yet, was just going by what was in the snippet they had provided, i'll check the cert on the endpoint | 20:18 |
| fungi | indeed, looks like they have a let's encrypt cert on it | 20:20 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Add Rackspace Flex to our OpenStackSDK configs https://review.opendev.org/c/opendev/system-config/+/926943 | 20:20 |
| clarkb | following up on the arm64 issues at least one kolla job is timing out after 3 hours | 20:28 |
| clarkb | so each of those jobs is consuming one node (I checked it isn't multinode) for 3 hours and our total node capacity is ~20? | 20:29 |
| clarkb | maybe someone that understands those jobs and their logs can look at where the time is lost so we can better understand the timeouts | 20:29 |
| opendevreview | Merged opendev/system-config master: Run tox-linters on Noble https://review.opendev.org/c/opendev/system-config/+/926863 | 20:32 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Set tox-linters job timeout to the default https://review.opendev.org/c/opendev/system-config/+/926958 | 20:33 |
| clarkb | frickler: ^ there is the suggested timeout cleanup for the tox-linters job in system-config | 20:33 |
| opendevreview | Merged openstack/project-config master: Mirror charm-ceph-nfs to GitHub https://review.opendev.org/c/openstack/project-config/+/926949 | 20:41 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Add Rackspace Flex to our OpenStackSDK configs https://review.opendev.org/c/opendev/system-config/+/926943 | 21:54 |
| opendevreview | Clark Boylan proposed openstack/project-config master: Split min ready nodes between jammy and noble https://review.opendev.org/c/openstack/project-config/+/926972 | 23:12 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!