| *** elodilles is now known as elodilles_pto | 05:18 | |
| mnasiadka | Is there anything bad happening with aarch64 on osuosl nodepool provider? We're getting job time outs after 3 hours of Kolla image build, where usually in the past it finished around ~30 minutes (and 2h 30m in very bad cases - but have no clue why) | 07:07 |
|---|---|---|
| frickler | mnasiadka: yes, I noticed that yesterday already. time to check where exactly things are being slow I guess | 07:13 |
| mnasiadka | thanks | 07:14 |
| frickler | hmm, from some logs I looked at, nothing stands out in particular, just the builds dragging along quite slowly, might be slow disk IO or possibly networking, although the download speeds where they are listed look reasonable | 07:21 |
| frickler | Ramereth: ^^ maybe you are aware of some issue in the osuosl cloud? | 07:21 |
| opendevreview | Benjamin Schanzel proposed zuul/zuul-jobs master: Add build-diskimage role https://review.opendev.org/c/zuul/zuul-jobs/+/922911 | 11:37 |
| opendevreview | Benjamin Schanzel proposed zuul/zuul-jobs master: Add build_diskimage_environment role variable https://review.opendev.org/c/zuul/zuul-jobs/+/926224 | 11:37 |
| opendevreview | Benjamin Schanzel proposed zuul/zuul-jobs master: Add a diskimage-builder job https://review.opendev.org/c/zuul/zuul-jobs/+/926225 | 11:37 |
| opendevreview | Merged openstack/project-config master: Split min ready nodes between jammy and noble https://review.opendev.org/c/openstack/project-config/+/926972 | 11:55 |
| opendevreview | Merged opendev/system-config master: Add inventory entries for new Vexxhost mirrors https://review.opendev.org/c/opendev/system-config/+/925438 | 12:41 |
| opendevreview | Merged opendev/system-config master: Add Rackspace Flex to our OpenStackSDK configs https://review.opendev.org/c/opendev/system-config/+/926943 | 12:41 |
| opendevreview | Merged opendev/system-config master: Set tox-linters job timeout to the default https://review.opendev.org/c/opendev/system-config/+/926958 | 12:41 |
| opendevreview | Merged openstack/project-config master: Retire unmaintained charm repositories https://review.opendev.org/c/openstack/project-config/+/926791 | 13:14 |
| opendevreview | Jeremy Stanley proposed openstack/project-config master: Replace 2024.2/Dalmatian key with 2025.1/Epoxy https://review.opendev.org/c/openstack/project-config/+/927031 | 14:21 |
| fungi | the last deploy run of infra-prod-letsencrypt failed on both new vexxhost mirror instances after 925438 merged: 'letsencrypt_certs' is undefined | 14:36 |
| fungi | tonyb: ^ (it's probably late for you at this point, i'll look into getting any missing bits added so the job succeeds again) | 14:37 |
| fungi | yeah, 925438 is missing the hostvars, i think that's all i need to add | 14:38 |
| corvus | fungi: ++ | 14:39 |
| Ramereth | frickler: we might be hitting some I/O issues but I'm not sure | 14:40 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Add hostvars for new Vexxhost mirrors https://review.opendev.org/c/opendev/system-config/+/927034 | 14:47 |
| Clark[m] | fungi: that change lgtm but having a slow start and not quite to an approve on Gerrit stage yet | 15:17 |
| fungi | i don't think there's any hurry, we have a month before it starts to cause any critical impact | 15:21 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Switch Rackspace Flex authentication to project_id https://review.opendev.org/c/opendev/system-config/+/927048 | 17:04 |
| clarkb | fungi: one question in ^ | 17:07 |
| fungi | clarkb: yeah, i was kinda on the fence about that. from the perspective of the clouds.yaml file and skyline login it's definitely a "password" but from the perspective of how it's generated in the rackspace management dashboard it's an api key | 17:10 |
| fungi | whereas the same value when used to authenticate the classic rackspace cloud is definitely passed as an api_key field (with the rackspaceauth plugin) | 17:12 |
| fungi | i don't feel strongly either way, happy to go with the group's consensus on that | 17:12 |
| clarkb | fungi: I think my concern is more for the humans who might want to reset it being confused as to what goes in that variable | 17:15 |
| clarkb | if we call it a password we could very easily stick the wrong info in there down the road | 17:16 |
| fungi | fair enough. i'll rename it | 17:17 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Switch Rackspace Flex authentication to project_id https://review.opendev.org/c/opendev/system-config/+/927048 | 17:22 |
| fungi | i also spotted a copy/paste error and corrected it | 17:22 |
| fungi | the new entries in our private hostvars have also been updated to match | 17:22 |
| clarkb | you may also need to add those new variables to the test hostvars file so that the files can be templated out in testing | 17:24 |
| clarkb | but this looks fine other than that | 17:24 |
| clarkb | playbooks/zuul/templates/group_vars/nodepool.yaml.j2 and playbooks/zuul/templates/group_vars/control-plane-clouds.yaml.j2 files | 17:26 |
| fungi | yeah, just found them, thanks | 17:26 |
| opendevreview | Jeremy Stanley proposed opendev/system-config master: Switch Rackspace Flex authentication to project_id https://review.opendev.org/c/opendev/system-config/+/927048 | 17:30 |
| opendevreview | Merged opendev/system-config master: Add hostvars for new Vexxhost mirrors https://review.opendev.org/c/opendev/system-config/+/927034 | 17:48 |
| clarkb | the nb04 disk cleanup is in progress but we already have enough free space that the running builds should hopefully start succeeding | 21:32 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!