NeilHanlon | metalink may be helpful to use clarkb; but unfortunately this is an unsolved issue in EL mirroring. even fedora encounters this from time to time | 02:19 |
---|---|---|
NeilHanlon | it maybe makes sense now to make some openinfra mirrors of rocky, perhaps | 02:22 |
opendevreview | Merged zuul/zuul-jobs master: Allow overriding of Bazel installer checksum https://review.opendev.org/c/zuul/zuul-jobs/+/859943 | 05:44 |
frickler | I've paused the rockylinux-9 image now to keep the builders from spinning uselessly, we can retry once in a while | 06:10 |
opendevreview | Merged opendev/system-config master: Disable distro cloud image users more forcefully https://review.opendev.org/c/opendev/system-config/+/860112 | 06:27 |
frickler | looking at AFS stats, I don't think we can set up a new mirror without doing another round of cleanup first https://grafana.opendev.org/d/9871b26303/afs?orgId=1&from=now-6M&to=now | 06:27 |
*** marios is now known as marios|ruck | 06:31 | |
*** jpena|off is now known as jpena | 07:37 | |
*** jpodivin_ is now known as jpodivin | 12:12 | |
*** kopecmartin is now known as kopecmartin|sick | 12:56 | |
*** marios|ruck is now known as marios | 13:31 | |
*** dasm|off is now known as dasm | 13:43 | |
*** Guest2330 is now known as diablo_rojo | 13:46 | |
clarkb | frickler: agreed | 14:06 |
clarkb | NeilHanlon: is there any way to see what is causing the underlying failure? https://nb01.opendev.org/rockylinux-9-0000003632.log shows what we are currently logging. I got discouraged beacuse trying to reproduce by hand by fetching the mirror list then fetching that package on the same build host seems to work fine | 14:07 |
NeilHanlon | we could try removing the mirrorlist and pointing directly to the Rocky Linux CDN. want me to throw in a change which does that for the rocky container image? | 14:44 |
NeilHanlon | clarkb :^^ | 14:44 |
clarkb | NeilHanlon: ya that might be a good place to start. At elast then we'd know exactly what we are talking to? | 14:44 |
clarkb | and if it fails there we have something to pull on | 14:44 |
NeilHanlon | yep. exactly my thought | 14:45 |
opendevreview | Merged openstack/diskimage-builder master: Fix wrong yum.conf name of CentOS 9 Stream https://review.opendev.org/c/openstack/diskimage-builder/+/852408 | 14:50 |
opendevreview | Neil Hanlon proposed openstack/diskimage-builder master: Change rockylinux-9 container to use baseurl instead of mirrorlist https://review.opendev.org/c/openstack/diskimage-builder/+/860428 | 14:52 |
NeilHanlon | i'm running some checks on the rocky mirrors as well to see if I can find the bad mirror(s) | 14:54 |
clarkb | NeilHanlon: thansk! | 14:54 |
opendevreview | Clark Boylan proposed openstack/project-config master: Update OpenDev tenants' default ansible to 6 https://review.opendev.org/c/openstack/project-config/+/860474 | 15:12 |
*** marios is now known as marios|out | 15:17 | |
clarkb | I sent notice of ^ to the service-announce list | 15:22 |
clarkb | I don't really expect problems but wanted to make sure people had pointers to the testing we've done and how to override this if necessary etc | 15:22 |
fungi | i'll give openstack-discuss a heads up with a pointer to that announcement | 16:03 |
fungi | and sent | 16:06 |
corvus | clarkb: you want to merge that tomorrow if no concerns? | 16:21 |
clarkb | yup I think tomorrow works | 16:22 |
corvus | cool | 16:23 |
jrosser_ | fwiw the ansible apt module now tries to be much more specific about the versions of things it installs with ansible-core 2.13.x, which would be part of ansible-6 afaik | 16:37 |
fungi | jrosser_: i'm assuming that's a good thing? | 16:38 |
clarkb | its weird it wouldn't defer that to apt though | 16:38 |
fungi | or are you calling it out as a potentially breaking behavior change for some jobs? | 16:38 |
*** jpena is now known as jpena|off | 16:38 | |
jrosser_ | yes - potentially | 16:38 |
jrosser_ | this is at least fixed now https://github.com/ansible/ansible/pull/78327 | 16:38 |
jrosser_ | where pinning was just ignored, which you'd think was something that the ansible apt module just defered to the system | 16:39 |
clarkb | right, that would've always been my assumption. Apt module lets apt figure it out | 16:39 |
clarkb | interesting that it isn't | 16:39 |
jrosser_ | i think thats been the only breaking thing we've found from the OSA side in ansible-core 2.13.x | 16:40 |
clarkb | we found an issue in zuul-jobs around the interpretation of shebang lines in modules | 16:40 |
clarkb | I filed a bug upstream askign the mto clarify the behavior in the documentation and was basically told no | 16:41 |
clarkb | :/ | 16:41 |
jrosser_ | ah yes right - i think we had one of those too but it only manifested itself on rocky-9 due to some interpreter discovery stuff | 16:41 |
clarkb | tl;dr is that ansible uses the shebang to know what version of python to execute a module under not the specific binary | 16:41 |
clarkb | which is a complete misuse of a shebang imo, but all I really wanted the mto do was document the behavior so we could deal with it | 16:41 |
fungi | rather than relying on the kernel's shebang parsing | 16:41 |
jrosser_ | i believe you don't need them at all | 16:42 |
clarkb | jrosser_: correct that was our solution | 16:42 |
fungi | well, you need them if you want to execute them as scripts | 16:42 |
clarkb | btu also it isn't documented that they are optional. The docs say they are required | 16:42 |
clarkb | I found it all very confusing, but apparently upstream doesn't think so so no docs updates to clarify | 16:42 |
fungi | i should say, if you want an ansible module to also be an executable script without the caller needing to specify the interpreter on their own | 16:43 |
clarkb | at least google should find my issue now helping similarly confused individuals in the future | 16:43 |
jrosser_ | thats kind or orthogonal to some new ansible behviour where it will try many interpreters until it finds one where all the imports work | 16:43 |
fungi | another workaround is to make your own executable wrapper script which imports the module, and then devs can use that for local testing outside ansible | 16:44 |
fungi | but basically ansible and local invocation can no longer share the same entrypoint | 16:44 |
fungi | since the shebang will be parsed by two different incompatible mechanisms | 16:45 |
fungi | you'd think it would have made more sense for ansible to just invent its own magic comment syntax independent of shebang, so that they can coexist independently in the same file | 16:46 |
jrosser_ | it's worth knowing about this as well https://github.com/ansible/ansible/blob/devel/lib/ansible/modules/apt.py#L1235-L1237 | 16:46 |
*** dviroel is now known as dviroel|afk | 21:17 | |
*** dasm is now known as dasm|off | 21:34 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!