Sunday, 2023-06-04

corvusinfra-root: there appears to be an afs-related kernel issue on the new zuul-executors.
corvusi'm going to revert the jammy executor changes so that we'll be back on the focal hosts by monday00:50
opendevreviewJames E. Blair proposed opendev/system-config master: Revert "Replace ze01-ze06"
opendevreviewJames E. Blair proposed opendev/ master: Revert "Replace ze01-ze06"
opendevreviewMerged opendev/ master: Revert "Replace ze01-ze06"
opendevreviewMerged opendev/system-config master: Revert "Replace ze01-ze06"
opendevreviewMerged openstack/project-config master: Add nebulous/zuul-jobs
opendevreviewwaleed mousa proposed openstack/diskimage-builder master: Add nm-dhcp-ib-interfaces element
fricklerit isn't obvious to me why executors need afs. also I'm not 100% convinced that the backtrace is afs-related, though it does sound likely09:24
fungifrickler: jobs doing publication to afs volumes directly from executors rather than creating/revoking temporary permissions for job nodes to do so13:01
corvusthe backtrace happened after the executor process made an afs ioctl and then immediately crashed14:53
corvusthe strace:
opendevreviewJames E. Blair proposed opendev/ master: Update serial on zone file
fungilooks like lunar and mantic have 1.8.9 packaged which we might be able to backport fairly trivially in a ppa if the issue is one that's been fixed upstream15:18
fungisame packages as in debian bookworm and sid15:18
opendevreviewMerged opendev/ master: Update serial on zone file
fungior maybe the changes from 1.8.9 are what's in the -3 update build of 1.8.8 in jammy15:20
fungifocal's on linux 5.4 while jammy is 5.1515:26
fungithere's also apparently openafs 1.9.0 and 1.9.115:36
fungirelease notes for 1.8.8 indicate support for linux kernels up to 5.13:
fungi1.8.9 adds support for up to linux 6.015:45
fungimaybe 1.8.8 simply doesn't work for jammy's linux 5.1515:46
fungiat least the release notes don't say to expect it to work15:47
fungi"Import upstream patches to support linux through 5.18 (Closes: #1010764)"15:48
fungimaybe something else was missed15:48
fungiyeah, debian's 1.8.8-1 build included a patch for linux up to 5.14, 1.8.8-2 improved that, 1.8.8-3 added support for build issues on 5.15, added support for kernels up to 5.16, added support for linux up to 5.18, then for ubuntu's extra revisions on top of that there's support up through linux 5.19 to work with the hwe backport kernel in jammy15:52
fungimaybe we're just hitting a different corner case they haven't accounted for15:53
*** dmellado170 is now known as dmellado1718:52
ianw is surely it; null deref to llseek23:47

Generated by 2.17.3 by Marius Gedminas - find it at!