Sunday, 2021-12-12

*** sshnaidm|afk is now known as sshnaidm12:49
*** odyssey4me is now known as Guest830920:37
ianwfungi: good catch; looks like there is something up with the job22:06
ianwThe task includes an option with an undefined variable. The error was: 'ansible.vars.hostvars.HostVarsVars object' has no attribute 'letsencrypt_certcheck_domains'22:08
clarkbianw: Ithink that happens if it bails out early elsewhere? Becusae that var is set by running the stuff to set up le domains22:09
ianwyeah, i think so too22:09
clarkbeg there may be another earlier error22:09
ianwi think [mirror01.regionone.limestone.opendev.org] might be the issue22:09
clarkbah I had to reboot it about a week ago. I wonder if it is down again22:10
clarkbmaybe put it in emergency?22:10
ianwhrm, it seems up now22:10
ianwRunning 2021-12-06T23:35:52Z22:11
ianwmaybe i'm looking at the wrong logs22:12
ianwi'm not, and i suspect another of my "no-op" changes to the job layout has been a little less than no-op :/22:13
ianwperiodic appears to not be running22:30
ianwit's all jobs; not just infra-prod jobs, e.g. https://zuul.opendev.org/t/openstack/build/7dbe6bebea344eb893347bc733f55c29 (developer-openstack-goaccess-report) not running either22:31
ianwwhich suggests to me a configuration error, but i'm not sure where the notification is22:32
ianwdebug.log.12.gz:2021-11-30 02:02:31,238 DEBUG zuul.Pipeline.openstack.periodic: [e: 71eaeb5c330145d382efcfd765313b7c] <QueueItem b36e20e6ba614d6cb24abf4ea13f2f72 for <Branch 0x7f550dc184f0 opendev/system-config refs/heads/master updated None..None> in periodic> is a failing item because ['it has an invalid configuration']22:54
ianwthat is the next day.  but that might be in the period clarkb/fungi were fixing the original errors.  22:55
ianw2021-12-10 02:02:41,564 DEBUG zuul.Pipeline.openstack.periodic: [e: 6745d4c7473047f69964e816afcaaec6] <QueueItem 0b84a8c775964ce3af4e487283c6a073 for <Branch 0x7fb68fb101c0 opendev/system-config refs/heads/master updated None..None> in periodic> is a failing item because ['it has an invalid configuration']22:58
ianwthat seems to be the most recent one22:58
ianwahh!23:00
ianwException: Job infra-prod-service-zookeeper depends on system-config-promote-image-zookeeper-statsd which was not run.23:00
ianwthis would have been easier to pick out of the logs if the exception lines were prefected with the e: event too23:01
ianwi swear i had a change that did that somewhere23:02

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!