Saturday, 2021-04-03

*** hamalq has quit IRC00:01
*** evrardjp has quit IRC01:05
*** evrardjp has joined #zuul01:06
*** evrardjp has quit IRC02:33
*** evrardjp has joined #zuul02:33
*** irclogbot_0 has quit IRC03:20
*** irclogbot_2 has joined #zuul03:25
*** icey has quit IRC05:17
*** icey has joined #zuul05:18
*** ricolin has joined #zuul07:05
*** ianychoi has joined #zuul07:40
*** tosky has joined #zuul09:44
*** ykarel has joined #zuul10:14
*** ykarel_ has joined #zuul10:31
*** ykarel has quit IRC10:34
*** ykarel_ has quit IRC12:24
*** phildawson has joined #zuul14:18
*** phildawson has quit IRC14:22
*** ykarel_ has joined #zuul15:20
*** tosky has quit IRC15:30
*** ykarel_ has quit IRC15:34
funginot debilitating, but i think we may be encountering a regression with our nodepool launchers for the past week16:39
fungii keep finding items hung in pipelines with builds queued indefinitely, some launcher has picked up the node request and either failed or (more rarely) satisfied it but then never unlocked the request. restarting the launcher frees the lock and the request gets picked up by it or some other launcher immediately thereafter16:41
fungiit's happened with several different launchers and providers16:42
fungithere's no obvious error in the logs about it, the launcher just stops short of logging the "Fulfilled node request" line (at least in the cases where it does satisfy the request with a successfully booted node)16:45
funginot really sure how to go about troubleshooting it, since i don't know what conditions are necessary to trigger the problem, though it does seem to come in bursts and happens much more often with boot failures than successes16:48
fungieven the ones which succeed but get stuck seem to have had at least one boot failure and then succeeded on a retry (but still never unlocked the request)16:48
*** leoluk_ has quit IRC18:48
*** leoluk_ has joined #zuul18:50
*** tosky has joined #zuul20:20
*** evrardjp has quit IRC21:52
*** evrardjp has joined #zuul21:52
*** paladox has quit IRC22:04
*** paladox has joined #zuul22:25
*** tosky has quit IRC23:50

Generated by 2.17.2 by Marius Gedminas - find it at!