Thursday, 2022-10-20

-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul-jobs] 861924: stage-output: use links in docs https://review.opendev.org/c/zuul/zuul-jobs/+/86192400:07
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 861947: Serve all paused handlers before unpausing https://review.opendev.org/c/zuul/nodepool/+/86194708:02
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 861947: Serve all paused handlers before unpausing https://review.opendev.org/c/zuul/nodepool/+/86194708:13
-@gerrit:opendev.org- Zuul merged on behalf of Benedikt Löffler: [zuul/nodepool] 860470: Cleanup local builds without .d folder https://review.opendev.org/c/zuul/nodepool/+/86047008:35
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 861947: Serve all paused handlers before unpausing https://review.opendev.org/c/zuul/nodepool/+/86194709:55
-@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 861947: Serve all paused handlers before unpausing https://review.opendev.org/c/zuul/nodepool/+/86194710:07
-@gerrit:opendev.org- Thomas Cardonne proposed wip: [zuul/zuul] 862134: [DNM] TEST zuul_stream: close streamer when task is skipped https://review.opendev.org/c/zuul/zuul/+/86213412:42
-@gerrit:opendev.org- Thomas Cardonne proposed wip: [zuul/zuul] 862134: [DNM] TEST zuul_stream: close streamer when task is skipped https://review.opendev.org/c/zuul/zuul/+/86213413:03
@jim:acmegating.comAnyone know if Thomas Cardonne is on matrix?13:58
-@gerrit:opendev.org- Thomas Cardonne proposed wip: [zuul/zuul] 862134: [DNM] TEST zuul_stream: close streamer when task is skipped https://review.opendev.org/c/zuul/zuul/+/86213414:24
@jim:acmegating.comI emailed them to try to understand what's going on with ^14:26
-@gerrit:opendev.org- Thomas Cardonne proposed wip: [zuul/zuul] 862134: [DNM] TEST zuul_stream: close streamer when task is skipped https://review.opendev.org/c/zuul/zuul/+/86213414:46
-@gerrit:opendev.org- Thomas Cardonne proposed wip: [zuul/zuul] 862134: [DNM] TEST zuul_stream: close streamer when task is skipped https://review.opendev.org/c/zuul/zuul/+/86213415:20
@newbie2024:matrix.orgHi guys,16:38
here is a newbie question.
I would like to trigger some actions when "a pipeline starts" (i.e. when the first job for a certain pipeline is about to start) and when "a pipeline ends" (the last job of a certain pipeline finished).
I could think of the following:
- add some pre-pipeline and post-pipeline job, make all the job depend from the pre-pipeline (is that even possible without adding a lot of dependencies: directives?), make post-pipeline depend on all jobs (sounds like a nightmare to maintain even if it works
- configure some reporter like MQTT to report when a pipeline start/end
@newbie2024:matrix.orgAny suggestions on how to approach this?16:38
@avass:vassast.orgnewbie2024: i think i would likely use mqtt to make sure it doesn't affect jobs. But of course it depends on what you're trying to achieve 16:46
@avass:vassast.orgIt also decouples zuul from the service carrying out the actions so it's easier to hook up other services in the future if they need to listen to events from zuul16:49
@newbie2024:matrix.org> <@avass:vassast.org> It also decouples zuul from the service carrying out the actions so it's easier to hook up other services in the future if they need to listen to events from zuul17:00
The idea is to collect some metrics about pipelines.
I read latest and greatest version of Zuul come with nice Prometheus and Statd metrics, but 1. in the short term a Zuul upgrade is not an option and 2. not totally sure you get that granularity level that allow you to monitor pipeline latency, etc.
@avass:vassast.orgnewbie2024: yup we used mqtt to collect metrics as well17:02
@newbie2024:matrix.org> <@avass:vassast.org> newbie2024: yup we used mqtt to collect metrics as well17:14
Got it, thanks!
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 861797: DNM checking docker image builds https://review.opendev.org/c/zuul/nodepool/+/86179717:24
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 861797: DNM checking docker image builds https://review.opendev.org/c/zuul/nodepool/+/86179718:34
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/nodepool] 861797: DNM checking docker image builds https://review.opendev.org/c/zuul/nodepool/+/86179721:10
@jim:acmegating.comi believe https://bugs.launchpad.net/ubuntu/+source/git/+bug/1993586 is affecting us; a local test run just failed with that21:20
@jim:acmegating.comi think the workaround described in that bug report will probably work for us in the unit test, so i'll work on adding that21:21
@jim:acmegating.com(it fails tests.unit.test_merger_repo.TestMergerRepo.test_ensure_cloned but i suspect the issue is related strictly to our unit test framework)21:22
@clarkb:matrix.orgfwiw I think that may be affecting the pip tests too21:26
@jim:acmegating.comi just need to figure out how to get a "-c" into the git command :)21:28
@clarkb:matrix.orgI wonder what symlinks we've got?21:34
@clarkb:matrix.orgseems like not having symlinks might be a good way to avoid this, but maybe they are there by default? I think HEAD for example is a symlink? so maybe the distinction in the git update isn't really helpful21:34
@iwienand:matrix.orgafter more than a bit of head-scratching, i think i've narrowed down our zuul-jobs documentation issues to probably a docutils bug with the way it detects recursive includes21:38
@iwienand:matrix.orghttps://paste.opendev.org/show/brTxHYllHebBIs1wHbfM/21:38
@iwienand:matrix.org^ before i send it ... do we feel like that is understandable as a replication?21:38
@clarkb:matrix.orgianw: I haevn't followed that as I'ev been distracted so my input isn't super helpful. But you might want to have an assert or similar in that script to show what you expect the behavior to be and call out how it is buggy?21:41
@iwienand:matrix.orgoh sorry, yeah the bug is that this fails with a warning that there is a recursive include, which i don't believe there is21:41
@jim:acmegating.comClark: we don't have symlinks, we have a git submodule with a file:// prefix which is no longer allowed by default21:45
@jim:acmegating.comianw: looks comprehensible :)21:46
@clarkb:matrix.orgoh! I see21:46
@clarkb:matrix.orgsymlinks in objects is another way to trip this I guess21:46
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:21:49
- [zuul/zuul] 862192: Fix test_ensure_cloned after git CVE-2022-39253 https://review.opendev.org/c/zuul/zuul/+/862192
- [zuul/zuul] 862193: Fix implied branch matchers and override-checkout https://review.opendev.org/c/zuul/zuul/+/862193
@jim:acmegating.comClark: yeah, i think either way would do it.21:49
@jim:acmegating.comthere's the magic incantation to gitpython to fix that.21:50
@jim:acmegating.comzuul-maint: https://review.opendev.org/862192 is necessary to unblock zuul tests due to a git CVE21:50
@jim:acmegating.comzuul-maint: https://review.opendev.org/860989 is the next change needed for 8.0.021:51
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 862194: Defensively handle null JobData hashes https://review.opendev.org/c/zuul/zuul/+/86219421:57
@iwienand:matrix.org> <@iwienand:matrix.org> ^ before i send it ... do we feel like that is understandable as a replication?22:31
https://sourceforge.net/p/docutils/bugs/459/
@jim:acmegating.comwhen it rains it pours... now there's something with jwt22:52
@jim:acmegating.comi'm trying to track down what changed22:52
@jim:acmegating.compyjwt 2.5.0 .. 2.6.022:56
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:23:01
- [zuul/zuul] 862192: Fix test_ensure_cloned and JWT tests https://review.opendev.org/c/zuul/zuul/+/862192
- [zuul/zuul] 862193: Fix implied branch matchers and override-checkout https://review.opendev.org/c/zuul/zuul/+/862193
@jim:acmegating.comClark: tristanC ^ 862192 is updated with a second urgent fix23:02
@jim:acmegating.com(if anyone has time to look into/fix the pyjwt issue and unpin, feel free!)23:02

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!