| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 938092: Add disambiguator to k8s/openshift resources https://review.opendev.org/c/zuul/nodepool/+/938092 | 01:22 | |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 940650: Launcher: continue processing nodes during nodescan https://review.opendev.org/c/zuul/zuul/+/940650 | 02:18 | |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 940751: Fix error with empty nodeset request https://review.opendev.org/c/zuul/zuul/+/940751 | 14:54 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 940824: Use niz nodes for unit tests https://review.opendev.org/c/zuul/zuul/+/940824 | 19:16 | |
| @chaos2022:matrix.org | Hey everyone! I'm **new to Zuul** and am trying to migrate some of our jenkins jobs. I'm having issues w/ how artifacts are passed between jobs? What's the standard way to do that w/ Zuul? I've tried looking at the "Job Content" docs and messed around w/ the `zuul_return` task but I haven't quite figured out how to use it correctly. | 19:44 |
|---|---|---|
| For context, I have 2 jobs that live in jenkins right now. Let's call them 'build-product' and 'test-product'. The 'build-product' does as the name implies and builds the product which produces a sys.bin file. Is there an "artifacts" directory I can place this file? What's the "Zuul" way to pass off this file to my 'test-product' job? | ||
| Many thanks! | ||
| @clarkb:matrix.org | In general your jobs are responsible for stashing the artifact somewhere (like object store, file server, of package repo) and the zuul_return returns a pointer to that info | 19:45 |
| @fungicide:matrix.org | chaos2022: if it helps to look at a working example, our zuul-nox-docs job is a pretty straightforward one | 19:45 |
| @clarkb:matrix.org | * In general your jobs are responsible for stashing the artifact somewhere (like object store, file server, or package repo) and the zuul_return returns a pointer to that info | 19:46 |
| @chaos2022:matrix.org | Alex DuPree: Okay that's great. A working example is just what I need. Much appreciated! | 19:46 |
| @fungicide:matrix.org | chaos2022: expand the first post playbook in https://zuul.opendev.org/t/zuul/build/aef7193c257e49508606b1ccb461b4ec/console | 19:47 |
| @chaos2022:matrix.org | ^ This was my next qeustion, where can I find that job. Thanks for the link | 19:48 |
| @fungicide:matrix.org | the playbook is https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/nox-docs/post.yaml but it's basically just including a role | 19:49 |
| @fungicide:matrix.org | that role is defined here: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/fetch-sphinx-tarball | 19:50 |
| @fungicide:matrix.org | https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/fetch-sphinx-tarball/tasks/html.yaml is the interesting bit, the "Return artifact to Zuul" task returns the file that to zuul | 19:52 |
| @fungicide:matrix.org | s/the file that/the file's upload location/ | 19:52 |
| @fungicide:matrix.org | whoever thought it was a good idea to put enter and backspace next to each other on a keyboard was smoking something | 19:53 |
| @jim:acmegating.com | i just hit enter every time i hit - | 19:53 |
| @fungicide:matrix.org | almost as bad. the enter key needs a quarantine margin | 19:53 |
| @jim:acmegating.com | Alex: there are 2 other related concepts to understand: job dependencies, and provides/requires. you'll use dependencies to get the artifact information between different jobs in the same buildset (ie, build and test). you'll use provides/requires to get artifact information between different buildsets (ie, speculative execution chains). that's a concept that's unique to zuul (ie, no jenkins mapping). you don't need to deal with it right away, and you may not need to use it depending on how your builds work. | 19:55 |
| @chaos2022:matrix.org | Follow-up question, I have a pytest suite that generates an html report after the tests run. On the Zuul build dashboard there's a tab for "Artifacts" and "Logs". Is there a way to copy my generated test report to somewhere so that it shows up in the "Artifacts" or "Logs" tab? Or is it another case of "The job is reponsible for stashing the artifact somewhere"? | 19:55 |
| @chaos2022:matrix.org | Thanks for explaining that! I'll definitely have to look into those concepts some more. | 19:56 |
| @fungicide:matrix.org | the job just needs to notify zuul that it's an artifact, the "unite test report" you see at https://zuul.opendev.org/t/zuul/build/45db921fd6a04dd29e9b0b1bb7a53cbe/artifacts is an example of exactly what you describe | 19:57 |
| @fungicide:matrix.org | unit test... sigh | 19:57 |
| @fungicide:matrix.org | it's the same thing you get by clicking the "test_results.html" raw link at https://zuul.opendev.org/t/zuul/build/45db921fd6a04dd29e9b0b1bb7a53cbe/logs | 19:58 |
| @fungicide:matrix.org | the second post playbook in https://zuul.opendev.org/t/zuul/build/45db921fd6a04dd29e9b0b1bb7a53cbe/console is what's doing that | 19:59 |
| @fungicide:matrix.org | the "fetch-subunit-output: Return artifact to Zuul" task specifically | 20:00 |
| @chaos2022:matrix.org | Perfect! Thanks again for the links! I'll take a look now. | 20:00 |
| @fungicide:matrix.org | https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/fetch-subunit-output/tasks/process.yaml#L43-L55 is the task definition | 20:01 |
| @fungicide:matrix.org | but basically what we do in pretty much all cases is just add our artifacts like any other logs, but then notify zuul that specific items there are artifacts and give them appropriately descriptive names | 20:02 |
| @fungicide:matrix.org | if you browse around the build results for jobs we run on the zuul project itself, you'll (hopefully unsurprisingly) see a lot of good examples for ways to take advantage of zuul's own features | 20:04 |
| @fungicide:matrix.org | the zuul project's jobs, and the opendev collaboratory's zuul deployment more generally, tends to be a bit of a proving ground for zuul features | 20:05 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 940842: Report some scheduler cpu stats https://review.opendev.org/c/zuul/zuul/+/940842 | 23:23 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 940842: Report some scheduler cpu stats https://review.opendev.org/c/zuul/zuul/+/940842 | 23:33 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!