Thursday, 2022-09-01

-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530900:35
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530900:54
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530901:12
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530901:29
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530901:41
-@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 855403: Do not use _display outside the main thread in zuul_stream https://review.opendev.org/c/zuul/zuul/+/85540301:46
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/85530902:24
-@gerrit:opendev.org- Ian Wienand proposed:04:30
- [zuul/zuul] 851942: docs: update console streaming docs https://review.opendev.org/c/zuul/zuul/+/851942
- [zuul/zuul] 855309: [wip] disable streaming writing via var https://review.opendev.org/c/zuul/zuul/+/855309
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855309: zuul-stream: Add variable to disable writing streaming files https://review.opendev.org/c/zuul/zuul/+/85530905:08
-@gerrit:opendev.org- Ian Wienand proposed: [zuul/zuul] 855297: web: console: compress datalist https://review.opendev.org/c/zuul/zuul/+/85529706:45
@avass:vassast.org> <@jim:acmegating.com> Albin Vass: ^ you may be interested in... well... most of the conversation above re 85540307:58
ah nice :)
-@gerrit:opendev.org- Thomas Cardonne marked as active: [zuul/zuul] 855439: feat(elasticsearch): allow filtering of reported returned-vars https://review.opendev.org/c/zuul/zuul/+/85543911:36
@mbecker12:matrix.orgcorvus: I fixed some of your comments in https://review.opendev.org/c/zuul/nodepool/+/853993. I'm not sure how to handle the timeout in the test when the node is locked. And I think we would like to keep the configurable timeout in the command to still be able to hold a node after it's done with a job, for static nodes anyway12:46
@jim:acmegating.commbecker12: i would not recommend that workflow.  you will be racing nodepool itself.  in that case i would recommend removing the node from the config file.14:12
@mbecker12:matrix.orgYeah I see. regarding the nodepool config, you were talking about a nodepool-in-zuul spec. Do you have more info on that? Or a link or something? :)14:19
@jim:acmegating.commbecker12: https://review.opendev.org/849887  and yeah, it would make that process much simpler/faster14:24
@mbecker12:matrix.orgCool, thanks! I will have a look14:39
@mbecker12:matrix.orgDo you want me to remove the timeout from the command altogether then? I think it would be more in line with the other commands14:41
@jim:acmegating.comyeah, i think that would be best14:44
-@gerrit:opendev.org- Marvin Becker proposed: [zuul/nodepool] 853993: Add hold command to disable nodes https://review.opendev.org/c/zuul/nodepool/+/85399316:09
-@gerrit:opendev.org- Marvin Becker proposed: [zuul/nodepool] 853993: Add hold command to disable nodes https://review.opendev.org/c/zuul/nodepool/+/85399316:15
@mbecker12:matrix.orgcorvus: Done! I also left another comment regarding the test cases16:27
@clarkb:matrix.orgwhen writing an ansible module is there is a utility method to convert 'yes' 'True' etc into a boolean python value consistent with ansible expectations?17:40
@clarkb:matrix.orgoh apparently it is just module.boolean()?17:43
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540218:03
@clarkb:matrix.orgWhen you invoke a script liek that on the command line how do you pass arguments to it? does ansible module do some magic for command line use?18:05
@clarkb:matrix.orgI haven't run it locally yet as that bit isn't clear to me.18:05
@tristanc_:matrix.orgClark: do you mean something like this: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/htmlify-logs/library ?18:07
@clarkb:matrix.orgYa I guess I need to split the main calls up like that one18:08
@clarkb:matrix.orgI'll see what zuul complains about first then look into that after lunch if I've got time18:09
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540218:12
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540218:25
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540218:45
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540219:40
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540220:23
@clarkb:matrix.orgI'm still a bit stumped on what python2 isn't liking in that change.20:23
@vlotorev:matrix.orgHi, I'm having unexpected behaviour:20:31
* two jobs in check pipeline, the first one 'provides', the second one 'requires'. job with 'requires' has 'dependencies'
* zuul runs four jobs for two changes changes changeA, changeB
* 'provides' job for changeB finishes earlier then 'provides' for changeA,
as a result: artifacts from changeB are passed to changeA 'requires' job.
Is this expected?
@clarkb:matrix.orgI think so. provides and requires describe the relationship between buildsets. Then the job dependencies ensure order within a buildset20:32
@clarkb:matrix.orgWhat this means is whichever runs first will provide the image for other buildsets. If those other buildsets need to make their own updates to the image they need to have a dependency on the image build job which overrides the provided image20:33
@vlotorev:matrix.orgBut if buildsets provide artifacts to each other that would mean totaly random order. In my case changeA starts testing image from later changeB and sometimes it's testing from changeA.20:36
@clarkb:matrix.orgvlotorev: the idea is that you'd express the dependencies through git or depends on so that it isn't random20:38
@vlotorev:matrix.orgIn my case changeA and changeB in the same repo.20:39
@clarkb:matrix.orgIt may be the case that having the provides be satisfied without that relationship is a bug if that is happening20:39
@clarkb:matrix.orgI'd have to think about that more20:39
@clarkb:matrix.org> <@vlotorev:matrix.org> In my case changeA and changeB in the same repo.20:40
Note you can use git's built in lineage for changes or depends on within a single repo. But only depends on will work between different repos or different branches
@vlotorev:matrix.orgIn my case changeA and changeB are linear in the same repo.20:41
@clarkb:matrix.orgIs changeB the parent of changeA if so the behavior you described is expected20:42
-@gerrit:opendev.org- Clark Boylan proposed: [zuul/zuul-jobs] 855402: Speed up log file fetching tasks https://review.opendev.org/c/zuul/zuul-jobs/+/85540220:43
@vlotorev:matrix.orgchangeA is parent of changeB20:43
@clarkb:matrix.orgIn that case I believe the expected behavior is taht change B would wait until changeA's resource is available so that the child can consume the parent's build20:44
@clarkb:matrix.org(Again it shouldn't be random nor should it be child before parent)20:44
@clarkb:matrix.orgcorvus: ^ did we break that?20:44
@vlotorev:matrix.orgIt's random because it depends on how long 'provides' job for changeA and changeB are running. And this length is not controlled by zuul (there might changes in playbooks).20:48
If 'provides' job for changeB finishes earlier then 'provides' job for changeB then artifacts from this job are in 'requires' job in changeA.
if 'provides' job for changeB finishes later then 'provides' job for changeB then *no* artifacts from changeB in changeA.
@vlotorev:matrix.org * It's random because it depends on how long 'provides' job for changeA and changeB are running. And this duration is not controlled by zuul (there might changes in playbooks).20:49
If 'provides' job for changeB finishes earlier then 'provides' job for changeB then artifacts from this job are in 'requires' job in changeA.
if 'provides' job for changeB finishes later then 'provides' job for changeB then _no_ artifacts from changeB in changeA.
@clarkb:matrix.orgExcept zuul knows what the dependencies are and it is supposed to wait20:49
@clarkb:matrix.orgI wonder if there is some missing config to make that happen20:49
@clarkb:matrix.orgvlotorev: maybe you can share your configs?20:51
@vlotorev:matrix.orgLet me recheck, probably when I have one change then it works as expected. And then two changes then changeA always waiting for child changeB.20:56
@vlotorev:matrix.org * Let me recheck, probably when I have one change then it works as expected. And when there two changes then changeA always waiting for child changeB.20:56
@clarkb:matrix.orgZuulians https://review.opendev.org/c/zuul/zuul-jobs/+/855402/ is ready for review now I think. It passes testing and I added a bit more testing including using the unitest framework and the ansible integration testing. That said this will likely affect many base jobs so please review it carefully and suggest additional testing. I'll do my best to add it20:59
@clarkb:matrix.orgFor some of opendev's jobs i expect that to cut minutes off our runtime though which would be great20:59
@clarkb:matrix.orgThe python2 issue is I needed a __init__.py file in the role dir not just the role/library dir21:00
@vlotorev:matrix.orgClark: Is there any sandbox project with zuul enabled so I could upload both jobs and demonstrate how they are running?21:05
@clarkb:matrix.orgvlotorev: opendev has a sandbox repo. I don't know how much effort it would be to port something like that into that repo21:06
@clarkb:matrix.orgBut it is theoretically doable21:06
@vlotorev:matrix.orgThis one https://zuul.opendev.org/t/openstack/project/opendev.org/opendev/sandbox ?21:07
@clarkb:matrix.orgyes21:07
@jim:acmegating.comClark: i'm not aware of any breakage related to that.  i believe that's working as designed/specified (if not as expected).21:22
@jim:acmegating.comvlotorev: provides/requires isn't intended for the case where the buildset in question has both a provide and requires job.21:23
@jim:acmegating.com(it is, as you observed, self-satisfying in that case)21:23
@vlotorev:matrix.orgI've uploaded two jobs and two changes https://review.opendev.org/c/opendev/sandbox/+/855590/.21:38
ChangeA is parent for changeB, even though jobs for changeB are faster they still wait for jobs from changeA to finish and artifacts from changeA are provided to change B.
Is this expected behaviour?
@vlotorev:matrix.orgClark: corvus  thanks for help. Behaviour on https://review.opendev.org/c/opendev/sandbox/+/855069/ matches the one on my instance and it matches doc in https://zuul-ci.org/docs/zuul/latest/config/job.html?highlight=job+requires#attr-job.requires.22:03
-@gerrit:opendev.org- Ian Wienand proposed:22:19
- [zuul/zuul] 855574: web: task summary: make more consistent with other tabs https://review.opendev.org/c/zuul/zuul/+/855574
- [zuul/zuul] 855575: web: console: better task modal titles https://review.opendev.org/c/zuul/zuul/+/855575
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed:22:40
- [zuul/zuul] 854458: Add support for configuring and testing tracing https://review.opendev.org/c/zuul/zuul/+/854458
- [zuul/zuul] 855096: Tracing: implement span save/restore https://review.opendev.org/c/zuul/zuul/+/855096
- [zuul/zuul] 855293: Add tracing tutorial https://review.opendev.org/c/zuul/zuul/+/855293
-@gerrit:opendev.org- Ian Wienand proposed:23:38
- [zuul/zuul] 854556: web: console: convert to PF4 DataList https://review.opendev.org/c/zuul/zuul/+/854556
- [zuul/zuul] 855297: web: console: compress datalist https://review.opendev.org/c/zuul/zuul/+/855297
- [zuul/zuul] 855574: web: task summary: make more consistent with other tabs https://review.opendev.org/c/zuul/zuul/+/855574
- [zuul/zuul] 855575: web: console: better task modal titles https://review.opendev.org/c/zuul/zuul/+/855575
- [zuul/zuul] 855577: web: update to patternfly 4.235.7 https://review.opendev.org/c/zuul/zuul/+/855577
- [zuul/zuul] 855578: web: build/autohold: fix props input https://review.opendev.org/c/zuul/zuul/+/855578
@iwienand:matrix.orgcorvus: ^ that has addressed all your prior comments; 855297 fiddles things to make the pf4 console page more compressed as requested.  more tweaking may be possible there.  i've added on a few other things that seemed inconsistent to me when flipping around with the updated console too23:58
@iwienand:matrix.orghttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_598/855575/2/check/zuul-build-dashboard-opendev/598ac0c/npm/html/23:59
@iwienand:matrix.orgis the capstone site preview if anyone wants to poke quickly23:59

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!