Tuesday, 2020-09-15

*** armstrongs has quit IRC00:04
*** hamalq has quit IRC00:45
*** zenkuro has quit IRC01:24
*** ianychoi_ has joined #zuul01:46
*** ianychoi has quit IRC01:48
*** iurygregory has quit IRC02:08
*** rlandy has quit IRC02:22
*** hashar has joined #zuul02:48
*** sanjayu_ has joined #zuul04:01
*** saneax has quit IRC04:02
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** vishalmanchanda has joined #zuul04:34
*** sassyn has quit IRC04:40
*** hashar has quit IRC05:13
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: only run docker-setup.yaml when installed  https://review.opendev.org/74706205:48
openstackgerritIan Wienand proposed zuul/zuul-jobs master: update-json-file: add role to combine values into a .json  https://review.opendev.org/74683405:48
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: Linaro MTU workaround  https://review.opendev.org/74706305:48
openstackgerritIan Wienand proposed zuul/zuul master: web: PF4 minor rework of log viewer page  https://review.opendev.org/75114005:49
*** mach1na has joined #zuul05:51
*** sanjayu_ has quit IRC06:10
openstackgerritRico Lin proposed zuul/zuul-jobs master: Allow skip files when download logs  https://review.opendev.org/75197306:11
*** saneax has joined #zuul06:24
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: only run docker-setup.yaml when installed  https://review.opendev.org/74706206:27
openstackgerritIan Wienand proposed zuul/zuul-jobs master: update-json-file: add role to combine values into a .json  https://review.opendev.org/74683406:27
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: Linaro MTU workaround  https://review.opendev.org/74706306:27
openstackgerritIan Wienand proposed zuul/zuul-jobs master: Retire Fedora 31 for 32  https://review.opendev.org/75197506:27
openstackgerritMerged zuul/zuul master: Handle review requirements in canMerge  https://review.opendev.org/74904006:35
*** mach1na has quit IRC06:35
openstackgerritJan Kubovy proposed zuul/zuul master: Scheduler's pause/resume functionality  https://review.opendev.org/70973506:42
openstackgerritJan Kubovy proposed zuul/zuul master: Separate connection registries in tests  https://review.opendev.org/71295806:42
openstackgerritJan Kubovy proposed zuul/zuul master: Prepare Zookeeper for scale-out scheduler  https://review.opendev.org/71726906:42
openstackgerritJan Kubovy proposed zuul/zuul master: Mandatory Zookeeper connection for ZuulWeb in tests  https://review.opendev.org/72125406:42
openstackgerritJan Kubovy proposed zuul/zuul master: Driver event ingestion  https://review.opendev.org/71729906:42
openstackgerritJan Kubovy proposed zuul/zuul master: Connect merger to Zookeeper  https://review.opendev.org/71622106:42
openstackgerritJan Kubovy proposed zuul/zuul master: Connect fingergw to Zookeeper  https://review.opendev.org/71687506:42
openstackgerritJan Kubovy proposed zuul/zuul master: Connect executor to Zookeeper  https://review.opendev.org/71626206:42
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Switch to using zookeeper instead of gearman for jobs (keep gearman for mergers)  https://review.opendev.org/74441606:42
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Switch to using zookeeper instead of gearman for jobs (keep gearman for mergers)  https://review.opendev.org/74441606:50
*** mach1na has joined #zuul06:55
*** iurygregory has joined #zuul06:58
*** jcapitao has joined #zuul07:13
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161107:15
*** hashar has joined #zuul07:24
*** tosky has joined #zuul07:34
*** saneax has quit IRC07:36
openstackgerritMerged zuul/zuul master: Don't match branch protection rule patterns locally  https://review.opendev.org/75168607:38
*** jpena|off is now known as jpena07:49
*** saneax has joined #zuul07:52
*** sshnaidm|afk is now known as sshnaidm08:04
*** harrymichal has joined #zuul08:20
openstackgerritRico Lin proposed zuul/zuul-jobs master: Allow skip files when download logs  https://review.opendev.org/75197308:21
openstackgerritMatthieu Huin proposed zuul/zuul master: [DNM] Add zuul-client to requirements  https://review.opendev.org/75019608:24
*** holser has joined #zuul08:30
*** nils has joined #zuul08:30
*** harrymichal has quit IRC08:43
*** harrymichal has joined #zuul08:44
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Make default config files location a class attribute  https://review.opendev.org/75129108:58
*** zenkuro has joined #zuul09:08
openstackgerritDmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python  https://review.opendev.org/75161109:09
openstackgerritMatthieu Huin proposed zuul/zuul master: [DNM] Add zuul-client to requirements  https://review.opendev.org/75019609:16
*** harrymichal has quit IRC09:34
*** yolanda has joined #zuul09:37
noonedeadpunkfolks, is fedora 31 supposed to fail on zuul/zuul-jobs ?09:46
noonedeadpunkhttps://zuul.opendev.org/t/zuul/build/14944c447b694db682d2f102b76c26c809:46
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Add cross testing with Zuul  https://review.opendev.org/75126409:51
openstackgerritMatthieu Huin proposed zuul/zuul-client master: Make default config files location a class attribute  https://review.opendev.org/75129109:51
openstackgerritMatthieu Huin proposed zuul/zuul master: [DNM] Add zuul-client to requirements  https://review.opendev.org/75019609:57
openstackgerritTobias Henkel proposed zuul/zuul master: Evaluate CODEOWNERS settings during canMerge check  https://review.opendev.org/64455710:04
*** jcapitao is now known as jcapitao_lunch10:24
*** sanjayu_ has joined #zuul10:30
*** saneax has quit IRC10:30
*** sanjayu__ has joined #zuul11:03
*** sanjayu_ has quit IRC11:03
*** mach1na has quit IRC11:10
*** mach1na has joined #zuul11:11
*** mach1na has quit IRC11:15
openstackgerritMatthieu Huin proposed zuul/zuul master: [DNM] Add zuul-client to requirements  https://review.opendev.org/75019611:25
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul master: Reduce column size for time values  https://review.opendev.org/75201811:31
*** jpena is now known as jpena|lunch11:35
*** Goneri has joined #zuul11:44
openstackgerritTobias Henkel proposed zuul/nodepool master: Add zookeeper-timeout connection config  https://review.opendev.org/75202211:48
*** mach1na has joined #zuul11:50
*** brendangalloway has joined #zuul11:56
funginoonedeadpunk: we suspect it's related to https://bugzilla.redhat.com/show_bug.cgi?id=1853736 which only got fixed in f32 and later11:58
openstackbugzilla.redhat.com bug 1853736 in systemd "systemctl show service fails with "Failed to parse bus message: Invalid argument"" [Unspecified,Closed: errata] - Assigned to systemd-maint11:58
fungiclarkb is trying to work around it with https://review.opendev.org/75187211:58
fungibut ianw has also pushed https://review.opendev.org/751975 to just switch to f3211:59
noonedeadpunktbh I'd rather just used f32 if possible...11:59
noonedeadpunkbut yeah, I see11:59
noonedeadpunkthanks for heads up:)12:00
*** rfolco|ruck has joined #zuul12:03
*** jcapitao_lunch is now known as jcapitao12:05
*** rlandy has joined #zuul12:07
*** brendangalloway has quit IRC12:18
openstackgerritPierre-Louis Bonicoli proposed zuul/zuul master: gitlab: merge request approval: specify the commit  https://review.opendev.org/75203112:20
*** Goneri has quit IRC12:23
mhuhello fungi, re: your suggestion to test adding zuul-client as a zuul requirement: I'm trying to pre-install zuul-client in the tox venv in a pre playbook, before the tox job is run12:23
mhuthis is in https://review.opendev.org/#/c/750196/12:24
mhubut it looks like tox doesn't seem to see the "manually" installed version of zuul-client and still fetches the lib from pypi12:24
mhuwhich breaks the test since the package is incorrect12:25
*** sshnaidm has quit IRC12:25
fungimhu: i think our tox role does the right thing via its "tox-siblings" detection, where if you have a requirement which is listed as a required-projects entry for the job then it gets automatically preinstalled into the venv12:26
tristanCfungi: iirc the tox role install the siblings after an initial installation from pypi12:29
fungiahh, yeah, though it should currently be installable, it's just not importable12:33
mhufungi, tristanC yeah that's exactly the problem, the build fails when attempting to initialize the zuul entry points - since the tox siblings scripts occur after the tox run without testing, it's too late12:35
*** jpena|lunch is now known as jpena12:36
mhuthat's why I'm trying to install the fixed lib from a local build before this, but it looks like tox cleans the venv first12:36
openstackgerritPierre-Louis Bonicoli proposed zuul/zuul master: FakeGitlabAPIClient: use subject instead of title  https://review.opendev.org/75203512:38
mhuthe test confirms at least that the wheel builds correctly and can be installed: https://zuul.opendev.org/t/zuul/build/bcfbe4b98f6442f09862bcae236420cc/log/job-output.txt#74012:39
mhuas of https://review.opendev.org/#/c/751291/12:40
*** piotrowskim has joined #zuul12:45
*** Goneri has joined #zuul12:49
*** sshnaidm has joined #zuul12:50
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client testing  https://review.opendev.org/75203912:55
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client testing  https://review.opendev.org/75203912:56
*** hashar has quit IRC13:16
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client to requirements  https://review.opendev.org/75204313:21
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client to requirements  https://review.opendev.org/75204313:22
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client testing  https://review.opendev.org/75203913:52
*** yolanda has quit IRC13:53
*** yolanda has joined #zuul13:54
*** AshBullock has joined #zuul13:55
*** jfoufas1 has joined #zuul13:56
openstackgerritPierre-Louis Bonicoli proposed zuul/zuul master: gitlab: merge request approval: specify the commit  https://review.opendev.org/75203113:57
*** stevthedev_ has joined #zuul13:57
*** gouthamr__ has joined #zuul13:57
*** guilhermesp_ has joined #zuul13:57
*** gmann_ has joined #zuul13:57
*** smyers_ has joined #zuul13:57
*** jbryce_ has joined #zuul13:58
*** gouthamr has quit IRC14:00
*** jbryce has quit IRC14:00
*** guilhermesp has quit IRC14:00
*** stevthedev has quit IRC14:00
*** fungi has quit IRC14:00
*** Eighth_Doctor has quit IRC14:00
*** smyers has quit IRC14:00
*** logan- has quit IRC14:00
*** smyers_ is now known as smyers14:00
*** gmann has quit IRC14:00
*** ironfoot has quit IRC14:00
*** jbryce_ is now known as jbryce14:00
*** stevthedev_ is now known as stevthedev14:00
*** gouthamr__ is now known as gouthamr14:00
*** guilhermesp_ is now known as guilhermesp14:00
*** ironfoot has joined #zuul14:00
*** gmann_ is now known as gmann14:00
*** logan- has joined #zuul14:01
*** Eighth_Doctor has joined #zuul14:07
*** fungi has joined #zuul14:09
AshBullockHey, is anyone with better knowledge of the code base able to point me in the right direction of what is responsible for setting the "self.updated" var of the class "MergeCompletedEvent", I'm working on a driver for bitbucketcloud and have some webhooks firing events, but they are all being set as updated: False by the merger, I can't figure out14:19
AshBullockwhere this is calculated14:19
openstackgerritTobias Henkel proposed zuul/zuul master: Remove an unneeded api call when creating check_runs  https://review.opendev.org/75205614:20
*** jfoufas1 has quit IRC14:23
*** AshBullock has quit IRC14:27
felixedelAshBullock: Not sure if that helps, but I just did a search in the code for that field: It looks like the "updated" field is directly set on the MergeCompletedEvent() when it is initialized in scheduler.onMergeCompleted() https://opendev.org/zuul/zuul/src/branch/master/zuul/scheduler.py#L555 This method is called by the MergeClient  https://opendev.org/zuul/zuul/src/branch/master/zuul/merger/client.py#L199 whereby the14:27
felixedelupdated field of the job is used14:27
*** AshBullock has joined #zuul14:28
AshBullockHey, is anyone with better knowledge of the codebase able to point me in the right direction of how the "self.updated" variable of the class "MergeCompletedEvent" gets set? I've got a bitbucketcloud driver set up firing some webhook events, but they are all set as "updated: False" by the merge client and I can't seem to find how that's evaluated14:34
AshBullockfelixedel thanks! yeah I was looking there, but can't see how the job gets that value set either14:35
felixedelAshBullock: Hmm, not sure. That might come from gearman directly. At least it seems to be set on the job result. The getJobData() method just extracts the "data" attribute that is set on the job.14:42
openstackgerritTobias Henkel proposed zuul/zuul master: Remove an unneeded api call when creating check_runs  https://review.opendev.org/75205614:43
clarkbAshBullock: felixedel https://opendev.org/zuul/zuul/src/branch/master/zuul/merger/server.py#L141 https://opendev.org/zuul/zuul/src/branch/master/zuul/merger/server.py#L175 https://opendev.org/zuul/zuul/src/branch/master/zuul/merger/server.py#L20314:45
clarkbthen in merger/client.py the gearman merge client reads that value and applies it to the merge event in the scheduler14:46
AshBullockclarkb Thanks, that's what I'm looking for14:49
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client testing  https://review.opendev.org/75203914:57
*** ianychoi__ has joined #zuul15:41
openstackgerritJan Kubovy proposed zuul/zuul master: WIP: Switch to using zookeeper instead of gearman for jobs (keep gearman for mergers)  https://review.opendev.org/74441615:44
*** mach1na has quit IRC15:45
*** ianychoi_ has quit IRC15:45
*** mach1na has joined #zuul15:45
*** mach1na has quit IRC15:50
*** mach1na has joined #zuul16:02
*** mach1na has quit IRC16:06
-openstackstatus- NOTICE: Our PyPI caching proxies are serving stale package indexes for some packages. We think because PyPI's CDN is serving stale package indexes. We are sorting out how we can either fix or workaround that. In the meantime updating requirements is likely the wrong option.16:12
*** jcapitao has quit IRC16:12
openstackgerritMatthieu Huin proposed zuul/zuul master: Add zuul-client testing  https://review.opendev.org/75203916:13
*** nils has quit IRC16:22
mhufungi: I've split the zuul-client > zuul integration over two changes: the first, https://review.opendev.org/#/c/752039/ is only for unit testing that the zuul-client module gets installed16:30
mhubut from the tox logs it doesn't seem like the depends-on version of zuul-client is installed by the tox siblings script16:31
fungimhu: sorry, i'm being pulled in half a dozen directions today, can you link to the build result where you expected it to get installed from source and it wasn't?16:35
mhufungi, no worries, I'm about to call it a day anyway. There's a build in progress right now16:35
openstackgerritTobias Henkel proposed zuul/zuul master: Remove an unneeded api call when creating check_runs  https://review.opendev.org/75205616:38
openstackgerritTobias Henkel proposed zuul/zuul master: Save superfluous api requests in check run reporting  https://review.opendev.org/75207916:38
*** sanjayu__ has quit IRC16:39
*** saneax has joined #zuul16:41
*** saneax has quit IRC16:46
*** piotrowskim has quit IRC16:51
*** jpena is now known as jpena|off16:56
*** paladox has quit IRC17:37
*** paladox has joined #zuul17:38
*** tosky has quit IRC17:40
*** vishalmanchanda has quit IRC18:13
openstackgerritTobias Henkel proposed zuul/zuul master: Remove an unneeded api call when creating check_runs  https://review.opendev.org/75205618:31
openstackgerritTobias Henkel proposed zuul/zuul master: Save superfluous api requests in check run reporting  https://review.opendev.org/75207918:31
*** AshBullock has quit IRC18:31
*** ashbullock has joined #zuul18:32
ashbullockthanks for your pointers earlier, I now have jobs triggering for bitbucketcloud on commits to branchs, prs, and pr branches :D  I'm in the process of cleaning up the code for reviewal now18:33
openstackgerritJames E. Blair proposed zuul/zuul master: Use bionic images for zuul-stream-functional tests  https://review.opendev.org/74996718:36
ashbullockpr comments* I've encountered a few things to consider along the way, the bitbucketcloud webhook integrations don't pass an authentication token like github/lab do, and their docs just advise to lock down to bitbucket cloud IP's, https://support.atlassian.com/bitbucket-cloud/docs/manage-webhooks/18:39
ashbullockI'm thinking in this case the best I can do is document that and ensure required headers are in place on the requests, and lock down to https, does anyone have any thoughts on that?18:41
corvuswow, you'd need a dedicated zuul-web worker just for bitbucket in order to firewall by ip :(18:42
fungiashbullock: maybe the connection driver should also include a configuration option to allow you to specify allowed ip addresses for the bb webhooks?18:43
fungiugly, but might make it possible to not need to use network firewalls to restrict source addresses for those specific paths18:43
corvusfungi: that would also prevent using load balancers, proxies, ssl terminators...18:44
corvusi think it would be better to do that outside of zuul-web18:44
fungiyeah, fair, if you put zuul-web behind a non-transparent load balancer you'd need to do the layer 7 filtering on the lb layer18:44
corvusashbullock: when you say 'required headers' what do you mean?  is there a header that can be used to authenticate that the webhook event is from bbc?18:45
ashbullockfungi yeah thats exactly what i've got set up on my test, zuul exposed on a public lb with rules18:46
ashbullockit is rather annoying, it seems like a core requirement18:47
ashbullockcorvus i just mean the standard webhook headers bitbucketcloud adds (X-Event-Key, X-Hook-UUID, X-Request-UUID)  https://support.atlassian.com/bitbucket-cloud/docs/event-payloads/18:51
ashbullockthey also have User-Agent: Bitbucket-Webhooks/2.0, but that's about it18:51
fungiso easily spoofed by anyone18:52
ashbullockunfortunately, yeah18:54
ashbullockand on another point, it doesn't have a concept of pull request refs like github/lab does, so at the moment I've been taking refs/heads/<branch>, not sure if that would encounter problems18:58
*** mattd01 has joined #zuul18:58
clarkbashbullock: the proposed content should be fetchable in some way?18:58
clarkbif you pull refs/heads/branch that is just the existing code on the branch isn't it?18:59
ashbullocki'd assumed it would be at the latest of the branch which would have the changes19:00
ashbullockbut I've seen a few ways the pull request head can be calculated which I want to try out tomorrow19:01
*** armstrongs has joined #zuul19:05
openstackgerritIan Wienand proposed zuul/zuul-jobs master: Retire Fedora 31 for 32  https://review.opendev.org/75197519:15
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: only run docker-setup.yaml when installed  https://review.opendev.org/74706219:15
openstackgerritIan Wienand proposed zuul/zuul-jobs master: update-json-file: add role to combine values into a .json  https://review.opendev.org/74683419:15
openstackgerritIan Wienand proposed zuul/zuul-jobs master: ensure-docker: Linaro MTU workaround  https://review.opendev.org/74706319:15
openstackgerritIan Wienand proposed zuul/zuul master: web: PF4 minor rework of log viewer page  https://review.opendev.org/75114019:27
*** ashbullock has quit IRC19:33
openstackgerritMerged zuul/zuul master: Drop support for python 3.5  https://review.opendev.org/74994719:49
ianwcorvus: do  you think we're gtg with the pf4 stack from https://review.opendev.org/#/c/750875 down?19:57
corvusianw: i'll take a look, thx for the reminder19:59
PilouWith zuul.opendev.org, is there a way to get logs of failed builds (for example: https://zuul.opendev.org/t/zuul/build/8d2e556e988045b196c612a60c8e6f7c) ?20:00
fungiPilou: that's why it ended in a post_failure result. zuul was unable to upload the logs for that build20:01
fungiso hard to serve logs for a build which failed trying to record its logs, unfortunately20:01
fungiPilou: though the timing on that looks coincident with when opendev's zuul was unable to upload logs to one of its configured swift regions where a quota was reached, since corrected20:02
fungii expect that's the reason for the failure20:02
Pilouok, thanks for the explanation!20:03
openstackgerritPierre-Louis Bonicoli proposed zuul/zuul master: gitlab: merge request approval: specify the commit  https://review.opendev.org/75203120:13
*** AshBullock has joined #zuul20:23
*** mattd01 has left #zuul20:38
*** AshBullock has quit IRC21:03
*** armstrongs33 has joined #zuul21:26
corvusianw: i'm confused by 75087521:33
corvusianw: that eliminates horizontal scrolling on the logs page, and asserts that "we don't like horizontal scrolling"21:33
corvusianw: i like it very much, and indeed we asked zbr to do quite a bit of work to ensure that we don't lose it21:34
corvusso it seems really weird that we would suddenly decide that when felixedel proposes we get rid of it that we forget that21:34
*** armstrongs33 has quit IRC21:35
corvusi even left a review comment on 750322 that we needed to maintain the horizontal scrolling on the logs tab21:35
corvustristanC: ^ fyi21:36
corvustobiash: ^ also21:39
ianwcorvus: I don't think i ever -1'd a wrap change, although i probably didn't vote for it.  i'm taking in the context of having looked at  contemporary examples, from github and gitlab, which i linked in a few places21:41
corvusianw: i don't understand21:41
ianwin prior discussion, i saw opinions, but never "github does like this, here's the link", "gitlab does like this, here's the link", "jenkins does like this" here's the link21:41
corvusianw: my point is that 750875 contradicts what i said earlier in 750322 and should not be approved.21:42
corvusthere definitely is no consensus that "we don't like horizontal scrolling".  i *love* horizontal scrolling.21:42
corvusat best, we are divided, which is why we're adding a user-pref toggle.21:43
ianwi would agree that's a strong thing to write in that commit message21:43
corvusso i think we should maintain the status quo, then add the new functionality in the toggle21:43
tristanCcorvus: i understood the issue is that without 750875, the whole ui, including the navbar doesn't horiwontal scroll properly21:45
corvustristanC: it looks like without 750875, we get viewport horizontal scrolling (and a really wide navbar)21:47
tristanCcorvus: for example, with the current webui, i can't see the top right part of this page: https://zuul.opendev.org/t/zuul/build/f3aeaa6a6d76482b8173e606db0e71c7/log/job-output.txt21:47
corvustristanC: yep21:48
corvusthat's also not desirable21:48
tristanCcorvus: while with the site-preview of 750875, then at least the navbar is rendered correctly. but I agree we also want horizontal scroll for logfile content21:49
corvusyeah, i'm thinking we can live with the stretched navbar until this is fixed21:49
corvusi'd like to wait until the whole stack is ready before we merge anything though21:50
*** rfolco|ruck has quit IRC22:51
*** Goneri has quit IRC23:03
*** armstrongs70 has joined #zuul23:09
*** armstrongs70 has quit IRC23:19

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!