Wednesday, 2020-05-27

*** rlandy has quit IRC00:56
*** Goneri has quit IRC01:03
*** rlandy has joined #zuul01:05
*** rlandy has quit IRC01:11
*** swest has quit IRC01:31
*** swest has joined #zuul01:45
*** tumble has quit IRC01:46
*** jamesmcarthur has joined #zuul02:35
*** jamesmcarthur has quit IRC03:26
*** jamesmcarthur has joined #zuul03:27
*** jamesmcarthur has quit IRC03:35
*** ysandeep|away is now known as ysandeep03:38
*** jamesmcarthur has joined #zuul03:46
*** jamesmcarthur has quit IRC03:51
*** evrardjp has quit IRC04:33
*** evrardjp has joined #zuul04:33
*** saneax has joined #zuul04:49
*** kmalloc has quit IRC04:56
*** jamesmcarthur has joined #zuul05:13
*** jamesmcarthur has quit IRC05:17
*** jamesmcarthur has joined #zuul05:18
*** ianychoi has quit IRC05:34
*** jamesmcarthur has quit IRC05:50
*** jamesmcarthur has joined #zuul05:52
*** hashar has joined #zuul05:57
*** dpawlik has joined #zuul06:05
*** dpawlik has quit IRC06:12
*** dpawlik has joined #zuul06:12
*** jamesmcarthur has quit IRC06:22
*** jamesmcarthur has joined #zuul06:23
*** jamesmcarthur has quit IRC06:29
*** sgw has quit IRC06:50
*** jamesmcarthur has joined #zuul07:00
*** jcapitao has joined #zuul07:09
*** jamesmcarthur has quit IRC07:10
*** tosky has joined #zuul07:26
*** jamesmcarthur has joined #zuul07:46
*** jpena|off is now known as jpena07:51
openstackgerritJan Kubovy proposed zuul/zuul master: Improve typings in context of 630472  https://review.opendev.org/71524707:52
openstackgerritJan Kubovy proposed zuul/zuul master: Required SQL reporters  https://review.opendev.org/63047207:52
*** jamesmcarthur has quit IRC07:55
*** bolg has joined #zuul07:56
*** bolg has quit IRC07:59
*** bolg has joined #zuul08:00
*** asaleh_ has joined #zuul08:01
*** nils has joined #zuul08:08
*** stevthedev_ has joined #zuul08:12
*** evgenyl_ has joined #zuul08:12
*** guilhermesp_ has joined #zuul08:12
*** gundalow_ has joined #zuul08:13
*** mnaser_ has joined #zuul08:13
*** mugsie_ has joined #zuul08:14
*** mnaser has quit IRC08:20
*** evgenyl has quit IRC08:20
*** stevthedev has quit IRC08:20
*** mugsie has quit IRC08:20
*** guilhermesp has quit IRC08:20
*** gundalow has quit IRC08:20
*** stevthedev_ is now known as stevthedev08:20
*** evgenyl_ is now known as evgenyl08:20
*** mnaser_ is now known as mnaser08:20
*** guilhermesp_ is now known as guilhermesp08:20
*** gundalow_ is now known as gundalow08:20
*** rpittau|afk is now known as rpittau08:22
*** zenkuro has quit IRC08:23
openstackgerritJan Kubovy proposed zuul/zuul master: Improve typings in context of 630472  https://review.opendev.org/71524708:30
*** ysandeep is now known as ysandeep|lunch08:46
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add ensure-dnf-copr  https://review.opendev.org/73074308:47
*** guillaumec has joined #zuul09:06
*** sshnaidm|afk is now known as sshnaidm09:26
*** ysandeep|lunch is now known as ysandeep09:39
*** threestrands has quit IRC09:39
*** harrymichal has quit IRC09:39
*** guillaumec has quit IRC09:44
*** guillaumec has joined #zuul09:52
*** jamesmcarthur has joined #zuul09:52
*** jamesmcarthur has quit IRC09:58
*** rpittau is now known as rpittau|bbl10:07
openstackgerritTobias Henkel proposed zuul/zuul master: Support per branch change queues  https://review.opendev.org/71853110:09
openstackgerritTobias Henkel proposed zuul/zuul master: Move queue from pipeline to project  https://review.opendev.org/72018210:10
openstackgerritTobias Henkel proposed zuul/zuul master: Add optional support for circular dependencies  https://review.opendev.org/68535410:11
zbri seen quite neat feature on azure pipelines today, a sudden popup appeared w/o me doing enything: https://sbarnea.com/ss/Screen-Shot-2020-05-27-11-18-08.64.png10:19
zbrseems like something very practical, maybe we can implement it in zuul in the future.10:19
*** jcapitao is now known as jcapitao_lunch10:36
*** hashar has quit IRC11:16
*** fbo|off is now known as fbo11:19
openstackgerritMatthieu Huin proposed zuul/zuul master: Web UI: add "held" information, filtering in Builds page  https://review.opendev.org/72926511:19
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757811:21
openstackgerritTobias Henkel proposed zuul/zuul master: Move queue from pipeline to project  https://review.opendev.org/72018211:23
openstackgerritTobias Henkel proposed zuul/zuul master: Add optional support for circular dependencies  https://review.opendev.org/68535411:23
*** harrymichal has joined #zuul11:24
*** harrymichal has quit IRC11:24
*** sshnaidm is now known as sshnaidm|afk11:25
openstackgerritTobias Henkel proposed zuul/zuul master: Move queue from pipeline to project  https://review.opendev.org/72018211:26
openstackgerritTobias Henkel proposed zuul/zuul master: Add optional support for circular dependencies  https://review.opendev.org/68535411:26
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757811:27
*** jpena is now known as jpena|lunch11:31
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757811:34
AJaegercorvus, clarkb, mordred, I rebased and fixed the "trivial" problems ^11:35
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: upload-artifactory: documentation fix  https://review.opendev.org/73117011:36
avassmordred: keeping subunit2html in the role seems it's more effort than just adding os-testr to test-requirements11:40
avassmordred: since it's also dependent on subunit11:40
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: fetch-subunit-output: stop using system os-testr  https://review.opendev.org/73048211:43
avassmordred: so how about we go with that ^ ?11:44
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: ensure-haskell-stack: Make sure dnf copr is installed  https://review.opendev.org/73117311:46
*** jcapitao_lunch is now known as jcapitao11:47
avassAJaeger: between https://review.opendev.org/#/c/730743/ and https://review.opendev.org/731173 what would you prefer? I don't see a reason we need a role for that so I'd say 73117311:47
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757811:50
AJaegeravass: agree to go with 73117311:51
*** jamesmcarthur has joined #zuul11:55
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Bump ansible-lint to 4.3.0  https://review.opendev.org/70267911:57
*** rlandy has joined #zuul11:58
AJaegermnaser: could you check VEXXHOST CI, please? I see it failing in several places like https://review.opendev.org/#/c/731173/11:59
*** jamesmcarthur has quit IRC12:00
guilhermespmornings! corvus fungi regarding our conversation from yesterday about nodesets in db... i guess a way to do it for now is just to add an extra column in the buildset table so we can store the nodesets for a given buildset?12:04
guilhermespAJaeger: oh the ci is failing?12:05
guilhermespi will take a look at this now12:05
*** rpittau|bbl is now known as rpittau12:06
AJaegerguilhermesp: thanks12:07
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757812:17
avassAJaeger: I'll take a look at that as well, that could be my fault but I don't understand why that worked in the first place12:18
*** marvs has joined #zuul12:18
AJaegerthanks12:19
avassAJaeger: it worked here for some reason https://review.opendev.org/#/c/729520/ maybe it's a difference between python versions?12:21
openstackgerritJan Kubovy proposed zuul/zuul master: Required SQL reporters  https://review.opendev.org/63047212:22
guilhermesphum i can see some errors to build subprocess32 https://zuul.vexxhost.dev/t/opendev/build/ede22823593647d2ae698de39ac8ee5b/log/job-output.txt#67912:23
guilhermespat least for one of the jobs, the others i see https://zuul.vexxhost.dev/t/opendev/build/c285c0e6b69945068c5b632c538ced89/log/job-output.txt#42212:23
* guilhermesp digs if issue is in our side 12:23
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: tox: envlist bugfixes  https://review.opendev.org/73038112:32
avassguilhermesp, AJaeger: ah, I think the problem occurs if the module is executed with python2.712:33
avasslet me see if I can fix that12:33
AJaegermordred: could you review https://review.opendev.org/#/c/730334 again, please? and https://review.opendev.org/#/c/729348/ as well12:34
avassbut that's a bit worrying that we don't test that12:35
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: siblings: python2.7 configparser has no __getitem__  https://review.opendev.org/73118712:37
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: siblings: python2.7 ConfigParser has no __getitem__  https://review.opendev.org/73118712:38
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: siblings: python2.7 ConfigParser has no __getitem__  https://review.opendev.org/73118712:39
avassAJaeger, guilhermesp: I believe that ^ should fix it12:39
guilhermesp++ avass12:39
* AJaeger waits for test results ;)12:39
avass:)12:40
AJaegerthanks12:40
mnaseravass: i wonder how this wasn't caught the first place12:40
avassmnaser: yeah, maybe some machines are using python2.7 instead of python3 ?12:41
avassmnaser: since it works for python312:42
mnaseravass: weird, the only change that happened was addition of new dib images and thats it12:42
*** Goneri has joined #zuul12:42
avassmnaser: it should also work for python2.7 if the backported configparser is installed, could that be it?12:43
mnasermaybe something changed in debian world12:43
*** sshnaidm|afk is now known as sshnaidm12:45
tristanCcorvus: would it be possible to get a new zuul release?12:53
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: siblings: python2.7 ConfigParser has no __getitem__  https://review.opendev.org/73118713:04
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Constrain soupsieve to <2 for python2.7  https://review.opendev.org/73119513:04
avassAJaeger: looking at the logs I believe we need that ^ too: https://zuul.opendev.org/t/zuul/build/61626b13cc9543308c17962cdc5457cb13:05
*** sgw has joined #zuul13:05
openstackgerritTristan Cacqueray proposed zuul/zuul master: executor: add extra kubectl port-forward debug and releasenotes  https://review.opendev.org/73120013:09
corvustristanC: yes, i'll work on preparing that today; tristanC, tobiash: have either of you used the zk config with tls yet?13:23
corvusi was hoping we would get opendev to that point, but we haven't yet (we're close though).  but i agree, it's too long between releases and we shouldn't wait any more13:24
corvusstill, would be nice to have confirmation :)13:24
tobiashcorvus: not yet, we did a zk upgrade last week in preparation and are planning to switch to tls during one of the next few weekends13:24
tobiashbut we tested it in test and integration deployments13:24
tobiashthere it worked13:24
tobiashcorvus: shall we add a release note for step 2 in https://etherpad.opendev.org/p/zuulv4 before tagging?13:26
tobiashor would you do that via mailing list?13:26
corvustobiash: i think relnote is good for that13:26
corvus(and we'll also send to the list)13:26
corvusi'll write one up13:27
tristanCcorvus: same as tobiash, not enabled in production yet13:27
corvustobiash, tristanC: should this be the last 3.x?13:29
tobiashcorvus: according to the plan yes13:30
bolgyes :)13:30
corvusi figure we could either announce that this will be the last 3.x (unless we need a bugfix 3.x.y), or we could wait a little bit and see if there's anything else we want to release in 3.x and do another 3.x right before 4.013:30
tristanCwhere is the plan etherpad again?13:30
corvustristanC: https://etherpad.opendev.org/p/zuulv413:30
tobiashat least regarding stuff we're having in flight it's fine to do in a 4.0 release13:31
tristanCyep, makes sense to me13:31
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Constrain soupsieve to <2 for python2.7  https://review.opendev.org/73119513:43
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: siblings: python2.7 ConfigParser has no __getitem__  https://review.opendev.org/73118713:43
toskyzuul API question: I was able to retrieve the jobs and the inheritance information through the /api/tenant/{tenant}/jobs endpoing, but is there a way to know from which repository a job comes from?13:44
tobiashtosky: that's part of the source_context which is part of the json response of a job13:52
tobiashtosky: but that's part of the .../job/<name> endpoint13:53
fungihttps://zuul.opendev.org/api/tenant/openstack/job/openstack-tox-py3713:53
tobiashthe jobs endpoint doesn't provide this information13:53
fungi0.source_context.project there says openstack/openstack-zuul-jobs13:53
fungiand includes the branch and file13:54
fungijust remember it's going to return a list of matches, because a job can be defined on multiple branches13:54
toskyoh, thanks! Is there a way to make that endpoint appear on https://zuul.opendev.org/openapi ?13:56
tosky(I know it's written "incomplete")13:56
*** jamesmcarthur has joined #zuul13:56
corvustobiash: yes, it needs to be added to https://opendev.org/zuul/zuul/src/branch/master/web/public/openapi.yaml14:01
*** jamesmcarthur has quit IRC14:01
tobiashI know that :D14:01
corvustosky: ^ sorry :)14:01
*** jpena|lunch is now known as jpena14:04
toskyoh, no automagic extraction from some comment in the code?14:07
*** asaleh_ has quit IRC14:08
*** jamesmcarthur has joined #zuul14:09
corvustosky: nope, that's hand-edited14:12
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757814:12
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Fix py27 tox  https://review.opendev.org/73118714:13
tobiashtosky: as far as I understood the initial discussion around that it was non-trivial to auto extract that from the code14:14
openstackgerritJames E. Blair proposed zuul/zuul master: Add release note about the final 3.x release  https://review.opendev.org/73122114:18
corvustobiash, tristanC: ^14:18
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247814:20
tobiashcorvus: how shall we treat step 5 (Have all components connect to ZK, even if they just idle for now)?14:20
corvustobiash: oh that's a good point; we should revise that relnote about that14:21
tobiashthat is currently in the plan between 3.x and 4.0, but as far as I understood the release not would contradict what is stated there14:21
tobiashcorvus: do you think we should do idle, optional zk connections to all components with the 3.x release as well?14:22
tobiashoh wait, zk configuration for all components should be enough14:22
tobiashso I think tweaking the release note is enougb14:22
openstackgerritJames E. Blair proposed zuul/zuul master: Add release note about the final 3.x release  https://review.opendev.org/73122114:23
corvustobiash: ^ how's that?14:23
corvustobiash: so in 4.0, we make it an error if a component can't connect to zk14:24
tobiashlgtm14:24
AJaegermordred: could I trouble you with reviewing https://review.opendev.org/#/c/730334 again, please? and https://review.opendev.org/#/c/729348/ as well14:25
avasscorvus: the last sentence feels strange14:26
openstackgerritJames E. Blair proposed zuul/zuul master: Add release note about the final 3.x release  https://review.opendev.org/73122114:28
tristanCcorvus: next zuul release could also use this note: https://review.opendev.org/#/c/731200/14:28
corvusavass: ^ how's that?14:28
avasscorvus: should 'highly available' be 'high availability'?14:30
tobiashtristanC: there is a typo in the debug log14:30
corvustristanC: is that referring to a previous fix?  what was it?14:31
tobiashmaybe https://review.opendev.org/715308 ?14:32
avasscorvus: oh! got it, I was reading it wrong14:32
corvusavass: well, if you read it wrong it may mean i wrote it wrong :)14:32
avasscorvus: 'highly available and scaled-out schedulers' instead of 'scale-out' maybe?14:33
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757814:35
AJaegercorvus: I'm slowly beating this into submission ^. You invented some new filters like "issuperset" or "search", hope I rewrite them correctly...14:36
openstackgerritJames E. Blair proposed zuul/zuul master: Add release note about the final 3.x release  https://review.opendev.org/73122114:36
corvusavass: ^?14:36
*** hashar has joined #zuul14:38
avasscorvus: ++14:39
mordredcorvus: ++14:39
openstackgerritTristan Cacqueray proposed zuul/zuul master: executor: add extra kubectl port-forward debug and releasenotes  https://review.opendev.org/73120014:41
bolgcorvus: does https://review.opendev.org/731221 mean we can proceeed with reviews on https://review.opendev.org/c/630472 ?14:44
avassso this fixes py27 for VEXXHOST but breaks for zuul since python2-dev is missing: https://review.opendev.org/#/c/731187/14:48
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Fix py27 tox  https://review.opendev.org/73118714:49
AJaegeravass: fixed ^14:49
avassAJaeger: ah :)14:49
avassAJaeger: isn't it python2-devel for rpm though?14:51
AJaegerzuul-jobs-maint, we have a few test fails on zuul-jobs right now, avass is fixing them with 731187.14:51
AJaegeravass: I checked with openstack/project-config/nodepool/elements/bindep-fallback.txt14:52
corvusmordred, tristanC: i left a suggestion on the kubectl reno patch14:53
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247814:53
avassAJaeger: fedora is python2-devel but centos etc is python-devel14:56
AJaegeravass: "rpm -q --provides python2-devel" - I expect it provides python-devel for compatibility14:57
openstackgerritMerged zuul/zuul-jobs master: Remove unused tox_envlist in fetch-subunit-output  https://review.opendev.org/72934814:58
AJaegeravass: otherwise the fallback file would be broken and we would see reports for that14:58
avassAJaeger: the python-devel package looks like it installs python3 headers for me on fedora 31, but I'm not sure how bindep works exactly15:02
avassAJaeger: while the python2-devel package is needed for python2 headers15:03
AJaegeravass: interesting, hope ianw has an idea ^15:04
mordredavass: I imagine python-devel on f31 depends-on python3-devel15:04
mordredwe can be more specific than platform:rpm if we need to be15:05
avassmordred: I mean, it only installs python3-devel15:05
mordredyeah - I think what I'm saying is that rather than using python-dev or python-devel at all, we explicitly depend on python2-dev or python2-devel where we need them15:06
AJaegeravass: on centos8 it fails "No package python-devel available."15:06
mordredyeah. python-devel is too non-specific15:06
avassmordred: oh, yeah15:06
mordredI don't think there is any python2 on centos15:06
mordredI don't think there is any python2 on centos815:06
AJaegermordred: https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/bindep-fallback.txt15:07
AJaegermight need some updates15:07
clarkbhttps://apps.fedoraproject.org/packages/ is super useful for sorting out fedora15:07
AJaegeravass: for your change, exclude fedora and CentOS8. do you know what needs to be done or shall I update?15:07
mordredAJaeger: yeah- or, it just needs to go away15:07
mordredAJaeger: that file has needed to die for quite some time15:08
AJaegermordred: yeah15:08
AJaegerwe're not adding new files anymore to it but can't delete it completely yet15:08
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Fix py27 tox  https://review.opendev.org/73118715:09
avassAJaeger: you mean like that ^ ?15:09
mordredavass: yeah15:09
AJaegeravass: maybe "!platform:centos-8" ?15:12
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Fix py27 tox  https://review.opendev.org/73118715:12
avassAJaeger: done :)15:12
AJaegeravass: LGTM, gave my +2 in the hope it passes ;) Thanks15:13
*** Open10K8S has quit IRC15:16
*** Open10K8S has joined #zuul15:16
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757815:22
AJaegertristanC: want to review this change, please? https://review.opendev.org/731173 fixes ensure-haskell-stack15:24
openstackgerritMerged zuul/zuul-jobs master: Fix py27 tox  https://review.opendev.org/73118715:28
openstackgerritJeremy Stanley proposed zuul/zuul master: Docs: CPD between non-shared-queue changes  https://review.opendev.org/73124615:32
AJaegeryeah! Thanks, avass !15:32
avassno problem :)15:33
openstackgerritFabien Boucher proposed zuul/zuul master: Add missing dateutil requirement in requirements.txt  https://review.opendev.org/73124915:40
openstackgerritMerged zuul/zuul master: Gitlab - avoid duplicates in the cache  https://review.opendev.org/72866715:44
openstackgerritMerged zuul/zuul-jobs master: fetch-tox-output: empty envlist should behave like tox -e ALL  https://review.opendev.org/73033415:46
AJaegermordred, corvus, everybody, the configure-os-mirror change https://review.opendev.org/#/c/677578/ is updated and I now need help with the failures on Ubuntu and Debian. Could anybody dig into them and advise changes, please? Feel free to fix yourself.15:47
openstackgerritMerged zuul/zuul-jobs master: ensure-haskell-stack: Make sure dnf copr is installed  https://review.opendev.org/73117315:51
openstackgerritMatthieu Huin proposed zuul/zuul master: [WIP] web UI: add Autoholds Requests page  https://review.opendev.org/72930716:00
tobiashbolg: yes, after tagging16:02
mhutristanC, would you mind having a look at https://review.opendev.org/#/c/729307/ ? I need some react expertise :) when I try to access a autohold request page, I get an error "remoteData is undefined"16:03
mhuI've tried to mimic what was done for the single buildset page but I must have missed something16:03
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757816:10
AJaegerthis just syncs a bit more with configure-mirror - I'm still unclear why configure-mirror works but configure-os-mirrors fails for Ubuntu with "Destination directory /tmp/etc/apt does not exist", see https://zuul.opendev.org/t/zuul/build/2cb3bcada7fa4e26ab9d0bb3db1a60ce16:12
corvusbolg: oh sorry didn't mean to ignore you question earlier.  i agree with tobiash's response.16:13
*** rpittau is now known as rpittau|afk16:19
openstackgerritMerged zuul/zuul-jobs master: tox: envlist bugfixes  https://review.opendev.org/73038116:20
*** hashar has quit IRC16:28
avassAJaeger: why are they installed into /tmp/?16:30
avassAJaeger: should that be '/{{ zj_repo }}' instead of '/tmp/{{ zj_repo }}' ?16:33
AJaegeravass: indeed - how did I miss that before?16:35
AJaegerfixing...16:35
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757816:36
*** hashar has joined #zuul16:36
AJaegeravass: thanks!16:36
*** jcapitao has quit IRC16:43
avassAJaeger: I believe the other problem is that the templates are using the DEB822 format but doesn't have the .sources extension16:46
*** ysandeep is now known as ysandeep|away16:49
*** yolanda has quit IRC16:53
corvusmordred, tristanC, tobiash: can you look at my comment on https://review.opendev.org/731200 ?  i'd like to resolve that before the release (either by removing or changing the reno)16:54
openstackgerritTristan Cacqueray proposed zuul/zuul master: executor: add extra kubectl port-forward debug and releasenotes  https://review.opendev.org/73120016:56
tristanCcorvus: i kept the reno because i think it's an important fix16:57
corvustristanC: ok, wfm, thanks :)16:58
tobiash++16:58
corvusi think that's both outstanding release notes approved, so when they land, i'll tag the release16:59
tobiash:)16:59
tristanCcorvus: nice, thanks!16:59
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247817:10
*** jpena is now known as jpena|off17:10
*** fbo is now known as fbo|off17:11
openstackgerritMerged zuul/zuul master: Add release note about the final 3.x release  https://review.opendev.org/73122117:18
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757817:26
*** ianychoi has joined #zuul17:27
avassAJaeger: that should probably work a little better ^ :)17:28
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757817:42
AJaegerthanks, avass !17:53
*** hashar has quit IRC17:53
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add configure-os-mirrors role  https://review.opendev.org/67757817:53
openstackgerritMerged zuul/zuul master: executor: add extra kubectl port-forward debug and releasenotes  https://review.opendev.org/73120017:54
openstackgerritFabien Boucher proposed zuul/zuul master: Add missing python-dateutil requirement in requirements.txt  https://review.opendev.org/73124917:54
*** harrymichal has joined #zuul17:55
*** dpawlik has quit IRC17:59
openstackgerritMerged zuul/zuul master: Include extra, host, and group variables in job serialization  https://review.opendev.org/72975318:00
avassAJaeger: looks like it's just the ubuntu plain images that are failing now18:07
AJaegeravass: yeah18:09
AJaegerthe message is strange "You have broken packages"18:10
zbrwho worked on the fake zuul_return code?18:13
fungiavass: AJaeger: got a link? that's usually a case of dependency version mismatches18:14
avassAJaeger: it's a depency problem ,18:14
avassfungi: yeah18:14
avassfungi: this is what you want https://e7eb7933bc64c756eec0-cb65abe58d87a1a010092a9adcbaff91.ssl.cf5.rackcdn.com/677578/14/check/zuul-jobs-test-new-mirror-roles-ubuntu-bionic-plain/9f6c4f5/job-output.json18:14
avassfungi: python3-pip : Depends: python-pip-whl18:14
zbri managed to propose a generic workaround at https://github.com/ansible/ansible-lint/pull/801 maybe you can help me with some feedback.18:15
avasszbr: ++18:16
avasszbr: if you want to make it better you could make it handle it's exit with exit_json() as well18:17
zbrwell, i am not proud of the implementation, hacking env inside __init__, maybe someone will have better ideas.18:17
avasszbr: like this https://review.opendev.org/#/c/728684/23/tests/fake-ansible/library/zuul_return.py18:17
zbrfor the moment I only want to add basic faking support18:17
*** jamesmcarthur has quit IRC18:17
avasszbr: ah, I'll take a close look later then :)18:18
*** jamesmcarthur has joined #zuul18:18
*** jamesmcarthur has quit IRC18:19
*** jamesmcarthur has joined #zuul18:19
openstackgerritOleksandr Kozachenko proposed zuul/zuul-jobs master: Add the namespace in wait-for-pods role  https://review.opendev.org/73129218:38
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Add CentOS-8 support  https://review.opendev.org/73129318:38
AJaegeravass: I'm bringing in CentOS-8 support but stack this on top for now, we can squeeze later. Didn't want to interfere with any edits you might have in flight ^18:39
avassAJaeger: ah, I don't have any :)18:40
AJaegeravass: that's sad ;)18:40
openstackgerritSorin Sbarnea (zbr) proposed zuul/zuul-jobs master: Bump ansible-lint to 4.3.0  https://review.opendev.org/70267918:41
AJaegerso, why is our job failing but configure-mirror working? Or are we just not testing that?18:41
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247818:42
avassAJaeger: trying to figure that out at the moment18:43
*** jamesmcarthur has quit IRC18:43
AJaegerthanks18:44
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247818:45
fungiavass: so looking at the error (sorry got sidetracked by something else) it's trying to install the python3-pip version from the bionic release suite while newer python-pip-whl from the bionic-updates suite is already installed and would have to be downgraded to satisfy the strict version dependency18:49
fungiso the question is why isn't it trying to install python3-pip from bionic-updates18:50
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Add CentOS-8 support  https://review.opendev.org/73129318:51
openstackgerritOleksandr Kozachenko proposed zuul/zuul-jobs master: Add the namespace in wait-for-pods role  https://review.opendev.org/73129218:51
fungiavass: it looks like the answer is that we've built the image with packages from the bionic-updates suite but are only including bionic and bionic-security suites in the sources.list18:51
clarkbfungi: possible that we never added bionic-updates in after the repos actually existed and that it never caused a problem until now?18:52
clarkbiirc updates is the one that routinely gives us trouble with reprepro18:53
fungiclarkb: i expect it's that the ubuntu-bionic-plain images don't have pip preinstalled, while our ubuntu-bionic images do, so aren't exercising this code path18:53
clarkbah18:53
*** jamesmcarthur has joined #zuul18:54
fungialso we did work out the solution to reprepro mirroring "empty" -security and -updates suites, there's a command you can run to force it to create the indices for all configured suites even if some are empty18:54
AJaegeravass: in general, we need to check what is done for configure-mirrors and sync... CentOS-8 support was the first thing coming to mind.18:54
fungiclarkb: as for why we're only seeing it for that change, i think it's because the change is incomplete (its the work for our next-generation mirror handling role)18:55
*** jamesmcarthur has quit IRC18:55
*** jamesmcarthur has joined #zuul18:55
fungibut i haven't looked closely enough at it yet18:55
avassfungi, AJaeger: ah okay18:56
clarkbfungi: zuul-jobs/roles/configure-mirror does appear to configure updates for ubuntu nodes18:56
clarkbso that repo should be available on all our bionic hosts I think18:56
AJaegerfungi: yeah, I'm fear it's incomplete - it's a change from September 2019 that we just barely have working ;)18:57
fungiAJaeger: hey, it sounds remarkably close!18:57
AJaegeryeah, I'm suprised how much seems to pass - I started with patch set 2 8 hours ago, now thanks to avass' help, we're at number 14 ;)18:58
*** jamesmcarthur has quit IRC18:59
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add updates mirror  https://review.opendev.org/73130519:01
avassfungi: I'm guessing something like that ^ should be enough to get the tests to pass then19:01
avassfungi: since we're not separating the files, at least not yet19:02
openstackgerritMatthieu Huin proposed zuul/zuul master: Web UI: add "held" information, filtering in Builds page  https://review.opendev.org/72926519:05
*** jamesmcarthur has joined #zuul19:06
fungiavass: likely, though i also noticed in the log you linked that the node was pulling package indices for both xenial and bionic rather than just bionic19:11
fungiprobably those entries should be grouped by release, not by suite type19:12
*** sshnaidm is now known as sshnaidm|afk19:12
fungisuites: ['bionic', 'bionic-security', 'bionic-updates']19:13
fungithough i'm unclear as to how the task which installs the sources.list is supposed to filter entries by release19:14
avassfungi: yep19:14
*** jamesmcarthur has quit IRC19:15
*** jamesmcarthur has joined #zuul19:15
fungilooking at the data model, maybe our zuul_site_mirror_info keys should be like debian-buster and ubuntu-bionic rather than just debian and ubuntu19:15
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Add CentOS-8 support  https://review.opendev.org/73129319:21
*** rlandy is now known as rlandy|biab19:23
avassfungi: it's currently filtering it by checking ansible_distribution_release :)19:24
fungiavass: and matching against what in the current data structure?19:25
fungiavass: oh! this is a test payload19:26
fungiso it's trying to install multiple releases just to exercise the list generation bits19:26
fungiand is not representative of a real-world variable set19:27
avassyeah19:27
avassfungi: but I guess that wouldn't work otherwise since the suite doens't need to include the release right?19:28
fungiavass: yes, it's merely convention19:29
fungiavass: for some of my personal package repositories, the suite is merely "./" and the component list is empty19:30
fungiand that works just fine19:30
avassfungi: any idea why https://zuul.opendev.org/t/zuul/build/3ba6859891ec44c99b2fc271af0df1a9 fails?19:32
fungii think the idea here though is that we say we want the default ubuntu bionic sources and then pass in the appropriate variables for a given set of entries19:32
fungiwhich in turn generates the entries for bionic, bionic-security and bionic-updates suites19:32
*** jamesmcarthur has quit IRC19:33
fungibut we may also add variables to declare other entries, like nodesource or something19:33
*** jamesmcarthur has joined #zuul19:35
fungiavass: that "Zuul clone something not in required-projects" task looks obsolete... we haven't supported the zuul-cloner shim in ages i didn't think (anyway it's not preinstalled on that image)19:35
avassfungi: yeah, I was thinking more of the os_testr import19:36
fungioh, nevermind, i misread that task19:36
*** harrymichal has quit IRC19:39
fungiyeah, so /usr/os-testr-env/ seems to have a subunit2html entrypoint which can't import from os_testr.subunit2html19:39
fungithat's weird19:39
avassyeah :)19:39
fungii'll pull up an image build log and see if i can tell what goes on to create that env19:39
fungi2020-05-25 05:54:32.722 in https://nb01.opendev.org/ubuntu-xenial-plain-0000014730.log is where the venv is created19:40
fungierror: invalid command 'bdist_wheel'19:41
fungithe errors there make me wonder if pip or setuptools is too old19:41
*** hashar has joined #zuul19:41
clarkbbdist_wheel required the wheel package for a while right? did it ever get pulled into pip/setuptools themselves?19:42
fungior it's an issue with the distutils in py35 on xenial19:42
avassclarkb: doesn't look like it19:44
fungiclarkb: oh, yeah, could be we need to explicitly include wheel in the venv under 3.519:44
clarkbfungi: ya that would be my guess19:44
fungiit's included in newer venvs19:44
fungichecking now to see how far back19:45
fungihuh actually not with any of my upstream python builds from 3.5 through 3.9 beta19:47
fungionly pip and setuptools are seeded19:47
fungiso i must have misremembered that19:47
guilhermesphey ya! So currently ensure-tox installs tox inside a python-venv right? I think we are having issues when we are using non-system python19:47
fungiwe should probably directly install wheel if in there if we need to install sdists19:47
guilhermesphttps://www.irccloud.com/pastebin/CulApC95/19:47
fungiguilhermesp: looks like ansible is using python 2.7 there, i wonder if pkg_resources is only installed for python 3.x19:49
mnaserguilhermesp: i think this is the thing where we workaround installing python3-tox19:50
mnasererrr, python3-venv19:50
mnaserut we don't do it for python2-venv ?19:50
fungiwe did just discuss today that apparently ansible still defaults to using python2 with legacy-auto19:50
mnaserit must have spurred up recently because we had no change other than just new nodepool images being uploaded19:51
clarkbya I think there may have been different expectations for ansible python choice19:51
clarkbauto is supposed to prefer python3 if present but the default is auto legacy19:52
clarkbthough mordred mentioned nodepool should be setting auto. Maybe we aren't doing that properly or auto in ansible is buggy?19:52
*** jamesmcarthur has quit IRC19:53
*** jamesmcarthur has joined #zuul19:56
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Sync with configure-mirrors  https://review.opendev.org/73129319:59
AJaegeravass: this syncs all relevant changes from configure-mirrors over, we can squash the changes once the above is fine ^20:00
avassAJaeger: sure!20:01
openstackgerritAlbin Vass proposed zuul/zuul-jobs master: Add updates mirror  https://review.opendev.org/73130520:01
avassI think I'm going to quit for today, have a good evening :)20:02
corvusclarkb, mnaser, mordred: nodepool defaults to telling zuul to tell ansible to use "auto" for the python interpreter, but if it's "auto" zuul will set it to "python2" for ansible < 2.8 since auto isn't supported in 2.720:02
corvusyou can confirm what was given to ansible in the logs; eg: https://zuul.opendev.org/t/openstack/build/323025c9d3ea4a898e1ffa56b176b1f0/log/zuul-info/inventory.yaml#720:02
corvusguilhermesp: ^20:03
AJaegeravass: unfortunatley all broken right now ;(20:03
AJaegeravass: I'll quit soon as well - good night20:04
guilhermespyes i can see here for our debian-buster corvus ansible_python_interpreter: auto20:06
mnaserso does that mean ansible has autodetected auto to py27 on debian buster even if its not set to legacy-auto? :X20:07
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Sync with configure-mirrors  https://review.opendev.org/73129320:08
clarkbmnaser: yes I think so. Its possible that is a bug, but may also be intended behavior20:09
clarkbapparently there is some lookup table ansible uses in the auto case20:09
*** olaph has joined #zuul20:09
mnaserclarkb: yeah i remember that file20:09
*** jamesmcarthur has quit IRC20:11
*** harrymichal has joined #zuul20:12
openstackgerritAndreas Jaeger proposed zuul/zuul-jobs master: WIP: Sync with configure-mirrors  https://review.opendev.org/73129320:13
AJaegeravass: stacked them all on top of each other, if those pass, let's squash all three and review ;)20:14
* AJaeger waves good night20:14
*** jamesmcarthur has joined #zuul20:16
*** jamesmcarthur has quit IRC20:20
openstackgerritOleksandr Kozachenko proposed zuul/zuul-jobs master: Add namespace in the collect-k8s-logs role  https://review.opendev.org/73131920:21
*** jamesmcarthur has joined #zuul20:21
*** harrymichal has quit IRC20:23
*** jamesmcarthur has quit IRC20:28
*** jamesmcarthur has joined #zuul20:29
*** harrymichal has joined #zuul20:34
*** jamesmcarthur has quit IRC20:35
*** nils has quit IRC20:42
*** jamesmcarthur has joined #zuul20:49
corvusclarkb, tobiash, mordred, tristanC: does https://zuul-ci.org/docs/zuul/reference/releasenotes.html look good?20:49
corvusclarkb, tobiash, mordred, tristanC: and does this look right? commit 6161ad75a83cd8e8c3bd347ea7f40b0e2d6b5c33 (HEAD -> master, tag: 3.19.0, origin/master, origin/HEAD)20:50
openstackgerritLida Liu proposed zuul/zuul master: WIP: Add commit id to Change for mqtt reporter  https://review.opendev.org/72247820:51
tobiashcorvus: reading20:51
clarkbcorvus: maybe we should note that the sql connection is only needed for scheduler and web (we note that zk will be universal)20:52
clarkbbut ya I think it looks good and gives people a clear path forward20:52
mordredcorvus: looks good!20:54
tobiashclarkb: I think that's a general good addition to the docs (imho no need to put that info into the release note)20:54
tobiashcorvus: release notes and hash lgtm20:54
* clarkb checks the hash now20:54
clarkb6161ad75a83cd8e8c3bd347ea7f40b0e2d6b5c33 is what I see as HEAD -> master as well. so that hash lgtm20:56
corvuszuul actual is go for tagging 3.19.020:58
* mordred wants to know some official sounding response to that21:11
corvushttps://pypi.org/project/zuul/3.19.0/ exists21:12
corvusoh, we need to tag nodepool too21:13
*** hashar has quit IRC21:14
corvustobiash, clarkb, mordred, tristanC: commit fa2a850cb93066df04ae8ff5bebf4a42554ca0e4 (HEAD -> master, tag: 3.13.0, origin/master, origin/HEAD)21:14
corvusthat look right for nodepool?21:14
tobiash++21:15
tobiashwow there was a long time since the last release21:16
clarkbfa2a850cb93066df04ae8ff5bebf4a42554ca0e4 is what I see too. lgtm. Tag version looks correct too. There was at least one feature added (the inheritance of image specs)21:16
mordred++21:16
corvuspushed; i'll prep announcement emails21:16
mordredso I guess we have to start reviewing all the bolg patches now21:16
corvushttps://pypi.org/project/nodepool/3.13.0/ exists21:27
corvusemail sent21:27
*** saneax has quit IRC21:34
*** jamesmcarthur_ has joined #zuul21:37
tobiashmordred: the change queue patches and cdep would be awesome as well :)21:40
*** jamesmcarthur has quit IRC21:41
corvusi'm planning on reviewing cdep with a fresh brain tomorrow; i'm +2 on the queue21:44
corvusi also pointed the queue patches out to some other opendev folks to make sure they're okay with the implications (so far so good)21:45
tobiashcorvus: thanks!21:45
*** jamesmcarthur_ has quit IRC21:48
*** harrymichal has quit IRC21:49
*** jamesmcarthur has joined #zuul22:03
*** rlandy|biab is now known as rlandy22:04
* fungi cheers zuul 3.19.0 and nodepool 3.13.0 from the sidelines22:10
corvusfungi: soon we get to cough politely when someone says "zuul v3"22:16
fungithe python community will be doing the same once python 4 releases and still uses /usr/bin/python3 as its executable name ;)22:18
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: shake-build: add shake build system job  https://review.opendev.org/73136522:21
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: shake-build: add shake build system job  https://review.opendev.org/73136522:22
tristanCcorvus: is it me or the new timezone selector is missing from the https://zuul.opendev.org deployment?22:27
tristanCand congrats for the release, well done!22:28
corvustristanC: we may need a container restart now (we used to deploy web near-continuously, but i think since we switched to containers, we'll need to restart)22:29
clarkbwe can probably switch web back to restarting on container update22:30
corvushrm, i just pulled and restarted and still don't see it22:30
clarkbits a separate config to schedyler22:30
corvusmore investigation may be warranted :/22:30
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: WIP: shake-build: add shake build system job  https://review.opendev.org/73136522:34
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: WIP: shake-build: add shake build system job  https://review.opendev.org/73136522:46
*** guillaumec has quit IRC22:46
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: shake-build: add shake build system job  https://review.opendev.org/73136523:04
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: shake-build: add shake build system job  https://review.opendev.org/73136523:14
openstackgerritPierre-Louis Bonicoli proposed zuul/zuul master: last3x release note: fix a typo  https://review.opendev.org/73137223:16
*** tosky has quit IRC23:30
openstackgerritPierre-Louis Bonicoli proposed zuul/nodepool master: doc: openshiftpods handles python-path too  https://review.opendev.org/73137323:38
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: shake-build: add shake build system job  https://review.opendev.org/73136523:40
*** Goneri has quit IRC23:49
*** jamesmcarthur has quit IRC23:50
*** jamesmcarthur has joined #zuul23:54

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!