| @pedromoritz:matrix.org | Clark: Unfortunately, It does not work as it supposed to. Apparently an ubuntu:bionic Docker image is not enough to run the jobs properly. Where should I find a image definition for the nodes running on Kubernetes? | 02:15 |
|---|---|---|
| @pedromoritz:matrix.org | * Clark: Unfortunately, It does not work as it supposed to. Apparently an ubuntu:bionic Docker image is not enough to run the jobs properly. Where should I find an image definition for the nodes running on Kubernetes? | 02:15 |
| @q:fricklercloud.de | > <@q:fricklercloud.de> looking at https://zuul.opendev.org/t/openstack/project/opendev.org/openstack/devstack# I see 12 tabs named "master", but from looking at the jobs, some of those should correlate to stable branches. | 06:44 |
| can anyone reproduce this? is it a bug or expected behavior somehow? seems to affect any project with branches, devstack is just an example | ||
| @gtema:matrix.org | `AttributeError: 'ZuulWeb' object has no attribute 'wsplugin'` - is this exception known to anybody who tried update to 5.1.0? | 08:36 |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 835011: Don't yield to a provider with unsupported labels https://review.opendev.org/c/zuul/nodepool/+/835011 | 08:46 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 830840: Make it possible to configure job retries with zuul_return https://review.opendev.org/c/zuul/zuul/+/830840 | 09:08 | |
| -@gerrit:opendev.org- Dong Zhang marked as active: [zuul/zuul] 834857: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 09:39 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 835019: tools/test-setup-docker.sh run zookeeper inside a shell https://review.opendev.org/c/zuul/zuul/+/835019 | 09:40 | |
| @avass:vassast.org | Clark: I've tried zookeeper versions down to v3.5 with `tools/test-setup-docker.sh` and they all seem to have the same issue. I guess for some reason zookeeper doesn't like being pid 1 | 09:40 |
| @avass:vassast.org | tobiash: do you want to renew your +2 on: https://review.opendev.org/c/zuul/zuul/+/830840 ? I noticed a hole in the testcase | 09:42 |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 835040: Replace Python 3.6 with 3.10 test job https://review.opendev.org/c/zuul/nodepool/+/835040 | 11:09 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 835040: Replace Python 3.6 with 3.10 test job https://review.opendev.org/c/zuul/nodepool/+/835040 | 11:10 | |
| -@gerrit:opendev.org- Simon Westphahl proposed on behalf of Sorin Sbârnea: [zuul/zuul-jobs] 821247: Add tox-py310 job https://review.opendev.org/c/zuul/zuul-jobs/+/821247 | 11:21 | |
| -@gerrit:opendev.org- Simon Westphahl proposed on behalf of Sorin Sbârnea: [zuul/zuul-jobs] 821247: Add tox-py310 job https://review.opendev.org/c/zuul/zuul-jobs/+/821247 | 11:26 | |
| -@gerrit:opendev.org- Simon Westphahl proposed on behalf of Sorin Sbârnea: [zuul/zuul-jobs] 821247: Add tox-py310 job https://review.opendev.org/c/zuul/zuul-jobs/+/821247 | 11:29 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 835040: Replace Python 3.6 with 3.10 test job https://review.opendev.org/c/zuul/nodepool/+/835040 | 11:32 | |
| -@gerrit:opendev.org- Simon Westphahl proposed: [zuul/nodepool] 835040: Replace Python 3.6 with 3.10 test job https://review.opendev.org/c/zuul/nodepool/+/835040 | 11:34 | |
| @fungicide:matrix.org | > <@pedromoritz:matrix.org> Clark: Unfortunately, It does not work as it supposed to. Apparently an ubuntu:bionic Docker image is not enough to run the jobs properly. Where should I find an image definition for the nodes running on Kubernetes? | 11:55 |
| can you expand on what you mean by "not enough to run the jobs properly"? is ansible unable to connect? | ||
| -@gerrit:opendev.org- Simon Westphahl proposed on behalf of Sorin Sbârnea: [zuul/zuul-jobs] 821247: Add tox-py310 job https://review.opendev.org/c/zuul/zuul-jobs/+/821247 | 12:25 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 13:15 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 13:18 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 835074: Recover from broken process pools in merge operations https://review.opendev.org/c/zuul/zuul/+/835074 | 13:30 | |
| @avass:vassast.org | tobiash: I think you may be interested in that ^ | 13:30 |
| @jim:acmegating.com | swest: do we need to add py3.10 at the same moment we remove py36? | 13:34 |
| @westphahl:matrix.org | corvus: probably not. I can split that up | 13:34 |
| @jim:acmegating.com | swest: sounds good -- we can consider dropping 3.9 when we do that... i don't think we necessarily want to run all the versions; usually just a lower and upper; and the upper should be what we build images from i think... and we should get zuul and nodepool back in sync... | 13:37 |
| -@gerrit:opendev.org- Simon Westphahl proposed: | 13:41 | |
| - [zuul/nodepool] 835040: Drop support for Python 3.6 https://review.opendev.org/c/zuul/nodepool/+/835040 | ||
| - [zuul/nodepool] 835075: Run tests for Python 3.10 https://review.opendev.org/c/zuul/nodepool/+/835075 | ||
| @jim:acmegating.com | zuul-maint: https://review.opendev.org/835040 is high priority to unblock nodepool | 13:52 |
| -@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 816509: zuul-gui: add more documentation about public URL https://review.opendev.org/c/zuul/zuul/+/816509 | 13:53 | |
| @mhuin:matrix.org | tobiash: regarding your review of https://review.opendev.org/c/zuul/zuul/+/831948 : this change only makes sense if the depends-on is merged, ie https://review.opendev.org/c/zuul/zuul-client/+/831946 - however full browser auth in the CLI may not make much sense | 13:58 |
| @jim:acmegating.com | mhu: what's going on with https://review.opendev.org/834507 ? | 14:18 |
| @mhuin:matrix.org | corvus: we needed to backport this for SF, we'll ship zuul 5.0.0 in the next release | 14:21 |
| @mhuin:matrix.org | it's easier for our patching process to have a patch upstream but if this is problematic I can abandon it | 14:22 |
| @mhuin:matrix.org | I don't want to add extra noise | 14:23 |
| @jim:acmegating.com | mhu: i think that might be best :) | 14:24 |
| @mhuin:matrix.org | got it, apologies | 14:24 |
| @jim:acmegating.com | np. thanks for having a patching process that favors upstream :) | 14:25 |
| -@gerrit:opendev.org- Joshua Watt proposed: [zuul/nodepool] 833099: openstack: Keep node request on quota failure https://review.opendev.org/c/zuul/nodepool/+/833099 | 14:27 | |
| @mhuin:matrix.org | The original patch is still up for review though: https://review.opendev.org/c/zuul/zuul/+/830846 - I see I forgot to answer one of your comment on the other gui patch | 14:29 |
| -@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 832293: REST API: cache tenants list https://review.opendev.org/c/zuul/zuul/+/832293 | 14:30 | |
| -@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 816509: zuul-gui: add more documentation about public URL https://review.opendev.org/c/zuul/zuul/+/816509 | 14:32 | |
| -@gerrit:opendev.org- Matthieu Huin https://matrix.to/#/@mhuin:matrix.org proposed: [zuul/zuul] 831222: GUI: Do not show sign-in button if no IdP is available https://review.opendev.org/c/zuul/zuul/+/831222 | 14:46 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Albin Vass: [zuul/zuul] 830840: Make it possible to configure job retries with zuul_return https://review.opendev.org/c/zuul/zuul/+/830840 | 14:50 | |
| @avass:vassast.org | corvus: I'm trying to dig into 835019 a bit, so I just wanna check what version of docker you're on and if happen to use any cached zookeeper image? | 14:51 |
| @avass:vassast.org | it's quite annoying to have to stash that line of code to get the unittests to work :) | 14:54 |
| @jim:acmegating.com | Albin Vass: i just did a docker-compose pull so should have the latest -- `Docker version 20.10.7, build 20.10.7-0ubuntu5~21.04.2` running on Ubuntu 21.04 | 14:55 |
| @jim:acmegating.com | Albin Vass: and yeah... it feels like we're missing something | 14:56 |
| @avass:vassast.org | corvus: the only difference I see is that the entrypooint ends with a `exec $@` which leaves zookeeper running as pid 1, so `sh -c ...` avoids that. | 14:57 |
| @avass:vassast.org | but I don't understand why it's working for some people and not for others. | 14:57 |
| @pedromoritz:matrix.org | fungi: Yes, Ansible is able to connect. However, the job i am running seems to need sudo, iproute2 and python pre-installed. Another problem: after installed by Ansible, mysql-server cant start. | 14:58 |
| @avass:vassast.org | I'm on ubuntu 20.04, docker version 20.10.14 | 14:58 |
| -@gerrit:opendev.org- Joshua Watt proposed: [zuul/nodepool] 833099: openstack: Keep node request on quota failure https://review.opendev.org/c/zuul/nodepool/+/833099 | 15:00 | |
| @jim:acmegating.com | Albin Vass: also fwiw, opendev runs zk out of docker-compose without any changes to the entrypoint/cmd. that's running `Docker version 20.10.12, build e91ed57` on ubuntu 20.04 | 15:03 |
| @jim:acmegating.com | (but `network_mode: host` in that case) | 15:04 |
| -@gerrit:opendev.org- Zuul merged on behalf of Simon Westphahl: [zuul/nodepool] 835040: Drop support for Python 3.6 https://review.opendev.org/c/zuul/nodepool/+/835040 | 15:04 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Benjamin Schanzel: [zuul/nodepool] 834109: Pass requestor data to Nodes https://review.opendev.org/c/zuul/nodepool/+/834109 | 15:04 | |
| @avass:vassast.org | well... now it suddenly started working so I'm a bit clueless | 15:22 |
| -@gerrit:opendev.org- Zuul merged on behalf of Tobias Henkel: [zuul/nodepool] 752022: Add zookeeper-timeout connection config https://review.opendev.org/c/zuul/nodepool/+/752022 | 15:23 | |
| -@gerrit:opendev.org- Zuul merged on behalf of Ian Wienand: [zuul/nodepool] 831895: functional-test : ensure glean started https://review.opendev.org/c/zuul/nodepool/+/831895 | 15:23 | |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 15:32 | |
| @avass:vassast.org | oh, nvm got confused by test output. But I think I found something after adding some logging. Without a shell zookeeper gets Access denied when creating the keystore. | 15:34 |
| https://paste.opendev.org/show/bDOe4Hp6DDh096LqAyKc/ | ||
| @avass:vassast.org | heh this looks very suspicious in the entrypoint: | 15:41 |
| ``` | ||
| # Allow the container to be started with `--user` | ||
| if [[ "$1" = 'zkServer.sh' && "$(id -u)" = '0' ]]; then | ||
| chown -R zookeeper "$ZOO_DATA_DIR" "$ZOO_DATA_LOG_DIR" "$ZOO_LOG_DIR" | ||
| exec gosu zookeeper "$0" "$@" | ||
| fi | ||
| ``` | ||
| @jim:acmegating.com | Albin Vass: ah. my local uid is 1000 and so is the zookeeper user inside the container, so that is running but is a noop for me. opendev sets the docker user to 10001 so that doesn't run. | 15:45 |
| @avass:vassast.org | yep :) | 15:45 |
| -@gerrit:opendev.org- Dong Zhang proposed: [zuul/zuul] 834857: Fix bug in getting changed files https://review.opendev.org/c/zuul/zuul/+/834857 | 16:11 | |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/nodepool] 834519: Correct tagged version docs build https://review.opendev.org/c/zuul/nodepool/+/834519 | 16:29 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 835019: Start zookeeper with users uid in test-setup-docker.sh https://review.opendev.org/c/zuul/zuul/+/835019 | 16:46 | |
| -@gerrit:opendev.org- Albin Vass proposed: [zuul/zuul] 835019: Start zookeeper with users uid in test-setup-docker.sh https://review.opendev.org/c/zuul/zuul/+/835019 | 16:47 | |
| @avass:vassast.org | corvus: that should fix it ^ | 16:47 |
| @avass:vassast.org | d-j-j, frickler , Clark ^ | 16:48 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835100: Rely on the unparsed config cache in reconfigurations https://review.opendev.org/c/zuul/zuul/+/835100 | 17:11 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835100: Rely on the unparsed config cache in reconfigurations https://review.opendev.org/c/zuul/zuul/+/835100 | 17:56 | |
| @fungicide:matrix.org | > <@pedromoritz:matrix.org> fungi: Yes, Ansible is able to connect. However, the job i am running seems to need sudo, iproute2 and python pre-installed. Another problem: after installed by Ansible, mysql-server cant start. | 20:23 |
| it really depends on how you want your jobs to work. most of the jobs i deal with are intended to install any packages they need during the build, usually in a pre-run phase playbook, in order to keep the images as minimal and general-purpose as possible | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835121: Fix Ansible plugin loading https://review.opendev.org/c/zuul/zuul/+/835121 | 20:52 | |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835125: DNM: baseline test zuul-stream-functional https://review.opendev.org/c/zuul/zuul/+/835125 | 21:16 | |
| @ecsantos:matrix.org | Hello folks | 21:46 |
| @ecsantos:matrix.org | Is there a way to recreate this role documentation [1] manually without using the zuul-sphinx extension? | 21:46 |
| [1] https://zuul-ci.org/docs/zuul-jobs/general-roles.html#role-add-build-sshkey | ||
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835121: Fix Ansible plugin loading https://review.opendev.org/c/zuul/zuul/+/835121 | 21:50 | |
| @jim:acmegating.com | ecsantos: it's generated from this rst file source: https://opendev.org/zuul/zuul-jobs/raw/branch/master/roles/add-build-sshkey/README.rst | 21:55 |
| @ecsantos:matrix.org | corvus: Yes, but in order for this .. zuul:rolevar:: syntax to work, I'll need to install the zuul-sphinx extension, right? | 21:57 |
| @jim:acmegating.com | ecsantos: yes, those sphinx roles are implemented by zuul-sphinx. | 21:58 |
| -@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 835100: Rely on the unparsed config cache in reconfigurations https://review.opendev.org/c/zuul/zuul/+/835100 | 22:00 | |
| @ecsantos:matrix.org | corvus: So there's no way of manualy formatting my RST like that without zuul-sphinx? | 22:00 |
| @jim:acmegating.com | ecsantos: erm, well, you could probably reverse-engineer zuul-sphinx and type in some sphinx syntax that accomplished something that looked similar. but if you're talking about zuul/ repos (like zuul-jobs) please don't -- we want all the docs in that format. | 22:05 |
| @ecsantos:matrix.org | corvus: Oh no, it's for my own private repos :) Thanks! I was just curious on how the formatting was generated | 22:07 |
| @jim:acmegating.com | ecsantos: iirc, i don't think that exact formatting can be achieved with plain rst; it requires a sphinx domain (so it actually has more in common with the python library documentation than plain restructuredtext). in other words, no plain rst parser would be able to handle it; only one that understood the sphinx syntax. | 22:10 |
| @mnaser:matrix.org | Is there a pattern out there for Zuul jobs that are "optional" and modify the behaviour of other jobs if they run or not? For example, I have a folder containing a bunch of Docker image definitions, I don't want to build this on every run since it will take a significant amount of resources, so I only want to rebuild images if the `images/` folder has changes. However, I need to actually figure out a way to set the prefix for all images to point at an existing registry (if the images were not built), or point at the buildset registry (if the images were built). Any suggestions? | 22:13 |
| @ecsantos:matrix.org | corvus: That sounds like more work than I initially thought it'd be. It's just that I'm hesitant to add new requirements to my projects, but I'll probably end up using zuul-sphinx then, its formatting makes a lot of sense for roles | 22:13 |
| @ecsantos:matrix.org | Anyway, thanks for the info! :) | 22:13 |
| @jim:acmegating.com | ecsantos: yeah, i think we tried to do it with plain rst, but it was just clunky enough to make it worth using a plugin. | 22:15 |
| @jim:acmegating.com | mnaser: the docker roles in zuul-jobs are designed so that you can always point to the "real" names and the buildset registry is a hidden implementation detail. if there's a built image, it will use that, otherwise it will pull it from elsewhere. | 22:19 |
| @jim:acmegating.com | (so for example, if a zuul change depends-on a nodepool change, we'll get the built nodepool image in the zuul-quick-start job (which runs container images); otherwise we'll get the published one. | 22:20 |
| @jim:acmegating.com | * (so for example, if a zuul change depends-on a nodepool change, we'll get the built nodepool image in the zuul-quick-start job (which runs container images); otherwise we'll get the published one.) | 22:20 |
| @jim:acmegating.com | * (so for example, if a zuul change depends-on a nodepool change, we'll get the built nodepool image in the zuul-quick-start job (which runs container images); otherwise we'll get the latest published one from dockerhub.) | 22:20 |
| @mnaser:matrix.org | hrmm, okay, I've got a few 'steps' in between zuul and the image names (like.. running molecule driven by zuul which deploys stuff inside kubernetes).. so i think i'll do a little bit of research on how the roles take care of this | 22:21 |
| @mnaser:matrix.org | as i'm dredging those roles, are my eyes lying to me or this seems pretty redundant? https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/run-buildset-registry/tasks/main.yaml#L1-L17 | 22:27 |
| @mnaser:matrix.org | it looks like use of python's passlib was removed which made the lists identical, but no one merged the tasks, heh -- v | 22:28 |
| @mnaser:matrix.org | * it looks like use of python's passlib was removed which made the lists identical, but no one merged the tasks, heh -- https://opendev.org/zuul/zuul-jobs/commit/4cc307699d2d0bd1d3faee0c9d8c47c850557f52 | 22:28 |
| -@gerrit:opendev.org- Mohammed Naser proposed: [zuul/zuul-jobs] 835156: run-buildset-registry: Drop extra install packages task https://review.opendev.org/c/zuul/zuul-jobs/+/835156 | 22:30 | |
| @mnaser:matrix.org | ok so looks like the way its done using use-buildset-registry is that it configures `/etc/containers/registries.conf` to include an additional mirror that points towards the build set registry, then falling back to the 'original' prefi | 22:42 |
| @mnaser:matrix.org | pretty clever way of getting that fallback if needed | 22:42 |
| -@gerrit:opendev.org- Zuul merged on behalf of James E. Blair https://matrix.to/#/@jim:acmegating.com: [zuul/zuul] 835121: Fix Ansible plugin loading https://review.opendev.org/c/zuul/zuul/+/835121 | 23:06 | |
| @jim:acmegating.com | zuul-maint: this look okay for a zuul release? commit 6214731f8bd3ce96b2431c1b87bcf64cf43ff3da (HEAD -> master, tag: 5.2.0, origin/master, gerrit/master, refs/changes/21/835121/2) | 23:07 |
| @jim:acmegating.com | pushed | 23:13 |
| @fungicide:matrix.org | lgtm, thanks! | 23:19 |
| @mnaser:matrix.org | welp, looks like ensure-kubernetes + crio is borked | 23:20 |
| @mnaser:matrix.org | https://github.com/kubernetes/minikube/issues/13816 | 23:21 |
| @mnaser:matrix.org | https://github.com/kubernetes/minikube/commit/921816747a5101d4f8e4a3dff0e37cce609234d7 | 23:23 |
| @mnaser:matrix.org | looks like it's making certain assumptions that don't exist in our vms (because we use minikube with 'none' driver so it it using the host system) | 23:23 |
| -@gerrit:opendev.org- Mohammed Naser proposed: | 23:29 | |
| - [zuul/zuul-jobs] 835156: run-buildset-registry: Drop extra install packages task https://review.opendev.org/c/zuul/zuul-jobs/+/835156 | ||
| - [zuul/zuul-jobs] 835162: ensure-kubernetes: fix missing 02-crio.conf https://review.opendev.org/c/zuul/zuul-jobs/+/835162 | ||
| @jim:acmegating.com | release announcement sent | 23:41 |
| -@gerrit:opendev.org- Mohammed Naser proposed: | 23:47 | |
| - [zuul/zuul-jobs] 835162: ensure-kubernetes: fix missing 02-crio.conf https://review.opendev.org/c/zuul/zuul-jobs/+/835162 | ||
| - [zuul/zuul-jobs] 835156: run-buildset-registry: Drop extra install packages task https://review.opendev.org/c/zuul/zuul-jobs/+/835156 | ||
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!