| clarkb | (thinking out loud more though I don't think it matters if the pyyaml used to parse the test matrix is python3 though or if ansible runs under python3) | 00:00 |
|---|---|---|
| clarkb | so we may still be able to python3 those bits | 00:00 |
| ianw | yeah ... all our hosts *have* python3 | 00:00 |
| openstackgerrit | Ian Wienand proposed openstack/devstack-gate master: Convert testmatrix run to venv https://review.opendev.org/712590 | 00:05 |
| fungi | python3 venv can be used to install python3 virtualenv which can then be used to create a python2 env | 00:07 |
| fungi | this is how i create python2.7 envs | 00:07 |
| fungi | python3 -m venv foo;foo/bin/pip install virtualenv;foo/bin/virtualenv -p python2.7 bar | 00:08 |
| fungi | though you could also given the right circumstances shorten that to `pip install --user virtualenv;virtualenv -p python2.7 bar` | 00:09 |
| fungi | (python3 -m pip ... as needed) | 00:10 |
| fungi | ultimately i feel like jumping through the venv module is still cleaner, assuming it's installed (which we've decided it will be) | 00:10 |
| clarkb | fungi: ya that shorter version won't work in ourproposed new state | 00:11 |
| fungi | i figured | 00:11 |
| clarkb | (no pip) | 00:11 |
| fungi | right, basically i use venv to have a working pip to get a working virtualenv to make a working python2 env | 00:12 |
| fungi | and the intermediate foo venv can just be deleted afterward | 00:13 |
| *** prometheanfire has joined #openstack-infra | 00:13 | |
| *** tetsuro has joined #openstack-infra | 00:13 | |
| *** prometheanfire has quit IRC | 00:15 | |
| ianw | it's like the python version of alice in wonderland | 00:17 |
| ianw | i hope you do this on a container in a vm behind dvr with about 15 layers of tunnels and bridges | 00:19 |
| fungi | 'twas brillig and the slithy toves did gyre and gimble in the wabe | 00:20 |
| fungi | though i guess jabberwocky was in through the looking glass | 00:21 |
| fungi | not wonderland | 00:21 |
| fungi | how doth the little crocodile improve his shining tail? | 00:22 |
| fungi | that's more like it | 00:22 |
| fungi | (ftr i prefer looking glass, of the two) | 00:23 |
| fungi | if i taught math theory, i'd make that required reading, along with flatland | 00:23 |
| *** ijw has joined #openstack-infra | 00:26 | |
| *** ijw has quit IRC | 00:30 | |
| *** nicolasbock has quit IRC | 00:30 | |
| *** ijw has joined #openstack-infra | 00:30 | |
| *** nicolasbock has joined #openstack-infra | 00:30 | |
| *** nicolasbock has quit IRC | 00:43 | |
| *** openstackstatus has joined #openstack-infra | 00:44 | |
| *** ChanServ sets mode: +v openstackstatus | 00:44 | |
| *** prometheanfire has joined #openstack-infra | 01:06 | |
| *** hongbin has joined #openstack-infra | 01:12 | |
| openstackgerrit | Trinh Nguyen proposed opendev/irc-meetings master: Remove Searchlight meeting https://review.opendev.org/712595 | 01:15 |
| *** dangtrinhnt has joined #openstack-infra | 01:16 | |
| *** diablo_rojo_phon has joined #openstack-infra | 01:22 | |
| *** dangtrinhnt has quit IRC | 01:31 | |
| *** dangtrinhnt has joined #openstack-infra | 01:32 | |
| *** yamamoto has joined #openstack-infra | 01:35 | |
| *** yamamoto has quit IRC | 01:36 | |
| *** yamamoto has joined #openstack-infra | 01:36 | |
| *** gyee has quit IRC | 01:51 | |
| *** dangtrinhnt has quit IRC | 01:51 | |
| *** sgw has joined #openstack-infra | 02:11 | |
| sgw | Hi Infra team, what's the process to get someone added to allow them to do merge commits? I would like to add Shuicheng Lin to the list of people allowed to do merge commit in StarlingX repos | 02:12 |
| clarkb | sgw: to click the approval button in gerrit? | 02:13 |
| *** diablo_rojo has quit IRC | 02:13 | |
| sgw | No to do git review pushes | 02:14 |
| *** xinranwang has joined #openstack-infra | 02:14 | |
| sgw | git review -t centos8-rebase remote: Processing changes: refs: 1, done To ssh://slin14@review.opendev.org:29418/starlingx/integ.git ! [remote rejected] HEAD -> refs/publish/f/centos8/centos8-rebase (you are not allowed to upload merges) error: failed to push some refs to 'ssh://slin14@review.opendev.org:29418/starlingx/integ.git' | 02:14 |
| clarkb | oh I see actual merge commits | 02:14 |
| clarkb | one sec | 02:14 |
| *** rlandy|bbl is now known as rlandy | 02:15 | |
| sgw | yup, I have permissions, but want to have shuicheng do it in the future | 02:15 |
| clarkb | sgw: currently it looks like starlingx repos have acls that allow the starglinx-release team to push merge commits | 02:16 |
| clarkb | https://review.opendev.org/#/admin/projects/starlingx/helm-charts,access random example I pulled up | 02:16 |
| clarkb | you can add Shuicheng Lin to starglinx-release if appropriate. If not appropriate the acls could be updated to allow another different group to push the merge commit | 02:17 |
| sgw | Ok, thanks, I think adding him there mades the most sense | 02:17 |
| *** jamesmcarthur has joined #openstack-infra | 02:18 | |
| sgw | Oh **&*^, I am still having that dang Web interface failure I had before, I need to go back to the CLI again | 02:19 |
| clarkb | hrm that is really weird. I wonder if it is some mismatch between web account and ssh account | 02:20 |
| sgw | I can do reviews, I jst can't add people to groups | 02:20 |
| clarkb | sgw: when its not 7pm I'd be happy to look into that more | 02:20 |
| *** yamamoto has quit IRC | 02:20 | |
| sgw | Agreed, just dealing with a small backlog issue. | 02:20 |
| sgw | we can talk again tomorrow | 02:21 |
| sgw | thanks for your help now | 02:21 |
| fungi | sgw: if you go to https://review.opendev.org/#/settings/ what account id number does it show you? | 02:22 |
| fungi | also does the username it shows on that page correspond to the one you're using with ssh? | 02:23 |
| sgw | yup, they are the same sgw-starlingx | 02:24 |
| sgw | is the '-' a problem? | 02:24 |
| fungi | shouldn't be | 02:24 |
| fungi | okay, so account 28607 | 02:25 |
| sgw | yup, that's what seems to be the acct id | 02:26 |
| sgw | I was able to do ssh add just now. This can wait for tomorrow if we want to try again, we talked weeks about about this. | 02:26 |
| fungi | i've double-checked, the preferred_email associated with that account is unique too (there is a bit of a bug with gerrit's openid account autocreation where it can get confused if multiple accounts get created for the same email) | 02:27 |
| fungi | so yeah, not the usual suspects at least | 02:27 |
| fungi | what error do you get when trying to add people to groups using the webui? | 02:27 |
| sgw | Code Review - Error | 02:28 |
| sgw | The page you requested was not found, or you do not have permission to view this page. | 02:28 |
| fungi | huh | 02:29 |
| fungi | also i've double-checked the Lin Shuicheng account and it looks fine too | 02:29 |
| sgw | Yup went through this the last time also, when I found that the SSH CLI worked, we just stopped looking at the WebUI failure. | 02:31 |
| fungi | that comes up after you select a user and try to hit the "add" button i guess? | 02:31 |
| sgw | correct | 02:31 |
| fungi | have you tried a different browser? grasping at straws obviously | 02:31 |
| fungi | tried turning it off and on again? ;) | 02:31 |
| fungi | this is definitely one i haven't heard of before your case | 02:32 |
| sgw | Different OSes, Browsers, on VPN/off VPN | 02:32 |
| fungi | strange | 02:32 |
| sgw | Logged out and in again, Incognetio mode, ... | 02:32 |
| sgw | I am just cursed! | 02:33 |
| fungi | i'm double-checking gerrit's logs, but they have a tendency to be kinda useless | 02:33 |
| fungi | opaque java backtraces spanning hundreds of lines | 02:34 |
| fungi | and full of benign "errors" looking very similar | 02:34 |
| *** yamamoto has joined #openstack-infra | 02:35 | |
| sgw | thanks for looking again. | 02:35 |
| fungi | yeah, sorry i'm coming up short again too | 02:37 |
| sgw | Forunately the CLI works, I just have to search how to use it which is easy enough! | 02:39 |
| fungi | it's at least thoroughly documented https://review.opendev.org/Documentation/cmd-index.html | 02:43 |
| fungi | also has some fairly useful context help if you pass --help on incomplete commands | 02:43 |
| fungi | and is flexible about how you refer to specific users (display name, email address, account id, username...) | 02:44 |
| fungi | you can also refer to groups by name or id number | 02:44 |
| LiangFang | AJaeger: https://review.opendev.org/#/c/711878/ Brian has reviewed and gave +1, thanks | 02:50 |
| *** jamesmcarthur has quit IRC | 02:56 | |
| *** jamesmcarthur has joined #openstack-infra | 02:58 | |
| *** hongbin has quit IRC | 03:03 | |
| *** jamesmcarthur has quit IRC | 03:03 | |
| *** jamesmcarthur has joined #openstack-infra | 03:06 | |
| *** rkukura has quit IRC | 03:10 | |
| *** rkukura has joined #openstack-infra | 03:12 | |
| *** yamamoto has quit IRC | 03:19 | |
| *** yamamoto has joined #openstack-infra | 03:24 | |
| *** KeithMnemonic1 has joined #openstack-infra | 03:28 | |
| *** KeithMnemonic has quit IRC | 03:31 | |
| *** ricolin_ has joined #openstack-infra | 03:31 | |
| *** ricolin_ has quit IRC | 03:33 | |
| *** ricolin_ has joined #openstack-infra | 03:34 | |
| *** jamesmcarthur has quit IRC | 03:34 | |
| *** jamesmcarthur has joined #openstack-infra | 03:35 | |
| *** psachin has joined #openstack-infra | 03:36 | |
| *** jamesmcarthur has quit IRC | 03:40 | |
| *** tetsuro has quit IRC | 03:41 | |
| *** yamamoto has quit IRC | 03:44 | |
| *** rlandy has quit IRC | 03:44 | |
| *** tetsuro has joined #openstack-infra | 03:45 | |
| *** yamamoto has joined #openstack-infra | 03:45 | |
| *** ykarel|away is now known as ykarel | 03:48 | |
| *** jamesmcarthur has joined #openstack-infra | 03:56 | |
| *** dave-mccowan has quit IRC | 03:58 | |
| *** apetrich has quit IRC | 04:00 | |
| *** bdodd has joined #openstack-infra | 04:00 | |
| *** KeithMnemonic1 has quit IRC | 04:06 | |
| *** tobiash has quit IRC | 04:16 | |
| *** udesale has joined #openstack-infra | 04:17 | |
| *** tobiash has joined #openstack-infra | 04:17 | |
| *** jamesmcarthur has quit IRC | 04:23 | |
| *** jamesmcarthur has joined #openstack-infra | 04:27 | |
| *** jamesmcarthur has quit IRC | 04:32 | |
| *** jamesmcarthur has joined #openstack-infra | 04:33 | |
| *** factor has joined #openstack-infra | 04:34 | |
| *** tobiash has quit IRC | 04:43 | |
| *** tobiash has joined #openstack-infra | 04:46 | |
| *** Martouf has quit IRC | 05:14 | |
| *** raukadah is now known as chandankumar | 05:16 | |
| *** dSrinivas has joined #openstack-infra | 05:18 | |
| dSrinivas | Hi All, i am getting this error http://paste.openstack.org/show/790571/ from March 3 in nova-compute logs in our CI FC HBA's are Online and Connectivity exists between vm and Storage | 05:18 |
| *** tetsuro_ has joined #openstack-infra | 05:23 | |
| *** zxiiro has quit IRC | 05:25 | |
| *** tetsuro has quit IRC | 05:27 | |
| *** jamesmcarthur has quit IRC | 05:30 | |
| *** lbragstad__ has joined #openstack-infra | 05:33 | |
| *** lbragstad_ has quit IRC | 05:35 | |
| *** evrardjp has quit IRC | 05:35 | |
| *** evrardjp has joined #openstack-infra | 05:36 | |
| *** strigazi has quit IRC | 05:49 | |
| *** strigazi has joined #openstack-infra | 05:51 | |
| ianw | clarkb: few things in flight @ https://review.opendev.org/#/q/topic:cleanup-test-image-python ... i feel like that might be enough that devstack doesn't blow up instantly on a plain node. todo is tox tests | 05:59 |
| *** xinranwang has quit IRC | 06:04 | |
| *** prometheanfire has quit IRC | 06:26 | |
| *** prometheanfire has joined #openstack-infra | 06:28 | |
| *** prometheanfire has quit IRC | 06:36 | |
| *** prometheanfire has joined #openstack-infra | 06:37 | |
| AJaeger | dSrinivas: better ask the nova team on #openstack-nova | 06:39 |
| *** yamamoto has quit IRC | 06:40 | |
| *** yamamoto has joined #openstack-infra | 06:42 | |
| *** yamamoto has quit IRC | 06:50 | |
| *** lmiccini has joined #openstack-infra | 06:53 | |
| *** yamamoto has joined #openstack-infra | 06:55 | |
| *** LiangFang has quit IRC | 07:02 | |
| *** strigazi has quit IRC | 07:03 | |
| *** smcginnis has quit IRC | 07:03 | |
| *** dpawlik has joined #openstack-infra | 07:04 | |
| *** smcginnis has joined #openstack-infra | 07:04 | |
| *** Liang__ has joined #openstack-infra | 07:04 | |
| dSrinivas | AJaeger: Thank you | 07:08 |
| *** prometheanfire has quit IRC | 07:10 | |
| *** roman_g has quit IRC | 07:11 | |
| *** prometheanfire has joined #openstack-infra | 07:16 | |
| *** prometheanfire has quit IRC | 07:17 | |
| *** rpittau|afk is now known as rpittau | 07:17 | |
| *** prometheanfire has joined #openstack-infra | 07:20 | |
| *** pgaxatte has joined #openstack-infra | 07:24 | |
| *** tetsuro has joined #openstack-infra | 07:25 | |
| AJaeger | config-core, please review https://review.opendev.org/712550 to remove a duplicate role. | 07:27 |
| *** tetsuro_ has quit IRC | 07:29 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Use a fake zuul_return and an .ansible-lint file https://review.opendev.org/712546 | 07:29 |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Use a fake zuul_return and an .ansible-lint file https://review.opendev.org/712547 | 07:30 |
| AJaeger | config-core, those two as well (if they pass now), please - allow linting without Zuul installed ^ | 07:34 |
| *** tetsuro_ has joined #openstack-infra | 07:35 | |
| *** tetsuro has quit IRC | 07:37 | |
| *** matt_kosut has quit IRC | 07:46 | |
| *** matt_kosut has joined #openstack-infra | 07:46 | |
| *** matt_kosut has quit IRC | 07:51 | |
| AJaeger | mordred: 712547 needs some more work to make linting happy, 712546 passes now | 07:56 |
| *** hashar has joined #openstack-infra | 07:58 | |
| *** slaweq has joined #openstack-infra | 08:02 | |
| *** apetrich has joined #openstack-infra | 08:03 | |
| *** amoralej|off is now known as amoralej | 08:06 | |
| *** tesseract has joined #openstack-infra | 08:08 | |
| *** matt_kosut has joined #openstack-infra | 08:10 | |
| *** jcapitao has joined #openstack-infra | 08:15 | |
| *** dchen has quit IRC | 08:17 | |
| *** tosky has joined #openstack-infra | 08:18 | |
| *** ramishra has quit IRC | 08:37 | |
| *** ramishra has joined #openstack-infra | 08:39 | |
| *** tetsuro_ has quit IRC | 08:44 | |
| *** jpena|off is now known as jpena | 08:45 | |
| *** tetsuro has joined #openstack-infra | 08:47 | |
| *** pkopec has joined #openstack-infra | 08:51 | |
| *** rpittau is now known as rpittau|bbl | 08:52 | |
| *** tetsuro_ has joined #openstack-infra | 08:53 | |
| *** tetsuro has quit IRC | 08:57 | |
| *** ralonsoh has joined #openstack-infra | 08:58 | |
| *** xek has joined #openstack-infra | 08:58 | |
| *** matt_kos_ has joined #openstack-infra | 09:07 | |
| *** matt_kosut has quit IRC | 09:08 | |
| *** matt_kos_ has quit IRC | 09:12 | |
| *** dtantsur|afk is now known as dtantsur | 09:13 | |
| *** matt_kosut has joined #openstack-infra | 09:13 | |
| *** tetsuro has joined #openstack-infra | 09:14 | |
| *** tetsuro_ has quit IRC | 09:17 | |
| *** ykarel is now known as ykarel|lunch | 09:19 | |
| *** tetsuro_ has joined #openstack-infra | 09:20 | |
| *** tetsuro has quit IRC | 09:23 | |
| *** priteau has joined #openstack-infra | 09:25 | |
| *** sshnaidm|afk is now known as sshnaidm | 09:39 | |
| *** derekh has joined #openstack-infra | 09:41 | |
| openstackgerrit | Jens Harbott (frickler) proposed opendev/system-config master: Add goaccess reporting to more static.o.o sites https://review.opendev.org/712576 | 09:43 |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Declare support for Python3.8 https://review.opendev.org/712480 | 09:45 |
| openstackgerrit | Merged openstack/devstack-gate master: Fix virtualenv detection https://review.opendev.org/712587 | 09:49 |
| *** ociuhandu has joined #openstack-infra | 09:59 | |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Trove team meeting https://review.opendev.org/712451 | 09:59 |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Searchlight meeting https://review.opendev.org/712595 | 10:05 |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Doc team meeting https://review.opendev.org/712453 | 10:05 |
| lifeless | fungi: :) | 10:09 |
| lifeless | mordred: :) | 10:09 |
| openstackgerrit | Merged opendev/system-config master: Remove old 404 checker job https://review.opendev.org/712575 | 10:16 |
| *** matt_kosut has quit IRC | 10:18 | |
| *** matt_kosut has joined #openstack-infra | 10:18 | |
| *** ykarel|lunch is now known as ykarel | 10:19 | |
| *** ociuhandu has quit IRC | 10:25 | |
| *** ociuhandu has joined #openstack-infra | 10:28 | |
| *** dSrinivas has quit IRC | 10:38 | |
| *** tetsuro_ has quit IRC | 10:39 | |
| openstackgerrit | Merged opendev/system-config master: Add goaccess reporting to more static.o.o sites https://review.opendev.org/712576 | 10:49 |
| *** ociuhandu has quit IRC | 10:49 | |
| dpawlik | Hi. Is possible to add new Fedora releases to mirror.mtl01 ? | 10:50 |
| *** ociuhandu has joined #openstack-infra | 10:50 | |
| *** ociuhandu has quit IRC | 10:53 | |
| dpawlik | cc fungi ^^ | 10:53 |
| *** nicolasbock has joined #openstack-infra | 10:56 | |
| *** ociuhandu has joined #openstack-infra | 10:58 | |
| *** matt_kosut has quit IRC | 10:59 | |
| *** jamesdenton has joined #openstack-infra | 11:01 | |
| *** jcapitao is now known as jcapitao_afk | 11:02 | |
| *** ociuhandu has quit IRC | 11:03 | |
| *** derekh has quit IRC | 11:10 | |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Upgrades SIG meeting https://review.opendev.org/712452 | 11:14 |
| *** nicolasbock has quit IRC | 11:15 | |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Networking VPP team meeting https://review.opendev.org/712448 | 11:15 |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Group-Based policy team meeting https://review.opendev.org/712457 | 11:15 |
| *** sshnaidm has quit IRC | 11:18 | |
| *** sshnaidm has joined #openstack-infra | 11:19 | |
| *** derekh has joined #openstack-infra | 11:20 | |
| *** ociuhandu has joined #openstack-infra | 11:20 | |
| openstackgerrit | Fabien Boucher proposed zuul/zuul master: Declare support for Python3.8 https://review.opendev.org/712480 | 11:20 |
| *** yamamoto has quit IRC | 11:22 | |
| *** sshnaidm has quit IRC | 11:22 | |
| *** yamamoto has joined #openstack-infra | 11:24 | |
| *** ociuhandu has quit IRC | 11:27 | |
| *** yamamoto has quit IRC | 11:27 | |
| *** ociuhandu has joined #openstack-infra | 11:27 | |
| *** tetsuro has joined #openstack-infra | 11:28 | |
| openstackgerrit | Thierry Carrez proposed opendev/irc-meetings master: Consolidate meeting channels https://review.opendev.org/712656 | 11:29 |
| *** sshnaidm has joined #openstack-infra | 11:30 | |
| *** sshnaidm has quit IRC | 11:30 | |
| openstackgerrit | Thierry Carrez proposed opendev/irc-meetings master: Consolidate meeting channels https://review.opendev.org/712656 | 11:33 |
| *** matt_kosut has joined #openstack-infra | 11:35 | |
| *** nicolasbock has joined #openstack-infra | 11:39 | |
| *** matt_kosut has quit IRC | 11:40 | |
| *** nicolasbock has quit IRC | 11:42 | |
| *** nicolasbock has joined #openstack-infra | 11:43 | |
| *** matt_kosut has joined #openstack-infra | 11:46 | |
| *** jpena is now known as jpena|lunch | 11:49 | |
| *** nicolasbock has quit IRC | 11:51 | |
| *** eharney has joined #openstack-infra | 11:52 | |
| *** sshnaidm has joined #openstack-infra | 11:52 | |
| *** sshnaidm has quit IRC | 11:53 | |
| *** sshnaidm has joined #openstack-infra | 11:54 | |
| *** nicolasbock has joined #openstack-infra | 11:54 | |
| *** ociuhandu has quit IRC | 11:54 | |
| *** ociuhandu has joined #openstack-infra | 11:55 | |
| *** ociuhandu has quit IRC | 11:55 | |
| *** ociuhandu has joined #openstack-infra | 11:55 | |
| *** nicolasbock has quit IRC | 11:56 | |
| *** nicolasbock has joined #openstack-infra | 11:57 | |
| *** yamamoto has joined #openstack-infra | 11:59 | |
| *** rlandy has joined #openstack-infra | 12:01 | |
| *** TViernion has quit IRC | 12:04 | |
| *** yamamoto has quit IRC | 12:05 | |
| *** yamamoto has joined #openstack-infra | 12:14 | |
| *** udesale_ has joined #openstack-infra | 12:14 | |
| *** yamamoto has quit IRC | 12:15 | |
| openstackgerrit | Albin Vass proposed zuul/nodepool master: Enable setting label and instance name separately https://review.opendev.org/712666 | 12:15 |
| *** TViernion has joined #openstack-infra | 12:16 | |
| *** udesale has quit IRC | 12:17 | |
| *** lastmikoi has quit IRC | 12:20 | |
| *** gfidente has joined #openstack-infra | 12:21 | |
| *** tetsuro has quit IRC | 12:22 | |
| *** rh-jelabarre has joined #openstack-infra | 12:24 | |
| *** lastmikoi has joined #openstack-infra | 12:25 | |
| *** rcernin has quit IRC | 12:25 | |
| *** tkajinam has quit IRC | 12:27 | |
| *** jpena|lunch is now known as jpena | 12:32 | |
| *** Lucas_Gray has joined #openstack-infra | 12:43 | |
| *** ahosam has joined #openstack-infra | 12:44 | |
| *** dciabrin_ is now known as dciabrin | 12:45 | |
| *** jcapitao_afk is now known as jcapitao | 12:46 | |
| *** psachin has quit IRC | 12:47 | |
| *** Lucas_Gray has quit IRC | 12:49 | |
| *** ociuhandu has quit IRC | 12:50 | |
| *** ociuhandu has joined #openstack-infra | 12:51 | |
| *** yamamoto has joined #openstack-infra | 12:52 | |
| *** Lucas_Gray has joined #openstack-infra | 12:53 | |
| *** eharney has quit IRC | 12:53 | |
| *** nightmare_unreal has joined #openstack-infra | 12:56 | |
| nightmare_unreal | how can one create a cell on devstack1 and attach it to devstack2 ? | 12:57 |
| *** ociuhandu has quit IRC | 12:57 | |
| *** yamamoto has quit IRC | 12:57 | |
| *** ociuhandu has joined #openstack-infra | 13:00 | |
| *** rpittau|bbl is now known as rpittau | 13:02 | |
| *** Lucas_Gray has quit IRC | 13:10 | |
| *** psachin has joined #openstack-infra | 13:12 | |
| *** ianychoi has quit IRC | 13:13 | |
| *** amoralej is now known as amoralej|lunch | 13:15 | |
| *** ociuhandu has quit IRC | 13:15 | |
| *** ociuhandu has joined #openstack-infra | 13:16 | |
| *** nightmare_unreal has quit IRC | 13:19 | |
| *** ociuhandu has quit IRC | 13:21 | |
| *** ociuhandu has joined #openstack-infra | 13:22 | |
| *** yamamoto has joined #openstack-infra | 13:24 | |
| *** derekh has quit IRC | 13:29 | |
| *** ociuhandu has quit IRC | 13:30 | |
| mgoddard | Hi. I am seeing in the centos-7 nodepool image that creating a virtualenv now defaults to using python 3. Previously it was python 2. This is breaking some jobs - kayobe & tenks | 13:30 |
| mgoddard | Are there any recent changes that could have caused this? | 13:30 |
| *** ijw has quit IRC | 13:31 | |
| *** ociuhandu has joined #openstack-infra | 13:32 | |
| openstackgerrit | Albin Vass proposed zuul/nodepool master: Enable setting label and instance name separately https://review.opendev.org/712666 | 13:32 |
| openstackgerrit | Albin Vass proposed zuul/nodepool master: Enable setting label and instance name separately https://review.opendev.org/712666 | 13:33 |
| fungi | dpawlik: newer than fedora 30 you mean? | 13:33 |
| dpawlik | fungi, can be fedora 31 :) | 13:34 |
| dpawlik | 32 is not released yet, so maybe after a while I will come back :) | 13:34 |
| fungi | just seeing we have 29 and 30 mirrored at the moment | 13:35 |
| *** dtantsur is now known as dtantsur|brb | 13:36 | |
| *** eharney has joined #openstack-infra | 13:38 | |
| dpawlik | fungi, yes. It is possible to add new or someone else is doing that? | 13:38 |
| fungi | dpawlik: https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/mirror-update/files/fedora-mirror-update#L49 | 13:38 |
| fungi | also need to update line 74 of that file similarly | 13:39 |
| *** yamamoto has quit IRC | 13:39 | |
| dpawlik | fungi, thank you ! | 13:40 |
| fungi | looks like we have plenty of available quota for the fedora mirror volume so that shouldn't pose an issue | 13:40 |
| fungi | mgoddard: i think since all our platforms have python3 available now, there was a recent change to start using it to install virtualenv consistently across all platforms. there's work underway to stop preinstalling it at all so that it gets installed at job runtime, so that projects have a bit more control over how it gets there, but i think that's still being tested in a separate node type to work | 13:42 |
| fungi | out the kinks | 13:42 |
| cloudnull | mgoddard it looks like https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L42-L49 is the issue we're seeing on those c7 nodes, and I think all we need is to have python{2,3}-devel installed on the base image. is there a good place to amend the package list to ensure that is done? | 13:43 |
| cloudnull | -cc fungi | 13:43 |
| fungi | i don't recall if that was changed more recently on centos-7 than on ubuntu-xenial, but i recall having some discussions about it back around november | 13:43 |
| fungi | mgoddard: cloudnull: have a link to a failing build? | 13:44 |
| cloudnull | https://zuul.opendev.org/t/openstack/build/bf343e1ad1684bfb902fb0703085e922 | 13:44 |
| fungi | curious to see, if the job includes a capture of the installed package list, what packages end up installed | 13:44 |
| *** amoralej|lunch is now known as amoralej | 13:46 | |
| openstackgerrit | Daniel Pawlik proposed opendev/system-config master: Added new Fedora release to mirroring https://review.opendev.org/712680 | 13:46 |
| yoctozepto | fungi, cloudnull, mgoddard: moving here from kolla | 13:47 |
| yoctozepto | so images suddenly have python3 with pip3 | 13:47 |
| yoctozepto | and the base job does us bad favor installing virtualenv favoring pip3 if available | 13:48 |
| fungi | so, better cross-platform support there would be to invoke `virtualenv -p python2.7 ...` | 13:49 |
| *** dklyle has quit IRC | 13:49 | |
| *** dklyle has joined #openstack-infra | 13:49 | |
| yoctozepto | fungi: hmm, mgoddard tried that | 13:49 |
| yoctozepto | https://2ae0518c3adaf13d29a6-33cd363c3f72485dda255154bdda0fc8.ssl.cf5.rackcdn.com/712673/1/check/kayobe-overcloud-centos/cdc6674/primary/ansible/overcloud-deploy | 13:50 |
| fungi | though i haven't been following the python cleanup work closely so i don't know when that changed for centos-7 (i think it changed for ubuntu-xenial a while back) | 13:50 |
| yoctozepto | "msg": "Error while linking: [Errno 2] No such file or directory", | 13:50 |
| yoctozepto | "path": "/home/zuul/kolla-venv/lib/python2.7/site-packages/selinux" | 13:50 |
| yoctozepto | argh | 13:50 |
| yoctozepto | mgoddard: ^ | 13:50 |
| yoctozepto | fungi: could you help us trace where/how centos image changed? | 13:50 |
| *** ijw has joined #openstack-infra | 13:51 | |
| fungi | i'll see if anything obvious landed in diskimage-builder or project-config recently related to the python cleanup work | 13:51 |
| yoctozepto | fungi: thanks | 13:52 |
| fungi | my first guess would be https://review.opendev.org/707513 | 13:53 |
| yoctozepto | fungi: yeah, desc sounds like it | 13:54 |
| yoctozepto | (thought not the subject) | 13:54 |
| yoctozepto | though* | 13:54 |
| fungi | or possibly https://review.opendev.org/712225 | 13:55 |
| yoctozepto | fungi: yeah, all in the gerrit topic together | 13:56 |
| *** ijw has quit IRC | 13:56 | |
| yoctozepto | fungi: this way we started getting python3+pip3 | 13:56 |
| fungi | more broadly this is implementing bits of https://docs.opendev.org/opendev/infra-specs/latest/specs/cleanup-test-node-python.html | 13:56 |
| yoctozepto | fungi: hmm, then base job assumptions changed considerably | 13:57 |
| yoctozepto | we can't be replacing virtualenv with virtualenv-for-py3 | 13:57 |
| yoctozepto | it's actually not straightforward thinking | 13:57 |
| fungi | well, we're not trying to replace virtualenv with virtualenv-for-py3 | 13:58 |
| fungi | we're trying to get away from preinstalling virtualenv and pip at all | 13:58 |
| fungi | and then letting them get installed flexibly at job runtime | 13:59 |
| yoctozepto | fungi: well, there must be pip3 installed in the image if base job detects it and does replace-virtualenv dance | 13:59 |
| fungi | at the moment i think the base job is supposed to be handling this, but it's possible the logic used to install virtualenv on centos-7 isn't correct | 13:59 |
| yoctozepto | fungi: https://opendev.org/opendev/base-jobs/src/branch/master/playbooks/base/pre.yaml#L43-L49 | 13:59 |
| yoctozepto | fungi: it's part of dirty hack | 13:59 |
| *** jistr is now known as jistr|mtg | 13:59 | |
| fungi | and yes, i wonder if it's because centos-7 incorporates pip3 at this point | 14:00 |
| yoctozepto | fungi: well, it *is* | 14:00 |
| yoctozepto | fungi: do you think we still need that pin? | 14:00 |
| yoctozepto | fungi: if not, the situation should clarify if we remove it | 14:01 |
| yoctozepto | fungi: not necessarily improve though :-) | 14:01 |
| yoctozepto | fungi: at least we won't be doing something possibly dumb | 14:02 |
| *** derekh has joined #openstack-infra | 14:03 | |
| fungi | git blame says it was added by https://review.opendev.org/710851 | 14:03 |
| *** yamamoto has joined #openstack-infra | 14:03 | |
| fungi | in service of working around https://review.opendev.org/710851 | 14:04 |
| fungi | er https://gitlab.com/python-devs/importlib_resources/issues/83 | 14:04 |
| fungi | looks like the fix for that merged a week ago | 14:05 |
| fungi | seeing if there's been a release since | 14:05 |
| fungi | importlib-resources 1.2.0 should have it now | 14:06 |
| yoctozepto | fungi: yeah, proposing WIP | 14:06 |
| fungi | oh, but was also updated by https://review.opendev.org/710967 to work around https://github.com/pypa/virtualenv/issues/1670 | 14:08 |
| AJaeger | dpawlik: to use Fedora 31, you also need nodepool images. ianw is working on this, this needs some larger changes (new nodepool host) | 14:08 |
| openstackgerrit | Radosław Piliszek proposed opendev/base-jobs master: WIP: Stop pinning virtualenv/importlib https://review.opendev.org/712689 | 14:08 |
| yoctozepto | fungi: and I can make my change depend on it and it should pick it up, right? | 14:09 |
| dpawlik | AJaeger, ack. Thanks for info | 14:10 |
| frickler | clarkb: triggered a periodic run with 712576 merged | 14:10 |
| yoctozepto | doing https://review.opendev.org/712644 | 14:11 |
| *** ociuhandu has quit IRC | 14:11 | |
| fungi | if i'm reading that virtualenv issue correctly, the cascade of regressions which came after it should all be settled out as of 20.0.8 | 14:11 |
| yoctozepto | fungi: thanks, that makes it likely to work | 14:12 |
| fungi | yoctozepto: unfortunately changes to opendev/base-jobs can not be tested speculatively, for safety reasons | 14:12 |
| yoctozepto | fungi: ah | 14:12 |
| frickler | yoctozepto: no, you cannot test that via depends-on. you would need to patch the base-test job, get that merged and then have a job run on that | 14:12 |
| yoctozepto | frickler: :-( | 14:12 |
| fungi | we have a comment in the file explaining how we can make the alteration to the base-test job first and then reparent an affected job on that | 14:12 |
| * yoctozepto sad like never before | 14:12 | |
| yoctozepto | fungi: where? | 14:13 |
| *** eharney has quit IRC | 14:13 | |
| mgoddard | I'm going to try installing virtualenv via pip2 as a workaround | 14:14 |
| yoctozepto | mgoddard: +1, for kayobe | 14:15 |
| fungi | yoctozepto: oh, sorry, in jobs.yaml here: https://opendev.org/opendev/base-jobs/src/branch/master/zuul.d/jobs.yaml#L5-L23 | 14:15 |
| mgoddard | correct, and tenks | 14:15 |
| yoctozepto | mgoddard: best do in pre, it should be right | 14:15 |
| yoctozepto | cloudnull: ^ use mgoddard's idea for workaround in tripleo | 14:16 |
| frickler | clarkb: seems this works fine so far. two small issues: a) it would be great if we could somehow include the name of the site within the report, currently it is hidden at the end of the long log url | 14:17 |
| yoctozepto | fungi: well, base-test does not have this workaround | 14:18 |
| yoctozepto | fungi: so I can skip to step 4 :D | 14:18 |
| frickler | b) the daily curve seems to indicate a dip for the first and last day, since we only process partial data there. maybe we should consider doing log rotation more 0:00z-ish and then don't include the current log file in the report | 14:18 |
| fungi | yoctozepto: frickler: yes, i expect we can just propose reverts of 710851 and 710967 if a run reparented on base-test works | 14:22 |
| *** ijw has joined #openstack-infra | 14:22 | |
| *** auristor has quit IRC | 14:23 | |
| mgoddard | yoctozepto, fungi: another data point: this was working yesterday: http://zuul.openstack.org/builds?job_name=tenks-deploy-teardown-centos7 | 14:24 |
| yoctozepto | mgoddard, fungi: yeah, it matches the time when centos images rebuilt with better python3 coverage | 14:26 |
| *** ijw has quit IRC | 14:27 | |
| fungi | mgoddard: looks like that failed while installing libvirt-python under python3.6, so if it was previously using 2.7 that might explain it | 14:28 |
| mgoddard | right | 14:28 |
| fungi | i need to step away for a few minutes and finish my morning routine, but will be back asap | 14:29 |
| *** pkopec has quit IRC | 14:29 | |
| *** yamamoto has quit IRC | 14:29 | |
| frickler | clarkb: also, there seems to be a very long sequence of "waiting for logger" msgs in the job log, is there a way to avoid those? | 14:30 |
| *** dave-mccowan has joined #openstack-infra | 14:31 | |
| frickler | yoctozepto: fungi: you'd have to run the base-test based jobs against a number of specific job+stable branch combinations, iirc one issue was only seen with stable/rocky, the other on newer stable branches | 14:33 |
| clarkb | frickler: I'll look into annotating the report with the sitename. The jobs have the waiting on logger message because we dont start a zuul console log daemon on static.opendev.org, I think this might actually be desireable in this case, but am open to changing that | 14:36 |
| clarkb | (there is a role we can run to start it) | 14:37 |
| yoctozepto | frickler: it would break centos/train for its python2, then again iirc ubuntu/rocky has had py3.5 so you might be right there | 14:37 |
| yoctozepto | frickler: you think testing it with devstack/rocky would make sense? | 14:38 |
| *** auristor has joined #openstack-infra | 14:38 | |
| yoctozepto | frickler: argh, devstack sets parent to multinode from zuul-jobs, bum | 14:40 |
| *** ricolin_ has quit IRC | 14:41 | |
| *** ricolin_ has joined #openstack-infra | 14:41 | |
| *** ociuhandu has joined #openstack-infra | 14:42 | |
| yoctozepto | well, at most it will break multinode things but should pass some things | 14:43 |
| yoctozepto | I hope | 14:43 |
| *** gyee has joined #openstack-infra | 14:43 | |
| clarkb | thinking out loud here, can we simply shim in a pip = pip -p python2 redirect on the jobs for centos7 | 14:44 |
| yoctozepto | clarkb: the base job does pip3 | 14:45 |
| yoctozepto | like in *pip3* | 14:45 |
| frickler | clarkb: I'm just watching things on static.o.o, seems goaccess uses files in /tmp and not in-memory as the man page claims. taking >30mins now on docs.o.o | 14:45 |
| yoctozepto | the pip3 :D | 14:45 |
| frickler | clarkb: also the various reports seem blocked on each other, likely due to the /tmp files having non-unique names | 14:46 |
| clarkb | frickler: oh hrm, it definitely said it uses memory by default | 14:46 |
| clarkb | frickler: ok so we may need to sequence stuff or figure out how to force using memory | 14:46 |
| clarkb | yoctozepto: well its fine to use pip3 if thats ehat you want. I thought the issue is jobs using `pip` getting pip3? | 14:47 |
| clarkb | yoctozepto: an easy fix for that is to make `pip` pip2 | 14:47 |
| *** ociuhandu has quit IRC | 14:47 | |
| *** ricolin_ has quit IRC | 14:48 | |
| yoctozepto | clarkb: no, the issue is that base job is rewriting virtualenv to mean virtualenv for py3 | 14:48 |
| yoctozepto | clarkb: when the assumption is otherwise | 14:48 |
| yoctozepto | clarkb: dirty hack bit us | 14:48 |
| yoctozepto | (like they always do) | 14:48 |
| clarkb | yoctozepto: can you link to that? | 14:50 |
| clarkb | frickler: ok we can set --keep-db-files explicitly false and then set --db-path to unique path per site | 14:51 |
| clarkb | then it should delete files on exit and avoid collisions (I dont understand why memory is not used) | 14:51 |
| frickler | clarkb: the other idea would be to keep the files and look into setting up the iterated logfile processing properly | 14:52 |
| yoctozepto | clarkb: sure, it's the part being reverted here https://review.opendev.org/712689 | 14:52 |
| *** psachin has quit IRC | 14:52 | |
| frickler | clarkb: that might allow us to report over a longer range and also avoid reprocessing logs each day, if that turns up to take significant time | 14:53 |
| *** ijw has joined #openstack-infra | 14:53 | |
| clarkb | frickler: yes, the tricky thing with that I found is if you process a log line twice it gets recorded as multiple requests | 14:53 |
| frickler | clarkb: yeah, so we'd just feed it the *.1 file once each day | 14:54 |
| clarkb | we'd have to be very careful about input data if we do that and I was hoping to start simple and improve frlm there | 14:54 |
| clarkb | frickler: ya | 14:54 |
| frickler | clarkb: could even trigger that by logrotate instead of a periodic job | 14:54 |
| clarkb | frickler: oh thats an interesting idea, then zuul could just collect it | 14:55 |
| clarkb | yoctozepto: ah ok I've been trying to revert that all week :) | 14:55 |
| yoctozepto | clarkb: late by just one day! :D | 14:55 |
| yoctozepto | clarkb: ianw's cleanup re glean hit us | 14:56 |
| yoctozepto | as fungi helped us to establish | 14:56 |
| clarkb | yoctozepto: https://review.opendev.org/#/c/712107/ | 14:56 |
| EmilienM | mordred: hey, where can I find some infos about the container build/push things you're doing? | 14:56 |
| yoctozepto | clarkb: hah, I missed that | 14:56 |
| *** ociuhandu has joined #openstack-infra | 14:57 | |
| AJaeger | clarkb: for sequencing: do we need a semaphore? | 14:58 |
| mordred | EmilienM: hi there! one sec, lemme get you a link and some pointers | 14:58 |
| clarkb | AJaeger: yes, but uf we do the --db-path we dont need to sequence unless wprried about other resource consumption there | 14:58 |
| AJaeger | clarkb: ok, understood | 14:58 |
| *** ijw has quit IRC | 14:58 | |
| clarkb | AJaeger: frickler I think first step is set those goaccess args and maybe add a sempahore then look into only processing the .1 log file each day | 14:59 |
| *** Lucas_Gray has joined #openstack-infra | 15:00 | |
| mordred | EmilienM: https://zuul-ci.org/docs/zuul-jobs/docker-jobs.html is the general documentation. you can see an example of it in use with some base jobs here: https://opendev.org/opendev/system-config/src/branch/master/.zuul.yaml#L24-L49 ... and then scroll down a bit and you can see jobs building specific container images with their interdependencies expressed | 15:00 |
| frickler | clarkb: did you ever run a test against docs.o.o logs? the job is at 45mins now, at least it only seems to use one out of 8 cpus | 15:01 |
| clarkb | frickler: I did not. It was primarily tested against zuul and also bad input (to check behavior when given bad input) | 15:01 |
| *** ociuhandu has quit IRC | 15:02 | |
| *** yamamoto has joined #openstack-infra | 15:02 | |
| mordred | EmilienM: the tl;dr is that we have job constructs that can set up buildset registries so that images can be built as-if other images have been published - and we can pull images built in gate and promote those images to be published to a registry in the promote pipeline instead of needing to rebuild after gate for publication | 15:02 |
| mordred | EmilienM: the buildset registry is also shared between jobs in the buildset, so you can build images in one job and then test them with other jobs | 15:03 |
| clarkb | frickler: if you think we should revert the broader application and then sort out these problems that is fine by me | 15:03 |
| clarkb | but still trying to catch up on all the things this morning | 15:03 |
| EmilienM | mordred: excellent. I'll look at all of it | 15:03 |
| mordred | EmilienM: there's a LOT there :) feel free to follow up of course - or if you want to schedule a time to sync up more synchronously just let me know | 15:05 |
| corvus | EmilienM, mordred: i'm happy to help out too | 15:05 |
| mordred | EmilienM: fwiw - the registry support groks support for multi-registry (like quay.io or whatnot) - and we also have support for configuring k8s and openshift to use the buildset registry | 15:05 |
| *** yamamoto has quit IRC | 15:07 | |
| frickler | clarkb: I'm thinking I'll give it another 30 mins and if it doesn't finish until then, to kill it and rerun manually with in-memory. that should still leave enough room until the next automatic periodic trigger | 15:07 |
| EmilienM | corvus, mordred: ok, nice. There is a lot to digest, I'll take a look and come back to you | 15:08 |
| clarkb | infra-root 712107 would be good to land to fix yoctozepto's problem | 15:08 |
| yoctozepto | confirmed - fixing and no pin no longer needed from testing so far | 15:09 |
| yoctozepto | "no pin needed any longer"* | 15:09 |
| clarkb | ya I did a bit of testing removing the pins myslef as long as our images are up to date (they were when I pushed that change) I thibk we are safe to proceed | 15:10 |
| *** pkopec has joined #openstack-infra | 15:10 | |
| yoctozepto | clarkb: yeah, they changed a bit with that glean cleanup so was probably worth testing again | 15:11 |
| *** Lucas_Gray has quit IRC | 15:14 | |
| *** ijw has joined #openstack-infra | 15:16 | |
| frickler | clarkb: oh, the jobs already timed-out long ago, but still left the goaccess processes running. so maybe we should indeed revert the added sites and I can do some more testing then tomorrow | 15:16 |
| yoctozepto | frickler: commented, not worth waiting | 15:16 |
| *** Lucas_Gray has joined #openstack-infra | 15:16 | |
| yoctozepto | frickler: devstack happily replaced virtualenv by itself | 15:17 |
| yoctozepto | otoh, I wonder how virtualenv 20.0.10 went in there? ;o | 15:18 |
| *** hashar has quit IRC | 15:18 | |
| clarkb | frickler: revert sounds good | 15:18 |
| *** Goneri has joined #openstack-infra | 15:18 | |
| clarkb | frickler: then maybe start with setting paths to see if they timed out due to internal conflicts | 15:18 |
| clarkb | and go from there | 15:18 |
| frickler | dirk: cmurphy: these SSL errors seem to fail devstack runs since a couple of days, does that look familiar to you? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8ac/712634/1/check/devstack-platform-opensuse-15/8ac29df/job-output.txt | 15:26 |
| openstackgerrit | Jens Harbott (frickler) proposed opendev/system-config master: Revert "Add goaccess reporting to more static.o.o sites" https://review.opendev.org/712712 | 15:27 |
| frickler | clarkb: ^^ | 15:28 |
| clarkb | frickler: +2 we can give it a minute or two for others to review but should be safe to single core approve that one | 15:29 |
| openstackgerrit | Merged opendev/base-jobs master: Cleanup workaround for importlib-resources bad version https://review.opendev.org/712107 | 15:29 |
| AJaeger | frickler, clarkb, for goaccess: Want to keep the jobs and just remove from periodic pipeline instead? | 15:29 |
| AJaeger | Your decision what's easier moving forward... | 15:30 |
| cmurphy | frickler: not familiar to me, is that only on opensuse? | 15:30 |
| clarkb | AJaeger: I dont think we can trigger them without the pipeline config so probably doesnt help much to keep the jobs | 15:30 |
| *** Lucas_Gray has quit IRC | 15:30 | |
| cmurphy | wonder why it is trying to download from https://pypi.org/simple/nose/ and not the mirror | 15:30 |
| *** Lucas_Gray has joined #openstack-infra | 15:32 | |
| frickler | cmurphy: that may be part of the issue, yes. I haven't seen this elsewhere, was just looking why the opensuse jobs seem to be failing persistently | 15:32 |
| *** jistr|mtg is now known as jistr | 15:33 | |
| *** ykarel is now known as ykarel|away | 15:34 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Support buildkit backend when building docker images https://review.opendev.org/712716 | 15:35 |
| openstackgerrit | Daniel Pawlik proposed zuul/zuul-jobs master: Add phoronix-test-suite job https://review.opendev.org/679082 | 15:39 |
| openstackgerrit | Merged opendev/irc-meetings master: Remove Glance Bug Squad meeting https://review.opendev.org/712455 | 15:40 |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Use buildkit to mount instead of copy /output https://review.opendev.org/712717 | 15:41 |
| AJaeger | mordred: want to add a fake zuul_console to https://review.opendev.org/#/c/712547/ as well? | 15:44 |
| frickler | clarkb: looking at the goaccess manpage again, the "configuration" section seems to list compile-time options, not run-time. so likely ubuntu compiles it to use /tmp, we'd have to build our own pkg to use in-memory. the jobs did finish successfully though after about an hour, so maybe as a first step we can just increase the job timeout to 2h and see what happens over the weekend | 15:44 |
| clarkb | frickler: aha | 15:44 |
| clarkb | frickler: increasing the timeout wfm | 15:45 |
| AJaeger | mordred, clarkb, frickler, do we need the test anywhere for mirror-info, see frickler's question on https://review.opendev.org/#/c/712550/ ? | 15:45 |
| frickler | clarkb: o.k. I'll propose a patch | 15:45 |
| mordred | AJaeger: yah - will add zuul_console - thanks | 15:45 |
| *** rlandy is now known as rlandy|afk | 15:46 | |
| AJaeger | nice | 15:46 |
| clarkb | AJaeger: frickler the role in ozj was unused if tested. Wecan add a test back into base-jobs, but for now it seems to be working. Not sure if we want to wait for need or proactively set up a test | 15:47 |
| * AJaeger sticks to his +2 for now... | 15:49 | |
| *** eharney has joined #openstack-infra | 15:49 | |
| openstackgerrit | Jens Harbott (frickler) proposed opendev/system-config master: Increase timeout for goaccess report jobs https://review.opendev.org/712718 | 15:49 |
| frickler | clarkb: ^^ | 15:51 |
| clarkb | +2 | 15:51 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 15:51 |
| openstackgerrit | Michal Arbet proposed openstack/project-config master: Add xstatic-** projects for vitrage-dashboard https://review.opendev.org/704133 | 15:54 |
| *** dtantsur|brb is now known as dtantsur | 15:56 | |
| *** diablo_rojo has joined #openstack-infra | 15:58 | |
| clarkb | yoctozepto: if it isn't too late in your day it would be good if you can confirm that base-jobs cleanup makes jobs starting after that merged happy | 16:01 |
| yoctozepto | clarkb: sure, the base-test helped so rather should as they are almost the same now; will let you know, already running several previously blocked changes | 16:04 |
| *** diablo_rojo has quit IRC | 16:06 | |
| *** jamesmcarthur has joined #openstack-infra | 16:06 | |
| *** roman_g has joined #openstack-infra | 16:07 | |
| *** diablo_rojo has joined #openstack-infra | 16:10 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 16:11 |
| *** pgaxatte has quit IRC | 16:11 | |
| *** pgaxatte has joined #openstack-infra | 16:12 | |
| clarkb | sgw: fungi: was brainstorming a bit on things that could possibly cause that behavior. Assuming the web user and the ssh user are the same (which I think we've double checked twice now) I would expect the db to be fully coherent. One idea is that this could be an api bug of some sort | 16:12 |
| *** pgaxatte has quit IRC | 16:13 | |
| clarkb | I think last time we ruled out browser plugins by using different browsers and incognito mode (if we can confirm that that may be helpful) | 16:13 |
| clarkb | but given that different browsers exhibit the same behavior and everything works fine via ssh that really makes me think something is up with the http api | 16:14 |
| *** ociuhandu has joined #openstack-infra | 16:15 | |
| openstackgerrit | Albin Vass proposed zuul/nodepool master: Enable setting label and instance name separately https://review.opendev.org/712666 | 16:15 |
| *** ijw has quit IRC | 16:19 | |
| *** ociuhandu has quit IRC | 16:19 | |
| *** yamamoto has joined #openstack-infra | 16:20 | |
| *** jamesmcarthur has quit IRC | 16:20 | |
| *** ijw has joined #openstack-infra | 16:24 | |
| *** jamesmcarthur has joined #openstack-infra | 16:24 | |
| *** dpawlik has quit IRC | 16:28 | |
| *** dpawlik has joined #openstack-infra | 16:28 | |
| *** ijw has quit IRC | 16:29 | |
| *** gshippey has joined #openstack-infra | 16:30 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove mirror-info role and tests https://review.opendev.org/712550 | 16:31 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Use a fake zuul_return and an .ansible-lint file https://review.opendev.org/712546 | 16:31 |
| zbr | AJaeger: ^ thanks, quite good since there is no whitelisting support in ansible-lint | 16:33 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 16:36 |
| mordred | zbr: you saw that we still had to use find yes? the ansible-lint finding roles and playbooks worked VERY badly | 16:36 |
| mordred | but I'm very happy with the addition of the config file - I think it makes things much more readable | 16:37 |
| *** hashar has joined #openstack-infra | 16:37 | |
| mordred | (just mentionoing in case you happen to interact with the upstream in some manner) | 16:37 |
| yoctozepto | clarkb: all jobs that were failing previously - now passing - as expected | 16:39 |
| clarkb | excellent, thank you for confirming | 16:39 |
| *** jcapitao is now known as jcapitao_afk | 16:40 | |
| *** tesseract has quit IRC | 16:40 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Support buildkit backend when building docker images https://review.opendev.org/712716 | 16:42 |
| openstackgerrit | Merged opendev/system-config master: Increase timeout for goaccess report jobs https://review.opendev.org/712718 | 16:46 |
| zbr | mordred: do you have a bug files regarding detection failure? i could look at it over the weekend. | 16:46 |
| zbr | because the linter maintenance is still in limbo, i was considering forking it in order to fix some outstanding bugs, but i still hope that aspect will be sorted soon. | 16:48 |
| zbr | last success was to enable zuul on it | 16:48 |
| openstackgerrit | James E. Blair proposed zuul/nodepool master: Add ZooKeeper TLS support https://review.opendev.org/712733 | 16:48 |
| *** udesale_ has quit IRC | 16:49 | |
| *** jamesmcarthur has quit IRC | 16:54 | |
| *** ijw has joined #openstack-infra | 16:56 | |
| *** jamesmcarthur has joined #openstack-infra | 16:56 | |
| openstackgerrit | Michal Arbet proposed openstack/project-config master: Add xstatic-** projects for vitrage-dashboard https://review.opendev.org/704133 | 16:56 |
| *** ijw has quit IRC | 16:58 | |
| *** ijw has joined #openstack-infra | 16:59 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Remove stretch-backports from docker build https://review.opendev.org/712737 | 16:59 |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Install javascript tools in docker via bindep https://review.opendev.org/712738 | 16:59 |
| openstackgerrit | Michal Arbet proposed openstack/project-config master: Add xstatic-** projects for vitrage-dashboard https://review.opendev.org/704133 | 16:59 |
| mordred | zbr: I don't - it was the EOD yesterday and I was out of brain pellets - I'll see if I can do a better job today | 17:00 |
| mordred | zbr: it did a good job of ignoring non-ansible files - so that's an improvement | 17:00 |
| mordred | zbr: the main issue was that it skipped MANY ansible files | 17:01 |
| mordred | so it was failing open | 17:01 |
| *** priteau has quit IRC | 17:01 | |
| zbr | mordred: new logic is to ignore task files from inside roles because it tests when when testing the role itself. | 17:02 |
| zbr | but i am sure that the logic is still flawed, also got https://github.com/ansible/ansible-lint/pull/655 which was not reviewed. | 17:04 |
| mordred | zbr: it was not clear that it was doing anything with the role itself ... but I'll take another peek at it | 17:04 |
| mordred | ianw: ^^ | 17:04 |
| zbr | mordred: it would be very useful if you, or others would get a bit active on its issues, it may help me raise awareness and start a more active maintenance process for it. | 17:05 |
| zbr | github tickets, but using #ansible-galaxy channel is also a good idea, the linter being under the protection of galaxy team. | 17:06 |
| mordred | zbr: nod | 17:06 |
| zbr | mordred: i am sure is not beyond salvation, but it needs a kick ;) | 17:07 |
| *** sshnaidm is now known as sshnaidm|afk | 17:07 | |
| *** jcapitao_afk is now known as jcapitao | 17:12 | |
| * mordred afks for a few minutes | 17:15 | |
| fungi | clarkb: sgw: given that the logging in gerrit isn't much help for this, it might make sense to make a note to revisit it after we upgrade | 17:18 |
| clarkb | fungi: ya, the only other proactive idea I had was to try and capture the http requests and responses | 17:19 |
| *** jamesmcarthur has quit IRC | 17:19 | |
| *** rlandy|afk is now known as rlandy | 17:19 | |
| sgw | Morning guys. I think we tried the capture last time also, there really anything useful if I recall correctly. Let me know after the upgrade happens. | 17:24 |
| fungi | clarkb: which is not easy given it's all https | 17:24 |
| AJaeger | config-core, a few open reviews: https://review.opendev.org/711114 https://review.opendev.org/711878 https://review.opendev.org/712586 https://review.opendev.org/712048 https://review.opendev.org/#/c/708642/ | 17:25 |
| AJaeger | please put on your review queue | 17:25 |
| clarkb | fungi: ya easiest method is probably for sgw to do it in the browser then export that (somehow) | 17:25 |
| *** rpittau is now known as rpittau|afk | 17:27 | |
| *** ahosam has quit IRC | 17:28 | |
| *** ahosam has joined #openstack-infra | 17:29 | |
| *** auristor has quit IRC | 17:30 | |
| *** hashar has quit IRC | 17:33 | |
| *** dtantsur is now known as dtantsur|afk | 17:34 | |
| *** evrardjp has quit IRC | 17:35 | |
| *** evrardjp has joined #openstack-infra | 17:36 | |
| *** kozhukalov has joined #openstack-infra | 17:46 | |
| *** jamesmcarthur has joined #openstack-infra | 17:47 | |
| *** smarcet has joined #openstack-infra | 17:58 | |
| smarcet | fungi: afternoon when u have some time please review https://review.opendev.org/#/c/712511/ :) thx u! | 17:58 |
| *** derekh has quit IRC | 18:01 | |
| *** Lucas_Gray has quit IRC | 18:05 | |
| *** auristor has joined #openstack-infra | 18:05 | |
| *** paladox has quit IRC | 18:07 | |
| *** paladox has joined #openstack-infra | 18:09 | |
| *** jcapitao has quit IRC | 18:20 | |
| *** pkopec has quit IRC | 18:21 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 18:24 |
| *** ahosam has quit IRC | 18:26 | |
| *** ralonsoh has quit IRC | 18:29 | |
| openstackgerrit | Merged opendev/puppet-openstackid master: Added python packages install support https://review.opendev.org/712511 | 18:33 |
| *** gfidente is now known as gfidente|afk | 18:41 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Support buildkit backend when building docker images https://review.opendev.org/712716 | 18:42 |
| *** jpena is now known as jpena|off | 18:51 | |
| *** gmann is now known as gmann_lunch | 19:00 | |
| *** andrewbonney has quit IRC | 19:02 | |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-jobs master: install-kubernetes: install lz4 packages https://review.opendev.org/712771 | 19:04 |
| *** gfidente|afk has quit IRC | 19:05 | |
| *** kozhukalov has quit IRC | 19:13 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 19:13 |
| *** jamesmcarthur has quit IRC | 19:15 | |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Remove stretch-backports from docker build https://review.opendev.org/712737 | 19:18 |
| openstackgerrit | Monty Taylor proposed zuul/zuul master: Be explicit about source of base images https://review.opendev.org/712772 | 19:18 |
| *** amoralej is now known as amoralej|off | 19:24 | |
| openstackgerrit | Merged zuul/zuul-jobs master: install-kubernetes: install lz4 packages https://review.opendev.org/712771 | 19:27 |
| openstackgerrit | David Shrewsbury proposed zuul/nodepool master: Add options to CLI info command https://review.opendev.org/712539 | 19:33 |
| openstackgerrit | David Shrewsbury proposed zuul/nodepool master: WIP: Support uploads in 'info' CLI command https://review.opendev.org/712775 | 19:33 |
| *** jamesmcarthur has joined #openstack-infra | 19:35 | |
| *** smarcet has quit IRC | 19:36 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 19:41 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove hacking from requirements https://review.opendev.org/712778 | 19:45 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove hacking from requirements https://review.opendev.org/712778 | 19:46 |
| *** smarcet has joined #openstack-infra | 19:49 | |
| openstackgerrit | Monty Taylor proposed zuul/nodepool master: Stop using hacking for anything https://review.opendev.org/712781 | 19:50 |
| *** trident has quit IRC | 19:51 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 19:53 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove hacking from requirements https://review.opendev.org/712778 | 19:54 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 19:57 |
| *** trident has joined #openstack-infra | 19:59 | |
| *** gmann_lunch is now known as gmann | 20:01 | |
| *** jamesdenton has quit IRC | 20:03 | |
| openstackgerrit | Monty Taylor proposed zuul/nodepool master: Stop using hacking for anything https://review.opendev.org/712781 | 20:03 |
| *** jamesdenton has joined #openstack-infra | 20:03 | |
| *** Goneri has quit IRC | 20:18 | |
| *** rh-jelabarre has quit IRC | 20:22 | |
| *** smarcet has quit IRC | 20:24 | |
| *** smarcet has joined #openstack-infra | 20:27 | |
| *** rh-jelabarre has joined #openstack-infra | 20:29 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 20:34 |
| *** hashar has joined #openstack-infra | 20:37 | |
| *** smarcet has quit IRC | 20:38 | |
| *** ociuhandu has joined #openstack-infra | 20:42 | |
| fungi | gonna step away for ~45 minutes to get a walk in while the weather's cooperative | 20:48 |
| *** ociuhandu has quit IRC | 21:02 | |
| *** ociuhandu has joined #openstack-infra | 21:03 | |
| *** gshippey has quit IRC | 21:07 | |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: fedora-mirror-update: remove Fedora 29 mirrors https://review.opendev.org/712797 | 21:07 |
| *** ociuhandu has quit IRC | 21:08 | |
| ianw | dpawlik: ^ it sounded like you're using the mirror outside infra? i don't want to break you unnecessarily, but in general we're not thinking of external users when we commit changes either so it's going to be fragile generally | 21:09 |
| clarkb | ianw: https://review.opendev.org/712778 would be a good one for you to look at (its causing nodepool to run hacking) | 21:10 |
| ianw | clarkb: huh, it was there before just capped. so it's an issue with the new version? | 21:11 |
| ianw | (of hacking) | 21:11 |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove hacking from requirements https://review.opendev.org/712778 | 21:12 |
| clarkb | ianw: ya I think nodepool was old hacking clean, but then new hacking doesn't respect the ignore H rule or something and causes nodepool to run hacking anyway | 21:12 |
| clarkb | ianw: because nodepool is installing flake8 and running it and dib pulls in hacking transitively (nodepool doesn't intend to run hacking at all but this does an end around that) | 21:12 |
| mordred | yeah - or more to the point there is a hacking test that prints stuff to stdout that for some reason just started showing up where it didn't before | 21:13 |
| mordred | so if you run tox -epep8 in nodepol it is ... unpleasant | 21:13 |
| mordred | and that's even with H in the ignores list | 21:13 |
| clarkb | mordred: maybe te ignores means run everything then filter rather than filter then run | 21:13 |
| mordred | but - that was really just the thing that caused me to call down the rabbithole | 21:14 |
| mordred | clarkb: I am pretty certain that is the case | 21:14 |
| ianw | clarkb/mordred : i feel like we did just this before -- put hacking into test-requirements.txt and then reverted it https://review.opendev.org/#/c/682257/ | 21:15 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 21:15 |
| clarkb | ianw: ya one suggestion I had was that instead of deping on hacking could dep on flake8 instead | 21:15 |
| clarkb | but mordred felt that was still not appropriate | 21:16 |
| mordred | yeah. I think it's worth breaking people | 21:16 |
| mordred | or worth making dib-lint its own package | 21:16 |
| mordred | or something | 21:16 |
| mordred | but if I install diskimage-builder to build images I don't expect to get linter tools | 21:16 |
| mordred | I think depending on flake8 and not hacking would be an acceptable compromise though | 21:17 |
| mordred | if everybody else feels strongly that dib-lint is an important part of what dib is shipping | 21:17 |
| ianw | hrm, i think my thinking was it's kind of ilke warnings in a compiler; you might want to run it on your elements | 21:17 |
| clarkb | it does help provide useful advice for producing maintainable elements | 21:17 |
| clarkb | (things like how to set up debug tracing) | 21:18 |
| mordred | yeah - I can see it being a useful tool | 21:18 |
| ianw | i'm not strongly of that opinion, however. i think the immediate issue was project-config broke (or will break with that) | 21:18 |
| mordred | k. how about we start with just depending on flake8 | 21:18 |
| clarkb | ya I suggested mordred test with project-config too since we use the linter there | 21:18 |
| mordred | since that won't break anything | 21:18 |
| mordred | then we can come back to the other question as a followon? | 21:19 |
| clarkb | ya that makes sense | 21:19 |
| clarkb | we can take the halfway step to remove hacking from things while not breaking existing users | 21:19 |
| clarkb | then sort out how to transition users if ncessary | 21:19 |
| ianw | i think that seems very reasonable; i think hacking has really just been copy-pasted over the years, rather than being the actual requirement | 21:19 |
| *** stampeder has joined #openstack-infra | 21:20 | |
| openstackgerrit | Monty Taylor proposed openstack/diskimage-builder master: Remove hacking from requirements https://review.opendev.org/712778 | 21:21 |
| mordred | clarkb: feel like re-reviewing https://review.opendev.org/#/c/712772/ and https://review.opendev.org/#/c/712772/ - I removed the buildkit stuff from teh stack | 21:24 |
| ianw | cool; i can point-release with that ... assuming there's not some consistent issue with the triple-o job :/ if there is we can force-merge | 21:24 |
| openstackgerrit | Monty Taylor proposed zuul/nodepool master: Be explicit about base image source https://review.opendev.org/712798 | 21:25 |
| mordred | ianw: fingers crossed | 21:25 |
| clarkb | mordred: those are different changes but I'll review them anyway :) | 21:25 |
| clarkb | looking for the tab where I had the other stack | 21:26 |
| mordred | clarkb: one of them is new :) | 21:26 |
| *** rh-jelabarre has quit IRC | 21:26 | |
| mordred | clarkb: also the nodepool one there I just uploaded | 21:26 |
| mordred | yay thanks! | 21:26 |
| *** Martouf has joined #openstack-infra | 21:26 | |
| mordred | Shrews: ^^ nodepool if you're bored | 21:26 |
| ianw | btw i just approved the nb01.opendev.org deployment so will be watching what ansible gets up to with that soon | 21:27 |
| *** rh-jelabarre has joined #openstack-infra | 21:27 | |
| ianw | mordred: i don't think podman-compose will update the containers, right? | 21:27 |
| clarkb | ianw: exciting. fyi we (mostly frickler) discovered that goaccess is compile with using /tmp for data rather than memory on ubuntu this makes it a bit slower than expected (those safer for large data sets I suppose. To address this we bumped the job timeout to 2 hours | 21:27 |
| clarkb | docs.openstack.org took about an hour I guess | 21:28 |
| mordred | ianw: it actually should - I believe our stuff does pull-always yeah? | 21:28 |
| mordred | ianw: but - let's watch and see :) | 21:28 |
| ianw | mordred: i ... don't know. we'll find out soon enough | 21:28 |
| ianw | clarkb: cool, that seems long; as long as it doesn't kill the webserver in the process ;) | 21:29 |
| clarkb | ianw: its single core so should be relatively safe | 21:30 |
| clarkb | (and by writing to disk avoids using much memory) | 21:30 |
| melwitt | does anyone know how I can know which log files are indexed by our logstash? for example, are the mysql error logs indexed? | 21:30 |
| clarkb | I expect its fine and we can probably nice it to be extra sure | 21:30 |
| clarkb | melwitt: one sec | 21:30 |
| clarkb | melwitt: https://opendev.org/opendev/base-jobs/src/branch/master/roles/submit-logstash-jobs/defaults/main.yaml is the list | 21:32 |
| melwitt | ah thank you | 21:32 |
| *** rlandy is now known as rlandy|afk | 21:32 | |
| clarkb | doesn't look like mysql error logs are in there | 21:34 |
| clarkb | but you might be able to get a canary log from something sqlalchemy leaves in service logs ? | 21:35 |
| openstackgerrit | Merged opendev/system-config master: Add nb01.opendev.org https://review.opendev.org/693119 | 21:36 |
| openstackgerrit | Merged opendev/system-config master: Added new Fedora release to mirroring https://review.opendev.org/712680 | 21:36 |
| *** stampeder has quit IRC | 21:37 | |
| *** hashar has quit IRC | 21:40 | |
| openstackgerrit | James E. Blair proposed zuul/zuul master: Add TLS support for ZooKeeper https://review.opendev.org/712531 | 21:40 |
| melwitt | clarkb: thanks. I'm back looking at the cell timeout gate bug, was just seeing if I could do a larger scale search to check if there's a 100% fail pattern in the error log. unfortunately not something that shows up in service logs, but I can just keep looking by hand. I was just gonna use logstash if I could to get even more result :) | 21:41 |
| *** ociuhandu has joined #openstack-infra | 21:41 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 21:43 |
| *** xek has quit IRC | 21:45 | |
| mordred | ianw: looking forward to our new nb01 overlords | 21:46 |
| openstackgerrit | Mohammed Naser proposed zuul/zuul-jobs master: ensure-tox: use python3 by default https://review.opendev.org/712804 | 21:50 |
| *** amoralej|off is now known as amoralej | 22:00 | |
| *** ociuhandu has quit IRC | 22:03 | |
| *** ociuhandu has joined #openstack-infra | 22:04 | |
| *** rcernin has joined #openstack-infra | 22:04 | |
| *** rcernin has quit IRC | 22:04 | |
| *** rcernin has joined #openstack-infra | 22:05 | |
| *** ociuhandu has quit IRC | 22:09 | |
| ianw | cron is failing on the old nb01 when it runs git gc on the dib_cache/source-repositories directoires with : fatal: bad object refs/remotes/origin/HEAD | 22:22 |
| ianw | unfortunately, it doesn't say what repo | 22:22 |
| ianw | but i guess it means we're probably distributing one bad repo currently ... running manually to see what's up | 22:22 |
| fungi | ianw: i take it that was you generating a sudo error on afs01.ord.o.o? | 22:22 |
| ianw | fungi: yes, sorry something else i noticed. we had a bad sudo file on there, from ages ago when i deployed a corrupt one | 22:23 |
| fungi | oops. cool, thanks for fixing | 22:23 |
| ianw | this is the problem with tailing ansible.log, you notice all sorts of things :) | 22:23 |
| fungi | and yeah, it looked like the cryptic error you get when someone tries to sudo and the sudoers is corrupt | 22:23 |
| ianw | yep, went back in via root on bridge and cleared it | 22:24 |
| openstackgerrit | Merged zuul/nodepool master: Be explicit about base image source https://review.opendev.org/712798 | 22:25 |
| *** factor has quit IRC | 22:27 | |
| *** slaweq has quit IRC | 22:28 | |
| *** jamesmcarthur has quit IRC | 22:30 | |
| *** nicolasbock has quit IRC | 22:43 | |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul-operator master: Add missing zuul service volumes https://review.opendev.org/712811 | 22:44 |
| *** dave-mccowan has quit IRC | 22:50 | |
| *** rlandy|afk is now known as rlandy | 22:55 | |
| *** tkajinam has joined #openstack-infra | 22:56 | |
| *** matt_kosut has quit IRC | 22:59 | |
| *** Goneri has joined #openstack-infra | 23:08 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-operator master: Use explicit provides/requires for container jobs https://review.opendev.org/712816 | 23:21 |
| *** jamesmcarthur has joined #openstack-infra | 23:22 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-operator master: Update to dhall lang v14 https://review.opendev.org/710649 | 23:23 |
| openstackgerrit | James E. Blair proposed zuul/zuul-operator master: Add TLS configuration to ZooKeeper service https://review.opendev.org/712759 | 23:23 |
| openstackgerrit | James E. Blair proposed zuul/zuul master: WIP: use ZK TLS in quickstart https://review.opendev.org/712817 | 23:27 |
| *** jamesmcarthur has quit IRC | 23:27 | |
| ianw | PLAY [Configure nodepool builders] ********************************************* | 23:28 |
| ianw | skipping: no hosts matched | 23:28 |
| ianw | hrm ... | 23:28 |
| *** amoralej is now known as amoralej|off | 23:29 | |
| ianw | argh, no it's some sort of distutils error | 23:34 |
| ianw | mordred: http://paste.openstack.org/show/790653/ does this look familiar? | 23:34 |
| ianw | FAILED! => {"changed": true, "cmd": ["python3", "/var/lib/get-pip.py"], ... "ModuleNotFoundError: No module named 'distutils.util'"], | 23:35 |
| fungi | https://github.com/pypa/get-pip/issues/43 | 23:36 |
| fungi | need python3-distutils installed on debian and its derivatives, i guess | 23:36 |
| fungi | it's separated out into its own package | 23:37 |
| *** jamesmcarthur has joined #openstack-infra | 23:37 | |
| ianw | fungi: sigh, thanks | 23:37 |
| fungi | any time | 23:37 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: pip3: Add python3-distutils https://review.opendev.org/712818 | 23:39 |
| ianw | i guess that's on gate hosts, which is why it didn't show up in CI | 23:39 |
| ianw | (for now) | 23:39 |
| ianw | in fact, we could try system-config on the plain nodes ... | 23:40 |
| *** dchen has joined #openstack-infra | 23:40 | |
| mordred | ianw: yes. python3-distutil | 23:41 |
| mordred | ianw: have I mentioned how much I love all of this? :) | 23:41 |
| openstackgerrit | Ian Wienand proposed opendev/system-config master: [dnm] test with plain nodes https://review.opendev.org/712819 | 23:43 |
| ianw | let's see what explosions that brings | 23:43 |
| *** dchen has quit IRC | 23:43 | |
| mordred | ianw: I think that's a GREAT idea | 23:45 |
| *** dchen has joined #openstack-infra | 23:46 | |
| *** jamesmcarthur has quit IRC | 23:49 | |
| *** threestrands has joined #openstack-infra | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!