*** jamesmcarthur has joined #zuul | 00:04 | |
*** jamesmcarthur has quit IRC | 00:05 | |
*** jamesmcarthur has joined #zuul | 00:05 | |
*** jamesmcarthur has quit IRC | 01:12 | |
SpamapS | pabelanger:seems like jobs<->checks is a clear and obvious map so hopefully it's just a simple matter of code | 01:18 |
---|---|---|
*** jamesmcarthur has joined #zuul | 01:43 | |
*** jamesmcarthur has quit IRC | 01:44 | |
*** jamesmcarthur_ has joined #zuul | 01:44 | |
tristanC | jhesketh: i think i found the issue with test_job_pause, i'll rebase the stack again (because of new conflict introduced yesterday) with a fix | 01:52 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Get executor job params https://review.opendev.org/607078 | 01:52 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Separate out executor server from runner https://review.opendev.org/607079 | 01:52 |
*** rlandy|bbl is now known as rlandy | 02:04 | |
*** rlandy has quit IRC | 02:04 | |
*** bhavikdbavishi has joined #zuul | 02:04 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Separate out executor server from runner https://review.opendev.org/607079 | 02:10 |
*** bhavikdbavishi has quit IRC | 02:15 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Move repository preparation into common class https://review.opendev.org/648642 | 02:16 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: Separate out executor concerns from AnsibleJob https://review.opendev.org/648643 | 02:16 |
*** bhavikdbavishi has joined #zuul | 02:20 | |
*** jamesmcarthur_ has quit IRC | 02:33 | |
*** jamesmcarthur has joined #zuul | 02:34 | |
*** jamesmcarthur has quit IRC | 03:08 | |
*** bhavikdbavishi has quit IRC | 03:10 | |
*** jamesmcarthur has joined #zuul | 03:11 | |
tristanC | now it seems like zuul-tox-remote failre is not related, it randomly fails on TestZuulStream2[567].test_command | 03:15 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: config: add tenant.toDict() method and REST endpoint https://review.opendev.org/621344 | 03:28 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: gerrit: add support for report only connection https://review.opendev.org/568216 | 03:30 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: [WIP] test_remote_zuul_stream: add debug https://review.opendev.org/657914 | 03:33 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: runner: implement prep-workspace https://review.opendev.org/607082 | 03:34 |
*** jamesmcarthur has quit IRC | 03:34 | |
*** jamesmcarthur has joined #zuul | 04:05 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: [WIP] test_remote_zuul_stream: add debug https://review.opendev.org/657914 | 04:20 |
*** markwork has joined #zuul | 04:28 | |
*** raukadah is now known as chandankumar | 04:30 | |
*** swest has joined #zuul | 04:36 | |
tobiash | pabelanger: yes, there was already discussion about this and also an implementation by a collegue: https://review.opendev.org/#/q/status:open+project:zuul/zuul+branch:master+topic:bloeffler-report-reties | 04:39 |
tobiash | we may want to continue on that | 04:42 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: runner: add configuration schema https://review.opendev.org/640672 | 04:52 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: runner: add prepare-workspace command line interface https://review.opendev.org/644770 | 04:52 |
*** badboy has joined #zuul | 05:24 | |
badboy | mordred: hi, does zuul support draft-created event? | 05:25 |
*** markwork has quit IRC | 05:32 | |
*** bhavikdbavishi has joined #zuul | 05:44 | |
*** markwork has joined #zuul | 06:05 | |
*** markwork has quit IRC | 06:13 | |
*** themroc has joined #zuul | 06:40 | |
*** quiquell|off is now known as quiquell | 06:47 | |
openstackgerrit | Mark Meyer proposed zuul/zuul master: dd https://review.opendev.org/657945 | 06:53 |
AJaeger | zuul team, the zuul-jobs fail on https://review.opendev.org/#/c/656908/ since Sphinx now needs python 3 and the tox-py27 is not using that. So, right now all of zuul-jobs gating looks broken ;( | 06:59 |
*** markwork has joined #zuul | 07:12 | |
*** panda|off is now known as panda | 07:19 | |
*** gtema has joined #zuul | 07:19 | |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: runner: add execute sub-command https://review.opendev.org/630944 | 07:24 |
openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: runner: enable reuse of a job-dir https://review.opendev.org/657955 | 07:24 |
openstackgerrit | Mark Meyer proposed zuul/zuul master: Add Bitbucket Server source functionality https://review.opendev.org/657837 | 07:24 |
*** jpena|off is now known as jpena | 07:45 | |
*** jangutter has joined #zuul | 08:39 | |
*** panda has quit IRC | 08:55 | |
*** panda has joined #zuul | 08:55 | |
*** wxy-xiyuan has quit IRC | 09:26 | |
*** themroc has quit IRC | 09:59 | |
*** themroc has joined #zuul | 09:59 | |
*** mugsie has quit IRC | 10:25 | |
*** mugsie has joined #zuul | 10:35 | |
*** mugsie has quit IRC | 10:35 | |
*** mugsie has joined #zuul | 10:36 | |
*** mugsie has quit IRC | 10:38 | |
*** mugsie has joined #zuul | 10:39 | |
*** panda is now known as panda|lunch | 11:02 | |
openstackgerrit | Mark Meyer proposed zuul/zuul master: Add Bitbucket Server source functionality https://review.opendev.org/657837 | 11:03 |
*** themroc has quit IRC | 11:14 | |
*** themroc has joined #zuul | 11:14 | |
*** gtema has quit IRC | 11:18 | |
*** gtema has joined #zuul | 11:18 | |
openstackgerrit | Mark Meyer proposed zuul/zuul master: Add Bitbucket Server source functionality https://review.opendev.org/657837 | 11:35 |
*** jpena is now known as jpena|lunch | 11:39 | |
*** rf0lc0 is now known as rfolco|ruck | 11:49 | |
*** panda|lunch is now known as panda | 12:06 | |
*** abraverm has joined #zuul | 12:10 | |
*** rlandy has joined #zuul | 12:20 | |
*** jamesmcarthur has quit IRC | 12:21 | |
*** jamesmcarthur has joined #zuul | 12:21 | |
pabelanger | tobiash: great, thanks. I'll look and see what help it needs | 12:28 |
*** jamesmcarthur has quit IRC | 12:30 | |
*** jpena|lunch is now known as jpena | 12:31 | |
*** quiquell is now known as quiquell|lunch | 12:37 | |
*** gtema has quit IRC | 12:37 | |
openstackgerrit | Mark Meyer proposed zuul/zuul master: Add Bitbucket Server source functionality https://review.opendev.org/657837 | 12:38 |
*** gtema has joined #zuul | 12:48 | |
*** jamesmcarthur has joined #zuul | 12:49 | |
pabelanger | tristanC: yah, that test needs to be debugged. It has been bouncing for a while | 13:02 |
pabelanger | badboy: you _should_ be able to create a trigger based on it. But know opendev doesn't use it today, feature is diabled. | 13:03 |
*** jamesmcarthur has quit IRC | 13:05 | |
*** quiquell|lunch is now known as quiquell | 13:25 | |
openstackgerrit | Mark Meyer proposed zuul/zuul master: Add Bitbucket Server source functionality https://review.opendev.org/657837 | 13:30 |
*** gtema has quit IRC | 13:40 | |
*** altlogbot_0 has quit IRC | 13:43 | |
*** altlogbot_1 has joined #zuul | 13:46 | |
*** quiquell is now known as quiquell|brb | 13:55 | |
openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: tox siblings install: handle no metadata in setup.cfg https://review.opendev.org/656908 | 13:59 |
openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Shift doc requirements to doc/requirements.txt https://review.opendev.org/658087 | 13:59 |
*** bhavikdbavishi has quit IRC | 14:02 | |
openstackgerrit | Merged zuul/zuul-jobs master: Shift doc requirements to doc/requirements.txt https://review.opendev.org/658087 | 14:25 |
openstackgerrit | Merged zuul/zuul-jobs master: tox siblings install: handle no metadata in setup.cfg https://review.opendev.org/656908 | 14:25 |
*** gchenuet has joined #zuul | 14:25 | |
gchenuet | Hi guys! Quick question about infra sizing. I saw that Executor nodes have also a merger role. Is it better to have separate executor and merger nodes or only executor ? | 14:28 |
gchenuet | I also saw that OpenStack have 12 executors but can't find how merger nodes do you have. Can you share you some infos about your infra please ? | 14:29 |
Shrews | gchenuet: i think we use 8 mergers | 14:31 |
Shrews | whether or not you use separate mergers depends on how active your zuul is. not sure we've really quantified that somewhere, though | 14:33 |
pabelanger | gchenuet: for zuul.ansible.com, we run 2 executors and 2 mergers. This is mostly for HA reasons, right now. But if we disabled the 2 mergers, right now I think we'd be fine. Potentially slower job start times. | 14:33 |
Shrews | It's talked about a bit here: https://zuul-ci.org/docs/zuul/admin/components.html#merger | 14:34 |
gchenuet | thanks! for now, on Zuulv2 we have ~1.5K change merged by day and 3K builds on Jenkins. | 14:39 |
gchenuet | I'll scale down our executors nodes and add merger nodes. | 14:39 |
*** gtema has joined #zuul | 14:47 | |
markwork | Is that just my impression or is the `zuul-tox-remote' a little bit flakey? | 14:49 |
markwork | (The test job) | 14:49 |
pabelanger | markwork: yes, we need somebody to debug that failure | 14:51 |
pabelanger | it looks to be around the zuul_stream plugin | 14:51 |
*** quiquell|brb is now known as quiquell|off | 15:01 | |
*** markwork has quit IRC | 15:03 | |
*** themroc has quit IRC | 15:06 | |
*** themroc has joined #zuul | 15:07 | |
*** jamesmcarthur has joined #zuul | 15:13 | |
*** themroc has quit IRC | 15:14 | |
Shrews | i *still* can't get the tox remote tests to run locally to try to help debug that. ssh during the test isn't working for some reason | 15:15 |
clarkb | local firewall? | 15:20 |
Shrews | nope | 15:20 |
Shrews | my suspicion is that the ssh key i'm telling it to use is not being used | 15:20 |
*** chandankumar is now known as raukadah | 15:28 | |
corvus | Shrews: i have a vm on my local network with a zuul user with a dedicated ssh key, and i just verified this incantation works: ZUUL_SSH_KEY=~/.ssh/id_rsa_zuultest ZUUL_REMOTE_IPV4=192.168.1.219 ttrun tests.remote.test_remote_zuul_stream.TestZuulStream27.test_command | 15:39 |
Shrews | corvus: using pretty much the same command: ZUUL_REMOTE_IPV4=192.168.1.26 ZUUL_SSH_KEY=/home/shrews/.ssh/test_id_rsa ttrun -e remote tests.remote.test_remote_zuul_stream.TestZuulStream27.test_command | 15:42 |
corvus | (keep in mind it's going to want to log into the "remote" machine as the user "zuul" by default) | 15:42 |
Shrews | yep. i can: ssh -i /home/shrews/.ssh/test_id_rsa zuul@192.168.1.26 | 15:43 |
Shrews | and that works | 15:43 |
Shrews | but i keep getting: "msg": "SSH Error: data could not be sent to remote host \"192.168.1.26\". Make sure this host can be reached over ssh" | 15:43 |
Shrews | i cannot figure it out | 15:43 |
Shrews | this *used* to work for me months ago. something is different (obviously) | 15:44 |
Shrews | i tried adding "-o IdentityFile" to the ansible ssh args out of desperation. that had no effect | 15:45 |
corvus | i wonder if there could be any weird selinux/apparmor stuff going on | 15:46 |
Shrews | corvus: what OS version are you using? | 15:48 |
corvus | i just restructured my command to be like yours (to make sure there wasn't an issue with the way i was doing tox envs) and it still works | 15:48 |
corvus | ubuntu 18.04 | 15:48 |
Shrews | 18.04 here too | 15:49 |
Shrews | this has been beyond frustrating over multiple days | 15:49 |
* Shrews should just admit defeat | 15:50 | |
*** timburke has joined #zuul | 15:51 | |
Shrews | corvus: it would be useful if we had a way to tell tests to keep the tmpdir test files around on test failures | 15:52 |
corvus | Shrews: KEEP_TEMPDIRS=1 | 15:53 |
Shrews | that doesn't work | 15:53 |
Shrews | corvus: oh, sorry, it does! i tried that before and it didn't. maybe a typo | 15:54 |
corvus | Shrews: it just worked for me -- i ran with it and /tmpfs/tmp34tstkth/zuul-test/93b8fcd3bf9d46888cf2f7834d5aa5ea/ exists. i found the path by looking for output about what ansible commands are running | 15:55 |
Shrews | probably forgot the 'S' | 15:55 |
corvus | ah cool | 15:55 |
corvus | (i have ZUUL_TEST_ROOT=/tmpfs also set in my env, so it doesn't thrash my ssd, thus the '/tmpfs') | 15:56 |
Shrews | hrm | 15:56 |
Shrews | unix_listener: "/mnt/ramdisk/zuul/tmpf94rmq4u/zuul-test/0769046734924744a42208da6514073b/.ansible/cp/f544621055.8rOs7EfDhNObuQgx" too long for Unix domain socket | 15:56 |
Shrews | when i try the logged SSH command manually | 15:56 |
corvus | that's new to me | 15:56 |
Shrews | my test root is /mnt/ramdisk. maybe that's a few characters too much | 15:57 |
corvus | wow that would be something | 15:57 |
corvus | in production for us the "/mnt/ramdisk/zuul/tmpf94rmq4u/zuul-test" part is "/var/lib/zuul/builds" which is shorter as well. | 15:58 |
Shrews | #define UNIX_PATH_MAX 108 | 15:59 |
corvus | 113 > 108 | 15:59 |
Shrews | from /usr/include/linux/un.h | 15:59 |
Shrews | *sigh* | 15:59 |
corvus | Shrews: it's a pretty lame answer, but at least it's an answer. :) | 16:00 |
corvus | and we have all learned another piece of useless unix trivia today | 16:00 |
Shrews | i mean... just, wow | 16:00 |
corvus | (i'll file that away with shebang path lengths max out at 128) | 16:01 |
mordred | 108 is the loneliest number | 16:01 |
* Shrews reconfigures his tmpfs to be on /t | 16:01 | |
Shrews | it's a pretty random number | 16:02 |
corvus | Shrews: if you use single letter names for all files and dirs, you'll be safe | 16:02 |
Shrews | corvus++ | 16:02 |
Shrews | corvus: seems like we could have captured that output somewhere | 16:03 |
corvus | Shrews: yeah, did you run ansible and it output that? | 16:03 |
*** bhavikdbavishi has joined #zuul | 16:04 | |
Shrews | corvus: no, i ran the ssh command that ansible output during the test | 16:04 |
*** bhavikdbavishi has quit IRC | 16:07 | |
*** bhavikdbavishi has joined #zuul | 16:07 | |
Shrews | Ran 1 test in 20.780s | 16:09 |
Shrews | OK | 16:09 |
Shrews | so very stupid | 16:09 |
Shrews | *sigh* | 16:10 |
SpamapS | "108 is the loneliest number", that 1973 one hit wonder by The Nerds. | 16:11 |
corvus | and here i thought 0x01 was the loneliest number | 16:11 |
Shrews | i'm going to celebrate this victory with the eating of food. bbl | 16:17 |
SpamapS | corvus:only on little endian | 16:24 |
mordred | Shrews: on osx, UNIX_PATH_MAX is 104 | 16:25 |
corvus | must be to account for "C:\\" | 16:26 |
mordred | https://serverfault.com/questions/641347/check-if-a-path-exceeds-maximum-for-unix-domain-socket in case anyone cares | 16:26 |
Shrews | mordred: anyone trying to run Zuul tests on osx deserves all the pain that would engender | 16:29 |
*** jamesmcarthur has quit IRC | 16:34 | |
mordred | Shrews: I agree | 16:41 |
*** jpena is now known as jpena|off | 16:42 | |
*** irclogbot_1 has quit IRC | 16:46 | |
*** irclogbot_1 has joined #zuul | 16:48 | |
SpamapS | hah, I did it once | 17:05 |
SpamapS | still have a scar | 17:05 |
*** vivobg has joined #zuul | 17:10 | |
*** gtema has quit IRC | 17:14 | |
*** bhavikdbavishi has quit IRC | 17:19 | |
vivobg | Hello. I am trying to install Zuul after seeing it at the OpenInfra Summit in Denver. After following the zuul from scratch docs, I am getting the following error: | 17:37 |
vivobg | Zuul encountered an error while accessing the repo zuul/zuul-base- jobs. The error was: Cmd('git') failed due to: exit code(-13) cmdline: git ls-remote https://opendev.org/zuul/zuul-base-jobs stderr: 'Error reading command stream' | 17:37 |
vivobg | Do you have any ideas on how to fix this? Thanks | 17:38 |
vivobg | I see the above error in the scheduler logs, and in the Web UI notifications | 17:39 |
*** vivobg has quit IRC | 17:48 | |
*** armstrongs has joined #zuul | 17:49 | |
*** gchenuet has quit IRC | 18:08 | |
*** armstrongs has quit IRC | 18:12 | |
*** themroc has joined #zuul | 18:12 | |
clarkb | vivobg is gone but that ls remote command works for me. Given that I would suspect a firewall | 18:16 |
*** jamesmcarthur has joined #zuul | 18:34 | |
*** jamesmcarthur has quit IRC | 18:38 | |
*** markwork has joined #zuul | 18:42 | |
*** jamesmcarthur has joined #zuul | 18:47 | |
*** electrofelix has quit IRC | 18:56 | |
*** themroc has quit IRC | 19:15 | |
*** jamesmcarthur has quit IRC | 19:17 | |
*** jamesmcarthur has joined #zuul | 19:31 | |
*** jamesmcarthur has quit IRC | 19:39 | |
*** jamesmcarthur has joined #zuul | 19:50 | |
*** jamesmcarthur has quit IRC | 20:23 | |
*** markwork has quit IRC | 20:35 | |
*** VitaliyL has joined #zuul | 20:41 | |
*** jamesmcarthur has joined #zuul | 20:54 | |
*** armstrongs has joined #zuul | 20:56 | |
*** logan- has quit IRC | 21:00 | |
*** maxamillion has quit IRC | 21:02 | |
*** maxamillion has joined #zuul | 21:03 | |
*** logan- has joined #zuul | 21:03 | |
*** jamesmcarthur has quit IRC | 21:05 | |
*** armstrongs has quit IRC | 21:05 | |
*** VitaliyL has quit IRC | 21:12 | |
*** Armstrongs has joined #zuul | 21:16 | |
*** jamesmcarthur has joined #zuul | 21:17 | |
*** jamesmcarthur has quit IRC | 21:21 | |
*** Armstrongs has quit IRC | 21:25 | |
*** armstrongs has joined #zuul | 23:02 | |
armstrongs | regarding the issue above, we can run the git commands on the Zuul server from the command line, under the Zulu user. It just seems like the Zuul scheduler can't run the same commands successfully so we are a bit stuck | 23:05 |
armstrongs | This is our 1st attempt at running Zuul so we are thinking there may be a step we are missing in the docs? | 23:06 |
armstrongs | This is happening with the zuul-git connection listed here https://zuul-ci.org/docs/zuul/admin/zuul-from-scratch.html | 23:08 |
armstrongs | on centos 7 | 23:08 |
*** jamesmcarthur has joined #zuul | 23:36 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!