Friday, 2022-08-05

kata-irc-bot<arron.wang> Yes, we use webhookrelay, free service don't have rate limitation, but have limits for log service, after exceed the limits, the logs of events forward by webhookrelay will not saved on the server01:13
kata-irc-bot<chelsea.e.mafrica> thanks @liubin032904:52
kata-irc-bot<bbolroc> It seems the runk test on ubuntu got unstable at https://github.com/kata-containers/tests/blob/main/integration/containerd/runk/runk-tests.sh#L64 with: ```test ps command ctr: /usr/local/bin/runk did not terminate successfully: exit status 1: ERROR: command is not implemented yet : unknown ERROR: ps command failed  script:   name: 'integration/containerd/runk/runk-tests.sh'   pid: 124126   directory:12:22
kata-irc-bot'/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests'   details: 'drwxrwxr-x 16 jenkins jenkins ? 4096 Aug  5 09:58 /tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests' failure:   function: 'test_runk'   file:12:22
kata-irc-bot'/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests/integration/containerd/runk/runk-tests.sh'   line: 64   name: 'integration/containerd/runk/runk-tests.sh' stacktrace:   0: {function: 'dump_details', file: '/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests/lib/error.sh', line: 169}   1: {function: 'die', file:12:22
kata-irc-bot'/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests/lib/common.bash', line: 68}   2: {function: 'test_runk', file: '/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests/integration/containerd/runk/runk-tests.sh', line: 64, current='yes'}   3: {function: 'main', file:12:22
kata-irc-bot'/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/src/github.com/kata-containers/tests/integration/containerd/runk/runk-tests.sh', line: 86} process-hierarchy:   0: {pid: 124126, command: 'bash -f integration/containerd/runk/runk-tests.sh', current='yes'}   1: {pid: 124117, command: 'make runk'}   2: {pid: 124116, command: 'sudo -E12:22
kata-irc-botPATH=/tmp/jenkins/workspace/kata-containers-2.0-tests-ubuntu20.04-PR/go/bin:/usr/local/go/bin:/usr/sbin:/sbin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin CRI_RUNTIME=containerd bash -c make runk'}   3: {pid: 56676, command: '/bin/bash .ci/run.sh'}   4: {pid: 11659, command: '/bin/bash .ci/jenkins_job_build.sh github.com/kata-containers/tests'}   5: {pid: 11632, command: '/bin/bash12:22
kata-irc-bot/tmp/jenkins10099043415394538837.sh'}   6: {pid: 11493, command: 'java -jar remoting.jar -workDir /home/jenkins/remoting'}   7: {pid: 11489, command: 'sshd: jenkins@notty'}   8: {pid: 11414, command: 'sshd: jenkins [priv]'}   9: {pid: 1717, command: 'sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups'}   10: {pid: 1, command: '/sbin/init'}```12:22
kata-irc-bot<bbolroc> You can see the same phenomenon at http://jenkins.katacontainers.io/job/kata-containers-2.0-tests-ubuntu20.04-PR/1516/ and http://jenkins.katacontainers.io/job/kata-containers-2.0-tests-ubuntu-s390x-main-PR/1066/ Any ideas to fix this?12:25
kata-irc-bot<bbolroc> Here is the debug log: ```14:39:36 + test_runk 14:39:36 + echo 'start container with runk' 14:39:36 start container with runk 14:39:36 + sudo ctr run --pid-file id1.pid --rm -d --runc-binary /usr/local/bin/runk docker.io/library/busybox:latest id1 14:39:37 + read CID PID STATUS 14:39:37 ++ sudo ctr t ls 14:39:37 ++ grep id1 14:39:37 ++ cat id1.pid 14:39:37 + '[' 80951 == 80951 ']' 14:39:37 + '[' RUNNING == RUNNING ']' 14:39:37 + echo12:48
kata-irc-bot'exec process in a container' 14:39:37 exec process in a container 14:39:37 + sudo ctr t exec --exec-id id1 id1 sh -c 'echo hello > /tmp/foo' 14:39:37 ++ sudo ctr t exec --exec-id id1 id1 cat /tmp/foo 14:39:37 + '[' hello == hello ']' 14:39:37 + echo 'test ps command' 14:39:37 test ps command 14:39:37 + sudo ctr t exec --detach --exec-id id1 id1 sh 14:39:37 ++ sudo ctr t ps id1 14:39:37 ++ wc -l 14:39:37 ctr: /usr/local/bin/runk did not terminate12:48
kata-irc-botsuccessfully: exit status 1: ERROR: command is not implemented yet 14:39:37 : unknown 14:39:37 + '[' 3 == 0 ']'``` 12:48
kata-irc-bot<bbolroc> You can see the same phenomenon at http://jenkins.katacontainers.io/job/kata-containers-2.0-tests-ubuntu20.04-PR/1516/ and http://jenkins.katacontainers.io/job/kata-containers-2.0-tests-ubuntu-s390x-main-PR/1066/ Any ideas to fix this?13:08
kata-irc-bot<bbolroc> Here is the debug log: ```14:39:36 + test_runk 14:39:36 + echo 'start container with runk' 14:39:36 start container with runk 14:39:36 + sudo ctr run --pid-file id1.pid --rm -d --runc-binary /usr/local/bin/runk docker.io/library/busybox:latest id1 14:39:37 + read CID PID STATUS 14:39:37 ++ sudo ctr t ls 14:39:37 ++ grep id1 14:39:37 ++ cat id1.pid 14:39:37 + '[' 80951 == 80951 ']' 14:39:37 + '[' RUNNING == RUNNING ']' 14:39:37 + echo13:08
kata-irc-bot'exec process in a container' 14:39:37 exec process in a container 14:39:37 + sudo ctr t exec --exec-id id1 id1 sh -c 'echo hello > /tmp/foo' 14:39:37 ++ sudo ctr t exec --exec-id id1 id1 cat /tmp/foo 14:39:37 + '[' hello == hello ']' 14:39:37 + echo 'test ps command' 14:39:37 test ps command 14:39:37 + sudo ctr t exec --detach --exec-id id1 id1 sh 14:39:37 ++ sudo ctr t ps id1 14:39:37 ++ wc -l 14:39:37 ctr: /usr/local/bin/runk did not terminate13:08
kata-irc-botsuccessfully: exit status 1: ERROR: command is not implemented yet 14:39:37 : unknown 14:39:37 + '[' 3 == 0 ']'```13:08
kata-irc-bot<bbolroc> Seems this could be a cause for the problem: ```jenkins@kata-ci-debug-01:~$ sudo ctr t ls TASK    PID      STATUS     id1     80951    RUNNING jenkins@kata-ci-debug-01:~$ sudo ctr t pause id1 ctr: OCI runtime pause failed: /usr/local/bin/runk did not terminate successfully: exit status 1: ERROR: command is not implemented yet : unknown```13:10
kata-irc-bot<fidencio> cc @manabu.sugimoto13:18
kata-irc-bot<manabu.sugimoto> This happened the https://github.com/kata-containers/tests/pull/4942 was accidentally was merged  before addint the https://github.com/kata-containers/kata-containers/pull/4763, so ps command failed. I'll create a PR to comment out the test as temporary measure and uncomment it again after ps command is added.13:28
kata-irc-bot<fidencio> No, no need, let me review and get the runk changes in @manabu.sugimoto13:29
kata-irc-bot<fidencio> @manabu.sugimoto, if you have some cicles to also review that, that would be good13:29
kata-irc-bot<manabu.sugimoto> Sure, I'll take a look at https://github.com/kata-containers/kata-containers/pull/4763 and approve it. Thank you.13:33
kata-irc-bot<fidencio> Thank you @manabu.sugimoto, you rock!13:33
kata-irc-bot<bbolroc> Thank you guys. ^^13:34
kata-irc-bot<manabu.sugimoto> @fidencio I approve it, Could you approve and merge it if there are no problems?14:28
kata-irc-bot<fidencio> Done!14:28

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!