| *** sameo has joined #kata-dev | 05:12 | |
| *** dklyle has quit IRC | 07:11 | |
| *** sgarzare has joined #kata-dev | 07:19 | |
| *** jodh has joined #kata-dev | 07:20 | |
| *** sgarzare has quit IRC | 08:01 | |
| *** davidgiluk has joined #kata-dev | 08:01 | |
| *** gwhaley has joined #kata-dev | 08:03 | |
| *** igordc has quit IRC | 08:13 | |
| *** sgarzare has joined #kata-dev | 08:13 | |
| *** pcaruana has quit IRC | 09:50 | |
| *** jodh has quit IRC | 09:59 | |
| *** pcaruana has joined #kata-dev | 10:27 | |
| *** amorenoz__ has quit IRC | 11:19 | |
| *** amorenoz__ has joined #kata-dev | 11:20 | |
| *** vgoyal has joined #kata-dev | 11:56 | |
| *** devimc has joined #kata-dev | 12:24 | |
| *** igordc has joined #kata-dev | 13:07 | |
| *** ailan has joined #kata-dev | 13:30 | |
| kata-irc-bot | <fidencio> People, I've been facing the following issue and I'd like to understand where it my come from: | 13:39 |
|---|---|---|
| kata-irc-bot | <fidencio> ```time="2020-04-23T13:33:18.79933569Z" level=info msg="New client" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 proxy=459682 source=virtcontainers subsystem=kata_agent url="vsock://3290964649:1024" time="2020-04-23T13:33:18.828614464Z" level=info msg="New client" arch=amd64 command=create | 13:39 |
| kata-irc-bot | container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 proxy=459682 source=virtcontainers subsystem=kata_agent url="vsock://3290964649:1024" time="2020-04-23T13:33:18.831232551Z" level=info msg="New client" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 proxy=459682 source=virtcontainers subsystem=kata_agent | 13:39 |
| kata-irc-bot | url="vsock://3290964649:1024" time="2020-04-23T13:33:18.838197951Z" level=info msg="Agent started in the sandbox" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=sandbox time="2020-04-23T13:33:18.838344474Z" level=info msg="New client" arch=amd64 command=create | 13:39 |
| kata-irc-bot | container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 proxy=459682 source=virtcontainers subsystem=kata_agent url="vsock://3290964649:1024" time="2020-04-23T13:33:18.853875836Z" level=info msg="device details" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 device-major=0 device-minor=551 | 13:39 |
| kata-irc-bot | mountpoint=/var/lib/containers/storage/overlay/a017e4b957b1cd547be8e1a042f5b0635494e30eed422c8ed8d616dc92f85f9b/merged name=kata-runtime pid=459658 sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=container time="2020-04-23T13:33:18.854001921Z" level=info msg="normal attach devices" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 | 13:39 |
| kata-irc-bot | devices="[]" machine_type=q35 name=kata-runtime pid=459658 sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=container time="2020-04-23T13:33:18.856280681Z" level=warning msg="Selinux label specified in config, but not supported in Kata yet, running container without selinux" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime | 13:39 |
| kata-irc-bot | pid=459658 source=virtcontainers subsystem=kata_agent time="2020-04-23T13:33:18.856440536Z" level=info msg="Using sandbox shm" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 shm-size=65536000 source=virtcontainers subsystem=kata_agent time="2020-04-23T13:33:18.856497349Z" level=info msg="New client" arch=amd64 command=create | 13:39 |
| kata-irc-bot | container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 name=kata-runtime pid=459658 proxy=459682 source=virtcontainers subsystem=kata_agent url="vsock://3290964649:1024" time="2020-04-23T13:33:19.531347625Z" level=warning msg="Could not remove container rootfs dir" error="directory not empty" | 13:39 |
| kata-irc-bot | rootfs-dir=/run/kata-containers/shared/sandboxes/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7/rootfs time="2020-04-23T13:33:19.531544438Z" level=warning msg="Could not umount" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 error="no such file or directory" | 13:39 |
| kata-irc-bot | host-path=/run/kata-containers/shared/sandboxes/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7-730d5d94633c63b1-.containerenv name=kata-runtime pid=459658 sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=container time="2020-04-23T13:33:19.531606794Z" level=error msg="rollback failed unmountHostMounts()" | 13:39 |
| kata-irc-bot | arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 error="no such file or directory" name=kata-runtime pid=459658 sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=container time="2020-04-23T13:33:19.531675374Z" level=warning msg="Could not remove container rootfs dir" error="directory not empty" | 13:39 |
| kata-irc-bot | rootfs-dir=/run/kata-containers/shared/sandboxes/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7/4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7/rootfs time="2020-04-23T13:33:19.531707742Z" level=error msg="rollback failed bindUnmountContainerRootfs()" arch=amd64 command=create container=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 error="invalid argument" name=kata-runtime pid=459658 | 13:39 |
| kata-irc-bot | sandbox=4721cbae75a7eefc3d07225afc256699e6a519ca39f444c9737c2660bb6b9ab7 source=virtcontainers subsystem=container``` | 13:39 |
| kata-irc-bot | <fidencio> Most important parts are the 2 last lines | 13:39 |
| *** sameo has quit IRC | 14:10 | |
| *** sameo has joined #kata-dev | 14:11 | |
| *** dklyle has joined #kata-dev | 14:49 | |
| *** pcaruana has quit IRC | 15:27 | |
| *** pcaruana has joined #kata-dev | 15:39 | |
| *** devimc has quit IRC | 15:52 | |
| *** devimc has joined #kata-dev | 15:52 | |
| *** gmmaha has quit IRC | 16:04 | |
| *** gmmaha has joined #kata-dev | 16:14 | |
| *** amorenoz__ has quit IRC | 16:16 | |
| *** amorenoz has joined #kata-dev | 16:23 | |
| *** gmmaha has quit IRC | 16:23 | |
| *** gmmaha has joined #kata-dev | 16:33 | |
| *** gwhaley has quit IRC | 17:00 | |
| kata-irc-bot | <graham.whaley> well, that feel on deaf ears @fidencio - questions to promote discussion then.... were you asking which code printed that and why? (I suspect not...), or why that might happen.... in which case, did you check that directory to see if it was empty, and if not, what was in it and what did `lsof` tell you about any files there. /me just thinking out loud | 17:01 |
| kata-irc-bot | <fidencio> So, a few things crossed my mind ... first one was what may be printing that error? It looks like agent, but may be shim. | 17:03 |
| kata-irc-bot | <fidencio> Considering it's agent, I'm still trying to figure out how to proceed with the debug | 17:03 |
| *** sgarzare has quit IRC | 17:27 | |
| davidgiluk | fidencio: a quick greb suggests bindUnmountContainerRootfs is runtime | 17:49 |
| davidgiluk | fidencio: runtime/virtcontainers/mount.go | 17:49 |
| * davidgiluk wonders how he mistyped grep as greb and flips the 'b' | 17:50 | |
| fidencio | davidgiluk: there's something fishy on this, as I can only reproduce this on RHCOS | 18:04 |
| fidencio | davidgiluk: exactly the same runtime binary from fedora32 just works | 18:04 |
| kata-irc-bot | <greg.bock> are you matching runtime binary and boot kernel/initrd ? | 18:05 |
| kata-irc-bot | <greg.bock> There are dependencies there between certain versions | 18:05 |
| kata-irc-bot | <fidencio> I do match them in the sense all of them support virtiofs | 18:08 |
| kata-irc-bot | <greg.bock> what release are the kernel/initrd from vs runtime? | 18:11 |
| kata-irc-bot | <fidencio> So, this whole thing is complicated. :slightly_smiling_face: I'm using a downstream kernel (EL) patched to support virtiofs. And latest runtime. Again, similar combination works on Fedora. Let me get to the runtime code and check whether it may be some regression there. I had it working with alpha without any issue ... | 18:13 |
| kata-irc-bot | <greg.bock> i had similar issues when vsock had changes | 18:14 |
| kata-irc-bot | <greg.bock> https://github.com/kata-containers/runtime/issues/1378 https://github.com/kata-containers/agent/pull/508 | 18:14 |
| kata-irc-bot | <greg.bock> at the very least you'd be best making sure the agent in the initrd and your runtime are from the same checkout | 18:15 |
| kata-irc-bot | <greg.bock> kernel may or may not need different build options | 18:15 |
| kata-irc-bot | <fidencio> cool, really good pointers! | 18:16 |
| kata-irc-bot | <greg.bock> There have also been changes to the on disk json configs that weren't backwards compatible between runtimes | 18:17 |
| *** davidgiluk has quit IRC | 19:16 | |
| *** khyr0n has quit IRC | 19:30 | |
| *** igordc has quit IRC | 19:39 | |
| *** igordc has joined #kata-dev | 20:32 | |
| *** sameo has quit IRC | 20:36 | |
| *** jugs has quit IRC | 20:46 | |
| *** jugs has joined #kata-dev | 20:48 | |
| *** igordc has quit IRC | 21:51 | |
| *** ailan has quit IRC | 21:56 | |
| *** devimc has quit IRC | 22:12 | |
| *** vgoyal has quit IRC | 22:13 | |
| *** igordc has joined #kata-dev | 22:26 | |
| *** igordc has quit IRC | 23:05 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!