Thursday, 2019-03-07

*** igordc has quit IRC02:07
kata-irc-bot<fupan> Yeah, the codes have been merged in containerd/cri  https://github.com/containerd/cri/pull/1029 and in kata: https://github.com/kata-containers/runtime/pull/1173  I will send a PR to update the Document later.02:33
*** eernst has joined #kata-dev04:03
*** eernst has quit IRC04:07
*** eernst has joined #kata-dev04:07
*** eernst has quit IRC04:11
*** Bhujay has joined #kata-dev05:34
*** igordc has joined #kata-dev05:47
*** Bhujay has quit IRC07:08
*** Bhujay has joined #kata-dev07:09
*** Bhujay has quit IRC07:10
*** Bhujay has joined #kata-dev07:10
*** Bhujay has quit IRC07:11
*** Bhujay has joined #kata-dev07:12
*** Bhujay has quit IRC07:13
*** Bhujay has joined #kata-dev07:13
*** Bhujay has quit IRC07:14
*** Bhujay has joined #kata-dev07:15
*** Bhujay has quit IRC07:16
*** Bhujay has joined #kata-dev07:16
*** Bhujay has quit IRC07:17
*** Bhujay has joined #kata-dev07:18
*** Bhujay has quit IRC07:19
*** Bhujay has joined #kata-dev07:19
*** Bhujay has quit IRC07:20
*** Bhujay has joined #kata-dev07:21
*** Bhujay has quit IRC07:22
*** Bhujay has joined #kata-dev07:23
*** tmhoang has quit IRC07:36
*** david-lyle has joined #kata-dev07:36
*** dklyle has quit IRC07:37
kata-irc-bot<afrosi> I opened an issue https://github.com/kata-containers/tests/issues/126607:37
*** dklyle has joined #kata-dev07:41
*** david-lyle has quit IRC07:42
*** igordc has quit IRC07:54
*** dklyle has quit IRC07:55
*** dklyle has joined #kata-dev07:55
*** jodh has joined #kata-dev08:21
*** tmhoang has joined #kata-dev08:37
*** Bhujay has quit IRC08:55
*** Bhujay has joined #kata-dev08:56
*** Bhujay has quit IRC08:57
*** Bhujay has joined #kata-dev08:58
*** davidgiluk has joined #kata-dev08:58
*** Bhujay has quit IRC08:59
*** Bhujay has joined #kata-dev08:59
*** Bhujay has quit IRC09:00
*** Bhujay has joined #kata-dev09:01
*** Bhujay has quit IRC09:02
*** Bhujay has joined #kata-dev09:02
*** Bhujay has quit IRC09:03
*** Bhujay has joined #kata-dev09:04
*** gwhaley has joined #kata-dev09:05
*** Bhujay has quit IRC09:05
*** Bhujay has joined #kata-dev09:05
*** Bhujay has quit IRC09:06
*** Bhujay has joined #kata-dev09:07
*** Bhujay has quit IRC09:08
*** Bhujay has joined #kata-dev09:08
*** Bhujay has quit IRC09:09
*** Bhujay has joined #kata-dev09:10
*** Bhujay has quit IRC09:11
*** Bhujay has joined #kata-dev09:11
*** Bhujay has quit IRC09:12
*** Bhujay has joined #kata-dev09:13
*** Bhujay has quit IRC09:14
*** Bhujay has joined #kata-dev09:14
*** Bhujay has quit IRC09:15
*** Bhujay has joined #kata-dev09:16
*** Bhujay has quit IRC09:17
*** Bhujay has joined #kata-dev09:17
*** Bhujay has quit IRC09:18
*** Bhujay has joined #kata-dev09:19
*** Bhujay has quit IRC09:20
*** Bhujay has joined #kata-dev09:20
*** Bhujay has quit IRC09:21
*** Bhujay has joined #kata-dev09:22
*** Bhujay has quit IRC09:23
*** Bhujay has joined #kata-dev09:23
*** Bhujay has quit IRC09:24
*** Bhujay has joined #kata-dev09:25
*** Bhujay has quit IRC09:26
*** Bhujay has joined #kata-dev09:26
*** Bhujay has quit IRC09:27
*** Bhujay has joined #kata-dev09:28
*** Bhujay has quit IRC09:29
*** Bhujay has joined #kata-dev09:29
*** Bhujay has quit IRC09:30
*** Bhujay has joined #kata-dev09:31
*** Bhujay has quit IRC09:32
*** Bhujay has joined #kata-dev09:32
*** Bhujay has quit IRC09:33
*** Bhujay has joined #kata-dev09:34
*** Bhujay has quit IRC09:35
*** Bhujay has joined #kata-dev09:35
*** Bhujay has quit IRC09:36
*** Bhujay has joined #kata-dev09:37
*** Bhujay has quit IRC09:38
*** Bhujay has joined #kata-dev09:38
*** Bhujay has quit IRC09:39
*** Bhujay has joined #kata-dev09:40
*** Bhujay has quit IRC09:41
*** Bhujay has joined #kata-dev09:41
*** Bhujay has quit IRC09:42
*** Bhujay has joined #kata-dev09:43
*** Bhujay has quit IRC09:44
*** Bhujay has joined #kata-dev09:44
*** Bhujay has quit IRC09:45
*** Bhujay has joined #kata-dev09:46
*** Bhujay has quit IRC09:47
*** Bhujay has joined #kata-dev09:47
*** Bhujay has quit IRC09:48
*** Bhujay has joined #kata-dev09:49
*** Bhujay has quit IRC09:50
*** Bhujay has joined #kata-dev09:50
*** Bhujay has quit IRC09:51
*** Bhujay has joined #kata-dev09:52
*** Bhujay has quit IRC09:53
*** Bhujay has joined #kata-dev09:53
*** Bhujay has quit IRC09:54
*** Bhujay has joined #kata-dev09:55
*** Bhujay has quit IRC09:56
*** Bhujay has joined #kata-dev09:56
*** Bhujay has quit IRC09:57
*** Bhujay has joined #kata-dev09:58
*** Bhujay has quit IRC09:59
*** Bhujay has joined #kata-dev09:59
*** Bhujay has quit IRC10:00
*** Bhujay has joined #kata-dev10:01
*** Bhujay has quit IRC10:02
*** Bhujay has joined #kata-dev10:02
*** jugs has quit IRC10:03
*** Bhujay has quit IRC10:03
*** jugs has joined #kata-dev10:03
*** Bhujay has joined #kata-dev10:04
*** Bhujay has quit IRC10:05
*** Bhujay has joined #kata-dev10:05
*** Bhujay has quit IRC10:06
*** Bhujay has joined #kata-dev10:07
*** Bhujay has quit IRC10:08
*** Bhujay has joined #kata-dev10:08
*** Bhujay has quit IRC10:09
*** Bhujay has joined #kata-dev10:10
*** Bhujay has quit IRC10:11
*** Bhujay has joined #kata-dev10:11
*** Bhujay has quit IRC10:12
*** Bhujay has joined #kata-dev10:13
*** Bhujay has quit IRC10:14
*** Bhujay has joined #kata-dev10:14
*** Bhujay has quit IRC10:15
*** Bhujay has joined #kata-dev10:16
*** Bhujay has quit IRC10:17
*** Bhujay has joined #kata-dev10:17
*** Bhujay has quit IRC10:18
*** Bhujay has joined #kata-dev10:19
*** Bhujay has quit IRC10:20
*** Bhujay has joined #kata-dev10:20
*** Bhujay has quit IRC10:21
*** Bhujay has joined #kata-dev10:22
*** Bhujay has quit IRC10:23
*** Bhujay has joined #kata-dev10:23
*** Bhujay has quit IRC10:24
*** Bhujay has joined #kata-dev10:25
*** Bhujay has quit IRC10:26
*** Bhujay has joined #kata-dev10:26
*** Bhujay has quit IRC10:27
*** Bhujay has joined #kata-dev10:28
*** Bhujay has quit IRC10:29
*** Bhujay has joined #kata-dev10:29
*** Bhujay has quit IRC10:30
*** Bhujay has joined #kata-dev10:31
*** Bhujay has quit IRC10:32
*** Bhujay has joined #kata-dev10:32
*** Bhujay has quit IRC10:33
*** Bhujay has joined #kata-dev10:34
*** Bhujay has quit IRC10:35
*** Bhujay has joined #kata-dev10:35
*** Bhujay has quit IRC10:36
*** Bhujay has joined #kata-dev10:37
*** Bhujay has quit IRC10:38
*** Bhujay has joined #kata-dev10:38
*** Bhujay has quit IRC10:39
*** Bhujay has joined #kata-dev10:40
*** Bhujay has quit IRC10:41
*** Bhujay has joined #kata-dev10:41
*** Bhujay has quit IRC10:42
*** Bhujay has joined #kata-dev10:43
*** Bhujay has quit IRC10:44
*** Bhujay has joined #kata-dev10:44
*** Bhujay has quit IRC10:45
*** Bhujay has joined #kata-dev10:46
*** sameo has joined #kata-dev11:48
*** gwhaley has quit IRC12:09
*** gwhaley has joined #kata-dev12:55
*** devimc has joined #kata-dev13:24
*** fuentess has joined #kata-dev13:35
kata-irc-bot<mnaser> hi kata-ers :slightly_smiling_face:13:38
kata-irc-bot<mnaser> a super unrelated but related issue to kata13:38
kata-irc-bot<mnaser> in magnum world (tool that allows you to deploy k8s cluster on openstack), we use CI to test it out, so we deploy openstack inside a VM and then we use nested virt. to deploy VMs to deploy k8s inside13:38
kata-irc-bot<mnaser> yes, that's k8s on openstack on openstack!13:39
kata-irc-bot<mnaser> the CI was pretty stable but recently, the VMs started crashing.  we have no documented hardware/system change, the only changes that occurred was the use of a newer kernel in ubuntu13:39
kata-irc-bot<mnaser> has anyone ever ran into this with more recent kernels?  does anyone know if there's a specific kernel that solves things?  i worry that potenetial kata deployers might be hit by the same thing13:40
kata-irc-bot<graham.whaley> hi @mnaser - doesn't ring a bell - we used to see the other way around (as you know, old host kernels had issues running newer kernels in the VMs). /cc @changcheng.liu @julio.montes who might be likely to have seen it if it occured in Kata land.13:48
kata-irc-bot<graham.whaley> grrr - @salvador.fuentes ^^13:48
kata-irc-bot<graham.whaley> (auto complete error!)13:48
kata-irc-bot<graham.whaley> so, @mnaser - is that CI running prow? I looked at prow to try and run up a CI to test kata-in-k8s (I wanted to test with the k8s e2e tests for instance), but then found at the bottom of prow it uses dind (docker-in-docker) a lot, and got a bit stuck at that point. I might have to figure out if I can split the prow stuff into dind and kata specific bits, or see if we can get dind working with kata (there is an Issue in kata about13:50
kata-irc-botthat already). Or, I have wondered if we need to contemplate kata-in-kata ... err, 'kink' (tm)(you heard it here first!)13:50
kata-irc-bot<mnaser> @graham.whaley no its not using prow actaully, we just spin up a cluster and start 1 pod, no fancy pants stuff yet.  the host is a centos kernel (it was the one recommended by... someone.. i cant remember who from here) and that worked fine for a while13:51
kata-irc-bot<salvador.fuentes> hi @mnaser, so the host VM (where kata is running) is the one that is crashing?14:02
kata-irc-bot<eric.ernst> Only recent issue I’ve seen for kata wrt kernel is the vsock regression which has been slow to get backported for at least Ubuntu....14:12
*** devimc has quit IRC14:18
*** devimc has joined #kata-dev14:19
kata-irc-bot<xwlpt> @mnaser Maybe your VM are out of disk? I met this issue after I installed some package to the VM. Had you write something to the container’s root disk?14:32
*** devimc has quit IRC14:39
*** devimc has joined #kata-dev14:41
*** Bhujay has quit IRC14:56
*** tmhoang_ has joined #kata-dev14:56
*** tmhoang has quit IRC14:58
*** tmhoang__ has joined #kata-dev14:58
*** tmhoang_ has quit IRC15:01
kata-irc-bot<mnaser> no sorry its the guest vm16:00
kata-irc-bot<mnaser> and it's actually not kata crashing, its an openstack project which is broken, just figured that it shares the same concerns which might lead kata to crash too16:00
kata-irc-bot<mnaser> so figured the experience you have might be helpful :X16:01
kata-irc-bot<jose.carlos.venegas.m> @mvedovati @james.o.hunt @eric.ernst do you know if there is something similar to https://raw.githubusercontent.com/kata-containers/tests/master/data/rpm-signkey.pub  for deb packages ?16:08
kata-irc-bot<jose.carlos.venegas.m> Or  if the same can be used by apt-get ?16:08
*** tmhoang__ has quit IRC16:08
kata-irc-bot<raravena80> kata-in-kata :clap: :,)16:19
kata-irc-bot<eric.ernst> I don't know.16:25
*** igordc has joined #kata-dev16:29
*** sameo has quit IRC16:51
*** sameo has joined #kata-dev17:23
*** igordc has quit IRC17:41
*** irclogbot_0 has joined #kata-dev18:02
*** gwhaley has quit IRC18:04
*** jodh has quit IRC18:04
kata-irc-bot<mvedovati> you can use `apt-key add rpm-signkey.pub`19:47
kata-irc-bot<mvedovati> if you dont do it you will get this error: ``` Reading package lists... Done W: GPG error: https://download.opensuse.org/repositories/home:/katacontainers:/releases:/x86_64:/master/xUbuntu_18.04  Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY D0B37B826063F3ED E: The repository19:50
kata-irc-bot'https://download.opensuse.org/repositories/home:/katacontainers:/releases:/x86_64:/master/xUbuntu_18.04  Release' is not signed. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details. ```19:50
kata-irc-bot<jose.carlos.venegas.m> excellent19:51
kata-irc-bot<jose.carlos.venegas.m> \o/19:51
*** eernst has joined #kata-dev20:07
kata-irc-bot<eric.ernst> Hey @manohar.r.castelino -- I took a look @ your [comment](https://github.com/kata-containers/packaging/pull/382#discussion_r263474561) ; it'll create that path for you.  The larger issue, though, is that /usr/local/bin wouldn't be in Clear Linux's path then...20:25
*** eernst has quit IRC20:26
kata-irc-bot<eric.ernst> I was trying to avoid ability to write certain directories on the host, but perhaps for wider compatability (including with ClearLinux) I should just temporarily create a symlink in /usr/bin.20:26
kata-irc-bot<eric.ernst> WDYT?20:26
*** davidgiluk has quit IRC20:27
kata-irc-bot<eric.ernst> I was trying to avoid ability to write certain directories on the host, but perhaps for wider compatability (including with ClearLinux) I should just temporarily create a symlink in /usr/bin.  WDYT?  @krsna1729 fyi20:28
*** sameo has quit IRC20:34
kata-irc-bot<jose.carlos.venegas.m> @mvedovati ``` If you run a public mirror, please get in contact so we can give you access to the stage rsync server. You'll find conditions for access and further information at http://en.opensuse.org/Mirror_Infrastructure  ```20:34
kata-irc-bot<jose.carlos.venegas.m> I wonder if stage is latency update is short20:34
kata-irc-bot<jose.carlos.venegas.m> ``` This is rsync.opensuse.org, public rsync server of openSUSE.org, limited to 50 connections.  ```20:35
kata-irc-bot<jose.carlos.venegas.m> Also I feel the rsync is slow proabably because that reason?20:36
kata-irc-bot<jose.carlos.venegas.m> I am doing a wget recursive and seems faster20:36
kata-irc-bot<jose.carlos.venegas.m> ``` time  rsync --progress -rlptH rsync.opensuse.org[0/0] nsuse-full-really-everything-including-repositories/opensuse/repositories/home:/katacontainers:/releases:/x86_64:/stable-1.5 "${PWD}/pkgs" --delete-after -hi --stats --exclude='**/*.src.rpm' --include='**/*.rpm' --include='**/*.deb' --include='*/' --exclude='*' ```20:37
kata-irc-bot<jose.carlos.venegas.m> I am filtering what to download in both rsync and wget20:37
kata-irc-bot<jose.carlos.venegas.m> wget Downloaded: 447 files, 907M in 26m 13s (591 KB/s)20:41
*** igordc has joined #kata-dev20:44
kata-irc-bot<jose.carlos.venegas.m> @sebastien.boeuf you were asking about the storage needed for a kata release20:44
kata-irc-bot<sebastien.boeuf> roughly 1GiB per version?20:48
kata-irc-bot<sebastien.boeuf> @jose.carlos.venegas.m ^20:48
kata-irc-bot<eric.ernst> wonder what we can trim :020:48
kata-irc-bot<jose.carlos.venegas.m> yeah20:48
kata-irc-bot<eric.ernst> that's for the tarball?20:48
kata-irc-bot<jose.carlos.venegas.m> I think the image20:48
kata-irc-bot<eric.ernst> I opened an issue before to remove non-needed QEMU bits.20:48
kata-irc-bot<eric.ernst> but that's piddly20:48
kata-irc-bot<jose.carlos.venegas.m> @eric.ernst not all packages for all the 8 distros20:48
kata-irc-bot<jose.carlos.venegas.m> 12 distros *20:49
kata-irc-bot<jose.carlos.venegas.m> only one arch atm20:49
kata-irc-bot<jose.carlos.venegas.m> so will need quite a good mount of storage depending what we want to keep on package clould20:50
kata-irc-bot<eric.ernst> 12GB/release is what i'm seeing?20:53
kata-irc-bot<eric.ernst> unless we start picking and choosing per distro20:53
kata-irc-bot<sebastien.boeuf> wow what? 1GB per release and per distro?20:57
kata-irc-bot<sebastien.boeuf> that's a lot20:57
kata-irc-bot<sebastien.boeuf> never realized it was consuming so much20:57
kata-irc-bot<manohar.r.castelino> @eric.ernst it is in the path always.. just does not exist as a dir20:59
kata-irc-bot<eric.ernst> i see -- then we're good.21:00
kata-irc-bot<jose.carlos.venegas.m> not 1G for all of them21:58
kata-irc-bot<jose.carlos.venegas.m> if we keep only the last 3 releases21:59
kata-irc-bot<jose.carlos.venegas.m> for example master(alpha) , 1.5 ,  1.421:59
kata-irc-bot<jose.carlos.venegas.m> these are 3 GB21:59
kata-irc-bot<jose.carlos.venegas.m> just keeping the latest of each22:00
*** devimc has quit IRC22:05
*** tmhoang__ has joined #kata-dev22:11
kata-irc-bot<eric.ernst> i think we want 2 or 3 of each22:12
*** tmhoang__ is now known as tmhoang22:12
kata-irc-bot<eric.ernst> (at least)S22:12
kata-irc-bot<jose.carlos.venegas.m> yeah I am fine with that too22:12
kata-irc-bot<jose.carlos.venegas.m> we still need to test if mutlple version works on package clould22:13
*** tmhoang has quit IRC22:53
kata-irc-bot<eric.ernst> this familiar for any containrd v2 shim folk? ```io.containerd.kata.v2: shim namespace cannot be empty``` ?23:19
kata-irc-bot<eric.ernst> failure to start a container23:19
*** fuentess has quit IRC23:25
*** irclogbot_0 has quit IRC23:26
kata-irc-bot<eric.ernst> @manohar.r.castelino can I pick your brain for a couple?23:31
kata-irc-bot<eric.ernst> @sebastien.boeuf ^ you too?23:31
kata-irc-bot<sebastien.boeuf> couple of what? hours?23:31
kata-irc-bot<sebastien.boeuf> days?23:31
kata-irc-bot<eric.ernst> Just FYI -- it seems we can't do the 'indirection' trick with v223:31
kata-irc-bot<sebastien.boeuf> what's the indirection trick?23:32
kata-irc-bot<manohar.r.castelino> what inderection23:32
kata-irc-bot<eric.ernst> ``` $ cat /usr/local/bin/containerd-shim-kata-v2  #!/bin/bash /opt/kata/bin/containerd-shim-kata-v2   ```23:32
kata-irc-bot<manohar.r.castelino> params23:33
kata-irc-bot<manohar.r.castelino> $@23:33
kata-irc-bot<eric.ernst> or, more usefully: ```#!/bin/bash KATA_CONF_FILE=/opt/kata/share/defaults/kata-containers/configuration.toml /opt/kata/bin/${shim_binary} $@ ```23:33
kata-irc-bot<eric.ernst> I knew I was an idiot - thanks ya'll.23:34
kata-irc-bot<eric.ernst> I need to escape $23:35
kata-irc-bot<eric.ernst> ``` ```KATA_CONF_FILE=/opt/kata/share/defaults/kata-containers/configuration.toml /opt/kata/bin/${shim_binary} \$@```23:35
kata-irc-bot<eric.ernst> i'll die from bash someday23:35

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!