*** goldyfruit_ has joined #openstack-containers | 01:20 | |
*** ricolin has joined #openstack-containers | 02:11 | |
*** ykarel|away has joined #openstack-containers | 02:27 | |
*** ykarel|away has quit IRC | 02:32 | |
*** udesale has joined #openstack-containers | 03:48 | |
*** ykarel|away has joined #openstack-containers | 03:51 | |
*** ykarel|away is now known as ykarel | 03:51 | |
*** pcaruana has joined #openstack-containers | 05:38 | |
*** pcaruana has quit IRC | 05:42 | |
*** rcernin has quit IRC | 06:09 | |
*** udesale has quit IRC | 06:13 | |
*** udesale has joined #openstack-containers | 06:14 | |
*** elenalindq has joined #openstack-containers | 06:28 | |
*** ykarel_ has joined #openstack-containers | 06:42 | |
*** ykarel has quit IRC | 06:45 | |
*** ykarel__ has joined #openstack-containers | 07:01 | |
*** udesale has quit IRC | 07:02 | |
*** udesale has joined #openstack-containers | 07:03 | |
*** ykarel_ has quit IRC | 07:03 | |
*** udesale has quit IRC | 07:06 | |
*** udesale has joined #openstack-containers | 07:06 | |
*** ykarel__ is now known as ykarel | 07:08 | |
*** pcaruana has joined #openstack-containers | 07:17 | |
*** ramishra has quit IRC | 07:21 | |
*** ramishra has joined #openstack-containers | 07:28 | |
*** ykarel is now known as ykarel|lunch | 07:37 | |
*** rcernin has joined #openstack-containers | 08:02 | |
*** namrata has joined #openstack-containers | 08:20 | |
*** ykarel|lunch is now known as ykarel | 08:27 | |
*** udesale has quit IRC | 08:31 | |
*** udesale has joined #openstack-containers | 08:32 | |
*** udesale has quit IRC | 08:58 | |
brtknr | strigazi: flwang: you guys there? | 08:59 |
---|---|---|
strigazi | o/ | 09:01 |
strigazi | brtknr: o/ | 09:01 |
brtknr | o/ strigazi | 09:02 |
brtknr | strigazi: hows the containerd work going? | 09:03 |
strigazi | brtknr: excellent | 09:03 |
strigazi | brtknr: we are working also on lazy loading images | 09:04 |
brtknr | whats that? | 09:04 |
strigazi | brtknr: I'm trying figure out if we want to curl a binary or build our own container that deploys things | 09:04 |
*** lpetrut has joined #openstack-containers | 09:04 | |
brtknr | strigazi: the latter sounds more fun but is the latter doable without mounting root? | 09:05 |
brtknr | kata-containers deployed binaries on the host from a container | 09:06 |
brtknr | so does nvidia-drivers that coems with kubespray i believe | 09:06 |
strigazi | the same thing basically, you mount /usr/local/ and /etc/systemd/system | 09:06 |
brtknr | does someone already build these images? we dont want additional maintenance overhead of building these imagess unless we have to | 09:07 |
brtknr | strigazi: where was the containerd meeting you attended yesterday? on iRC or slack? | 09:09 |
strigazi | one moment | 09:11 |
*** udesale has joined #openstack-containers | 09:12 | |
trident | Do we think there will be a meeting today? | 09:16 |
brtknr | trident: strigazi is here, flwang said he would be here | 09:17 |
strigazi | brtknr: the meeting was here in the campus for an internal system: https://cernvm.cern.ch/portal/filesystem | 09:18 |
brtknr | trident: but we will discuss your issue, dont worry | 09:18 |
strigazi | brtknr: I don't know if someone builds the contaiener | 09:18 |
brtknr | strigazi: cool, whats your reason for pursuing containerd | 09:19 |
brtknr | is it a prereq for this filesystem? | 09:20 |
strigazi | brtknr: higher velocity to iterate on upstream code, support of remote-snapshotter, control of what we run. Now we take docker from fedora. | 09:21 |
strigazi | brtknr: it is a prereq, yes | 09:21 |
strigazi | brtknr: there is another solution that uses google/crfs instead of cvmfs | 09:21 |
strigazi | I approved https://review.opendev.org/#/c/696884 brtknr trident | 09:24 |
brtknr | this is the closest thing ive found but not maintained: https://hub.docker.com/r/crosbymichael/containerd/dockerfile | 09:25 |
brtknr | suppose we need to build our own installer :) | 09:25 |
strigazi | brtknr: I have one already the builds plugins too. My concern is docker.io | 09:26 |
trident | strigazi: Great, thanks! I guess the other three related changes that are also required need some approves as well? | 09:27 |
strigazi | trident rocky? | 09:27 |
namrata | strigazi trident for reference https://review.opendev.org/#/q/topic:rocky-7.1.1+(status:open+OR+status:merged) we need all these patches | 09:27 |
trident | Exactly, thanks namrata! | 09:28 |
brtknr | strigazi: the remaining three are to bring calico in parity with flannel in terms of support for 1.15.5 and 1.14.8 in rocky | 09:28 |
brtknr | strigazi: with PSP, I removed the pieces of code which were only relevant for containerised flannel | 09:29 |
strigazi | I don't see the PSP in flannel | 09:31 |
trident | strigazi: And I have verified that everything deploy fine both with flannel and calico with both 1.15.5 and 1.14.8 with the patches above applied. | 09:32 |
brtknr | strigazi: https://review.opendev.org/#/c/694032/4/magnum/drivers/common/templates/kubernetes/fragments/flannel-service.sh | 09:33 |
strigazi | brtknr: this is stein | 09:33 |
brtknr | strigazi: there is a PSP for flannel in stein+ only | 09:33 |
brtknr | in rocky, flannel runs as systemd service | 09:33 |
strigazi | 10:30 < brtknr> strigazi: with PSP, ... now this messahe makes more sense. | 09:34 |
brtknr | strigazi: :) | 09:34 |
strigazi | brtknr: we have a patch that moves this higher I think https://review.opendev.org/#/c/696916/3/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh | 09:35 |
brtknr | strigazi: ah yes i remember | 09:36 |
brtknr | bb747ac5e79d3734422d9561c52dc85213f2e22b | 09:37 |
brtknr | strigazi: although we havent cherry-picked that patch to stein | 09:38 |
brtknr | flwang pointed out that stable policy only allows backports from n -> n-1, not from n -> n-2 | 09:40 |
*** namrata has quit IRC | 09:54 | |
*** lpetrut has quit IRC | 09:54 | |
*** ramishra has quit IRC | 09:54 | |
*** ykarel has quit IRC | 09:54 | |
*** ricolin has quit IRC | 09:54 | |
*** goldyfruit_ has quit IRC | 09:54 | |
*** spiette has quit IRC | 09:54 | |
*** jakeyip has quit IRC | 09:54 | |
*** jmlowe has quit IRC | 09:54 | |
*** andrein has quit IRC | 09:54 | |
*** mnasiadka has quit IRC | 09:54 | |
*** flwang has quit IRC | 09:54 | |
*** trident has quit IRC | 09:54 | |
*** kgz has quit IRC | 09:54 | |
*** openstackgerrit has quit IRC | 09:54 | |
*** brtknr has quit IRC | 09:54 | |
*** elenalindq has quit IRC | 09:54 | |
*** dasp has quit IRC | 09:54 | |
*** mgoddard has quit IRC | 09:54 | |
*** arbrandes has quit IRC | 09:54 | |
*** dioguerra has quit IRC | 09:54 | |
*** logan- has quit IRC | 09:54 | |
*** yankcrime has quit IRC | 09:54 | |
*** Anticimex has quit IRC | 09:54 | |
*** spotz has quit IRC | 09:54 | |
*** pcaruana has quit IRC | 09:54 | |
*** mgariepy has quit IRC | 09:54 | |
*** yolanda has quit IRC | 09:54 | |
*** johanssone has quit IRC | 09:54 | |
*** Jeffrey4l has quit IRC | 09:54 | |
*** cosmicsound has quit IRC | 09:54 | |
*** tbarron has quit IRC | 09:54 | |
*** iokiwi has quit IRC | 09:54 | |
*** irclogbot_3 has quit IRC | 09:55 | |
*** sapd1_ has quit IRC | 09:55 | |
*** aspiers has quit IRC | 09:55 | |
*** strigazi has quit IRC | 09:55 | |
*** rcernin has quit IRC | 09:55 | |
*** gouthamr has quit IRC | 09:55 | |
*** lxkong has quit IRC | 09:55 | |
*** fungi has quit IRC | 09:55 | |
*** gmann has quit IRC | 09:55 | |
*** udesale has quit IRC | 09:55 | |
*** osmanlicilegi has quit IRC | 09:55 | |
*** aluria has quit IRC | 09:55 | |
*** ioni has quit IRC | 09:55 | |
*** tobberydberg has quit IRC | 09:55 | |
*** freerunner has quit IRC | 09:55 | |
*** jhesketh has quit IRC | 09:55 | |
*** nwonknu has quit IRC | 09:55 | |
*** dtruong has quit IRC | 09:55 | |
*** vesper11 has quit IRC | 09:55 | |
*** kklimonda has quit IRC | 09:55 | |
*** jrosser has quit IRC | 09:55 | |
*** guilhermesp has quit IRC | 09:55 | |
*** squarebracket has quit IRC | 09:55 | |
*** mnaser has quit IRC | 09:55 | |
*** NobodyCam has quit IRC | 09:55 | |
*** ykarel has joined #openstack-containers | 10:04 | |
*** brtknr has joined #openstack-containers | 10:04 | |
*** jmlowe has joined #openstack-containers | 10:04 | |
*** jakeyip has joined #openstack-containers | 10:04 | |
*** spiette has joined #openstack-containers | 10:04 | |
*** goldyfruit_ has joined #openstack-containers | 10:04 | |
*** ricolin has joined #openstack-containers | 10:04 | |
*** ramishra has joined #openstack-containers | 10:04 | |
*** lpetrut has joined #openstack-containers | 10:04 | |
*** flwang has joined #openstack-containers | 10:04 | |
*** mnasiadka has joined #openstack-containers | 10:04 | |
*** andrein has joined #openstack-containers | 10:04 | |
*** openstackgerrit has joined #openstack-containers | 10:04 | |
*** kgz has joined #openstack-containers | 10:04 | |
*** trident has joined #openstack-containers | 10:04 | |
*** rcernin has joined #openstack-containers | 10:04 | |
*** pcaruana has joined #openstack-containers | 10:04 | |
*** osmanlicilegi has joined #openstack-containers | 10:04 | |
*** mgariepy has joined #openstack-containers | 10:04 | |
*** spotz has joined #openstack-containers | 10:04 | |
*** yolanda has joined #openstack-containers | 10:04 | |
*** vesper11 has joined #openstack-containers | 10:04 | |
*** jhesketh has joined #openstack-containers | 10:04 | |
*** johanssone has joined #openstack-containers | 10:04 | |
*** Jeffrey4l has joined #openstack-containers | 10:04 | |
*** jrosser has joined #openstack-containers | 10:04 | |
*** kklimonda has joined #openstack-containers | 10:04 | |
*** tbarron has joined #openstack-containers | 10:04 | |
*** cosmicsound has joined #openstack-containers | 10:04 | |
*** iokiwi has joined #openstack-containers | 10:04 | |
*** gouthamr has joined #openstack-containers | 10:04 | |
*** ioni has joined #openstack-containers | 10:04 | |
*** irclogbot_3 has joined #openstack-containers | 10:04 | |
*** sapd1_ has joined #openstack-containers | 10:04 | |
*** lxkong has joined #openstack-containers | 10:04 | |
*** guilhermesp has joined #openstack-containers | 10:04 | |
*** aluria has joined #openstack-containers | 10:04 | |
*** fungi has joined #openstack-containers | 10:04 | |
*** aspiers has joined #openstack-containers | 10:04 | |
*** gmann has joined #openstack-containers | 10:04 | |
*** dtruong has joined #openstack-containers | 10:04 | |
*** tobberydberg has joined #openstack-containers | 10:04 | |
*** strigazi has joined #openstack-containers | 10:04 | |
*** freerunner has joined #openstack-containers | 10:04 | |
*** squarebracket has joined #openstack-containers | 10:04 | |
*** nwonknu has joined #openstack-containers | 10:04 | |
*** NobodyCam has joined #openstack-containers | 10:04 | |
*** mnaser has joined #openstack-containers | 10:04 | |
brtknr | thanks for coming! | 10:04 |
*** elenalindq has joined #openstack-containers | 10:04 | |
*** dasp has joined #openstack-containers | 10:04 | |
*** mgoddard has joined #openstack-containers | 10:04 | |
*** dioguerra has joined #openstack-containers | 10:04 | |
*** arbrandes has joined #openstack-containers | 10:04 | |
*** logan- has joined #openstack-containers | 10:04 | |
*** yankcrime has joined #openstack-containers | 10:04 | |
*** Anticimex has joined #openstack-containers | 10:04 | |
brtknr | and nice chatting | 10:04 |
brtknr | where is your containerd installer btw strigazi ? | 10:04 |
*** logan- has quit IRC | 10:05 | |
trident | brtknr: Seems to have been a IRC netsplit between servers for a while. Seems better now. | 10:06 |
*** logan- has joined #openstack-containers | 10:06 | |
openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/rocky: k8s_fedora: Move rp_filter=1 for calico up https://review.opendev.org/697433 | 10:08 |
*** osmanlicilegi has quit IRC | 10:18 | |
*** osmanlicilegi has joined #openstack-containers | 10:19 | |
*** osmanlicilegi has quit IRC | 10:22 | |
openstackgerrit | Merged openstack/magnum stable/rocky: fix: Deploy enable_service last (rocky only) https://review.opendev.org/696884 | 10:26 |
*** osmanlicilegi has joined #openstack-containers | 10:27 | |
*** ykarel is now known as ykarel|afk | 10:27 | |
*** namrata has joined #openstack-containers | 10:28 | |
*** pcaruana has quit IRC | 10:42 | |
openstackgerrit | Merged openstack/magnum stable/rocky: k8s: Clear cni configuration https://review.opendev.org/696915 | 11:00 |
*** ykarel|afk is now known as ykarel | 11:07 | |
*** udesale has joined #openstack-containers | 11:51 | |
brtknr | trident: once all the changes are merged, we can propose a release | 11:52 |
brtknr | it will be 7.2.0 instead of 7.1.1 due to PSP feature | 11:52 |
*** namrata has quit IRC | 12:12 | |
trident | brtknr: Sounds great! :) | 12:18 |
andrein | hello everyone | 12:29 |
andrein | brtknr: can you merge https://review.opendev.org/#/c/696706/ ? | 12:29 |
openstackgerrit | Merged openstack/magnum stable/rocky: k8s_fedora_atomic: Add PodSecurityPolicy https://review.opendev.org/697060 | 12:50 |
*** rcernin has quit IRC | 12:52 | |
*** pcaruana has joined #openstack-containers | 12:54 | |
openstackgerrit | Merged openstack/magnum stable/rocky: k8s_fedora: Move rp_filter=1 for calico up https://review.opendev.org/697433 | 13:17 |
openstackgerrit | Merged openstack/magnum stable/stein: k8s: stop introspecting instance name https://review.opendev.org/695709 | 13:17 |
openstackgerrit | Merged openstack/magnum stable/stein: Using vxlan as default value for flannel_backend https://review.opendev.org/695713 | 13:17 |
openstackgerrit | Merged openstack/magnum stable/stein: k8s_fedora: Move rp_filter=1 for calico up https://review.opendev.org/697432 | 13:17 |
*** goldyfruit_ has quit IRC | 13:20 | |
*** udesale has quit IRC | 13:30 | |
brtknr | andrein: done :) | 13:38 |
*** udesale has joined #openstack-containers | 13:39 | |
*** ykarel is now known as ykarel|afk | 13:50 | |
openstackgerrit | Merged openstack/magnum master: Change k8s-keystone-auth docker repo https://review.opendev.org/696706 | 14:31 |
*** pcaruana has quit IRC | 14:38 | |
*** goldyfruit_ has joined #openstack-containers | 14:48 | |
*** goldyfruit___ has joined #openstack-containers | 15:00 | |
*** goldyfruit_ has quit IRC | 15:02 | |
*** elenalindq has quit IRC | 15:03 | |
*** elenalindq has joined #openstack-containers | 15:17 | |
andrein | brtknr: how long does it usually take to set up a new kubernetes cluster with magnum for you? | 15:20 |
brtknr | andrein: which version of magnum? | 15:22 |
andrein | 9.1.0 | 15:22 |
andrein | train stable | 15:22 |
andrein | I'm pretty sure it used to be faster, but I'm now at 25 minutes and counting | 15:23 |
andrein | I think something changed in heat-container-agent as well since last time | 15:23 |
andrein | (last time I tested was last week) | 15:23 |
brtknr | andrein: it took that long to create a cluster? | 15:26 |
andrein | it hasn't finished yet | 15:26 |
openstackgerrit | Theodoros Tsioutsias proposed openstack/magnum master: nodegroup list with --limit gives wrong next URL https://review.opendev.org/694230 | 15:27 |
andrein | Dec 05 15:24:44 chaosmonkeys-z7ygajndwaaw-master-0.novalocal runc[1398]: + atomic install --storage ostree --system --system-package=no --name=kube-proxy docker.io/openstackmagnum/kubernetes-proxy:v1.15.6 | 15:28 |
andrein | Dec 05 15:24:44 chaosmonkeys-z7ygajndwaaw-master-0.novalocal runc[1398]: time="2019-12-05T15:24:44Z" level=fatal msg="Error writing blob: unexpected EOF" | 15:28 |
andrein | I think this caused it... | 15:28 |
brtknr | wcreated_at | 2019-12-04T14:15:40+00:00 | 15:28 |
brtknr | updated_at | 2019-12-04T14:23:16+00:00 | 15:28 |
brtknr | so thats 12 mins | 15:28 |
brtknr | but that was yesterday | 15:29 |
brtknr | i'll try again today | 15:29 |
brtknr | are you doing it with podman enabled? | 15:29 |
brtknr | andrein: | 15:29 |
andrein | I don't have podman enabled | 15:29 |
andrein | should I? | 15:29 |
andrein | brtknr: https://hub.docker.com/layers/openstackmagnum/kubernetes-proxy/v1.15.6/images/sha256-b0626dca7c206f510c90bd3c15ab508582f8afe7c87d8acefad8c54a8b738bf7 | 15:30 |
brtknr | andrein: my stat is with podman enabled | 15:31 |
andrein | I'll try with podman | 15:31 |
andrein | brtknr: that image was pushed around the time I created my cluster | 15:32 |
brtknr | andrein: ah, actually i havent tried creating a cluster with 1.15.6 | 15:33 |
andrein | wonder if it crapped out because the new tag was pushed midway | 15:33 |
brtknr | andrein: i'll try spawning a cluster now | 15:35 |
*** udesale has quit IRC | 15:37 | |
andrein | brtknr: I started a new cluster from the same template | 15:46 |
andrein | it spawned correctly in 11m this time | 15:47 |
brtknr | andrein: cool | 15:49 |
*** ykarel|afk is now known as ykarel|away | 16:01 | |
*** ykarel|away has quit IRC | 16:05 | |
*** dave-mccowan has joined #openstack-containers | 16:08 | |
*** ykarel|away has joined #openstack-containers | 16:20 | |
brtknr | trident: https://review.opendev.org/#/c/697514/ | 16:35 |
*** openstackgerrit has quit IRC | 16:42 | |
*** goldyfruit_ has joined #openstack-containers | 16:43 | |
*** goldyfruit___ has quit IRC | 16:46 | |
*** ricolin has quit IRC | 16:54 | |
*** dave-mccowan has quit IRC | 16:58 | |
*** dave-mccowan has joined #openstack-containers | 17:00 | |
andrein | brtknr: are you still around? | 17:04 |
*** dave-mccowan has quit IRC | 17:10 | |
*** goldyfruit___ has joined #openstack-containers | 17:12 | |
*** goldyfruit_ has quit IRC | 17:15 | |
*** lpetrut has quit IRC | 17:40 | |
*** lpetrut has joined #openstack-containers | 18:07 | |
*** ykarel|away has quit IRC | 18:07 | |
*** dave-mccowan has joined #openstack-containers | 18:39 | |
*** openstackgerrit has joined #openstack-containers | 19:18 | |
openstackgerrit | Matthew Fuller proposed openstack/magnum master: PDF documentation build https://review.opendev.org/684436 | 19:18 |
*** jmlowe has quit IRC | 19:19 | |
*** dave-mccowan has quit IRC | 19:36 | |
openstackgerrit | Merged openstack/magnum master: Make it possible to use uwsgi easily https://review.opendev.org/659764 | 19:43 |
*** rcernin has joined #openstack-containers | 20:03 | |
*** jmlowe has joined #openstack-containers | 20:11 | |
*** rcernin has quit IRC | 20:18 | |
*** icassano has joined #openstack-containers | 20:50 | |
icassano | hello boys, please help me with magnum stein on centos | 20:51 |
icassano | the following error in /var/log/messages:Dec 5 21:14:49 tst2-osctrl01 magnum-api: Traceback (most recent call last):Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 568, in process_requestDec 5 21:14:49 tst2-osctrl01 magnum-api: self.finish_request(request, client_address)Dec 5 21:14:49 tst2-osctrl01 | 20:52 |
icassano | magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 334, in finish_requestDec 5 21:14:49 tst2-osctrl01 magnum-api: self.RequestHandlerClass(request, client_address, self)Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 651, in __init__Dec 5 21:14:49 tst2-osctrl01 magnum-api: self.finish()Dec 5 | 20:52 |
icassano | 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 710, in finishDec 5 21:14:49 tst2-osctrl01 magnum-api: self.wfile.close()Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/socket.py", line 279, in closeDec 5 21:14:49 tst2-osctrl01 magnum-api: self.flush()Dec 5 21:14:49 tst2-osctrl01 | 20:52 |
icassano | magnum-api: File "/usr/lib64/python2.7/socket.py", line 303, in flushDec 5 21:14:49 tst2-osctrl01 magnum-api: self._sock.sendall(view[write_offset:write_offset+buffer_size])Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 401, in sendallDec 5 21:14:49 tst2-osctrl01 magnum-api: tail = | 20:52 |
icassano | self.send(data, flags)Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 395, in sendDec 5 21:14:49 tst2-osctrl01 magnum-api: return self._send_loop(self.fd.send, data, flags)Dec 5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line | 20:52 |
icassano | 382, in _send_loopDec 5 21:14:49 tst2-osctrl01 magnum-api: return send_method(data, *args)Dec 5 21:14:49 tst2-osctrl01 magnum-api: error: [Errno 32] Broken pipe | 20:52 |
icassano | Please | 20:52 |
*** icassano has quit IRC | 21:01 | |
*** dave-mccowan has joined #openstack-containers | 21:14 | |
*** dasp_ has joined #openstack-containers | 21:52 | |
*** dasp has quit IRC | 21:55 | |
*** goldyfruit___ has quit IRC | 22:05 | |
*** rcernin has joined #openstack-containers | 22:28 | |
brtknr | icassano: nothing obvious from what you’ve pasted sorry | 23:05 |
brtknr | icassano: not sure how you deployed magnum? | 23:05 |
brtknr | icassano: btw use paste.openstack.org for posting logs | 23:06 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!