Thursday, 2019-12-05

*** goldyfruit_ has joined #openstack-containers01:20
*** ricolin has joined #openstack-containers02:11
*** ykarel|away has joined #openstack-containers02:27
*** ykarel|away has quit IRC02:32
*** udesale has joined #openstack-containers03:48
*** ykarel|away has joined #openstack-containers03:51
*** ykarel|away is now known as ykarel03:51
*** pcaruana has joined #openstack-containers05:38
*** pcaruana has quit IRC05:42
*** rcernin has quit IRC06:09
*** udesale has quit IRC06:13
*** udesale has joined #openstack-containers06:14
*** elenalindq has joined #openstack-containers06:28
*** ykarel_ has joined #openstack-containers06:42
*** ykarel has quit IRC06:45
*** ykarel__ has joined #openstack-containers07:01
*** udesale has quit IRC07:02
*** udesale has joined #openstack-containers07:03
*** ykarel_ has quit IRC07:03
*** udesale has quit IRC07:06
*** udesale has joined #openstack-containers07:06
*** ykarel__ is now known as ykarel07:08
*** pcaruana has joined #openstack-containers07:17
*** ramishra has quit IRC07:21
*** ramishra has joined #openstack-containers07:28
*** ykarel is now known as ykarel|lunch07:37
*** rcernin has joined #openstack-containers08:02
*** namrata has joined #openstack-containers08:20
*** ykarel|lunch is now known as ykarel08:27
*** udesale has quit IRC08:31
*** udesale has joined #openstack-containers08:32
*** udesale has quit IRC08:58
brtknrstrigazi: flwang: you guys there?08:59
strigazio/09:01
strigazibrtknr: o/09:01
brtknro/ strigazi09:02
brtknrstrigazi: hows the containerd work going?09:03
strigazibrtknr: excellent09:03
strigazibrtknr: we are working also on lazy loading images09:04
brtknrwhats that?09:04
strigazibrtknr: I'm trying figure out if we want to curl a binary or build our own container that deploys things09:04
*** lpetrut has joined #openstack-containers09:04
brtknrstrigazi: the latter sounds more fun but is the latter doable without mounting root?09:05
brtknrkata-containers deployed binaries on the host from a container09:06
brtknrso does nvidia-drivers that coems with kubespray i believe09:06
strigazithe same thing basically, you mount /usr/local/ and /etc/systemd/system09:06
brtknrdoes someone already build these images? we dont want additional maintenance overhead of building these imagess unless we have to09:07
brtknrstrigazi: where was the containerd meeting you attended yesterday? on iRC or slack?09:09
strigazione moment09:11
*** udesale has joined #openstack-containers09:12
tridentDo we think there will be a meeting today?09:16
brtknrtrident: strigazi is here, flwang said he would be here09:17
strigazibrtknr: the meeting was here in the campus for an internal system: https://cernvm.cern.ch/portal/filesystem09:18
brtknrtrident: but we will discuss your issue, dont worry09:18
strigazibrtknr: I don't know if someone builds the contaiener09:18
brtknrstrigazi: cool, whats your reason for pursuing containerd09:19
brtknris it a prereq for this filesystem?09:20
strigazibrtknr: higher velocity to iterate on upstream code, support of remote-snapshotter, control of what we run. Now we take docker from fedora.09:21
strigazibrtknr: it is a prereq, yes09:21
strigazibrtknr: there is  another solution that uses google/crfs instead of cvmfs09:21
strigaziI approved https://review.opendev.org/#/c/696884 brtknr trident09:24
brtknrthis is the closest thing ive found but not maintained: https://hub.docker.com/r/crosbymichael/containerd/dockerfile09:25
brtknrsuppose we need to build our own installer :)09:25
strigazibrtknr: I have one already the builds plugins too. My concern is docker.io09:26
tridentstrigazi: Great, thanks! I guess the other three related changes that are also required need some approves as well?09:27
strigazitrident rocky?09:27
namratastrigazi trident for reference https://review.opendev.org/#/q/topic:rocky-7.1.1+(status:open+OR+status:merged) we need all these patches09:27
tridentExactly, thanks namrata!09:28
brtknrstrigazi: the remaining three are to bring calico in parity with flannel in terms of support for 1.15.5 and 1.14.8 in rocky09:28
brtknrstrigazi: with PSP, I removed the pieces of code which were only relevant for containerised flannel09:29
strigaziI don't see the PSP in flannel09:31
tridentstrigazi: And I have verified that everything deploy fine both with flannel and calico with both 1.15.5 and 1.14.8 with the patches above applied.09:32
brtknrstrigazi: https://review.opendev.org/#/c/694032/4/magnum/drivers/common/templates/kubernetes/fragments/flannel-service.sh09:33
strigazibrtknr: this is stein09:33
brtknrstrigazi: there is a PSP for flannel in stein+ only09:33
brtknrin rocky, flannel runs as systemd service09:33
strigazi10:30 < brtknr> strigazi: with PSP, ... now this messahe makes more sense.09:34
brtknrstrigazi: :)09:34
strigazibrtknr: we have a patch that moves this higher I think https://review.opendev.org/#/c/696916/3/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh09:35
brtknrstrigazi: ah yes i remember09:36
brtknrbb747ac5e79d3734422d9561c52dc85213f2e22b09:37
brtknrstrigazi: although we havent cherry-picked that patch to stein09:38
brtknrflwang pointed out that stable policy only allows backports from n -> n-1, not from n -> n-209:40
*** namrata has quit IRC09:54
*** lpetrut has quit IRC09:54
*** ramishra has quit IRC09:54
*** ykarel has quit IRC09:54
*** ricolin has quit IRC09:54
*** goldyfruit_ has quit IRC09:54
*** spiette has quit IRC09:54
*** jakeyip has quit IRC09:54
*** jmlowe has quit IRC09:54
*** andrein has quit IRC09:54
*** mnasiadka has quit IRC09:54
*** flwang has quit IRC09:54
*** trident has quit IRC09:54
*** kgz has quit IRC09:54
*** openstackgerrit has quit IRC09:54
*** brtknr has quit IRC09:54
*** elenalindq has quit IRC09:54
*** dasp has quit IRC09:54
*** mgoddard has quit IRC09:54
*** arbrandes has quit IRC09:54
*** dioguerra has quit IRC09:54
*** logan- has quit IRC09:54
*** yankcrime has quit IRC09:54
*** Anticimex has quit IRC09:54
*** spotz has quit IRC09:54
*** pcaruana has quit IRC09:54
*** mgariepy has quit IRC09:54
*** yolanda has quit IRC09:54
*** johanssone has quit IRC09:54
*** Jeffrey4l has quit IRC09:54
*** cosmicsound has quit IRC09:54
*** tbarron has quit IRC09:54
*** iokiwi has quit IRC09:54
*** irclogbot_3 has quit IRC09:55
*** sapd1_ has quit IRC09:55
*** aspiers has quit IRC09:55
*** strigazi has quit IRC09:55
*** rcernin has quit IRC09:55
*** gouthamr has quit IRC09:55
*** lxkong has quit IRC09:55
*** fungi has quit IRC09:55
*** gmann has quit IRC09:55
*** udesale has quit IRC09:55
*** osmanlicilegi has quit IRC09:55
*** aluria has quit IRC09:55
*** ioni has quit IRC09:55
*** tobberydberg has quit IRC09:55
*** freerunner has quit IRC09:55
*** jhesketh has quit IRC09:55
*** nwonknu has quit IRC09:55
*** dtruong has quit IRC09:55
*** vesper11 has quit IRC09:55
*** kklimonda has quit IRC09:55
*** jrosser has quit IRC09:55
*** guilhermesp has quit IRC09:55
*** squarebracket has quit IRC09:55
*** mnaser has quit IRC09:55
*** NobodyCam has quit IRC09:55
*** ykarel has joined #openstack-containers10:04
*** brtknr has joined #openstack-containers10:04
*** jmlowe has joined #openstack-containers10:04
*** jakeyip has joined #openstack-containers10:04
*** spiette has joined #openstack-containers10:04
*** goldyfruit_ has joined #openstack-containers10:04
*** ricolin has joined #openstack-containers10:04
*** ramishra has joined #openstack-containers10:04
*** lpetrut has joined #openstack-containers10:04
*** flwang has joined #openstack-containers10:04
*** mnasiadka has joined #openstack-containers10:04
*** andrein has joined #openstack-containers10:04
*** openstackgerrit has joined #openstack-containers10:04
*** kgz has joined #openstack-containers10:04
*** trident has joined #openstack-containers10:04
*** rcernin has joined #openstack-containers10:04
*** pcaruana has joined #openstack-containers10:04
*** osmanlicilegi has joined #openstack-containers10:04
*** mgariepy has joined #openstack-containers10:04
*** spotz has joined #openstack-containers10:04
*** yolanda has joined #openstack-containers10:04
*** vesper11 has joined #openstack-containers10:04
*** jhesketh has joined #openstack-containers10:04
*** johanssone has joined #openstack-containers10:04
*** Jeffrey4l has joined #openstack-containers10:04
*** jrosser has joined #openstack-containers10:04
*** kklimonda has joined #openstack-containers10:04
*** tbarron has joined #openstack-containers10:04
*** cosmicsound has joined #openstack-containers10:04
*** iokiwi has joined #openstack-containers10:04
*** gouthamr has joined #openstack-containers10:04
*** ioni has joined #openstack-containers10:04
*** irclogbot_3 has joined #openstack-containers10:04
*** sapd1_ has joined #openstack-containers10:04
*** lxkong has joined #openstack-containers10:04
*** guilhermesp has joined #openstack-containers10:04
*** aluria has joined #openstack-containers10:04
*** fungi has joined #openstack-containers10:04
*** aspiers has joined #openstack-containers10:04
*** gmann has joined #openstack-containers10:04
*** dtruong has joined #openstack-containers10:04
*** tobberydberg has joined #openstack-containers10:04
*** strigazi has joined #openstack-containers10:04
*** freerunner has joined #openstack-containers10:04
*** squarebracket has joined #openstack-containers10:04
*** nwonknu has joined #openstack-containers10:04
*** NobodyCam has joined #openstack-containers10:04
*** mnaser has joined #openstack-containers10:04
brtknrthanks for coming!10:04
*** elenalindq has joined #openstack-containers10:04
*** dasp has joined #openstack-containers10:04
*** mgoddard has joined #openstack-containers10:04
*** dioguerra has joined #openstack-containers10:04
*** arbrandes has joined #openstack-containers10:04
*** logan- has joined #openstack-containers10:04
*** yankcrime has joined #openstack-containers10:04
*** Anticimex has joined #openstack-containers10:04
brtknrand nice chatting10:04
brtknrwhere is your containerd installer btw strigazi ?10:04
*** logan- has quit IRC10:05
tridentbrtknr: Seems to have been a IRC netsplit between servers for a while. Seems better now.10:06
*** logan- has joined #openstack-containers10:06
openstackgerritBharat Kunwar proposed openstack/magnum stable/rocky: k8s_fedora: Move rp_filter=1 for calico up  https://review.opendev.org/69743310:08
*** osmanlicilegi has quit IRC10:18
*** osmanlicilegi has joined #openstack-containers10:19
*** osmanlicilegi has quit IRC10:22
openstackgerritMerged openstack/magnum stable/rocky: fix: Deploy enable_service last (rocky only)  https://review.opendev.org/69688410:26
*** osmanlicilegi has joined #openstack-containers10:27
*** ykarel is now known as ykarel|afk10:27
*** namrata has joined #openstack-containers10:28
*** pcaruana has quit IRC10:42
openstackgerritMerged openstack/magnum stable/rocky: k8s: Clear cni configuration  https://review.opendev.org/69691511:00
*** ykarel|afk is now known as ykarel11:07
*** udesale has joined #openstack-containers11:51
brtknrtrident: once all the changes are merged, we can propose a release11:52
brtknrit will be 7.2.0 instead of 7.1.1 due to PSP feature11:52
*** namrata has quit IRC12:12
tridentbrtknr: Sounds great! :)12:18
andreinhello everyone12:29
andreinbrtknr: can you merge https://review.opendev.org/#/c/696706/ ?12:29
openstackgerritMerged openstack/magnum stable/rocky: k8s_fedora_atomic: Add PodSecurityPolicy  https://review.opendev.org/69706012:50
*** rcernin has quit IRC12:52
*** pcaruana has joined #openstack-containers12:54
openstackgerritMerged openstack/magnum stable/rocky: k8s_fedora: Move rp_filter=1 for calico up  https://review.opendev.org/69743313:17
openstackgerritMerged openstack/magnum stable/stein: k8s: stop introspecting instance name  https://review.opendev.org/69570913:17
openstackgerritMerged openstack/magnum stable/stein: Using vxlan as default value for flannel_backend  https://review.opendev.org/69571313:17
openstackgerritMerged openstack/magnum stable/stein: k8s_fedora: Move rp_filter=1 for calico up  https://review.opendev.org/69743213:17
*** goldyfruit_ has quit IRC13:20
*** udesale has quit IRC13:30
brtknrandrein: done :)13:38
*** udesale has joined #openstack-containers13:39
*** ykarel is now known as ykarel|afk13:50
openstackgerritMerged openstack/magnum master: Change k8s-keystone-auth docker repo  https://review.opendev.org/69670614:31
*** pcaruana has quit IRC14:38
*** goldyfruit_ has joined #openstack-containers14:48
*** goldyfruit___ has joined #openstack-containers15:00
*** goldyfruit_ has quit IRC15:02
*** elenalindq has quit IRC15:03
*** elenalindq has joined #openstack-containers15:17
andreinbrtknr: how long does it usually take to set up a new kubernetes cluster with magnum for you?15:20
brtknrandrein: which version of magnum?15:22
andrein9.1.015:22
andreintrain stable15:22
andreinI'm pretty sure it used to be faster, but I'm now at 25 minutes and counting15:23
andreinI think something changed in heat-container-agent as well since last time15:23
andrein(last time I tested was last week)15:23
brtknrandrein: it took that long to create a cluster?15:26
andreinit hasn't finished yet15:26
openstackgerritTheodoros Tsioutsias proposed openstack/magnum master: nodegroup list with --limit gives wrong next URL  https://review.opendev.org/69423015:27
andreinDec 05 15:24:44 chaosmonkeys-z7ygajndwaaw-master-0.novalocal runc[1398]: + atomic install --storage ostree --system --system-package=no --name=kube-proxy docker.io/openstackmagnum/kubernetes-proxy:v1.15.615:28
andreinDec 05 15:24:44 chaosmonkeys-z7ygajndwaaw-master-0.novalocal runc[1398]: time="2019-12-05T15:24:44Z" level=fatal msg="Error writing blob: unexpected EOF"15:28
andreinI think this caused it...15:28
brtknrwcreated_at           | 2019-12-04T14:15:40+00:0015:28
brtknrupdated_at           | 2019-12-04T14:23:16+00:0015:28
brtknrso thats 12 mins15:28
brtknrbut that was yesterday15:29
brtknri'll try again today15:29
brtknrare you doing it with podman enabled?15:29
brtknrandrein:15:29
andreinI don't have podman enabled15:29
andreinshould I?15:29
andreinbrtknr: https://hub.docker.com/layers/openstackmagnum/kubernetes-proxy/v1.15.6/images/sha256-b0626dca7c206f510c90bd3c15ab508582f8afe7c87d8acefad8c54a8b738bf715:30
brtknrandrein: my stat is with podman enabled15:31
andreinI'll try with podman15:31
andreinbrtknr: that image was pushed around the time I created my cluster15:32
brtknrandrein: ah, actually i havent tried creating a cluster with 1.15.615:33
andreinwonder if it crapped out because the new tag was pushed midway15:33
brtknrandrein: i'll try spawning a cluster now15:35
*** udesale has quit IRC15:37
andreinbrtknr: I started a new cluster from the same template15:46
andreinit spawned correctly in 11m this time15:47
brtknrandrein: cool15:49
*** ykarel|afk is now known as ykarel|away16:01
*** ykarel|away has quit IRC16:05
*** dave-mccowan has joined #openstack-containers16:08
*** ykarel|away has joined #openstack-containers16:20
brtknrtrident: https://review.opendev.org/#/c/697514/16:35
*** openstackgerrit has quit IRC16:42
*** goldyfruit_ has joined #openstack-containers16:43
*** goldyfruit___ has quit IRC16:46
*** ricolin has quit IRC16:54
*** dave-mccowan has quit IRC16:58
*** dave-mccowan has joined #openstack-containers17:00
andreinbrtknr: are you still around?17:04
*** dave-mccowan has quit IRC17:10
*** goldyfruit___ has joined #openstack-containers17:12
*** goldyfruit_ has quit IRC17:15
*** lpetrut has quit IRC17:40
*** lpetrut has joined #openstack-containers18:07
*** ykarel|away has quit IRC18:07
*** dave-mccowan has joined #openstack-containers18:39
*** openstackgerrit has joined #openstack-containers19:18
openstackgerritMatthew Fuller proposed openstack/magnum master: PDF documentation build  https://review.opendev.org/68443619:18
*** jmlowe has quit IRC19:19
*** dave-mccowan has quit IRC19:36
openstackgerritMerged openstack/magnum master: Make it possible to use uwsgi easily  https://review.opendev.org/65976419:43
*** rcernin has joined #openstack-containers20:03
*** jmlowe has joined #openstack-containers20:11
*** rcernin has quit IRC20:18
*** icassano has joined #openstack-containers20:50
icassanohello boys, please help me with magnum stein on centos20:51
icassanothe following error in /var/log/messages:Dec  5 21:14:49 tst2-osctrl01 magnum-api: Traceback (most recent call last):Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 568, in process_requestDec  5 21:14:49 tst2-osctrl01 magnum-api: self.finish_request(request, client_address)Dec  5 21:14:49 tst2-osctrl0120:52
icassanomagnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 334, in finish_requestDec  5 21:14:49 tst2-osctrl01 magnum-api: self.RequestHandlerClass(request, client_address, self)Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 651, in __init__Dec  5 21:14:49 tst2-osctrl01 magnum-api: self.finish()Dec  520:52
icassano21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/SocketServer.py", line 710, in finishDec  5 21:14:49 tst2-osctrl01 magnum-api: self.wfile.close()Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib64/python2.7/socket.py", line 279, in closeDec  5 21:14:49 tst2-osctrl01 magnum-api: self.flush()Dec  5 21:14:49 tst2-osctrl0120:52
icassanomagnum-api: File "/usr/lib64/python2.7/socket.py", line 303, in flushDec  5 21:14:49 tst2-osctrl01 magnum-api: self._sock.sendall(view[write_offset:write_offset+buffer_size])Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 401, in sendallDec  5 21:14:49 tst2-osctrl01 magnum-api: tail =20:52
icassanoself.send(data, flags)Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line 395, in sendDec  5 21:14:49 tst2-osctrl01 magnum-api: return self._send_loop(self.fd.send, data, flags)Dec  5 21:14:49 tst2-osctrl01 magnum-api: File "/usr/lib/python2.7/site-packages/eventlet/greenio/base.py", line20:52
icassano382, in _send_loopDec  5 21:14:49 tst2-osctrl01 magnum-api: return send_method(data, *args)Dec  5 21:14:49 tst2-osctrl01 magnum-api: error: [Errno 32] Broken pipe20:52
icassanoPlease20:52
*** icassano has quit IRC21:01
*** dave-mccowan has joined #openstack-containers21:14
*** dasp_ has joined #openstack-containers21:52
*** dasp has quit IRC21:55
*** goldyfruit___ has quit IRC22:05
*** rcernin has joined #openstack-containers22:28
brtknricassano: nothing obvious from what you’ve pasted sorry23:05
brtknricassano: not sure how you deployed magnum?23:05
brtknricassano: btw use paste.openstack.org for posting logs23:06

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!