Wednesday, 2019-05-08

*** ttsiouts has quit IRC00:06
*** KeithMnemonic has quit IRC00:56
*** hongbin has joined #openstack-containers01:31
openstackgerritFeilong Wang proposed openstack/magnum master: New config option for default Keystone auth policy  https://review.opendev.org/64322502:12
*** ricolin has joined #openstack-containers02:23
*** ttsiouts has joined #openstack-containers02:39
*** ttsiouts has quit IRC02:44
*** ykarel|away has joined #openstack-containers03:14
*** sidsheikh1983 has joined #openstack-containers03:19
*** itlinux has joined #openstack-containers03:20
*** itlinux has quit IRC03:22
*** ramishra_ has quit IRC03:33
*** sidsheikh1983 has quit IRC03:34
*** ramishra has joined #openstack-containers03:37
*** udesale has joined #openstack-containers03:55
*** ykarel|away has quit IRC04:07
*** hongbin has quit IRC04:19
*** ykarel|away has joined #openstack-containers04:23
*** ykarel_ has joined #openstack-containers04:25
*** ykarel|away has quit IRC04:28
*** ivve has quit IRC04:35
*** ykarel_ is now known as ykarel04:41
*** janki has joined #openstack-containers04:47
*** dims has quit IRC05:32
*** dims has joined #openstack-containers05:33
*** ivve has joined #openstack-containers05:39
*** udesale has quit IRC06:05
*** udesale has joined #openstack-containers06:05
*** ricolin_ has joined #openstack-containers06:12
*** ricolin has quit IRC06:12
*** dims has quit IRC06:16
*** ricolin_ has quit IRC06:27
*** yolanda_ has joined #openstack-containers06:31
*** ttsiouts has joined #openstack-containers06:34
*** dims has joined #openstack-containers06:42
*** dims has quit IRC06:49
*** dims has joined #openstack-containers06:54
*** rcernin has quit IRC07:01
*** udesale has quit IRC07:03
*** udesale has joined #openstack-containers07:03
*** ttsiouts has quit IRC07:33
jakeyiphi, who manages the containers at https://hub.docker.com/r/openstackmagnum/ ? if I want to patch something, how would I go about doing it?07:39
*** ykarel is now known as ykarel|lunch07:44
*** rtjure has quit IRC07:48
*** rtjure has joined #openstack-containers07:54
*** rtjure has quit IRC08:16
*** ykarel|lunch is now known as ykarel08:25
*** lpetrut has joined #openstack-containers08:38
*** ttsiouts has joined #openstack-containers09:06
*** ttsiouts has quit IRC09:11
*** yankcrime has quit IRC09:32
openstackgerritDiogo Guerra proposed openstack/magnum master: [wip] [k8s] Update prometheus monitoring helm based configuration  https://review.opendev.org/65740309:41
*** yankcrime has joined #openstack-containers10:31
*** ttsiouts has joined #openstack-containers10:46
*** ttsiouts has quit IRC10:50
*** ykarel is now known as ykarel|afk10:51
*** sapd1_x has joined #openstack-containers11:11
*** udesale has quit IRC11:14
*** janki has quit IRC11:23
*** sidsheikh1983 has joined #openstack-containers11:24
*** sidsheikh1983 has quit IRC11:53
*** ykarel|afk is now known as ykarel11:56
*** mgariepy has quit IRC12:11
*** henriqueof has joined #openstack-containers12:17
*** mgariepy has joined #openstack-containers12:21
*** mgariepy has quit IRC12:29
*** ttsiouts has joined #openstack-containers12:32
*** mgariepy has joined #openstack-containers12:34
*** henriqueof has quit IRC12:43
*** henriqueof has joined #openstack-containers12:43
*** nwilburn has joined #openstack-containers12:51
*** ttsiouts has quit IRC12:53
*** mgariepy has quit IRC12:58
*** mgariepy has joined #openstack-containers13:09
*** ttsiouts has joined #openstack-containers13:30
*** ykarel is now known as ykarel|away13:52
*** ykarel|away has quit IRC13:59
*** lpetrut has quit IRC13:59
*** lpetrut has joined #openstack-containers14:24
*** hongbin has joined #openstack-containers14:29
*** ykarel|away has joined #openstack-containers14:29
jrosseri get this error http://paste.openstack.org/show/751120/ running pip installed cli tools against my rocky cloud, python-openstackclient==3.17.0 and python-magnumclient==2.13.0, is that a bug?14:32
*** lpetrut has quit IRC14:37
*** lpetrut has joined #openstack-containers14:39
*** ykarel|away is now known as ykarel14:57
NobodyCamGood morning Magnum folks, is it possible to set max-pods for Kubelet at time of deploy?14:57
*** ttsiouts has quit IRC15:07
*** ivve has quit IRC15:07
*** sapd1_x has quit IRC15:09
*** itlinux has joined #openstack-containers15:09
*** sapd1_x has joined #openstack-containers15:09
*** ttsiouts has joined #openstack-containers15:12
*** altlogbot_1 has quit IRC15:21
*** altlogbot_3 has joined #openstack-containers15:21
*** irclogbot_2 has quit IRC15:22
*** irclogbot_1 has joined #openstack-containers15:23
*** altlogbot_3 has quit IRC15:27
*** altlogbot_2 has joined #openstack-containers15:27
*** irclogbot_1 has quit IRC15:28
*** irclogbot_0 has joined #openstack-containers15:29
*** henriqueof has quit IRC15:32
*** itlinux has quit IRC15:42
*** lpetrut has quit IRC16:11
*** ykarel is now known as ykarel|away16:18
nwilburnHey all. I am in the process of investigating Magnum for use at my work. Does anyone have any good/bad experiences with Magnum? I'd love to hear from people who are actually using it in production and any "gotchas" or negatives, as well as the positives. I apologize if this isn't the right place to ask16:32
*** henriqueof has joined #openstack-containers16:42
*** ramishra has quit IRC17:09
*** ttsiouts has quit IRC17:10
*** ramishra has joined #openstack-containers17:12
*** flwang1 has joined #openstack-containers17:14
*** ttsiouts has joined #openstack-containers17:19
*** ianychoi_ has joined #openstack-containers17:29
*** ianychoi has quit IRC17:31
*** ttsiouts has quit IRC17:54
*** ivve has joined #openstack-containers17:54
*** mgariepy has quit IRC17:57
*** mgariepy has joined #openstack-containers17:58
*** ramishra has quit IRC18:09
*** ttsiouts has joined #openstack-containers18:09
*** ttsiouts has quit IRC18:14
*** ykarel|away has quit IRC18:28
*** ttsiouts has joined #openstack-containers18:42
*** lpetrut has joined #openstack-containers19:08
*** lpetrut has quit IRC19:12
*** hongbin has quit IRC19:17
*** flwang1 has quit IRC19:39
*** ttsiouts has quit IRC19:44
*** ttsiouts has joined #openstack-containers19:59
*** ttsiouts has quit IRC20:04
*** mgoddard has quit IRC20:13
*** nwilburn has quit IRC20:14
*** nwilburn has joined #openstack-containers20:14
*** yolanda_ has quit IRC20:15
*** imdigitaljim has quit IRC20:15
*** yolanda_ has joined #openstack-containers20:28
*** ttsiouts has joined #openstack-containers20:37
*** ttsiouts has quit IRC20:42
*** itlinux has joined #openstack-containers20:42
*** guimaluf has quit IRC20:44
*** itlinux has quit IRC20:45
flwangnwilburn: CERN, Catalyst Cloud and Blizzard are using Magnum on production20:57
flwangjrosser: that's probably because your magnum version is not new which doesn't support hidden20:59
flwangbut in short, i think it's a bug in magnum client20:59
jrosserflwang: yes i was wondering what a user would expect, i.e to just pip intstall the client and not really have to care about versins21:00
flwangjakeyip:  me and strigazi are the maintainer of the openstackmagnum repo, how can i help?21:02
*** nwilburn has quit IRC21:04
ivveflwang: i saw mnaser added a retry function for downloading master/node packages with atomic install, it actually solves some slow network issues since there isn't any good way to proxy it21:22
ivveis that anything you have thought about?21:22
ivvehttps://review.opendev.org/#/c/623567/221:23
flwangivve: no, we're using stable/stein and stable/rocky before, all good for us21:23
flwangivve: are you using multi regions?21:23
ivvenope21:24
flwangjrosser: just need to check the micro version before refer the new attribute21:24
flwangivve: then you should be ok21:24
flwangivve: what's your heat version?21:24
ivveflwang: stable/stein21:24
flwangivve: then you're good to go21:25
ivvei still get weird issues with --registry-enabled21:25
ivveatomic installs timeout21:25
ivvesometimes21:25
ivvethen the entire cluster fails.. if i watch it there can be time to rebuild the failing instance, but that doesn't feel very automatic :P21:26
flwangivve: we have just fixed an issue of registry-enabled21:29
ivveflwang: oh21:29
flwangyou can try to disable it for now to focus on the overall workflow21:29
ivveyes that is what i have done21:30
flwangthere is not much we can do for atomic install timeout21:30
ivvebasically, only floating for the octavia and labels21:30
ivveflwang: oh one thing! what version of atomic-fedora is actually recommended? i only got this one working: 28 2018.08.0621:31
*** sidsheikh1983 has joined #openstack-containers21:32
ivvei've scoured through so much magnum/k8s docs for openstack i found several different recommendations/supported versions, none of them worked though21:32
ivvetried tons of verson between 27 - 2921:33
flwangnow, use 2721:33
ivveflwang: can you be more specific?21:35
ivvelatest 27 or specific version?21:35
flwangjust latest 2721:42
*** henriqueof has quit IRC21:44
ivveok, thanks for taking the time to answer my questions :)21:52
flwangivve: you're welcome, now i'm serving the ptl of magnum, so any question is welcome here21:58
*** rcernin has joined #openstack-containers22:31
jakeyipivve: I've found that using your own local registry worked really well in preventing timeouts22:56
jakeyipflwang: I was testing reboots of master nodes and found that kube-apiserver seems to be starting up too early (possbily before network?) and failing with an error. found that a small dependency change to the systemd service file fixes that22:58
*** sidsheikh1983 has quit IRC22:59
jakeyipbasically add `After=network-online.target` to kube-apiserver.service file23:00
flwangjakeyip: i found that issue as well23:28
flwangjakeyip: https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/enable-services-master.sh#L2023:29
flwangcan you pls try to replace 'start' with 'restart' in above file? and let me know if it works for you23:29
flwangjakeyip: btw, i'm working on this https://review.opendev.org/#/c/653270/   when i test this, i found the issue you mentioned above23:30
jakeyipthis is on first boot? I'm referring to on a reboot23:30
flwangprobably same issue, so i'm asking if you can test23:31
flwangthis is a first boot, but not really, it will reuse the etcd data/volume23:32
flwangso apiserver could be start very quick23:32
flwangjakeyip: but i think your solution is better than mine, so meanwhile i'm happy to test yours as well23:34
flwangfor your issue, you can fix the image here https://github.com/openstack/magnum/blob/master/dockerfiles/kubernetes-apiserver/service.template23:34
jakeyipok. I can try. btw the error is `May 08 09:30:25 kube-113-rze33jusjxcg-master-0.novalocal runc[1150]: error: unable to find suitable network address.error='no default routes found in "/proc/net/route" or "/proc/net/ipv6_route"'. Try to set the AdvertiseAddress directly or provide a valid BindAddress to fix this`23:34
flwangafter it's approved, we will automatically release a new image23:34
flwangare you using flannel?23:35
jakeyipI'm using flannel23:36
flwangthen probably same issue23:36
jakeyipcool I might try to build the docker container ourselves for testing23:37
jakeyipI'm on rocky and I've done some in house patches to move enable-services to run last23:37
flwanggo for it and i'm happy for doing any code review, cheers23:37
jakeyipthat worked for us23:37
flwangok23:38
flwangcould you please file a story and then proprose the patch?23:39
jakeyipsure23:40
*** ttsiouts has joined #openstack-containers23:41
jakeyipspeaking of story there's something I filed recently https://storyboard.openstack.org/#!/story/200553923:41
jakeyipI'm thinking if we need some sort of versioning to solve this properly23:42
*** sidsheikh1983 has joined #openstack-containers23:53
*** sidsheikh1983 has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!