*** ttsiouts has quit IRC | 00:06 | |
*** KeithMnemonic has quit IRC | 00:56 | |
*** hongbin has joined #openstack-containers | 01:31 | |
openstackgerrit | Feilong Wang proposed openstack/magnum master: New config option for default Keystone auth policy https://review.opendev.org/643225 | 02:12 |
---|---|---|
*** ricolin has joined #openstack-containers | 02:23 | |
*** ttsiouts has joined #openstack-containers | 02:39 | |
*** ttsiouts has quit IRC | 02:44 | |
*** ykarel|away has joined #openstack-containers | 03:14 | |
*** sidsheikh1983 has joined #openstack-containers | 03:19 | |
*** itlinux has joined #openstack-containers | 03:20 | |
*** itlinux has quit IRC | 03:22 | |
*** ramishra_ has quit IRC | 03:33 | |
*** sidsheikh1983 has quit IRC | 03:34 | |
*** ramishra has joined #openstack-containers | 03:37 | |
*** udesale has joined #openstack-containers | 03:55 | |
*** ykarel|away has quit IRC | 04:07 | |
*** hongbin has quit IRC | 04:19 | |
*** ykarel|away has joined #openstack-containers | 04:23 | |
*** ykarel_ has joined #openstack-containers | 04:25 | |
*** ykarel|away has quit IRC | 04:28 | |
*** ivve has quit IRC | 04:35 | |
*** ykarel_ is now known as ykarel | 04:41 | |
*** janki has joined #openstack-containers | 04:47 | |
*** dims has quit IRC | 05:32 | |
*** dims has joined #openstack-containers | 05:33 | |
*** ivve has joined #openstack-containers | 05:39 | |
*** udesale has quit IRC | 06:05 | |
*** udesale has joined #openstack-containers | 06:05 | |
*** ricolin_ has joined #openstack-containers | 06:12 | |
*** ricolin has quit IRC | 06:12 | |
*** dims has quit IRC | 06:16 | |
*** ricolin_ has quit IRC | 06:27 | |
*** yolanda_ has joined #openstack-containers | 06:31 | |
*** ttsiouts has joined #openstack-containers | 06:34 | |
*** dims has joined #openstack-containers | 06:42 | |
*** dims has quit IRC | 06:49 | |
*** dims has joined #openstack-containers | 06:54 | |
*** rcernin has quit IRC | 07:01 | |
*** udesale has quit IRC | 07:03 | |
*** udesale has joined #openstack-containers | 07:03 | |
*** ttsiouts has quit IRC | 07:33 | |
jakeyip | hi, who manages the containers at https://hub.docker.com/r/openstackmagnum/ ? if I want to patch something, how would I go about doing it? | 07:39 |
*** ykarel is now known as ykarel|lunch | 07:44 | |
*** rtjure has quit IRC | 07:48 | |
*** rtjure has joined #openstack-containers | 07:54 | |
*** rtjure has quit IRC | 08:16 | |
*** ykarel|lunch is now known as ykarel | 08:25 | |
*** lpetrut has joined #openstack-containers | 08:38 | |
*** ttsiouts has joined #openstack-containers | 09:06 | |
*** ttsiouts has quit IRC | 09:11 | |
*** yankcrime has quit IRC | 09:32 | |
openstackgerrit | Diogo Guerra proposed openstack/magnum master: [wip] [k8s] Update prometheus monitoring helm based configuration https://review.opendev.org/657403 | 09:41 |
*** yankcrime has joined #openstack-containers | 10:31 | |
*** ttsiouts has joined #openstack-containers | 10:46 | |
*** ttsiouts has quit IRC | 10:50 | |
*** ykarel is now known as ykarel|afk | 10:51 | |
*** sapd1_x has joined #openstack-containers | 11:11 | |
*** udesale has quit IRC | 11:14 | |
*** janki has quit IRC | 11:23 | |
*** sidsheikh1983 has joined #openstack-containers | 11:24 | |
*** sidsheikh1983 has quit IRC | 11:53 | |
*** ykarel|afk is now known as ykarel | 11:56 | |
*** mgariepy has quit IRC | 12:11 | |
*** henriqueof has joined #openstack-containers | 12:17 | |
*** mgariepy has joined #openstack-containers | 12:21 | |
*** mgariepy has quit IRC | 12:29 | |
*** ttsiouts has joined #openstack-containers | 12:32 | |
*** mgariepy has joined #openstack-containers | 12:34 | |
*** henriqueof has quit IRC | 12:43 | |
*** henriqueof has joined #openstack-containers | 12:43 | |
*** nwilburn has joined #openstack-containers | 12:51 | |
*** ttsiouts has quit IRC | 12:53 | |
*** mgariepy has quit IRC | 12:58 | |
*** mgariepy has joined #openstack-containers | 13:09 | |
*** ttsiouts has joined #openstack-containers | 13:30 | |
*** ykarel is now known as ykarel|away | 13:52 | |
*** ykarel|away has quit IRC | 13:59 | |
*** lpetrut has quit IRC | 13:59 | |
*** lpetrut has joined #openstack-containers | 14:24 | |
*** hongbin has joined #openstack-containers | 14:29 | |
*** ykarel|away has joined #openstack-containers | 14:29 | |
jrosser | i get this error http://paste.openstack.org/show/751120/ running pip installed cli tools against my rocky cloud, python-openstackclient==3.17.0 and python-magnumclient==2.13.0, is that a bug? | 14:32 |
*** lpetrut has quit IRC | 14:37 | |
*** lpetrut has joined #openstack-containers | 14:39 | |
*** ykarel|away is now known as ykarel | 14:57 | |
NobodyCam | Good morning Magnum folks, is it possible to set max-pods for Kubelet at time of deploy? | 14:57 |
*** ttsiouts has quit IRC | 15:07 | |
*** ivve has quit IRC | 15:07 | |
*** sapd1_x has quit IRC | 15:09 | |
*** itlinux has joined #openstack-containers | 15:09 | |
*** sapd1_x has joined #openstack-containers | 15:09 | |
*** ttsiouts has joined #openstack-containers | 15:12 | |
*** altlogbot_1 has quit IRC | 15:21 | |
*** altlogbot_3 has joined #openstack-containers | 15:21 | |
*** irclogbot_2 has quit IRC | 15:22 | |
*** irclogbot_1 has joined #openstack-containers | 15:23 | |
*** altlogbot_3 has quit IRC | 15:27 | |
*** altlogbot_2 has joined #openstack-containers | 15:27 | |
*** irclogbot_1 has quit IRC | 15:28 | |
*** irclogbot_0 has joined #openstack-containers | 15:29 | |
*** henriqueof has quit IRC | 15:32 | |
*** itlinux has quit IRC | 15:42 | |
*** lpetrut has quit IRC | 16:11 | |
*** ykarel is now known as ykarel|away | 16:18 | |
nwilburn | Hey all. I am in the process of investigating Magnum for use at my work. Does anyone have any good/bad experiences with Magnum? I'd love to hear from people who are actually using it in production and any "gotchas" or negatives, as well as the positives. I apologize if this isn't the right place to ask | 16:32 |
*** henriqueof has joined #openstack-containers | 16:42 | |
*** ramishra has quit IRC | 17:09 | |
*** ttsiouts has quit IRC | 17:10 | |
*** ramishra has joined #openstack-containers | 17:12 | |
*** flwang1 has joined #openstack-containers | 17:14 | |
*** ttsiouts has joined #openstack-containers | 17:19 | |
*** ianychoi_ has joined #openstack-containers | 17:29 | |
*** ianychoi has quit IRC | 17:31 | |
*** ttsiouts has quit IRC | 17:54 | |
*** ivve has joined #openstack-containers | 17:54 | |
*** mgariepy has quit IRC | 17:57 | |
*** mgariepy has joined #openstack-containers | 17:58 | |
*** ramishra has quit IRC | 18:09 | |
*** ttsiouts has joined #openstack-containers | 18:09 | |
*** ttsiouts has quit IRC | 18:14 | |
*** ykarel|away has quit IRC | 18:28 | |
*** ttsiouts has joined #openstack-containers | 18:42 | |
*** lpetrut has joined #openstack-containers | 19:08 | |
*** lpetrut has quit IRC | 19:12 | |
*** hongbin has quit IRC | 19:17 | |
*** flwang1 has quit IRC | 19:39 | |
*** ttsiouts has quit IRC | 19:44 | |
*** ttsiouts has joined #openstack-containers | 19:59 | |
*** ttsiouts has quit IRC | 20:04 | |
*** mgoddard has quit IRC | 20:13 | |
*** nwilburn has quit IRC | 20:14 | |
*** nwilburn has joined #openstack-containers | 20:14 | |
*** yolanda_ has quit IRC | 20:15 | |
*** imdigitaljim has quit IRC | 20:15 | |
*** yolanda_ has joined #openstack-containers | 20:28 | |
*** ttsiouts has joined #openstack-containers | 20:37 | |
*** ttsiouts has quit IRC | 20:42 | |
*** itlinux has joined #openstack-containers | 20:42 | |
*** guimaluf has quit IRC | 20:44 | |
*** itlinux has quit IRC | 20:45 | |
flwang | nwilburn: CERN, Catalyst Cloud and Blizzard are using Magnum on production | 20:57 |
flwang | jrosser: that's probably because your magnum version is not new which doesn't support hidden | 20:59 |
flwang | but in short, i think it's a bug in magnum client | 20:59 |
jrosser | flwang: yes i was wondering what a user would expect, i.e to just pip intstall the client and not really have to care about versins | 21:00 |
flwang | jakeyip: me and strigazi are the maintainer of the openstackmagnum repo, how can i help? | 21:02 |
*** nwilburn has quit IRC | 21:04 | |
ivve | flwang: i saw mnaser added a retry function for downloading master/node packages with atomic install, it actually solves some slow network issues since there isn't any good way to proxy it | 21:22 |
ivve | is that anything you have thought about? | 21:22 |
ivve | https://review.opendev.org/#/c/623567/2 | 21:23 |
flwang | ivve: no, we're using stable/stein and stable/rocky before, all good for us | 21:23 |
flwang | ivve: are you using multi regions? | 21:23 |
ivve | nope | 21:24 |
flwang | jrosser: just need to check the micro version before refer the new attribute | 21:24 |
flwang | ivve: then you should be ok | 21:24 |
flwang | ivve: what's your heat version? | 21:24 |
ivve | flwang: stable/stein | 21:24 |
flwang | ivve: then you're good to go | 21:25 |
ivve | i still get weird issues with --registry-enabled | 21:25 |
ivve | atomic installs timeout | 21:25 |
ivve | sometimes | 21:25 |
ivve | then the entire cluster fails.. if i watch it there can be time to rebuild the failing instance, but that doesn't feel very automatic :P | 21:26 |
flwang | ivve: we have just fixed an issue of registry-enabled | 21:29 |
ivve | flwang: oh | 21:29 |
flwang | you can try to disable it for now to focus on the overall workflow | 21:29 |
ivve | yes that is what i have done | 21:30 |
flwang | there is not much we can do for atomic install timeout | 21:30 |
ivve | basically, only floating for the octavia and labels | 21:30 |
ivve | flwang: oh one thing! what version of atomic-fedora is actually recommended? i only got this one working: 28 2018.08.06 | 21:31 |
*** sidsheikh1983 has joined #openstack-containers | 21:32 | |
ivve | i've scoured through so much magnum/k8s docs for openstack i found several different recommendations/supported versions, none of them worked though | 21:32 |
ivve | tried tons of verson between 27 - 29 | 21:33 |
flwang | now, use 27 | 21:33 |
ivve | flwang: can you be more specific? | 21:35 |
ivve | latest 27 or specific version? | 21:35 |
flwang | just latest 27 | 21:42 |
*** henriqueof has quit IRC | 21:44 | |
ivve | ok, thanks for taking the time to answer my questions :) | 21:52 |
flwang | ivve: you're welcome, now i'm serving the ptl of magnum, so any question is welcome here | 21:58 |
*** rcernin has joined #openstack-containers | 22:31 | |
jakeyip | ivve: I've found that using your own local registry worked really well in preventing timeouts | 22:56 |
jakeyip | flwang: I was testing reboots of master nodes and found that kube-apiserver seems to be starting up too early (possbily before network?) and failing with an error. found that a small dependency change to the systemd service file fixes that | 22:58 |
*** sidsheikh1983 has quit IRC | 22:59 | |
jakeyip | basically add `After=network-online.target` to kube-apiserver.service file | 23:00 |
flwang | jakeyip: i found that issue as well | 23:28 |
flwang | jakeyip: https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/enable-services-master.sh#L20 | 23:29 |
flwang | can you pls try to replace 'start' with 'restart' in above file? and let me know if it works for you | 23:29 |
flwang | jakeyip: btw, i'm working on this https://review.opendev.org/#/c/653270/ when i test this, i found the issue you mentioned above | 23:30 |
jakeyip | this is on first boot? I'm referring to on a reboot | 23:30 |
flwang | probably same issue, so i'm asking if you can test | 23:31 |
flwang | this is a first boot, but not really, it will reuse the etcd data/volume | 23:32 |
flwang | so apiserver could be start very quick | 23:32 |
flwang | jakeyip: but i think your solution is better than mine, so meanwhile i'm happy to test yours as well | 23:34 |
flwang | for your issue, you can fix the image here https://github.com/openstack/magnum/blob/master/dockerfiles/kubernetes-apiserver/service.template | 23:34 |
jakeyip | ok. I can try. btw the error is `May 08 09:30:25 kube-113-rze33jusjxcg-master-0.novalocal runc[1150]: error: unable to find suitable network address.error='no default routes found in "/proc/net/route" or "/proc/net/ipv6_route"'. Try to set the AdvertiseAddress directly or provide a valid BindAddress to fix this` | 23:34 |
flwang | after it's approved, we will automatically release a new image | 23:34 |
flwang | are you using flannel? | 23:35 |
jakeyip | I'm using flannel | 23:36 |
flwang | then probably same issue | 23:36 |
jakeyip | cool I might try to build the docker container ourselves for testing | 23:37 |
jakeyip | I'm on rocky and I've done some in house patches to move enable-services to run last | 23:37 |
flwang | go for it and i'm happy for doing any code review, cheers | 23:37 |
jakeyip | that worked for us | 23:37 |
flwang | ok | 23:38 |
flwang | could you please file a story and then proprose the patch? | 23:39 |
jakeyip | sure | 23:40 |
*** ttsiouts has joined #openstack-containers | 23:41 | |
jakeyip | speaking of story there's something I filed recently https://storyboard.openstack.org/#!/story/2005539 | 23:41 |
jakeyip | I'm thinking if we need some sort of versioning to solve this properly | 23:42 |
*** sidsheikh1983 has joined #openstack-containers | 23:53 | |
*** sidsheikh1983 has quit IRC | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!