*** rcernin has joined #openstack-containers | 00:03 | |
*** itlinux has quit IRC | 00:17 | |
*** livelace2 has quit IRC | 00:24 | |
*** livelace2 has joined #openstack-containers | 00:24 | |
*** flwang has quit IRC | 00:30 | |
*** flwang has joined #openstack-containers | 00:43 | |
*** ricolin has joined #openstack-containers | 00:45 | |
*** ricolin has quit IRC | 00:46 | |
*** hongbin has joined #openstack-containers | 01:16 | |
*** dtruong_ has quit IRC | 01:20 | |
*** openstackgerrit has joined #openstack-containers | 02:07 | |
openstackgerrit | Merged openstack/magnum-ui master: Add release notes for Rocky https://review.openstack.org/585635 | 02:07 |
---|---|---|
*** itlinux has joined #openstack-containers | 02:11 | |
*** armaan has quit IRC | 02:13 | |
*** itlinux has quit IRC | 02:15 | |
*** ricolin has joined #openstack-containers | 02:31 | |
*** openstack has joined #openstack-containers | 02:49 | |
*** ChanServ sets mode: +o openstack | 02:49 | |
*** hongbin has quit IRC | 02:56 | |
*** vijaykc4 has joined #openstack-containers | 03:02 | |
*** dave-mcc_ has quit IRC | 03:02 | |
*** jmlowe has joined #openstack-containers | 03:06 | |
openstackgerrit | Feilong Wang proposed openstack/magnum master: Create /etc/kubernetes/manifests on k8s master https://review.openstack.org/585935 | 03:11 |
flwang1 | strigazi: I have created story https://storyboard.openstack.org/#!/story/2003103 to track our work to fix v1.11.x | 03:11 |
*** jmlowe has quit IRC | 03:13 | |
*** ramishra has joined #openstack-containers | 03:15 | |
*** vijaykc4 has quit IRC | 03:38 | |
*** udesale has joined #openstack-containers | 03:48 | |
*** lpetrut has joined #openstack-containers | 03:53 | |
*** vijaykc4 has joined #openstack-containers | 03:57 | |
*** itlinux has joined #openstack-containers | 03:58 | |
*** lpetrut has quit IRC | 04:03 | |
*** dtruong_ has joined #openstack-containers | 04:06 | |
*** janki has joined #openstack-containers | 04:11 | |
*** itlinux has quit IRC | 04:11 | |
*** mdnadeem has joined #openstack-containers | 04:17 | |
*** mjura has joined #openstack-containers | 04:40 | |
*** ykarel|away has joined #openstack-containers | 04:47 | |
*** spsurya_ has quit IRC | 04:48 | |
*** spsurya_ has joined #openstack-containers | 04:49 | |
*** armaan has joined #openstack-containers | 04:57 | |
*** armaan has quit IRC | 05:01 | |
*** spsurya_ is now known as spsurya | 05:07 | |
*** flwang1 has quit IRC | 05:50 | |
*** vijaykc4 has quit IRC | 06:01 | |
*** udesale has quit IRC | 06:04 | |
*** udesale has joined #openstack-containers | 06:04 | |
*** flwang1 has joined #openstack-containers | 06:36 | |
*** serlex has joined #openstack-containers | 06:41 | |
*** mgoddard has joined #openstack-containers | 06:41 | |
*** flwang1 has quit IRC | 06:49 | |
*** mgoddard has quit IRC | 06:50 | |
*** ispp has joined #openstack-containers | 07:06 | |
*** flwang1 has joined #openstack-containers | 07:10 | |
*** flwang1 has quit IRC | 07:17 | |
*** flwang1 has joined #openstack-containers | 07:17 | |
*** vijaykc4 has joined #openstack-containers | 07:23 | |
*** pcaruana has joined #openstack-containers | 07:25 | |
*** mgoddard has joined #openstack-containers | 07:31 | |
*** AlexeyAbashkin has joined #openstack-containers | 07:33 | |
*** vijaykc4 has quit IRC | 07:37 | |
*** ispp has quit IRC | 07:40 | |
*** mjura has quit IRC | 07:58 | |
*** mjura has joined #openstack-containers | 07:58 | |
*** flwang1 has quit IRC | 07:58 | |
*** ispp has joined #openstack-containers | 08:05 | |
strigazi | flwang: I was writing a story about this but I was still collecting data. Didn't want an empty one | 08:10 |
strigazi | flwang: thanks I'll update it | 08:10 |
*** vijaykc4 has joined #openstack-containers | 08:11 | |
*** Bhujay has joined #openstack-containers | 08:14 | |
*** armaan has joined #openstack-containers | 08:19 | |
*** Bhujay has quit IRC | 08:37 | |
*** Bhujay has joined #openstack-containers | 08:37 | |
*** ykarel|away has quit IRC | 08:38 | |
*** ykarel| has joined #openstack-containers | 08:38 | |
*** udesale_ has joined #openstack-containers | 08:44 | |
*** janki has quit IRC | 08:45 | |
*** udesale has quit IRC | 08:46 | |
strigazi | flwang: you there? | 08:49 |
*** cbrumm has quit IRC | 09:01 | |
*** jkuei has quit IRC | 09:01 | |
*** schaney has quit IRC | 09:01 | |
*** dtruong_ has quit IRC | 09:02 | |
*** digitaljim has quit IRC | 09:02 | |
*** ispp has quit IRC | 09:10 | |
*** salmankhan has joined #openstack-containers | 09:12 | |
*** armaan has quit IRC | 09:22 | |
*** armaan has joined #openstack-containers | 09:23 | |
*** Bhujay has quit IRC | 09:30 | |
*** Bhujay has joined #openstack-containers | 09:30 | |
*** Bhujay has quit IRC | 09:48 | |
*** Bhujay has joined #openstack-containers | 09:48 | |
*** armaan has quit IRC | 09:50 | |
*** armaan has joined #openstack-containers | 09:51 | |
*** Bhujay has quit IRC | 09:51 | |
*** Bhujay has joined #openstack-containers | 09:52 | |
*** Bhujay has quit IRC | 09:54 | |
*** Bhujay has joined #openstack-containers | 09:55 | |
*** Bhujay has quit IRC | 09:57 | |
*** Bhujay has joined #openstack-containers | 09:58 | |
*** armaan has quit IRC | 10:01 | |
*** armaan has joined #openstack-containers | 10:02 | |
*** janki has joined #openstack-containers | 10:06 | |
*** udesale__ has joined #openstack-containers | 10:08 | |
*** jkuei has joined #openstack-containers | 10:09 | |
*** schaney has joined #openstack-containers | 10:10 | |
*** dtruong_ has joined #openstack-containers | 10:10 | |
*** udesale_ has quit IRC | 10:10 | |
*** imdigitaljim has joined #openstack-containers | 10:10 | |
*** cbrumm has joined #openstack-containers | 10:12 | |
*** Bhujay has quit IRC | 10:22 | |
*** Bhujay has joined #openstack-containers | 10:23 | |
*** ispp has joined #openstack-containers | 10:24 | |
*** armaan has quit IRC | 10:50 | |
*** armaan has joined #openstack-containers | 10:50 | |
*** vijaykc4 has quit IRC | 10:53 | |
*** Bhujay has quit IRC | 10:56 | |
*** Bhujay has joined #openstack-containers | 10:57 | |
*** Bhujay has quit IRC | 10:57 | |
*** flwang1 has joined #openstack-containers | 10:58 | |
*** Bhujay has joined #openstack-containers | 10:58 | |
*** linkmark has joined #openstack-containers | 10:58 | |
flwang1 | strigazi: around to discuss the v1.11.x issues? | 10:58 |
*** Bhujay has quit IRC | 10:59 | |
*** Bhujay has joined #openstack-containers | 10:59 | |
*** rcernin has quit IRC | 11:04 | |
*** vijaykc4 has joined #openstack-containers | 11:08 | |
*** dave-mccowan has joined #openstack-containers | 11:08 | |
*** Bhujay has quit IRC | 11:11 | |
*** Bhujay has joined #openstack-containers | 11:11 | |
*** vijaykc4 has quit IRC | 11:12 | |
*** vijaykc4 has joined #openstack-containers | 11:12 | |
*** udesale__ has quit IRC | 11:25 | |
*** Bhujay has quit IRC | 11:27 | |
*** Bhujay has joined #openstack-containers | 11:27 | |
*** Bhujay has quit IRC | 11:33 | |
*** Bhujay has joined #openstack-containers | 11:38 | |
*** ispp has quit IRC | 11:48 | |
*** ispp has joined #openstack-containers | 11:48 | |
*** flwang1 has quit IRC | 11:50 | |
*** flwang1 has joined #openstack-containers | 11:51 | |
strigazi | flwang: sorry, I'm now | 11:53 |
*** Bhujay has quit IRC | 12:00 | |
*** armaan has quit IRC | 12:03 | |
*** armaan has joined #openstack-containers | 12:04 | |
*** armaan has quit IRC | 12:07 | |
*** armaan has joined #openstack-containers | 12:08 | |
*** armaan has quit IRC | 12:11 | |
*** armaan has joined #openstack-containers | 12:12 | |
*** vijaykc4 has quit IRC | 12:14 | |
*** vijaykc4 has joined #openstack-containers | 12:16 | |
*** armaan has quit IRC | 12:27 | |
*** armaan has joined #openstack-containers | 12:27 | |
*** mdnadeem has quit IRC | 12:34 | |
*** armaan has quit IRC | 12:35 | |
*** armaan has joined #openstack-containers | 12:36 | |
*** openstackgerrit has quit IRC | 12:36 | |
*** vijaykc4 has quit IRC | 12:39 | |
*** armaan has quit IRC | 12:46 | |
*** armaan has joined #openstack-containers | 12:46 | |
*** armaan has quit IRC | 13:00 | |
*** ykarel| has quit IRC | 13:01 | |
*** ykarel| has joined #openstack-containers | 13:03 | |
*** armaan has joined #openstack-containers | 13:05 | |
*** armaan has quit IRC | 13:08 | |
*** ykarel| has quit IRC | 13:12 | |
*** jmlowe has joined #openstack-containers | 13:20 | |
*** ispp has quit IRC | 13:21 | |
*** vijaykc4 has joined #openstack-containers | 13:34 | |
*** ispp has joined #openstack-containers | 13:35 | |
*** vijaykc4 has quit IRC | 13:37 | |
*** markguz has joined #openstack-containers | 13:45 | |
*** Bhujay has joined #openstack-containers | 13:47 | |
*** Bhujay has quit IRC | 13:47 | |
*** jmlowe has quit IRC | 13:47 | |
*** hongbin has joined #openstack-containers | 13:52 | |
*** ispp has quit IRC | 13:58 | |
*** ispp has joined #openstack-containers | 13:58 | |
*** jmlowe has joined #openstack-containers | 14:00 | |
*** armaan has joined #openstack-containers | 14:09 | |
*** jmlowe has quit IRC | 14:09 | |
*** armaan has quit IRC | 14:20 | |
*** hongbin has quit IRC | 14:46 | |
*** janki has quit IRC | 15:15 | |
*** vijaykc4 has joined #openstack-containers | 15:33 | |
*** ispp has quit IRC | 15:36 | |
*** pcaruana has quit IRC | 15:38 | |
*** livelace2 has quit IRC | 15:44 | |
*** hongbin has joined #openstack-containers | 15:49 | |
*** vijaykc4 has quit IRC | 15:55 | |
*** ykarel| has joined #openstack-containers | 15:57 | |
*** itlinux has joined #openstack-containers | 16:01 | |
*** AlexeyAbashkin has quit IRC | 16:10 | |
*** ykarel| has quit IRC | 16:18 | |
*** ricolin has quit IRC | 16:27 | |
*** ykarel| has joined #openstack-containers | 16:30 | |
*** ykarel| has quit IRC | 16:42 | |
imdigitaljim | o/ | 16:51 |
*** markguz has quit IRC | 17:03 | |
*** salmankhan has quit IRC | 17:15 | |
*** serlex has quit IRC | 17:16 | |
*** markguz has joined #openstack-containers | 17:55 | |
*** markguz is now known as markguz_ | 17:55 | |
markguz_ | flwang: updated heat and magnum to stable/queens, rest of the stack is still at pike. Now I'm getting errors about (Anti)Affinity servergroups not being supported. | 18:17 |
flwang1 | markguz_: don't you support server group in your env? | 18:24 |
markguz_ | flwang1: i guess i never configured it | 18:24 |
markguz_ | it's not a public cloud so the need never arose | 18:25 |
flwang1 | ok, i may have to propose a patch to make it configurable | 18:25 |
flwang1 | the background is, https://review.openstack.org/#/c/527946/ | 18:25 |
markguz_ | flwang1: i'm guessing it's not trivial to just enable servergroups? | 18:25 |
flwang1 | by default magnum will try to deploy nodes on different compute host to get better HA | 18:25 |
flwang1 | what's your nova version? | 18:26 |
markguz_ | flwang1: pike | 18:26 |
flwang1 | markguz_: that's ok | 18:26 |
flwang1 | that's a very old feature in nova actually | 18:28 |
flwang1 | but I can't remember if it needs to be enabled/configured in nova, can you pls show me the log in your conductor | 18:29 |
markguz_ | flwang1: nova conductor or magnum conductor? | 18:31 |
flwang1 | markguz_: sorry, magnum | 18:31 |
markguz_ | flwang1: http://paste.openstack.org/show/726705/ | 18:32 |
markguz_ | flwang1: i don't have any server groups configured. | 18:33 |
flwang1 | markguz_: that's ok. magnum will create server group automatically and set the policy | 18:33 |
markguz_ | flwang1: so why is it failing then? | 18:34 |
flwang1 | markguz_: i'm thinking and checking | 18:34 |
flwang1 | markguz_: can you please check if you have ServerGroupAffinityFilter in your nova.conf | 18:35 |
markguz_ | i do | 18:35 |
markguz_ | flwang1: does it need to be in every nova conf or just the scheduler | 18:36 |
flwang1 | you should have ServerGroupAntiAffinityFilter and ServerGroupAffinityFilter | 18:36 |
flwang1 | i think only nova schedule's conf is enough, but better to have it in all conf | 18:37 |
markguz_ | flwang1: i do | 18:37 |
flwang1 | so you have the two filters? | 18:38 |
markguz_ | flwang1: yes | 18:39 |
flwang1 | hmm... | 18:39 |
markguz_ | first thing i did when i saw the error | 18:39 |
flwang1 | you mean you added it or you found it's there when you checked it? | 18:40 |
markguz_ | no i added it the first time i got the error, restarted the scheduler and tried again. | 18:41 |
flwang1 | markguz_: mind trying restart all nova services? | 18:41 |
markguz_ | flwang1: on the controller or everywhere? | 18:41 |
flwang1 | because it's a 400 error, so for me, it's most like an error thrown by nova-api | 18:41 |
flwang1 | at least nova-api | 18:42 |
flwang1 | i don't think nova-compute needs restart | 18:42 |
flwang1 | given it's a 400 error, so you can try to restart nova-api, and try again in magnum | 18:42 |
*** mgoddard has quit IRC | 18:45 | |
markguz_ | flwang1: now i'm getting "No Valid Host Found" | 18:50 |
markguz_ | which is strange because there's plenty of "valid" hosts | 18:50 |
flwang1 | can you boot an instance from nova directly? | 18:50 |
markguz_ | before setting the affinity filters i was. I'll check if it still works now | 18:51 |
markguz_ | flwang1: nope. seems broken now | 18:53 |
flwang1 | can you pls check the nova-scheduler log? | 18:54 |
flwang1 | it will explain why there is 0 valid host | 18:55 |
markguz_ | oh wait. i think i see why it's b0rked. placement api is b0rked | 18:57 |
flwang1 | ah | 18:58 |
flwang1 | try restart placement api? | 18:59 |
flwang1 | and check its log before restart | 18:59 |
markguz_ | flwang1: because I was pip installing things i b0rked the oslo.db version ... should have used virtualenvs.. | 19:06 |
markguz_ | anyway. fixed it | 19:06 |
markguz_ | trying again | 19:06 |
flwang1 | i hope it's just a dev env....... | 19:07 |
*** ianychoi_ has joined #openstack-containers | 19:15 | |
markguz_ | flwang1: nope, it's live. but it's not for paying customers, it's a private stack for a bunch of developers | 19:16 |
markguz_ | flwang1: so they can stand a little disruption | 19:16 |
flwang1 | markguz_: i mean at least for the one you're changing/playing, it SHOULD be a testing/dev env, instead of your 'prod' | 19:17 |
*** pcaruana has joined #openstack-containers | 19:17 | |
markguz_ | flwang1: i don't have one. no resources for it. | 19:17 |
*** ianychoi has quit IRC | 19:18 | |
flwang1 | ah, fair enough | 19:21 |
flwang1 | any progress? | 19:21 |
markguz_ | yeah. it creates the master | 19:22 |
markguz_ | but fails on the first minion | 19:22 |
markguz_ | flwang1: no valid host when trying to create minion | 19:24 |
flwang1 | but master created? | 19:25 |
markguz_ | yups | 19:25 |
flwang1 | how many computes you have? | 19:25 |
markguz_ | about 25 | 19:25 |
flwang1 | you probably need to check scheduler log | 19:25 |
markguz_ | yeah | 19:25 |
flwang1 | to see why the minion one failed | 19:26 |
flwang1 | at least, we're making progress | 19:26 |
markguz_ | yeah. I'll debug that later. need to do some other non openstack things now | 19:26 |
flwang1 | i'm going to take breakfast and driving to office | 19:26 |
flwang1 | you can reach me after 1.5 hour if you want | 19:26 |
flwang1 | good luck | 19:27 |
markguz_ | flwang1: sure thanks for your help. Seriously. you've been awesome. | 19:28 |
markguz_ | flwang1: also fyi. THe master booted with the fedora-atomic-27 image. so i guess it was something to do with the pike version not liking it | 19:31 |
flwang1 | markguz_: you're welcome, thanks for the feedback for magnum | 19:32 |
flwang1 | for pike, we recommend f26 | 19:32 |
*** pcaruana has quit IRC | 19:45 | |
*** flwang1 has quit IRC | 19:51 | |
*** jmlowe has joined #openstack-containers | 20:02 | |
*** flwang1 has joined #openstack-containers | 21:11 | |
*** markguz has joined #openstack-containers | 21:30 | |
*** markguz has quit IRC | 21:34 | |
*** jmlowe has quit IRC | 21:43 | |
markguz_ | flwang1: it's all working now. Deployed a working 2 node 1 master k8s cluster with Fed Atomic 27. works great! | 21:44 |
markguz_ | flwang1: thanks again | 21:44 |
*** itlinux has quit IRC | 21:47 | |
*** markguz_ is now known as markguz | 21:51 | |
*** rcernin has joined #openstack-containers | 22:19 | |
flwang1 | markguz: no problem | 22:20 |
*** itlinux has joined #openstack-containers | 22:41 | |
*** hongbin has quit IRC | 23:00 | |
*** itlinux has quit IRC | 23:16 | |
*** itlinux has joined #openstack-containers | 23:43 | |
*** itlinux has quit IRC | 23:52 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!