| openstackgerrit | Feilong Wang proposed openstack/magnum master: Add health_status and health_status_reason to cluster https://review.openstack.org/570818 | 00:05 |
|---|---|---|
| *** ricolin has joined #openstack-containers | 00:08 | |
| *** gsimondon has quit IRC | 00:26 | |
| *** gyankum has joined #openstack-containers | 01:17 | |
| *** Nel1x has joined #openstack-containers | 01:31 | |
| *** dardelean has joined #openstack-containers | 01:34 | |
| *** dardelean has quit IRC | 01:39 | |
| openstackgerrit | Feilong Wang proposed openstack/magnum master: Add health_status and health_status_reason to cluster https://review.openstack.org/570818 | 01:42 |
| *** hongbin has joined #openstack-containers | 02:02 | |
| *** yamamoto has quit IRC | 02:04 | |
| *** yamamoto has joined #openstack-containers | 02:04 | |
| *** threestrands has quit IRC | 02:05 | |
| *** threestrands_ has joined #openstack-containers | 02:05 | |
| *** yankcrime has quit IRC | 02:07 | |
| *** _nick has joined #openstack-containers | 02:08 | |
| *** ramishra has joined #openstack-containers | 02:31 | |
| *** zhubingbing has joined #openstack-containers | 02:31 | |
| *** zhubingbing has quit IRC | 02:36 | |
| *** jhesketh has quit IRC | 02:37 | |
| *** jhesketh has joined #openstack-containers | 02:37 | |
| *** raginbajin has quit IRC | 02:40 | |
| *** raginbajin has joined #openstack-containers | 02:40 | |
| *** yolanda_ has quit IRC | 02:41 | |
| *** mkrai has quit IRC | 02:42 | |
| *** yolanda_ has joined #openstack-containers | 02:42 | |
| *** yasemin has quit IRC | 02:44 | |
| *** flwang1 has quit IRC | 02:44 | |
| *** lxkong has quit IRC | 02:44 | |
| *** jmlowe_ has quit IRC | 02:44 | |
| *** spsurya has quit IRC | 02:44 | |
| *** ArchiFleKs has quit IRC | 02:44 | |
| *** portdirect has quit IRC | 02:44 | |
| *** flwang1 has joined #openstack-containers | 02:45 | |
| *** lxkong has joined #openstack-containers | 02:45 | |
| *** jmlowe_ has joined #openstack-containers | 02:45 | |
| *** spsurya has joined #openstack-containers | 02:45 | |
| *** ArchiFleKs has joined #openstack-containers | 02:45 | |
| *** portdirect has joined #openstack-containers | 02:45 | |
| *** yasemin has joined #openstack-containers | 02:45 | |
| *** gyankum has quit IRC | 02:46 | |
| *** slunkad has quit IRC | 02:46 | |
| *** andreykurilin has quit IRC | 02:46 | |
| *** yamamoto has quit IRC | 02:46 | |
| *** rcernin has quit IRC | 02:46 | |
| *** openstackgerrit has quit IRC | 02:46 | |
| *** thomasem has quit IRC | 02:46 | |
| *** kgz has quit IRC | 02:46 | |
| *** gyankum has joined #openstack-containers | 02:47 | |
| *** slunkad has joined #openstack-containers | 02:47 | |
| *** andreykurilin has joined #openstack-containers | 02:47 | |
| *** yamamoto has joined #openstack-containers | 02:48 | |
| *** rcernin has joined #openstack-containers | 02:48 | |
| *** openstackgerrit has joined #openstack-containers | 02:48 | |
| *** thomasem has joined #openstack-containers | 02:48 | |
| *** kgz has joined #openstack-containers | 02:48 | |
| *** freerunner has quit IRC | 02:50 | |
| *** olivierbourdon38 has quit IRC | 02:50 | |
| *** tobberydberg has quit IRC | 02:50 | |
| *** isssp has quit IRC | 02:50 | |
| *** Miouge has quit IRC | 02:50 | |
| *** hongbin has quit IRC | 02:50 | |
| *** kaiokmo has quit IRC | 02:50 | |
| *** kbyrne has quit IRC | 02:50 | |
| *** parasitid has quit IRC | 02:50 | |
| *** flwang has quit IRC | 02:50 | |
| *** threestrands_ has quit IRC | 02:50 | |
| *** ianychoi_ has quit IRC | 02:50 | |
| *** strigazi has quit IRC | 02:50 | |
| *** sgordon has quit IRC | 02:50 | |
| *** brtknr has quit IRC | 02:50 | |
| *** aspiers has quit IRC | 02:50 | |
| *** freerunner has joined #openstack-containers | 02:50 | |
| *** olivierbourdon38 has joined #openstack-containers | 02:50 | |
| *** tobberydberg has joined #openstack-containers | 02:50 | |
| *** isssp has joined #openstack-containers | 02:50 | |
| *** Miouge has joined #openstack-containers | 02:50 | |
| *** hongbin has joined #openstack-containers | 02:51 | |
| *** kaiokmo has joined #openstack-containers | 02:51 | |
| *** kbyrne has joined #openstack-containers | 02:51 | |
| *** parasitid has joined #openstack-containers | 02:51 | |
| *** flwang has joined #openstack-containers | 02:51 | |
| *** threestrands_ has joined #openstack-containers | 02:51 | |
| *** ianychoi_ has joined #openstack-containers | 02:51 | |
| *** strigazi has joined #openstack-containers | 02:51 | |
| *** sgordon has joined #openstack-containers | 02:51 | |
| *** brtknr has joined #openstack-containers | 02:51 | |
| *** aspiers has joined #openstack-containers | 02:51 | |
| *** Nel1x has quit IRC | 02:59 | |
| *** mdnadeem has quit IRC | 03:16 | |
| *** mkrai has joined #openstack-containers | 03:18 | |
| *** lpetrut has joined #openstack-containers | 03:40 | |
| *** ykarel|away has joined #openstack-containers | 03:46 | |
| *** hongbin has quit IRC | 03:50 | |
| *** mdnadeem has joined #openstack-containers | 04:08 | |
| *** ykarel|away is now known as ykarel | 04:18 | |
| *** lpetrut has quit IRC | 04:20 | |
| openstackgerrit | Feilong Wang proposed openstack/magnum master: (WIP) Support cluster-level logging with FEK https://review.openstack.org/570709 | 04:21 |
| *** udesale has joined #openstack-containers | 04:26 | |
| *** pcichy has joined #openstack-containers | 04:27 | |
| *** ykarel has quit IRC | 04:31 | |
| openstackgerrit | Feilong Wang proposed openstack/magnum master: (WIP) Support cluster-level logging with FEK https://review.openstack.org/570709 | 04:31 |
| flwang | magnum gate is failing because of cmd2 needs py3.4+, here is the fix in requirements https://review.openstack.org/#/c/570811/ just FYI | 04:44 |
| flwang | strigazi: ^ | 04:44 |
| *** ykarel has joined #openstack-containers | 04:46 | |
| *** janki has joined #openstack-containers | 04:49 | |
| *** flwang1 has quit IRC | 04:55 | |
| *** fragatina has joined #openstack-containers | 04:56 | |
| *** masber has quit IRC | 05:08 | |
| *** masber has joined #openstack-containers | 05:29 | |
| *** chhagarw has joined #openstack-containers | 05:29 | |
| *** yolanda has joined #openstack-containers | 05:33 | |
| *** fragatina has quit IRC | 05:33 | |
| *** yolanda_ has quit IRC | 05:35 | |
| *** fragatina has joined #openstack-containers | 05:39 | |
| *** fragatina has quit IRC | 05:49 | |
| *** mjura has joined #openstack-containers | 05:51 | |
| *** ramishra has quit IRC | 05:55 | |
| *** iranzo has joined #openstack-containers | 06:01 | |
| *** pengdake_ has joined #openstack-containers | 06:02 | |
| *** ramishra has joined #openstack-containers | 06:08 | |
| *** sfilatov has joined #openstack-containers | 06:12 | |
| *** masuberu has joined #openstack-containers | 06:27 | |
| *** masber has quit IRC | 06:29 | |
| *** gsimondon has joined #openstack-containers | 06:34 | |
| *** pcaruana has joined #openstack-containers | 06:38 | |
| *** armaan has joined #openstack-containers | 06:38 | |
| *** pengdake_ has quit IRC | 06:41 | |
| *** ramishra has quit IRC | 06:46 | |
| *** ramishra has joined #openstack-containers | 06:49 | |
| *** gsimondo1 has joined #openstack-containers | 06:56 | |
| *** gsimondon has quit IRC | 06:59 | |
| *** dardelean has joined #openstack-containers | 07:02 | |
| *** lpetrut has joined #openstack-containers | 07:03 | |
| *** pengdake_ has joined #openstack-containers | 07:11 | |
| *** armaan has quit IRC | 07:14 | |
| *** threestrands_ has quit IRC | 07:14 | |
| *** belmoreira has joined #openstack-containers | 07:15 | |
| *** janki has quit IRC | 07:19 | |
| *** dardelean has quit IRC | 07:22 | |
| *** armaan has joined #openstack-containers | 07:37 | |
| *** janki has joined #openstack-containers | 07:38 | |
| *** ykarel is now known as ykarel|lunch | 07:40 | |
| *** ktibi has joined #openstack-containers | 07:40 | |
| *** belmoreira has quit IRC | 07:42 | |
| *** rcernin has quit IRC | 07:42 | |
| *** AlexeyAbashkin has joined #openstack-containers | 07:46 | |
| *** belmoreira has joined #openstack-containers | 07:54 | |
| *** mikal_ has joined #openstack-containers | 07:58 | |
| *** mikal has quit IRC | 08:00 | |
| *** yolanda has quit IRC | 08:01 | |
| *** mgoddard has joined #openstack-containers | 08:03 | |
| *** belmoreira has quit IRC | 08:07 | |
| *** belmoreira has joined #openstack-containers | 08:08 | |
| *** serlex has joined #openstack-containers | 08:09 | |
| *** mago__ has quit IRC | 08:14 | |
| *** dardelean has joined #openstack-containers | 08:17 | |
| *** yolanda has joined #openstack-containers | 08:17 | |
| *** ykarel|lunch is now known as ykarel | 08:35 | |
| *** mago_ has joined #openstack-containers | 08:39 | |
| *** mago__ has joined #openstack-containers | 08:39 | |
| *** mago__ has quit IRC | 08:39 | |
| *** ramishra has quit IRC | 08:40 | |
| *** ianychoi_ is now known as ianychoi | 08:40 | |
| strigazi | flwang: do we have do smth in magnum side? | 08:40 |
| ricolin | strigazi, FYI I think you already knows this, Blizzard use Magnum | 08:41 |
| strigazi | ricolin: yes, rochapor1o told me :) | 08:44 |
| *** ramishra has joined #openstack-containers | 08:47 | |
| ricolin | strigazi, super! | 08:52 |
| ricolin | they're finding ways to help upstream | 08:53 |
| *** rcernin has joined #openstack-containers | 08:58 | |
| *** salmankhan has joined #openstack-containers | 09:02 | |
| *** belmoreira has quit IRC | 09:03 | |
| *** ricolin has quit IRC | 09:04 | |
| *** belmoreira has joined #openstack-containers | 09:10 | |
| *** ramishra has quit IRC | 09:12 | |
| *** ramishra has joined #openstack-containers | 09:19 | |
| *** pengdake_ has quit IRC | 09:22 | |
| *** armaan has quit IRC | 09:23 | |
| *** pcaruana has quit IRC | 09:23 | |
| *** dardelean has quit IRC | 09:25 | |
| *** dardelean has joined #openstack-containers | 09:25 | |
| *** pcaruana has joined #openstack-containers | 09:27 | |
| *** _nick is now known as yankcrime | 09:35 | |
| *** armaan has joined #openstack-containers | 09:35 | |
| *** flwang1 has joined #openstack-containers | 09:35 | |
| *** zhubingbing has joined #openstack-containers | 09:37 | |
| *** dardelean has quit IRC | 09:39 | |
| *** dardelean has joined #openstack-containers | 09:39 | |
| flwang1 | strigazi: around? | 09:40 |
| strigazi | flwang1: yes | 09:40 |
| flwang1 | strigazi: cool | 09:40 |
| flwang1 | strigazi: need your opinion at here https://review.openstack.org/#/c/561783/7/magnum/drivers/common/templates/kubernetes/fragments/configure-kubernetes-master.sh@25 | 09:42 |
| *** sfilatov has quit IRC | 09:42 | |
| *** zhubingbing has quit IRC | 09:42 | |
| flwang1 | strigazi: now i'm "hardcode" the roles list, we can pass in by lables, but it will need more labels, and i'm not sure which is the better way | 09:43 |
| *** dardelean has quit IRC | 09:44 | |
| strigazi | flwang1: may we discuss it in the meeting? | 09:45 |
| *** sfilatov has joined #openstack-containers | 09:45 | |
| flwang1 | strigazi: yep, sure, im happy with that | 09:45 |
| strigazi | in 14 mins :) | 09:45 |
| flwang1 | no problem | 09:45 |
| *** pcaruana has quit IRC | 09:54 | |
| *** ricolin has joined #openstack-containers | 09:59 | |
| strigazi | #startmeeting containers | 10:00 |
| openstack | Meeting started Tue May 29 10:00:08 2018 UTC and is due to finish in 60 minutes. The chair is strigazi. Information about MeetBot at http://wiki.debian.org/MeetBot. | 10:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 10:00 |
| *** openstack changes topic to " (Meeting topic: containers)" | 10:00 | |
| openstack | The meeting name has been set to 'containers' | 10:00 |
| strigazi | #topic Roll Call | 10:00 |
| *** openstack changes topic to "Roll Call (Meeting topic: containers)" | 10:00 | |
| flwang1 | o/ | 10:00 |
| ricolin | O/ | 10:01 |
| strigazi | Hello flwang1 and ricolin | 10:02 |
| strigazi | #topic Announcements | 10:02 |
| *** openstack changes topic to "Announcements (Meeting topic: containers)" | 10:02 | |
| strigazi | I'll do a magnumclient release this week for queens, to include a fix for the quota cmd | 10:03 |
| strigazi | #link http://git.openstack.org/cgit/openstack/python-magnumclient/commit/?h=stable/queens&id=40327b75edcab608e9c9d9ac0993855de088926b | 10:03 |
| strigazi | #topic Blueprints/Bugs/Ideas | 10:04 |
| *** openstack changes topic to "Blueprints/Bugs/Ideas (Meeting topic: containers)" | 10:04 | |
| strigazi | From my side, I'm finishing the patch for the enable_cloud_provider label | 10:04 |
| strigazi | I'm also testing the move to fedora 28, seems ok, I'm running the conformance tests | 10:05 |
| brtknr | Hi all | 10:06 |
| strigazi | Finally, I have a patch for the make cert files to do less api call, use the same token and fetch the ca once. here: | 10:07 |
| strigazi | https://github.com/openstack/magnum/blob/master/magnum/drivers/common/templates/kubernetes/fragments/make-cert-client.sh#L43 | 10:07 |
| strigazi | hi brtknr | 10:07 |
| *** vabada has joined #openstack-containers | 10:07 | |
| strigazi | And one more thing that I need input from ricolin and all | 10:08 |
| strigazi | Will we gain anything if we consolidate the software deployment and software configs? | 10:08 |
| *** ricolin has quit IRC | 10:08 | |
| strigazi | I mean if we gain anything in db size and requests | 10:08 |
| strigazi | @all fyi, the templates create a lot resources in heat which loads quite bit the heat db | 10:09 |
| flwang1 | any performance issue on heat side? | 10:09 |
| *** rcernin has quit IRC | 10:10 | |
| *** yamamoto has quit IRC | 10:10 | |
| *** pcaruana has joined #openstack-containers | 10:10 | |
| strigazi | flwang1: yes, in our deployement we create a lot of connection to the db and requires some tuning on db config | 10:11 |
| flwang1 | strigazi: i mean are you aware of any performance issue on heat | 10:11 |
| *** gyankum has quit IRC | 10:11 | |
| strigazi | the problem goes away if heat is configured properly (I mean the error when talkin to the db) | 10:11 |
| strigazi | but I was wondering if we can reduce the load | 10:11 |
| brtknr | Do you mean by reducing the number of objects that heat is responsible for handling? | 10:12 |
| strigazi | brtknr yes | 10:13 |
| flwang1 | strigazi: we can do that | 10:13 |
| strigazi | I just wanted some input from heat team, do be sure that we gain something in performance | 10:14 |
| strigazi | we can always have a look at the code though :) | 10:14 |
| strigazi | Anyway, I'll have a look | 10:15 |
| flwang1 | cool | 10:15 |
| strigazi | flwang1: do you want to go next? | 10:15 |
| flwang1 | strigazi: ok | 10:15 |
| flwang1 | i have propose a patch for k8s keystone auth integration | 10:15 |
| brtknr | On one of my current deployments with 1 master, 3 nodes, I have 139 objets | 10:16 |
| flwang1 | it works but need some input from you folks | 10:16 |
| brtknr | at nested depth 4 | 10:16 |
| *** sfilatov has quit IRC | 10:16 | |
| flwang1 | i will talk more about this later | 10:16 |
| *** ktibi has quit IRC | 10:16 | |
| flwang1 | and i also proposed a patch to support cluster-level logging with FEK | 10:16 |
| *** ktibi_ has joined #openstack-containers | 10:16 | |
| flwang1 | logging is the only important addons we're missing for k8s | 10:17 |
| strigazi | flwang1 Could we have a parameter to point to an external ES? | 10:17 |
| strigazi | flwang1: or both | 10:17 |
| flwang1 | strigazi: could be | 10:17 |
| flwang1 | we can add it later? or you want to do it in current patch? | 10:17 |
| strigazi | flwang1: if the change is not big, could we do in this patch? | 10:18 |
| flwang1 | strigazi: but the hard part is how to save those certs/credentials from fluentd to ES | 10:18 |
| flwang1 | strigazi: i don't know, i need to take a look to get back to you | 10:18 |
| strigazi | flwang1: can we make the policy a configmap? | 10:19 |
| strigazi | no we can't | 10:19 |
| flwang1 | you mean the policy of k8s keystone auth? | 10:19 |
| strigazi | it is not a pod | 10:19 |
| flwang1 | no, we can't | 10:19 |
| *** mdnadeem has quit IRC | 10:19 | |
| flwang1 | unless we want to put it into master's kubelet | 10:19 |
| *** belmoreira has quit IRC | 10:20 | |
| flwang1 | but i don't want to go for that way, that's one of the problems | 10:20 |
| *** sfilatov has joined #openstack-containers | 10:20 | |
| strigazi | Does this policy need to change frequently? | 10:21 |
| *** ramishra has quit IRC | 10:22 | |
| flwang1 | strigazi: you know, like the policy.json in openstack world | 10:22 |
| strigazi | I mean, it need to change if we give access to more projects? | 10:22 |
| flwang1 | it shouldn't be based on my understanding | 10:22 |
| flwang1 | strigazi: hmm... for that case, maybe | 10:23 |
| *** jmlowe_ has quit IRC | 10:23 | |
| strigazi | So if project A has a cluster and owns the cluster. Can the admin give read access to project B? | 10:23 |
| *** jmlowe has joined #openstack-containers | 10:23 | |
| *** ramishra has joined #openstack-containers | 10:23 | |
| flwang1 | strigazi: TBH, i haven't tested this, but technically yes | 10:24 |
| flwang1 | however, my current patch doesn't support that | 10:24 |
| flwang1 | currently, the project id is injected siliently | 10:24 |
| strigazi | ok, I'll test it | 10:25 |
| strigazi | flwang1: I think giving access to more project in running clusters is a plus, what do you think? | 10:26 |
| flwang1 | strigazi: it could be useful for private cloud | 10:27 |
| flwang1 | not public cloud ;) | 10:27 |
| flwang1 | we can discuss more details offline | 10:28 |
| strigazi | ok | 10:28 |
| strigazi | thanks | 10:28 |
| flwang1 | another thing i'm working on is the cluster monitoring | 10:28 |
| flwang1 | i have proposed a patch to add health_status and health_status_reason | 10:28 |
| flwang1 | for next step, i need to know current status of the eventlet issue | 10:29 |
| strigazi | flwang1: I think it will take too long to fix | 10:29 |
| strigazi | flwang1: we should just use python requests IMO | 10:29 |
| flwang1 | strigazi: can we just add a very think wrapper to use requests | 10:30 |
| strigazi | maybe it works in python3, but it is not good enough | 10:30 |
| flwang1 | and switch back when it's fixed | 10:30 |
| strigazi | flwang1: sounds good given the situation with eventlet, the problem in magnum is fixed but breaks elsewhere | 10:30 |
| flwang1 | strigazi: ok, i will try to make a wrapper | 10:31 |
| strigazi | so we can't bump o/r/g-r | 10:31 |
| strigazi | flwang1: node status should be enough to start with | 10:32 |
| flwang1 | or just replace k8s client with requests | 10:32 |
| flwang1 | strigazi: yep | 10:32 |
| flwang1 | i'm using json dict for the health_status_reason, so we should be able to express more | 10:33 |
| strigazi | flwang1 +1 | 10:33 |
| strigazi | flwang1: it could be the dict returned by k8s api? | 10:34 |
| strigazi | hmm, maybe it will limit us in the future | 10:34 |
| flwang1 | strigazi: i prefer to do some re-formating | 10:34 |
| flwang1 | instead of using the resp from k8s api | 10:34 |
| flwang1 | to make sure we have some flexible space | 10:35 |
| strigazi | flwang1: fyi https://github.com/kubernetes/kubernetes/tree/master/cluster/addons/node-problem-detector | 10:35 |
| flwang1 | that's on my list | 10:35 |
| strigazi | cool | 10:36 |
| flwang1 | that's all from my side | 10:37 |
| flwang1 | lot of things to do | 10:37 |
| strigazi | Cool, I looked into one more thing | 10:37 |
| strigazi | multimaster without octavia lbaas | 10:38 |
| strigazi | it can be done if we habe a reverse proxy in the nodes. kubespray does this | 10:38 |
| *** yolanda has quit IRC | 10:38 | |
| strigazi | the only caveat is that if the masters change we need to update the nodes | 10:39 |
| strigazi | thoughts? | 10:39 |
| flwang1 | what do you mean update the nodes? updates the master ip address in nodes? | 10:39 |
| strigazi | yes, update the master ip(s) | 10:40 |
| strigazi | at the moment, we don't support change of the masters anyway, but if we do in the future it is doable | 10:41 |
| flwang1 | that's doable | 10:41 |
| *** yolanda has joined #openstack-containers | 10:42 | |
| strigazi | ok then, I'll have a look | 10:42 |
| strigazi | brtknr: do you want to discuss something? | 10:43 |
| strigazi | brtknr: I have something for you actually | 10:43 |
| strigazi | brtknr: Do you want to push a patch to be able to chose the cgroup-driver? | 10:43 |
| strigazi | systemd/cgroupfs | 10:44 |
| brtknr | I wanted to see where this conversation was going, plus maybe ask question about the blueprint i submitted | 10:44 |
| brtknr | I can push that patch :) | 10:45 |
| strigazi | brtknr: thanks | 10:45 |
| strigazi | brtknr: which bp? | 10:45 |
| brtknr | strigazi: Blueprint re attaching multiple networks to magnum cluster | 10:45 |
| brtknr | which we are currently doing manually via nova | 10:45 |
| brtknr | after cluster creation | 10:46 |
| strigazi | brtknr: do you have a mock patch for this, how to do it in heat? | 10:46 |
| strigazi | brtknr: multiple private? | 10:46 |
| brtknr | yes | 10:46 |
| brtknr | I dont have a mock patch yet but wondering if this is something blueprint-worthy/whether other people also have the same problem | 10:47 |
| strigazi | brtknr: you want to be able to do it in cluster creation only or change it after as well? | 10:47 |
| flwang1 | brtknr: does that mean something like 1 network for master and 1 for nodes? | 10:47 |
| strigazi | brtknr: It sounds like a fearure to me :) | 10:47 |
| strigazi | flwang1: many private networks for all nodes | 10:48 |
| flwang1 | strigazi: wow | 10:48 |
| flwang1 | that's not a small change i think | 10:48 |
| strigazi | it isn't | 10:48 |
| brtknr | No, e.g. attach infiniband, ethernet both to masters and nodes | 10:48 |
| strigazi | No to what? | 10:49 |
| brtknr | No to 1 network for master, 1 for node | 10:49 |
| *** belmoreira has joined #openstack-containers | 10:49 | |
| brtknr | although that is an interesting proposition | 10:49 |
| strigazi | brtknr: well flwang1 is interested more in master in project and minions in the other | 10:50 |
| strigazi | we as well, but this is even harder | 10:50 |
| *** dardelean has joined #openstack-containers | 10:50 | |
| strigazi | the above logic can be usefull though | 10:50 |
| brtknr | hmm yes, similar to invisible control plane that they have on gcloud? | 10:50 |
| strigazi | yes | 10:50 |
| flwang1 | yes | 10:51 |
| *** sfilatov has quit IRC | 10:51 | |
| strigazi | I like to call it not accountable :) | 10:51 |
| flwang1 | I would like to call it invisible masters :) | 10:51 |
| *** dardelean has quit IRC | 10:51 | |
| strigazi | we can have a router that is owned by the ops team | 10:52 |
| *** dardelean has joined #openstack-containers | 10:52 | |
| strigazi | and a router for the client | 10:52 |
| brtknr | openstack coe cluster create --invisible-master? | 10:52 |
| strigazi | is it like this in GKE? | 10:54 |
| flwang1 | brtknr: no, it could be a default action configured by ops | 10:54 |
| flwang1 | strigazi: no, in GKE, it's the default behaviour | 10:54 |
| strigazi | we can offer both | 10:55 |
| flwang1 | strigazi: sure | 10:55 |
| brtknr | For the multiple networks, the syntax would look something like `openstack cluster create k8s-cluster --fixed-network network1 network2 network3 | 10:55 |
| flwang1 | i'd like to pick this up in S cycle | 10:55 |
| strigazi | advanced user might want to access the master nodes, it is their cluster anyway | 10:55 |
| brtknr | I am not sure how subnets would be handled | 10:55 |
| strigazi | Maybe they want to access the etcd db | 10:55 |
| strigazi | brtknr: you can describe how you do it manually in the bp | 10:57 |
| flwang1 | we're running out of time | 10:57 |
| brtknr | Ok will do | 10:57 |
| strigazi | thanks | 10:57 |
| strigazi | let's continue offline | 10:57 |
| strigazi | thanks for joining the meeting brtknr and flwang1 | 10:58 |
| brtknr | Back to the other point, where would systemd/cgroupfs option be defined? At cluster creation? | 10:58 |
| flwang1 | strigazi: thank you | 10:58 |
| strigazi | brtknr: it would a label | 10:58 |
| strigazi | we can continue in the channel | 10:59 |
| strigazi | #endmeeting | 10:59 |
| brtknr | okay makes sense | 10:59 |
| *** openstack changes topic to "OpenStack Containers Team" | 10:59 | |
| openstack | Meeting ended Tue May 29 10:59:16 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 10:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-29-10.00.html | 10:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-29-10.00.txt | 10:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/containers/2018/containers.2018-05-29-10.00.log.html | 10:59 |
| *** dardelean has quit IRC | 10:59 | |
| brtknr | I have just got a devstack env setup to start developing magnum | 11:00 |
| flwang1 | strigazi: anything else you want to discuss? | 11:00 |
| flwang1 | i'm gonna offline | 11:00 |
| brtknr | Currently testing a patch by mgoddard to enable cluster creation with floating ip disabled for k8s and docker swarm | 11:01 |
| brtknr | After that I can work on the driver patch | 11:02 |
| *** sfilatov has joined #openstack-containers | 11:03 | |
| strigazi | brtknr: cool, let me know if you need anything | 11:05 |
| strigazi | brtknr: I'm out for lunch, I'm in europe, so ping me | 11:06 |
| brtknr | Re cluster creation, looks like disable floating IP flag is being ignored at the moment | 11:06 |
| brtknr | strigazi: I am currently stuck because certs are not being copied over so etcd.service is failing to start | 11:07 |
| brtknr | Will continue to investigate... | 11:07 |
| brtknr | strigazi: Will do :) | 11:07 |
| *** yamamoto has joined #openstack-containers | 11:11 | |
| *** sfilatov has quit IRC | 11:14 | |
| *** yamamoto has quit IRC | 11:16 | |
| *** sfilatov has joined #openstack-containers | 11:18 | |
| *** gyankum has joined #openstack-containers | 11:24 | |
| *** udesale_ has joined #openstack-containers | 11:33 | |
| *** udesale has quit IRC | 11:34 | |
| *** dardelean has joined #openstack-containers | 11:36 | |
| *** yamamoto has joined #openstack-containers | 11:36 | |
| *** sfilatov has quit IRC | 11:37 | |
| *** udesale_ has quit IRC | 11:37 | |
| *** zhubingbing has joined #openstack-containers | 11:39 | |
| *** pcaruana has quit IRC | 11:42 | |
| *** zhubingbing has quit IRC | 11:43 | |
| *** yamamoto has quit IRC | 11:47 | |
| *** yamamoto has joined #openstack-containers | 11:48 | |
| *** fragatina has joined #openstack-containers | 11:59 | |
| *** sfilatov has joined #openstack-containers | 12:01 | |
| *** sfilatov has quit IRC | 12:01 | |
| *** sfilatov has joined #openstack-containers | 12:02 | |
| *** pcaruana has joined #openstack-containers | 12:02 | |
| *** sfilatov has quit IRC | 12:03 | |
| *** sfilatov has joined #openstack-containers | 12:06 | |
| strigazi | brtknr: what is the error? | 12:11 |
| *** udesale has joined #openstack-containers | 12:11 | |
| *** udesale has quit IRC | 12:17 | |
| brtknr | strigazi: Ah, so looks like the certs dont copy over | 12:20 |
| brtknr | strigazi: Certs for etcd | 12:20 |
| brtknr | strigazi: I'm working on this branch: https://github.com/stackhpc/magnum/tree/swarm-disable-floating-ip | 12:21 |
| strigazi | brtknr you can push it in gerrit as WIO | 12:21 |
| strigazi | brtknr you can push it in gerrit as WIP | 12:21 |
| *** Alexey_Abashkin has joined #openstack-containers | 12:33 | |
| *** udesale has joined #openstack-containers | 12:34 | |
| *** AlexeyAbashkin has quit IRC | 12:36 | |
| *** Alexey_Abashkin is now known as AlexeyAbashkin | 12:36 | |
| *** sfilatov has quit IRC | 12:37 | |
| *** belmoreira has quit IRC | 12:43 | |
| *** mgariepy has joined #openstack-containers | 12:49 | |
| *** sfilatov has joined #openstack-containers | 12:53 | |
| brtknr | http://paste.openstack.org/show/722255/ | 12:58 |
| strigazi | brtknr journalctl -u etcd --no-pager | 12:59 |
| openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/queens: Support disabling floating IPs in swarm mode clusters https://review.openstack.org/570937 | 13:01 |
| brtknr | output: http://paste.openstack.org/show/722257/ | 13:03 |
| strigazi | brtknr: etcdmain: open /etc/etcd/certs/server.crt: no such file or directory | 13:04 |
| strigazi | brtknr: cat /var/log/cloud-init-output.log | 13:05 |
| brtknr | Yes, I am trying to work out why the certs arent being copied over | 13:05 |
| strigazi | sh -x /var/lib/cloud/scripts/<something>-part005 | 13:06 |
| *** ykarel is now known as ykarel|away | 13:06 | |
| strigazi | brtknr NOTE: the output contains password | 13:07 |
| strigazi | passwords | 13:07 |
| *** fragatina has quit IRC | 13:08 | |
| *** ykarel|away has quit IRC | 13:10 | |
| brtknr | https://gist.github.com/848687b3324c7d5fa88593ff7e01f919 | 13:11 |
| *** fragatina has joined #openstack-containers | 13:11 | |
| brtknr | thats okay, this is a test dev environment | 13:11 |
| strigazi | brtknr: https://gist.github.com/brtknr/848687b3324c7d5fa88593ff7e01f919#file-cloud-init-output-log-L156 | 13:12 |
| strigazi | brtknr: is /var/lib/cloud/instance/scripts/part-011 the make-cert file | 13:12 |
| strigazi | ? | 13:12 |
| strigazi | I suspect connectivy from vms to OS apis | 13:13 |
| brtknr | hmm all the scripts folders are empty | 13:15 |
| brtknr | wait, i was checking the wrong place | 13:15 |
| brtknr | i cannot find part 005 | 13:16 |
| strigazi | part 11 ? | 13:17 |
| brtknr | i can see certs in /etc/kubernetes/certs | 13:17 |
| brtknr | but no /etc/etcd/certs | 13:17 |
| strigazi | fedora 27? | 13:17 |
| brtknr | yes fa27 | 13:17 |
| strigazi | good | 13:18 |
| brtknr | i ran part11 without any problems | 13:18 |
| strigazi | what is inside? | 13:19 |
| brtknr | inside part-011? | 13:19 |
| strigazi | yes | 13:20 |
| *** dave-mccowan has joined #openstack-containers | 13:21 | |
| brtknr | sh -x /var/lib/cloud/scripts/<something>-part005 | 13:22 |
| brtknr | oops | 13:23 |
| brtknr | https://gist.github.com/4c86384d794392ce47333af218ef774d | 13:23 |
| strigazi | brtknr part 11 runs without any errors? | 13:23 |
| brtknr | AFAICS | 13:24 |
| brtknr | sudo sh +x /var/lib/cloud/instance/scripts/part-011 | 13:24 |
| brtknr | % Total % Received % Xferd Average Speed Time Time Time Current | 13:24 |
| brtknr | Dload Upload Total Spent Left Speed | 13:24 |
| brtknr | 100 1407 100 1407 0 0 1407 0 0:00:01 0:00:01 --:--:-- 987 | 13:24 |
| brtknr | Generating RSA private key, 4096 bit long modulus | 13:24 |
| brtknr | ................................................................................................................................................................................................++ | 13:24 |
| brtknr | .......................++ | 13:24 |
| brtknr | e is 65537 (0x010001) | 13:24 |
| brtknr | Error Loading request extension section req_ext | 13:24 |
| brtknr | 139739154462528:error:2206D06D:X509 V3 routines:X509V3_parse_list:invalid null value:crypto/x509v3/v3_utl.c:299: | 13:24 |
| brtknr | 139739154462528:error:22097069:X509 V3 routines:do_ext_nconf:invalid extension string:crypto/x509v3/v3_conf.c:93:name=subjectAltName,section=IP:,IP:10.0.0.4,IP:127.0.0.1,IP:10.254.0.1,DNS:kubernetes,DNS:kubernetes.default,DNS:kubernetes.default.svc,DNS:kubernetes.default.svc.cluster.local | 13:24 |
| brtknr | 139739154462528:error:22098080:X509 V3 routines:X509V3_EXT_nconf:error in extension:crypto/x509v3/v3_conf.c:47:name=subjectAltName, value=IP:,IP:10.0.0.4,IP:127.0.0.1,IP:10.254.0.1,DNS:kubernetes,DNS:kubernetes.default,DNS:kubernetes.default.svc,DNS:kubernetes.default.svc.cluster.localy | 13:24 |
| brtknr | wait completely didnt see the error | 13:24 |
| brtknr | Error Loading request extension section req_ext | 13:25 |
| *** dave-mcc_ has joined #openstack-containers | 13:25 | |
| *** dave-mccowan has quit IRC | 13:26 | |
| brtknr | My /etc/kubernetes/certs/server.conf looks like this: http://paste.openstack.org/show/722261/ | 13:28 |
| brtknr | There is an IP missing | 13:28 |
| *** belmoreira has joined #openstack-containers | 13:28 | |
| strigazi | brtknr: interesting | 13:29 |
| strigazi | brtknr: it is this ip KUBE_NODE_PUBLIC_IP=$(curl -s http://169.254.169.254/latest/meta-data/public-ipv4) | 13:30 |
| strigazi | https://gist.github.com/brtknr/4c86384d794392ce47333af218ef774d#file-part-011-sh-L40 | 13:30 |
| brtknr | KUBE_NODE_IP=$(curl -s http://169.254.169.254/latest/meta-data/local-ipv4) | 13:33 |
| brtknr | strigazi: i didnt mean to paste that | 13:33 |
| brtknr | Yes, it comes back empty at the moment | 13:33 |
| *** zhubingbing has joined #openstack-containers | 13:35 | |
| *** ktibi_ is now known as ktibi | 13:38 | |
| *** yolanda_ has joined #openstack-containers | 13:40 | |
| *** yolanda has quit IRC | 13:42 | |
| strigazi | brtknr: this is it then | 13:46 |
| *** ykarel|away has joined #openstack-containers | 13:51 | |
| *** serlex has quit IRC | 13:54 | |
| *** dave-mcc_ has quit IRC | 13:54 | |
| *** ykarel|away is now known as ykarel | 13:55 | |
| *** dave-mccowan has joined #openstack-containers | 13:56 | |
| *** gsimondo1 has quit IRC | 13:57 | |
| *** mikal has joined #openstack-containers | 14:03 | |
| *** dardelean has quit IRC | 14:06 | |
| *** dardelean has joined #openstack-containers | 14:06 | |
| *** mikal_ has quit IRC | 14:07 | |
| *** dardelean has quit IRC | 14:11 | |
| *** dardelean has joined #openstack-containers | 14:13 | |
| brtknr | think i fixed it | 14:14 |
| *** sfilatov has quit IRC | 14:16 | |
| *** dave-mcc_ has joined #openstack-containers | 14:18 | |
| *** dave-mccowan has quit IRC | 14:21 | |
| openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/queens: Support disabling floating IPs in swarm mode https://review.openstack.org/570937 | 14:41 |
| *** hongbin has joined #openstack-containers | 14:42 | |
| *** mjura has quit IRC | 14:52 | |
| *** ykarel is now known as ykarel|away | 14:54 | |
| openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/queens: Support disabling floating IPs in swarm mode https://review.openstack.org/570937 | 15:01 |
| openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/queens: Support disabling floating IPs in swarm mode https://review.openstack.org/570937 | 15:04 |
| *** dardelean has quit IRC | 15:04 | |
| *** dardelean has joined #openstack-containers | 15:05 | |
| *** dardelean has quit IRC | 15:09 | |
| *** sfilatov has joined #openstack-containers | 15:10 | |
| *** dave-mcc_ is now known as dave-mccowan | 15:13 | |
| *** lpetrut has quit IRC | 15:15 | |
| openstackgerrit | Bharat Kunwar proposed openstack/magnum stable/queens: Support disabling floating IPs in swarm mode https://review.openstack.org/570937 | 15:26 |
| *** mago_ has quit IRC | 15:33 | |
| openstackgerrit | Piotr Mrowczynski proposed openstack/magnum master: Strip signed certificate https://review.openstack.org/570557 | 15:35 |
| *** belmoreira has quit IRC | 15:37 | |
| *** AlexeyAbashkin has quit IRC | 15:49 | |
| *** zhubingbing has quit IRC | 15:51 | |
| *** iranzo has quit IRC | 15:53 | |
| *** udesale_ has joined #openstack-containers | 15:54 | |
| brtknr | strigazi: I am getting dependency failure for docker that requires me to manually invoke systemctl daemon-reload inside the node, in order to start docker.service | 15:56 |
| *** udesale has quit IRC | 15:57 | |
| strigazi | docker-swarm? | 15:57 |
| brtknr | strigazi: No, k8s... | 15:57 |
| strigazi | brtknr: dependency on what? | 15:57 |
| brtknr | strigazi: Although, I imagine docker swarm is probably having a similar issue... will look at that after fixing k8s | 15:57 |
| strigazi | brtknr: what is the error? | 15:58 |
| brtknr | May 29 15:29:53 k8s-fa27-kbrrxuimp6kd-master-0.novalocal systemd[1]: Stopped Docker Application Container Engine. | 15:59 |
| brtknr | May 29 15:36:23 k8s-fa27-kbrrxuimp6kd-master-0.novalocal systemd[1]: Dependency failed for Docker Application Container Engine. | 15:59 |
| brtknr | May 29 15:36:23 k8s-fa27-kbrrxuimp6kd-master-0.novalocal systemd[1]: docker.service: Job docker.service/start failed with result 'dependency'.y | 15:59 |
| brtknr | So it worked after I did `sudo systemctl daemon-reload` | 16:00 |
| strigazi | are you using overlay2 ? | 16:00 |
| brtknr | But this is a manual process | 16:00 |
| brtknr | yes | 16:00 |
| strigazi | ok, but which dependency? | 16:00 |
| brtknr | I am not sure... | 16:06 |
| *** udesale__ has joined #openstack-containers | 16:07 | |
| brtknr | I will create a new cluster and re-examine, one sec | 16:07 |
| brtknr | nevermind, I think it worked this time... | 16:09 |
| brtknr | I have no clue as to why... it just did | 16:10 |
| *** udesale_ has quit IRC | 16:10 | |
| brtknr | Another issue is that I am creating a cluster with floating IP disabled on swarm-mode. I can see that heat has created the stack successfully. However magnum fails to register that this is the case | 16:11 |
| brtknr | This is a swarm-mode only issue, k8s is unaffected | 16:12 |
| *** faridda has joined #openstack-containers | 16:13 | |
| *** armaan has quit IRC | 16:14 | |
| faridda | hi guys, do you know what is the latest version of k8s supported by pike magnum ? | 16:14 |
| *** udesale__ has quit IRC | 16:14 | |
| strigazi | v1.7.7 | 16:15 |
| *** mgoddard has quit IRC | 16:15 | |
| faridda | cool thx | 16:15 |
| strigazi | v1.8.1 might work as well | 16:15 |
| strigazi | v1.9.x or 10 no | 16:15 |
| *** armaan has joined #openstack-containers | 16:16 | |
| faridda | ok, i will try 1.8.1 | 16:16 |
| strigazi | I strongly recommend to have magnum in queens, but you need to have a way to deploy mixed versions. eg different vm or containers | 16:18 |
| strigazi | magnum queens works with other openstack services in newton and onwards | 16:19 |
| *** pcichy has quit IRC | 16:21 | |
| faridda | i tried to deployed a queens version of magnum with a pike Openstack. But i had some issue between magnum and heat. I dont remember exactly but i can try again. I didn't know it was supported. | 16:22 |
| brtknr | strigazi: is non-empty node_addresses and master_addresses one of the conditions for a CREATE_COMPLETE status? | 16:25 |
| *** pcaruana has quit IRC | 16:39 | |
| *** ramishra has quit IRC | 16:43 | |
| *** lpetrut has joined #openstack-containers | 16:51 | |
| *** eandersson has quit IRC | 16:53 | |
| *** gsimondon has joined #openstack-containers | 16:56 | |
| *** sfilatov has quit IRC | 16:59 | |
| *** sfilatov has joined #openstack-containers | 17:00 | |
| *** sfilatov has quit IRC | 17:00 | |
| *** armaan has quit IRC | 17:06 | |
| *** salmankhan has quit IRC | 17:12 | |
| *** armaan has joined #openstack-containers | 17:15 | |
| *** armaan has quit IRC | 17:29 | |
| *** armaan has joined #openstack-containers | 17:30 | |
| *** pcichy has joined #openstack-containers | 17:39 | |
| *** pcaruana has joined #openstack-containers | 17:43 | |
| *** fragatina has quit IRC | 17:55 | |
| *** dardelean has joined #openstack-containers | 18:00 | |
| *** gyankum has quit IRC | 18:02 | |
| *** dardelean has quit IRC | 18:04 | |
| *** ktibi has quit IRC | 18:20 | |
| *** fragatina has joined #openstack-containers | 18:24 | |
| *** janki has quit IRC | 18:25 | |
| *** openstacking_123 has joined #openstack-containers | 18:27 | |
| *** openstacking_123 has quit IRC | 18:27 | |
| *** openstacking_123 has joined #openstack-containers | 18:28 | |
| *** pcaruana has quit IRC | 18:39 | |
| *** pcichy_ has joined #openstack-containers | 18:45 | |
| *** mikal_ has joined #openstack-containers | 18:48 | |
| *** lpetrut has quit IRC | 18:49 | |
| *** armaan_ has joined #openstack-containers | 18:50 | |
| *** kbyrne_ has joined #openstack-containers | 18:51 | |
| *** pcichy has quit IRC | 18:52 | |
| *** armaan has quit IRC | 18:52 | |
| *** mikal has quit IRC | 18:52 | |
| *** mgariepy has quit IRC | 18:52 | |
| *** kaiokmo has quit IRC | 18:52 | |
| *** kbyrne has quit IRC | 18:52 | |
| *** parasitid has quit IRC | 18:52 | |
| *** flwang has quit IRC | 18:53 | |
| *** pcichy_ is now known as pcichy | 18:53 | |
| *** kbyrne_ is now known as kbyrne | 18:53 | |
| *** kaiokmo has joined #openstack-containers | 19:00 | |
| *** flwang has joined #openstack-containers | 19:00 | |
| *** parasitid has joined #openstack-containers | 19:00 | |
| *** chhagarw has quit IRC | 19:00 | |
| *** armaan_ has quit IRC | 19:02 | |
| *** mgariepy has joined #openstack-containers | 19:02 | |
| *** armaan has joined #openstack-containers | 19:02 | |
| *** AlexeyAbashkin has joined #openstack-containers | 19:06 | |
| *** armaan has quit IRC | 19:08 | |
| *** AlexeyAbashkin has quit IRC | 19:10 | |
| *** AlexeyAbashkin has joined #openstack-containers | 19:11 | |
| *** dave-mccowan has quit IRC | 19:12 | |
| *** salmankhan has joined #openstack-containers | 19:16 | |
| *** salmankhan has quit IRC | 19:20 | |
| *** AlexeyAbashkin has quit IRC | 19:34 | |
| *** armaan has joined #openstack-containers | 19:39 | |
| openstackgerrit | Merged openstack/magnum master: k8s_fedora: Make CoreDNS config a SoftwareDeployment https://review.openstack.org/566533 | 19:40 |
| *** openstacking_123 has quit IRC | 19:48 | |
| *** harlowja has joined #openstack-containers | 20:00 | |
| *** openstacking_123 has joined #openstack-containers | 20:01 | |
| *** ykarel|away has quit IRC | 20:14 | |
| *** yasemin has quit IRC | 20:18 | |
| *** flwang1 has quit IRC | 20:19 | |
| *** yasemin has joined #openstack-containers | 20:20 | |
| *** AlexeyAbashkin has joined #openstack-containers | 20:20 | |
| *** AlexeyAbashkin has quit IRC | 20:25 | |
| *** pcichy has quit IRC | 20:27 | |
| *** pcichy has joined #openstack-containers | 20:28 | |
| *** pcichy has quit IRC | 20:32 | |
| *** jmlowe has quit IRC | 20:42 | |
| *** jmlowe has joined #openstack-containers | 20:44 | |
| *** dtruong_ has joined #openstack-containers | 20:47 | |
| *** gsimondon has quit IRC | 20:49 | |
| *** flwang1 has joined #openstack-containers | 21:19 | |
| *** faridda has quit IRC | 21:37 | |
| *** rcernin has joined #openstack-containers | 22:18 | |
| openstackgerrit | Lingxian Kong proposed openstack/magnum master: Use Octavia for LoadBalancer type service https://review.openstack.org/567173 | 22:34 |
| *** dardelea_ has joined #openstack-containers | 22:38 | |
| *** dardelea_ has quit IRC | 22:41 | |
| *** dardelea_ has joined #openstack-containers | 22:41 | |
| *** dardelea_ has quit IRC | 22:46 | |
| *** hongbin has quit IRC | 23:00 | |
| *** openstacking_123 has quit IRC | 23:02 | |
| *** dardelea_ has joined #openstack-containers | 23:10 | |
| *** cbrumm has joined #openstack-containers | 23:16 | |
| *** openstackstatus has joined #openstack-containers | 23:42 | |
| *** ChanServ sets mode: +v openstackstatus | 23:42 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!