Thursday, 2017-12-14

*** mnasiadka has quit IRC00:03
*** dardelean_ has quit IRC00:09
*** mnasiadka has joined #openstack-containers00:13
*** mnasiadka has quit IRC00:19
*** itlinux has quit IRC00:22
*** yuanying_ has joined #openstack-containers00:25
*** yuanying has quit IRC00:27
*** fragatina has quit IRC00:28
*** fragatina has joined #openstack-containers00:28
*** fragatin_ has joined #openstack-containers00:33
*** fragatina has quit IRC00:33
*** fragatin_ has quit IRC00:34
*** mnasiadka has joined #openstack-containers00:43
*** harlowja has quit IRC00:45
*** mnasiadka has quit IRC00:49
*** fragatina has joined #openstack-containers00:49
*** AlexeyAbashkin has joined #openstack-containers00:53
*** fragatina has quit IRC00:54
*** AlexeyAbashkin has quit IRC00:57
*** mnasiadka has joined #openstack-containers00:59
*** yuanying_ has quit IRC01:00
*** mnasiadka has quit IRC01:03
*** yuanying has joined #openstack-containers01:09
*** mnasiadka has joined #openstack-containers01:14
*** mnasiadka has quit IRC01:18
*** kiennt26 has joined #openstack-containers01:19
*** mnasiadka has joined #openstack-containers01:27
*** mnasiadka has quit IRC01:33
*** mnasiadka has joined #openstack-containers01:44
*** mnasiadka has quit IRC01:49
*** mnasiadka has joined #openstack-containers01:59
*** mnasiadka has quit IRC02:04
*** dardelean_ has joined #openstack-containers02:06
*** itlinux has joined #openstack-containers02:09
*** dardelean_ has quit IRC02:10
*** akhil has joined #openstack-containers02:10
*** mnasiadka has joined #openstack-containers02:14
*** mnasiadka has quit IRC02:19
*** absubram has quit IRC02:20
*** threestrands_ has joined #openstack-containers02:22
*** threestrands has quit IRC02:22
*** threestrands_ has quit IRC02:22
*** threestrands_ has joined #openstack-containers02:23
*** absubram has joined #openstack-containers02:26
*** daidv has quit IRC02:29
*** daidv has joined #openstack-containers02:29
*** absubram has quit IRC02:30
*** threestrands_ has quit IRC02:32
*** yuanying has quit IRC02:32
*** sahilsinha has quit IRC02:32
*** tobberydberg has quit IRC02:32
*** openstackstatus has quit IRC02:32
*** threestrands_ has joined #openstack-containers02:36
*** yuanying has joined #openstack-containers02:36
*** sahilsinha has joined #openstack-containers02:36
*** tobberydberg has joined #openstack-containers02:36
*** openstackstatus has joined #openstack-containers02:36
*** barjavel.freenode.net sets mode: +v openstackstatus02:36
shu-mutou-AWAYHi everyone, please let me know how to setup magnum for quota management (i.e. enable to run `magnum quota-*` commands).02:40
shu-mutou-AWAYIn my env, quota-* commands returned errors like "ERROR: Policy doesn't allow quota:get to be performed (HTTP 403)".02:41
*** shu-mutou-AWAY is now known as shu-mutou02:41
*** flwang1 has quit IRC02:42
*** flwang1 has joined #openstack-containers02:43
*** mnasiadka has joined #openstack-containers02:44
*** mnasiadka has quit IRC02:49
*** mnasiadka has joined #openstack-containers02:59
*** mnasiadka has quit IRC03:03
*** mnasiadka has joined #openstack-containers03:14
*** mnasiadka has quit IRC03:18
*** penick has quit IRC03:25
*** mnasiadka has joined #openstack-containers03:29
*** mnasiadka has quit IRC03:33
*** mnasiadka has joined #openstack-containers03:44
*** mnasiadka has quit IRC03:48
*** oikiki has quit IRC03:50
*** vijaykc4 has joined #openstack-containers03:51
*** vijaykc4 has quit IRC03:55
*** akhil has left #openstack-containers03:55
*** flwang1 has quit IRC03:55
*** mnasiadka has joined #openstack-containers03:59
*** ramishra has joined #openstack-containers03:59
*** ricolin has joined #openstack-containers04:00
*** mnasiadka has quit IRC04:04
*** mnasiadka has joined #openstack-containers04:14
*** yamamoto has joined #openstack-containers04:18
*** mnasiadka has quit IRC04:18
*** mnasiadka has joined #openstack-containers04:29
*** mnasiadka has quit IRC04:34
*** kiennt26 has quit IRC04:36
*** hieulq has quit IRC04:36
*** hieulq has joined #openstack-containers04:36
*** kiennt26 has joined #openstack-containers04:37
shu-mutouHi core reviewers! Please look https://review.openstack.org/#/c/496136/ and merge it.04:39
*** daidv has quit IRC04:40
*** daidv has joined #openstack-containers04:40
*** mnasiadka has joined #openstack-containers04:44
*** itlinux has quit IRC04:45
*** mnasiadka has quit IRC04:48
*** ykarel|travel has joined #openstack-containers04:49
*** mnasiadka has joined #openstack-containers04:59
*** ykarel|travel has quit IRC05:02
*** ykarel|travel has joined #openstack-containers05:03
*** mnasiadka has quit IRC05:04
*** ricolin has quit IRC05:10
*** vijaykc4 has joined #openstack-containers05:11
*** mnasiadka has joined #openstack-containers05:14
*** adisky__ has joined #openstack-containers05:18
*** mnasiadka has quit IRC05:19
*** mnasiadka has joined #openstack-containers05:29
*** mnasiadka has quit IRC05:34
*** vijaykc4 has quit IRC05:37
*** chhavi has joined #openstack-containers05:38
*** vijaykc4 has joined #openstack-containers05:40
*** mnasiadka has joined #openstack-containers05:44
*** janki has joined #openstack-containers05:48
*** penick has joined #openstack-containers05:49
*** mnasiadka has quit IRC05:49
*** penick_ has joined #openstack-containers05:53
*** penick has quit IRC05:54
*** mnasiadka has joined #openstack-containers05:55
openstackgerritShu Muto proposed openstack/magnum-ui master: Add attributes for cluster to show  https://review.openstack.org/52786006:05
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661806:08
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661806:18
ykarel|travelchandankumar, one correction ^^06:21
*** ykarel|travel is now known as ykarel06:21
*** lpetrut has joined #openstack-containers06:24
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661806:25
chandankumarykarel: ^^06:25
ykarelchandankumar, looks good, lets wait for the result06:25
openstackgerritShu Muto proposed openstack/magnum-ui master: Add attributes for cluster to show  https://review.openstack.org/52786006:26
*** vijaykc4 has quit IRC06:37
*** daidv has quit IRC06:41
*** daidv has joined #openstack-containers06:41
*** openstackgerrit has quit IRC06:47
*** mjura has joined #openstack-containers06:52
*** threestrands_ has quit IRC06:53
gokhangood morning ykarel, how are you ?06:56
gokhanykarel, I solved my issu with givin auth url manual on heat templates and adding -k option on some fragments and now swarm and kubernates cluster created06:57
*** openstackgerrit has joined #openstack-containers06:57
openstackgerritShu Muto proposed openstack/magnum-ui master: Add attributes for cluster to show  https://review.openstack.org/52786006:57
gokhanykarel, but on minion node kubelet is failed06:57
gokhanykarel, error is Error: failed to run Kubelet: could not init cloud provider "openstack": Post https://safircloud.b3lab.org:5000/v3/auth/tokens: x509: certificate signed by unknown authority06:58
ykarelflwang, For the issue you saw in kube-controller-manager, are you running magnum in devstack? if yes you might be affected by this issue: https://github.com/gophercloud/gophercloud/pull/423, i will check if this is fixed07:06
ykarelgokhan, hi07:06
ykarelgokhan, i think this is the same issue you stucked last time07:07
ykarelyou need cacert07:08
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661807:09
chandankumarykarel: ^ now it will work07:09
ykarelgokhan, /etc/kubernetes/kube_openstack_config in minion node, https://github.com/kubernetes/kubernetes/blob/a46153e2f988382535aaf27a5a90b13b6c10712b/pkg/cloudprovider/providers/openstack/openstack.go#L13507:10
gokhanykarel, ı am trying it now adding trustee_domain_id to magnum.conf. is it help ?07:11
gokhanykarel, do I create ca-cert is manually ?07:11
ykarelchandankumar, ack07:12
*** daidv has quit IRC07:14
gokhanbtw ykarel strigazi, I tested https://review.openstack.org/#/c/524151/ on pike and it works clearly :)07:14
ykarelgokhan, you can try with existing ca files07:14
*** daidv has joined #openstack-containers07:14
gokhanykarel, ok I am trying07:17
*** mnasiadka has quit IRC07:21
*** hieulq has quit IRC07:23
*** kiennt26 has quit IRC07:24
gokhanykarel, a new question on minion node I see /etc/ssl/certs/ca-bundle.crt and /etc/ssl/certs/ca-bundle.trust.crt.  can I use one of tem ?07:24
ykarelshu-mutou, from which user you were running quota-get commands?07:26
ykarelcurrent default policy for guota get is: https://github.com/openstack/magnum/blob/5e45e0f7164d4134e7e41febc8ccdb0cac70790e/magnum/common/policies/quota.py#L4507:27
ykarelgokhan, they might be for kubenetes api, you need ones for openstack-apis07:28
*** lpetrut has quit IRC07:28
ykarelgokhan, for contacting your openstack api's you must be using some cafile, you have to try with that07:28
shu-mutouykarel, I tried quotas-list from admin user on demo project.07:29
*** magicboiz has joined #openstack-containers07:29
ykarelshu-mutou, can you try with admin tenant also07:31
*** ricolin has joined #openstack-containers07:35
shu-mutouykarel, yes. I also have tried admin user on admin project.07:35
ykarelshu-mutou, same issue?07:35
shu-mutouykarel, yes. same as on demo project07:36
ykarelshu-mutou, ok, devstack?07:36
*** armaan has quit IRC07:36
*** armaan has joined #openstack-containers07:36
gokhanykarel, I use ssl on haproxy for openstack services like http://paste.openstack.org/show/628918/. so I think I need ca-cert on haproxy nodes ?07:36
shu-mutouykarel, yes. on devstack.07:36
ykarelshu-mutou, share your magnum.conf07:37
*** cweeks has quit IRC07:38
shu-mutouykarel, magnum.conf http://paste.openstack.org/show/628919/07:38
ykarelshu-mutou, now share: /etc/magnum/policy.yaml07:39
shu-mutouykarel, policy.yaml http://paste.openstack.org/show/628920/07:39
ykarelshu-mutou, quota is missing from policy.yaml, that's the issue07:40
ykarelshu-mutou, also it's json07:40
ykarelfrom where did you got that json file07:42
shu-mutouykarel, originally my policy.json has quota* params, but I have seen https://review.openstack.org/#/c/509365/ , I removed them.07:43
shu-mutouykarel, when use original policy.json that has quota* params, same problem occurred.07:44
ykarelshu-mutou, just remove /etc/magnum/policy.yaml and try again07:45
*** ykarel is now known as ykarel|lunch07:50
shu-mutouykarel, same problem occurred... and pasted api log into http://paste.openstack.org/show/628921/07:51
shu-mutouykarel, /etc/magnum/policy.yaml ???07:51
*** mnasiadka has joined #openstack-containers07:52
shu-mutouykarel, policy is to be yaml or to be json...07:53
ykarel|lunchshu-mutou, both should work07:54
ykarel|lunchlooks like a bug, api should be quotas:get_all, but from logs it is quota:get_all07:54
shu-mutouykarel, I ran `quota-list` command. sorry.07:55
ykarel|lunchshu-mutou, Ok try with correct command07:56
ykarel|lunchgokhan, i don't much about it, just check how you communicate with ssl backed keystone and use the same ca-file in /etc/kubernetes/kube_openstack_config on master node07:57
*** ricolin has quit IRC07:58
*** ricolin has joined #openstack-containers08:00
*** dpawar has joined #openstack-containers08:07
*** AlexeyAbashkin has joined #openstack-containers08:09
shu-mutouykarel, I added policy.yaml (all commented out, like https://docs.openstack.org/magnum/latest/configuration/samples/policy-yaml.html), then I run `quota-show` as http://paste.openstack.org/show/628923/08:09
gokhanykarel|lunch, I can not see ca-file on master node but kubelet works on master node clearly. I can see only one difference between /etc/kubernetes/kube_openstack_config on master and minion node and it is subnet-id=   null under the loadbalancer.08:13
strigaziflwang1 you can add redirection for the keystone endpoint08:14
*** janki has quit IRC08:15
*** rcernin has quit IRC08:15
*** penick_ has quit IRC08:18
*** absubram has joined #openstack-containers08:21
*** absubram_ has joined #openstack-containers08:25
*** absubram has quit IRC08:25
*** absubram_ is now known as absubram08:25
*** dardelean_ has joined #openstack-containers08:34
*** mdnadeem has joined #openstack-containers08:36
*** absubram has quit IRC08:42
*** dardelean_ has quit IRC08:58
*** dardelean_ has joined #openstack-containers08:58
*** dardelean_ has quit IRC09:05
*** mgoddard has joined #openstack-containers09:15
*** chhavi has quit IRC09:15
*** rcernin has joined #openstack-containers09:23
*** shu-mutou is now known as shu-mutou-AWAY09:24
*** vijaykc4 has joined #openstack-containers09:26
*** vijaykc4 has quit IRC09:28
*** vijaykc4 has joined #openstack-containers09:28
*** ykarel|lunch is now known as ykarel09:31
*** janki has joined #openstack-containers09:36
*** vijaykc4 has quit IRC09:40
*** vijaykc4 has joined #openstack-containers09:40
*** ramishra has quit IRC09:42
ykarelshu-mutou-AWAY, it must be a bug as we are defining quotas:get_all in policy.yaml and actually it is quota:get_all: https://github.com/openstack/magnum/blob/master/magnum/api/controllers/v1/quota.py#L13309:43
ykarelshu-mutou-AWAY, please file a bug for it09:43
*** ramishra has joined #openstack-containers09:44
ykarelgokhan, the file /etc/kubernetes/kube_openstack_config is used differently, For example: on master(for lb functionality) and minion node(for cinder volume) etc09:45
ykarelsubnet-id=null is in master or minion?09:45
*** vijaykc4 has quit IRC09:58
*** lpetrut has joined #openstack-containers09:59
ykarelchandankumar, looks you need to switch to tempest directory before using venv-tempest, can you check10:01
strigaziykarel chandankumar this is the only was I could make it work ^10:01
strigaziykarel chandankumar and I used functional-api but on the tempest plugin dir10:01
*** dardelean_ has joined #openstack-containers10:02
ykarelstrigazi, so you tried this locally10:03
strigaziykarel: I propose to enable tls-proxy in all jobs with my patch for the openstack_ca10:03
strigaziykarel: yes I tried locally10:03
strigaziykarel: worked fine10:03
openstackgerritMerged openstack/magnum master: [doc-migration] Consolidate install guide  https://review.openstack.org/52692610:03
ykarelstrigazi, Ok10:03
strigaziykarel ok for tls?10:03
strigazior for testing locally?10:04
ykarelstrigazi, for testing locally10:04
ykarelstrigazi, i saw your comment in the tls-proxy testing patch,10:06
ykarelactullay heat is not running with ssl10:06
ykarelso it should work without -k10:07
strigaziykarel: heat no? ok, but anyway the the nodes got the certs from magnum using the https endpoint10:07
ykarelstrigazi, yes other services are running with ssl, so that worked10:08
chandankumarykarel: strigazi can you comment what i need to change actually?10:09
strigazichandankumar ok10:09
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661810:10
*** vijaykc4 has joined #openstack-containers10:10
chandankumarykarel: added tempest switch dir10:11
ykarelchandankumar, for now it's ok for testing, in next patch use pushd and popd as later in the code we need to be in the magnum dir10:12
chandankumarykarel: sure10:13
ykarelchandankumar, also where is BASE defined? i cannot see it in local.conf10:14
ykarelshouldn't you use: DEST?10:14
*** salmankhan has joined #openstack-containers10:14
ykarelDEST=/opt/stack/new10:14
chandankumarykarel: sure10:16
strigaziykarel DEST is /opt/stack stackrc:DEST=/opt/stack10:16
ykarelchandankumar, BASE should also work10:17
ykarelstrigazi, i saw: http://logs.openstack.org/40/519540/2/check/magnum-functional-k8s/3fb45b8/logs/local.conf.txt.gz10:17
*** flwang1 has joined #openstack-containers10:18
strigaziBASE is /opt/stack and DEST starts as /opt/stack then is set to /opt/stack/new Let's use BASE since it used already in this script10:18
openstackgerritChandan Kumar proposed openstack/magnum master: Remove intree magnum tempest plugin  https://review.openstack.org/52661810:19
ykarelstrigazi, oK10:19
strigaziykarel enable tls-proxy for functional tests?10:20
strigaziWhat do you think?10:20
ykarelstrigazi, i was thinking to enable in all jobs except any one10:20
strigaziexcept which one?10:21
ykarelany one of swarm or k8s10:21
strigazikeep it disabled for swamr and k8s?10:21
strigaziwhy?10:22
strigaziykarel: But anyway, do you have any other comments for https://review.openstack.org/#/c/525662/10:23
ykarelstrigazi, just to test magnum without tls10:24
ykarelstrigazi, haven't looked at openstack_ca_file patch yet, will look soon10:24
*** dardelean_ has quit IRC10:26
*** dardelean_ has joined #openstack-containers10:26
strigaziykarel: I left a comment pointing where it is tested with magnum using https and with magnum using http10:29
strigaziykarel: clusters with tls-disabled will work anyway but we can do run with magnum using https and cluster with tls-disabled10:31
flwang1hi team, mind me chiming in?10:34
strigaziflwang1 you are welcome10:35
flwang1strigazi: a quick question, i know in magnum, the instance will try to talk with api node for heat wait condition notify and k8s -> cinder10:36
flwang1i just wanna double check if the api node will talk to instance10:36
strigaziflwang1 and k8s -> nova, keystone10:36
strigaziflwang1: no10:37
flwang1because we're designing the network for magnum10:37
strigazithe cluster are only doing requests to the apis10:37
flwang1but when magnum do the monitor, will it need to talk to instance? or just call the k8s api10:37
strigazimagnum talks only to the cluster API10:38
flwang1and technically, the cluster API is based on the floating IP, right?10:38
flwang1so we can assume the cluster API is reachable10:38
strigaziflwang1 yes, but this depends on your network10:39
flwang1yep, i see.10:40
strigaziflwang1: you public neutron network must me reachable from the magnum controller10:40
flwang1and that's only for the monitor, right?10:40
flwang1is there any other feature need to do that?10:40
strigaziflwang1 yes, we are working on making this optional10:41
flwang1great10:42
strigaziflwang1:  Ricardo is working cluster healing based on this mechanism, meaning magnum will try check how many nodes are up based on what the COE thinks10:42
strigaziflwang1: wtill this will be optional10:42
strigaziflwang1: still, this will be optional10:43
gokhanykarel, on minion node  subnet-id=10:43
gokhanykarel, there is nothing10:43
strigaziflwang1: I'll be back in 20-30 mins10:43
flwang1strigazi: it sounds like the monitor i'm proposing?10:43
gokhanykarel, do I need also ca-file on master node ?10:44
ykarelgokhan, you might need that, have you resolved kublet on minion node?10:55
chandankumarykarel: strigazi we made it working10:57
ykarelchandankumar, great10:57
openstackgerritFeilong Wang proposed openstack/magnum master: [WIP] Support basic monitor for node status  https://review.openstack.org/52793310:57
chandankumarykarel: can you start working on magnum tempest plugin packaging10:57
chandankumaror i can do it?10:57
flwang1chandankumar: is the tempest plugin fully ready now?10:58
chandankumarflwang1: i think so,10:58
flwang1chandankumar: i'm trying to add a basic scenario test10:58
chandankumarflwang1: https://review.openstack.org/#/c/526618/ you can find it in action here10:58
flwang1chandankumar: cool, it's on my list now10:59
chandankumarflwang1: thanks :-)10:59
flwang1chandankumar: ykarel: strigazi: are you guys aware anybody working on magnum scenario test?10:59
gokhanykarel, unfortunately no because I am new to ssl and not have enough information about it. I copied /etc/ssl/certs/ca-certificates.crt from keystone container to my kubernates minion node and write ca-file=/etc/ssl/certs/ca-certificates.crt on kube_openstack_config10:59
gokhanykarel, but it doesn't work it says no such file or directory :(11:00
*** vijaykc4 has quit IRC11:00
*** vijaykc4 has joined #openstack-containers11:01
gokhanykarel, Error: failed to run Kubelet: could not init cloud provider "openstack": open /etc/ssl/certs/ca-certificates.crt : no such file or directory11:01
gokhanykarel, but I have this file on minion node11:01
ykarelchandankumar, Ok will do11:01
ykarelflwang1, no11:02
flwang1ykarel: got, thanks11:02
*** mnasiadka has quit IRC11:06
*** mnasiadka has joined #openstack-containers11:06
openstackgerritFeilong Wang proposed openstack/magnum master: [WIP] Support basic monitor for node status  https://review.openstack.org/52793311:08
*** AlexeyAbashkin has quit IRC11:10
*** vijaykc4 has quit IRC11:10
*** vijaykc4 has joined #openstack-containers11:11
*** AlexeyAbashkin has joined #openstack-containers11:11
ykarelstrigazi, Ok will check your comment11:11
*** mnasiadka has quit IRC11:11
*** armaan has quit IRC11:11
*** armaan has joined #openstack-containers11:12
ykarelgokhan, may be permission issue then11:12
*** yamamoto has quit IRC11:12
ykarelAlso check on minion node "sudo docker ps"11:13
gokhanykarel, sudo docker ps11:13
gokhanCONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS               NAMES11:13
*** clenimar has quit IRC11:14
*** armaan has quit IRC11:17
*** armaan has joined #openstack-containers11:18
*** clenimar has joined #openstack-containers11:24
openstackgerritRicardo Rocha proposed openstack/magnum master: Allow flavor_id on cluster create  https://review.openstack.org/48951211:26
*** chhavi has joined #openstack-containers11:31
flwang1rochapor1o: waves from NZ11:34
*** linkmark has joined #openstack-containers11:40
*** mnasiadka has joined #openstack-containers11:42
*** janki has quit IRC11:46
*** yamamoto has joined #openstack-containers11:53
*** yamamoto has quit IRC11:54
*** yamamoto has joined #openstack-containers11:55
*** basvanveen has joined #openstack-containers12:09
strigaziflwang1: are you still here?12:10
flwang1strigazi: yes12:11
flwang1strigazi: btw, before putting more effort, is this https://review.openstack.org/#/c/527933/ on the right direction based on our talk?12:11
strigaziflwang1 for tempest, the plugin was already available, but in-tree.12:12
*** basvanveen has quit IRC12:12
strigaziflwang1: yes, that is the goal, to take the status from the API12:12
flwang1strigazi: yep, i see. so i'm waiting chandankumar's patch landed12:13
flwang1because we(catalyst cloud) would like to upstream a basic scenario test12:13
flwang1which will be used for advanced monitoring for magnum service12:13
strigazithen compare number of nodes up with the number of nodes in the magnum DB12:13
strigaziflwang1 we use rally12:14
strigaziwe (CERN)12:14
*** dpawar has quit IRC12:14
flwang1strigazi: rally is another option12:14
*** chhavi__ has joined #openstack-containers12:14
*** vijaykc4 has quit IRC12:14
strigazibut tempest is a perfect option that we use for the CI12:14
strigaziwe magnum upstream12:14
*** vijaykc4 has joined #openstack-containers12:14
flwang1strigazi: yep, can't agree more12:15
strigaziThe next step for monitoring, is12:15
strigazicheck if the number of nodes that the API reported matches the number in the db12:15
*** chhavi has quit IRC12:15
strigaziand we can use some extra status like HEALTHY and UNHEALTHY12:16
strigaziwhich is only how many nodes are up12:16
openstackgerritFeilong Wang proposed openstack/magnum master: [WIP] Support anti-affinity policy for nodes  https://review.openstack.org/52794612:16
strigazibased on that we can trigger a rebuild of the nodes that are down12:16
flwang1strigazi: how do get the number of nodes up?12:17
flwang1write  your own script ?12:17
strigaziflwang1: check in your patch: "'reason': 'KubeletReady',"12:17
strigazior 'type': 'Ready'12:18
strigaziit the same info when you do kubectl get nodes12:18
flwang1i see, i mean is that already existing?12:18
flwang1in magnum12:18
flwang1i just want to avoid duplicated code12:18
strigaziit is not there, you just added it12:19
strigazihttps://review.openstack.org/#/c/527933/2/magnum/drivers/common/k8s_monitor.py@20312:19
*** salmankhan has quit IRC12:19
strigaziflwang1: but, we do not use this information12:19
*** yamamoto has quit IRC12:19
strigaziit suppoesed to be pushed to ceilometer12:19
*** dpawar has joined #openstack-containers12:20
flwang1strigazi: cool, good to know you guys like it12:20
*** dave-mccowan has joined #openstack-containers12:21
strigaziflwang1: the patch yes, pushing info to ceilometer not so much, we have ceilometer but hasn't been proven very useful for magnum cluster monitoring12:21
strigaziI think the best option is to go for the status HEALTHY and UNHEALTHY12:22
flwang1strigazi: i see. personally, i'd like to see a management/admin api for ops to get the health status of clusters12:22
strigaziflwang1 only admin?12:22
strigaziif yes, why?12:23
flwang1strigazi: that's not the key point, i mean it would be nice if magnum can provide an api for health monitor12:23
flwang1for tenant user, then can easily get the their cluster's status12:24
*** dave-mcc_ has joined #openstack-containers12:24
flwang1but for admin/ops, they need an over view12:24
strigaziflwang1 so on demand? on a periodic task?12:24
flwang1something like, tell me the cluster list which are in unhealthy status12:24
*** chhavi__ has quit IRC12:24
flwang1on demand12:25
strigaziok, so12:25
flwang1personally, i don't like periodic task12:25
strigaziflwang1:  me neither12:25
*** dave-mccowan has quit IRC12:25
*** salmankhan has joined #openstack-containers12:25
flwang1for most of the cases, it just generates lots of useless info12:25
strigaziit is proven to be difficult to manage12:25
flwang1and ^12:25
flwang1keep a service/process always running under hood is not my fav12:26
*** chhavi__ has joined #openstack-containers12:26
strigaziflwang1: +10012:26
strigaziwe could extend https://github.com/openstack/magnum/blob/master/magnum/api/controllers/v1/stats.py12:26
flwang1strigazi: yep, but /stats is not a great name, TBH12:27
flwang1but it's not blocker12:27
flwang1i'm happy to extend it12:27
flwang1for now, it's too limited12:28
flwang1IIRC, only nodes number or something like that12:28
flwang1not very useful12:28
strigaziflwang1: the only problem with not having a periodic task is for automatic healing12:28
flwang1as an mgmt api, ops want to know more12:28
strigaziI'm working on upgrades and I am adding it as an action12:29
flwang1it can be plugable12:29
strigazihttps://review.openstack.org/#/c/514959/1/magnum/api/controllers/v1/cluster_actions.py12:29
strigaziwe can have more actions12:30
flwang1cool, btw, thanks for addressing my comments in the psec12:30
flwang1spec12:30
strigaziI'm trying to finish the an api ref12:31
flwang1fantastic12:31
strigazifor testing I do something like:12:31
flwang1given there is an api change, i think we need the api ref for sure12:31
strigaziflwang1: https://gist.github.com/strigazi/ae99e6a9c41c778da0cd80f47acf56c812:32
flwang1i can understand the param 'image', but not the 'kube_tag'12:33
flwang1will it be parsed?12:33
strigaziflwang1 so, in CT (cluster template) kube_tag is a label12:34
flwang1never mind, i got it12:34
strigaziflwang1: we either do it like this, with a dict of parameters or we replicate all parameters from CT and cluster, so for upgrade you would do:12:36
flwang1so as you said in the spec, the general idea is update the params of the template, then do stack update, right?12:36
strigazi"image": "fedora-1", "labels": {"kube_tag": "v1.8.2"}12:36
*** chhavi__ has quit IRC12:37
strigazithe idea is to take the parameters from the upgrade request, update cluster not CT, and do the stack update12:38
flwang1yep, sorry, i mean cluster, not CT12:40
flwang1and i assume no service-offline right?12:40
strigaziso, for single master you will have some downtime of the kube API but not of the app running on the cluster12:41
strigazithe app running on the cluster if it has more than one node it should experience no downtime12:42
flwang1i see, just wanna double check to make sure i didn't miss anything at Sydney ;)12:43
*** vijaykc4 has quit IRC12:51
*** vijaykc4 has joined #openstack-containers12:51
*** dardelea_ has joined #openstack-containers12:54
*** dardelean_ has quit IRC12:54
*** dardelean_ has joined #openstack-containers12:55
*** dardelea_ has quit IRC12:59
*** vijaykc4 has quit IRC13:05
*** vijaykc4 has joined #openstack-containers13:06
*** yamamoto has joined #openstack-containers13:07
*** armaan has quit IRC13:13
*** vijaykc4 has quit IRC13:13
*** vijaykc4 has joined #openstack-containers13:14
*** dpawar has quit IRC13:14
*** chhavi has joined #openstack-containers13:36
*** yamamoto has quit IRC13:41
openstackgerritRicardo Rocha proposed openstack/python-magnumclient master: Add missing master_flavor_id in cluster attributes  https://review.openstack.org/52796113:47
openstackgerritRicardo Rocha proposed openstack/python-magnumclient master: OSC: Add --flavor to coe cluster create  https://review.openstack.org/48962713:49
*** yamamoto has joined #openstack-containers13:50
*** dpawar has joined #openstack-containers13:54
*** yamamoto has quit IRC13:54
*** kiennt26 has joined #openstack-containers13:55
*** dpawar has quit IRC13:56
*** rcernin has quit IRC13:59
openstackgerritSpyros Trigazis (strigazi) proposed openstack/magnum master: Make docker_storage_driver a str instead of enum  https://review.openstack.org/51088214:00
*** vijaykc4 has quit IRC14:03
*** aluria has quit IRC14:03
*** vijaykc4 has joined #openstack-containers14:03
*** vijaykc4 has quit IRC14:04
*** armaan has joined #openstack-containers14:05
*** aluria has joined #openstack-containers14:07
*** salmankhan has quit IRC14:11
*** yamamoto has joined #openstack-containers14:14
*** salmankhan has joined #openstack-containers14:16
*** basvanveen has joined #openstack-containers14:16
*** yamamoto has quit IRC14:19
*** mnasiadka has quit IRC14:26
*** mdnadeem has quit IRC14:28
*** magicboiz has quit IRC14:29
*** mnasiadka has joined #openstack-containers14:30
*** vijaykc4 has joined #openstack-containers14:32
*** mnasiadka has quit IRC14:35
*** mnasiadka has joined #openstack-containers14:41
*** mdnadeem has joined #openstack-containers14:41
openstackgerritRicardo Rocha proposed openstack/magnum master: Make docker_storage_driver a str instead of enum  https://review.openstack.org/51088214:42
*** basvanveen has quit IRC14:46
*** mnasiadka has quit IRC14:48
*** armaan has quit IRC14:49
*** ykarel is now known as ykarel|afk14:50
*** armaan has joined #openstack-containers14:50
*** mdnadeem has quit IRC14:50
*** mdnadeem has joined #openstack-containers14:51
*** mnasiadka has joined #openstack-containers14:51
*** vijaykc4 has quit IRC14:53
*** vijaykc4 has joined #openstack-containers14:54
*** mnasiadka has quit IRC14:56
*** ykarel|afk has quit IRC14:56
*** mnasiadka has joined #openstack-containers14:59
*** jmlowe_ has joined #openstack-containers14:59
*** jmlowe has quit IRC15:00
*** marst has joined #openstack-containers15:01
*** mnasiadka has quit IRC15:04
*** jmlowe has joined #openstack-containers15:04
*** jmlowe_ has quit IRC15:06
*** mnasiadka has joined #openstack-containers15:07
*** mnasiadka has quit IRC15:16
*** itlinux has joined #openstack-containers15:19
*** mnasiadka has joined #openstack-containers15:21
*** itlinux has quit IRC15:22
*** mnasiadka has quit IRC15:25
*** kiennt26 has quit IRC15:26
*** mnasiadka has joined #openstack-containers15:29
*** ykarel|afk has joined #openstack-containers15:30
ricolinstrigazi, is it an option to move meeting two hour earlier?15:31
ricolinor three:)15:32
*** mnasiadka has quit IRC15:35
*** vijaykc4 has quit IRC15:36
strigaziricolin more than fine for me15:38
strigaziwe don't have many people at the US15:39
ricolinstrigazi, if we can do 13:00-15:00 UTC that will cover most Asia15:40
ricolinstrigazi, and of course the earlier the better for me:)15:41
*** mnasiadka has joined #openstack-containers15:41
strigaziricolin NZ?15:41
ricolinhave to move 5 hour earlier if we want to cover NZ15:44
strigaziI think, by moving 3 hours we already lose US so we may be able to overdo it15:45
ricolinI mean that will be 9:00 pm - 11:00pm when we start the meeting15:45
strigaziricolin 9 or 10 NZ local time?15:45
ricolinNew Zealand right?15:45
*** magicboiz has joined #openstack-containers15:46
strigaziyes15:46
ricolinso 8:00 am UTC is 9:00pm in NZ15:47
ricolinNZ is UTC+1315:47
*** mnasiadka has quit IRC15:48
ricolinif we capable to move the meeting time, I would like to suggest that we move our meeting to #openstack-containers channel15:49
ricolinwhich IMO work pretty well:)15:50
strigazifine for me15:50
*** mnasiadka has joined #openstack-containers15:52
*** mnasiadka has quit IRC15:56
*** mnasiadka has joined #openstack-containers15:59
*** mjura has quit IRC16:00
*** armaan has quit IRC16:04
*** armaan has joined #openstack-containers16:05
*** mnasiadka has quit IRC16:05
openstackgerritSpyros Trigazis (strigazi) proposed openstack/python-magnumclient master: Make cluster-config rbac compatible for kubebernetes  https://review.openstack.org/52742816:06
*** basvanveen has joined #openstack-containers16:10
*** mnasiadka has joined #openstack-containers16:11
*** mnasiadka has quit IRC16:18
*** basvanveen has quit IRC16:21
*** mnasiadka has joined #openstack-containers16:21
*** itlinux has joined #openstack-containers16:21
*** ykarel|afk has quit IRC16:26
*** mnasiadka has quit IRC16:26
*** itlinux has quit IRC16:28
*** mnasiadka has joined #openstack-containers16:29
*** armaan has quit IRC16:33
*** armaan has joined #openstack-containers16:33
*** mnasiadka has quit IRC16:34
*** absubram has joined #openstack-containers16:38
*** mnasiadka has joined #openstack-containers16:39
*** absubram has quit IRC16:43
*** mnasiadka has quit IRC16:44
*** yamamoto has joined #openstack-containers16:46
*** absubram has joined #openstack-containers16:50
*** yamamoto has quit IRC16:54
*** penick has joined #openstack-containers17:04
*** vijaykc4 has joined #openstack-containers17:04
*** chhavi has quit IRC17:07
*** fragatin_ has joined #openstack-containers17:10
*** mnasiadka has joined #openstack-containers17:14
*** lpetrut has quit IRC17:14
*** dardelean_ has quit IRC17:17
*** mnasiadka has quit IRC17:18
*** mnasiadka has joined #openstack-containers17:22
*** AlexeyAbashkin has quit IRC17:23
*** mnasiadka has quit IRC17:27
*** mnasiadka has joined #openstack-containers17:29
*** fragatin_ has quit IRC17:31
*** vijaykc4 has quit IRC17:31
*** mdnadeem has quit IRC17:33
*** mnasiadka has quit IRC17:34
*** vijaykc4 has joined #openstack-containers17:34
*** sahilsinha has quit IRC17:36
*** dardelean_ has joined #openstack-containers17:37
*** sahilsinha has joined #openstack-containers17:39
*** dardelean_ has quit IRC17:42
*** mnasiadka has joined #openstack-containers17:44
*** sahilsinha has quit IRC17:44
*** logan- has quit IRC17:44
*** logan- has joined #openstack-containers17:45
*** sahilsinha has joined #openstack-containers17:46
*** mnasiadka has quit IRC17:48
*** ramishra has quit IRC17:51
*** jmlowe has quit IRC17:51
*** oikiki has joined #openstack-containers17:51
*** dardelean_ has joined #openstack-containers17:56
*** mnasiadka has joined #openstack-containers17:59
*** flwang1 has quit IRC18:00
*** vijaykc4 has quit IRC18:00
*** dardelean_ has quit IRC18:01
*** mnasiadka has quit IRC18:03
*** yamamoto has joined #openstack-containers18:05
*** mgoddard has quit IRC18:05
*** penick has quit IRC18:06
*** vijaykc4 has joined #openstack-containers18:06
*** magicboiz has quit IRC18:06
*** flwang1 has joined #openstack-containers18:07
*** penick has joined #openstack-containers18:08
*** absubram has quit IRC18:08
*** flwang1 has quit IRC18:12
*** mnasiadka has joined #openstack-containers18:14
*** vijaykc4 has quit IRC18:17
*** mnasiadka has quit IRC18:18
*** flwang1 has joined #openstack-containers18:22
*** itlinux has joined #openstack-containers18:26
*** mnasiadka has joined #openstack-containers18:29
*** harlowja has joined #openstack-containers18:29
*** mnasiadka has quit IRC18:33
*** mnasiadka has joined #openstack-containers18:43
*** penick has quit IRC18:44
*** mgoddard has joined #openstack-containers18:45
*** penick has joined #openstack-containers18:45
*** AlexeyAbashkin has joined #openstack-containers18:47
*** mnasiadka has quit IRC18:48
*** AlexeyAbashkin has quit IRC18:52
*** armaan has quit IRC18:56
*** armaan has joined #openstack-containers18:56
*** itlinux has quit IRC18:57
*** mnasiadka has joined #openstack-containers18:59
*** mnasiadka has quit IRC19:03
*** salmankhan has quit IRC19:08
*** adisky__ has quit IRC19:11
*** jmlowe has joined #openstack-containers19:12
*** mnasiadka has joined #openstack-containers19:13
*** openstack has joined #openstack-containers20:32
*** ChanServ sets mode: +o openstack20:32
*** mnasiadka has quit IRC20:33
*** lpetrut has joined #openstack-containers20:38
*** mnasiadka has joined #openstack-containers20:44
*** jmlowe has joined #openstack-containers20:45
*** AlexeyAbashkin has joined #openstack-containers20:46
*** mnasiadka has quit IRC20:49
*** AlexeyAbashkin has quit IRC20:51
*** salmankhan has joined #openstack-containers21:00
*** salmankhan has quit IRC21:04
*** yamamoto has joined #openstack-containers21:07
*** SamYaple has quit IRC21:07
*** SamYaple has joined #openstack-containers21:08
*** openstack has joined #openstack-containers21:12
*** ChanServ sets mode: +o openstack21:12
*** mnasiadka has joined #openstack-containers21:14
*** yamamoto has quit IRC21:15
*** mnasiadka has quit IRC21:19
*** SamYaple has quit IRC21:22
*** SamYaple has joined #openstack-containers21:23
*** mnasiadka has joined #openstack-containers21:29
*** threestrands has joined #openstack-containers21:31
*** threestrands has quit IRC21:31
*** threestrands has joined #openstack-containers21:31
*** mnasiadka has quit IRC21:34
*** mnasiadka has joined #openstack-containers21:44
*** penick has quit IRC21:48
*** mgoddard has quit IRC21:48
*** armaan has quit IRC21:48
*** mnasiadka has quit IRC21:49
*** aluria has quit IRC21:50
*** aluria has joined #openstack-containers21:50
*** yamamoto has joined #openstack-containers21:51
*** oikiki has quit IRC21:57
*** rcernin has joined #openstack-containers21:58
*** mnasiadka has joined #openstack-containers21:59
*** penick has joined #openstack-containers22:04
*** mnasiadka has quit IRC22:04
*** absubram has quit IRC22:10
*** flwang1 has quit IRC22:13
*** mnasiadka has joined #openstack-containers22:14
*** mnasiadka has quit IRC22:18
*** mnasiadka has joined #openstack-containers22:29
*** mnasiadka has quit IRC22:34
*** mnasiadka has joined #openstack-containers22:44
*** mnasiadka has quit IRC22:49
*** absubram has joined #openstack-containers22:57
*** mnasiadka has joined #openstack-containers22:59
*** oikiki has joined #openstack-containers23:03
*** mnasiadka has quit IRC23:04
*** threestrands_ has joined #openstack-containers23:10
*** threestrands has quit IRC23:13
*** masuberu has quit IRC23:15
*** lpetrut has quit IRC23:21
*** mnasiadka has joined #openstack-containers23:29
*** harlowja has quit IRC23:32
*** mnasiadka has quit IRC23:33
*** dave-mcc_ has quit IRC23:37
*** harlowja has joined #openstack-containers23:39
*** harlowja has quit IRC23:40
*** harlowja has joined #openstack-containers23:42
*** mnasiadka has joined #openstack-containers23:44
*** mnasiadka has quit IRC23:49
*** harlowja has quit IRC23:50
*** mnasiadka has joined #openstack-containers23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!