15:02:01 #startmeeting monasca 15:02:02 Meeting started Wed Aug 15 15:02:01 2018 UTC and is due to finish in 60 minutes. The chair is dougsz_. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:03 Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:05 The meeting name has been set to 'monasca' 15:02:26 hi 15:02:47 Hi koji_n 15:03:00 Only two topics on the agenda today: https://etherpad.openstack.org/p/monasca-team-meeting-agenda 15:03:42 #topic Scalable Kafka cluster 15:04:05 pandiyan - over to you 15:04:13 Hi 15:04:42 I need to scale kafka cluster for 3 node setup 15:05:02 Am running in docker swarm mode 15:05:45 Dougz .. may i know how to achieve 15:06:07 Right now upstream docker suppprts single node setup 15:06:18 How about ro scale n 3 node setup 15:06:29 I haven't done it with Swarm, but it's pretty simple. 15:06:42 You'll likely want a zookeeper cluster as well 15:07:11 for Kafka, here is some example config from kolla-ansible: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/kafka/templates/kafka.server.properties.j2 15:07:14 Yes but zookeeper failed to detect if scale katka cluster 15:07:40 Like it cant find zookeeper id wgile scaling 15:08:18 Here is a zookeeper example config from Kolla Ansible: https://github.com/openstack/kolla-ansible/tree/master/ansible/roles/zookeeper/templates 15:08:34 Sure dougz i will look into yours.. how about grafana database map to MySQL 15:08:38 Which s next topic 15:08:53 ok, we can move to next topic 15:09:05 Yes 15:09:09 #topic MySQL 15:09:33 I have created storyboard and work scenario to reproduce 15:10:05 I can't see any logs on the story 15:10:44 Okay, can you please see docker file mapped to use mysql is that coreect 15:11:06 If its correct, getting error as failed to authenticate 15:11:15 What you need to do, is look at how the grafana config file is being generated from the ENV vars 15:11:55 Once you have the container running you can poke around inside with 'docker exec -it grafana_container bash' 15:12:14 Yes, i changed env as per that 15:12:17 Have a look at the grafana.ini file, and look at the database section to see if it is configured properly. 15:12:51 I have passed docker grafana environment variables with mysql details is that correct 15:12:56 Here is an example config mysql config from kolla-ansible again: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/grafana/templates/grafana.ini.j2#L18 15:13:50 pandiyan: The only way to find out is to look at how the grafana config file is generated from the env vars. 15:14:35 Dougz, i have passed same values in docker file as in storyboard but after creating image.. those changes not reflected inside docker container..under grafana.ini files also authentication error 15:15:00 Have you looked at the config file generated from the env vars? 15:15:11 Dougz, kindly please take a look at my storyboard docker file environment variables, is that coreect ? 15:15:29 I don't know. You need to check yourself. 15:15:42 Yes i took look into it.. which not having changes mentioned n docker file 15:15:57 https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2 15:16:15 ^ It doesn't look like the mysql section references any env vars 15:16:44 That is probably why it isn't working for you. 15:16:48 May i know how to restart grafana after doing changes in grafana.ini.j2 manually inside grafana container 15:17:10 If i restarts grafana service, complete container got restarted 15:17:20 I think just a docker restart grafana_container should do it 15:18:11 So in summary it looks like you need to add your mysql fields to https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2 15:18:30 Do we have any other topics for discussion? 15:18:57 Yiu mean do changes in that filr and restart that docker ? 15:19:25 No topics from my end to discuss 15:19:48 pandiyan: yes - that should work for prototyping 15:19:56 it seems that the configuration file for grafana cannot read environment variables 15:20:07 https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2#L62-L68 15:20:09 Quickly.. dougz have yiu tested kafka_zookeeper in HA mode 15:20:31 pandiyan: Yeah, we've been running it for about 4 months. 15:20:43 No issues. We haven't tuned it yet. 15:21:20 Okay 15:21:54 as koji_n mentions, you can insert your env vars on L62-L68 like on this line: https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2#L10 15:22:28 So if there are no other issues we can conclude the meeting. 15:22:33 Thanks all. 15:22:43 dougsz_ can I add something, real quick? 15:22:53 Go for it kaiokmo :) 15:23:12 since witek isn't here, I will pass the updates to you 15:23:22 ok, please do 15:23:41 so, I think I finished support for monasca-agent role on OSA for bionic, centos, and opensuse 15:23:53 https://review.openstack.org/#/c/586933/ and https://review.openstack.org/#/c/588462/ and https://review.openstack.org/#/c/588456/ 15:24:41 Nice job kaiokmo 15:24:53 I'm still working on bionic support for the monasca role. centos and opensuse looks solid, and I will send a patch soon 15:24:56 In OSA, the monasca agent runs directly on the host? 15:25:16 on bionic, I got some failed on tempest tests. it will need further investigation 15:25:39 yes, you must determinate the ip of the hosts that the agent will be installed 15:26:06 like this https://docs.openstack.org/openstack-ansible-os_monasca-agent/latest/configure-monasca-agent.html#configuring-target-hosts 15:26:58 I suppose you could also get the hosts from the Ansible inventory? 15:27:05 yup. 15:27:46 so, I will keep working on monasca role, and I will keep you guys updated 15:28:00 Sounds good, thanks kaiokmo! 15:28:18 no problem. thanks for the space :) 15:28:30 np. Any other topics to discuss? 15:29:05 In that case lets end the meeting. 15:29:10 thanks everyone. 15:29:11 #endmeeting