15:02:01 <dougsz_> #startmeeting monasca 15:02:02 <openstack> Meeting started Wed Aug 15 15:02:01 2018 UTC and is due to finish in 60 minutes. The chair is dougsz_. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:02:03 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:02:05 <openstack> The meeting name has been set to 'monasca' 15:02:26 <koji_n> hi 15:02:47 <dougsz_> Hi koji_n 15:03:00 <dougsz_> Only two topics on the agenda today: https://etherpad.openstack.org/p/monasca-team-meeting-agenda 15:03:42 <dougsz_> #topic Scalable Kafka cluster 15:04:05 <dougsz_> pandiyan - over to you 15:04:13 <pandiyan> Hi 15:04:42 <pandiyan> I need to scale kafka cluster for 3 node setup 15:05:02 <pandiyan> Am running in docker swarm mode 15:05:45 <pandiyan> Dougz .. may i know how to achieve 15:06:07 <pandiyan> Right now upstream docker suppprts single node setup 15:06:18 <pandiyan> How about ro scale n 3 node setup 15:06:29 <dougsz_> I haven't done it with Swarm, but it's pretty simple. 15:06:42 <dougsz_> You'll likely want a zookeeper cluster as well 15:07:11 <dougsz_> for Kafka, here is some example config from kolla-ansible: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/kafka/templates/kafka.server.properties.j2 15:07:14 <pandiyan> Yes but zookeeper failed to detect if scale katka cluster 15:07:40 <pandiyan> Like it cant find zookeeper id wgile scaling 15:08:18 <dougsz_> Here is a zookeeper example config from Kolla Ansible: https://github.com/openstack/kolla-ansible/tree/master/ansible/roles/zookeeper/templates 15:08:34 <pandiyan> Sure dougz i will look into yours.. how about grafana database map to MySQL 15:08:38 <pandiyan> Which s next topic 15:08:53 <dougsz_> ok, we can move to next topic 15:09:05 <pandiyan> Yes 15:09:09 <dougsz_> #topic MySQL 15:09:33 <pandiyan> I have created storyboard and work scenario to reproduce 15:10:05 <dougsz_> I can't see any logs on the story 15:10:44 <pandiyan> Okay, can you please see docker file mapped to use mysql is that coreect 15:11:06 <pandiyan> If its correct, getting error as failed to authenticate 15:11:15 <dougsz_> What you need to do, is look at how the grafana config file is being generated from the ENV vars 15:11:55 <dougsz_> Once you have the container running you can poke around inside with 'docker exec -it grafana_container bash' 15:12:14 <pandiyan> Yes, i changed env as per that 15:12:17 <dougsz_> Have a look at the grafana.ini file, and look at the database section to see if it is configured properly. 15:12:51 <pandiyan> I have passed docker grafana environment variables with mysql details is that correct 15:12:56 <dougsz_> Here is an example config mysql config from kolla-ansible again: https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/grafana/templates/grafana.ini.j2#L18 15:13:50 <dougsz_> pandiyan: The only way to find out is to look at how the grafana config file is generated from the env vars. 15:14:35 <pandiyan> Dougz, i have passed same values in docker file as in storyboard but after creating image.. those changes not reflected inside docker container..under grafana.ini files also authentication error 15:15:00 <dougsz_> Have you looked at the config file generated from the env vars? 15:15:11 <pandiyan> Dougz, kindly please take a look at my storyboard docker file environment variables, is that coreect ? 15:15:29 <dougsz_> I don't know. You need to check yourself. 15:15:42 <pandiyan> Yes i took look into it.. which not having changes mentioned n docker file 15:15:57 <dougsz_> https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2 15:16:15 <dougsz_> ^ It doesn't look like the mysql section references any env vars 15:16:44 <dougsz_> That is probably why it isn't working for you. 15:16:48 <pandiyan> May i know how to restart grafana after doing changes in grafana.ini.j2 manually inside grafana container 15:17:10 <pandiyan> If i restarts grafana service, complete container got restarted 15:17:20 <dougsz_> I think just a docker restart grafana_container should do it 15:18:11 <dougsz_> So in summary it looks like you need to add your mysql fields to https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2 15:18:30 <dougsz_> Do we have any other topics for discussion? 15:18:57 <pandiyan> Yiu mean do changes in that filr and restart that docker ? 15:19:25 <pandiyan> No topics from my end to discuss 15:19:48 <dougsz_> pandiyan: yes - that should work for prototyping 15:19:56 <koji_n> it seems that the configuration file for grafana cannot read environment variables 15:20:07 <koji_n> https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2#L62-L68 15:20:09 <pandiyan> Quickly.. dougz have yiu tested kafka_zookeeper in HA mode 15:20:31 <dougsz_> pandiyan: Yeah, we've been running it for about 4 months. 15:20:43 <dougsz_> No issues. We haven't tuned it yet. 15:21:20 <pandiyan> Okay 15:21:54 <dougsz_> as koji_n mentions, you can insert your env vars on L62-L68 like on this line: https://github.com/monasca/monasca-docker/blob/master/grafana/grafana.ini.j2#L10 15:22:28 <dougsz_> So if there are no other issues we can conclude the meeting. 15:22:33 <dougsz_> Thanks all. 15:22:43 <kaiokmo> dougsz_ can I add something, real quick? 15:22:53 <dougsz_> Go for it kaiokmo :) 15:23:12 <kaiokmo> since witek isn't here, I will pass the updates to you 15:23:22 <dougsz_> ok, please do 15:23:41 <kaiokmo> so, I think I finished support for monasca-agent role on OSA for bionic, centos, and opensuse 15:23:53 <kaiokmo> https://review.openstack.org/#/c/586933/ and https://review.openstack.org/#/c/588462/ and https://review.openstack.org/#/c/588456/ 15:24:41 <dougsz_> Nice job kaiokmo 15:24:53 <kaiokmo> I'm still working on bionic support for the monasca role. centos and opensuse looks solid, and I will send a patch soon 15:24:56 <dougsz_> In OSA, the monasca agent runs directly on the host? 15:25:16 <kaiokmo> on bionic, I got some failed on tempest tests. it will need further investigation 15:25:39 <kaiokmo> yes, you must determinate the ip of the hosts that the agent will be installed 15:26:06 <kaiokmo> like this https://docs.openstack.org/openstack-ansible-os_monasca-agent/latest/configure-monasca-agent.html#configuring-target-hosts 15:26:58 <dougsz_> I suppose you could also get the hosts from the Ansible inventory? 15:27:05 <kaiokmo> yup. 15:27:46 <kaiokmo> so, I will keep working on monasca role, and I will keep you guys updated 15:28:00 <dougsz_> Sounds good, thanks kaiokmo! 15:28:18 <kaiokmo> no problem. thanks for the space :) 15:28:30 <dougsz_> np. Any other topics to discuss? 15:29:05 <dougsz_> In that case lets end the meeting. 15:29:10 <dougsz_> thanks everyone. 15:29:11 <dougsz_> #endmeeting