| *** Fdaisuke_ has joined #openstack-monasca | 06:55 | |
| *** witek has joined #openstack-monasca | 07:09 | |
| witek | good morning | 07:09 |
|---|---|---|
| Fdaisuke_ | Hi, witek, | 07:10 |
| witek | hi Fdaisuke_ | 07:10 |
| witek | do you have any topics? | 07:10 |
| Fdaisuke_ | sorry, i have no topics, today | 07:11 |
| witek | no problem | 07:11 |
| witek | yesterday we discussed merging the APIs and if we should aim to completely get rid of monasca-common library | 07:11 |
| witek | we kicked off the effort of adding Monasca to OpenStack Helm | 07:12 |
| witek | and wend through some open reviews | 07:13 |
| Fdaisuke_ | cool | 07:13 |
| witek | if you look for some reviewing activity in Monasca, you may have a look at the list | 07:14 |
| witek | it's always good opportunity to learn the code | 07:14 |
| witek | does anyone else want to bring up anything? | 07:15 |
| Fdaisuke_ | thank you, I'll look for Reviews list | 07:16 |
| witek | OK, thanks Fdaisuke_, I'll move then to my morning routine | 07:17 |
| witek | see you next time | 07:17 |
| Fdaisuke_ | OK, thank you witek | 07:17 |
| Fdaisuke_ | see you | 07:17 |
| *** mohankumar has joined #openstack-monasca | 08:56 | |
| *** dougsz has joined #openstack-monasca | 08:58 | |
| mohankumar | Hi , experiencing huge consumer lag in kafka . How to reduce lag , any pointers? pls | 08:58 |
| mohankumar | if i need to tune persister to read more data/ write fast into influxdb what should i change config ? | 08:59 |
| witek | mohankumar: you could try increasing number of workers in persister | 09:18 |
| witek | you can also try to play with batch_size | 09:20 |
| mohankumar | witek : thanks , I can't find config file to increase no.of worker thread https://github.com/openstack/monasca-persister/tree/master/docker | 09:30 |
| mohankumar | witek: could you help to find config file ? | 09:30 |
| witek | in case of Docker deployment it's easier to just deploy several replicas of persister container | 09:36 |
| dougsz | +1, make sure you have enough partitions in your metrics topic for the extra workers | 09:37 |
| dougsz | https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/monasca/templates/monasca-persister/persister.conf.j2#L20 | 09:37 |
| dougsz | ^ Example of setting number of threads | 09:37 |
| mohankumar | witek: if several persister writing in same influxdb record, will it cause any inconsistency ? | 09:37 |
| witek | no | 09:38 |
| witek | they won | 09:38 |
| witek | they won't write the same record | 09:38 |
| mohankumar | witek : Great , Thanks ! | 09:38 |
| witek | persister instances will load balance the messages from Kafka | 09:38 |
| witek | and if the same message would appear for some reason, it will just overwrite the record in InfluxDB | 09:39 |
| witek | dougsz: is Kolla deployment fully clustered? | 09:40 |
| dougsz | witek: It is indeed, we quite often do 3 node deploys | 09:41 |
| dougsz | some caveats, influxdb single instance, and thresholder runs on only one node right now | 09:41 |
| witek | thanks, I think akhil_jain was asking about clustered deployment yesterday | 09:41 |
| witek | Kolla is currently the best supported option, I reckon | 09:41 |
| mohankumar | dougsz: Yes i tried by increasing partitions , with single persister it not helped much . i ll check with multiple persister instances | 09:41 |
| dougsz | mohankumar: You will see in the logs that each persister gets a share of the partitions, it's cool how they rebalance automatically when a new persister joins / leaves. | 09:42 |
| dougsz | witek: sounds good, the Kolla Monasca deploy will work standalone if he needs it to (docs are here: https://docs.openstack.org/kolla-ansible/latest/reference/logging-and-monitoring/monasca-guide.html) | 09:44 |
| mohankumar | dougz, witek : In my deployment database_batch_size is "1000" https://github.com/openstack/monasca-persister/blob/a18a2b6e8ae7a72cd8d29b92c37e9ba49be3ca48/docker/monasca_persister.conf.j2#L48 , any suggestion how much i can increase that would be optimal ? | 09:46 |
| mohankumar | dougz, witek : I know its noob question , still | 09:48 |
| mohankumar | dougsz ^ | 09:50 |
| dougsz | mohankumar: you a probably in a better position that me to tune it | 09:51 |
| dougsz | *are | 09:51 |
| dougsz | I am using kolla-ansible defaults - haven't hit a scaling issue yet | 09:52 |
| witek | I'm afraid I don't have any optimization investigation results | 09:52 |
| mohankumar | dougsz , witek : okay , thanks for your prompt replies :) | 09:53 |
| akhil_jain | witek: dougsz: thanks guys I just want to make development env ready to run basic scenarios. do you think kolla is best and suitable way to achieve that? | 10:57 |
| dougsz | akhil_jain: Kolla will be fairly heavyweight for a dev env | 11:00 |
| *** zenirc369 has joined #openstack-monasca | 12:39 | |
| *** mohankumar has quit IRC | 14:18 | |
| *** openstackgerrit has joined #openstack-monasca | 15:38 | |
| openstackgerrit | Witold Bedyk proposed openstack/monasca-events-api master: Updated policy names https://review.openstack.org/613679 | 15:38 |
| dougsz | Did anyone hit the issue with Kafka 1.x reaping connections yet :) | 16:02 |
| openstackgerrit | Merged openstack/python-monascaclient master: Fix alarm-definition-list in Python 3 https://review.openstack.org/636150 | 16:17 |
| openstackgerrit | Merged openstack/monasca-api master: Use global job for building docker image https://review.openstack.org/632088 | 16:19 |
| *** trident has quit IRC | 16:46 | |
| *** aagate has joined #openstack-monasca | 17:04 | |
| *** zenirc369 has quit IRC | 17:15 | |
| openstackgerrit | Amir Mofakhar proposed openstack/monasca-events-api master: Updated policy names https://review.openstack.org/613679 | 17:23 |
| *** dougsz has quit IRC | 18:35 | |
| openstackgerrit | Amir Mofakhar proposed openstack/monasca-events-api master: Updated policy names https://review.openstack.org/613679 | 19:45 |
| *** witek has quit IRC | 20:09 | |
| -openstackstatus- NOTICE: Jobs are failing due to ssh host key mismatches caused by duplicate IPs in a test cloud region. We are disabling the region and will let you know when jobs can be rechecked. | 21:32 | |
| -openstackstatus- NOTICE: The test cloud region using duplicate IPs has been removed from nodepool. Jobs can be rechecked now. | 22:14 | |
| openstackgerrit | guang-yee proposed openstack/monasca-agent master: properly convey Keystone v3 params https://review.openstack.org/637069 | 22:40 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!