*** ivve has quit IRC | 00:21 | |
*** pcaruana has quit IRC | 01:26 | |
*** bobh has joined #openstack-monasca | 01:40 | |
*** bobh has quit IRC | 02:53 | |
*** pcaruana has joined #openstack-monasca | 03:44 | |
openstackgerrit | jianweizhang proposed openstack/monasca-common master: fix confluent kafka pull method https://review.opendev.org/675037 | 06:52 |
---|---|---|
openstackgerrit | jianweizhang proposed openstack/monasca-persister master: python3 json loads issue https://review.opendev.org/675038 | 07:05 |
openstackgerrit | jianweizhang proposed openstack/monasca-persister master: use confluent kafka python driver https://review.opendev.org/675046 | 07:29 |
*** ivve has joined #openstack-monasca | 07:34 | |
*** witek has joined #openstack-monasca | 07:40 | |
*** spsurya has joined #openstack-monasca | 07:50 | |
openstackgerrit | jianweizhang proposed openstack/monasca-common master: fix confluent kafka pull method https://review.opendev.org/675037 | 08:07 |
*** Wasaac has joined #openstack-monasca | 08:11 | |
openstackgerrit | jianweizhang proposed openstack/monasca-common master: Confluent kafka driver broker otpion bug https://review.opendev.org/675055 | 08:20 |
*** dougsz has joined #openstack-monasca | 08:21 | |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/673297 | 08:36 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/673297 | 08:38 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/675061 | 08:52 |
openstackgerrit | jianweizhang proposed openstack/monasca-persister master: python3 json loads issue https://review.opendev.org/675038 | 09:12 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/675061 | 09:14 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/675061 | 09:15 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/675061 | 09:16 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-agent master: [WIP] Change Elasticsearch urls to fix failing metrics retrieval https://review.opendev.org/672937 | 09:27 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-tempest-plugin master: [WIP] Change body in requests to Kibana https://review.opendev.org/674598 | 09:30 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-ui master: [WIP] Add content-type field https://review.opendev.org/674601 | 09:56 |
*** chaconpiza has quit IRC | 10:23 | |
openstackgerrit | Witold Bedyk proposed openstack/monasca-notification master: Use Confluent Kafka client https://review.opendev.org/674812 | 10:25 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-ui master: [WIP] Add content-type field https://review.opendev.org/674601 | 10:27 |
*** Wasaac has quit IRC | 10:34 | |
*** Wasaac has joined #openstack-monasca | 10:38 | |
*** Wasaac has quit IRC | 11:53 | |
*** Wasaac_ has joined #openstack-monasca | 11:53 | |
openstackgerrit | Dobroslaw Zybort proposed openstack/monasca-persister master: Fix InfluxdbClientError exception bug https://review.opendev.org/665591 | 11:54 |
*** Wasaac_ has quit IRC | 11:54 | |
*** Wasaac has joined #openstack-monasca | 11:55 | |
openstackgerrit | Merged openstack/monasca-notification master: Templates for Slack notifications https://review.opendev.org/519630 | 12:04 |
openstackgerrit | Merged openstack/monasca-notification master: Add PagerDuty notification plugin documentation https://review.opendev.org/656750 | 12:13 |
openstackgerrit | Merged openstack/monasca-persister master: Add tests for influxdb/metrics_repository.py https://review.opendev.org/652070 | 12:41 |
openstackgerrit | Merged openstack/monasca-common master: Fix Confluent Kafka consumer topics subscription https://review.opendev.org/674804 | 12:41 |
openstackgerrit | Arseni Lipinski proposed openstack/monasca-log-api master: [WIP] Upgrade Elkstack https://review.opendev.org/675061 | 13:04 |
*** Wasaac has quit IRC | 14:38 | |
*** Wasaac has joined #openstack-monasca | 14:39 | |
*** sgrasley has joined #openstack-monasca | 14:45 | |
*** altlogbot_1 has quit IRC | 14:46 | |
*** altlogbot_3 has joined #openstack-monasca | 14:47 | |
witek | Courtesy Monasca meeting reminder in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz,fouadben, amofakhar, haru5ny (haruki),kaiokmo,pandiyan,charana,guilhermesp,chaconpiza,toabctl,hosanai,Wasaac | 15:00 |
witek | #startmeeting monasca | 15:00 |
openstack | Meeting started Wed Aug 7 15:00:51 2019 UTC and is due to finish in 60 minutes. The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
dougsz | hello all | 15:00 |
*** openstack changes topic to " (Meeting topic: monasca)" | 15:00 | |
openstack | The meeting name has been set to 'monasca' | 15:00 |
witek | hi dougsz | 15:01 |
witek | the agenda as usual: | 15:01 |
witek | https://etherpad.openstack.org/p/monasca-team-meeting-agenda | 15:02 |
witek | #topic IPv6 | 15:02 |
*** openstack changes topic to "IPv6 (Meeting topic: monasca)" | 15:02 | |
witek | not much from me to this one | 15:02 |
witek | just an update on gmann's work | 15:03 |
witek | here the list of current reviews: | 15:03 |
witek | https://review.opendev.org/#/q/topic:ipv6-only-deployment-and-testing+projects:openstack/monasca | 15:03 |
witek | I haven't look into this but we probably will have to change the way we configure Kafka | 15:04 |
witek | to be IPv6 compliant | 15:04 |
joadavis | do we need a new version of kafka, or is it just configuration? | 15:04 |
witek | configuration I assume | 15:04 |
gmann | yeah, seems still issue. I have not checked the recent log though | 15:06 |
gmann | kafka seems configured with correct uri - https://logs.opendev.org/74/673274/6/check/monasca-tempest-influxdb-ipv6-only/0e53dc2/controller/logs/etc/monasca-api/monasca-api_conf.txt.gz | 15:07 |
witek | the action item is unassigned, it reminds me I should update our priorities list for that | 15:07 |
*** Wasaac has quit IRC | 15:07 | |
*** Wasaac has joined #openstack-monasca | 15:08 | |
witek | gmann: we have a change in review upgrading Kafka and updating the configuration file | 15:09 |
witek | https://review.opendev.org/670914 | 15:09 |
witek | but I understand it's probably a misconfiguration of clients, right? | 15:10 |
gmann | yeah, i am not seeing all logs there in recent run so cannot confirm exactly what failing | 15:11 |
gmann | may be other failure happening now. | 15:11 |
witek | #action witek Update Train priorities page with IPv6 goal | 15:12 |
witek | thanks gmann, I hope we can pick up on that work | 15:13 |
gmann | thanks witek . | 15:13 |
witek | #topic Confluent Kafka client [notification] | 15:13 |
*** openstack changes topic to "Confluent Kafka client [notification] (Meeting topic: monasca)" | 15:13 | |
witek | thanks a log for your reviews in the last week | 15:14 |
witek | I pushed new changes with the implementation in monasca-notification | 15:14 |
witek | https://review.opendev.org/674812 | 15:15 |
witek | and https://review.opendev.org/674814 | 15:15 |
dougsz | thanks a log :) | 15:15 |
witek | the keys are too close each other :) | 15:16 |
witek | when testing these changes I've noticed problems with kafka-python and newest broker versions | 15:17 |
witek | I think it's related with probing the Kafka API version and the very outdated Kafka client | 15:17 |
witek | anyone there are errors in Kafka log and notification engine crashes | 15:18 |
witek | the latest compatible Kafka version I found was 2.0.1 | 15:18 |
witek | https://review.opendev.org/670914 | 15:19 |
witek | another bad news is that this is not tested in CI | 15:19 |
witek | I mean notification engine | 15:19 |
witek | I think we should add it to our backlog to add some integration testing here | 15:20 |
witek | do you have any questions to these changes or anything related? | 15:22 |
witek | #topic Faust investigation | 15:23 |
*** openstack changes topic to "Faust investigation (Meeting topic: monasca)" | 15:23 | |
dougsz | Nice work, it seems like a great time to be upgrading the Kafka client given the issues with Kafka 2.3 and other work going on to upgrade ELK | 15:23 |
witek | yes, it's been way too long in the backlog | 15:24 |
witek | for the Faust library investigation, I wanted to share the link to Sumit's repo with some initial code | 15:25 |
witek | one issue which he identified is, that there is no way to dynamically create Tables and Windows after the Application has been initialized | 15:26 |
witek | which means that in the running Faust Application we cannot add alarms with different evaluation periods | 15:27 |
witek | but I think we can work around this by starting new subprocesses | 15:28 |
witek | here is Sumit's repo: | 15:29 |
witek | https://github.com/sjamgade/pythresh-proto | 15:29 |
witek | #topic AOB | 15:29 |
*** openstack changes topic to "AOB (Meeting topic: monasca)" | 15:29 | |
dougsz | So a subprocess per alarm in the most extreme case? | 15:29 |
witek | I think we'd need subprocess per evaluation period | 15:30 |
witek | so, if all alarms have the same period, they'd fit in one Table | 15:31 |
dougsz | I see - that wouldn't be too bad | 15:31 |
witek | but yes, if every alarm would have a different evaluation period, we'll need as many subprocesses with own Tables | 15:32 |
witek | or we'd have to rethink the approach | 15:32 |
joadavis | is there a minimum granularity to the evaluation period? | 15:33 |
joadavis | could you just put all alarms into a table at the minimum period, but have the processing recognize when the per-alarm period wasn't met and just no-op for a cycle? | 15:34 |
joadavis | I may be misunderstanding hwo it works, if the table is used to collect data for just a period and would not carry over to another period | 15:34 |
witek | what we're using here are Windows, being views on the Table | 15:36 |
witek | https://faust.readthedocs.io/en/latest/userguide/tables.html#windowing | 15:36 |
witek | if the window is configured to fit our evaluation period, then we don't have to do much more | 15:37 |
witek | we probably could indeed build in some logic and evaluate alarms for other periods as well though | 15:38 |
dougsz | I forget - do we have any benchmark data yet? | 15:38 |
witek | for Faust? no | 15:39 |
dougsz | Just thinking it would be nice to check that it scales well early on | 15:39 |
witek | yes, good point | 15:40 |
witek | please take a moment to look at our board: | 15:42 |
witek | https://storyboard.openstack.org/#!/board/141 | 15:42 |
witek | and add or move the cards to reflect the work you're active on | 15:43 |
witek | I think it can help us all with reviewing | 15:43 |
witek | do we have any other topics for today? | 15:44 |
joadavis | Congratulations to all who had sessions acepted to Shanghai | 15:45 |
witek | oh yes, forgot that one :) | 15:45 |
witek | congratulations joadavis ! | 15:45 |
dougsz | yes, well done! | 15:45 |
joadavis | Well, now I have to actually come up with content... | 15:45 |
joadavis | I guess I'll be working card #1165 from our board :) | 15:46 |
dougsz | This is the CloudKitty + Monasca talk right? | 15:46 |
joadavis | https://www.openstack.org/summit/shanghai-2019/summit-schedule/events/23932/transitioning-your-cloud-monitoring-from-ceilometer-to-monasca | 15:47 |
joadavis | quite controversial, I'm sure. ;) | 15:47 |
joadavis | I think Witek's other session will be interesting too - https://www.openstack.org/summit/shanghai-2019/summit-schedule/events/23919/efficient-monitoring-and-root-cause-analysis-in-complex-systems | 15:48 |
witek | the workshop hasn't been accepted this time, right? | 15:49 |
joadavis | I haven't looked for workshops yet... | 15:49 |
joadavis | there are a couple of monitoring in kubernetes talks that may be interesting too | 15:49 |
witek | alright, thanks for joining today | 15:52 |
dougsz | thanks all | 15:52 |
joadavis | thanks, see you later | 15:52 |
witek | have a nice summer week | 15:52 |
witek | and see you next Wednesday | 15:53 |
witek | #endmeeting | 15:53 |
joadavis | (and the workshop list seems really short this time around) | 15:53 |
*** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca" | 15:53 | |
openstack | Meeting ended Wed Aug 7 15:53:18 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:53 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.html | 15:53 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.txt | 15:53 |
openstack | Log: http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-08-07-15.00.log.html | 15:53 |
*** ivve has quit IRC | 16:23 | |
*** dougsz has quit IRC | 16:57 | |
*** altlogbot_3 has quit IRC | 17:17 | |
*** altlogbot_3 has joined #openstack-monasca | 17:23 | |
*** altlogbot_3 has quit IRC | 17:30 | |
*** altlogbot_3 has joined #openstack-monasca | 17:35 | |
*** spsurya has quit IRC | 18:22 | |
*** Wasaac has quit IRC | 18:29 | |
*** Wasaac has joined #openstack-monasca | 18:30 | |
*** Wasaac has quit IRC | 18:52 | |
*** Wasaac has joined #openstack-monasca | 19:00 | |
*** Wasaac has joined #openstack-monasca | 19:29 | |
*** Wasaac has quit IRC | 19:38 | |
*** Wasaac has joined #openstack-monasca | 19:44 | |
*** ivve has joined #openstack-monasca | 20:15 | |
*** witek has quit IRC | 20:24 | |
*** Wasaac has quit IRC | 21:10 | |
*** Wasaac has joined #openstack-monasca | 21:15 | |
*** Wasaac has quit IRC | 21:43 | |
*** Wasaac has joined #openstack-monasca | 21:43 | |
*** ivve has quit IRC | 22:45 | |
*** Wasaac has quit IRC | 23:19 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!