Wednesday, 2019-05-08

*** chaconpiza has joined #openstack-monasca07:16
*** witek has joined #openstack-monasca07:53
*** dougsz has joined #openstack-monasca08:08
*** chaconpiza has quit IRC08:34
*** chaconpiza has joined #openstack-monasca08:38
*** chaconpiza has quit IRC08:49
openstackgerritArseni Lipinski proposed openstack/monasca-persister master: Minor refactoring for utils.py  https://review.opendev.org/65202611:33
openstackgerritArseni Lipinski proposed openstack/monasca-persister master: Minor refactoring for utils.py  https://review.opendev.org/65202611:36
*** bobh has joined #openstack-monasca11:57
*** bobh has quit IRC12:02
*** witek has quit IRC12:13
openstackgerritDobroslaw Zybort proposed openstack/monasca-persister master: Add tests for cassandra/token_range_query_manager.py  https://review.opendev.org/65265312:16
openstackgerritDobroslaw Zybort proposed openstack/monasca-persister master: Add tests for cassandra/retry_policy.py  https://review.opendev.org/65297412:18
openstackgerritDobroslaw Zybort proposed openstack/monasca-persister master: Add tests for cassandra/alarm_state_history_repository.py  https://review.opendev.org/65370312:26
openstackgerritArseni Lipinski proposed openstack/monasca-persister master: Add tests for cassandra/token_range_query_manager.py  https://review.opendev.org/65265312:57
*** witek has joined #openstack-monasca14:30
*** witek has left #openstack-monasca14:30
*** witek has joined #openstack-monasca14:30
joadavisReminder: team meeting at 1500 UTC, agenda at https://etherpad.openstack.org/p/monasca-team-meeting-agenda14:43
openstackgerritJoseph Davis proposed openstack/monasca-agent master: WIP Enable unit tests for py36  https://review.opendev.org/65782914:54
*** halbbalda has quit IRC14:57
*** koji_n has joined #openstack-monasca15:00
witek#startmeeting monasca15:00
openstackMeeting started Wed May  8 15:00:23 2019 UTC and is due to finish in 60 minutes.  The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: monasca)"15:00
openstackThe meeting name has been set to 'monasca'15:00
witekhello everyone15:00
koji_nhi15:00
witekagenda for today:15:01
witekhttps://etherpad.openstack.org/p/monasca-team-meeting-agenda15:01
dougszhello all - apologies for not making Saturday at PTG, the honest answer was that I totally forgot :(15:01
joadavis:)15:02
witek:) no worries, we covered most of the topics on Friday already15:02
joadavisgood to know you are human15:02
dougsz:-D15:02
witek#topic Train tasks prioritization15:03
*** openstack changes topic to "Train tasks prioritization (Meeting topic: monasca)"15:03
witekI think the list should be complete now15:04
witekI've created new or linked to existing Stories15:04
witekthere is also a link to meeting minutes, I haven't managed to write a summary yet15:04
witekplease also let me know or just add to the list if something is missing or should be differently handled15:06
witekI would like to evaluate the results in one week15:07
dougszok, thanks witek15:07
witekany comments right now to list items?15:08
witekor anything related?15:08
joadavisits a good list15:09
dougszShould merge APIs task be on there, I guess that should make Train?15:09
witekoh yes, forgot to comment on that one15:09
dougsz(just thinking about the log-query API which will come after)15:10
joadavisright, we discussed if tasks in progress should be on the list15:10
witekI assumed we will continue the work on merging APIs and Kafka upgrade15:10
witekso these will automatically make it to the priorities list15:10
dougszsounds good, thanks15:10
witekjoadavis, dougsz: I don't remember if we decided how we should handle these, is it OK to skip them from the game or you prefer to have them as well?15:12
DobroslawI would prefer them in game so we see all "big" tasks15:13
dougszI guess Kafka upgrade is already part of Middleware upgrade15:13
Dobroslawthat are worked on/considered15:13
joadavisI'd add a second section below the table for voting and list them there for context15:13
witekdougsz: no, client upgrade is meant, it includes code changes15:13
joadavisor make them a different color so they stand out as in-progress15:13
witekOK, I'll add the two to the list and mark as in progress, we have stories for them already15:15
dougszI suppose from a reviewing perspective, it would be nice to have them all there, to make it clear where review time should be targetted.15:16
witekwill update after the meeting15:16
witekany other comments?15:16
witek#topic TimescaleDB15:17
*** openstack changes topic to "TimescaleDB (Meeting topic: monasca)"15:17
Dobroslawthat's from me15:17
DobroslawI found it few days ago15:17
Dobroslawand it looks promising as a alternative for influx/cassandra15:18
DobroslawI added more links in etherpad15:18
Dobroslawin short: extension to PostgreSQL15:18
Dobroslawa lot faster than PostgreSQL for storing and handling metrics (use something called hypertable on top of Postgres)15:19
Dobroslawapparently also a lot faster than cassandra15:19
Dobroslawslower than influx if we send few metrics from every node15:20
Dobroslawbut if number of metrics from one node increase it's starting to be faster than inflax15:20
Dobroslawbig point: we can use most tools for Postgres for HA15:21
*** altlogbot_0 has quit IRC15:21
Dobroslawhttps://blog.timescale.com/high-availability-timescaledb-postgresql-patroni-a4572264a831/15:21
DobroslawThere are also cons like much higher disk usage than Influx in exchange for less memory and CPU use. They recomend to run TimescaleDB on top of ZFS as users often see 3-9x compression.15:21
witekdo they have any dedicated clients, or standard mysql should be used?15:21
dougszI suppose for me, it's an interesting thing to keep an eye on for the future.15:22
Dobroslawas far as I understand standard sql15:22
*** altlogbot_0 has joined #openstack-monasca15:22
*** irclogbot_2 has quit IRC15:22
witekhow does it scale horizontally, any limitations?15:23
Dobroslaw^ link have more info15:23
Dobroslawusing etcd or zookeeper or anything similar for choosing master15:24
*** irclogbot_2 has joined #openstack-monasca15:24
Dobroslawlimitations I would say similar to Postgres15:24
Dobroslawneed streaming replication from HA tools15:25
witekhttps://docs.timescale.com/v1.3/faq#clustered15:25
witek"Full, scale-out clustering (i.e., for data volumes > 500 billion rows and ingest rates > 300K row inserts / second) is in the works and will leverage the automated partitioning capabilities already available in single-node TimescaleDB today."15:26
witeknot sure, if that's up to date15:26
*** altlogbot_0 has quit IRC15:27
Dobroslawwell, it's just another tool on Apache 2.0 to check from time to time15:27
*** altlogbot_2 has joined #openstack-monasca15:28
witekI've heard of TimescaleDB before and it seems they are actively developing it15:28
*** irclogbot_2 has quit IRC15:28
dougszI suppose the other question is how well does it handle high cardinality15:29
Dobroslawthey raised 15M $ in January15:29
joadavisit is appealing that it supports "all of SQL"15:29
Dobroslawhttps://blog.timescale.com/what-is-high-cardinality-how-do-time-series-databases-influxdb-timescaledb-compare/15:29
dougsz:)15:29
Dobroslawdougsz: newest post on they blog :)15:29
*** irclogbot_2 has joined #openstack-monasca15:30
dougszI wonder what their business model is15:30
witekthey also have Prometheus remote read/write adapter15:30
witekhttps://github.com/timescale/prometheus-postgresql-adapter15:30
Dobroslawhttps://www.timescale.com/pricing15:30
DobroslawTimescale License basically block Amazon and similar from providing it as a SaaS15:31
DobroslawDBaaS15:31
Dobroslawdougsz: https://blog.timescale.com/how-we-are-building-an-open-source-business-a7701516a480/15:32
witekhm, could licensing also be an issue for us?15:33
DobroslawCommunity features (free): Will be licensed under the TSL, but will be made available at no charge. There are two exceptions that are prohibited from using these features (without a commercial agreement): (1) cloud and SaaS providers who just offer a hosted “database-as-a-service” version of TimescaleDB, and (2) OEMs that don’t provide any other value on top of the database. This tier enables us to continue15:33
Dobroslawto provide free features to and invest in our community, while protecting from open-source strip mining.15:33
DobroslawBase is Apache 2.015:33
DobroslawDifferences in functionality here: https://www.timescale.com/pricing15:34
witekI see some functionality is  not included in Apache license15:34
DobroslawI did not read this license but Monasca IS providing value on top of the database15:35
witekI understand that implementing support for TimescaleDB addresses the same problems as `Sharding model for InfluxDB` on our priorities list15:36
Dobroslawbut I'm not lawyer15:36
witekDobroslaw: correct, wanted to comment with the same sentence15:36
witekI guess we would need one to clarify15:36
Dobroslawyea... I hate this license wars...15:36
witekor check if Apache is enough for us15:36
witekshould we be adding Timescale to our game list?15:37
Dobroslawdon't know, up to you all15:38
witekhave you discussed it in your team?15:38
DobroslawI just showed it today to Adrian but he did not look much into this15:39
Dobroslawjust said it's nice that we can connect to it like to any SQL db15:39
witekI'd be interested in Matthias' opinion15:40
Dobroslawhe is sick this week15:40
witekfor now, I would say we can keep an eye on it and can evaluate, but don't include in the list yet15:41
Dobroslawfine by me15:41
witeklet's move on15:41
dougszthanks Dobroslaw15:42
Dobroslaw:)15:42
witek#topic new tag for monasca-log-api Pike15:42
*** openstack changes topic to "new tag for monasca-log-api Pike (Meeting topic: monasca)"15:42
witekdougsz: thanks for the heads-up15:42
witekI've given +1 today15:43
dougszThanks witek, I've been trying to gets someone to W+1 in reviews15:43
witekeveryone busy after Summit I assume15:43
dougszyeah15:43
dougszI guess that is it for this15:44
joadavisLooks ok to me, should I give it the W+!?15:44
witekjoadavis: it15:44
dougszCan you do it in releases?15:44
joadavisoh, good point. :(15:45
witekI can ping in #openstack-release15:45
witek#topic Readme formating errors in Pike15:46
*** openstack changes topic to "Readme formating errors in Pike (Meeting topic: monasca)"15:46
witekhttps://review.opendev.org/65285415:46
witekreminder from last time15:46
witekwe cannot tag on Pike because of formatting errors in Readmes15:46
witekhttp://logs.openstack.org/54/652854/3/check/openstack-tox-validate/14a09ef/job-output.txt.gz#_2019-04-18_05_37_47_48413515:47
witekit would be great if someone could pick it up15:48
witekI can help as well15:48
witek#topic Python 3 support in monasca-agent15:49
*** openstack changes topic to "Python 3 support in monasca-agent (Meeting topic: monasca)"15:49
joadavisI posted a WIP patch for py36 environment enabling in mon-agent15:49
witeknice, thanks15:49
witekstill a lot of work to turn it green, right?15:50
joadavisThere are still a number of errors that result from the patch, and will need to track them down15:50
joadaviszuul says 86, which is more than I saw locally. :)15:51
witekdo you want to work on this?15:51
joadavisI did when I thought the list of errors would be shorter. ;)15:52
witekhaha15:52
witekperhaps it could be split15:52
joadavisI will take another pass at it today, and will ask for help where I can't find an easy fix15:52
witekcool, thanks15:53
joadavisI suspect there are many repeated errors, and most can be solved by a quick google for the equivalent call, or importing six15:53
joadavisWe should check all the other monasca-* projects are properly invoking the py36 unit tests15:53
dougszWill try and take a look sometime15:53
witekI think monasca-agent is the only one not executing tests15:54
joadavisthanks15:54
witekbtw., I've added the story to the new board15:54
joadavisand I would appreciate anyone with a bit more tox expertise reviewing the tox.ini change to make sure I didn't miss something. :)15:54
witekhttps://storyboard.openstack.org/#!/board/14115:54
witek#topic Telemetry meeting15:55
*** openstack changes topic to "Telemetry meeting (Meeting topic: monasca)"15:55
witekTelemetry team has scheduled a bi-weekly meeting15:56
witekon Thursdays 2am UTC15:56
witekhttp://eavesdrop.openstack.org/#Telemetry_Team_Meeting15:56
witekmiddle of the night for me15:57
joadavis7pm here, but I have a conflict tonight15:57
witekwe've seen a lot of interest during the Summit from people asking how to migrate from Ceilometer/Aodh to Monasca15:58
joadavisI may have to just review the logs.  I do want to get a conversation with the telemetry team about publishers15:58
dougsz+1 People have been showing up in Kolla-Ansible asking for help with Monasca for this purpose15:58
joadavisyes, it might be good to write a quick article about how to migrate and what are some differences15:59
witekvolunteers? :)15:59
dougszWhat is the reference design for Monasca?15:59
joadavishah, are you looking at me?15:59
joadavisdougsz: good question. should we be steering users to kolla or docker or a distribution?16:00
joadavisor just give a simple devstack based example16:00
witekdougsz: what do you mean by reference?16:00
dougszCeilometer replacement16:01
witekdon't understadn16:01
dougszI suppose these people want to do billing?16:02
joadavissome will, some just want monitoring16:02
witekI think Monasca publisher is important, we should also describe installation methods (or link) in the central place (d.o.o)16:04
joadavisI do wish we had a recent user who had moved so we could reference their experience.16:04
witekarticle is a great idea16:04
witekwe could also reach out to Telemetry team and ask if they are interested in migrating16:05
joadavisIt might be easiest to start hacking out the article as a page on the wiki, then when ready we can try submitting it to the Superuser magazine16:05
witekand provide use cases which have to be supported16:05
witekOK, I think we can wrap up now, we're over time anyway16:06
witekbut we should definitely follow up on this16:06
witekthanks for joining16:06
joadavisyes.  I'll start an outline and will post the link to this channel16:07
dougszThanks all16:07
witekplease remember about priorities16:07
witekthanks joadavis16:07
koji_nthanks16:07
witekthanks everyone16:07
witekbye16:07
witek#endmeeting16:07
*** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca"16:07
Dobroslawbye16:07
openstackMeeting ended Wed May  8 16:07:31 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:07
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-08-15.00.html16:07
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-08-15.00.txt16:07
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-08-15.00.log.html16:07
*** koji_n has quit IRC16:07
*** witek has quit IRC16:16
*** dougsz has quit IRC16:58
joadavisIt still kills me that when you go to https://docs.openstack.org/stein/ and search for "monasca" you get no results17:16
joadavisQuick start - https://wiki.openstack.org/wiki/Monasca/Migration_from_Ceilometer17:43
*** guimaluf has quit IRC20:44
*** bobh has joined #openstack-monasca20:44
*** bobh has quit IRC20:45
*** bobh has joined #openstack-monasca21:22
*** bobh has quit IRC21:26

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!