Wednesday, 2018-11-21

*** jamesmcarthur has quit IRC00:00
*** jamesmcarthur has joined #openstack-meeting-300:07
*** yamamoto has quit IRC00:34
*** jamesmcarthur has quit IRC01:05
*** jamesmcarthur has joined #openstack-meeting-301:08
*** jamesmcarthur has quit IRC01:17
*** jamesmcarthur has joined #openstack-meeting-301:18
*** jamesmcarthur has quit IRC01:22
*** iyamahat has quit IRC01:47
*** yamahata has quit IRC01:47
*** jamesmcarthur has joined #openstack-meeting-301:56
*** mtreinish has quit IRC02:13
*** mtreinish has joined #openstack-meeting-302:13
*** yamamoto has joined #openstack-meeting-304:05
*** psachin has joined #openstack-meeting-304:14
*** iyamahat has joined #openstack-meeting-304:52
*** iyamahat has quit IRC04:54
*** iyamahat has joined #openstack-meeting-304:54
*** yamahata has joined #openstack-meeting-305:11
*** yamamoto has quit IRC05:20
*** yamamoto has joined #openstack-meeting-305:24
*** yamamoto has quit IRC05:47
*** yamamoto has joined #openstack-meeting-305:51
*** yamamoto has quit IRC06:07
*** apetrich has joined #openstack-meeting-306:40
*** yamamoto has joined #openstack-meeting-306:41
*** dconde has quit IRC06:57
*** yamahata has quit IRC08:03
*** iyamahat has quit IRC08:04
*** yamahata has joined #openstack-meeting-308:23
*** yamamoto has quit IRC08:24
*** iyamahat has joined #openstack-meeting-308:41
*** bobh has joined #openstack-meeting-308:43
*** yamamoto has joined #openstack-meeting-308:47
*** ralonsoh has joined #openstack-meeting-308:50
*** e0ne has joined #openstack-meeting-309:03
*** Fdaisuke has joined #openstack-meeting-309:14
*** Fdaisuke has left #openstack-meeting-309:15
*** Fdaisuke__ has joined #openstack-meeting-309:16
*** Fdaisuke__ has left #openstack-meeting-309:18
*** rossella_s has joined #openstack-meeting-309:19
*** tssurya has joined #openstack-meeting-309:32
*** pcaruana has joined #openstack-meeting-309:48
*** yamamoto has quit IRC09:55
*** bobh has quit IRC10:01
*** yamamoto has joined #openstack-meeting-310:22
*** yamamoto has quit IRC10:28
*** yamamoto has joined #openstack-meeting-310:30
*** sambetts_ has joined #openstack-meeting-311:20
*** sambetts_ is now known as sambetts|afk11:21
*** yamamoto has quit IRC11:45
*** mugsie has joined #openstack-meeting-311:49
*** tssurya has quit IRC11:55
*** raildo has joined #openstack-meeting-311:59
*** psachin has quit IRC12:01
*** yamamoto has joined #openstack-meeting-312:07
*** yamamoto has quit IRC12:36
*** e0ne has quit IRC12:45
*** tssurya has joined #openstack-meeting-313:02
*** e0ne has joined #openstack-meeting-313:02
*** e0ne has quit IRC13:03
*** e0ne has joined #openstack-meeting-313:03
*** yamamoto has joined #openstack-meeting-313:06
*** yamamoto has quit IRC13:18
*** Fdaisuke_ has joined #openstack-meeting-313:38
*** munimeha1 has joined #openstack-meeting-314:03
*** Fdaisuke__ has joined #openstack-meeting-314:05
*** pbourke has quit IRC14:07
*** pbourke has joined #openstack-meeting-314:09
*** Fdaisuke_ has left #openstack-meeting-314:10
*** Fdaisuke__ has quit IRC14:10
*** bobh has joined #openstack-meeting-314:21
*** witek has joined #openstack-meeting-314:41
*** Fdaisuke_ has joined #openstack-meeting-314:47
*** koji_n has joined #openstack-meeting-314:55
*** joadavis has joined #openstack-meeting-314:58
witek#startmeeting monasca15:00
openstackMeeting started Wed Nov 21 15:00:29 2018 UTC and is due to finish in 60 minutes.  The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: monasca)"15:00
openstackThe meeting name has been set to 'monasca'15:00
witekHello everyone15:00
koji_nhi15:00
witekhi koji_n15:01
*** dougsz has joined #openstack-meeting-315:01
Fdaisuke_hello15:01
dougszHey all15:01
witeknice to see you all15:01
witekthe agenda in the usual place:15:01
witekhttps://etherpad.openstack.org/p/monasca-team-meeting-agenda15:02
witeklet's start with the quick Summit recap15:02
witek#topic Berlin Summit recap15:02
*** openstack changes topic to "Berlin Summit recap (Meeting topic: monasca)"15:02
witekwe had couple presentations in Berlin15:03
*** hongbin has joined #openstack-meeting-315:03
witekProject Update15:03
witekhttps://www.openstack.org/summit/berlin-2018/summit-schedule/events/22869/monasca-openstack-monitoring15:03
witekunfortunately still no videos available15:03
witekI have listed our work around events and logs as the focus in Stein release15:04
witekthe interest was quite big15:04
witek2. Project Onboarding15:05
witekhttp://btw23.de/johannes/talks/monasca-onboarding.tar.bz215:05
witekthen we had a presentation from StackHPC15:05
witek3. Monitoring as a Service in the HPC Cloud15:06
witekhttps://www.openstack.org/summit/berlin-2018/summit-schedule/events/22446/monitoring-as-a-service-in-the-hpc-cloud15:06
witekvery good informative presentation15:06
witekpresenting Monasca deployed with Kolla Ansible15:07
joadavisgood to hear the interest in monasca was high15:07
witek4. Monitoring Hands-On Workshop15:07
witekhttps://github.com/martinchacon/monasca-bootcamp15:08
witekthat one was really packed!15:08
witekwe had almost 100 people doing hands-on excercises with Monasca15:08
joadaviswow15:08
dougszGreat job from Martin on that one15:08
witekafter both, Project Update and Hands-On there were questions about Ceilometer15:09
witekif Monasca can/will replace it?15:10
witekalso, there were questions about deployment methods for the agent15:10
witekI have pointed to the monasca-ceilometer plugin15:11
witekanother very interesting presentation was from Red Hat15:11
witekhttps://www.openstack.org/assets/presentation-media/OpenStack-Summit-2018-Prometheus-Operator-to-monitor-OpenStack.pdf15:11
witekthey have admitted that Gnocchi is not a viable solution for monitoring at scale15:13
joadavisfacinating. Scale was one of the main points of Gnocchi15:13
witekand proposed an architecture similar to Monasa's15:13
witekwith Collectd, message bus and Prometheus15:14
witekeverything deployed on OpenShift15:14
dougszQuite the stack15:15
witekin general, my conclusion from the summit is that we should invest some more effort in the agent, to make it more accessible and useful for users15:16
witekwe should define `core` plugins and support them better, add some testing15:17
witekwhat has come up in the PTG already, we should adevertise our support for Prometheus15:17
dougszI think there are also some issues with some of the detection plugins not working well from inside a container15:17
witekyes, we have seen some as well, some fixed, some not15:18
witekwe should also think about making official packages for the agent15:19
witekfor Debian/Ubuntu and CentOS15:19
dougszOfficial Ansible playbook could be nice as well15:20
witekhave to check if there is one in OSA15:20
witek#action check for official Ansible playbook15:21
joadavisThere is https://docs.openstack.org/openstack-ansible-os_monasca/latest/ but I'm not sure if it is up to date/usable15:21
dougszWe have forked one and got it working with Ubuntu/Centos/SuSE15:21
dougszAs you say it would be nice to have one under the Monasca namespace15:22
witekjoadavis: that's for all Monasca, should be functional15:22
joadavislong ago we talked internally about contributing changes from Ardana to OSA, but haven't put time in to it15:22
witekdougsz: good to hear, perhaps we should move it to OSA?15:23
witekcan you share the repo?15:23
dougszhttps://github.com/stackhpc/ansible-role-monasca-agent15:23
witekthanks15:24
witekanother topic which pulled some attention was auto-scaling15:24
joadavishttps://github.com/ArdanaCLM/monasca-ansible is part of it. There are also repos for monasca-transform-ansible and spark-ansible15:24
dougsz👍15:25
witekfrom what I heard Monasca role in OSA should be working fine15:26
witekbut does not has logging and monasca-transform15:26
joadavisor cassandra support from what I see15:26
witekcorrect15:26
witekwe could ping the guys if they're interested adding support for these15:27
witekanyway, we've side-tracked a little15:27
joadavisand add monasca-ceilometer to the list. :)15:27
witekI think Ansible is not providing that kind of comfort as distribution packages15:28
witekand I think most operators expect to install it from the package15:29
dougszI think we have a slightly different perspective. Galaxy roles have worked well for us.15:29
witekagree for your case15:29
dougszWhatever official solution there is, it would be nice to import it to Kolla Ansible. Packages would work, or Galaxy role. Not sure about importing OSA components.15:30
dougszAnyway, sorry for sidetracking!15:30
witekanother think I wanted to mention is auto-scaling discussions in Forum15:31
witekthey think about creating a new SIG for auto-scaling15:32
witekto unify approaches, identify problems, collect documentation15:32
joadavisso a separate SIG from self-healing?15:32
witekyes15:32
witekricolin from Heat drives it15:32
witekhttps://etherpad.openstack.org/p/autoscaling-integration-and-feedback15:33
witekself-healing had a meeting of course too:15:33
witekhttps://etherpad.openstack.org/p/berlin-self-healing-sig-brainstorm15:33
witekanother thought after Summit, we should put more attention to upgrading the middleware regularly15:35
witekin particular our ELK stack is very outdated15:35
witekdougsz: any comments about the summit from you?15:35
dougszWas great to see so many people turn up to the Monasca meetings15:36
witekyes, that was indeed very positive15:36
dougszI think you covered it well15:36
witekwe also had a chat with Fdaisuke_ about plans of monasca-analytics15:37
Fdaisuke_yes15:37
witekI asked for more work on monitoring related use-cases, like anomaly prediction or forecasting15:38
Fdaisuke_We talked about monasca-analytics as follows15:39
Fdaisuke_- Update top page of monasca-analytics15:39
Fdaisuke_- Submit sample with monasca15:40
Fdaisuke_And now, we update existing functions, and add new functions15:41
Fdaisuke_for monasca-analytics15:41
witekthanks, yes, I would like to have some simple example use case, how the repo can be used with the rest of Monasca15:42
witekwith easy step-by-step procedure15:42
witekoops, I wanted it to be a *short* recap15:43
joadavis:)15:43
joadavisI'm looking forward to the videos15:43
witekif there are no other comments, we can move on15:43
witek#topic specs15:44
*** openstack changes topic to "specs (Meeting topic: monasca)"15:44
witekhttps://review.openstack.org/58380315:44
witekI have added some small changes and comments yesterday15:45
joadavisthanks15:45
joadavisI'll take a look15:45
witekone question is, should we store all events in one ES index rotated daily?15:46
witekfor admin project15:46
witekhttps://review.openstack.org/60905515:47
joadavisI haven't looked at that side of events yet. And I'm not an ES expert. Anyone else have an opinion?15:47
dougszWhat are the other options? Classify events and save those to separate indices?15:47
dougszI suppose we still need to rotate them in that case.15:47
witekfor logs we store them per tenant15:48
witekKibana plugin filters the indices for a given project15:48
witekso you cannot see other projects' data15:48
witekfor events, we could do similarly and spread events across projects15:49
witekthere are some problems with that approach15:49
dougszYes - are all events associated with a project id?15:50
witekoperator(admin) would have to change the index for every project15:50
*** tssurya has quit IRC15:50
witekdougsz: that's another problem, not all events include project information15:50
joadavissome events, like keystone creating a user, are not associated with a project15:50
dougszHmm. It does seem easier to make them all admin only, at least to begin with.15:51
dougszWe could always have something which selectively copies out events to a tenants project if required in the future.15:52
witekfolks, please think through and leave the comment in review15:52
dougsz👍15:53
witekfor merging APIs https://review.openstack.org/60905515:53
witeksomeone from our team will polish it this week15:53
witekand I think is ready to merge15:53
witekthere are two others:15:54
witekMetrics retention policy enhancement15:54
witekhttps://review.openstack.org/54723315:54
witekSpec for Performance metrics of Python Persister15:54
witekhttps://review.openstack.org/60578215:54
joadavisI think both of those are ready to merge. We may have more details to add to metrics retention policy, but can add those in a subsequent commit15:55
witekOK, I'll try to find time to review15:56
joadavisthanks15:56
witek#topic self-healing meeting15:56
*** openstack changes topic to "self-healing meeting (Meeting topic: monasca)"15:56
witekone more announcement15:56
*** dconde has joined #openstack-meeting-315:56
witekSelf-healing SIG has now a regular meeting15:56
witekevery second Wed15:57
witekhttp://eavesdrop.openstack.org/#Self-healing_SIG_Meeting15:57
witekat 9am and 5pm UTC15:57
witekthe second one in one hour15:57
witekI have attended the morning one15:57
witekand advertised that we're looking for developers willing to work on Monasca - Vitrage integration15:58
joadaviscool15:58
witekthat's all from me15:59
witekthe time is also over15:59
dougszthanks all,  bye15:59
witekthank you everyone for joining15:59
koji_nthx!15:59
witeksee you next time15:59
*** dougsz has left #openstack-meeting-315:59
witek#endmeeting15:59
joadavisbye15:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:59
openstackMeeting ended Wed Nov 21 15:59:47 2018 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-11-21-15.00.html15:59
*** koji_n has quit IRC15:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-11-21-15.00.txt15:59
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2018/monasca.2018-11-21-15.00.log.html15:59
*** Fdaisuke_ has quit IRC16:00
*** joadavis has left #openstack-meeting-316:00
*** diablo_rojo has joined #openstack-meeting-316:16
*** jamesmcarthur has quit IRC16:17
*** jamesmcarthur_ has joined #openstack-meeting-316:18
*** bobh has quit IRC16:19
*** pcaruana has quit IRC16:50
*** e0ne has quit IRC17:02
*** sambetts|afk has quit IRC17:14
*** sambetts_ has joined #openstack-meeting-317:16
*** yamamoto has joined #openstack-meeting-317:16
*** yamamoto has quit IRC17:20
*** yamahata has quit IRC17:39
*** iyamahat has quit IRC17:39
*** jamesmcarthur_ has quit IRC17:41
*** jamesmcarthur has joined #openstack-meeting-317:42
*** iyamahat has joined #openstack-meeting-317:52
*** jamesmcarthur has quit IRC17:54
*** jamesmcarthur has joined #openstack-meeting-317:54
*** jamesmcarthur has quit IRC18:07
*** jamesmcarthur has joined #openstack-meeting-318:09
*** jamesmcarthur has quit IRC18:14
*** jamesmcarthur has joined #openstack-meeting-318:15
*** jamesmcarthur has quit IRC18:20
*** yamahata has joined #openstack-meeting-318:21
*** jamesmcarthur has joined #openstack-meeting-318:23
*** ralonsoh has quit IRC18:40
*** apetrich has quit IRC19:00
*** jamesmcarthur has quit IRC19:02
*** jamesmcarthur has joined #openstack-meeting-319:12
*** jamesmcarthur has quit IRC19:13
*** jamesmcarthur has joined #openstack-meeting-319:14
*** apetrich has joined #openstack-meeting-319:15
*** e0ne has joined #openstack-meeting-319:33
*** bobh has joined #openstack-meeting-319:35
*** dklyle has quit IRC19:38
*** jamesmcarthur has quit IRC19:40
*** raildo has quit IRC19:43
*** raildo has joined #openstack-meeting-319:43
*** jamesmcarthur has joined #openstack-meeting-319:44
*** dklyle has joined #openstack-meeting-319:46
*** apetrich has quit IRC20:01
*** jamesmcarthur has quit IRC20:25
*** bobh has quit IRC20:29
*** jamesmcarthur has joined #openstack-meeting-320:29
*** raildo has quit IRC20:35
*** bobh has joined #openstack-meeting-320:39
*** jamesmcarthur has quit IRC20:46
*** jamesmcarthur has joined #openstack-meeting-320:49
*** jamesmcarthur has quit IRC21:09
*** jamesmcarthur has joined #openstack-meeting-321:13
*** radeks_ has quit IRC21:22
*** bobh has quit IRC21:28
*** e0ne has quit IRC21:32
*** yamamoto has joined #openstack-meeting-321:50
*** diablo_rojo has quit IRC23:02
*** munimeha1 has quit IRC23:09
*** slaweq has quit IRC23:45

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!