Tuesday, 2020-05-26

*** vishalmanchanda has joined #openstack-monasca03:35
*** witek has joined #openstack-monasca07:05
*** dougsz has joined #openstack-monasca07:16
*** openstackstatus has quit IRC07:39
*** openstackstatus has joined #openstack-monasca07:40
*** ChanServ sets mode: +v openstackstatus07:40
*** vishalmanchanda has quit IRC07:44
*** dougsz has quit IRC07:55
*** k_mouza has joined #openstack-monasca09:02
witekchaconpiza: it seems libressl3.0-libcrypto and libressl3.0-libssl are only available in Alpine 3.11 now09:45
chaconpizaThat's the reason of check fail in Adrians change, right?09:51
chaconpizabuild-monasca-docker-image09:52
witekyes, saw it yesterday in another place as well10:03
chaconpizaOk, I am preparing the change10:03
witek+110:08
openstackgerritMartin Chacon Piza proposed openstack/monasca-common master: Bump sublibraries  https://review.opendev.org/73074910:08
chaconpizaThose sublibraries ^^ were updated on 24 of may http://dl-cdn.alpinelinux.org/alpine/edge/main/x86_64/10:09
witekI'm wondering if we shouldn't bump the base image to something like 3.8.3-alpine3.1110:11
chaconpizagood point, so far we have python:3.6.8-alpine3.910:12
witekwe could discuss it next week though10:13
*** vishalmanchanda has joined #openstack-monasca10:23
*** adriancz has joined #openstack-monasca11:19
openstackgerritWitold Bedyk proposed openstack/monasca-api master: [DevStack] Allow testing different Kibana versions  https://review.opendev.org/73063711:40
*** k_mouza_ has joined #openstack-monasca12:19
*** k_mouza has quit IRC12:22
*** jawad_axd has quit IRC12:39
*** jawad_axd has joined #openstack-monasca12:40
*** jawad_axd has quit IRC12:45
*** jawad_ax_ has joined #openstack-monasca12:45
chaconpizaCourtesy Monasca meeting reminder in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz,fouadben, amofakhar, haru5ny (haruki),kaiokmo,pandiyan,guilhermesp,chaconpiza,hosanai,Wasaac,brtknr,bandorf,adriancz12:48
*** bandorf has joined #openstack-monasca12:55
chaconpiza#startmeeting monasca13:00
openstackMeeting started Tue May 26 13:00:12 2020 UTC and is due to finish in 60 minutes.  The chair is chaconpiza. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
*** openstack changes topic to " (Meeting topic: monasca)"13:00
openstackThe meeting name has been set to 'monasca'13:00
chaconpizaHello everyone13:00
bandorfhello13:00
chaconpizaHi Matthias13:00
chaconpizaThe agenda as usual https://etherpad.opendev.org/p/monasca-team-meeting-agenda13:01
witekhi13:02
chaconpizaI have changed a little bit the order in the agenda to start with the action items from previous meetings13:02
chaconpizaHi Witek13:02
chaconpizawitek, thanks for leading last week.13:03
chaconpiza#topic Action items from previous meeting13:03
*** openstack changes topic to "Action items from previous meeting (Meeting topic: monasca)"13:03
witekI think there was one for me, which I forgot...13:03
chaconpizaFrom 2 weeks ago, I promised: chaconpiza Set minimum version for InfluxDB and influxdb-python-client. Clean the influxdb/metrics_repository13:04
chaconpizaIt will be on this change https://review.opendev.org/#/c/725779/ Still to do.13:04
chaconpizaI think witek means: #action create a story to fix Cassandra installation in DevStack plugin13:05
chaconpizaand #action witek mark monasca-tempest-python2-cassandra job as non-voting13:05
Wasaaco/13:06
witekright, will do right after the meeting, promise :)13:06
witekhi Wasaac13:06
chaconpizaHi Isaac, welcome13:06
chaconpizathanks witek13:06
chaconpizaalright, let's move to the first technical topic13:07
chaconpiza#topic monasca-docker and zookeeper13:07
*** openstack changes topic to "monasca-docker and zookeeper (Meeting topic: monasca)"13:07
bandorfOK, I'll try to explain quickly13:07
bandorfWe had a customer issue: disk space usage is grwoing for monasca-thresh.13:07
bandorfchaconpiza's investigation has shown: Caused by snapshots and logs from zookeeper13:08
bandorfMany steps of investigation later:13:08
bandorfIt looks like we're using in-process zookeeper in monasca-thresh for nimbus and supervisor (as mentioned in thresh log)13:09
bandorfAnd, we're using zookeeper container for event_spout and metric_spout.13:09
bandorfThis sounds very strange to me.13:10
bandorfDoes anybody know a reason for this?13:10
bandorfMy guess: This happens unintentionally; ideally, only zookeeper container should be used.13:11
bandorfHowever, I haven't figured out how to use zookeeper container for supervisor and nimbus13:11
bandorfAny thoughts about this?13:11
witekhere is a note on using monasca-thresh with Storm13:12
witekhttps://github.com/monasca/monasca-docker/tree/master/monasca-thresh#running-with-and-without-storm13:12
chaconpizaThe issue is easy to reproduce: Start the containers from monasca/monasca-docker and check the space used in /tmp inside the thresh container. It will slowly grow until no space left.13:12
bandorfwitek: OK, thanks, that might help! I will check for this13:13
chaconpizaFrom Strom documentation: "It's critical that you set up a cron to compact Zookeeper's data and transaction logs. The Zookeeper daemon does not do this on its own, and if you don't set up a cron, Zookeeper will quickly run out of disk space. See here for more details." http://storm.apache.org/releases/current/Setting-up-a-Storm-cluster.html13:14
bandorfNow, topic 2.6: I assume, nobody has come across the issue with huge disk usage?13:14
witekI reckon it might be using localhost, because monasca-docker runs one-node installation13:14
witekone more note on container configuration, you could compare the Kolla setup as well13:15
bandorfUnfortunately, the functionality "purgeTxn..." (don't remember the name exactly, doesn't seem to be available in "in-process zookeeper"13:15
bandorfCurrent approach: chaconpiza is going to write a script that deletes these files13:15
WasaacCan confirm monasca-thresh volume disk usage problem in kolla-ansible too13:16
witekWasaac: thanks13:17
bandorfAah, ok. Did you resolve the issue?13:17
chaconpizaWassac, or how do you workaround it?13:18
WasaacHave been looking at containers to mount and clean the volume13:18
WasaacBut it would be nicer to approach it from the source of the issue13:18
bandorfchaconpiza: Could you pls. quickly explain the solution with zookeeper 3.4.14 - autopurge?13:19
chaconpizaOther way to workaround it for the case of https://github.com/monasca/monasca-docker  is to stop, remove containers, recreate containers and restart them.13:20
chaconpizabandorf: Sure, official zookeeper docker image 3.4.14 implements the autopurge with an env. variable13:21
chaconpizazookeeper 3.4.5 implements this code: https://github.com/krux/zookeeper-pkg/blob/3.4.5/src/java/main/org/apache/zookeeper/server/PurgeTxnLog.java13:22
chaconpizaBut as Matthias said, the reduced zookeeper provided by storm doesn't includes this part13:23
chaconpizaOk, we will keep you informed about this topic.13:24
bandorfOK, thanks for your input anyway. Wasaac: We can stay in touch, regarding the temporary solution, we're going to provide. We can keep you updated.13:25
bandorfOK, chaconpiza was faster :-)13:25
chaconpiza:)13:25
chaconpiza#topic kafka version in monasca-docker13:25
*** openstack changes topic to "kafka version in monasca-docker (Meeting topic: monasca)"13:25
bandorfPls. check just the agenda. monasca-docker is stil using kafka 0.9. Is there any reason for this?13:26
witekI think not, it just hasn't been updated13:26
bandorfOK, thanks - topic done :-)13:26
witekfrom what I recall we tested it in monasca-docker env13:27
bandorfYes, we executed system tests @est13:27
chaconpiza#action Update kafka in monasca/monasca-docker13:27
witek+113:27
bandorf+113:27
chaconpizabandorf, would you like to own this action?13:28
chaconpizaLet's continue with the last topic13:29
bandorfI suggest, that we (EST) will take care of it. Assignment to an individual can be done later. But it will take time.13:29
chaconpizabandorf, thanks13:29
chaconpiza#topic PTG planning13:30
*** openstack changes topic to "PTG planning (Meeting topic: monasca)"13:30
chaconpizaKendall and Kendall contacted me to choose the option for the virtual PTG13:30
witekhaha13:30
witekor short, Kendalls :)13:31
chaconpizaone option was zoom and the second jitsi running on opendev13:31
chaconpizaright, the Kendalls13:31
chaconpizaI decided jitsi because it includes an etherpad13:31
chaconpizaIt will look like: https://meetpad.opendev.org/TestJitsiOnOpendev13:32
witekdo we have an option to have zoom as backup solution?13:32
chaconpizaThe final channel is not yet defined13:32
chaconpiza#action Ask The Kendalls for a zoom backup channel13:33
chaconpizagood point, I will ask them.13:33
chaconpizaalright, concerning the content and topics for the vPTG13:34
chaconpizawitek have already created this etherpad https://etherpad.opendev.org/p/monasca-ptg-victoria13:35
witekI think it would be helpful to create Stories for each topic shortly describing the motivation and possible implementation direction13:36
chaconpizawitek, do we have already the two time slots reserved? Tuesday June 2nd (7 - 8 UTC and 13 - 17 UTC)13:37
witekyes13:37
chaconpizaGreat, thanks13:37
witekwe're in the Folsom room13:38
witekhttps://object-storage-ca-ymq-1.vexxhost.net/swift/v1/6e4619c416ff4bd19e1c087f27a43eea/www-assets-prod/ptg/PTG2020-Schedule.pdf13:38
witekoh, I think all participants should register!13:38
witekit's for free13:39
*** jawad_ax_ has quit IRC13:39
chaconpiza+113:39
chaconpizaWasaac feel free to add the topics you consider important13:40
Wasaacchaconpiza: thanks13:40
chaconpizaWasaac do you know if Doug Szumski can join the PTG?13:41
bandorfIs there a link to register?13:41
witekhttps://www.openstack.org/ptg13:41
openstackgerritMerged openstack/monasca-common master: Bump sublibraries  https://review.opendev.org/73074913:41
bandorfThanks!13:41
witekI think we could send an email to the mailing list advertising our sessions13:42
chaconpiza#action advertising our sessions. I will take this action13:42
witekalso, there is the Automation SIG session on Thursday13:42
Wasaacchaconpiza: I don't know what dougz schedule is like but he'll make it if able I'm sure13:43
witekthe agenda is here13:43
witek https://etherpad.opendev.org/p/Automation-2020-VPTG13:43
witekI've just noticed our Etherpad is not linked correctly13:45
witekhttp://ptg.openstack.org/etherpads.html13:45
chaconpizaThanks for the SIG agenda13:45
witekI can update it with openstackptg bot13:46
witekinstructions at the bottom13:46
chaconpizathanks13:46
chaconpizaOk, let's continue this week extending the Monasca PTG topics.13:48
chaconpiza#topic AOB13:48
*** openstack changes topic to "AOB (Meeting topic: monasca)"13:48
chaconpizaI have a small technical question13:49
chaconpizaIn monasca-notification and monasca-persister still some traces of ujson13:49
chaconpizahttp://codesearch.openstack.org/?q=ujson&i=nope&files=&repos=openstack/monasca-agent,openstack/monasca-analytics,openstack/monasca-api,openstack/monasca-ceilometer,openstack/monasca-common,openstack/monasca-events-api,openstack/monasca-grafana-datasource,openstack/monasca-kibana-plugin,openstack/monasca-log-api,openstack/monasca-notification,openstack/monasca-persister,openstack/monasca-specs,openstack/mon13:49
chaconpizaasca-statsd,openstack/monasca-tempest-plugin,openstack/monasca-thresh,openstack/monasca-transform,openstack/monasca-ui,openstack/python-monascaclient13:49
chaconpizado we need them?13:50
witekit's only lower-constraints, right?13:50
chaconpizayes13:50
witekno, should be dropped13:51
chaconpiza#action remove ujson traces from notificatin and persister13:51
chaconpizawitek, would you like to send the change?13:51
witekoki13:52
chaconpizathanks13:52
chaconpizaOk, those are all topics from the agenda.13:52
witekanother AI for everyone13:53
witekthink of topics for PTG13:53
witekalready posted and new13:54
WasaacWill discuss with the StackHPC team13:54
witekthanks13:55
chaconpizaThanks for joining today's meeting see you next week in the vPTG.13:55
Wasaaco/13:55
witekthanks chaconpiza13:55
witekthanks everyone13:55
witeksee you next week13:55
chaconpizao/13:56
bandorfTnaks, good-bye13:56
chaconpiza#endmeeting13:56
*** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca"13:56
openstackMeeting ended Tue May 26 13:56:08 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:56
openstackMinutes:        http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-26-13.00.html13:56
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-26-13.00.txt13:56
openstackLog:            http://eavesdrop.openstack.org/meetings/monasca/2020/monasca.2020-05-26-13.00.log.html13:56
witekWasaac: how is the Corona situation in UK?13:56
witekI know, boring topic...13:56
WasaacSlowly easing restrictions I think but it's all the same to me13:57
Wasaac Will be stuck at home until they allow hotdesk places to open again13:57
WasaacThat being said, looking outside you wouldn't know there was a pandemic, there's people everywhere13:59
witekin Bavaria we have school holidays in the following two weeks, let see how it impacts the situation13:59
*** bandorf has quit IRC14:50
openstackgerritWitold Bedyk proposed openstack/monasca-persister master: Remove ujson from lower-constraints  https://review.opendev.org/73085615:37
openstackgerritWitold Bedyk proposed openstack/monasca-notification master: Remove ujson from lower-constraints  https://review.opendev.org/73085715:39
*** jawad_axd has joined #openstack-monasca15:59
*** jawad_axd has quit IRC16:04
openstackgerritWitold Bedyk proposed openstack/monasca-persister master: Add Python3 victoria unit tests  https://review.opendev.org/72251516:22
*** coreycb has quit IRC16:51
*** vishalmanchanda has quit IRC16:54
*** coreycb has joined #openstack-monasca16:59
openstackgerritMerged openstack/monasca-persister master: Remove .testr.conf  https://review.opendev.org/72915217:01
*** k_mouza_ has quit IRC17:04
openstackgerritMerged openstack/monasca-api master: [DevStack] Allow testing different Kibana versions  https://review.opendev.org/73063717:07
openstackgerritMerged openstack/monasca-log-api master: Update nodejs and npm packages  https://review.opendev.org/70453617:08
openstackgerritMerged openstack/monasca-persister master: Remove ujson from lower-constraints  https://review.opendev.org/73085617:09
openstackgerritWitold Bedyk proposed openstack/monasca-persister master: Add Python3 victoria unit tests  https://review.opendev.org/72251517:15
*** vishalmanchanda has joined #openstack-monasca17:22
*** vishalmanchanda has quit IRC17:33
*** KeithMnemonic has joined #openstack-monasca17:42
openstackgerritMerged openstack/monasca-api master: Switch to newer openstackdocstheme and reno versions  https://review.opendev.org/72997717:43
*** witek has quit IRC17:43
*** irclogbot_2 has quit IRC18:26
*** witek has joined #openstack-monasca18:27
*** irclogbot_2 has joined #openstack-monasca18:30
*** jawad_axd has joined #openstack-monasca18:56
openstackgerritMerged openstack/monasca-notification master: Remove ujson from lower-constraints  https://review.opendev.org/73085719:02
openstackgerritMerged openstack/monasca-log-api master: Switch to newer openstackdocstheme and reno versions  https://review.opendev.org/73034619:10
*** jawad_axd has quit IRC19:24
*** jawad_axd has joined #openstack-monasca19:25
openstackgerritAdrian Czarnecki proposed openstack/monasca-agent master: Improve error handling in method that creates Monasca client  https://review.opendev.org/72415519:28
*** witek has quit IRC19:37
openstackgerritMerged openstack/monasca-common master: Remove .testr.conf  https://review.opendev.org/72915019:59
openstackgerritMerged openstack/monasca-api master: Move DB migrations documentation to its own file  https://review.opendev.org/73035619:59
*** witek has joined #openstack-monasca20:12
*** irclogbot_2 has quit IRC20:22
*** irclogbot_0 has joined #openstack-monasca20:25
*** witek has quit IRC20:52
openstackgerritAdrian Czarnecki proposed openstack/monasca-agent master: Improve error handling in method that creates Monasca client  https://review.opendev.org/72415523:20

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!