| *** bobh has joined #openstack-monasca | 00:08 | |
| *** altlogbot_0 has quit IRC | 00:10 | |
| *** altlogbot_2 has joined #openstack-monasca | 00:12 | |
| *** bobh has quit IRC | 00:18 | |
| *** bobh has joined #openstack-monasca | 00:48 | |
| *** bobh has quit IRC | 01:08 | |
| *** bobh has joined #openstack-monasca | 01:30 | |
| *** bobh has quit IRC | 01:42 | |
| *** eandersson has joined #openstack-monasca | 03:27 | |
| *** portdirect has quit IRC | 05:27 | |
| *** adriancz has quit IRC | 05:31 | |
| *** adriancz has joined #openstack-monasca | 05:33 | |
| *** portdirect has joined #openstack-monasca | 05:34 | |
| *** witek has joined #openstack-monasca | 06:52 | |
| openstackgerrit | Arseni Lipinski proposed openstack/monasca-common master: Change links usage https://review.opendev.org/659073 | 07:12 |
|---|---|---|
| witek | adriancz: Are you working on Falcon 2.0 support in log-api? | 07:13 |
| *** pcaruana has joined #openstack-monasca | 07:17 | |
| adriancz | @witek yes | 07:19 |
| witek | Could you please add the task here and assign to yourself: https://storyboard.openstack.org/#!/story/2005695 | 07:28 |
| adriancz | ok ; ) | 07:30 |
| witek | thanks, want to avoid duplicating the efforts | 07:31 |
| witek | I think Doug should be back later today, so you can also ping him if he has any ideas what is missing there | 07:32 |
| *** dougsz has joined #openstack-monasca | 08:15 | |
| openstackgerrit | Witold Bedyk proposed openstack/monasca-specs master: Resolve issues with Sphinx 2.0 https://review.opendev.org/660604 | 08:36 |
| openstackgerrit | Witold Bedyk proposed openstack/monasca-specs master: Add Train priorities page https://review.opendev.org/660459 | 08:43 |
| openstackgerrit | Witold Bedyk proposed openstack/python-monascaclient master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654762 | 08:51 |
| openstackgerrit | Merged openstack/monasca-common master: Upgrade Python version https://review.opendev.org/659567 | 09:01 |
| openstackgerrit | Witold Bedyk proposed openstack/monasca-specs master: Spec for Performance metrics of Python Persister https://review.opendev.org/605782 | 09:15 |
| *** bandorf has joined #openstack-monasca | 09:55 | |
| *** erolg has joined #openstack-monasca | 10:30 | |
| openstackgerrit | zhulingjie proposed openstack/monasca-persister master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654844 | 10:42 |
| openstackgerrit | Merged openstack/python-monascaclient master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654762 | 10:42 |
| openstackgerrit | zhulingjie proposed openstack/monasca-persister master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654844 | 10:43 |
| *** toabctl has joined #openstack-monasca | 10:58 | |
| *** halbbalda has joined #openstack-monasca | 11:38 | |
| *** bobh has joined #openstack-monasca | 12:10 | |
| *** bobh has quit IRC | 12:19 | |
| openstackgerrit | Matthias Bandorf proposed openstack/monasca-thresh master: Enable monasca-thresh to set topology.max.spout.pending f. Storm https://review.opendev.org/660703 | 12:45 |
| openstackgerrit | zhulingjie proposed openstack/monasca-persister master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654844 | 12:56 |
| *** adriancz has quit IRC | 13:10 | |
| *** kaiokmo has joined #openstack-monasca | 13:49 | |
| *** bobh has joined #openstack-monasca | 13:55 | |
| openstackgerrit | Witold Bedyk proposed openstack/monasca-ui master: Sync Sphinx requirement https://review.opendev.org/660719 | 14:00 |
| *** koji_n has joined #openstack-monasca | 14:12 | |
| openstackgerrit | zhulingjie proposed openstack/monasca-persister master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654844 | 14:20 |
| *** bobh has quit IRC | 14:30 | |
| *** eandersson has left #openstack-monasca | 14:54 | |
| *** hosanai has joined #openstack-monasca | 14:58 | |
| witek | Courtesy Monasca meeting reminder in #openstack-monasca: witek, jayahn,iurygregory,ezpz,igorn,haad,sc,joadavis, akiraY,tobiajo,dougsz_,fouadben, amofakhar, aagate, haru5ny (haruki),kaiokmo,pandiyan,charana,guilhermesp,chaconpiza,toabctl | 14:59 |
| witek | #startmeeting monasca | 15:00 |
| openstack | Meeting started Wed May 22 15:00:53 2019 UTC and is due to finish in 60 minutes. The chair is witek. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: monasca)" | 15:01 | |
| openstack | The meeting name has been set to 'monasca' | 15:01 |
| witek | hello everyone | 15:01 |
| bandorf | Hello | 15:01 |
| Dobroslaw | Hi | 15:01 |
| dougsz | hey all | 15:01 |
| koji_n | hello | 15:01 |
| joadavis | greetings | 15:01 |
| hosanai | hello | 15:01 |
| witek | hi, agenda as usual: | 15:01 |
| witek | https://etherpad.openstack.org/p/monasca-team-meeting-agenda | 15:01 |
| witek | #topic monasca-thresh config tuning | 15:02 |
| *** openstack changes topic to "monasca-thresh config tuning (Meeting topic: monasca)" | 15:02 | |
| *** haru5ny has joined #openstack-monasca | 15:02 | |
| witek | bandorf: thanks for putting this up, could you shortly summarize which problems it addresses? | 15:03 |
| bandorf | Regarding monasca-thresh: We did a change due to a customer issue where thresh finally crashed because of too high load. | 15:03 |
| bandorf | The change I uploaded is just a precondition so that the load can be controlled by setting Topology.max.spout.pending | 15:03 |
| bandorf | This setting will be used only if a message has a unique id. | 15:04 |
| bandorf | Thechange simply generates and sets this unique id | 15:04 |
| witek | what is the result of setting this value? | 15:05 |
| bandorf | The value basically controls the number of messages in storm not yet acknowledged. | 15:06 |
| bandorf | Thus, RAM consumption canbe controlled. | 15:06 |
| witek | what about CPU? | 15:06 |
| bandorf | In our scenario, RAM usage got higher and higher. Then, garbage collector ran frequently, without freeing much space. | 15:07 |
| bandorf | The lower you set the value the less RAM / CPU is being used. | 15:07 |
| bandorf | However, shouldn't be too low either. | 15:07 |
| dougsz | Nice work bandorf, I will take it for a spin | 15:07 |
| bandorf | CPU load gets high, I think, mainly because garbage collector is running more frequently. | 15:08 |
| witek | do you think we could set some reasonable default value in DevStack plugin as well? | 15:08 |
| bandorf | Anyway, if the value is decreased, CPU load will go down as well. | 15:08 |
| bandorf | We did not do extensive testing with different combinations. | 15:08 |
| dougsz | +1 for sensible default | 15:08 |
| bandorf | Basically, we provided some more heap (256 MB -> 768 MB), limited the number of messages in not ACK'd to 500. | 15:09 |
| bandorf | This seems a reasonable combination for smaller machines (16 GB - 32 GB RAM). | 15:10 |
| bandorf | Anyway: With the change proposed, you can do this kind of limitation. | 15:10 |
| bandorf | If the value max.spout.pending isn't set, nothing will change. | 15:11 |
| bandorf | So, there's no risk in defining the unique id. You then can set max.spout.pending or not | 15:11 |
| witek | right, sounds good to me | 15:12 |
| bandorf | My understanding: devstack will mainly be used for testing, i.e. smaller machines. | 15:12 |
| witek | regarding recommended values I see two options: | 15:12 |
| bandorf | My idea would be to start with similar values as we did | 15:12 |
| witek | * we can set these in DevStack plugin as the reference setup | 15:12 |
| witek | * write short list of tunable options in README | 15:13 |
| bandorf | Of course, it would be nice to test on several machines, with several parameters. | 15:13 |
| bandorf | But this would be some huge effort, I guess. | 15:13 |
| bandorf | Regaring the generation of unique ids: I tested. On my machine, it takes 240 ms for 10**6 ids | 15:15 |
| witek | short enough | 15:16 |
| witek | I will definitely try these values in our setup and check what's the impact | 15:17 |
| bandorf | I think you could play with values between 100 and 1000 for ...spout.pending. | 15:18 |
| bandorf | I plan to do some further testing as well. | 15:18 |
| witek | OK, sounds good | 15:18 |
| dougsz | same - I will set a default in Kolla Ansible | 15:19 |
| witek | then we can add some values to DevStack and document in README | 15:19 |
| bandorf | So, can then somebody review the code I uploaded? This still as no significant impact, is just the precondition | 15:19 |
| bandorf | as=has | 15:20 |
| witek | sure, adding myself | 15:20 |
| dougsz | +1 | 15:20 |
| bandorf | OK, great, thanks | 15:20 |
| witek | #action check optimal value of topology.max.spout.pending and heap size for monasca-thresh | 15:22 |
| witek | any other comments? | 15:22 |
| bandorf | In our config (docker), I chaanged one more param: # of partitions, I think. This has been set to 64. However, we don't use this parallelism, and it generates some overhead, as to my understanding. We reduced to 16 | 15:22 |
| witek | sounds reasonable to me | 15:23 |
| bandorf | I haven't checked in devstack yet | 15:24 |
| witek | #topic Falcon 2.0 | 15:24 |
| *** openstack changes topic to "Falcon 2.0 (Meeting topic: monasca)" | 15:24 | |
| witek | https://storyboard.openstack.org/#!/story/2005695 | 15:24 |
| sc | interesting story | 15:25 |
| *** bandorf has quit IRC | 15:25 | |
| witek | https://review.opendev.org/659264 | 15:25 |
| witek | unit and tempest tests for monasca-api are passing now | 15:26 |
| witek | the code seems not to be backwards compatible | 15:26 |
| witek | is it a problem for anyone? | 15:26 |
| sc | monasca-tempest-python2-influxdbFAILURE in 42m 20s | 15:27 |
| dougsz | Not for me | 15:27 |
| witek | sc: that's a random failure, in PS7 it passed | 15:28 |
| dougsz | Just the log API which needs updating right? | 15:28 |
| sc | OK | 15:28 |
| sc | my idea is to go forward and do not turn back | 15:28 |
| witek | dougsz: right, Adrian works on it | 15:28 |
| witek | I haven't seen any PS though | 15:29 |
| dougsz | Great :) thanks to adrian | 15:29 |
| witek | perhaps you could sync with him tomorrow and see if there are no blockers? | 15:30 |
| witek | otherwise I would suggest to just set this job as non-voting for now | 15:30 |
| dougsz | sounds good to me | 15:30 |
| witek | it blocks monasca-api for a while now already | 15:30 |
| dougsz | Will the log-api change get blocked on the Monasca API change not being merged? | 15:31 |
| sc | yes as far as I understand | 15:31 |
| witek | I think not, it does not require monasca-api really | 15:31 |
| sc | but IIRC log-api is failing same way | 15:32 |
| witek | right, so monasca-api change should depend on monasca-log-api | 15:33 |
| dougsz | anyway, as you say, if we hit an issue, we can just make the check non-gating temporarily | 15:33 |
| witek | right | 15:33 |
| witek | #topic monasca-persister instrumentation | 15:34 |
| *** openstack changes topic to "monasca-persister instrumentation (Meeting topic: monasca)" | 15:34 | |
| witek | https://review.opendev.org/659264 | 15:34 |
| joadavis | As we had talked about deprecating the java persister, I thought it might be worth finally merging that spec | 15:34 |
| witek | sorry, wrong url | 15:35 |
| witek | https://review.opendev.org/#/c/605782/ | 15:35 |
| joadavis | should we leave it in the rocky/approved location where it started, or move it forward to train/approved? | 15:35 |
| witek | don't have a strong opinion | 15:36 |
| joadavis | I'm ok leaving it as-is, if someone wants to workflow it | 15:36 |
| witek | I think we can merge it as-is | 15:37 |
| witek | #topic Train priorities | 15:38 |
| *** openstack changes topic to "Train priorities (Meeting topic: monasca)" | 15:38 | |
| witek | I've put together the results from the spreadsheet | 15:38 |
| witek | https://review.opendev.org/660459 | 15:38 |
| witek | not all descriptions are included | 15:38 |
| witek | please feel free to add | 15:39 |
| witek | also, if anyone would like to take the ownership of any task | 15:39 |
| witek | I've pushed another change to fix docs job in this repo: | 15:40 |
| witek | https://review.opendev.org/660604 | 15:40 |
| witek | the table formatting changed | 15:40 |
| witek | but I think it's not that critical | 15:41 |
| witek | any comments on this? | 15:41 |
| witek | #topic Meeting reminders | 15:42 |
| *** openstack changes topic to "Meeting reminders (Meeting topic: monasca)" | 15:42 | |
| witek | tomorrow is the meeting day :) | 15:42 |
| joadavis | doc change looks good so far | 15:42 |
| witek | joadavis: thanks | 15:42 |
| sc | tomorrow???? | 15:42 |
| witek | yes, for Telemetry team | 15:43 |
| witek | and Billing initiative | 15:43 |
| sc | OK, time? | 15:43 |
| witek | Telemetry - 2am and 8am UTC | 15:43 |
| joadavis | Is the self-healing meeting this week also? | 15:43 |
| witek | today, right! | 15:43 |
| witek | Billing initiative - tomorrow, 2pm UTC | 15:44 |
| sc | I'm busy both time | 15:44 |
| witek | #topic open stage | 15:45 |
| *** openstack changes topic to "open stage (Meeting topic: monasca)" | 15:45 | |
| joadavis | I think I also have conflicts (church meeting, sleep) | 15:45 |
| joadavis | for open stage - I am continuing on the py3 conversion for monasca-agent | 15:45 |
| witek | joadavis: :) yes, sleep is an important calendar item | 15:45 |
| witek | that's cool, thanks | 15:46 |
| sc | joadavis: grand | 15:46 |
| joadavis | I've hit some odd py2 to 3 differences that are hard to google, but have made some progress this week | 15:46 |
| witek | https://review.opendev.org/657829 | 15:47 |
| witek | that's the one, right? | 15:47 |
| joadavis | yes | 15:47 |
| joadavis | The failures on mock-open have me stumped. I think i can eventually figure out the binary string formatting. | 15:48 |
| witek | adding Adrian to review as well | 15:49 |
| witek | sc: did you have time to have a look at OSA? | 15:50 |
| joadavis | I saw an email about OSA that someone was pushing to deprecate, though sc had emailed he would look at supporting it | 15:50 |
| sc | not that much, I think that the best decision is to leave they abandon the roles and integrate new in the future | 15:50 |
| witek | :( | 15:51 |
| sc | tomorrow I'll my mid year review with my boss and I'll ask for time to develop on monasca | 15:52 |
| witek | nice, fingers crossed | 15:52 |
| sc | we had no time to speak since I got back from Denver | 15:52 |
| sc | so everything depends on tomorrow afternoon at 2:30GMT | 15:52 |
| witek | do we have anything else? | 15:53 |
| witek | I guess, we can wrap up | 15:53 |
| witek | thanks for joining | 15:54 |
| joadavis | thanks all | 15:54 |
| witek | see you next week | 15:54 |
| dougsz | thanks all | 15:54 |
| witek | #endmeeting | 15:54 |
| sc | see you | 15:54 |
| *** openstack changes topic to "OpenStack Monitoring as a Service | https://wiki.openstack.org/wiki/Monasca" | 15:54 | |
| haru5ny | thank you | 15:54 |
| openstack | Meeting ended Wed May 22 15:54:20 2019 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:54 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-22-15.00.html | 15:54 |
| koji_n | thx | 15:54 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-22-15.00.txt | 15:54 |
| hosanai | thanks, bye | 15:54 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/monasca/2019/monasca.2019-05-22-15.00.log.html | 15:54 |
| *** koji_n has quit IRC | 15:54 | |
| *** hosanai has quit IRC | 15:54 | |
| *** haru5ny has quit IRC | 15:54 | |
| openstackgerrit | Merged openstack/monasca-specs master: Resolve issues with Sphinx 2.0 https://review.opendev.org/660604 | 15:58 |
| *** witek has quit IRC | 16:01 | |
| *** dougsz has quit IRC | 17:03 | |
| *** bobh has joined #openstack-monasca | 17:06 | |
| *** bobh has quit IRC | 17:20 | |
| *** gyee has joined #openstack-monasca | 17:39 | |
| *** jgrassler has joined #openstack-monasca | 17:39 | |
| *** bobh has joined #openstack-monasca | 17:57 | |
| *** bobh has quit IRC | 18:28 | |
| *** bobh has joined #openstack-monasca | 19:16 | |
| *** bobh has quit IRC | 20:16 | |
| *** pcaruana has quit IRC | 20:20 | |
| *** joadavis has quit IRC | 22:20 | |
| *** joadavis has joined #openstack-monasca | 22:29 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!