-@gerrit:opendev.org- Bernhard Berg proposed: [zuul/zuul] 905700: Add a zuul unreachable variable to indicate if a host node is unreachable https://review.opendev.org/c/zuul/zuul/+/905700 | 09:25 | |
-@gerrit:opendev.org- Fabien Boucher proposed on behalf of Artem Goncharov: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/813136 | 10:06 | |
-@gerrit:opendev.org- Fabien Boucher proposed: [zuul/zuul] 906355: gitlab doc - update the reference pipelines https://review.opendev.org/c/zuul/zuul/+/906355 | 10:37 | |
@mfeder:matrix.org | Hello, I'm curious about the configuration and setup of Graphite, specifically regarding retention, used for https://grafana.opendev.org/. I noticed significant disk consumption (around 10GB in approximately 4 hours) when collecting metrics from a single, non-HA instance of Zuul. I came across this configuration at https://opendev.org/opendev/system-config/src/branch/master/playbooks/roles/graphite/templates. Is this the configuration employed for Graphite at grafana.opendev.org? | 11:45 |
---|---|---|
@mhuin:matrix.org | nice! | 12:46 |
-@gerrit:opendev.org- Benedikt Löffler proposed: [zuul/zuul] 906524: Test 10s delay bug after skipped task https://review.opendev.org/c/zuul/zuul/+/906524 | 14:14 | |
@jim:acmegating.com | mfeder: yes, that's the actual production config with the retention and aggregation tuned for use with statsd | 14:37 |
@jim:acmegating.com | mfeder: you can see the disk usage at http://cacti.openstack.org/cacti/graph_view.php -- curerntly 385GB | 14:38 |
@jim:acmegating.com | mfeder: disk usage doesn't scale by time, it scales by metric | 14:39 |
-@gerrit:opendev.org- Zuul merged on behalf of Fabien Boucher: [zuul/zuul] 906103: gitlab - avoid trigger build when reviewers added/removed https://review.opendev.org/c/zuul/zuul/+/906103 | 15:38 | |
-@gerrit:opendev.org- Zuul merged on behalf of Fabien Boucher: [zuul/zuul] 906355: gitlab doc - update the reference pipelines https://review.opendev.org/c/zuul/zuul/+/906355 | 18:43 | |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906544: Add support for AWS IMDSv2 https://review.opendev.org/c/zuul/nodepool/+/906544 | 19:21 | |
@mfeder:matrix.org | corvus: Thank you. I applied the same Graphite configs, and the deployment looks good so far. | 20:23 |
Just one thing is missing on my side. I'm wondering how you collect statsd metrics from ZooKeeper. I did not find any supported direct mechanism on the ZooKeeper side. So, my assumption is that you use a path like this: ZooKeeper JMX Metrics -> Metrics Collection Agent (e.g., Jolokia) -> Statsd/Graphite. | ||
Could you drop some hints on this as well? | ||
-@gerrit:opendev.org- Fabien Boucher proposed on behalf of Artem Goncharov: [zuul/zuul] 813136: Check blocking_discussions_resolved in gitlab driver https://review.opendev.org/c/zuul/zuul/+/813136 | 20:38 | |
@jim:acmegating.com | mfeder: opendev uses a script i wrote called zookeeper-statsd.py -- you should be able to find it in the system-config repo. alternatively, zk has a prometheus exporter now if you have a prometheus laying around. | 20:56 |
@fungicide:matrix.org | yeah, if we already had a prometheus live in the opendev collaboratory, we'd likely use that instead of a home-grown statsd emitter script | 20:59 |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/zuul] 906433: Add support for persisting add_host across playbooks https://review.opendev.org/c/zuul/zuul/+/906433 | 21:46 | |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906596: Fix duplicate fd registration in nodescan https://review.opendev.org/c/zuul/nodepool/+/906596 | 23:00 | |
-@gerrit:opendev.org- James E. Blair https://matrix.to/#/@jim:acmegating.com proposed: [zuul/nodepool] 906544: Add support for AWS IMDSv2 https://review.opendev.org/c/zuul/nodepool/+/906544 | 23:11 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!