Tuesday, 2019-05-14

*** openstackgerrit has joined #openstack-watcher02:27
openstackgerritMerged openstack/python-watcherclient master: Use upper-constraints in tox runs  https://review.opendev.org/65856702:27
openstackgerritMerged openstack/watcher master: Remove watcher.openstack.common=WARN from _DEFAULT_LOG_LEVELS  https://review.opendev.org/65839902:38
openstackgerritMerged openstack/watcher-tempest-plugin master: check status when live migration  https://review.opendev.org/65872502:38
openstackgerritMerged openstack/watcher-tempest-plugin master: Add tempest voting  https://review.opendev.org/65646002:38
openstackgerritMerged openstack/watcher master: allow building docs without ceilometer client  https://review.opendev.org/65880202:38
openstackgerritlicanwei proposed openstack/watcher-specs master: Add Placement helper  https://review.opendev.org/65644803:04
*** adiantum has joined #openstack-watcher05:21
openstackgerritchenker proposed openstack/watcher master: Update Sphinx requirement  https://review.opendev.org/65896505:41
openstackgerritlicanwei proposed openstack/watcher master: update api version history  https://review.opendev.org/65896605:43
*** adiantum has quit IRC05:55
openstackgerritchenker proposed openstack/watcher master: Update Sphinx requirement  https://review.opendev.org/65896506:05
openstackgerritlicanwei proposed openstack/watcher master: Update migration notification  https://review.opendev.org/65897307:15
*** tssurya has joined #openstack-watcher09:42
openstackgerritchenker proposed openstack/watcher-specs master: Spec for support-keystoneclient-option.rst  https://review.opendev.org/65900809:52
openstackgerritchenker proposed openstack/watcher master: support-keystoneclient-option  https://review.opendev.org/65810210:12
openstackgerritchenker proposed openstack/watcher master: support-keystoneclient-option  https://review.opendev.org/65810210:44
openstackgerritchenker proposed openstack/watcher master: support-keystoneclient-option  https://review.opendev.org/65810210:46
openstackgerritchenker proposed openstack/watcher master: support-keystoneclient-option  https://review.opendev.org/65810211:20
openstackgerritchenker proposed openstack/watcher master: Fix_inappropriate_name  https://review.opendev.org/65904211:28
*** josecastroleon has quit IRC11:35
openstackgerritDantali0n proposed openstack/watcher master: [WIP] Grafana proxy datasource to retrieve metrics  https://review.opendev.org/64934112:38
openstackgerritchenker proposed openstack/watcher master: Fix_inappropriate_name  https://review.opendev.org/65904212:38
*** mriedem has joined #openstack-watcher12:49
openstackgerritDantali0n proposed openstack/watcher master: [WIP] Grafana proxy datasource to retrieve metrics  https://review.opendev.org/64934113:09
openstackgerritchenker proposed openstack/watcher master: Use base_strategy's add_action_migrate method  https://review.opendev.org/65906213:35
mriedemDantalion: so at cern you guys use https://github.com/cernops/collectd-puppet to collect metrics on the compute nodes rather than use something like ceilometer-agent right?13:52
openstackgerritchenker proposed openstack/watcher master: Use base_strategy's add_action_migrate method  https://review.opendev.org/65906213:55
Dantalionmriedem: Yes metrics are either collected via collectd or using lemon although the later is being deprecated as we speak14:07
Dantalionmriedem: Collected metrics are fed into several different types of databases but mostly influxdb and these databases are configured into grafana14:07
Dantalionmriedem: we collect metrics both for compute nodes and for instances although the typically end up in different databases for scalability reasons14:08
mriedemb/c you've got tons more instances than nodes, right14:14
Dantalionmriedem: Yes and scaling horizontally with influxdb on the same databases has an expensive license fee while setting up multiple independent instances of influx does not14:15
mriedemright now we've still got ceilometer-agent on all the compute nodes which is a major perf issue, so looking at alternatives to that14:15
mriedemand we've got all this data in mongodb right now, but there isn't a clean way it looks like to use mongodb as a data source for grafana14:15
DantalionI can imagine, in general collectd has been working very well for us and is lightweight altough on the influx side that requires some more grunt to work properly.14:23
openstackgerritDantali0n proposed openstack/watcher-specs master: Spec for Grafana proxy datasource  https://review.opendev.org/65909915:17
openstackgerritDantali0n proposed openstack/watcher master: [WIP] Grafana proxy datasource to retrieve metrics  https://review.opendev.org/64934115:49
mriedemDantalion: has cern ever thought/talked about sharding watcher per cell? i'm not sure how feasible that is, just wondering if it would help scale watcher's db and mq if it were isolated per cell rather than global.15:50
*** openstackgerrit has quit IRC15:54
*** tssurya has quit IRC17:06
*** openstackgerrit has joined #openstack-watcher17:25
openstackgerritDantali0n proposed openstack/watcher-specs master: Spec for Grafana proxy datasource  https://review.opendev.org/65909917:25
openstackgerritMatt Riedemann proposed openstack/watcher master: Enhance the collector_plugins option help text  https://review.opendev.org/65913318:19
mriedemi'm a little confused about this change to the compute model collector based on audit scope https://review.opendev.org/#/c/640585/10/watcher/decision_engine/model/collector/nova.py@180 - on startup of the decision-engine service, it looks like it will never pre-load the data model even though the spec seems to imply that it should: https://review.opendev.org/#/c/641606/2/specs/stein/approved/scope-for-watcher-datamodel.rst18:43
mriedemdoesn't this mean that the compute cdm is always built fresh for every compute-related audit?18:43
mriedemregardless of whether or not the audit is scoped18:44
mriedemalso, i know i'm really late to the part of this change in stein, but i've left several comments about potential problems in the compute cdm builder https://review.opendev.org/#/c/640585/20:02
mriedemat the least there are performance inefficiencies in using the compute API20:02
mriedemi tried to summarize in the ML20:59
openstackgerritMatt Riedemann proposed openstack/watcher master: Remove dead code from NovaClusterDataModelCollector  https://review.opendev.org/65917521:49
openstackgerritMatt Riedemann proposed openstack/watcher master: WIP: Profile the nova CDM builder code  https://review.opendev.org/65918323:10
*** irclogbot_1 has quit IRC23:45
*** irclogbot_3 has joined #openstack-watcher23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!