| *** Nepoc has joined #openstack-telemetry | 00:02 | |
| *** thorst_ has joined #openstack-telemetry | 00:02 | |
| *** Qiming has quit IRC | 00:23 | |
| *** Nepoc has quit IRC | 00:25 | |
| *** Nepoc has joined #openstack-telemetry | 00:26 | |
| *** KrishR has joined #openstack-telemetry | 00:31 | |
| *** KrishR has quit IRC | 00:36 | |
| *** bapalm has quit IRC | 00:37 | |
| *** yuntongjin has joined #openstack-telemetry | 00:40 | |
| *** yuntongjin has quit IRC | 00:46 | |
| *** Nepoc has quit IRC | 00:49 | |
| *** Nepoc has joined #openstack-telemetry | 00:49 | |
| *** bapalm has joined #openstack-telemetry | 00:54 | |
| *** harlowja has quit IRC | 00:55 | |
| *** cheneydc has joined #openstack-telemetry | 01:00 | |
| *** jwcroppe has quit IRC | 01:04 | |
| *** Nepoc has quit IRC | 01:05 | |
| *** Nepoc has joined #openstack-telemetry | 01:05 | |
| *** Qiming has joined #openstack-telemetry | 01:19 | |
| *** Nepoc has quit IRC | 01:30 | |
| *** Nepoc has joined #openstack-telemetry | 01:30 | |
| *** caisan has joined #openstack-telemetry | 01:32 | |
| *** Eris72 has quit IRC | 01:47 | |
| *** Nepoc has quit IRC | 01:56 | |
| openstackgerrit | Merged openstack/ceilometer: Adjust log levels for InstanceShutOffException https://review.openstack.org/289677 | 01:57 |
|---|---|---|
| *** Nepoc has joined #openstack-telemetry | 02:06 | |
| *** safchain has quit IRC | 02:13 | |
| *** liusheng has quit IRC | 02:30 | |
| *** liusheng has joined #openstack-telemetry | 02:32 | |
| openstackgerrit | Ryota MIBU proposed openstack/ceilometer: tempest: migrate api and scnario tests from tempest https://review.openstack.org/268054 | 02:35 |
| openstackgerrit | Ryota MIBU proposed openstack/ceilometer: tempest: migrate api and scnario tests from tempest https://review.openstack.org/268054 | 02:38 |
| r-mibu | all, https://review.openstack.org/268054 is ready for your review :) | 02:42 |
| openstackgerrit | liusheng proposed openstack/python-aodhclient: Fix the -q/--query in threshold alarm creation https://review.openstack.org/289991 | 02:45 |
| liusheng | r-mibu: awsome, looking :) | 02:49 |
| r-mibu | liusheng: thanks! | 02:49 |
| *** jwcroppe has joined #openstack-telemetry | 02:53 | |
| openstackgerrit | Merged openstack/aodh: tempest: migrate api tests from tempest tree https://review.openstack.org/255188 | 03:00 |
| *** thorst_ has quit IRC | 03:05 | |
| *** thorst_ has joined #openstack-telemetry | 03:06 | |
| *** thorst_ has quit IRC | 03:14 | |
| openstackgerrit | Merged openstack/ceilometer: mitaka-3 release notes https://review.openstack.org/289455 | 03:16 |
| *** _nadya_ has joined #openstack-telemetry | 03:30 | |
| *** _nadya_ has quit IRC | 03:35 | |
| openstackgerrit | liusheng proposed openstack/python-aodhclient: Fix the -q/--query in threshold alarm creation https://review.openstack.org/289991 | 03:39 |
| *** jwcroppe has quit IRC | 03:51 | |
| *** links has joined #openstack-telemetry | 04:03 | |
| *** thorst_ has joined #openstack-telemetry | 04:12 | |
| *** thorst_ has quit IRC | 04:19 | |
| openstackgerrit | liusheng proposed openstack/python-aodhclient: Fix the -q/--query in threshold alarm creation https://review.openstack.org/289991 | 05:13 |
| *** liusheng has quit IRC | 05:16 | |
| *** thorst_ has joined #openstack-telemetry | 05:17 | |
| *** liusheng has joined #openstack-telemetry | 05:18 | |
| *** yuntongjin has joined #openstack-telemetry | 05:23 | |
| *** thorst_ has quit IRC | 05:23 | |
| *** yuntongjin1 has joined #openstack-telemetry | 05:46 | |
| *** yuntongjin has quit IRC | 05:48 | |
| *** jwcroppe has joined #openstack-telemetry | 05:52 | |
| *** yuntongjin has joined #openstack-telemetry | 05:57 | |
| *** yuntongjin1 has quit IRC | 05:59 | |
| *** liusheng has quit IRC | 06:08 | |
| *** rcernin has joined #openstack-telemetry | 06:09 | |
| *** liusheng has joined #openstack-telemetry | 06:09 | |
| *** _nadya_ has joined #openstack-telemetry | 06:09 | |
| *** thorst_ has joined #openstack-telemetry | 06:21 | |
| openstackgerrit | Lianhao Lu proposed openstack/aodh: Fixed tempest error due to upstream change https://review.openstack.org/290294 | 06:24 |
| *** thorst_ has quit IRC | 06:28 | |
| *** _nadya_ has quit IRC | 06:45 | |
| *** vishwanathj has quit IRC | 06:49 | |
| *** vishwanathj has joined #openstack-telemetry | 06:51 | |
| *** chlong has quit IRC | 06:54 | |
| openstackgerrit | Xia Linjuan proposed openstack/python-aodhclient: Fix aodh client fails when command with the arg --time-constraint https://review.openstack.org/272946 | 06:54 |
| *** dave-mccowan has quit IRC | 07:02 | |
| *** chlong has joined #openstack-telemetry | 07:07 | |
| *** vishwana_ has joined #openstack-telemetry | 07:10 | |
| openstackgerrit | liusheng proposed openstack/python-aodhclient: Fix the -q/--query in threshold alarm creation https://review.openstack.org/289991 | 07:11 |
| *** vishwanathj has quit IRC | 07:13 | |
| *** tomoiaga has joined #openstack-telemetry | 07:15 | |
| *** thorst_ has joined #openstack-telemetry | 07:26 | |
| *** ildikov has quit IRC | 07:28 | |
| *** thorst_ has quit IRC | 07:33 | |
| openstackgerrit | Merged openstack/aodh: Fixed tempest error due to upstream change https://review.openstack.org/290294 | 07:49 |
| *** belmoreira has joined #openstack-telemetry | 07:56 | |
| *** yprokule has joined #openstack-telemetry | 07:57 | |
| openstackgerrit | Xia Linjuan proposed openstack/python-aodhclient: Fix aodh client fails when command with the arg --time-constraint https://review.openstack.org/272946 | 08:00 |
| *** safchain has joined #openstack-telemetry | 08:16 | |
| *** pece has joined #openstack-telemetry | 08:31 | |
| *** thorst_ has joined #openstack-telemetry | 08:31 | |
| *** jwcroppe has quit IRC | 08:32 | |
| *** jwcroppe has joined #openstack-telemetry | 08:32 | |
| *** yuntongjin has quit IRC | 08:38 | |
| *** thorst_ has quit IRC | 08:39 | |
| openstackgerrit | Lianhao Lu proposed openstack/python-aodhclient: Fix aodh client fails when command with the arg --time-constraint https://review.openstack.org/272946 | 08:41 |
| *** shardy has joined #openstack-telemetry | 08:47 | |
| *** openstackgerrit has quit IRC | 08:47 | |
| *** openstackgerrit has joined #openstack-telemetry | 08:48 | |
| *** links has quit IRC | 08:55 | |
| *** yuntongjin has joined #openstack-telemetry | 08:58 | |
| openstackgerrit | zhangguoqing proposed openstack/gnocchi: [doc] update configuration for WSGI pipeline https://review.openstack.org/290334 | 08:59 |
| *** efoley has joined #openstack-telemetry | 09:08 | |
| *** efoley_ has joined #openstack-telemetry | 09:10 | |
| *** efoley has quit IRC | 09:13 | |
| *** bapalm has quit IRC | 09:14 | |
| *** idegtiarov_ has joined #openstack-telemetry | 09:16 | |
| *** ildikov has joined #openstack-telemetry | 09:19 | |
| *** liusheng has quit IRC | 09:27 | |
| *** yassine has joined #openstack-telemetry | 09:27 | |
| *** bapalm has joined #openstack-telemetry | 09:27 | |
| *** yuntongjin has quit IRC | 09:30 | |
| *** thorst_ has joined #openstack-telemetry | 09:36 | |
| *** thorst_ has quit IRC | 09:44 | |
| *** _nadya_ has joined #openstack-telemetry | 09:45 | |
| *** idegtiarov_ has quit IRC | 09:45 | |
| *** cheneydc has quit IRC | 10:00 | |
| *** idegtiarov_ has joined #openstack-telemetry | 10:14 | |
| *** gzhai-mobl has joined #openstack-telemetry | 10:16 | |
| *** gzhai-mobl has quit IRC | 10:24 | |
| *** Qiming has quit IRC | 10:32 | |
| *** thorst_ has joined #openstack-telemetry | 10:42 | |
| *** iberezovskiy has joined #openstack-telemetry | 10:48 | |
| *** thorst_ has quit IRC | 10:49 | |
| *** idegtiarov_ has quit IRC | 10:49 | |
| *** cdent has joined #openstack-telemetry | 10:54 | |
| *** idegtiarov_ has joined #openstack-telemetry | 11:05 | |
| *** efoley_ has quit IRC | 11:06 | |
| *** ildikov has quit IRC | 11:08 | |
| *** caisan_ has joined #openstack-telemetry | 11:14 | |
| openstackgerrit | Merged openstack/python-gnocchiclient: Corrected docstring for create metric https://review.openstack.org/290017 | 11:16 |
| *** caisan has quit IRC | 11:17 | |
| *** efoley_ has joined #openstack-telemetry | 11:21 | |
| *** Qiming has joined #openstack-telemetry | 11:22 | |
| *** caisan_ has quit IRC | 11:22 | |
| *** nijaba has quit IRC | 11:24 | |
| *** nijaba has joined #openstack-telemetry | 11:25 | |
| *** nijaba has quit IRC | 11:25 | |
| *** nijaba has joined #openstack-telemetry | 11:25 | |
| *** chlong has quit IRC | 11:42 | |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: [doc] update configuration for WSGI pipeline https://review.openstack.org/290334 | 11:43 |
| *** thorst_ has joined #openstack-telemetry | 11:47 | |
| *** links has joined #openstack-telemetry | 11:48 | |
| openstackgerrit | Julien Danjou proposed openstack/gnocchi: Enable CORS by default https://review.openstack.org/290429 | 11:49 |
| *** thorst_ has quit IRC | 11:53 | |
| *** efoley__ has joined #openstack-telemetry | 11:53 | |
| openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: [MongoDB] exchange compound index with single field indexes https://review.openstack.org/276262 | 11:54 |
| openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: [MongoDB] improve creation of ttl indexes https://review.openstack.org/290433 | 11:54 |
| *** efoley_ has quit IRC | 11:57 | |
| *** ildikov has joined #openstack-telemetry | 12:04 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: batch measurements https://review.openstack.org/289807 | 12:11 |
| *** chlong has joined #openstack-telemetry | 12:14 | |
| *** claudiub has joined #openstack-telemetry | 12:16 | |
| *** toddnni_ has joined #openstack-telemetry | 12:24 | |
| *** toddnni has quit IRC | 12:27 | |
| *** ryanpetrello has quit IRC | 12:27 | |
| *** alextricity25_ has quit IRC | 12:27 | |
| *** chlong has quit IRC | 12:27 | |
| *** toddnni_ is now known as toddnni | 12:27 | |
| *** bapalm has quit IRC | 12:27 | |
| *** bapalm has joined #openstack-telemetry | 12:27 | |
| *** alextricity25 has joined #openstack-telemetry | 12:31 | |
| *** ryanpetrello has joined #openstack-telemetry | 12:36 | |
| *** thorst_ has joined #openstack-telemetry | 12:39 | |
| *** chlong has joined #openstack-telemetry | 12:40 | |
| *** Gautam has joined #openstack-telemetry | 12:40 | |
| Gautam | Hi, Does Ceilometer still has dependency on Flask. Or it was only used during the configuration of v1 app ? | 12:42 |
| *** thumpba has joined #openstack-telemetry | 12:50 | |
| openstackgerrit | Merged openstack/gnocchi: [doc] update configuration for WSGI pipeline https://review.openstack.org/290334 | 12:56 |
| *** gchung has joined #openstack-telemetry | 13:09 | |
| *** dave-mccowan has joined #openstack-telemetry | 13:22 | |
| *** _nadya_ has quit IRC | 13:25 | |
| *** _nadya_ has joined #openstack-telemetry | 13:30 | |
| *** links has quit IRC | 13:35 | |
| *** _nadya_ has quit IRC | 13:42 | |
| *** claudiub has quit IRC | 13:55 | |
| *** Gautam has quit IRC | 14:03 | |
| *** pradk has quit IRC | 14:08 | |
| *** jwcroppe has quit IRC | 14:10 | |
| *** _nadya_ has joined #openstack-telemetry | 14:24 | |
| *** peristeri has joined #openstack-telemetry | 14:27 | |
| *** jwcroppe has joined #openstack-telemetry | 14:32 | |
| *** nicodemus_ has joined #openstack-telemetry | 14:35 | |
| *** jwcroppe has quit IRC | 14:40 | |
| openstackgerrit | Trevor McCasland proposed openstack/gnocchi: Increase partitioning logic period https://review.openstack.org/290542 | 14:42 |
| *** KrishR has joined #openstack-telemetry | 14:48 | |
| openstackgerrit | Merged openstack/gnocchi: carbonara: raises an error if timestamp before Epoch is sent https://review.openstack.org/289397 | 14:58 |
| *** rbak has joined #openstack-telemetry | 14:58 | |
| *** BigWillie has joined #openstack-telemetry | 15:08 | |
| *** pradk has joined #openstack-telemetry | 15:09 | |
| openstackgerrit | Merged openstack/gnocchi: rest: make sure all timestamps are after Epoch https://review.openstack.org/289399 | 15:19 |
| openstackgerrit | Merged openstack/gnocchi: rest: None is not a valid timestamp https://review.openstack.org/289418 | 15:19 |
| *** tomoiaga has quit IRC | 15:26 | |
| gchung | sileht: you ever see this before? http://logs.openstack.org/18/290118/2/gate/gate-telemetry-dsvm-integration-gnocchi/e4af116/logs/screen-ceilometer-collector.txt.gz?level=ERROR | 15:36 |
| sileht | http://logs.openstack.org/18/290118/2/gate/gate-telemetry-dsvm-integration-gnocchi/e4af116/logs/rabbitmq/rabbit@devstack-trusty-ovh-bhs1-8648662.txt.gz show "heartbeat_timeout" | 15:38 |
| sileht | gchung, so something looks stuck and the oslo.messaging thread can send the heartbeat packet at time | 15:39 |
| *** ildikov has quit IRC | 15:40 | |
| gchung | sileht: is that a bad node issue? i assume because of that, we can't process any messsages from queue? | 15:40 |
| sileht | gchung, does it happend inl on ovh node ? | 15:41 |
| sileht | inl/only | 15:41 |
| gchung | sileht: hmm... i've never checked... | 15:41 |
| * gchung just noticed my nick | 15:42 | |
| *** gchung is now known as gordc | 15:42 | |
| gordc | i'll keep an eye on it i guess. i just recheck blindly in past. | 15:43 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer: gnocchi: batch measurements https://review.openstack.org/289807 | 15:46 |
| *** yprokule has quit IRC | 15:46 | |
| openstackgerrit | Merged openstack/gnocchi: fix swift bulk-delete https://review.openstack.org/290118 | 15:46 |
| openstackgerrit | Merged openstack/ceilometer: tempest: migrate api and scnario tests from tempest https://review.openstack.org/268054 | 15:47 |
| *** Qiming has quit IRC | 15:53 | |
| *** thorst_ is now known as thorst_afk | 16:03 | |
| zigo | jd__: sileht: Tooz unit tests are failing in Python 3: http://paste.debian.net/413649/ | 16:10 |
| openstackgerrit | litong01 proposed openstack/ceilometer: Add http publisher https://review.openstack.org/290624 | 16:14 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Create default archive policies out of the box https://review.openstack.org/290626 | 16:14 |
| sileht | zigo, what is your voluptuous version ? | 16:15 |
| *** jwcroppe has joined #openstack-telemetry | 16:15 | |
| zigo | sileht: I first tried with what was in Debian (ie: 0.8.2), but this failed in Py2, so I upgraded to the latest from PyPi (ie: 0.8.9), and then only Py3 was failing. | 16:16 |
| zigo | sileht: It's been a long time there's this issue in py3 btw. | 16:16 |
| zigo | sileht: Is Voluptuous only useful for unit testing, or is it used at runtime too? | 16:16 |
| sileht | zigo, I'm a bit surprise, we are gating on python 3.4 | 16:16 |
| zigo | sileht: Sid has Python 3.5... | 16:17 |
| sileht | zigo, tooz needs voluptuous>=0.8.6 so 0.8.9 should be good | 16:17 |
| openstackgerrit | litong01 proposed openstack/ceilometer: Add http publisher https://review.openstack.org/290624 | 16:17 |
| zigo | sileht: upper-constraints.txt has 0.8.8, I can try with that one if you want, but I don't think it will fix anything. | 16:18 |
| zigo | sileht: The issue I have is that, because of this voluptuous thing, I can't upgrade Gnocchi (ie: it needs tooz >= 1.30, which needs a newer voluptuous). | 16:18 |
| zigo | sileht: Is tooz >= 1.30 really mandatory for Gnocchi, or can I just ignore it? | 16:18 |
| gordc | jd__: so apparently swiftclient logs everything for some reason. it basically duplicates logs that should be on server. https://bugs.launchpad.net/python-swiftclient/+bug/1213179 | 16:19 |
| openstack | Launchpad bug 1213179 in python-swiftclient "swiftclient logs all ClientException (404) at ERROR (with traceback)" [High,Confirmed] | 16:19 |
| zigo | (ie: is 1.29 fine...) | 16:19 |
| jd__ | gordc: err :/ | 16:19 |
| jd__ | zigo: they work upstream with py34 afaik | 16:20 |
| *** BigWillie has quit IRC | 16:20 | |
| sileht | zigo, I'm checking if that a python3.5 issue or a voluptuous==0.8.9 issue | 16:20 |
| zigo | cheers | 16:20 |
| zigo | fyi gnocchi is the last component I need to upgrade for Mitaka! :) | 16:22 |
| sileht | good news | 16:22 |
| *** jwcroppe has quit IRC | 16:23 | |
| sileht | zigo, tests pass with python3.5 and voluptuous==0.8.9 | 16:25 |
| zigo | sileht: Well, it's broken for me in Experimental... And as much as I know, it's also broken for Ubuntu people, they said. | 16:26 |
| sileht | zigo, I can't exactly reproduce the environment, but I have checkout the tag 1.34 and run tox -epy35 and it pass | 16:27 |
| zigo | sileht: So, you've switched your desktop to Fedora? :) | 16:27 |
| sileht | zigo, no really, I uses ton of VMs | 16:28 |
| zigo | sileht: And no Sid VM ? :) | 16:28 |
| sileht | zigo, I have tested on a jessie machine with python3.5 from sid | 16:29 |
| sileht | zigo, so all python deps came from pypi | 16:29 |
| zigo | sileht: git clone https://git.debian.org/git/openstack/python-tooz.git | 16:30 |
| sileht | zigo, the links doesn't work | 16:32 |
| zigo | Hum... | 16:33 |
| zigo | sileht: git clone https://anonscm.debian.org/git/openstack/python-tooz.git <--- Maybe this? | 16:33 |
| sileht | it's better | 16:33 |
| zigo | Otherwise, since you have an alioth account ssh://git.debian.org/git/openstack/python-tooz.git | 16:33 |
| openstackgerrit | gordon chung proposed openstack/gnocchi: disable swift retry https://review.openstack.org/290638 | 16:41 |
| sileht | zigo, I don't really have times to create now, I will build it tomorrow | 16:41 |
| zigo | sileht: Thanks. | 16:41 |
| openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: [MongoDB] improve creation of ttl indexes https://review.openstack.org/290433 | 16:42 |
| openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: [MongoDB] exchange compound index with single field indexes https://review.openstack.org/276262 | 16:42 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Updated from global requirements https://review.openstack.org/290643 | 16:45 |
| gordc | _nadya_: is this still relevant? https://bugs.launchpad.net/ceilometer/+bug/1464265 | 16:46 |
| openstack | Launchpad bug 1464265 in Ceilometer "hbase backend not collecting all Swift metric" [Low,Triaged] - Assigned to Nadya Privalova (nprivalova) | 16:46 |
| *** vishwana_ is now known as vishwanathj | 16:48 | |
| *** belmoreira has quit IRC | 16:52 | |
| *** wolsen has quit IRC | 16:52 | |
| *** wolsen has joined #openstack-telemetry | 16:52 | |
| *** slogan_r_ has joined #openstack-telemetry | 16:56 | |
| _nadya_ | gordc: I'll take a look | 16:59 |
| slogan_r_ | I'm looking for someone who might be interested in working with me to add ceilometer support for underlay networking statistics published by Broadcom's broadview. | 17:00 |
| gordc | _nadya_: thanks | 17:00 |
| gordc | slogan_r_: add ability to poll it? | 17:01 |
| slogan_r_ | well, we have a collector that is being pushed here: https://review.openstack.org/#/c/282365/ | 17:01 |
| slogan_r_ | it supports plugins for publishers like ceilometer - thinking it could post to OSLO and there might be a agent plugin that converts to ceilometer samples | 17:02 |
| slogan_r_ | it being the plugin | 17:02 |
| gordc | slogan_r_: that seems like a good path, it's pretty easy to add metrics for ceilometer to process from queue | 17:03 |
| slogan_r_ | we developed one plugin for monasca already, and a simple log file publisher plugin, thinking we could use some help from someone in ceilomter community to roll a ceilometer plugin | 17:03 |
| slogan_r_ | We are in code review now for the initial commit: https://review.openstack.org/#/c/290548/ | 17:04 |
| gordc | slogan_r_: i think it'd be good to just publish to queue rather than specific target like how notifications work in OpenStack in general | 17:05 |
| gordc | slogan_r_: if you start targetting specific systems, all the extra dependencies will cause a massive headache for you | 17:06 |
| *** BigWillie has joined #openstack-telemetry | 17:06 | |
| slogan_r_ | so, 6 months ago I experimented with ceilometer. I published raw JSON data coming from broadview to OSLO, and had a ceilometer agent plugin that convert this to counters | 17:07 |
| gordc | right now if you publish to gnocchi, ceilometer, monasca, etc... you now need to know about all their data structures, how they all work optimally, etc... | 17:07 |
| slogan_r_ | nod | 17:08 |
| gordc | i think that's the right path, just publish to oslo queue. let the consumer figure out how to deal with your payload | 17:08 |
| *** thorst_afk is now known as thorst_ | 17:09 | |
| *** rcernin has quit IRC | 17:09 | |
| slogan_r_ | right, and then whatever wanted to consume from ceilometer DB could do so | 17:09 |
| gordc | slogan_r_: exactly. | 17:09 |
| gordc | slogan_r_: right now, it's pretty easy to get ceilometer to interpret specific messages from queue. | 17:10 |
| gordc | you just need to add a definition to https://github.com/openstack/ceilometer/blob/master/ceilometer/meter/data/meters.yaml | 17:10 |
| slogan_r_ | when you say queue, what do you specifically mean, data in the database? | 17:10 |
| slogan_r_ | gordc: appreciate your help, thanks for taking the time | 17:11 |
| gordc | oh, by queue i mean RabbitMQ, zmq, kafka... whatever oslo.messaging supports | 17:11 |
| gordc | slogan_r_: np | 17:11 |
| slogan_r_ | one thing I found difficult was representing the metadata around our stats - it's not really suited for counters | 17:12 |
| gordc | if you look at nova code right now, they have a periodic task that builds metrics on instances, it will then just publish it to the message queue (in some schema) | 17:12 |
| slogan_r_ | monasca dimensions addressed this, I could basically give a value and associate with that value arbitrary metadata | 17:13 |
| gordc | do you have examples of the metrics you're building? | 17:13 |
| slogan_r_ | sure | 17:13 |
| gordc | ultimately you just need 3 things: resource_id, metric_name, timestamp, value | 17:14 |
| slogan_r_ | https://github.com/openstack/broadview-lib/blob/master/broadview_lib/bst/bst_parser.py#L368 | 17:14 |
| gordc | errr 4... (possibly more, because i'm over-simpifiying) | 17:14 |
| slogan_r_ | what I did was explode that into named metrics, but the names of course could not really be searched on or filtered. | 17:15 |
| slogan_r_ | so, one report might result in a large number of metrics with names that contained the metadata | 17:16 |
| gordc | is realm the metric name? | 17:16 |
| slogan_r_ | realm is a part of it, yes | 17:17 |
| gordc | ... the metric is built up over multiple levels? | 17:18 |
| slogan_r_ | analogy might work here | 17:20 |
| slogan_r_ | say you have a PC with 2 serial ports (ok, I know everything is USB, but I'm old school :-) | 17:20 |
| slogan_r_ | each has 7 pins | 17:21 |
| slogan_r_ | so, we would report something like serial-port-1-pin-3 up | 17:21 |
| slogan_r_ | seria-port-2-pin-5 up | 17:21 |
| slogan_r_ | etc. | 17:21 |
| slogan_r_ | I might convert one of those into ceilometer where value is 1 or 0, and name if serial-port-2-pin-5-state as the counter name | 17:22 |
| *** safchain has quit IRC | 17:23 | |
| gordc | seems like that would be an update event rather than a metric since it's not measuring anything numerically | 17:24 |
| gordc | but yeah, i get the idea. | 17:24 |
| gordc | i would make the formatting a bit easier to understand (less nested) but that's personal opinion | 17:25 |
| slogan_r_ | yeah, that's where I would expect someone more involved to ceilometer to be better at this than I :-) | 17:25 |
| gordc | but if you publish that format on queue, it's relatively simple to get ceilometer to normalise it into events and metrics | 17:25 |
| slogan_r_ | there are only counters, right? | 17:26 |
| gordc | ceilometer builds to different data models. events and metrics | 17:26 |
| slogan_r_ | from what I saw from nova cpu and networking, seemed like counters was what they are publishing to OSLO | 17:26 |
| gordc | so for example, nova publishes a message when it starts to create an instance, and when it finishes creating the instance | 17:27 |
| gordc | those are events (nothing numerical is present, just status on the system) | 17:27 |
| gordc | it also publishes information about host like cputime and such... these are metrics (numerical stuff) | 17:28 |
| slogan_r_ | well, my values are percents or raw buffer counts | 17:28 |
| slogan_r_ | so is really a metric | 17:29 |
| slogan_r_ | maybe the serial port analogy was a bad one | 17:29 |
| gordc | yeah, well ceilometer handles both regardless :) | 17:29 |
| slogan_r_ | I'm reporting microburst activity in a data center network chip, where buffers might overflow - we report the buffer levels as raw or percentage values | 17:30 |
| slogan_r_ | pretty useful in a cluster to know if packets are being dropped | 17:30 |
| slogan_r_ | even better to have some visibility into why | 17:32 |
| gordc | right. i would suggest you publish it on the queue and not worry about consumers. ideally, it'd be in a format that's readable ie. this is the metric_name, for this resource, and it has this value at this time [and here's some useful metadata related to resource] | 17:32 |
| gordc | so for example, nova publishes: cputime, instance_id, <value>, <timestamp>, metadata: <host>, <flavour details>, etc... | 17:34 |
| slogan_r_ | so the metadata has to be a part of the name of the statistic, or am I missing something? | 17:34 |
| slogan_r_ | ah | 17:34 |
| gordc | just attributes | 17:34 |
| gordc | you can decide how to structure format. | 17:34 |
| gordc | trying to find an existing example | 17:35 |
| slogan_r_ | k | 17:35 |
| gordc | slogan_r_: some rough examples | 17:36 |
| gordc | nova: https://github.com/openstack/ceilometer/blob/ec4848b9f0db227fdd03afd7e711d4c50d4af1fd/ceilometer/tests/unit/meter/test_notifications.py#L167-L201 | 17:36 |
| gordc | cadf: https://github.com/openstack/ceilometer/blob/ec4848b9f0db227fdd03afd7e711d4c50d4af1fd/ceilometer/tests/unit/meter/test_notifications.py#L93-L110 | 17:36 |
| gordc | if you publish in a common pattern, it's easier for ceilometer to handle and you might not even have to write any code in ceilometer | 17:37 |
| slogan_r_ | that would be ideal | 17:38 |
| gordc | basically the more you normalise data on your own end, the less you need to worry about consumers | 17:38 |
| slogan_r_ | when you say not right any code, we still have to register ourselves somewhere, no? | 17:40 |
| slogan_r_ | like in a yaml file...? | 17:40 |
| gordc | slogan_r_: correct, you just need to map your format to ceilometer format | 17:41 |
| slogan_r_ | the agent plugin should be the only thing that needs to be known to the world, of course | 17:41 |
| *** datravis has joined #openstack-telemetry | 17:41 | |
| gordc | so basically that last link i gave you, maps to https://github.com/openstack/ceilometer/blob/ec4848b9f0db227fdd03afd7e711d4c50d4af1fd/ceilometer/meter/data/meters.yaml#L82-L90 | 17:41 |
| gordc | it just defines where the matching values are in the payload | 17:42 |
| gordc | you'll also, need to tell ceilometer to listen to whatever topic you will publish to. | 17:42 |
| gordc | all the services by default publish to 'notifications' topic | 17:43 |
| slogan_r_ | yep | 17:43 |
| Nepoc | Does anyone have a postman collection for ceilometer api? | 17:43 |
| *** datravis has left #openstack-telemetry | 17:45 | |
| slogan_r_ | okay, thanks gordc. I'll save off this conversation and look at it more detail later. I have a lot of other work in the queue, would be nice if I could find someone interested in working with me who might be able to contribute while I am occupied elsewhere. | 17:46 |
| gordc | slogan_r_: ack. if you need help with publish to oslo, let us know. that will make your life easier since you don't need to worry about consumers | 17:48 |
| gordc | Nepoc: nope. sorry. we use gabbi for our api tests. | 17:49 |
| gordc | bbl, lunch | 17:49 |
| slogan_r_ | gordc: thanks | 17:49 |
| slogan_r_ | what's for lunch? | 17:49 |
| * slogan_r_ runs | 17:49 | |
| gordc | slogan_r_: whatever is not expired. :) | 17:49 |
| slogan_r_ | in my case, whatever is least expired | 17:50 |
| *** thumpba has quit IRC | 17:50 | |
| *** thumpba has joined #openstack-telemetry | 17:51 | |
| *** _nadya_ has quit IRC | 17:55 | |
| *** slogan_r_ has quit IRC | 17:59 | |
| *** shardy has quit IRC | 18:03 | |
| *** renatoarmani has joined #openstack-telemetry | 18:10 | |
| *** _nadya_ has joined #openstack-telemetry | 18:19 | |
| *** iberezovskiy has quit IRC | 18:24 | |
| *** ildikov has joined #openstack-telemetry | 18:33 | |
| *** renatoarmani has quit IRC | 18:34 | |
| *** renatoarmani has joined #openstack-telemetry | 18:39 | |
| *** pece has quit IRC | 18:42 | |
| *** KrishR has quit IRC | 18:43 | |
| *** jwcroppe has joined #openstack-telemetry | 18:59 | |
| *** cdent has quit IRC | 19:01 | |
| *** KrishR has joined #openstack-telemetry | 19:03 | |
| *** jdob has joined #openstack-telemetry | 19:05 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Add some resource types tests https://review.openstack.org/270419 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute number https://review.openstack.org/270091 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute bool https://review.openstack.org/270418 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute uuid https://review.openstack.org/270090 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Don't create Ceilometer resource types by default. https://review.openstack.org/270322 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Move legacy Ceilometer resource into indexer. https://review.openstack.org/270266 | 19:13 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource type CRUD. https://review.openstack.org/269844 | 19:14 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/gnocchi: Implements resource attribute string https://review.openstack.org/269888 | 19:14 |
| *** boris-42 has quit IRC | 19:14 | |
| *** gordc has quit IRC | 19:22 | |
| nicodemus_ | hello | 19:25 |
| *** renatoarmani has quit IRC | 19:26 | |
| nicodemus_ | If I were using an archive policy in which its first definition has 288 datapoints (http://paste.openstack.org/show/489894/) | 19:26 |
| nicodemus_ | and wanted to multiply by 5 one specific metric from all instance-type resources | 19:27 |
| nicodemus_ | could I do that manipulating the pipeline.yaml in ceilometer agents? | 19:28 |
| *** thorst__ has joined #openstack-telemetry | 19:36 | |
| *** jwcroppe has quit IRC | 19:37 | |
| *** yassine has quit IRC | 19:40 | |
| *** thorst_ has quit IRC | 19:40 | |
| *** efoley__ has quit IRC | 19:42 | |
| *** BigWillie has quit IRC | 19:54 | |
| *** renatoarmani has joined #openstack-telemetry | 20:00 | |
| *** gordc has joined #openstack-telemetry | 20:02 | |
| *** renatoarmani has quit IRC | 20:04 | |
| nicodemus_ | hi gordc, do you have a moment? | 20:08 |
| *** renatoarmani has joined #openstack-telemetry | 20:08 | |
| *** renatoarmani has quit IRC | 20:09 | |
| gordc | nicodemus_: sure | 20:13 |
| nicodemus_ | gordc, if I wanted to multiply by 5 one specific metric, could I do that manipulating the pipeline.yaml in ceilometer agents? | 20:14 |
| gordc | nicodemus_: yeah, you should be able to. there is an arithmetic transformer. | 20:15 |
| gordc | let me check | 20:15 |
| nicodemus_ | the first definition in my archive policy has 288 datapoints, and would need the instance uptime metric to have 1440 | 20:15 |
| nicodemus_ | gordc, great, thanks! | 20:15 |
| gordc | nicodemus_: err you want to multiply the value of the metric or you want the metric 5 times? | 20:17 |
| *** jwcroppe has joined #openstack-telemetry | 20:19 | |
| nicodemus_ | gordc, multiply the value of the metric | 20:19 |
| nicodemus_ | apologies if I didn't express clearly | 20:19 |
| gordc | ok cool. when you said datapoints i thought you want to increase the number of datapoints stored. you just want to change the value of the datapoint | 20:20 |
| gordc | so there's a scaling transformer: https://github.com/openstack/ceilometer/blob/master/ceilometer/transformer/conversions.py#L119 | 20:20 |
| *** jwcroppe has quit IRC | 20:21 | |
| nicodemus_ | gordc, if I understand correctly the pipeline.yaml file... Should I create a "name" entry to match that specific metric? and then create a sink that applies the scaling transformer? | 20:23 |
| nicodemus_ | I only want to modify the "instance" metric | 20:24 |
| openstackgerrit | Merged openstack/ceilometer: Updated from global requirements https://review.openstack.org/290643 | 20:24 |
| gordc | nicodemus_: kk, let me try building a sample pipeline | 20:24 |
| gordc | nicodemus_: something like this: http://paste.openstack.org/show/489906/ | 20:29 |
| nicodemus_ | gordc, fantastic! I'll give it a try | 20:29 |
| nicodemus_ | Thanks! | 20:29 |
| gordc | np. you can also remap to a new metric name if needed. different options as required | 20:31 |
| *** idegtiarov_ has quit IRC | 20:46 | |
| nicodemus_ | gordc, the new pipeline.yaml did the trick. Thanks!! | 20:49 |
| *** Ephur has joined #openstack-telemetry | 20:49 | |
| gordc | nicodemus_: cool. np | 21:00 |
| *** twm2016 has joined #openstack-telemetry | 21:11 | |
| *** _nadya_ has quit IRC | 21:11 | |
| *** thumpba has quit IRC | 21:13 | |
| *** thumpba has joined #openstack-telemetry | 21:14 | |
| twm2016 | I was looking at this bug: https://bugs.launchpad.net/python-ceilometerclient/+bug/1554727 and I was wondering would it be acceptable to limit events before it prints here: https://github.com/openstack/python-ceilometerclient/blob/master/ceilometerclient/v2/shell.py#L1131? | 21:14 |
| openstack | Launchpad bug 1554727 in python-ceilometerclient "limit argument does not work on event-list query" [Medium,Triaged] | 21:14 |
| *** waverider has joined #openstack-telemetry | 21:14 | |
| *** _nadya_ has joined #openstack-telemetry | 21:15 | |
| *** _nadya_ has quit IRC | 21:15 | |
| *** thumpba has quit IRC | 21:18 | |
| gordc | twm2016: based on error, it might relate to ceilometer api and not just client (since it gets a HTTP 400 code) | 21:24 |
| *** thorst__ is now known as thorst_ | 21:30 | |
| *** nicodemus_ has quit IRC | 21:35 | |
| *** r-mibu has quit IRC | 21:47 | |
| *** r-mibu has joined #openstack-telemetry | 21:47 | |
| *** twm2016 has quit IRC | 21:52 | |
| *** jdob has quit IRC | 22:00 | |
| *** thorst_ has quit IRC | 22:02 | |
| *** thorst_ has joined #openstack-telemetry | 22:05 | |
| *** thorst_ has quit IRC | 22:09 | |
| *** waverider has quit IRC | 22:12 | |
| *** gordc has quit IRC | 22:16 | |
| *** david-lyle has quit IRC | 22:19 | |
| *** dave-mccowan has quit IRC | 22:20 | |
| *** david-lyle has joined #openstack-telemetry | 22:20 | |
| *** thorst_ has joined #openstack-telemetry | 22:24 | |
| *** peristeri has quit IRC | 22:30 | |
| *** dave-mccowan has joined #openstack-telemetry | 22:34 | |
| openstackgerrit | litong01 proposed openstack/ceilometer: Add http publisher https://review.openstack.org/290624 | 22:47 |
| *** KrishR has quit IRC | 22:47 | |
| *** thorst_ has quit IRC | 22:51 | |
| *** thorst_ has joined #openstack-telemetry | 22:52 | |
| *** thorst_ has quit IRC | 23:01 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!