*** thorst_ has joined #openstack-telemetry | 00:30 | |
*** Qiming has quit IRC | 00:34 | |
*** thorst_ has quit IRC | 00:38 | |
*** thorst_ has joined #openstack-telemetry | 00:38 | |
*** thorst_ has quit IRC | 00:40 | |
*** thorst_ has joined #openstack-telemetry | 00:41 | |
*** Qiming has joined #openstack-telemetry | 01:23 | |
*** cheneydc has joined #openstack-telemetry | 01:38 | |
*** jaypipes has quit IRC | 01:54 | |
*** thorst_ has quit IRC | 01:56 | |
*** thorst_ has joined #openstack-telemetry | 01:57 | |
*** thorst_ has quit IRC | 02:05 | |
openstackgerrit | Zi Lian Ji proposed openstack/python-aodhclient: Fix aodh client fails when command with the arg --time-constraint https://review.openstack.org/272946 | 02:50 |
---|---|---|
*** achatterjee has joined #openstack-telemetry | 02:51 | |
*** liamji has joined #openstack-telemetry | 03:02 | |
*** thorst_ has joined #openstack-telemetry | 03:04 | |
*** thorst_ has quit IRC | 03:10 | |
*** david-lyle has joined #openstack-telemetry | 03:24 | |
*** larainema has quit IRC | 03:27 | |
*** larainema has joined #openstack-telemetry | 03:29 | |
*** Ephur has quit IRC | 03:33 | |
openstackgerrit | Merged openstack/python-aodhclient: add alarm history unit test https://review.openstack.org/273397 | 03:46 |
*** thorst_ has joined #openstack-telemetry | 04:08 | |
openstackgerrit | gordon chung proposed openstack/gnocchi: remove unnecessary sort_index https://review.openstack.org/286975 | 04:11 |
*** thorst_ has quit IRC | 04:16 | |
*** links has joined #openstack-telemetry | 04:51 | |
*** yprokule has joined #openstack-telemetry | 04:57 | |
*** thorst_ has joined #openstack-telemetry | 05:14 | |
*** thorst_ has quit IRC | 05:21 | |
*** pcaruana has joined #openstack-telemetry | 05:36 | |
*** pcaruana has quit IRC | 05:49 | |
*** rcernin has joined #openstack-telemetry | 05:51 | |
*** dave-mccowan has quit IRC | 05:51 | |
*** thorst_ has joined #openstack-telemetry | 06:19 | |
*** thorst_ has quit IRC | 06:26 | |
*** shardy has joined #openstack-telemetry | 07:00 | |
*** thorst_ has joined #openstack-telemetry | 07:23 | |
*** thorst_ has quit IRC | 07:31 | |
*** vishwanathj is now known as vishwanathj_zzz | 07:38 | |
*** belmoreira has joined #openstack-telemetry | 07:38 | |
openstackgerrit | Zi Lian Ji proposed openstack/ceilometer: Add the meter example file 'lbaas-v2-meter-definitions.yaml' https://review.openstack.org/286431 | 07:59 |
*** pcaruana has joined #openstack-telemetry | 08:02 | |
*** fwdit has joined #openstack-telemetry | 08:08 | |
*** thorst_ has joined #openstack-telemetry | 08:29 | |
openstackgerrit | liusheng proposed openstack/ceilometer: Caching info in the instance discovery https://review.openstack.org/267078 | 08:31 |
*** thorst_ has quit IRC | 08:35 | |
openstackgerrit | liusheng proposed openstack/ceilometer: Caching info in the instance discovery https://review.openstack.org/267078 | 08:40 |
*** permalac has joined #openstack-telemetry | 08:42 | |
*** permalac has quit IRC | 08:42 | |
openstackgerrit | liusheng proposed openstack/ceilometer: Caching info in the instance discovery https://review.openstack.org/267078 | 08:59 |
*** liamji has quit IRC | 09:00 | |
*** permalac has joined #openstack-telemetry | 09:00 | |
*** vishwanathj_zzz has quit IRC | 09:03 | |
permalac | hello guys, I'm with kilo and about to set up ceilometer in HA, as I understand that only the central agent can be in HA does this mean the other agents must be stoped on all the non working nodes? | 09:11 |
*** thorst_ has joined #openstack-telemetry | 09:33 | |
*** thorst_ has quit IRC | 09:40 | |
*** Qiming has quit IRC | 09:45 | |
*** sheeprine has quit IRC | 09:49 | |
*** sheeprine has joined #openstack-telemetry | 09:50 | |
*** _nadya_ has joined #openstack-telemetry | 09:58 | |
*** cheneydc has quit IRC | 09:59 | |
*** yassine__ has joined #openstack-telemetry | 10:28 | |
_nadya_ | liusheng: hi! | 10:28 |
_nadya_ | liusheng: I see that you're doing some changes in metadata cache patch. Did you see that one https://review.openstack.org/#/c/284322/ ? | 10:30 |
*** ityaptin_laptop has joined #openstack-telemetry | 10:30 | |
*** ityaptin_ has quit IRC | 10:33 | |
*** dikonoor has joined #openstack-telemetry | 10:36 | |
*** thorst_ has joined #openstack-telemetry | 10:38 | |
*** dikonoor has quit IRC | 10:40 | |
*** _nadya__ has joined #openstack-telemetry | 10:43 | |
*** _nadya_ has quit IRC | 10:43 | |
*** thorst_ has quit IRC | 10:45 | |
*** Qiming has joined #openstack-telemetry | 10:49 | |
*** cdent has joined #openstack-telemetry | 10:59 | |
*** ityaptin_laptop has quit IRC | 11:03 | |
*** ityaptin_laptop has joined #openstack-telemetry | 11:07 | |
*** _nadya__ has quit IRC | 11:10 | |
*** _nadya_ has joined #openstack-telemetry | 11:40 | |
*** thorst_ has joined #openstack-telemetry | 11:43 | |
*** _nadya_ has quit IRC | 11:45 | |
*** thorst_ has quit IRC | 11:51 | |
*** dave-mccowan has joined #openstack-telemetry | 11:53 | |
*** _nadya_ has joined #openstack-telemetry | 11:55 | |
*** kudemi has joined #openstack-telemetry | 11:57 | |
*** cdent has quit IRC | 12:06 | |
liusheng | _nadya_: Hi, yes, I saw it, but I don' think that change can perform a big improvement, right ? | 12:22 |
liusheng | _nadya_: thanks for reminding me :) | 12:22 |
*** Liuqing has joined #openstack-telemetry | 12:27 | |
_nadya_ | liusheng: we can update the cache once in 10 minutes, but poll once in 5 seconds. It's not actually "polling improvement", I agree | 12:28 |
_nadya_ | liusheng: the problem we faced with that if there are, let's say, 100000 instances, nova will return this list using pagination | 12:29 |
_nadya_ | liusheng: thus, we have one more thing to handle | 12:30 |
liusheng | _nadya_: maybe the instances in cache is out-of-dated for us if we update it per 10min | 12:31 |
liusheng | _nadya_: you mean in the global cache approach ? | 12:31 |
_nadya_ | liusheng: yep, they can. To have everything up-to-date, we need to do updates from notification agent | 12:31 |
_nadya_ | liusheng: yep, global cache approach, right | 12:32 |
_nadya_ | liusheng: looks like we need a session at the summit about this. too many questions still | 12:32 |
liusheng | _nadya_: we have inputted 'change-since' parameter, it unlikly to meet the nova API limitation for listing instances | 12:33 |
liusheng | _nadya_: not sure :) | 12:33 |
_nadya_ | liusheng: actually, we should not get all instances at all. If we start Ceilometer from the very beginning, we will always use "change-since". We just cannot launch 10000+ instances between cache update (10 minutes?). But if we lose the cache (how can we lose it if we have the cache in HA?), we need to populate it | 12:37 |
_nadya_ | liusheng: very corner-case problem | 12:38 |
liusheng | _nadya_: yes, I agree, even if we need to query 10000+ instances, can we address that case by code logic ? | 12:40 |
_nadya_ | liusheng: theoretically, yes. nova-experts have some doubts about performance. What is better: run several get_instance_by_host or one big query with pagination. We're going to test it at scale | 12:41 |
liusheng | liusheng: I am afraid that will make process more complex :(, what do you mean "several get_instance_by_host" | 12:44 |
liusheng | _nadya_: maybe we can give a maximum value (< 10000) to query instances from Nova API, if the return of Nova API is more than 10000, we query by serveral pagination query | 12:47 |
*** thorst_ has joined #openstack-telemetry | 12:48 | |
openstackgerrit | Michael Krotscheck proposed openstack/ceilometer: Moved CORS middleware configuration into oslo-config-generator https://review.openstack.org/286781 | 12:48 |
_nadya_ | liusheng: so, we want improve performance: instead of several "get_all_by host" (get_instance_by_host is incorrect name) from several computes we want ask get_all from one compute. But if get_all reurns 100000+ computes, performance may not be improved actually | 12:48 |
_nadya_ | liusheng: yep, probably, the only thing we may do is to support pagination | 12:50 |
_nadya_ | liusheng: *we should do | 12:50 |
liusheng | _nadya_: if we have more than 100000 instances, the compote nodes will be more thant "several" :) | 12:53 |
_nadya_ | liusheng: yep, definitely :) | 12:54 |
liusheng | _nadya_: I think it is easy to support nova API pagination query in ceilometer | 12:54 |
_nadya_ | liusheng: we need Gordon and ityaptin_laptop involved in this discussion once more. May do it today or tomorrow in irc meeting. Because, it seems that I don't see the actual blocker here.. "support pagination" doesn't seem a blocker | 12:56 |
*** Qiming has quit IRC | 12:59 | |
*** links has quit IRC | 12:59 | |
liusheng | _nadya_: cool, at least, the global cache is just a optional way, we can support local cache as before | 12:59 |
*** _nadya_ has quit IRC | 13:01 | |
*** nicodemus_ has joined #openstack-telemetry | 13:01 | |
openstackgerrit | gordon chung proposed openstack/gnocchi: remove unnecessary sort_index https://review.openstack.org/286975 | 13:21 |
*** vgridnev has joined #openstack-telemetry | 13:22 | |
*** vgridnev has quit IRC | 13:23 | |
*** pradk has quit IRC | 13:32 | |
*** Ephur has joined #openstack-telemetry | 13:47 | |
*** dikonoor has joined #openstack-telemetry | 13:48 | |
*** _nadya_ has joined #openstack-telemetry | 13:51 | |
*** dikonoor has quit IRC | 13:51 | |
*** fwdit has quit IRC | 13:56 | |
*** liamji has joined #openstack-telemetry | 14:01 | |
*** bapalm has quit IRC | 14:05 | |
*** jwcroppe_ is now known as jwcroppe | 14:05 | |
*** bapalm has joined #openstack-telemetry | 14:06 | |
*** dikonoor has joined #openstack-telemetry | 14:08 | |
*** yprokule has quit IRC | 14:08 | |
*** dikonoo has joined #openstack-telemetry | 14:09 | |
*** dikonoo has quit IRC | 14:09 | |
*** dikonoor has quit IRC | 14:09 | |
*** dikonoor has joined #openstack-telemetry | 14:10 | |
*** dikonoo has joined #openstack-telemetry | 14:10 | |
*** dikonoor has quit IRC | 14:10 | |
*** dikonoo has quit IRC | 14:10 | |
*** yprokule has joined #openstack-telemetry | 14:13 | |
*** thumpba has joined #openstack-telemetry | 14:16 | |
nicodemus_ | hello gordc | 14:17 |
nicodemus_ | oh, he's not around. | 14:19 |
*** ildikov has quit IRC | 14:23 | |
*** twm2016 has joined #openstack-telemetry | 14:28 | |
*** nicodemus_ has quit IRC | 14:31 | |
*** nicodemus_ has joined #openstack-telemetry | 14:31 | |
*** ljxiash has joined #openstack-telemetry | 14:33 | |
*** ljxiash has quit IRC | 14:36 | |
*** ljxiash has joined #openstack-telemetry | 14:36 | |
*** Liuqing has quit IRC | 14:44 | |
*** alejandrito has joined #openstack-telemetry | 14:49 | |
*** rbak has joined #openstack-telemetry | 14:55 | |
*** pradk has joined #openstack-telemetry | 14:55 | |
openstackgerrit | Igor Degtiarov proposed openstack/ceilometer: timedelta plugin for meter definition process https://review.openstack.org/286469 | 14:56 |
*** ildikov has joined #openstack-telemetry | 14:56 | |
*** ljxiash has quit IRC | 14:57 | |
*** ljxiash has joined #openstack-telemetry | 15:03 | |
twm2016 | Hi everyone, I am working on this bug https://bugs.launchpad.net/ceilometer/+bug/1528243 and I am in the middle of adding a record_events function in the gnocchi dispatcher. I was wondering how one would acquire the parameters for calling the _update_resouce function for an event instead of a metric. | 15:10 |
openstack | Launchpad bug 1528243 in Ceilometer "gnocchi dispatcher should leverage events" [Wishlist,Triaged] - Assigned to Trevor McCasland (twm2016) | 15:10 |
*** rickyrem has joined #openstack-telemetry | 15:15 | |
*** jaypipes has joined #openstack-telemetry | 15:17 | |
alejandrito | does anyone knows if gnocchi supports keystone domains ? | 15:20 |
*** kudemi has quit IRC | 15:25 | |
*** vishwanathj_zzz has joined #openstack-telemetry | 15:26 | |
*** vishwanathj_zzz is now known as vishwanathj | 15:27 | |
*** vishwana_ has joined #openstack-telemetry | 15:29 | |
*** yprokule has quit IRC | 15:30 | |
*** gordc has joined #openstack-telemetry | 15:31 | |
*** vishwana_ is now known as vishwanathj_ | 15:31 | |
*** vishwanathj has quit IRC | 15:31 | |
*** yprokule has joined #openstack-telemetry | 15:42 | |
*** liamji has quit IRC | 15:42 | |
*** yprokule has quit IRC | 15:43 | |
*** KrishR has joined #openstack-telemetry | 15:44 | |
*** albertom has left #openstack-telemetry | 15:45 | |
*** belmoreira has quit IRC | 15:50 | |
*** krypto has joined #openstack-telemetry | 15:54 | |
krypto | strange issue with ceilometer , "ceilometer alarm-list" shows gateway timeout ;api process is running;restarting process fixes this issue .Any idea? | 15:57 |
krypto | nothing in logs ;have a haproxy frontend which is under utilised | 15:58 |
gordc | krypto: nothing in logs == doesn't even know the api request happened?? | 16:02 |
krypto | will "ceilometer alarm-list " logs anything in api.log? | 16:04 |
krypto | gordc | 16:04 |
*** pcaruana has quit IRC | 16:05 | |
gordc | it should, yes. | 16:05 |
gordc | let me try finding an example | 16:05 |
gordc | krypto: something like http://logs.openstack.org/60/262660/6/check/gate-telemetry-dsvm-integration-ceilometer/708e8a7/logs/apache/aodh_access.txt.gz | 16:06 |
*** ljxiash has quit IRC | 16:07 | |
nicodemus_ | hello gordc, quick question: does gnocchi support keystone domains? Or is that an extra metadata we should add? | 16:08 |
*** jaypipes has quit IRC | 16:08 | |
*** _nadya_ has quit IRC | 16:09 | |
*** BigWillie has joined #openstack-telemetry | 16:11 | |
gordc | nicodemus_: i'm not sure we store that information. (i assume you're asking about storing the data vs authentication) | 16:12 |
*** ityaptin_laptop has quit IRC | 16:14 | |
*** alextricity25_ has joined #openstack-telemetry | 16:14 | |
*** smurke_ has quit IRC | 16:15 | |
*** sudorandom has quit IRC | 16:15 | |
*** alextricity25 has quit IRC | 16:15 | |
*** thorst_ has quit IRC | 16:15 | |
nicodemus_ | I was wondering if I enable domains in keystone, if a resource would *magically* have also domain id (meaning, the ceilometer agents would collect and push domain id as well) | 16:15 |
*** sudorandom has joined #openstack-telemetry | 16:15 | |
*** smurke has joined #openstack-telemetry | 16:15 | |
nicodemus_ | or if that would be something needed to add to the gnocchi_resources.yaml as additional metadata I want to have on my resources | 16:16 |
*** thorst_ has joined #openstack-telemetry | 16:16 | |
krypto | gordc sorry for the wrong information it logs: "Max retries exceeded with url: /v2/alarms/26d567a1-ea26-40b2-a0a7-4a592085039b/state (Caused by <class 'httplib.BadStatusLine'>: '') | 16:16 |
krypto | 2016-03-02 16:11:36.273 23501 TRACE ceilometer.alarm.evaluator | 16:16 |
krypto | " | 16:16 |
krypto | http://paste.ubuntu.com/15267787/ | 16:17 |
gordc | nicodemus_: you'd have to map it. it's pretty rigid right now in terms of adding new attrs/resource types. | 16:19 |
gordc | i think you'll need to wait for 2.1.x which will have sileht's patch to make things more dynamic | 16:20 |
*** yassine__ has quit IRC | 16:20 | |
gordc | https://review.openstack.org/#/q/status:open+project:openstack/gnocchi+branch:master+topic:bp/resource-type-rest-api | 16:20 |
nicodemus_ | gordc: good to know. Thanks! | 16:20 |
*** jaypipes has joined #openstack-telemetry | 16:22 | |
gordc | krypto: are you using aodh or ceilometer(liberty)? | 16:24 |
gordc | hm i guess ceilometer. | 16:24 |
krypto | gordc ceilometer | 16:25 |
gordc | i don't know. it seems like the server is rejecting calls from evaluator... so it's probably blocking your client reqs too. | 16:25 |
gordc | krypto: what version of client are you using? | 16:26 |
krypto | gordc ceilometer --version | 16:27 |
krypto | 1.0.12 | 16:27 |
krypto | can this be an issue with HAProxy itself? | 16:27 |
gordc | possibly? i've never seen that error to be honest | 16:28 |
gordc | krypto: are you on juno? | 16:28 |
krypto | yes | 16:29 |
gordc | oh... yeah, i was wondering why your client was so old. | 16:31 |
gordc | hmm.. well you do need some form of web server so it will need to work with haproxy | 16:32 |
gordc | i'm not sure. i'd need to google. but i have a few other items to track currently. | 16:32 |
*** datravis has joined #openstack-telemetry | 16:33 | |
krypto | other services are fine with haproxy but ceilometer sometimes go down;if i restart ceilometer it works again [ahh thats a hint so issue must be with ceilometer api process itself] | 16:33 |
*** datravis has left #openstack-telemetry | 16:34 | |
*** eglynn has joined #openstack-telemetry | 16:34 | |
*** david-lyle has quit IRC | 16:36 | |
*** jwcroppe has quit IRC | 16:37 | |
gordc | krypto: possibly. it does seem that some rate limiting is kicking in and it just resets when you restart api which is why it works at start and then stops after a while. | 16:38 |
*** david-lyle has joined #openstack-telemetry | 16:38 | |
*** ityaptin_laptop has joined #openstack-telemetry | 16:38 | |
krypto | gordc: good point thanks i will check for that | 16:40 |
alejandrito | gordc, one big issue that we are having with gnocchi 2.0 (the one nicodemus_ hacked with the now timestamp ) is a critical one that all different aggregates show the sames values | 16:44 |
*** BigWillie has quit IRC | 16:45 | |
*** ildikov has quit IRC | 16:46 | |
gordc | alejandrito: i'm installing ubuntu on a vm now to test | 16:48 |
gordc | alejandrito: have you tried with file backend? (trying to pinpoint whether it's a ceph thing, ubuntu thing, config thing, or something else) | 16:48 |
alejandrito | gordc, i can test it ... but want to know in what environment you are testing and works | 16:50 |
alejandrito | gordc, OS, backend for example | 16:50 |
gordc | fedora, file|swift. | 16:50 |
alejandrito | gordc, we can try file and nicodemus_ will let you know | 16:51 |
gordc | the gate uses ubuntu and file | 16:51 |
gordc | i'm not sure what sileht uses. debian and ceph probably. | 16:51 |
alejandrito | oka, switching from ubuntu/ceph to ubuntu/file on gnocchi 2.0 | 16:52 |
nicodemus_ | gordc: I'm switching to file and check the aggregates with our hack: http://paste.openstack.org/show/489008/ | 16:52 |
*** belmoreira has joined #openstack-telemetry | 16:53 | |
gordc | nicodemus_: are you asking me to validate the hack is valid? | 16:54 |
sileht | gordc, for Gnocchi/Ceph testing ubuntu trusty and ceph packages from ceph repo | 16:54 |
gordc | it will probably mess up all your data if you just reset the time | 16:54 |
*** jwcroppe has joined #openstack-telemetry | 16:55 | |
nicodemus_ | gordc: no, we did that just for metricd on 2.0 to start processing metrics | 16:55 |
nicodemus_ | if that is causing all aggregates to have the same value, it shouldn't change with file | 16:55 |
sileht | gordc, should we release a 2.0.1 with your upgrade fix, or did we wait some other fixes ? | 16:56 |
*** krypto has quit IRC | 16:56 | |
gordc | sileht: *gasp* you should be careful... red hat won't be happy ;) | 16:56 |
*** twm2016 has quit IRC | 16:56 | |
sileht | gordc, I have ton of VM with different OS | 16:56 |
gordc | sileht: good answer :P | 16:56 |
gordc | sileht: shall we merge https://review.openstack.org/#/c/286749/ | 16:57 |
sileht | gordc, of course , I have done it | 16:57 |
gordc | i have https://review.openstack.org/#/c/286246/ but it doesn't really affect anything... just throws errors when you stop service | 16:57 |
gordc | we can release 2.0.1. we can always release again | 16:59 |
*** _nadya_ has joined #openstack-telemetry | 17:00 | |
gordc | nicodemus_: i see. does it actually catch exception? i thought when i told you to add 'try/except Exception' it didn't catch error? | 17:02 |
nicodemus_ | gordc: nope, it doesn't | 17:03 |
gordc | nicodemus_: :(... i wonder what that value is that's cause mayhem. | 17:04 |
gordc | nothing in your logs seems strange: https://gist.github.com/nvlan/5e3e7f184fde2480508c | 17:04 |
*** ildikov has joined #openstack-telemetry | 17:12 | |
*** krypto has joined #openstack-telemetry | 17:18 | |
*** krypto has quit IRC | 17:22 | |
*** krypto has joined #openstack-telemetry | 17:22 | |
*** jaypipes has quit IRC | 17:22 | |
*** liusheng has quit IRC | 17:25 | |
*** liusheng has joined #openstack-telemetry | 17:27 | |
*** cdent has joined #openstack-telemetry | 17:30 | |
*** rbak has quit IRC | 17:31 | |
*** rbak has joined #openstack-telemetry | 17:33 | |
*** boris-42 has joined #openstack-telemetry | 17:35 | |
*** jaypipes has joined #openstack-telemetry | 17:36 | |
*** rickyrem has quit IRC | 17:37 | |
gordc | nicodemus_: what's the archive policy that you use? | 17:40 |
nicodemus_ | gordc: http://paste.openstack.org/show/489015/ | 17:41 |
gordc | ok. let me try that too | 17:43 |
*** jaypipes has quit IRC | 17:47 | |
*** _nadya_ has quit IRC | 17:53 | |
*** rbak_ has joined #openstack-telemetry | 17:57 | |
*** rbak has quit IRC | 17:59 | |
*** KrishR has quit IRC | 17:59 | |
*** belmoreira has quit IRC | 18:03 | |
*** safchain has joined #openstack-telemetry | 18:05 | |
*** shardy has quit IRC | 18:06 | |
*** cdent has left #openstack-telemetry | 18:06 | |
*** rbak__ has joined #openstack-telemetry | 18:07 | |
*** slaweq has joined #openstack-telemetry | 18:07 | |
slaweq | hello | 18:07 |
slaweq | I have question about ceilometer "backend" | 18:07 |
slaweq | I want to store metrics data in some opentsdb database (I will push such data with my own mechanism to db) | 18:08 |
slaweq | and I want to use ceilometer API to access to this data | 18:08 |
slaweq | is it possible somehow? | 18:08 |
slaweq | maybe there is some kind of mechanism to write own "plugin" or some "backend driver" to ceilometer? | 18:09 |
slaweq | if yes, can You maybe give me some links to documentation about that? | 18:09 |
slaweq | thx | 18:09 |
*** rbak_ has quit IRC | 18:09 | |
gordc | slaweq: i'm going to lunch but quick answer is it depends on how opentsdb stores data and how much work you want to put it to map that model to ceilometer-api | 18:11 |
gordc | you'll need to extend https://github.com/openstack/ceilometer/blob/master/ceilometer/storage/base.py | 18:12 |
*** david-lyle has quit IRC | 18:12 | |
gordc | i probably wouldn't waste my time on it unless you have a very good reason for using ceilomter-api models. | 18:12 |
slaweq | gordc: thx | 18:12 |
gordc | it's extremely verbose so doesn't really lend itself to timeserie models | 18:12 |
gordc | bbl | 18:12 |
*** david-lyle has joined #openstack-telemetry | 18:13 | |
slaweq | thx for link I will take a look on it, I have data about my cluster stored in such db and I want to use watcher | 18:13 |
slaweq | watcher is asking ceilometer about data | 18:13 |
slaweq | so I need ceilometer API as some kind of "middleware" there :) | 18:13 |
slaweq | thx a lot for help | 18:13 |
slaweq | and bon appetit :) | 18:14 |
stevelle | slaweq: gnocchi is designed for this storage, influxdb driver might be related to your effort | 18:15 |
stevelle | if there is another tsdb that you would like to use, a gnocchi driver might be easier | 18:16 |
slaweq | stevelle: ok, thx I will take a look on gnocchi also | 18:16 |
slaweq | but isn't gnocchi something what push metrics from ceilometer collector to opentsdb? | 18:16 |
stevelle | ceilometer publishes metrics to gnocchi, gnocchi provides an API for read/write of metrics backed by various storage engines | 18:17 |
stevelle | watcher can query gnocchi more efficiently | 18:18 |
*** jwcroppe has quit IRC | 18:19 | |
slaweq | ok, thx a lot for tips | 18:20 |
slaweq | I will check it | 18:20 |
*** safchain has quit IRC | 18:25 | |
*** alejandrito has quit IRC | 18:43 | |
openstackgerrit | Merged openstack/ceilometermiddleware: Updated from global requirements https://review.openstack.org/285015 | 18:43 |
nicodemus_ | gordc: I just finished testing gnocchi 2.0 with file backend and our datetime.now() hack for metricd to be able to process measures | 18:44 |
nicodemus_ | the metrics I queried return the same values for several aggregation methods | 18:45 |
gordc | nicodemus_: i don't understand, i thought you said your hack doesn't catch anything. | 18:52 |
gordc | slaweq: what stevelle said :) | 18:53 |
nicodemus_ | gordc: my bad, the "print" statement didn't print anything | 18:55 |
nicodemus_ | http://paste.openstack.org/show/489028/ | 18:57 |
nicodemus_ | the try-catch is catching the exception | 18:58 |
gordc | nicodemus_: you can actually catch it? i was under impression it didnt' work | 18:58 |
gordc | nicodemus_: can you see what the value is? that is throwing error.. | 18:58 |
gordc | your hack is more than likely just corrupting the data so i'd stop doing that. | 18:59 |
*** thorst_ has quit IRC | 19:00 | |
*** thorst has joined #openstack-telemetry | 19:01 | |
*** thorst has quit IRC | 19:01 | |
*** thorst has joined #openstack-telemetry | 19:01 | |
nicodemus_ | gordc: http://paste.openstack.org/show/489029/ is that date correct? | 19:02 |
gordc | ... nope. is one of your system's time messed up? | 19:05 |
gordc | i don't think it should throw an error though. http://pandas.pydata.org/pandas-docs/stable/gotchas.html#minimum-and-maximum-timestamps | 19:05 |
gordc | nicodemus_: are you printing 'ts'? https://github.com/openstack/gnocchi/blob/master/gnocchi/carbonara.py#L143 | 19:06 |
*** rickyrem has joined #openstack-telemetry | 19:11 | |
gordc | how come you have policies to store 5, 15, 30 and 60 years worth of data?lol | 19:17 |
*** KrishR has joined #openstack-telemetry | 19:22 | |
nicodemus_ | gordc: yeah... those timespans were left there from the first archive policy we started using | 19:23 |
gordc | kk. building with those rules now. maybe it's an edge case that is rounding the dates to some crazy old/new number. | 19:24 |
nicodemus_ | strangely, with this code: http://paste.openstack.org/show/489037/ I only see "OVERFLOW ERROR" with a 1956 date | 19:25 |
nicodemus_ | I'll try again just to be sure | 19:26 |
gordc | can you check the type as well in line 7 | 19:26 |
gordc | and i guess the value of 'freq' | 19:27 |
gordc | i can see it. | 19:38 |
gordc | it has something to do with the policies you have | 19:38 |
nicodemus_ | gordc: http://paste.openstack.org/show/489042/ | 19:42 |
nicodemus_ | every time it's that 1956 date | 19:42 |
nicodemus_ | hmmm... maybe I shouldn't try to store 60 years of data | 19:43 |
gordc | yeah, it's the 4.478976e+20 freq value | 19:46 |
gordc | when it tries to grab it's bucket of data, it's rounding back to some ridiculously old time. | 19:46 |
nicodemus_ | should I try dropping every definition above 1 year for example? | 19:47 |
gordc | sure... 5 years might be ok (re: no overflow) | 19:49 |
*** jwcroppe has joined #openstack-telemetry | 19:49 | |
*** jwcroppe has quit IRC | 19:50 | |
gordc | i don't know why you have 1956 tsthough. maybe it's a rounded value... | 19:50 |
gordc | i don't know why you have 1956 ts though. maybe it's a rounded value... | 19:50 |
*** jwcroppe has joined #openstack-telemetry | 19:50 | |
*** belmoreira has joined #openstack-telemetry | 19:50 | |
*** belmoreira has quit IRC | 19:51 | |
*** tongli has joined #openstack-telemetry | 19:53 | |
nicodemus_ | gordc: great. I'll give it a try andlet you know | 19:55 |
*** thorst has quit IRC | 20:01 | |
*** thorst has joined #openstack-telemetry | 20:01 | |
*** thorst has quit IRC | 20:05 | |
*** thorst has joined #openstack-telemetry | 20:08 | |
nicodemus_ | gordc: it appears to be working with this policy: http://paste.openstack.org/show/489043/ , I'd like to test it again with clean data | 20:15 |
gordc | nicodemus_: kk, i'm not sure exact fix but i lowered the priority since my laziness says i don't want to worry about 60 year data scenario just yet :) | 20:17 |
gordc | although the 1956 value does make a bit more sense now that i think about it. | 20:18 |
*** permalac has quit IRC | 20:30 | |
*** krypto has quit IRC | 20:34 | |
*** krypto has joined #openstack-telemetry | 20:34 | |
*** rcernin has quit IRC | 20:36 | |
*** rickyrem has quit IRC | 20:44 | |
*** thumpba has quit IRC | 20:44 | |
*** david-lyle has quit IRC | 20:45 | |
*** david-lyle has joined #openstack-telemetry | 20:47 | |
*** rickyrem has joined #openstack-telemetry | 20:57 | |
*** krypto has quit IRC | 21:00 | |
*** krypto has joined #openstack-telemetry | 21:01 | |
*** julim has quit IRC | 21:11 | |
*** Ephur has quit IRC | 21:24 | |
openstackgerrit | Vitaly Gridnev proposed openstack/ceilometer: [sahara] add events definitions regarding new notifications https://review.openstack.org/281226 | 21:39 |
nicodemus_ | gordc: how many measures should I have for the different aggregate methods to return different values? | 21:46 |
*** r-mibu has quit IRC | 21:46 | |
*** r-mibu has joined #openstack-telemetry | 21:47 | |
*** eglynn has quit IRC | 21:49 | |
gordc | depends on which metric and aggregate method... and frequency ceilometer is gathering data. | 21:50 |
gordc | probably easiest way to see something is to just make the polling intervals more frequent | 21:51 |
nicodemus_ | if using gnocchi client I execute "gnocchi measures show <UUID> --granularity 300 --aggregation X", being UUID a metric that has 10 different values, and X different aggregation methods | 21:52 |
nicodemus_ | the values displayed should change? | 21:52 |
nicodemus_ | I didn't try issuing a GET directly to the gnocchi API yet | 21:53 |
nicodemus_ | as per the docs | 21:53 |
nicodemus_ | for instance: http://paste.openstack.org/show/489059/ | 21:56 |
*** thorst has quit IRC | 22:01 | |
*** thorst has joined #openstack-telemetry | 22:02 | |
gordc | nicodemus_: hm... yes, i imagine the value should change. what happens if you use aggregation 'sum' or 'count'? | 22:05 |
gordc | err sorry. ignore sum, just saw you have it | 22:05 |
nicodemus_ | same values for count as well | 22:05 |
gordc | weird. i'll take a look a look at tests | 22:06 |
gordc | for client | 22:06 |
nicodemus_ | I see that there are a lot of objects in the ceph pool now for each metric, when with 1.3 we had about 10 | 22:06 |
*** thorst has quit IRC | 22:06 | |
nicodemus_ | now there are gnocchi_UUID_number_aggregationmethod_timespan.0 | 22:08 |
gordc | nicodemus_: yeah, before we stored all the datapoints for all the aggregates under one file. so if we wanted to update one, we had to pull in this giant blob | 22:08 |
nicodemus_ | gordc: that makes sense | 22:08 |
gordc | now it's all split up... and in smaller chunks so we're sending/handling less data | 22:09 |
nicodemus_ | would you like me to submit a bug report? | 22:09 |
gordc | nicodemus_: sure, let's target against client for now. https://bugs.launchpad.net/python-gnocchiclient/+bugs?orderby=-id&start=0 | 22:10 |
gordc | might want to include client version | 22:10 |
nicodemus_ | gordc: will do. Be advised, if I curl directly to gnocchi-api the same unchanged values are returned | 22:12 |
nicodemus_ | issuing a GET to v1/metric/fc8b7686-dae6-46a8-863d-fb89f79365c1/measures?aggregation=min | 22:12 |
gordc | nicodemus_: put it against gnocchi. don't really have time to look at it right now (sorry). | 22:13 |
gordc | i would include archive policy and frequency of pollin in ceiloemter | 22:13 |
nicodemus_ | gordc: will do, np | 22:13 |
nicodemus_ | gordc: thanks! | 22:14 |
gordc | and the name of metric | 22:14 |
*** thorst has joined #openstack-telemetry | 22:23 | |
tongli | @gordc, gordon, are you around? | 22:26 |
*** krypto has quit IRC | 22:27 | |
*** thorst has quit IRC | 22:27 | |
tongli | installed Ceilometer Liberty. For some reason, notification agent won't place the meters on the metering queue. | 22:29 |
tongli | Can someone tell me what configuration option is needed? | 22:29 |
*** nicodemus_ has quit IRC | 22:34 | |
openstackgerrit | Merged openstack/ceilometer: Remove unused pngmath Sphinx extension https://review.openstack.org/286202 | 22:49 |
*** yarkot_ has joined #openstack-telemetry | 22:53 | |
*** yarkot_ has quit IRC | 22:57 | |
*** yarkot_ has joined #openstack-telemetry | 22:57 | |
*** yarkot_ has quit IRC | 22:59 | |
*** Qiming has joined #openstack-telemetry | 23:05 | |
*** gordc has quit IRC | 23:09 | |
*** tongli has quit IRC | 23:14 | |
*** rickyrem has quit IRC | 23:28 | |
*** ljxiash has joined #openstack-telemetry | 23:33 | |
*** KrishR has quit IRC | 23:51 | |
*** pradk has quit IRC | 23:53 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!