Wednesday, 2016-02-17

*** r-mibu has joined #openstack-telemetry00:12
*** rbak has quit IRC00:17
openstackgerritMerged openstack/ceilometer: Adds timestamp option to Aggregation transformer  https://review.openstack.org/27367200:57
*** cheneydc has joined #openstack-telemetry01:01
marcin12345gordc: they are singluar not plural so: event_dispatcher = database and meter_dispatcher = gnocchi01:16
*** ekarlso has quit IRC01:30
*** Ephur has quit IRC01:32
*** ljxiash has joined #openstack-telemetry01:39
*** ljxiash has quit IRC01:40
*** ljxiash has joined #openstack-telemetry01:40
*** ekarlso has joined #openstack-telemetry01:45
*** thorst has joined #openstack-telemetry01:45
*** thorst has quit IRC01:47
*** thorst has joined #openstack-telemetry01:48
*** thorst has quit IRC01:52
*** Liuqing has joined #openstack-telemetry02:10
*** prashantD has quit IRC02:12
*** liamji has joined #openstack-telemetry02:18
*** changbl has joined #openstack-telemetry02:26
*** changbl has quit IRC02:26
*** dd has joined #openstack-telemetry02:32
*** dd has quit IRC02:34
*** achatterjee has joined #openstack-telemetry02:49
*** changbl has joined #openstack-telemetry02:51
*** thorst has joined #openstack-telemetry02:51
*** thorst has quit IRC02:57
marcin12345gordc: I need your help my ceilometer still sends samples to mysql, while I wanted to send it to gnocchi03:07
marcin12345I set dispatcher=gnocchi meter_dispatcher=gnocchi event_dispatcher=database [dispatcher_gnocchi] url=http://<my host>:804103:12
*** prashantD has joined #openstack-telemetry03:25
*** ljxiash has quit IRC03:28
*** ljxiash has joined #openstack-telemetry03:28
*** changbl has quit IRC03:32
*** ljxiash has quit IRC03:32
*** prashantD has quit IRC03:38
*** prashantD has joined #openstack-telemetry03:39
*** changbl has joined #openstack-telemetry03:40
*** rbak has joined #openstack-telemetry03:48
*** thorst has joined #openstack-telemetry03:56
*** thorst has quit IRC04:02
*** ljxiash has joined #openstack-telemetry04:12
*** ljxiash has quit IRC04:13
*** dave-mccowan has quit IRC04:22
*** links has joined #openstack-telemetry04:41
*** jwcroppe has joined #openstack-telemetry04:55
*** links has quit IRC04:57
*** thorst has joined #openstack-telemetry04:59
*** ljxiash has joined #openstack-telemetry05:01
*** yprokule has joined #openstack-telemetry05:01
*** prashantD has quit IRC05:04
*** sileht has quit IRC05:05
*** thorst has quit IRC05:06
*** sileht has joined #openstack-telemetry05:21
*** rbak has quit IRC05:23
*** cheneydc has quit IRC05:48
*** dongc has joined #openstack-telemetry05:48
*** dongc is now known as cheneydc05:50
*** thorst has joined #openstack-telemetry06:06
*** jwcroppe has quit IRC06:06
*** jwcroppe has joined #openstack-telemetry06:07
*** jwcroppe has quit IRC06:11
*** thorst has quit IRC06:11
*** _nadya_ has quit IRC06:27
*** _nadya_ has joined #openstack-telemetry06:28
*** _nadya_ has quit IRC06:32
*** _nadya_ has joined #openstack-telemetry06:39
-openstackstatus- NOTICE: A problem with the mirror used for CI jobs in the rax-iad region has been corrected. Please recheck changes that recently failed jobs on nodes in rax-iad.06:50
*** thorst has joined #openstack-telemetry07:09
*** maestro1 has joined #openstack-telemetry07:13
maestro1Hi All... While i tried disk.usage meter converted threshold to Bytes, it is in insufficient data state, pls help me out07:14
*** thorst has quit IRC07:17
openstackgerritZi Lian Ji proposed openstack/ceilometer: Enable the Load Balancer v2 for the Ceilometer(Part One)  https://review.openstack.org/27451807:18
*** julim has quit IRC07:28
openstackgerritliusheng proposed openstack/python-aodhclient: Return the error message of API request failure  https://review.openstack.org/28051907:29
*** _nadya_ has quit IRC07:29
*** julim has joined #openstack-telemetry07:30
openstackgerritliusheng proposed openstack/python-aodhclient: Add abbreviation of --meter-name hint in threshold alarm creation  https://review.openstack.org/28048207:42
*** rcernin has joined #openstack-telemetry07:42
openstackgerritZi Lian Ji proposed openstack/ceilometer: Enable the Load Balancer v2 for the Ceilometer(Part Two)  https://review.openstack.org/27743407:45
*** ildikov has quit IRC07:46
*** lsmola has joined #openstack-telemetry08:00
openstackgerritRen Qiaowei proposed openstack/ceilometer: Change LOG.warn to LOG.warning  https://review.openstack.org/28110008:03
*** thorst has joined #openstack-telemetry08:14
*** maestro1 has quit IRC08:15
*** ildikov has joined #openstack-telemetry08:16
*** thorst has quit IRC08:22
*** shardy has joined #openstack-telemetry08:35
openstackgerritliusheng proposed openstack/python-aodhclient: Add abbreviation of --meter-name hint in threshold alarm creation  https://review.openstack.org/28048208:40
*** pcaruana has joined #openstack-telemetry08:42
*** safchain has joined #openstack-telemetry08:55
*** liamji has quit IRC08:56
*** liamji has joined #openstack-telemetry08:57
*** efoley has joined #openstack-telemetry09:08
openstackgerritJulien Danjou proposed openstack/ceilometer: tests: fix unworking debug output  https://review.openstack.org/27959609:13
openstackgerritliusheng proposed openstack/python-aodhclient: Remove unused mothod  https://review.openstack.org/28113109:14
*** _nadya_ has joined #openstack-telemetry09:14
*** maestro1 has joined #openstack-telemetry09:16
*** maestro1 has left #openstack-telemetry09:17
*** Pandy has joined #openstack-telemetry09:18
*** thorst has joined #openstack-telemetry09:20
*** yassine__ has joined #openstack-telemetry09:24
*** bdossant has joined #openstack-telemetry09:26
*** thorst has quit IRC09:27
jd__sorry liusheng, you're entering the wild free zone of Telemetry where we don't follow cargo cult :)09:28
liushengjd__: lol09:30
*** Liuqing has quit IRC09:41
openstackgerritRen Qiaowei proposed openstack/ceilometer: Change LOG.warn to LOG.warning  https://review.openstack.org/28110009:47
*** ildikov has quit IRC09:52
*** ramishra has quit IRC09:52
*** yarkot has quit IRC09:52
*** pasquier-s has quit IRC09:52
*** fc__ has quit IRC09:52
*** hughhalf has quit IRC09:52
*** serverascode has quit IRC09:52
*** elemoine_ has quit IRC09:52
*** hparekh has quit IRC09:52
*** adreznec has quit IRC09:52
*** DinaBelova has quit IRC09:52
*** patrickeast has quit IRC09:52
*** smurke has quit IRC09:52
*** afazekas has quit IRC09:52
*** afazekas has joined #openstack-telemetry09:52
*** fc__ has joined #openstack-telemetry09:52
*** hparekh has joined #openstack-telemetry09:53
*** pasquier-s has joined #openstack-telemetry09:53
*** hughhalf has joined #openstack-telemetry09:53
*** DinaBelova has joined #openstack-telemetry09:53
*** adreznec has joined #openstack-telemetry09:54
*** kragniz has quit IRC09:56
*** kragniz has joined #openstack-telemetry09:58
*** elemoine_ has joined #openstack-telemetry10:01
*** ramishra has joined #openstack-telemetry10:01
*** serverascode has joined #openstack-telemetry10:02
*** cheneydc has quit IRC10:02
*** ramishra has quit IRC10:03
*** hparekh has quit IRC10:03
*** yassine__ has quit IRC10:03
*** rcernin has quit IRC10:03
*** yassine__ has joined #openstack-telemetry10:03
*** hparekh has joined #openstack-telemetry10:03
*** rcernin has joined #openstack-telemetry10:04
*** sileht has quit IRC10:08
*** chlong has quit IRC10:08
*** nijaba has quit IRC10:08
*** chlong has joined #openstack-telemetry10:08
*** sileht has joined #openstack-telemetry10:09
openstackgerritMerged openstack/python-aodhclient: Remove unused method  https://review.openstack.org/28113110:10
*** ramishra has joined #openstack-telemetry10:12
*** patrickeast has joined #openstack-telemetry10:15
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi: Allows to use cradox with ceph storage  https://review.openstack.org/27944810:23
*** jwcroppe has joined #openstack-telemetry10:24
*** thorst has joined #openstack-telemetry10:24
*** jwcroppe_ has joined #openstack-telemetry10:27
*** jwcroppe has quit IRC10:28
openstackgerritliusheng proposed openstack/python-aodhclient: WIP: Make the alarm list output more concise  https://review.openstack.org/28117510:30
*** thorst has quit IRC10:32
openstackgerritZi Lian Ji proposed openstack/ceilometer: Enable the Load Balancer v2 for the Ceilometer(Part One)  https://review.openstack.org/27451810:34
*** Liuqing has joined #openstack-telemetry10:40
*** ljxiash has quit IRC10:46
*** jwcroppe_ has quit IRC10:46
*** liamji has quit IRC10:46
*** jwcroppe has joined #openstack-telemetry10:46
*** patrickeast has quit IRC10:49
*** serverascode has quit IRC10:49
*** Pandy has quit IRC10:49
*** flwang has quit IRC10:49
*** albertom has quit IRC10:49
*** mstyne has quit IRC10:49
*** samstudio8 has quit IRC10:49
*** Pandy has joined #openstack-telemetry10:50
*** albertom has joined #openstack-telemetry10:50
*** yarkot has joined #openstack-telemetry10:50
*** jwcroppe has quit IRC10:51
*** smurke has joined #openstack-telemetry10:51
*** Pandy1 has joined #openstack-telemetry10:52
*** cdent has joined #openstack-telemetry10:52
*** efoley has quit IRC10:52
*** mstyne has joined #openstack-telemetry10:52
*** yassine__ has quit IRC10:53
*** Pandy has quit IRC10:54
*** Pandy has joined #openstack-telemetry10:55
*** ljxiash has joined #openstack-telemetry10:56
*** samstudio8 has joined #openstack-telemetry10:56
*** serverascode has joined #openstack-telemetry10:57
*** efoley has joined #openstack-telemetry10:57
*** Pandy1 has quit IRC10:58
*** patrickeast has joined #openstack-telemetry11:01
*** ljxiash has quit IRC11:01
openstackgerritZhiQiang Fan proposed openstack/ceilometer: Gnocchi: fix ResourcesDefinitionException for py3  https://review.openstack.org/28119011:03
*** rcernin has quit IRC11:03
*** ramishra has quit IRC11:04
*** elemoine has quit IRC11:04
*** kbyrne has quit IRC11:04
*** wolsen has quit IRC11:04
*** mgagne has quit IRC11:04
*** ryanpetrello has quit IRC11:04
*** mgagne has joined #openstack-telemetry11:04
*** datravis has joined #openstack-telemetry11:04
*** elemoine has joined #openstack-telemetry11:05
*** wolsen has joined #openstack-telemetry11:05
*** ryanpetrello has joined #openstack-telemetry11:05
*** kbyrne has joined #openstack-telemetry11:07
*** ramishra has joined #openstack-telemetry11:10
*** sileht has quit IRC11:13
*** sileht has joined #openstack-telemetry11:17
*** thorst has joined #openstack-telemetry11:30
*** thorst has quit IRC11:36
*** kbyrne has quit IRC11:39
*** krotscheck has quit IRC11:39
*** toddnni has quit IRC11:39
*** jasonamyers has quit IRC11:39
*** toddnni has joined #openstack-telemetry11:40
*** kbyrne has joined #openstack-telemetry11:40
*** jasonamyers has joined #openstack-telemetry11:42
*** jasonamyers has joined #openstack-telemetry11:42
*** krotscheck has joined #openstack-telemetry11:42
*** rcernin has joined #openstack-telemetry11:49
*** smurke has quit IRC11:50
*** _nadya_ has quit IRC11:50
*** julim has quit IRC11:50
*** gzhai2 has quit IRC11:50
*** gtt116_ has quit IRC11:50
*** bapalm has quit IRC11:50
*** sheeprine has quit IRC11:50
*** jdandrea has quit IRC11:50
*** therve has quit IRC11:50
*** gzhai2 has joined #openstack-telemetry11:50
*** sheeprine has joined #openstack-telemetry11:50
*** bapalm has joined #openstack-telemetry11:50
*** _nadya_ has joined #openstack-telemetry11:50
*** jdandrea has joined #openstack-telemetry11:51
*** julim has joined #openstack-telemetry11:51
*** smurke has joined #openstack-telemetry11:51
*** gtt116 has joined #openstack-telemetry11:55
*** gzhai3 has joined #openstack-telemetry11:59
*** openstack has joined #openstack-telemetry12:05
*** afazekas has joined #openstack-telemetry12:07
*** achatterjee has quit IRC12:07
*** bdossant has quit IRC12:11
*** bdossant has joined #openstack-telemetry12:11
*** lsmola has quit IRC12:12
openstackgerritVitaly Gridnev proposed openstack/ceilometer: [sahara] add events definitions regarding new notifications  https://review.openstack.org/28122612:19
*** yassine__ has joined #openstack-telemetry12:19
*** gtt116 has quit IRC12:24
*** ryanpetrello has quit IRC12:24
*** mstyne has quit IRC12:24
*** albertom has quit IRC12:24
*** elemoine_ has quit IRC12:24
*** kragniz has quit IRC12:24
*** adreznec has quit IRC12:24
*** hughhalf has quit IRC12:24
*** DinaBelova has quit IRC12:24
*** larainema has quit IRC12:24
*** ityaptin_ has quit IRC12:24
*** jroll has quit IRC12:24
*** zigo has quit IRC12:24
*** swamireddy has quit IRC12:24
*** jroll has joined #openstack-telemetry12:25
*** ityaptin_ has joined #openstack-telemetry12:25
*** ryanpetrello has joined #openstack-telemetry12:25
*** larainema has joined #openstack-telemetry12:25
*** kragniz has joined #openstack-telemetry12:25
*** DinaBelova has joined #openstack-telemetry12:25
*** larainema has quit IRC12:25
*** larainema has joined #openstack-telemetry12:25
*** mstyne has joined #openstack-telemetry12:25
*** albertom has joined #openstack-telemetry12:26
*** zigo has joined #openstack-telemetry12:26
*** hughhalf has joined #openstack-telemetry12:26
*** lsmola has joined #openstack-telemetry12:26
*** swamireddy has joined #openstack-telemetry12:27
*** gtt116 has joined #openstack-telemetry12:28
*** Pandy has quit IRC12:31
*** alextricity25_ has joined #openstack-telemetry12:32
*** adreznec has joined #openstack-telemetry12:32
*** datravis has quit IRC12:32
*** mgagne has quit IRC12:32
*** patrickeast has quit IRC12:32
*** cdent has quit IRC12:32
*** yarkot has quit IRC12:32
*** safchain has quit IRC12:32
*** r-mibu has quit IRC12:32
*** llu_laptop has quit IRC12:32
*** EmilienM has quit IRC12:32
*** tpeoples has quit IRC12:32
*** agireud has quit IRC12:32
*** openstackgerrit_ has quit IRC12:32
*** openstackgerrit has quit IRC12:32
*** alextricity25 has quit IRC12:32
*** davidlenwell has quit IRC12:32
*** mgagne_ has joined #openstack-telemetry12:32
*** mgagne_ has quit IRC12:32
*** mgagne_ has joined #openstack-telemetry12:32
*** datravis has joined #openstack-telemetry12:32
*** r-mibu has joined #openstack-telemetry12:32
*** safchain has joined #openstack-telemetry12:32
*** davidlenwell has joined #openstack-telemetry12:33
*** openstackgerrit has joined #openstack-telemetry12:34
*** openstackgerrit_ has joined #openstack-telemetry12:34
*** efoley has quit IRC12:35
*** llu has joined #openstack-telemetry12:36
*** EmilienM has joined #openstack-telemetry12:36
*** yarkot has joined #openstack-telemetry12:37
*** agireud has joined #openstack-telemetry12:38
*** elemoine_ has joined #openstack-telemetry12:42
*** gordc has joined #openstack-telemetry12:42
*** Pandy has joined #openstack-telemetry12:47
*** Pandy1 has joined #openstack-telemetry12:49
openstackgerritgordon chung proposed openstack/ceilometer: improve notification processing  https://review.openstack.org/27574112:49
*** thorst has joined #openstack-telemetry12:51
*** tpeoples has joined #openstack-telemetry12:51
*** Pandy has quit IRC12:51
*** ildikov has joined #openstack-telemetry12:58
*** efoley has joined #openstack-telemetry13:00
*** cdent has joined #openstack-telemetry13:00
*** alejandrito has joined #openstack-telemetry13:02
*** cdent has quit IRC13:02
*** cdent has joined #openstack-telemetry13:03
*** efoley_ has joined #openstack-telemetry13:03
*** efoley has quit IRC13:03
*** jwcroppe has joined #openstack-telemetry13:06
*** marcin12345 has quit IRC13:10
*** ildikov has quit IRC13:13
*** nicodemus_ has joined #openstack-telemetry13:22
nicodemus_morning sileht, do you have a minute?13:23
*** flwang has joined #openstack-telemetry13:23
silehtnicodemus_: sure13:25
nicodemus_sileht: I'd like to ask you about the new lib you mentioned on Monday, cradox. I'd love to test it :)13:26
*** ildikov has joined #openstack-telemetry13:27
openstackgerritVitaly Gridnev proposed openstack/ceilometer: [sahara] add events definitions regarding new notifications  https://review.openstack.org/28122613:28
*** Pandy1 has left #openstack-telemetry13:29
*** peristeri has joined #openstack-telemetry13:29
silehtnicodemus_, you can donwnload it here: https://pypi.python.org/pypi/cradox13:30
openstackgerritVitaly Gridnev proposed openstack/ceilometer: [sahara] add events definitions regarding new notifications  https://review.openstack.org/28122613:31
nicodemus_sileht: lovely! Is there any special config to be done?13:31
silehtnicodemus_, you need to apply this to use it with Gnocchi https://review.openstack.org/#/c/279448/13:32
*** dave-mccowan has joined #openstack-telemetry13:33
nicodemus_sileht: awesome, I'll give it a try and let you know. Thanks a lot!13:33
silehtnicodemus_, cradox will be the futur official rados pyton module13:34
silehtnicodemus_, I have just rename it cradox to not complict will an already installed rados module13:34
silehtnicodemus_, if Gnocchi found both cradox and rados it will use cradox13:35
nicodemus_sileht: perfect13:36
openstackgerritMerged openstack/python-aodhclient: Add abbreviation of --meter-name hint in threshold alarm creation  https://review.openstack.org/28048213:36
gordcnicodemus_: you may want to try https://review.openstack.org/#/c/279659/ as well13:42
gordc*should* help with metricd processing13:43
nicodemus_gordc: I tried that patch as well as https://review.openstack.org/#/c/276485 on monday, and those indeed helped13:44
nicodemus_I'll deploy cradox on the same HW host were those two patches are already working13:44
*** dhellmann has quit IRC13:44
silehtgordc, haven see my number about cradox vs rados python module ?13:45
gordcnicodemus_: phew. good to know :)13:45
gordcsileht: the commit message?13:45
*** dhellmann has joined #openstack-telemetry13:47
silehtgordc, performance numbers13:48
gordc15x?13:48
gordchttps://review.openstack.org/#/c/279448/17/doc/source/configuration.rst? i like big numbers :)13:48
silehtgordc, 30sec vs 8minutes to process 10000 measures on my devstack (that uses tmpfs as harddrive)13:49
silehtgordc, yes13:49
* sileht have forgot that he documents that13:49
gordcoh wow. that's nice.13:49
silehtremember don't use ctypes for IO stuff13:50
gordcsileht: were you building cradox by yourself?13:51
silehtgordc, yes13:51
gordcsileht: glad we're on the same team :)13:52
silehtlol13:52
*** jdandrea_ is now known as jdandrea13:52
cdentIsn't sileht on all teams?13:53
gordccdent: not yours.13:56
cdentyou're a jerk gordc, a real kneebiter13:56
gordccdent: i'm too lazy to urbandictionary kneebiter13:57
cdentthat's a movie quote. I can't remember which movie13:58
gordcah i see. i'll add it to the queue if you figure out.13:59
*** efoley_ has quit IRC14:00
*** ljxiash has joined #openstack-telemetry14:01
cdentsorry, not movie, hitchhiker's guide14:01
*** efoley_ has joined #openstack-telemetry14:03
gordcwhen there's a movie for a book, it's a movie to me.14:04
openstackgerritMerged openstack/ceilometer: tests: fix unworking debug output  https://review.openstack.org/27959614:07
*** julim has quit IRC14:10
openstackgerritNadya Shakhat proposed openstack/ceilometer: [WIP] Add cache abstraction  https://review.openstack.org/27671414:19
cdentgordc can't read14:21
*** bdossant_ has joined #openstack-telemetry14:22
*** Liuqing has quit IRC14:24
gordcthis is true14:25
*** bdossant has quit IRC14:26
openstackgerritgordon chung proposed openstack/ceilometer: cleanup devstack plugin for gnocchi  https://review.openstack.org/27081814:31
*** patrickeast_ has joined #openstack-telemetry14:33
*** patrickeast_ has quit IRC14:33
*** elemoine_ has quit IRC14:33
*** liamji has joined #openstack-telemetry14:36
*** bdossant_ has quit IRC14:36
*** KrishR has joined #openstack-telemetry14:36
*** KrishR has quit IRC14:37
*** elemoine_ has joined #openstack-telemetry14:37
openstackgerritJulien Danjou proposed openstack/gnocchi: carbonara: compress AggregatedTimeSerie using LZ4  https://review.openstack.org/27636514:38
*** ildikov has quit IRC14:42
gordcsileht: i missed this in oslo.messaging patch: https://review.openstack.org/#/c/281313/14:49
*** rbak has joined #openstack-telemetry14:53
*** julim has joined #openstack-telemetry14:55
*** ddieterly has joined #openstack-telemetry15:01
liamjigordc: Hi, do you have time to review the code: https://review.openstack.org/#/c/274518/ ? thanks : )15:03
*** pradk has joined #openstack-telemetry15:04
*** dhellmann has quit IRC15:05
*** dhellmann has joined #openstack-telemetry15:05
*** guillaume_ has joined #openstack-telemetry15:11
*** guillaume_ has quit IRC15:25
*** guillaume_ has joined #openstack-telemetry15:39
_nadya_sileht: Hi Mehdi! Thank you very much for your input regarding exchanges15:41
_nadya_sileht: one quick question... I'm investigating transformers still and today I noticed the strange behaviour on master branch. We start to process the next notification before finishing the previous one. I see your changes https://review.openstack.org/#/q/topic:sileht/batch-dispatcher . Perhaps, it may explain my observations? I run one notification worker, so only one thread. I expected to see one-by-one notificat15:45
_nadya_ion processing15:45
*** rbak has quit IRC15:45
gordc_nadya_: did you set executor_thread_pool_size to 1?15:49
openstackgerritMerged openstack/gnocchi: carbonara: compress AggregatedTimeSerie using LZ4  https://review.openstack.org/27636515:49
openstackgerritMerged openstack/gnocchi: Update configuration document  https://review.openstack.org/26327515:49
_nadya_gordc: no, is it an oslo option?15:50
gordc_nadya_: it's an oslo.messaging option. this is what i was mentioning when i was talking about threading in previous discussions15:50
gordcone worker does not mean one thread15:50
*** yprokule has quit IRC15:50
_nadya_gordc: I'm gonna cry15:51
gordcone worker by default has 64 threads... so you have 64 races15:51
_nadya_gordc: why I haven't seen it, I don't understand this. Is it a new option?15:51
*** efoley_ has quit IRC15:52
gordc_nadya_: nope. it's always worked like that.15:52
gordcor well it was called rpc_thread_pool_size before15:52
gordc_nadya_: i have a patch that makes it configurable to 1 thread15:52
gordc(without settingn the global option)15:52
*** jwcroppe_ has joined #openstack-telemetry15:53
_nadya_gordc: 64 threads... does this mean the listener may try to consume 64 messages at once?15:54
gordcyep.15:55
*** efoley_ has joined #openstack-telemetry15:55
*** ljxiash has quit IRC15:55
_nadya_gordc: I haven't seen that notification.info decreases by 64 messages at once15:56
*** jwcroppe has quit IRC15:56
*** ljxiash has joined #openstack-telemetry15:57
gordcerr... i'm not sure how you'd see that, but basically at any given time a listener is handling up to 64 messages15:57
*** rbak has joined #openstack-telemetry15:57
gordc(by default)15:57
_nadya_gordc: now I see the situation when 1 worker with local cache loses samples, a lot of out of orders. Trying to understand what's going on15:58
*** annasort has joined #openstack-telemetry15:59
*** jwcroppe_ has quit IRC15:59
openstackgerritJulien Danjou proposed openstack/gnocchi: storage: autoconfigure coordination_url  https://review.openstack.org/27090716:00
gordc_nadya_: it's this: https://review.openstack.org/#/c/275741/16:00
*** patrickeast_ has joined #openstack-telemetry16:01
jd__the new cloud looks sometime slow for such test http://logs.openstack.org/84/280784/1/gate/gate-gnocchi-tox-py34-mysql/4eba7a7/console.html gordc16:01
*** liamji has quit IRC16:01
_nadya_gordc: cool! commit message is very promising :) Thank you!16:02
gordcas i mentioned, basically the more worker * thread enabled, the more likely you will have race between related samples16:02
gordcjd__: yeah, i noticed that...16:03
gordcjd__: should we lower the points per split for tests or something?16:03
_nadya_gordc: yep, I see. Now it looks like the more notifications we processes at once, the much shuffling we have. Because the first "batch" is not finished yet, but we already start 100th batch.16:05
*** liamji has joined #openstack-telemetry16:06
_nadya_gordc: Thank you, Gordon! It helped a lot16:06
gordc_nadya_: np16:06
*** ildikov has joined #openstack-telemetry16:09
*** efoley_ has quit IRC16:10
*** MVenesio has joined #openstack-telemetry16:10
*** _nadya_ has quit IRC16:10
*** efoley_ has joined #openstack-telemetry16:11
*** cdent has quit IRC16:15
*** guillaume_ has quit IRC16:20
nicodemus_sileht: I've tested cradox, however I don't see much difference... http://paste.openstack.org/show/487292/16:31
nicodemus_sileht: the full logs for each run are available for download here: http://s000.tinyupload.com/index.php?file_id=05886189626316686744 (too long for paste)16:31
silehtnicodemus_, did you restart the API too16:32
sileht?16:32
*** guillaume_ has joined #openstack-telemetry16:33
nicodemus_sileht: no... should I? The API is in a different host16:33
silehtnicodemus_, gnocchi status only use the API16:33
silehtnicodemus_, you have to install cradox on API too16:34
*** cdent has joined #openstack-telemetry16:34
nicodemus_sileht: I see. I'll give it another try16:35
*** pcaruana has quit IRC16:35
openstackgerritgordon chung proposed openstack/gnocchi: partition unprocessed measures across workers  https://review.openstack.org/27965916:35
*** prashantD has joined #openstack-telemetry16:36
nicodemus_sileht: just for better understand it... why would cradox be needed on the API?16:37
silehtnicodemus_, API writes posted measures into a temporary place oin CEPH16:38
silehtnicodemus_, also the status check this temporary place to see how many thing metricd haven't done16:38
*** cdent has quit IRC16:38
silehtnicodemus_, because it connects directly to Ceph it need the python binding for rados16:39
*** cdent has joined #openstack-telemetry16:39
nicodemus_sileht: I see. Just FYI, my testing consisted on letting the two ceilometer-agent-compute finish their run and then stopping them, so that no new measures are being posted to the API16:40
nicodemus_sileht: during metricd's run, the only one accessing the CEPH cluster are the metricd workers16:41
silehtnicodemus_, when you issues 'gnocchi status', API access to CEPH16:41
nicodemus_sileht: the 'gnocchi status' was issued only before starting metricd, in order to have an exact number of measures to be processed... I recorded the end time using metricd's logs16:42
silehtnicodemus_, oh I see16:43
nicodemus_sileht: I'm about to measure again with the API on the same metricd host, with cradox16:44
*** mgagne_ is now known as mgagne16:45
*** prashantD has quit IRC16:45
silehtnicodemus_, the log 'Ceph storage backend use '<module 'rados' from '/usr/lib/python2.7/dist-packages/rados.pyc'>' python library' is weird, it should "Ceph storage backend use 'rados' python library"16:49
*** liamji has quit IRC16:49
silehtnicodemus_, that can't be my change that log that16:49
nicodemus_sileht: yeah, I added that16:49
*** liamji has joined #openstack-telemetry16:50
nicodemus_In order to be sure that metricd was using rados, isntead of uninstalling cradox16:50
silehtnicodemus_, RADOS_MODULE_NAME should not contains the module16:50
*** sheeprine has quit IRC16:50
*** sheeprine has joined #openstack-telemetry16:52
nicodemus_sileht: this is what I did for loading rados: http://paste.openstack.org/show/487299/16:52
silehtnicodemus_, oki, that's good :)16:53
*** MVenesio has quit IRC16:53
*** belmoreira has joined #openstack-telemetry16:54
*** boris-42 has joined #openstack-telemetry16:55
*** ljxiash has quit IRC16:56
*** julim has quit IRC16:58
nicodemus_sileht: the same result happened with the API using cradox, it took from 11:54:39 to 11:58:31 to process the same 867 measures posted by the two ceilometer-agent-computes17:00
*** liamji has quit IRC17:01
*** julim has joined #openstack-telemetry17:02
silehtnicodemus_, does your metricd server is CPU bound ?17:02
jd__gordc: something like that :)17:02
silehtI means cpu usage is ~ 400% for you17:03
*** ljxiash has joined #openstack-telemetry17:03
*** yassine__ has quit IRC17:04
nicodemus_the server has two intel e5-2620 for a total of 24 threads, when metricd is running I have a load average of 8. I configured gnocchi to have 16 metricd workers and 4 aggregation workers17:05
nicodemus_a 'top' when metricd is running shows about 50% cpu usage and 50% idle (average for all cores)17:06
silehtnicodemus_, each core have ~ 50% or those where metricd are running are 100% ?17:07
nicodemus_sileht: take a look how it is now while processing: http://paste.openstack.org/show/487303/17:08
silehtnicodemus_, ok that why you didn't see the difference between each lib17:10
nicodemus_sileht: is the server unable to cope with the load?17:10
silehtnicodemus_, many of your metrics take 5 to 8 seconds to compute payload to store according your log17:11
silehtnicodemus_, ceph get request is always 0.00 in your case17:11
silehtnicodemus_, infortunatly we didn't log the write time (perhaps something we should add for debugging)17:12
nicodemus_sileht: would you like me to add more CPU power? I do have a second server with the same HW specs17:12
*** ljxiash has quit IRC17:12
silehtnicodemus_, I will try to do some stats with your log to understand if this is due to measures computing only or if metricd consume cpu somewhere else too17:14
*** ljxiash has joined #openstack-telemetry17:14
*** ddieterly has quit IRC17:15
nicodemus_sileht: let me know if I can help with any more logs/testing17:15
*** jwcroppe has joined #openstack-telemetry17:15
openstackgerritgordon chung proposed openstack/ceilometer: cleanup devstack plugin for gnocchi  https://review.openstack.org/27081817:16
*** belmoreira has quit IRC17:25
*** ddieterly has joined #openstack-telemetry17:29
*** rbak has quit IRC17:31
*** larainema has quit IRC17:33
*** stevelle has quit IRC17:33
*** ljxiash has quit IRC17:33
*** patrickeast_ has quit IRC17:34
*** davidlenwell has quit IRC17:34
*** zigo has quit IRC17:34
*** yarkot has quit IRC17:34
*** rbak has joined #openstack-telemetry17:35
*** larainema has joined #openstack-telemetry17:35
*** elemoine_ has quit IRC17:35
*** mgagne has quit IRC17:35
*** ryanpetrello has quit IRC17:35
openstackgerritMehdi Abaakouk (sileht) proposed openstack/python-gnocchiclient: Add batching to client  https://review.openstack.org/27342917:35
*** mstyne has quit IRC17:36
*** datravis has quit IRC17:36
*** zigo has joined #openstack-telemetry17:36
*** davidlenwell has joined #openstack-telemetry17:37
*** stevelle has joined #openstack-telemetry17:39
*** mgagne has joined #openstack-telemetry17:39
*** ryanpetrello has joined #openstack-telemetry17:39
*** datravis has joined #openstack-telemetry17:39
*** mstyne has joined #openstack-telemetry17:41
*** patrickeast_ has joined #openstack-telemetry17:41
*** elemoine_ has joined #openstack-telemetry17:42
*** _nadya_ has joined #openstack-telemetry17:47
*** _nadya_ has quit IRC17:48
*** thumpba has joined #openstack-telemetry17:51
*** efoley_ has quit IRC17:59
*** _nadya_ has joined #openstack-telemetry18:00
silehtm18:00
*** jwcroppe has quit IRC18:01
*** guillaume_ has quit IRC18:01
*** jwcroppe has joined #openstack-telemetry18:02
*** julim has quit IRC18:03
*** julim has joined #openstack-telemetry18:05
openstackgerritMerged openstack/gnocchi: storage: fix typo in Metric.__eq__  https://review.openstack.org/28078418:08
*** _nadya_ has quit IRC18:13
*** guillaume_ has joined #openstack-telemetry18:15
*** safchain has quit IRC18:17
*** lsmola has quit IRC18:36
*** rcernin has quit IRC18:36
*** _nadya_ has joined #openstack-telemetry19:05
*** rcernin has joined #openstack-telemetry19:07
*** marcin12345 has joined #openstack-telemetry19:17
marcin12345does anyone know how to configure Ceilometer to dispatch samples to Gnocchi?19:18
marcin12345I have dispatcher=database meter_dispatcher=gnocchi event_dispatcher=database [dispatcher_gnocchi] url=http://<my host>:804119:18
marcin12345and sadly everything still goes to MySQL19:18
*** _nadya_ has quit IRC19:20
nicodemus_marcin12345: I believe you have to configure dispatcher=gnocchi19:20
marcin12345I tried that and get: ceilometer.dispatcher.gnocchi [-] fail to retrieve user of Gnocchi service19:23
marcin12345i am going to check if my keystone catalog is correct19:23
marcin12345my user definitely exists19:23
marcin12345I also get this: File "/usr/lib/python2.7/site-packages/ceilometer/dispatcher/gnocchi.py", line 193, in gnocchi_project_id19:24
*** nijaba has joined #openstack-telemetry19:28
*** nijaba has quit IRC19:28
*** nijaba has joined #openstack-telemetry19:28
*** ddieterly has quit IRC19:37
*** ddieterly has joined #openstack-telemetry19:46
marcin12345for Gnocchi should keystone catalog use service type 'metric' or 'key-manager'19:51
nicodemus_marcin12345: metric19:59
*** _nadya_ has joined #openstack-telemetry20:00
nicodemus_sileht, quick question: should metricd's processing time depend on/change with the volume of data already present in the ceph pool?20:07
*** gordc has quit IRC20:15
*** _nadya_ has quit IRC20:32
*** krotscheck is now known as krotscheck_dcm20:34
marcin12345nicodemus: thank you20:37
*** annasort has quit IRC20:44
*** guillaume_ has quit IRC20:50
*** ddieterly has quit IRC20:51
*** ddieterly has joined #openstack-telemetry20:52
*** gordc has joined #openstack-telemetry20:53
*** ddieterly has quit IRC20:56
*** thumpba has quit IRC20:57
*** guillaume_ has joined #openstack-telemetry21:08
*** ddieterly has joined #openstack-telemetry21:15
*** guillaume__ has joined #openstack-telemetry21:31
marcin12345so after changing my dispatcher to gnocchi I get: ERROR ceilometer.dispatcher.gnocchi [-] fail to retrieve user of Gnocchi service21:31
*** guillaume_ has quit IRC21:36
*** guillaume__ is now known as guillaume_21:36
gordcmarcin12345: i would look at https://github.com/openstack/ceilometer/blob/master/devstack/plugin.sh and https://github.com/openstack/gnocchi/blob/master/devstack/plugin.sh21:37
gordcit's how it's configured in gate21:37
*** thorst has quit IRC21:40
*** thorst has joined #openstack-telemetry21:41
*** thorst_ has joined #openstack-telemetry21:42
marcin12345ok21:45
*** thorst has quit IRC21:45
*** thorst_ has quit IRC21:47
*** guillaume__ has joined #openstack-telemetry21:52
*** guillaume_ is now known as g3ek21:56
*** guillaume__ has quit IRC21:59
*** thorst has joined #openstack-telemetry22:00
*** thorst has quit IRC22:04
*** nicodemus_ has quit IRC22:05
marcin12345I moved along, and now I have: The metric cpu_util of resource <some id> doesn't exists: 404 post_measure /usr/lib/python2.7/site-packages/ceilometer/dispatcher/gnocchi_client.py:24522:19
marcin12345what creates those metrics?22:19
*** ddieterly has quit IRC22:24
*** g3ek has quit IRC22:27
*** ddieterly has joined #openstack-telemetry22:27
*** g3ek_zzz has joined #openstack-telemetry22:28
*** g3ek_zzz is now known as g3ek22:28
*** diogogmt has joined #openstack-telemetry22:28
*** guillaume_ has joined #openstack-telemetry22:31
*** g3ek is now known as g3ek_zzz22:33
*** g3ek_zzz is now known as g3ek22:34
*** alejandrito has quit IRC22:42
*** julim has quit IRC22:46
*** diogogmt has quit IRC22:54
*** diogogmt has joined #openstack-telemetry22:54
*** diogogmt has quit IRC22:59
*** shardy has quit IRC23:04
*** gordc has quit IRC23:12
*** Ephur has joined #openstack-telemetry23:18
*** ddieterly has quit IRC23:28
*** cdent has quit IRC23:35
*** peristeri has quit IRC23:37
*** patrickeast_ is now known as patrickeast23:39

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!