Friday, 2017-03-31

*** ppiela has quit IRC00:05
*** ppiela has joined #openstack-telemetry00:07
*** donghao has joined #openstack-telemetry00:11
*** donghao has quit IRC00:16
*** Pneumatic_ has joined #openstack-telemetry00:19
*** Pneumatic_ has quit IRC00:23
*** zhurong has joined #openstack-telemetry00:29
*** thorst has joined #openstack-telemetry00:38
*** thorst has quit IRC00:39
*** zhangguoqing has joined #openstack-telemetry00:46
*** gongysh has joined #openstack-telemetry00:47
*** vint_bra has joined #openstack-telemetry00:53
*** lhx_ has quit IRC00:59
*** thorst has joined #openstack-telemetry01:10
*** vint_bra has quit IRC01:10
*** gongysh has quit IRC01:16
*** liusheng has joined #openstack-telemetry01:21
*** thorst has quit IRC01:28
*** thorst has joined #openstack-telemetry01:37
*** thorst has quit IRC01:38
*** lhx__ has joined #openstack-telemetry01:50
*** dixiaoli has joined #openstack-telemetry01:58
*** Pneumatic_ has joined #openstack-telemetry02:05
*** Pneumatic_ has quit IRC02:09
*** donghao has joined #openstack-telemetry02:13
*** donghao has quit IRC02:17
*** thorst has joined #openstack-telemetry02:39
*** thorst has quit IRC02:56
*** thorst has joined #openstack-telemetry02:57
*** thorst has quit IRC03:01
*** dschultz has quit IRC03:03
*** dschultz has joined #openstack-telemetry03:04
*** dixiaoli has quit IRC03:48
*** dixiaoli has joined #openstack-telemetry03:52
*** zhangguoqing has quit IRC03:53
*** dixiaoli has quit IRC04:00
*** thorst has joined #openstack-telemetry04:01
*** thorst has quit IRC04:06
*** jmlowe has joined #openstack-telemetry04:07
*** zhurong has quit IRC04:09
*** donghao has joined #openstack-telemetry04:15
*** gkadam has joined #openstack-telemetry04:17
*** donghao has quit IRC04:21
*** dixiaoli has joined #openstack-telemetry04:24
*** dixiaoli has quit IRC04:25
*** zhurong has joined #openstack-telemetry04:30
*** zhangguoqing has joined #openstack-telemetry04:38
*** jmlowe has quit IRC04:45
*** yprokule has joined #openstack-telemetry04:48
*** nadya has joined #openstack-telemetry04:52
*** nadya has quit IRC04:54
*** jmlowe has joined #openstack-telemetry05:02
*** thorst has joined #openstack-telemetry05:02
*** thorst has quit IRC05:07
*** lhx__ has quit IRC05:11
*** wagnqwsh has joined #openstack-telemetry05:12
*** dixiaoli has joined #openstack-telemetry05:35
*** zhurong has quit IRC05:41
*** dixiaoli has quit IRC05:43
*** jmlowe has quit IRC05:43
*** rcernin has joined #openstack-telemetry05:44
*** lhx__ has joined #openstack-telemetry05:46
*** lhx__ has quit IRC05:52
*** lhx__ has joined #openstack-telemetry05:53
*** dixiaoli has joined #openstack-telemetry05:59
*** dixiaoli has quit IRC06:00
*** thorst has joined #openstack-telemetry06:03
*** zhurong has joined #openstack-telemetry06:05
*** lhx__ has quit IRC06:06
*** thorst has quit IRC06:08
*** nadya has joined #openstack-telemetry06:08
*** dixiaoli has joined #openstack-telemetry06:14
*** donghao has joined #openstack-telemetry06:19
*** donghao has quit IRC06:23
*** lhx__ has joined #openstack-telemetry06:44
*** thorst has joined #openstack-telemetry07:04
*** lhx__ has quit IRC07:04
*** lhx__ has joined #openstack-telemetry07:05
*** nadya has quit IRC07:08
*** tesseract has joined #openstack-telemetry07:08
*** thorst has quit IRC07:09
*** pcaruana has joined #openstack-telemetry07:27
*** dixiaoli has quit IRC07:29
*** dixiaoli has joined #openstack-telemetry07:32
*** yprokule_ has joined #openstack-telemetry07:37
*** yprokule has quit IRC07:38
*** yprokule_ is now known as yprokule07:38
-openstackstatus- NOTICE: Jobs in gate are failing with POST_FAILURE. Infra roots are investigating07:45
*** ChanServ changes topic to "Jobs in gate are failing with POST_FAILURE. Infra roots are investigating"07:45
openstackgerritJulien Danjou proposed openstack/python-gnocchiclient master: Move doc8 into pep8 target  https://review.openstack.org/44585107:46
*** nadya has joined #openstack-telemetry07:50
*** liyi has joined #openstack-telemetry07:50
liyihello, everybody, I have a question. when we use ceph as gnocchi storage, the processing is very slow. The log like this: 2017-03-30 17:49:53.315 27844 Computed new metric 01f047bc-4bca-4133-809b-5bc3862a57c8 with 2 new measures in 7.25 seconds (1401 points/s, 6 measures/s) process_new_measures07:54
*** rcernin has quit IRC07:54
*** yprokule has quit IRC07:54
*** yprokule_ has joined #openstack-telemetry07:54
*** yprokule_ is now known as yprokule07:54
*** tesseract has quit IRC07:54
liyiany method to handle this issue?07:55
*** rcernin has joined #openstack-telemetry07:55
*** tesseract has joined #openstack-telemetry07:56
*** nadya has quit IRC07:56
*** nadya has joined #openstack-telemetry08:03
*** dixiaoli has quit IRC08:05
*** thorst has joined #openstack-telemetry08:05
*** dixiaoli has joined #openstack-telemetry08:05
*** nadya has quit IRC08:08
*** donghao has joined #openstack-telemetry08:21
*** yprokule has quit IRC08:23
*** yprokule has joined #openstack-telemetry08:24
*** thorst has quit IRC08:24
*** donghao has quit IRC08:25
-openstackstatus- NOTICE: logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed08:26
*** ChanServ changes topic to "logs.openstack.org has corrupted disks, it's being repaired. Please avoid rechecking until this is fixed"08:26
*** shardy has joined #openstack-telemetry08:26
openstackgerritJulien Danjou proposed openstack/gnocchi master: carbonara: add bitshuffle before compression  https://review.openstack.org/45186708:37
*** shardy has quit IRC08:37
*** shardy has joined #openstack-telemetry08:38
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer master: compute vnics: use the generic compute pollster  https://review.openstack.org/44636208:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer master: compute disks: use the generic compute pollster  https://review.openstack.org/44659708:40
openstackgerritMehdi Abaakouk (sileht) proposed openstack/ceilometer master: compute: remove default duration value  https://review.openstack.org/45210108:40
*** dixiaoli has quit IRC08:45
*** jahsis has joined #openstack-telemetry08:46
*** nadya has joined #openstack-telemetry08:46
*** dixiaoli has joined #openstack-telemetry09:05
*** cdent has joined #openstack-telemetry09:20
*** wagnqwsh has quit IRC09:26
*** zhangguoqing has quit IRC09:34
*** liyi has quit IRC09:39
*** cdent has quit IRC10:07
*** zhurong has quit IRC10:18
*** nadya has quit IRC10:20
*** thorst has joined #openstack-telemetry10:21
openstackgerritJulien Danjou proposed openstack/gnocchi master: carbonara: reduce the number of array copy  https://review.openstack.org/45213310:23
*** donghao has joined #openstack-telemetry10:23
*** thorst has quit IRC10:26
*** donghao has quit IRC10:28
*** zhangguoqing has joined #openstack-telemetry10:29
*** cdent has joined #openstack-telemetry10:38
*** zhurong has joined #openstack-telemetry10:41
*** dixiaoli has quit IRC10:49
*** dixiaoli has joined #openstack-telemetry10:51
*** nadya has joined #openstack-telemetry10:51
*** rbak has joined #openstack-telemetry11:13
*** shardy is now known as shardy_lunch11:14
*** thorst has joined #openstack-telemetry11:22
*** rbak has quit IRC11:26
*** thorst has quit IRC11:27
*** vint_bra has joined #openstack-telemetry11:32
*** thorst has joined #openstack-telemetry11:32
*** dixiaoli has quit IRC11:54
*** zhurong has quit IRC11:59
*** shardy_lunch is now known as shardy12:03
*** cdent has quit IRC12:08
*** adreznec has quit IRC12:14
*** adreznec has joined #openstack-telemetry12:17
*** yprokule has quit IRC12:19
*** vint_bra has quit IRC12:21
*** donghao has joined #openstack-telemetry12:25
*** donghao has quit IRC12:30
*** gordc has joined #openstack-telemetry12:34
*** catintheroof has joined #openstack-telemetry12:36
*** chlong has joined #openstack-telemetry12:40
*** gkadam has quit IRC12:57
*** lhx__ has quit IRC13:00
*** cdent has joined #openstack-telemetry13:05
*** dave-mccowan has joined #openstack-telemetry13:18
*** rbak has joined #openstack-telemetry13:23
*** Guest16838 has quit IRC13:25
*** vint_bra has joined #openstack-telemetry13:26
gordcjd_: sileht: how do you debug the pifpaf stuff? gabbi live tests are failing and i have no idea where to look for logs and stuff.13:27
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: docs: default to master  https://review.openstack.org/45220213:27
silehtgordc, pifpaf --debug run ...13:27
gordcsileht: do i just edit the run_tests.sh script?13:28
silehtgordc, yes13:29
silehtgordc, maybe we should add an env var for this, it could be fancier13:29
gordcsileht: kk, let me give that a try13:29
gordcsileht: hmm.. debug just seems to output the startup logs from driver and then nothing else.13:34
silehtgordc, maybe because we don't enable debug for gnocchi itself13:35
silehtgordc, gnocchi just works :p13:35
*** zhangguoqing has quit IRC13:35
gordclol true13:35
gordc(except with my patch)13:35
*** rbak has quit IRC13:36
*** Guest16838 has joined #openstack-telemetry13:37
*** lhx__ has joined #openstack-telemetry13:38
jd_gordc: what gabbi says?13:41
jd_gordc: you can also add verbose: True in gabbi yaml13:41
gordcoh yeah. i'll try that13:42
gordci just have gabbi.suitemaker.test_gabbi_live_live_get_myresource_measures_with_poll.test_request timing out13:42
gordclogs.openstack.org seems down so i can't sen dyou link13:42
gordchttp://paste.openstack.org/show/605066/13:43
gordci assume it's something to do with metricd though so... i'm sure there's something not being processed13:44
*** nadya has quit IRC13:44
*** yprokule has joined #openstack-telemetry13:46
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: docs: default to master  https://review.openstack.org/45220213:47
silehtgordc, did you rebase I have fixed a bug like that recently13:47
gordcsileht: yeah, i'm on latest.13:49
gordci think it might be becasue my patch requires coordination enabled.13:49
gordcpifpaf doesn't set up gnocchi with coordination?13:49
gordcyeah, it doesn't... seems we either need to enable coordination or i need to let my code work without coordination13:51
silehtgordc, I have thought we enable it automatically with the database driver as coordinator13:53
*** amoralej is now known as amoralej|lunch13:54
gordcsileht: hmm. i just did a search for coordination_url and couldn't find it in pifpaf. or does gnocchi do that by default?13:55
silehtgordc, in gnocchi/service.py13:55
gordcsileht: ah, yes.13:56
gordcmaybe sql driver doesn't support required functionality for partitioner?13:57
gordcyeah, it doesn't support watching groups. i guess i'll just add a fallback in my code and see if it helps pass.13:58
jd_yeah it does not14:02
jd_if you can add a fallback gordc that'd be great indeed14:02
jd_we can add support for coordination in pifpaf for gnocchi but it makes little sense TBH14:03
jd_except for testing14:03
gordcjd_: ack. my code should still work without coordination... just battling for metrics.14:04
gordcjd_: have you tested the distribution of tooz hashring, it's really not very uniform no matter how many replicas/partitions i configure.14:05
jd_Gnocchi 4: Battling For Metrics14:05
gordcnot sure if it's because of hashing of nodes or hashing of buckets14:06
jd_gordc: quickly, and it was more or less distributed but a bit random14:06
jd_there was up to 20% offset IIRC14:06
jd_I imagined that maybe my samples was not big enough14:06
gordcmine is +/- 50% from mean.14:07
jd_though we can change/fix the algo in tooz if it's broken in some way14:07
gordcwhich means in my partitioning patch, some of the processes get assigned nothing and other gets assigned 10/11 buckets14:07
gordcyeah, i'll look at how well it hashes. it's not working that great with my current patch though14:08
jd_gordc: anyway u never know which metrics will go in which sack14:09
jd_u can have 5 sacks on everything and most metrics pushed ends up in 2 sacks :D14:09
jd_2 sacks of the same node14:09
jd_but yeah if have a way of improving14:09
jd_i know the md5 stuff is pretty simple, there might be a better state of the art out there14:10
jd_I see that as good enough for now and reducing a lot the contention so, I'm still happy with it14:10
*** nicodemus_ has joined #openstack-telemetry14:10
nicodemus_morning14:11
gordcjd_: yeah, it seems like the sack contents themselves are relatively distributed. maybe becaues i have hundreds of metrics in each sack14:11
gordci'm also just using modulo14:11
jd_that's because u push to hundreds of different metrics14:11
gordcnicodemus_: morning14:11
jd_if u push always to the same 2 metrics… :p14:12
jd_but in Real Life it should be ok anyway14:12
jd_nicodemus_: hey14:12
jd_nicodemus_: btw I fixed Redis again (lock issue)14:12
gordcjd_: yeah, i only configured about 256 sack for 54 workers.14:12
nicodemus_jd_, great!14:12
jd_nicodemus_: if u can give a try to master14:12
nicodemus_was it a tooz issue or you mean gnocchi master?14:13
jd_nicodemus_: tooz master14:13
nicodemus_awesome, will do14:14
nicodemus_I wanted to ask you abour the S3 driver14:14
gordc*cough* don't use it *cough*14:14
jd_sileht: can u check https://review.openstack.org/#/c/450304 so i don't have to rebase soon :) and the next patches too14:15
jd_nicodemus_: what gordc said… :p14:15
jd_nicodemus_: nah we need to fix this bucket thing :(14:15
*** lhx__ has quit IRC14:16
nicodemus_hahahah give me some hope14:16
gordci think the latency of external storage will screw everything up (unless you use redis for incoming and aggregate very infrequently)14:16
*** lhx__ has joined #openstack-telemetry14:16
nicodemus_file with EFS simply doesn't work14:16
silehtjd_, such a motivation14:17
jd_gordc: yeah that's a good option for cheap storage of metrics I think14:17
silehtgordc, should help you: https://github.com/jd/pifpaf/pull/5514:19
silehtjd_, ^14:19
gordcsileht: yep, i think it will. i'll do the fallback regardless.14:20
openstackgerritgordon chung proposed openstack/gnocchi master: push incoming into different sacks  https://review.openstack.org/44138914:27
*** jroll has quit IRC14:32
*** nicodemus_ has quit IRC14:32
*** jroll has joined #openstack-telemetry14:34
*** amoralej|lunch is now known as amoralej14:36
*** nicodemus_ has joined #openstack-telemetry14:45
*** jahsis has quit IRC14:49
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: Add travis configuration  https://review.openstack.org/45223214:51
*** rbak has joined #openstack-telemetry14:52
openstackgerritMehdi Abaakouk (sileht) proposed openstack/gnocchi master: tests: Add travis configuration  https://review.openstack.org/45223214:54
silehtwhy each times I commit to pifpaf the CI is broken...15:03
*** rcernin has quit IRC15:08
*** nadya has joined #openstack-telemetry15:11
jd_sileht: it's ze game15:19
silehtjd_, can we drop the test about create_legacy_resource_types=True in pifpaf ?15:20
silehtjd_, tarball don't have it anymore15:20
* sileht is lazy to write gnocchi version detection15:20
*** yprokule has quit IRC15:22
*** nicodemus_ has quit IRC15:24
*** rbak has quit IRC15:27
*** donghao has joined #openstack-telemetry15:28
*** rbak has joined #openstack-telemetry15:29
*** jmlowe has joined #openstack-telemetry15:30
*** donghao has quit IRC15:33
*** wagnqwsh has joined #openstack-telemetry15:35
*** nicodemus_ has joined #openstack-telemetry15:40
*** donghao has joined #openstack-telemetry15:43
*** pcaruana has quit IRC15:46
*** Guest16838 has quit IRC15:56
*** rbak has quit IRC16:09
jd_sileht: I thought about that but I'm scared that it'll break old version of aodhclient16:09
jd_sileht: so yeah just drop the test not the code16:10
*** Guest16838 has joined #openstack-telemetry16:11
silehtjd_, I have written a skip test finally :)16:14
jd_kewl16:14
jd_you're brave16:14
jd_sileht: py3 is unhappy ;)16:16
*** Pneumatic_ has joined #openstack-telemetry16:21
*** cdent has quit IRC16:25
*** Pneumatic_ has quit IRC16:25
*** nadya has quit IRC16:35
*** cdent has joined #openstack-telemetry16:38
*** nadya has joined #openstack-telemetry16:41
*** nadya has quit IRC16:42
*** jmlowe has quit IRC16:48
*** Pneumatic_ has joined #openstack-telemetry16:55
*** donghao has quit IRC17:06
*** nadya has joined #openstack-telemetry17:16
*** nadya has quit IRC17:17
*** shardy has quit IRC17:17
*** nadya has joined #openstack-telemetry17:18
*** lhx__ has quit IRC17:29
*** swamireddy has quit IRC17:36
*** nadya has quit IRC17:39
*** toddnni has quit IRC17:50
*** toddnni has joined #openstack-telemetry17:55
nicodemus_jd_, do you by any chance have an idea about when the gnocchi S3 driver could be available?17:59
*** Guest16838 has quit IRC17:59
*** donghao has joined #openstack-telemetry18:06
*** donghao has quit IRC18:12
openstackgerritgordon chung proposed openstack/gnocchi master: cleanup empty test folder  https://review.openstack.org/45228318:19
*** tesseract has quit IRC18:21
*** cdent has quit IRC18:30
*** cdent has joined #openstack-telemetry18:32
*** nicodemus_ has quit IRC18:34
*** swamireddy has joined #openstack-telemetry18:38
*** nicodemus_ has joined #openstack-telemetry18:44
*** amoralej is now known as amoralej|off18:54
*** cdent has quit IRC19:17
*** nadya has joined #openstack-telemetry19:19
*** nadya has quit IRC19:20
pradksileht, can we backport https://review.openstack.org/#/c/436896/ to newton? i believe we are on stable/3.0 for newton19:28
silehtpradk, https://review.openstack.org/45229619:32
pradksileht, thx!19:32
*** rbak has joined #openstack-telemetry19:52
-openstackstatus- NOTICE: lists.openstack.org will be offline from 20:00 to 23:00 UTC for planned upgrade maintenance19:59
*** donghao has joined #openstack-telemetry20:09
*** Pneumatic_ has quit IRC20:10
*** donghao has quit IRC20:13
*** rbak has quit IRC20:15
*** Pneumatic_ has joined #openstack-telemetry20:45
*** Pneumatic_ has quit IRC21:06
*** jmlowe has joined #openstack-telemetry21:20
*** nicodemus_ has quit IRC21:39
openstackgerritMerged openstack/gnocchi master: cleanup empty test folder  https://review.openstack.org/45228321:44
-openstackstatus- NOTICE: The upgrade maintenance for lists.openstack.org has been completed and it is back online.21:51
*** vint_bra has quit IRC21:55
*** thorst has quit IRC22:10
*** donghao has joined #openstack-telemetry22:11
*** wagnqwsh has quit IRC22:13
*** gordc has quit IRC22:13
*** wagnqwsh has joined #openstack-telemetry22:14
*** donghao has quit IRC22:15
*** catintheroof has quit IRC22:36
*** thorst has joined #openstack-telemetry23:11
*** thorst has quit IRC23:15
*** dschultz has quit IRC23:17
*** dschultz has joined #openstack-telemetry23:19
*** wagnqwsh has quit IRC23:32
*** thorst has joined #openstack-telemetry23:42

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!