*** r-daneel has quit IRC | 00:02 | |
*** vint_bra has joined #openstack-telemetry | 00:04 | |
*** thorst has joined #openstack-telemetry | 00:06 | |
*** adriant has joined #openstack-telemetry | 00:21 | |
*** thorst has quit IRC | 00:22 | |
*** thorst has joined #openstack-telemetry | 00:22 | |
*** thorst has quit IRC | 00:27 | |
*** tovin07_ has joined #openstack-telemetry | 00:56 | |
*** dixiaoli has joined #openstack-telemetry | 00:56 | |
*** john5223_ has quit IRC | 00:59 | |
*** daidv has joined #openstack-telemetry | 01:11 | |
*** dixiaoli has quit IRC | 01:14 | |
*** dave-mccowan has joined #openstack-telemetry | 01:21 | |
*** thorst has joined #openstack-telemetry | 01:27 | |
*** thorst has quit IRC | 01:32 | |
*** dave-mccowan has quit IRC | 01:36 | |
*** thorst has joined #openstack-telemetry | 01:48 | |
*** thorst has quit IRC | 01:48 | |
*** lhx__ has joined #openstack-telemetry | 01:50 | |
*** zhurong has joined #openstack-telemetry | 01:51 | |
*** larainema has quit IRC | 02:32 | |
*** lhx__ has quit IRC | 02:43 | |
*** thorst has joined #openstack-telemetry | 02:49 | |
*** thorst has quit IRC | 02:54 | |
*** larainema has joined #openstack-telemetry | 02:59 | |
*** pradk has quit IRC | 03:11 | |
*** vint_bra has quit IRC | 03:15 | |
*** thorst has joined #openstack-telemetry | 03:50 | |
*** thorst has quit IRC | 03:54 | |
*** zhurong has quit IRC | 04:07 | |
*** zhangguoqing has joined #openstack-telemetry | 04:14 | |
*** donghao has joined #openstack-telemetry | 04:16 | |
*** zhangguoqing has quit IRC | 04:19 | |
*** zhangguoqing has joined #openstack-telemetry | 04:20 | |
*** donghao has quit IRC | 04:20 | |
*** adreznec has quit IRC | 04:41 | |
*** adreznec has joined #openstack-telemetry | 04:45 | |
*** zhurong has joined #openstack-telemetry | 04:46 | |
*** thorst has joined #openstack-telemetry | 04:51 | |
*** thorst has quit IRC | 04:55 | |
*** yprokule has joined #openstack-telemetry | 05:29 | |
*** pcaruana has joined #openstack-telemetry | 05:43 | |
*** adriant has quit IRC | 05:49 | |
*** thorst has joined #openstack-telemetry | 05:52 | |
*** thorst has quit IRC | 06:10 | |
*** rcernin has joined #openstack-telemetry | 06:10 | |
*** donghao has joined #openstack-telemetry | 06:19 | |
*** donghao has quit IRC | 06:23 | |
*** zhurong has quit IRC | 06:54 | |
*** zhurong has joined #openstack-telemetry | 06:58 | |
*** shardy has joined #openstack-telemetry | 07:07 | |
*** thorst has joined #openstack-telemetry | 07:07 | |
*** thorst has quit IRC | 07:11 | |
*** Drankis has joined #openstack-telemetry | 07:44 | |
*** openstackgerrit has quit IRC | 07:48 | |
*** thorst has joined #openstack-telemetry | 08:07 | |
*** thorst has quit IRC | 08:13 | |
*** donghao has joined #openstack-telemetry | 08:20 | |
*** efoley has joined #openstack-telemetry | 08:22 | |
*** donghao has quit IRC | 08:25 | |
*** thorst has joined #openstack-telemetry | 09:08 | |
*** thorst has quit IRC | 09:13 | |
*** zhurong has quit IRC | 09:19 | |
*** tovin07_ has quit IRC | 09:48 | |
*** daidv has quit IRC | 10:08 | |
*** thorst has joined #openstack-telemetry | 10:09 | |
*** thorst has quit IRC | 10:13 | |
*** donghao has joined #openstack-telemetry | 10:22 | |
*** cdent has joined #openstack-telemetry | 10:26 | |
*** donghao has quit IRC | 10:27 | |
*** openstackgerrit has joined #openstack-telemetry | 10:28 | |
openstackgerrit | Liang Cui proposed openstack/aodh master: Replace test.attr with decorators.attr https://review.openstack.org/468351 | 10:28 |
---|---|---|
*** ddyer2 has joined #openstack-telemetry | 10:29 | |
*** ddyer has quit IRC | 10:29 | |
*** Drankis has quit IRC | 10:49 | |
*** Drankis has joined #openstack-telemetry | 10:57 | |
*** shardy has quit IRC | 11:03 | |
*** thorst has joined #openstack-telemetry | 11:10 | |
*** rwsu has quit IRC | 11:11 | |
*** thorst has quit IRC | 11:14 | |
*** rwsu has joined #openstack-telemetry | 11:27 | |
*** thorst has joined #openstack-telemetry | 11:42 | |
*** masber has quit IRC | 12:00 | |
*** pradk has joined #openstack-telemetry | 12:18 | |
*** donghao has joined #openstack-telemetry | 12:25 | |
*** donghao has quit IRC | 12:29 | |
*** gordc has joined #openstack-telemetry | 12:36 | |
*** thorst has quit IRC | 12:45 | |
*** fguillot has joined #openstack-telemetry | 12:53 | |
*** ioggstream has joined #openstack-telemetry | 12:58 | |
ioggstream | hi dr_gogeta86: | 12:58 |
ioggstream | dr_gogeta86: sileht gordc hi, about https://review.openstack.org/#/c/465499/ (increase sample frequency to 1/300 ) we probably need to change https://github.com/openstack/gnocchi/blob/stable/3.1/gnocchi/cli.py#L154 too | 13:01 |
gordc | ioggstream: why is this? | 13:03 |
*** thorst has joined #openstack-telemetry | 13:04 | |
ioggstream | gordc: the default number of worker should fit the increased load, right? | 13:05 |
ioggstream | the default frequency was 1/600. Me and dr_gogeta86 modified it to 1/300 according to the linked patch | 13:05 |
ioggstream | and experienced a long backlog of metric processing | 13:06 |
*** chlong has joined #openstack-telemetry | 13:06 | |
*** dims has quit IRC | 13:07 | |
gordc | ioggstream: possibly? so the issue is that the optimal value for that number is based on: sample frequency vs metricd workers vs metricd processing efficiency | 13:07 |
gordc | (it's complicated) | 13:07 |
gordc | i should note that number doesn't exist in gnocchi4 so it's not relevant to master | 13:08 |
ioggstream | gordc: ok for gnocchi4. We are on newton ;) | 13:09 |
gordc | the alternative is we can: a) write a note in docs imforming people that they might need to change that value in gnocchi3, b) add a config option specific to gnocchi3 or both | 13:09 |
ioggstream | gordc: as the default is changed, I was guessing if it has impacts on other default params too | 13:09 |
gordc | gnocchi isn't actually tied openstack release cycle... ie similar to how you don't have a newton mysql release. | 13:09 |
gordc | if you can run gnocchi3.1, you can use exact same ceilometer code and target gnocchi4 (iirc) | 13:10 |
ioggstream | gordc: yep, but I'm on rhosp10 :D | 13:10 |
gordc | ioggstream: i think the TASKS_PER_WORKER value will affect the metric_processing_delay value | 13:11 |
gordc | ioggstream: tell pradk to get gnocchi4 packaged :P (even though we didn't release gnocchi4 yet | 13:11 |
ioggstream | gordc: so in the future release of gnocchi, should we take into account of the new default value of 300sec for any of the default params? | 13:12 |
gordc | if you increase TASKS_PER_WORKER and your backlog state is good, you will need to increase metric_processing_delay | 13:12 |
ioggstream | gordc: ok, so it's two parameters to modify dr_gogeta86 | 13:13 |
gordc | if you increase TASKS_PER_WORKER and your backlog state is bad, you might want to decresae metric_processing_delay | 13:13 |
ioggstream | gordc: while the polling.yaml change doesn't need any changes in the latest gnocchi release, right? | 13:13 |
gordc | the scheduling for the ceph driver in gnocchi3 i didn't realise was effected by backlog (my testing always had enough workers so it never got extremely overloaded) | 13:14 |
gordc | lastest gnocchi release meaning gnocchi4? | 13:15 |
ioggstream | I mean whatever version will be tied to the new polling interval | 13:16 |
ioggstream | ;) | 13:16 |
ioggstream | actually the gnocchi expert is dr_gogeta86, I'm just the user of the metric | 13:16 |
gordc | polling interval is independent of gnocchi. it's a ceilometer metric generation value | 13:16 |
ioggstream | I just wanted to be sure that the pipeline.yaml changes didn't require any changes elsewhere | 13:17 |
gordc | it will just generate metrics more frequently (it's something you should be configuring to fit your requirements) | 13:17 |
*** shardy has joined #openstack-telemetry | 13:18 | |
ioggstream | gordc: ok, that's great. so no impacts ;) | 13:19 |
gordc | it will impact gnocchi4 less... i did a test where i created a backlog of 35M measurements and 40K metrics and it cleared it up pretty quickly (ceph driver) | 13:19 |
ioggstream | can I ask how many worker do you have ? | 13:20 |
gordc | but you probably don't want to let your backlog grow that big (was just testing some catastrophic scenario) | 13:20 |
gordc | right now i'm working against a local 20OSD ceph env, 18 metricd workers, 32 api workers | 13:21 |
gordc | all gnocchi services under one machine. | 13:21 |
ioggstream | :DDD be assured I won't make any change :P | 13:22 |
gordc | ioggstream: here you go: https://www.slideshare.net/GordonChung/gnocchi-v4-preview/#10 | 13:22 |
ioggstream | just collecting all the stuff to argument with rh engineering the change we made | 13:22 |
ioggstream | and possibly have them integrated in newton rpms | 13:23 |
gordc | ioggstream: https://www.slideshare.net/GordonChung/gnocchi-v4-preview/#8 what i used to test v3 (so i had more HW in v3 test) | 13:23 |
ioggstream | linked, thx++ | 13:24 |
gordc | np | 13:24 |
*** cdent has quit IRC | 13:32 | |
*** dims has joined #openstack-telemetry | 14:04 | |
*** vint_bra has joined #openstack-telemetry | 14:08 | |
*** zhangguoqing has quit IRC | 14:10 | |
*** donghao has joined #openstack-telemetry | 14:27 | |
*** donghao has quit IRC | 14:32 | |
*** yprokule has quit IRC | 14:58 | |
*** masuberu has joined #openstack-telemetry | 14:58 | |
*** rcernin has quit IRC | 15:04 | |
*** efoley has quit IRC | 15:19 | |
*** Drankis has quit IRC | 15:29 | |
*** Tamayo has joined #openstack-telemetry | 15:55 | |
openstackgerrit | Merged openstack/panko master: storage: Ensure pymysql is prefered https://review.openstack.org/468135 | 15:55 |
*** donghao has joined #openstack-telemetry | 16:29 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/newton: add ceilometer storage disclaimer https://review.openstack.org/468467 | 16:32 |
*** donghao has quit IRC | 16:33 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/newton: clean up obs install instruction https://review.openstack.org/468468 | 16:37 |
*** cdent has joined #openstack-telemetry | 16:41 | |
*** ioggstream has quit IRC | 17:08 | |
*** aagate has quit IRC | 17:08 | |
*** jmlowe has quit IRC | 17:28 | |
*** jmlowe has joined #openstack-telemetry | 17:29 | |
*** jmlowe has quit IRC | 17:34 | |
*** pcaruana has quit IRC | 18:00 | |
*** visbits has quit IRC | 18:43 | |
*** jmlowe has joined #openstack-telemetry | 18:54 | |
*** Tamayo has quit IRC | 19:16 | |
*** donghao has joined #openstack-telemetry | 19:32 | |
openstackgerrit | Matt Wisch proposed openstack/ceilometer master: Added Nova Compute CPU metrics to gnocchi_resources.yaml https://review.openstack.org/468522 | 19:32 |
*** donghao has quit IRC | 19:38 | |
*** cdent has quit IRC | 19:52 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/newton: add ceilometer storage disclaimer https://review.openstack.org/468467 | 20:35 |
*** thorst has quit IRC | 20:40 | |
*** donghao has joined #openstack-telemetry | 20:41 | |
*** donghao has quit IRC | 20:45 | |
*** jmlowe has quit IRC | 20:49 | |
*** ioggstream has joined #openstack-telemetry | 20:50 | |
*** thorst has joined #openstack-telemetry | 21:00 | |
*** thorst has quit IRC | 21:04 | |
*** masuberu has quit IRC | 21:07 | |
*** fguillot has quit IRC | 21:14 | |
*** ioggstream has quit IRC | 21:15 | |
*** catintheroof has joined #openstack-telemetry | 21:33 | |
*** catintheroof has quit IRC | 21:39 | |
*** gordc has quit IRC | 22:19 | |
*** donghao has joined #openstack-telemetry | 22:43 | |
*** donghao has quit IRC | 22:47 | |
*** vint_bra has quit IRC | 22:51 | |
*** jmlowe has joined #openstack-telemetry | 22:51 | |
*** chlong has quit IRC | 23:10 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!