| openstackgerrit | xiexianbin proposed openstack/ceilometer stable/newton: Fixed error use retry_on_disconnect decorator https://review.openstack.org/478326 | 00:40 |
|---|---|---|
| *** tovin07_ has joined #openstack-telemetry | 00:50 | |
| *** zhangguoqing has joined #openstack-telemetry | 01:24 | |
| *** thorst has joined #openstack-telemetry | 01:53 | |
| *** thorst has quit IRC | 01:57 | |
| *** youzp has joined #openstack-telemetry | 02:09 | |
| openstackgerrit | xiexianbin proposed openstack/ceilometer stable/newton: Fixed NotificationService object has no attribute refresh_pipeline_periodic https://review.openstack.org/478339 | 02:09 |
| *** htruta` has quit IRC | 02:34 | |
| *** raginbajin has quit IRC | 02:34 | |
| *** htruta has joined #openstack-telemetry | 02:35 | |
| *** tonyb_ is now known as tonyb | 02:40 | |
| *** raginbajin has joined #openstack-telemetry | 02:40 | |
| *** dixiaoli has joined #openstack-telemetry | 02:42 | |
| openstackgerrit | xiexianbin proposed openstack/ceilometer master: Fixed ceilometer arithmetic transformer bug https://review.openstack.org/478352 | 03:13 |
| *** dixiaoli has quit IRC | 03:25 | |
| *** thorst has joined #openstack-telemetry | 03:54 | |
| *** Kevin_Zheng has quit IRC | 03:59 | |
| *** links has joined #openstack-telemetry | 04:00 | |
| *** thorst has quit IRC | 04:00 | |
| *** dixiaoli has joined #openstack-telemetry | 04:05 | |
| *** Liuqing has joined #openstack-telemetry | 04:12 | |
| *** sridhar_ram has joined #openstack-telemetry | 04:12 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack/ceilometer master: Fix some initializations https://review.openstack.org/478377 | 04:33 |
| *** rwsu has quit IRC | 04:37 | |
| openstackgerrit | Deepthi V V proposed openstack/ceilometer master: Ceilometer meter support to collect network statistics. https://review.openstack.org/477883 | 05:25 |
| openstackgerrit | Deepthi V V proposed openstack/ceilometer master: Gnocchi support for SDN controller meters https://review.openstack.org/478159 | 05:25 |
| *** thorst has joined #openstack-telemetry | 05:57 | |
| *** rcernin has joined #openstack-telemetry | 06:02 | |
| *** thorst has quit IRC | 06:02 | |
| openstackgerrit | xiexianbin proposed openstack/ceilometer master: Fixed ceilometer arithmetic transformer bug https://review.openstack.org/478352 | 06:08 |
| *** Liuqing has quit IRC | 06:18 | |
| *** flg has joined #openstack-telemetry | 06:19 | |
| *** Jack_Iv has joined #openstack-telemetry | 07:04 | |
| *** Jack_Iv has quit IRC | 07:07 | |
| *** tesseract has joined #openstack-telemetry | 07:08 | |
| *** shardy has joined #openstack-telemetry | 07:33 | |
| *** thorst has joined #openstack-telemetry | 07:58 | |
| *** yprokule has joined #openstack-telemetry | 07:58 | |
| *** sridhar_ram has quit IRC | 08:02 | |
| *** thorst has quit IRC | 08:03 | |
| *** Jack_Iv has joined #openstack-telemetry | 08:52 | |
| *** zhangguo_ has joined #openstack-telemetry | 08:54 | |
| *** zhangguoqing has quit IRC | 08:54 | |
| *** zhangguo_ has quit IRC | 08:55 | |
| *** zhangguoqing has joined #openstack-telemetry | 08:58 | |
| *** zhangguoqing has quit IRC | 08:59 | |
| *** zhangguoqing has joined #openstack-telemetry | 08:59 | |
| *** thorst has joined #openstack-telemetry | 09:24 | |
| *** pcaruana has joined #openstack-telemetry | 09:28 | |
| *** thorst has quit IRC | 09:29 | |
| *** rcernin has quit IRC | 09:55 | |
| *** tovin07_ has quit IRC | 10:02 | |
| *** rcernin has joined #openstack-telemetry | 10:03 | |
| *** rcernin has quit IRC | 10:09 | |
| *** rcernin has joined #openstack-telemetry | 10:11 | |
| *** dixiaoli has quit IRC | 10:19 | |
| *** cdent has joined #openstack-telemetry | 10:48 | |
| *** cdent has left #openstack-telemetry | 10:48 | |
| *** flg has quit IRC | 10:53 | |
| *** Jack_Iv has quit IRC | 11:05 | |
| *** Jack_Iv has joined #openstack-telemetry | 11:06 | |
| *** Jack_Iv has quit IRC | 11:10 | |
| *** thorst has joined #openstack-telemetry | 11:25 | |
| *** thorst has quit IRC | 11:29 | |
| *** Jack_Iv has joined #openstack-telemetry | 11:35 | |
| *** flg has joined #openstack-telemetry | 11:41 | |
| *** youzp has quit IRC | 11:47 | |
| *** Jack_Iv has quit IRC | 11:48 | |
| *** Jack_Iv has joined #openstack-telemetry | 11:49 | |
| *** Jack_Iv_ has joined #openstack-telemetry | 11:50 | |
| *** Jack_Iv has quit IRC | 11:50 | |
| *** pcaruana has quit IRC | 12:02 | |
| *** pcaruana has joined #openstack-telemetry | 12:02 | |
| *** thorst has joined #openstack-telemetry | 12:10 | |
| *** yassine has quit IRC | 12:10 | |
| *** yassine has joined #openstack-telemetry | 12:14 | |
| *** chlong_ has quit IRC | 12:15 | |
| *** pcaruana has quit IRC | 12:16 | |
| *** pcaruana has joined #openstack-telemetry | 12:23 | |
| *** pcaruana has quit IRC | 12:23 | |
| *** pcaruana has joined #openstack-telemetry | 12:23 | |
| *** pcaruana has quit IRC | 12:29 | |
| *** pcaruana has joined #openstack-telemetry | 12:37 | |
| *** gordc has joined #openstack-telemetry | 12:39 | |
| *** pcaruana has quit IRC | 12:43 | |
| *** pcaruana has joined #openstack-telemetry | 12:44 | |
| *** jmlowe_ has quit IRC | 12:50 | |
| *** pcaruana has quit IRC | 12:53 | |
| *** pcaruana has joined #openstack-telemetry | 13:05 | |
| *** pcaruana has quit IRC | 13:13 | |
| *** pcaruana has joined #openstack-telemetry | 13:14 | |
| *** links has quit IRC | 13:16 | |
| *** leitan has joined #openstack-telemetry | 13:18 | |
| openstackgerrit | Julien Danjou proposed openstack/ceilometer master: Limit the default numbers of metrics polled https://review.openstack.org/475838 | 13:20 |
| *** dixiaoli has joined #openstack-telemetry | 13:30 | |
| *** links has joined #openstack-telemetry | 13:33 | |
| openstackgerrit | gordon chung proposed openstack/aodh master: switch to openstackdocstheme https://review.openstack.org/476231 | 13:34 |
| *** chlong_ has joined #openstack-telemetry | 13:34 | |
| *** jmlowe has joined #openstack-telemetry | 13:35 | |
| *** zhurong_ has joined #openstack-telemetry | 13:38 | |
| *** pcaruana has quit IRC | 13:40 | |
| *** pcaruana has joined #openstack-telemetry | 13:46 | |
| *** links has quit IRC | 13:56 | |
| *** zhangguoqing has quit IRC | 13:57 | |
| *** flg has quit IRC | 14:21 | |
| *** dixiaoli has quit IRC | 15:00 | |
| *** zhurong_ has quit IRC | 15:03 | |
| *** rcernin has quit IRC | 15:06 | |
| *** links has joined #openstack-telemetry | 15:07 | |
| *** lpigueiras has joined #openstack-telemetry | 15:10 | |
| *** lhx__ has joined #openstack-telemetry | 15:11 | |
| lpigueiras | hello guys, I was tring to set up a ceilometer notification agent to read openstack notifications but I have a problem | 15:21 |
| lpigueiras | basically ceilometer-agent is spawning new threads and not cleaning any all the old threads | 15:22 |
| lpigueiras | example: https://pastebin.com/gqk5xdpu | 15:22 |
| lpigueiras | i'm not using anything fancy in the ceilometer.conf :( | 15:23 |
| lpigueiras | putting it in debug I think it spawns new thread with each of this new messages: https://pastebin.com/3CTmcanM | 15:23 |
| lpigueiras | do you know if I have a misconfiguration? is it a bug? | 15:24 |
| gordc | lpigueiras: you've set workers under [notification] section of ceilometer.conf | 15:27 |
| gordc | those all belong to same parent based on ids... doesn't seem like you have any old threads iiuc | 15:28 |
| lpigueiras | it's not the `ps -ef | grep ceilometer` the problematic one | 15:29 |
| gordc | the debug log is output every time ceilometer/oslo.messaging handles a message | 15:29 |
| lpigueiras | it's the `ps -T -p 10952 10953 10954 10955` which gives me 3.4k threads | 15:29 |
| gordc | lpigueiras: the master process doesn't actually do much it just manages the workers. | 15:30 |
| gordc | the reason you have so many threads in the worker processes is (probably) because oslo.messaging is threaded and by default i think it creates 64 threads for every single listener | 15:31 |
| lpigueiras | 64 * 4 = 256 no? | 15:31 |
| lpigueiras | executor_thread_pool_size = 64, i guess you are speaking about this setting | 15:32 |
| *** dixiaoli has joined #openstack-telemetry | 15:33 | |
| gordc | yeah. there is usually more than one listener if you have workload_partitioning enabled. | 15:33 |
| gordc | i'm not entirely sure how you got 3.4K though. | 15:33 |
| lpigueiras | it actually never stops growing as I said, ATM I have 3.9k | 15:34 |
| *** Jack_Iv_ has quit IRC | 15:35 | |
| *** Jack_Iv has joined #openstack-telemetry | 15:35 | |
| gordc | lpigueiras: what version of oslo.messaging do you have? | 15:35 |
| lpigueiras | 5.17 | 15:36 |
| *** links has quit IRC | 15:36 | |
| gordc | hmm.. i have 5.27 and have 167 results when i run ps -T on my 2 notificaiton workers | 15:37 |
| lpigueiras | i can try to update to 5.27 and see the results... | 15:38 |
| gordc | i'm also using master ceilometer (but i don't recall much work being done on ceilometer recently) | 15:43 |
| *** yprokule has quit IRC | 15:47 | |
| lpigueiras | i'll keep investigating | 15:50 |
| lpigueiras | btw I have 62 `messaging_urls` in my config file, not sure if it has something to do with my problem... | 15:51 |
| lpigueiras | thanks for the help ^^ | 15:51 |
| gordc | hm... possibly? i'm not entirely sure how oslo.messaging handles messaging_urls. sileht ^^? | 15:52 |
| gordc | i imagine it should be increasing though (it's not in my environment.) | 15:52 |
| gordc | shouldn't* | 15:52 |
| sileht | 62 urls oO | 15:53 |
| sileht | so you will have something like 62 * 4 *64 | 15:53 |
| lpigueiras | mmm decreasing the value in executor_thread_pool_size should do the trick? | 15:56 |
| lpigueiras | the 62 urls is because most of them are nova cells rabbits ¯\_(ツ)_/¯ | 15:57 |
| lpigueiras | our nova master is planning to change the config to move the notifications to one single notification rabbit, but until he comes back from holidays ... | 15:57 |
| *** yassine has quit IRC | 16:19 | |
| *** dixiaoli has quit IRC | 16:26 | |
| *** lhx__ has quit IRC | 16:32 | |
| *** dixiaoli has joined #openstack-telemetry | 16:49 | |
| *** ddyer has quit IRC | 17:04 | |
| *** ddyer has joined #openstack-telemetry | 17:09 | |
| *** dixiaoli has quit IRC | 17:19 | |
| *** ddyer has quit IRC | 17:23 | |
| *** ddyer has joined #openstack-telemetry | 17:32 | |
| *** bodgix_ has quit IRC | 17:44 | |
| *** bodgix has joined #openstack-telemetry | 17:44 | |
| *** bodgix has left #openstack-telemetry | 17:45 | |
| *** links has joined #openstack-telemetry | 17:47 | |
| *** shardy has quit IRC | 18:02 | |
| *** flg has joined #openstack-telemetry | 18:25 | |
| *** links has quit IRC | 18:30 | |
| *** jmlowe has quit IRC | 18:53 | |
| *** jmlowe has joined #openstack-telemetry | 18:55 | |
| *** Jack_Iv has quit IRC | 19:05 | |
| *** Jack_Iv has joined #openstack-telemetry | 19:05 | |
| *** Jack_Iv has quit IRC | 19:09 | |
| *** tesseract has quit IRC | 19:13 | |
| *** Jack_Iv has joined #openstack-telemetry | 19:14 | |
| *** Jack_Iv has quit IRC | 19:18 | |
| *** Jack_Iv has joined #openstack-telemetry | 19:18 | |
| *** Guest28796 is now known as mgagne | 19:19 | |
| *** mgagne has quit IRC | 19:19 | |
| *** mgagne has joined #openstack-telemetry | 19:19 | |
| *** jmlowe has quit IRC | 19:57 | |
| *** jmlowe has joined #openstack-telemetry | 19:57 | |
| *** flg has quit IRC | 20:12 | |
| *** Jack_Iv has quit IRC | 20:15 | |
| *** Jack_Iv has joined #openstack-telemetry | 20:16 | |
| *** Jack_Iv has quit IRC | 20:20 | |
| *** leitan has quit IRC | 20:48 | |
| *** leitan has joined #openstack-telemetry | 20:57 | |
| *** jmlowe has quit IRC | 21:01 | |
| *** pcaruana has quit IRC | 21:01 | |
| *** Jack_Iv has joined #openstack-telemetry | 21:02 | |
| *** Jack_Iv has quit IRC | 21:07 | |
| *** leitan has quit IRC | 21:08 | |
| *** thorst has quit IRC | 21:12 | |
| *** Jack_Iv has joined #openstack-telemetry | 21:17 | |
| *** Jack_Iv has quit IRC | 21:22 | |
| *** Jack_Iv has joined #openstack-telemetry | 21:33 | |
| *** Jack_Iv has quit IRC | 21:38 | |
| *** thorst has joined #openstack-telemetry | 21:46 | |
| *** thorst has quit IRC | 21:50 | |
| *** thorst has joined #openstack-telemetry | 22:10 | |
| *** gordc has quit IRC | 22:15 | |
| *** thorst has quit IRC | 22:17 | |
| *** thorst has joined #openstack-telemetry | 22:17 | |
| *** chlong_ has quit IRC | 22:18 | |
| *** Jack_Iv has joined #openstack-telemetry | 22:19 | |
| *** thorst has quit IRC | 22:22 | |
| *** Jack_Iv has quit IRC | 22:24 | |
| *** Jack_Iv has joined #openstack-telemetry | 22:35 | |
| *** Jack_Iv has quit IRC | 22:39 | |
| *** vint_bra has quit IRC | 22:40 | |
| *** masber has quit IRC | 22:42 | |
| *** masber has joined #openstack-telemetry | 22:42 | |
| *** leitan has joined #openstack-telemetry | 23:09 | |
| *** leitan has quit IRC | 23:14 | |
| *** Jack_Iv has joined #openstack-telemetry | 23:31 | |
| *** Jack_Iv has quit IRC | 23:36 | |
| *** jmlowe has joined #openstack-telemetry | 23:38 | |
| *** Jack_Iv has joined #openstack-telemetry | 23:47 | |
| *** Jack_Iv has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!