*** leitan has joined #openstack-telemetry | 00:08 | |
*** rcernin has quit IRC | 00:12 | |
*** masber has joined #openstack-telemetry | 00:37 | |
*** flg_ has joined #openstack-telemetry | 00:41 | |
*** flg__ has quit IRC | 00:44 | |
*** thorst_afk has joined #openstack-telemetry | 00:45 | |
*** thorst_afk has quit IRC | 00:49 | |
*** dixiaoli has joined #openstack-telemetry | 00:55 | |
*** dixiaoli has quit IRC | 00:56 | |
*** dixiaoli has joined #openstack-telemetry | 00:56 | |
*** masber has quit IRC | 01:20 | |
*** thorst_afk has joined #openstack-telemetry | 01:23 | |
*** dikonoor has joined #openstack-telemetry | 01:29 | |
*** dave-mccowan has joined #openstack-telemetry | 01:30 | |
*** vint_bra has joined #openstack-telemetry | 01:37 | |
*** vint_bra has quit IRC | 01:39 | |
*** thorst_afk has quit IRC | 01:46 | |
*** edmondsw has joined #openstack-telemetry | 01:51 | |
*** masber has joined #openstack-telemetry | 01:51 | |
*** lhx__ has joined #openstack-telemetry | 01:52 | |
*** zhurong has joined #openstack-telemetry | 01:54 | |
*** edmondsw has quit IRC | 01:55 | |
*** dave-mccowan has quit IRC | 02:07 | |
*** thorst_afk has joined #openstack-telemetry | 02:19 | |
*** thorst_afk has quit IRC | 02:19 | |
*** dave-mccowan has joined #openstack-telemetry | 02:24 | |
*** leitan has quit IRC | 02:39 | |
*** leitan has joined #openstack-telemetry | 02:39 | |
*** leitan has quit IRC | 02:44 | |
*** links has joined #openstack-telemetry | 03:18 | |
*** thorst_afk has joined #openstack-telemetry | 03:20 | |
*** thorst_afk has quit IRC | 03:25 | |
*** dave-mccowan has quit IRC | 03:27 | |
*** edmondsw has joined #openstack-telemetry | 03:39 | |
*** edmondsw has quit IRC | 03:44 | |
*** rmcall has quit IRC | 03:55 | |
*** rmcall has joined #openstack-telemetry | 03:57 | |
*** thorst_afk has joined #openstack-telemetry | 04:21 | |
*** thorst_afk has quit IRC | 04:26 | |
*** yprokule has joined #openstack-telemetry | 04:49 | |
*** zhurong has quit IRC | 04:58 | |
*** zhurong has joined #openstack-telemetry | 05:06 | |
*** rcernin has joined #openstack-telemetry | 05:10 | |
*** thorst_afk has joined #openstack-telemetry | 05:22 | |
*** thorst_afk has quit IRC | 05:26 | |
*** flg_ has quit IRC | 05:27 | |
*** rcernin has quit IRC | 05:27 | |
*** edmondsw has joined #openstack-telemetry | 05:28 | |
*** edmondsw has quit IRC | 05:32 | |
*** lhx__ has quit IRC | 05:49 | |
*** lhx__ has joined #openstack-telemetry | 05:50 | |
*** iranzo has joined #openstack-telemetry | 05:51 | |
*** rcernin has joined #openstack-telemetry | 06:12 | |
*** pcaruana has joined #openstack-telemetry | 06:21 | |
*** thorst_afk has joined #openstack-telemetry | 06:23 | |
*** thorst_afk has quit IRC | 06:27 | |
*** flg_ has joined #openstack-telemetry | 06:34 | |
*** gokhan has joined #openstack-telemetry | 07:10 | |
*** edmondsw has joined #openstack-telemetry | 07:16 | |
*** tesseract has joined #openstack-telemetry | 07:20 | |
*** edmondsw has quit IRC | 07:20 | |
*** thorst_afk has joined #openstack-telemetry | 07:24 | |
*** gokhan has quit IRC | 07:26 | |
*** thorst_afk has quit IRC | 07:28 | |
*** alexchadin has joined #openstack-telemetry | 07:31 | |
*** tesseract-RH has joined #openstack-telemetry | 07:49 | |
*** tesseract-RH has quit IRC | 07:50 | |
*** tesseract-RH has joined #openstack-telemetry | 07:50 | |
*** tesseract has quit IRC | 07:52 | |
*** tovin07_ has joined #openstack-telemetry | 07:59 | |
*** tesseract-RH has quit IRC | 08:01 | |
*** tesseract-RH has joined #openstack-telemetry | 08:03 | |
*** lhx__ has quit IRC | 08:18 | |
*** lhx__ has joined #openstack-telemetry | 08:18 | |
*** thorst_afk has joined #openstack-telemetry | 08:25 | |
*** thorst_afk has quit IRC | 08:29 | |
*** rmcall has quit IRC | 08:34 | |
*** psachin has joined #openstack-telemetry | 08:36 | |
*** alexchadin has quit IRC | 08:53 | |
*** alexchadin has joined #openstack-telemetry | 08:54 | |
*** dikonoo has joined #openstack-telemetry | 08:58 | |
*** flg_ has quit IRC | 08:59 | |
*** dikonoor has quit IRC | 09:01 | |
*** edmondsw has joined #openstack-telemetry | 09:04 | |
*** edmondsw has quit IRC | 09:09 | |
*** tesseract-RH has quit IRC | 09:18 | |
*** tesseract has joined #openstack-telemetry | 09:23 | |
*** thorst_afk has joined #openstack-telemetry | 09:25 | |
*** thorst_afk has quit IRC | 09:30 | |
*** psachin has quit IRC | 09:31 | |
*** iranzo has quit IRC | 09:44 | |
*** iranzo1 has joined #openstack-telemetry | 09:44 | |
*** iranzo1 has quit IRC | 09:47 | |
*** iranzo has joined #openstack-telemetry | 09:49 | |
*** iranzo has quit IRC | 09:49 | |
*** iranzo has joined #openstack-telemetry | 09:49 | |
*** alexchadin has quit IRC | 09:49 | |
*** alexchadin has joined #openstack-telemetry | 09:54 | |
*** flg_ has joined #openstack-telemetry | 10:07 | |
*** tovin07_ has quit IRC | 10:10 | |
*** alexchadin has quit IRC | 10:16 | |
*** thorst_afk has joined #openstack-telemetry | 10:26 | |
*** thorst_afk has quit IRC | 10:31 | |
*** dixiaoli has quit IRC | 10:51 | |
*** flg_ has quit IRC | 10:51 | |
*** edmondsw has joined #openstack-telemetry | 10:52 | |
*** edmondsw has quit IRC | 10:57 | |
*** flg_ has joined #openstack-telemetry | 11:09 | |
*** thorst_afk has joined #openstack-telemetry | 11:27 | |
*** alexchadin has joined #openstack-telemetry | 11:31 | |
*** thorst_afk has quit IRC | 11:32 | |
*** alexchadin has quit IRC | 11:36 | |
*** alexchadin has joined #openstack-telemetry | 11:37 | |
*** edmondsw has joined #openstack-telemetry | 11:50 | |
openstackgerrit | sumitjami proposed openstack/ceilometer master: Using threading executor for messaging listener, https://review.openstack.org/497219 | 12:03 |
---|---|---|
openstackgerrit | sumitjami proposed openstack/ceilometer master: Using threading executor for messaging listener, https://review.openstack.org/497219 | 12:04 |
*** thorst_afk has joined #openstack-telemetry | 12:16 | |
*** lhx__ has quit IRC | 12:48 | |
*** alexchadin has quit IRC | 12:52 | |
*** alexchadin has joined #openstack-telemetry | 12:53 | |
*** catintheroof has joined #openstack-telemetry | 13:02 | |
*** jmlowe_ has quit IRC | 13:33 | |
*** dave-mccowan has joined #openstack-telemetry | 13:34 | |
*** edmondsw has quit IRC | 13:40 | |
*** leitan has joined #openstack-telemetry | 13:44 | |
*** links has quit IRC | 13:46 | |
*** edmondsw has joined #openstack-telemetry | 13:56 | |
*** jmlowe has joined #openstack-telemetry | 14:12 | |
jmlowe | I think I'm having a problem with the gnocchi publisher keeping up | 14:16 |
jmlowe | I upgraded to ocata, switched from the notifier publisher to gnocchi and direct/panko | 14:16 |
jmlowe | I upgraded to ocata, switched from the notifier publisher to gnocchi and direct/panko and my rabbit queues like this one ceilometer-pipe-meter_source:meter_sink-4.sample are growing without bound | 14:17 |
jmlowe | has anybody encountered similar behavior? | 14:18 |
*** yprokule has quit IRC | 14:21 | |
*** alexchadin has quit IRC | 14:46 | |
*** dikonoo has quit IRC | 14:55 | |
jmlowe | ok, well, it's not great, but I think I have a workaround, it seems that the gnocchi publisher just gives up on error and stops servicing the rabbit queue, going back to notifier and using the collector gnocchi dispatcher seems to be clearing my queues | 15:25 |
jd_ | hi jmlowe | 15:28 |
jmlowe | Hey Julian | 15:29 |
jmlowe | any thoughts on my problem? | 15:30 |
jd_ | jmlowe: did you disable the notifier publisher? | 15:30 |
jd_ | if you don't it's gonna push things to Rabbit and since there's no collector running it will grow FOOOORRREEEVEEEER | 15:30 |
jmlowe | I did, went with gnocchi:// in the pipeline and direct://?dispatcher=panko in the event_pipeline | 15:31 |
jmlowe | I'd watch the consumers on the queue drop off over time | 15:31 |
jmlowe | they'd stay alive on the 0 message queues | 15:31 |
jmlowe | once I flipped back to nofifier:// and fired up the collector again the consumer count stayed stable at 1 per queue and they drained | 15:34 |
jmlowe | with the gnocchi:// publisher it would drain some on restart but I couldn't keep at least one consumer on every queue, the active queues would all loose their consumers eventually | 15:35 |
jmlowe | my gnocchi dates back to the 1.0 days, so it's not surprising that it's a big rough around the edges | 15:36 |
jmlowe | currently running 3.1.9 | 15:36 |
*** vint_bra has joined #openstack-telemetry | 15:48 | |
*** iranzo has quit IRC | 15:51 | |
*** vint_bra has quit IRC | 15:52 | |
*** leitan has quit IRC | 15:53 | |
*** rcernin has quit IRC | 15:54 | |
*** pcaruana has quit IRC | 15:57 | |
*** tesseract has quit IRC | 16:03 | |
*** openstackgerrit has quit IRC | 16:04 | |
*** leitan has joined #openstack-telemetry | 16:04 | |
*** links has joined #openstack-telemetry | 16:06 | |
*** vint_bra has joined #openstack-telemetry | 16:20 | |
*** dewanee has joined #openstack-telemetry | 16:34 | |
*** links has quit IRC | 16:38 | |
*** efoley has joined #openstack-telemetry | 16:44 | |
*** psachin has joined #openstack-telemetry | 16:51 | |
*** efoley has quit IRC | 16:54 | |
*** vint_bra has quit IRC | 16:55 | |
*** rcernin has joined #openstack-telemetry | 17:27 | |
*** catinthe_ has joined #openstack-telemetry | 17:44 | |
*** catintheroof has quit IRC | 17:45 | |
*** dixiaoli has joined #openstack-telemetry | 18:22 | |
*** dixiaoli has quit IRC | 18:26 | |
*** rmcall has joined #openstack-telemetry | 18:58 | |
*** masber has quit IRC | 19:00 | |
*** spilla has joined #openstack-telemetry | 19:13 | |
*** psachin has quit IRC | 19:57 | |
*** psachin has joined #openstack-telemetry | 19:59 | |
*** jmlowe has quit IRC | 20:09 | |
*** jmlowe has joined #openstack-telemetry | 20:13 | |
*** thorst_afk has quit IRC | 20:16 | |
*** thorst_afk has joined #openstack-telemetry | 20:19 | |
*** thorst_afk has quit IRC | 20:24 | |
*** jmlowe has quit IRC | 20:32 | |
*** psachin has quit IRC | 20:36 | |
*** thorst_afk has joined #openstack-telemetry | 20:36 | |
*** jmlowe has joined #openstack-telemetry | 20:41 | |
*** edmondsw has quit IRC | 20:43 | |
*** catinthe_ has quit IRC | 20:53 | |
*** catintheroof has joined #openstack-telemetry | 20:54 | |
*** jmlowe has quit IRC | 20:54 | |
*** catintheroof has quit IRC | 20:58 | |
*** rmcall has quit IRC | 21:07 | |
*** rcernin has quit IRC | 21:19 | |
*** dave-mccowan has quit IRC | 21:20 | |
*** flg_ has quit IRC | 21:30 | |
*** edmondsw has joined #openstack-telemetry | 21:49 | |
*** edmondsw has quit IRC | 21:54 | |
*** spilla has quit IRC | 21:54 | |
*** catintheroof has joined #openstack-telemetry | 21:59 | |
*** leitan has quit IRC | 22:02 | |
*** leitan has joined #openstack-telemetry | 22:02 | |
*** leitan has quit IRC | 22:02 | |
*** leitan has joined #openstack-telemetry | 22:02 | |
*** leitan has quit IRC | 22:03 | |
*** edmondsw has joined #openstack-telemetry | 22:52 | |
*** catintheroof has quit IRC | 23:46 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!