*** itlinux has joined #openstack-telemetry | 00:16 | |
*** edmondsw has quit IRC | 00:18 | |
*** caowei has joined #openstack-telemetry | 00:32 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 00:40 | |
*** links has joined #openstack-telemetry | 00:40 | |
*** AlexeyAbashkin has quit IRC | 00:44 | |
*** Tommy-Tom has joined #openstack-telemetry | 00:48 | |
*** chenyb4 has joined #openstack-telemetry | 00:50 | |
*** Tommy-Tom has quit IRC | 00:53 | |
*** itlinux has quit IRC | 01:19 | |
*** itlinux has joined #openstack-telemetry | 01:44 | |
*** edmondsw has joined #openstack-telemetry | 01:46 | |
*** edmondsw has quit IRC | 01:51 | |
*** itlinux has quit IRC | 02:10 | |
*** itlinux has joined #openstack-telemetry | 02:32 | |
*** sup92 has joined #openstack-telemetry | 02:32 | |
*** Tommy-Tom has joined #openstack-telemetry | 02:33 | |
sup92 | Hello, I am finding a weird Behavior in aodh where aodh alarm is getting triggered for a cpu_idle_alarm prematurely after the evaluation periods though cpu_util is high for half of the time during the evaluation period | 02:36 |
---|---|---|
sup92 | It would be great to get some inputs on this, if this is an expected behavior or a bug | 02:36 |
*** Tom-Tom has joined #openstack-telemetry | 02:40 | |
*** liusheng has quit IRC | 02:43 | |
*** liusheng has joined #openstack-telemetry | 02:43 | |
*** itlinux has quit IRC | 02:44 | |
*** Tom-Tom has quit IRC | 03:15 | |
*** r-daneel has joined #openstack-telemetry | 03:23 | |
*** gkadam has joined #openstack-telemetry | 03:24 | |
*** harlowja has quit IRC | 03:30 | |
*** Tommy-Tom has quit IRC | 03:34 | |
*** Tommy-Tom has joined #openstack-telemetry | 03:34 | |
*** edmondsw has joined #openstack-telemetry | 03:34 | |
sup92 | dug more into this, and it looks like when aodh is in insufficient data state and evaluation period is done, it doesn't check for consecutive samples being below threshold value and directly moves to alarm based on the last sample | 03:36 |
*** Tommy-Tom has quit IRC | 03:39 | |
*** caowei has quit IRC | 03:39 | |
*** edmondsw has quit IRC | 03:39 | |
*** Tom-Tom has joined #openstack-telemetry | 03:46 | |
*** links has quit IRC | 03:50 | |
*** Tom-Tom has quit IRC | 03:50 | |
*** sup92 has quit IRC | 03:57 | |
*** links has joined #openstack-telemetry | 04:07 | |
*** Tommy-Tom has joined #openstack-telemetry | 04:08 | |
*** Tommy-Tom has quit IRC | 04:09 | |
*** dave-mccowan has quit IRC | 04:10 | |
*** harlowja has joined #openstack-telemetry | 04:12 | |
*** gkadam_ has joined #openstack-telemetry | 04:13 | |
*** gkadam_ has quit IRC | 04:14 | |
*** gkadam_ has joined #openstack-telemetry | 04:14 | |
*** gkadam has quit IRC | 04:15 | |
*** Tom-Tom has joined #openstack-telemetry | 04:29 | |
*** harlowja has quit IRC | 04:30 | |
*** Tom-Tom has quit IRC | 04:45 | |
*** chenyb4 has quit IRC | 04:55 | |
*** chenyb4 has joined #openstack-telemetry | 05:03 | |
*** psachin` has joined #openstack-telemetry | 05:04 | |
*** psachin has joined #openstack-telemetry | 05:04 | |
*** vish_18 has joined #openstack-telemetry | 05:10 | |
*** Tom-Tom has joined #openstack-telemetry | 05:12 | |
*** harlowja has joined #openstack-telemetry | 05:14 | |
vish_18 | How can I enable the logs of aodh?? | 05:15 |
vish_18 | I am viewing the logs through sudo journalctl -f -u devstack@aodh* | 05:15 |
vish_18 | But very less are coming | 05:15 |
vish_18 | kindly help | 05:15 |
larsks | vish_18: there are more folks around here during us/europe business hours. I don't have aodh running right now otherwise I would take a look. | 05:16 |
vish_18 | larsks: thank you | 05:16 |
*** Tom-Tom has quit IRC | 05:17 | |
*** Tom-Tom has joined #openstack-telemetry | 05:20 | |
*** Tom-Tom has quit IRC | 05:21 | |
*** Tom-Tom has joined #openstack-telemetry | 05:21 | |
*** Tommy-Tom has joined #openstack-telemetry | 05:40 | |
*** psachin has quit IRC | 05:45 | |
*** psachin` has quit IRC | 05:45 | |
*** psachin has joined #openstack-telemetry | 05:52 | |
*** psachin has quit IRC | 06:20 | |
*** masber has joined #openstack-telemetry | 06:22 | |
*** harlowja has quit IRC | 06:24 | |
*** psachin has joined #openstack-telemetry | 06:28 | |
*** Tommy-Tom has quit IRC | 06:36 | |
*** Tommy-Tom has joined #openstack-telemetry | 06:42 | |
*** Tommy-Tom has quit IRC | 07:01 | |
*** Tommy-Tom has joined #openstack-telemetry | 07:02 | |
*** Tommy-Tom has quit IRC | 07:06 | |
*** edmondsw has joined #openstack-telemetry | 07:11 | |
*** yprokule has joined #openstack-telemetry | 07:14 | |
*** edmondsw has quit IRC | 07:15 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 07:16 | |
*** alexchadin has joined #openstack-telemetry | 07:17 | |
*** AlexeyAbashkin has quit IRC | 07:21 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 07:26 | |
*** Tommy-Tom has joined #openstack-telemetry | 07:30 | |
*** chenyb4 has quit IRC | 07:35 | |
*** pcaruana has joined #openstack-telemetry | 07:56 | |
*** Tom-Tom has quit IRC | 08:04 | |
*** masber has quit IRC | 08:05 | |
*** Tommy-Tom has quit IRC | 08:10 | |
*** Tommy-Tom has joined #openstack-telemetry | 08:11 | |
*** Tommy-Tom has quit IRC | 08:15 | |
*** amoralej|off is now known as amoralej | 08:20 | |
*** tesseract has joined #openstack-telemetry | 08:28 | |
*** rcernin has quit IRC | 08:33 | |
*** gkadam__ has joined #openstack-telemetry | 08:50 | |
*** gkadam_ has quit IRC | 08:53 | |
*** links has quit IRC | 08:53 | |
*** joadavis has joined #openstack-telemetry | 08:55 | |
*** Tommy-Tom has joined #openstack-telemetry | 08:57 | |
*** lionel has joined #openstack-telemetry | 09:04 | |
*** links has joined #openstack-telemetry | 09:06 | |
*** Tom-Tom has joined #openstack-telemetry | 09:28 | |
*** alexchadin has quit IRC | 09:56 | |
*** alexchadin has joined #openstack-telemetry | 09:57 | |
*** Tommy-Tom has quit IRC | 09:59 | |
*** Tommy-Tom has joined #openstack-telemetry | 10:00 | |
*** shardy has joined #openstack-telemetry | 10:02 | |
*** Tommy-Tom has quit IRC | 10:04 | |
*** Tom-Tom has quit IRC | 10:04 | |
*** pcaruana has quit IRC | 10:05 | |
*** pcaruana has joined #openstack-telemetry | 10:20 | |
*** edmondsw has joined #openstack-telemetry | 10:47 | |
*** edmondsw has quit IRC | 10:52 | |
vish_18 | Hi all.. | 11:04 |
*** Tommy-Tom has joined #openstack-telemetry | 11:04 | |
vish_18 | I am trying to create a alarm using | 11:04 |
vish_18 | aodh alarm create --name cpu_hi --type gnocchi_resources_threshold --description 'instance running hot' --metric cpu_util --threshold -10 --comparison-operator gt --aggregation-method mean --granularity 600 --evaluation-periods 3 --alarm-action log:// --resource-id 8009d866-25c0-414c-b5e9-2c7d62de9c44 --resource-type instance | 11:04 |
vish_18 | the above command | 11:05 |
*** AlexeyAbashkin has quit IRC | 11:05 | |
vish_18 | Everytime its state is insufficientdata | 11:05 |
vish_18 | Is there anything wrong?? KIndly help | 11:05 |
*** Tommy-Tom has quit IRC | 11:12 | |
*** pcaruana has quit IRC | 11:30 | |
*** alexchadin has quit IRC | 11:38 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 11:38 | |
*** pcaruana has joined #openstack-telemetry | 11:42 | |
*** Tommy-Tom has joined #openstack-telemetry | 11:43 | |
*** alexchadin has joined #openstack-telemetry | 11:47 | |
openstackgerrit | Chandan Kumar proposed openstack/ceilometer stable/pike: Use stable/4.0 branch for gnocchi https://review.openstack.org/544254 | 11:47 |
*** Tommy-Tom has quit IRC | 11:48 | |
*** Tommy-Tom has joined #openstack-telemetry | 11:52 | |
*** dave-mccowan has joined #openstack-telemetry | 11:56 | |
*** Tommy-Tom has quit IRC | 11:57 | |
*** gkadam has joined #openstack-telemetry | 12:17 | |
*** gkadam__ has quit IRC | 12:19 | |
*** Tommy-Tom has joined #openstack-telemetry | 12:29 | |
*** Tommy-Tom has quit IRC | 12:34 | |
*** edmondsw has joined #openstack-telemetry | 12:36 | |
*** gkadam has quit IRC | 12:38 | |
*** edmondsw has quit IRC | 12:40 | |
*** Tommy-Tom has joined #openstack-telemetry | 12:49 | |
*** edmondsw has joined #openstack-telemetry | 12:50 | |
*** r-daneel has quit IRC | 12:54 | |
*** Tommy-Tom has quit IRC | 12:54 | |
*** pradk has joined #openstack-telemetry | 12:56 | |
*** weshay_PTO is now known as weshay | 13:01 | |
*** r-daneel has joined #openstack-telemetry | 13:04 | |
openstackgerrit | Chandan Kumar proposed openstack/ceilometer stable/pike: Fix gnocchi/heat support in telemetry integration tests https://review.openstack.org/544254 | 13:12 |
*** Tommy-Tom has joined #openstack-telemetry | 13:26 | |
*** amoralej is now known as amoralej|lunch | 13:30 | |
*** Tommy-Tom has quit IRC | 13:31 | |
*** pradk has quit IRC | 13:36 | |
openstackgerrit | OpenStack Release Bot proposed openstack/aodh master: Update reno for stable/queens https://review.openstack.org/544307 | 13:40 |
openstackgerrit | OpenStack Release Bot proposed openstack/panko master: Update reno for stable/queens https://review.openstack.org/544335 | 13:44 |
*** Tommy-Tom has joined #openstack-telemetry | 13:44 | |
*** gordc has joined #openstack-telemetry | 13:47 | |
*** alexchadin has quit IRC | 14:08 | |
*** alexchadin has joined #openstack-telemetry | 14:08 | |
*** alexchadin has quit IRC | 14:08 | |
*** alexchadin has joined #openstack-telemetry | 14:09 | |
*** alexchadin has quit IRC | 14:09 | |
*** alexchadin has joined #openstack-telemetry | 14:10 | |
*** alexchadin has quit IRC | 14:10 | |
*** alexchadin has joined #openstack-telemetry | 14:11 | |
*** r-daneel has quit IRC | 14:11 | |
*** alexchadin has quit IRC | 14:11 | |
*** alexchadin has joined #openstack-telemetry | 14:11 | |
*** alexchadin has quit IRC | 14:12 | |
*** alexchadin has joined #openstack-telemetry | 14:12 | |
*** alexchadin has quit IRC | 14:12 | |
*** damch has quit IRC | 14:16 | |
*** alexchadin has joined #openstack-telemetry | 14:22 | |
*** Tommy-Tom has quit IRC | 14:24 | |
*** alexchadin has quit IRC | 14:26 | |
*** r-daneel has joined #openstack-telemetry | 14:29 | |
*** amoralej|lunch is now known as amoralej | 14:31 | |
*** links has quit IRC | 14:33 | |
*** jobewan has joined #openstack-telemetry | 14:53 | |
*** alexchadin has joined #openstack-telemetry | 15:00 | |
*** alexchadin has quit IRC | 15:03 | |
-openstackstatus- NOTICE: Due to a race in stable/queens branch creation and some job removals, Zuul has reported syntax errors for the past hour; if you saw a syntax error reported for "Job tripleo-ci-centos-7-ovb-containers-oooq not defined" you can safely recheck now | 15:05 | |
*** gkadam has joined #openstack-telemetry | 15:12 | |
*** r-daneel has quit IRC | 15:14 | |
*** AlexeyAbashkin has quit IRC | 15:17 | |
*** r-daneel has joined #openstack-telemetry | 15:22 | |
*** alexchadin has joined #openstack-telemetry | 15:30 | |
*** links has joined #openstack-telemetry | 15:40 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 15:42 | |
*** itlinux has joined #openstack-telemetry | 15:50 | |
*** gkadam_ has joined #openstack-telemetry | 15:52 | |
*** aagate has joined #openstack-telemetry | 15:53 | |
*** gordc has quit IRC | 15:59 | |
*** alexchadin has quit IRC | 16:02 | |
*** gkadam has quit IRC | 16:04 | |
*** gordc has joined #openstack-telemetry | 16:08 | |
*** pcaruana has quit IRC | 16:13 | |
*** psachin has quit IRC | 16:29 | |
*** alexchadin has joined #openstack-telemetry | 16:40 | |
*** itlinux has quit IRC | 16:41 | |
gordc | me too. | 16:43 |
*** alexchadin has quit IRC | 16:44 | |
*** ayoung has joined #openstack-telemetry | 16:49 | |
larsks | I am only seeing image, instance, and instance_network_interface resources in gnocchi. What do I need to configure to get e.g. volume resources? And the host_* metrics, etc? | 16:51 |
*** itlinux has joined #openstack-telemetry | 16:51 | |
jd_ | larsks: you need to enable them in Ceilometer polling config | 16:52 |
jd_ | unless you mean you don't see those resource types either in Gnocchi | 16:52 |
larsks | jd_: no, I see the resource *types*. Just not the metrics. They need to be enabled in the polling config on the controllers? | 16:53 |
jd_ | larsks: yup | 16:55 |
jd_ | if you don't enable them you won't see them | 16:56 |
larsks | jd_: okay. Is that the "polling.yaml" file? | 16:57 |
jd_ | larsks: yes | 16:57 |
larsks | jd_: Great. And what's the easiest way to see a list of potential metrics that could be configured in that file? | 16:57 |
jd_ | larsks: the doc has a list or you can use "*" | 16:58 |
jd_ | if you want to enable all | 16:58 |
larsks | Thanks. Which doc? I'm looking through https://docs.openstack.org/ceilometer/pike/admin/telemetry-data-collection.html#polling right now... | 16:59 |
gordc | https://docs.openstack.org/ceilometer/latest/admin/telemetry-measurements.html | 16:59 |
larsks | gordc: awesome, thank you. | 16:59 |
larsks | gordc: can I use wildcards? Like, can I ask for "volume.*"? | 17:01 |
gordc | the host metrics require snmp installed and then you need to add the host as a resource in your polling.yaml | 17:01 |
gordc | or if you have tripleo deployed, it can be discovered (but still need snmp on the hosts) | 17:02 |
gordc | yep wildcards works. | 17:02 |
larsks | Great. | 17:02 |
*** AlexeyAbashkin has quit IRC | 17:07 | |
*** AlexeyAbashkin has joined #openstack-telemetry | 17:15 | |
*** alexchadin has joined #openstack-telemetry | 17:16 | |
*** pcaruana has joined #openstack-telemetry | 17:17 | |
*** AlexeyAbashkin has quit IRC | 17:20 | |
*** links has quit IRC | 17:21 | |
larsks | gordc: so...I've modified polling.yaml (and restarted ceilometer-polling), but I still don't see the volume resources. Does Cinder need any configuration? I see that oslo_messaging_notifications/driver is "cinder.openstack.common.notifier.rpc_notifier", which is not what the docs call for. Should that be *replaced*? And are all the metrics provided via the cinder-volume-usage-audit command (that | 17:33 |
larsks | is, is it necessary for that cron job to be in place to see any volume.* metrics)? | 17:33 |
gordc | i need to check what volume.* metrics we have | 17:34 |
gordc | ok. they're all notifications. i think the install guide specifies what you need to do in cinder to get them | 17:37 |
larsks | Right, that's what I was asking about. | 17:38 |
larsks | In particular, the install guide says that oslo_messaging_notifications/driver should be "messagingv2". In the config I'm looking at, its "cinder.openstack.common.notifier.rpc_notifier". Should that be replaced? Are they equivalent? Docs don't say. | 17:39 |
larsks | The docs also say to run the cinder-volume-usage-audit command for "periodic usage statistics relating to block storage". Does that mean *any* metrics? Can I get volume.size without that? | 17:39 |
gordc | yeah i guess you need a cron job. although i'm pretty sure cinder will send them itself because i don't recall our gate configuring cron job and we definitely get the volume.provider.* metrics | 17:39 |
gordc | it's probably same. rpc_notifier stuff is just legacy option | 17:40 |
larsks | I'll try updating that. Even with manually running the usage-audit command a few times, I'm still not seeing any volume resources in gnocchi. | 17:40 |
gordc | iirc, the rpc_notifier code was removed years ago. whether the backward capability stuff still exists i'd need to dig into | 17:41 |
gordc | but yeah, still with the oslo_messaging_notifications/driver option | 17:42 |
*** jmlowe has quit IRC | 17:46 | |
openstackgerrit | Merged openstack/ceilometer master: ignore compute.instance.update for metrics https://review.openstack.org/533687 | 17:47 |
larsks | Hmm, still no volume resources. | 17:49 |
*** jmlowe has joined #openstack-telemetry | 17:49 | |
larsks | Oh, wait! | 17:49 |
*** alexchadin has quit IRC | 17:50 | |
larsks | Interesting, there are some visible to admin. But I was expecting the volumes I created to show up when authenticated as me (instances work that way). | 17:50 |
gordc | hmm.. the capacity metrics i recall don't have a user/project_id since cinder doesn't give us those details | 17:50 |
gordc | in that case, they're probably only visible to the admin | 17:51 |
larsks | I see. That was surprising, but I think that in fact things are looking okay. | 17:51 |
gordc | do you see the *.size metric? | 17:51 |
larsks | gordc: looks like it, yes. | 17:53 |
larsks | Sorry, took me a moment to remember the 'openstack metric measures show ...' command line. | 17:53 |
gordc | :) | 17:53 |
*** jmlowe has quit IRC | 18:00 | |
*** yprokule has quit IRC | 18:04 | |
*** hoonetorg has quit IRC | 18:05 | |
*** hoonetorg has joined #openstack-telemetry | 18:22 | |
*** aagate has quit IRC | 18:23 | |
*** pradk has joined #openstack-telemetry | 18:24 | |
*** psachin has joined #openstack-telemetry | 18:26 | |
*** jmlowe has joined #openstack-telemetry | 18:26 | |
*** alexchadin has joined #openstack-telemetry | 18:32 | |
*** openstackgerrit has quit IRC | 18:33 | |
*** alexchadin has quit IRC | 18:36 | |
*** shardy has quit IRC | 18:38 | |
*** tesseract has quit IRC | 18:54 | |
*** alexchadin has joined #openstack-telemetry | 19:07 | |
*** harlowja has joined #openstack-telemetry | 19:21 | |
*** aagate has joined #openstack-telemetry | 19:21 | |
*** openstackgerrit has joined #openstack-telemetry | 19:25 | |
openstackgerrit | Chandan Kumar proposed openstack/ceilometer stable/pike: Fix gnocchi/heat support in telemetry integration tests https://review.openstack.org/544254 | 19:25 |
*** rwsu has quit IRC | 19:28 | |
*** rwsu has joined #openstack-telemetry | 19:29 | |
*** alexchadin has quit IRC | 19:39 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/pike: Fix gnocchi/heat support in telemetry integration tests https://review.openstack.org/544254 | 19:53 |
*** Tommy-Tom has joined #openstack-telemetry | 20:00 | |
*** Tommy-Tom has quit IRC | 20:05 | |
*** amoralej is now known as amoralej|off | 20:07 | |
*** alexchadin has joined #openstack-telemetry | 20:21 | |
*** alexchadin has quit IRC | 20:25 | |
*** psachin has quit IRC | 21:12 | |
*** pcaruana has quit IRC | 21:28 | |
*** rcernin has joined #openstack-telemetry | 22:00 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/pike: Fix gnocchi/heat support in telemetry integration tests https://review.openstack.org/544254 | 22:09 |
*** dave-mccowan has quit IRC | 22:20 | |
*** threestrands has joined #openstack-telemetry | 22:31 | |
*** itlinux has quit IRC | 22:53 | |
*** pradk has quit IRC | 22:59 | |
*** edmondsw has quit IRC | 23:12 | |
openstackgerrit | gordon chung proposed openstack/ceilometer stable/ocata: Use Zuul 3 native tox jobs https://review.openstack.org/543108 | 23:13 |
*** gordc has quit IRC | 23:40 | |
*** larsks has quit IRC | 23:51 | |
*** de_Varf has quit IRC | 23:54 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!