*** mrunge has quit IRC | 01:33 | |
*** mrunge has joined #openstack-telemetry | 01:39 | |
*** mrunge has quit IRC | 01:46 | |
*** mrunge has joined #openstack-telemetry | 01:48 | |
*** threestrands has joined #openstack-telemetry | 02:13 | |
*** openstackgerrit has joined #openstack-telemetry | 03:30 | |
openstackgerrit | Merged openstack/aodh master: heat notifier: Fix getting unhealthy resource names https://review.opendev.org/687523 | 03:30 |
---|---|---|
*** psachin has joined #openstack-telemetry | 03:34 | |
openstackgerrit | Lingxian Kong proposed openstack/aodh stable/train: heat notifier: Fix getting unhealthy resource names https://review.opendev.org/687771 | 03:37 |
*** dave-mccowan has quit IRC | 04:51 | |
*** mbindlish has joined #openstack-telemetry | 05:05 | |
*** pcaruana has joined #openstack-telemetry | 05:07 | |
*** pcaruana has quit IRC | 05:35 | |
*** threestrands has quit IRC | 06:36 | |
*** threestrands has joined #openstack-telemetry | 06:36 | |
*** threestrands has quit IRC | 06:41 | |
*** soumplis has joined #openstack-telemetry | 06:43 | |
*** pcaruana has joined #openstack-telemetry | 06:51 | |
*** tesseract has joined #openstack-telemetry | 06:59 | |
*** rcernin has quit IRC | 07:07 | |
openstackgerrit | pengyuesheng proposed openstack/telemetry-tempest-plugin master: Sync Sphinx requirement https://review.opendev.org/687803 | 07:09 |
*** witek has joined #openstack-telemetry | 08:05 | |
*** arxcruz|rover is now known as arxcruz | 08:11 | |
*** witek has quit IRC | 08:42 | |
*** witek has joined #openstack-telemetry | 09:29 | |
*** witek has quit IRC | 10:13 | |
openstackgerrit | Rafael Weingärtner proposed openstack/ceilometer master: Create dynamic pollster feature https://review.opendev.org/677031 | 11:18 |
*** witek has joined #openstack-telemetry | 12:01 | |
openstackgerrit | Rafael Weingärtner proposed openstack/ceilometer master: Create dynamic pollster feature https://review.opendev.org/677031 | 12:39 |
openstackgerrit | jun923.gu proposed openstack/ceilometer master: Add hardware.ipmi.power metric collected https://review.opendev.org/687885 | 12:51 |
*** psachin has quit IRC | 13:15 | |
*** dave-mccowan has joined #openstack-telemetry | 13:43 | |
*** spsurya has joined #openstack-telemetry | 13:57 | |
*** adriant has quit IRC | 14:29 | |
*** adriant has joined #openstack-telemetry | 14:31 | |
*** pcaruana has quit IRC | 14:39 | |
*** dave-mccowan has quit IRC | 14:41 | |
*** jmlowe has quit IRC | 14:45 | |
*** jmlowe has joined #openstack-telemetry | 15:01 | |
*** pcaruana has joined #openstack-telemetry | 15:01 | |
joadavis | mbindlish: sorry for my slow response, its a strange week at work. It could be another configuration issue. I'll see if I can dig up a reference | 15:17 |
mbindlish | Thanks joadavis !! | 15:19 |
*** jmlowe has quit IRC | 15:26 | |
*** pcaruana has quit IRC | 15:26 | |
*** witek has quit IRC | 15:36 | |
joadavis | My first step would be to check your logs for any other errors, especially about being unable to connect to endpoints. | 15:39 |
*** dave-mccowan has joined #openstack-telemetry | 15:40 | |
joadavis | you can also check if monasca is getting any metrics with 'monasca metric-list'. I often then 'monasca metric-list | grep ceilometer -A 5 -B 7' to see if any of the metrics came from datasource: ceilometer | 15:40 |
joadavis | Then I'd check configuration files. Do you have a /etc/ceilometer/pipeline.yaml that specifies a publishers: -monasca:// url ? | 15:41 |
joadavis | FWIW, there are some Troubleshooting notes on https://wiki.openstack.org/wiki/Ceilosca | 15:46 |
*** witek has joined #openstack-telemetry | 15:56 | |
joadavis | (which could use some beefing up) | 15:57 |
mbindlish | monasca is getting metrics from monasca metric-list but there is no metrics from datasource: ceilometer | 15:58 |
mbindlish | Yes pipeline.yaml has publisher for monasca | 15:59 |
joadavis | Which metrics are configured to publish to that monasca sink? On my devstack I only have image.size, snapshot.size and volume.size configured | 16:07 |
mbindlish | What I have found | 16:07 |
mbindlish | File "/opt/stack/ceilometer/ceilometer/opts.py", line 113, in | 16:07 |
mbindlish | Oct 10 07:44:40 dev-queen-ceilosca ceilometer-agent-notification[31592]: ('rgw_client', ceilometer.objectstore.rgw.CLIENT_OPTS), | 16:07 |
mbindlish | Oct 10 07:44:40 dev-queen-ceilosca ceilometer-agent-notification[31592]: AttributeError: 'module' object has no attribute 'CLIENT_OPTS' | 16:07 |
mbindlish | ceilometer services are failing and ceilometer notification is expecting "CLIENT_OPTS' which was introduce from rocky but when I see the branch of ceilometer, it is showing stable/queens | 16:07 |
joadavis | that is odd. and ceilosca should not have any interaction with RGW | 16:08 |
*** witek has quit IRC | 16:09 | |
mbindlish | @joadavis yes image.size, snapshot.size and volume.size are configured on my devstack too. I am expecting image.size becomes visible in monasca metric-list. Also I created instance for image.size but still not get any metrics from ceilometer | 16:09 |
joadavis | yes, my pipeline.yaml is just the default from https://opendev.org/openstack/monasca-ceilometer/src/branch/master/etc/ceilometer/ceilosca-devstack_pipeline.yaml | 16:10 |
joadavis | oh, hmm. maybe then the rocky version of monasca-ceilometer isn't as compatible with the queens version of Ceilometer as I thought | 16:12 |
joadavis | honestly, the team I was on at the time skipped from Pike to Rocky, so there wasn't any testing on Queens for Ceilosca | 16:13 |
joadavis | typically we have tried to be backward compatible, but there must have been a change (the Rados gateway client) that changed in between versions that didn't get accounted for | 16:14 |
mbindlish | seems like that, actually ceilometer services are not running after devstack successfull installation...reason as I mentioned above as traceback | 16:15 |
joadavis | yeah, I should have mentioned to check that Ceilometer was running as a first step. :P | 16:15 |
joadavis | so you have a few options. Do you really need to run on the Queens release? | 16:16 |
mbindlish | yes, actually we have to run on queens | 16:16 |
mbindlish | Is there any way to proceed on it? | 16:17 |
joadavis | you could probably just hack the file and comment out that line, though I don't know what else you would need to hack | 16:17 |
mbindlish | I have tried that, after then got another error | 16:18 |
mbindlish | https://www.irccloud.com/pastebin/BM7FJyRs/ | 16:18 |
joadavis | I can take a quick look at the diff between mon-ceil in Pike and Rocky and compare to ceil Queens. I don't have a ton of time, but can give it a try | 16:19 |
mbindlish | yeah sure joadavis, I will also try to debug | 16:20 |
mbindlish | thanks joadavis for your help !! | 16:21 |
joadavis | Well, the good news is that when the monasca publisher commit is merged to Ceilometer this will be simpler in the U+ releases. | 16:22 |
mbindlish | joadavis: yes it is really good, i have seen your patch | 16:25 |
joadavis | I have to give witek credit for incorporating some feedback to make it better | 16:26 |
mbindlish | yeah witek work is prominent and appreciable | 16:28 |
*** jmlowe has joined #openstack-telemetry | 16:35 | |
*** pcaruana has joined #openstack-telemetry | 16:40 | |
joadavis | just to set expectations, I probably won't have anything useful to update until tomorrow earliest | 17:00 |
*** joadavis has quit IRC | 17:42 | |
*** joadavis has joined #openstack-telemetry | 17:53 | |
*** jmlowe has quit IRC | 18:22 | |
*** mbindlish has quit IRC | 19:01 | |
*** jmlowe has joined #openstack-telemetry | 19:03 | |
*** pcaruana has quit IRC | 20:15 | |
*** spsurya has quit IRC | 20:28 | |
openstackgerrit | Lingxian Kong proposed openstack/ceilometer master: Create dynamic pollster feature https://review.opendev.org/677031 | 20:48 |
*** tesseract has quit IRC | 20:53 | |
*** ryn_eq has quit IRC | 21:44 | |
*** ryn_eq has joined #openstack-telemetry | 21:55 | |
*** jbadiapa has quit IRC | 22:02 | |
*** rcernin has joined #openstack-telemetry | 22:46 | |
openstackgerrit | Lingxian Kong proposed openstack/ceilometer master: Create dynamic pollster feature https://review.opendev.org/677031 | 23:28 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!