| openstackgerrit | caoyuan proposed openstack/cloudkitty master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/654962 | 06:14 |
|---|---|---|
| zigo | peschk_l: Around? | 06:52 |
| peschk_l | zigo: o/ | 07:27 |
| zigo | peschk_l: Hi there! | 07:38 |
| peschk_l | hi! | 07:38 |
| zigo | peschk_l: I saw that cloudkitty in Stein has *removed* the storage_gnocchi backend? | 07:38 |
| zigo | Why that?!? | 07:38 |
| peschk_l | zigo: yes. As mentionned in the release notes, it was only for testing purposes. It was slow and unsuitable for production | 07:39 |
| openstackgerrit | Justin Ferrieu proposed openstack/cloudkitty master: Add Fetcher documentation https://review.opendev.org/655345 | 07:39 |
| zigo | I'm seriously considering to switch to another solution then, as using influxdb which is open-core, and *very* expensive for clustering, is not an option, IMO... :/ | 07:40 |
| peschk_l | zigo: another v2 storage backend is planned | 07:40 |
| peschk_l | zigo: btw if you have a proposal concerning what backend we should support, please tell us. What has been retained for now is elasticsearch, since they are supporting metrics/timeseries more and more | 07:41 |
| *** awestin1 has quit IRC | 09:54 | |
| *** awestin1_ has joined #cloudkitty | 09:54 | |
| zigo | peschk_l: IMO, you shouldn't have just replaced gnocchi by influxdb, and should have left gnocchi for at least one more release. | 10:04 |
| zigo | I'm not sure what to suggest as a backend... | 10:04 |
| zigo | Graphite ? | 10:04 |
| *** Emine has joined #cloudkitty | 11:44 | |
| openstackgerrit | Justin Ferrieu proposed openstack/cloudkitty master: Add Fetcher documentation https://review.opendev.org/655345 | 12:34 |
| *** irclogbot_0 has quit IRC | 12:55 | |
| *** irclogbot_0 has joined #cloudkitty | 12:55 | |
| *** altlogbot_3 has quit IRC | 12:57 | |
| *** altlogbot_3 has joined #cloudkitty | 12:57 | |
| zigo | peschk_l: If I understand well, I can still use cloudkitty/storage/v1/hybrid/backends/gnocchi.py, right? | 13:16 |
| zigo | How do I do that? What do I put in the config file? | 13:17 |
| zigo | The full of the class path ? | 13:17 |
| peschk_l | zigo: I'd rather use te sqlalchemy storage | 13:17 |
| zigo | peschk_l: How? | 13:17 |
| peschk_l | under [storage], specify version=1 and backend=sqlalchemy | 13:18 |
| zigo | Ok, thanks. | 13:18 |
| * zigo tries | 13:18 | |
| peschk_l | you'll have to run cloudkitty-storage-init and cloudkitty-dbsync upgrade afterwards | 13:18 |
| zigo | peschk_l: Normally, puppet does that for me. | 13:18 |
| zigo | :) | 13:18 |
| zigo | But I'll try by hand first. | 13:18 |
| zigo | peschk_l: Ok, now what can I do to get the metrics in? | 13:22 |
| zigo | I normally have ceilometer and gnocchi all setup, but probably it's wrong ... | 13:23 |
| zigo | There was this doc about setting-up rating of resources ... | 13:27 |
| peschk_l | zigo: ponce you rating rules are defined, you just need to start the processor | 13:35 |
| zigo | peschk_l: Normally, "cloudkitty report tenant list" should return a list of tenants, no? | 13:35 |
| peschk_l | zigo: if there is some data in the storage backend, yes | 13:36 |
| peschk_l | the tenants are retrieved from the already rated data | 13:36 |
| zigo | peschk_l: Where's the doc where it's explained how to setup rules? | 13:36 |
| zigo | I can't find it anymore ... :/ | 13:36 |
| peschk_l | zigp: this ? https://docs.openstack.org/cloudkitty/latest/user/rating/index.html | 13:37 |
| zigo | Ah thanks ! :) | 13:38 |
| peschk_l | see "More details" section for hashmap-specific documentation :) | 13:38 |
| zigo | peschk_l: Ok, now I got the hashmap set as per the example for rating a flavor, now how can I check it's working? | 14:02 |
| zigo | cloudkitty summary get <--- Always returns zero for the Rate... | 14:02 |
| peschk_l | zigo: enable the module, start the processor, wait a bit, and try to execute "cloudkitty summary get -a -g tenant_id" | 14:03 |
| zigo | peschk_l: The processor has always been started, should I restart it? | 14:03 |
| zigo | It's started on 3 nodes with zookeeper as backend for coordination... | 14:04 |
| peschk_l | zigo: you can, it may be waiting | 14:05 |
| peschk_l | zigo, other question: what scope fetcher are you using ? The default one ? | 14:05 |
| zigo | peschk_l: I'm not sure, probably yes... | 14:06 |
| zigo | You mean the keystone fetcher? | 14:06 |
| zigo | Yeah ... | 14:06 |
| peschk_l | zigo: okay, if you're using the keystone fetcher, you'll have to grant cloudkitty the "rating" role on tenants you want to rate | 14:06 |
| zigo | Oh yeah, forgot about this... | 14:07 |
| zigo | peschk_l: Done ... | 14:08 |
| peschk_l | okay, now you can restart the processors | 14:08 |
| zigo | I did. | 14:09 |
| zigo | I've turned off the other 2 ... | 14:09 |
| zigo | Only one now. | 14:09 |
| zigo | peschk_l: "cloudkitty summary get -a -g 1528887518294fc58226929d558de662" <--- Still zero Rate ... | 14:09 |
| zigo | I'm not even sure I got the metrics from Ceilometer ... | 14:10 |
| zigo | How can I check for this? | 14:10 |
| peschk_l | zigo: please check the processor logs | 14:11 |
| zigo | peschk_l: No more than this: http://paste.openstack.org/show/749706/ | 14:12 |
| peschk_l | zigo: that's weird, it looks like no tenants have been found by the keystone fetcher. You can try to use the gnocchi fetcher, which does tenant discovery based on what it can find in gnocchi | 14:14 |
| peschk_l | if you want to use it, specify 'backend=gnocchi' in the "[fetcher]" section and "auth_section=YOUR_AUTH_SECTION" under "[fetcher_gnocchi]" | 14:14 |
| zigo | Hum... | 14:19 |
| zigo | I'm getting SSL errors ... | 14:19 |
| zigo | peschk_l: What should I expect to see in the processor's log when it succeeds fetching the tenant list ? | 14:19 |
| peschk_l | zigo: "tenants loaded for fetcher gnocchi" | 14:20 |
| zigo | peschk_l: Well, with keystone, it DID show "Tenants loaded for fetcher keystone" | 14:21 |
| zigo | With gnocchi, I'm getting weirdo SSL verification issues. | 14:21 |
| zigo | keystoneauth1.exceptions.discovery.DiscoveryFailure: Could not find versioned identity endpoints when attempting to authenticate. Please check that your auth_url is correct. SSL exception connecting to https://z-api.infomaniak.ch:443/identity: HTTPSConnectionPool(host='z-api.infomaniak.ch', port=443): Max retries exceeded with url: /identity (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', ' | 14:21 |
| zigo | certificate verify failed')])"))) | 14:21 |
| zigo | Even though I've set the cafile = ... | 14:22 |
| peschk_l | zigo: argh, that's because of how keystoneauth handles ca certs. If you use a custom ca, add "cafile = PATH_OF_CA" to the "fetcher_gnocchi" section | 14:22 |
| peschk_l | zigo: cafile from the auth section aren't taken into account by keystoneauth | 14:22 |
| zigo | peschk_l: Looks like it doesn't have it by default ... :/ | 14:22 |
| peschk_l | zigo: can I see your cloudkitty.conf file ? | 14:23 |
| zigo | Now I get "Tenants loaded for fetcher gnocchi" | 14:24 |
| zigo | :) | 14:24 |
| zigo | Still nothing in the Rate. | 14:25 |
| zigo | peschk_l: http://paste.openstack.org/show/749707/ <--- That's my cloudkitty.conf | 14:28 |
| zigo | That's actual real passwords, but I don't really care, that's my PoC, and it's nated multiple times. | 14:28 |
| zigo | I'll destroy it once I get the puppet working as expected for cloudkitty. | 14:28 |
| peschk_l | zigo: ah good! could you have a look at the "rated_data_frames table" in cloudkitty's SQL database ? | 14:29 |
| zigo | peschk_l: It's empty... | 14:30 |
| zigo | As I wrote, I'm not even sure if Ceilometer is working as expected ... | 14:30 |
| peschk_l | hmm, so no tenats fetched here either. Does gnocchi resource list return something ? | 14:30 |
| zigo | peschk_l: Nop ... :/ | 14:31 |
| zigo | Empty result. | 14:31 |
| peschk_l | okay, so it's a telemetry issue then. Is there anything in the ceilometer logs about being unable to publish data ? | 14:31 |
| zigo | Let me investigate that ... | 14:32 |
| zigo | Hum... full of errors... | 14:32 |
| zigo | peschk_l: I guess I'll get back to you when I've fixed all of these ... :P | 14:33 |
| zigo | Thanks so much so far ! :) | 14:33 |
| peschk_l | zigo: all right! | 14:33 |
| zigo | Hopefully, OCI will get it right ... :) | 14:33 |
| peschk_l | zigo: you're welcome :) | 14:33 |
| zigo | peschk_l: How come I'm getting this on the controller? ceilometer.polling.manager ImportError: python-libvirt module is missing | 14:33 |
| zigo | peschk_l: Does Ceilometer need python3-libvirt on the controller nodes? | 14:34 |
| peschk_l | zigo: I dont belive so, on controllers the polling agent should be ran with --polling-namespace central | 14:34 |
| peschk_l | and with --polling-namespace compute on teh compute nodes | 14:34 |
| peschk_l | what ceiloemter services are running on your ccontroller nodes ? | 14:35 |
| *** lemko has joined #cloudkitty | 15:00 | |
| lemko | Hey, I'm having problem after installing cloudkitty with this configuration : http://paste.openstack.org/show/749710/ | 15:42 |
| lemko | Version is queens and I'm getting the following error : "Unauthorized: The request you have made requires authentication." in cloudkitty processor logs | 15:42 |
| lemko | Package is from here : http://ppa.launchpad.net/objectif-libre/cloudkitty-queens/ubuntu | 15:46 |
| *** altlogbot_3 has quit IRC | 16:09 | |
| *** altlogbot_2 has joined #cloudkitty | 16:11 | |
| *** altlogbot_2 has quit IRC | 16:43 | |
| *** altlogbot_2 has joined #cloudkitty | 16:43 | |
| *** altlogbot_2 has quit IRC | 16:53 | |
| *** altlogbot_3 has joined #cloudkitty | 16:53 | |
| *** openstackgerrit has quit IRC | 18:57 | |
| *** lemko has quit IRC | 20:19 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!