| *** thorst_ has joined #openstack-telemetry | 00:00 | |
| *** thorst_ has quit IRC | 00:09 | |
| *** ljxiash has joined #openstack-telemetry | 00:42 | |
| *** thorst_ has joined #openstack-telemetry | 00:42 | |
| *** ljxiash has quit IRC | 00:46 | |
| openstackgerrit | Merged openstack/aodh: Catch DriverLoadFailure + Correct concurrency of gabbi >1.22.0 + remove most oslo.context usage + remove dependency on sphinxcontrib-docbookrestapi https://review.openstack.org/330929 | 00:48 |
|---|---|---|
| openstackgerrit | Merged openstack/aodh: Fix and improve the partition coordinator https://review.openstack.org/326573 | 01:01 |
| *** thorst_ has quit IRC | 01:18 | |
| *** thorst_ has joined #openstack-telemetry | 01:19 | |
| *** khushbu has quit IRC | 01:21 | |
| *** thorst_ has quit IRC | 01:28 | |
| *** ljxiash has joined #openstack-telemetry | 01:51 | |
| openstackgerrit | Ren Qiaowei proposed openstack/ceilometer: add l3 cache usage meter https://review.openstack.org/325638 | 02:06 |
| openstackgerrit | Ren Qiaowei proposed openstack/ceilometer: add l3 cache usage meter https://review.openstack.org/325638 | 02:16 |
| *** thorst_ has joined #openstack-telemetry | 02:26 | |
| *** thorst_ has quit IRC | 02:33 | |
| *** ljxiash has quit IRC | 03:09 | |
| *** ljxiash has joined #openstack-telemetry | 03:09 | |
| *** ljxiash has quit IRC | 03:14 | |
| *** khushbu has joined #openstack-telemetry | 03:22 | |
| *** julim has joined #openstack-telemetry | 03:23 | |
| openstackgerrit | Shaoman Zhang proposed openstack/ceilometer: In Ceilometer Installing Manually charpter, Enabling Service Notifications section, lack Neutron modify description, add the following content for neutron.conf: [oslo_messaging_notifications] driver=messagingv2 https://review.openstack.org/331924 | 03:25 |
| *** dave-mccowan has quit IRC | 03:32 | |
| *** dave-mccowan has joined #openstack-telemetry | 03:32 | |
| *** thorst_ has joined #openstack-telemetry | 03:32 | |
| *** julim has quit IRC | 03:33 | |
| *** dave-mccowan has quit IRC | 03:36 | |
| *** thorst_ has quit IRC | 03:37 | |
| *** sheel has joined #openstack-telemetry | 03:40 | |
| *** links has joined #openstack-telemetry | 04:17 | |
| *** khushbu has quit IRC | 04:21 | |
| *** _nadya_ has joined #openstack-telemetry | 04:21 | |
| *** thorst_ has joined #openstack-telemetry | 04:34 | |
| *** thorst_ has quit IRC | 04:42 | |
| *** _nadya_ has quit IRC | 04:48 | |
| *** khushbu has joined #openstack-telemetry | 04:48 | |
| *** _nadya_ has joined #openstack-telemetry | 04:52 | |
| *** _nadya_ has quit IRC | 04:57 | |
| *** cllewellyn__ has joined #openstack-telemetry | 04:58 | |
| *** achatterjee has joined #openstack-telemetry | 05:02 | |
| *** ljxiash has joined #openstack-telemetry | 05:16 | |
| *** jwcroppe has joined #openstack-telemetry | 05:28 | |
| *** thorst_ has joined #openstack-telemetry | 05:40 | |
| *** thorst_ has quit IRC | 05:47 | |
| *** _nadya_ has joined #openstack-telemetry | 05:53 | |
| *** rcernin has joined #openstack-telemetry | 05:56 | |
| *** khushbu has quit IRC | 05:57 | |
| *** khushbu_ has joined #openstack-telemetry | 05:57 | |
| *** _nadya_ has quit IRC | 05:58 | |
| *** _nadya_ has joined #openstack-telemetry | 06:03 | |
| *** yprokule has joined #openstack-telemetry | 06:06 | |
| *** athinkingmeat has joined #openstack-telemetry | 06:28 | |
| *** rwsu_ is now known as rwsu | 06:32 | |
| *** liamji has joined #openstack-telemetry | 06:32 | |
| *** rwsu has quit IRC | 06:40 | |
| *** jmccarthy has joined #openstack-telemetry | 06:42 | |
| *** thorst_ has joined #openstack-telemetry | 06:45 | |
| openstackgerrit | Merged openstack/aodh: doc: remove leftover from docbookrestapi https://review.openstack.org/331226 | 06:45 |
| *** rwsu has joined #openstack-telemetry | 06:51 | |
| *** agireud has quit IRC | 06:51 | |
| *** thorst_ has quit IRC | 06:52 | |
| *** pcaruana has joined #openstack-telemetry | 06:52 | |
| *** _nadya_ has quit IRC | 06:54 | |
| openstackgerrit | Shaoman Zhang proposed openstack/ceilometer: Add install description for Neutron https://review.openstack.org/331924 | 06:54 |
| *** agireud has joined #openstack-telemetry | 06:55 | |
| *** jwcroppe has quit IRC | 06:57 | |
| *** jwcroppe has joined #openstack-telemetry | 07:00 | |
| *** belmoreira has joined #openstack-telemetry | 07:04 | |
| *** larainema has quit IRC | 07:13 | |
| *** Kevin_Zheng has quit IRC | 07:13 | |
| *** cllewellyn__ has quit IRC | 07:22 | |
| *** cllewellyn__ has joined #openstack-telemetry | 07:26 | |
| *** chlong|rhce_trng has quit IRC | 07:27 | |
| *** khushbu_ has quit IRC | 07:33 | |
| *** khushbu__ has joined #openstack-telemetry | 07:33 | |
| *** cllewellyn__ has quit IRC | 07:42 | |
| *** cllewellyn__ has joined #openstack-telemetry | 07:42 | |
| *** cllewellyn__ has quit IRC | 07:43 | |
| *** cllewellyn__ has joined #openstack-telemetry | 07:44 | |
| *** thorst_ has joined #openstack-telemetry | 07:50 | |
| *** khushbu__ has quit IRC | 07:51 | |
| *** khushbu has joined #openstack-telemetry | 07:51 | |
| *** khushbu_ has joined #openstack-telemetry | 07:56 | |
| *** khushbu has quit IRC | 07:56 | |
| *** _nadya_ has joined #openstack-telemetry | 07:56 | |
| *** thorst_ has quit IRC | 07:57 | |
| *** _nadya__ has joined #openstack-telemetry | 08:00 | |
| *** _nadya_ has quit IRC | 08:01 | |
| *** khushbu_ has quit IRC | 08:02 | |
| *** shardy has joined #openstack-telemetry | 08:05 | |
| *** khushbu_ has joined #openstack-telemetry | 08:08 | |
| *** agireud has quit IRC | 08:19 | |
| *** agireud has joined #openstack-telemetry | 08:28 | |
| *** larainema has joined #openstack-telemetry | 08:29 | |
| *** shardy has quit IRC | 08:32 | |
| *** khushbu_ has quit IRC | 08:32 | |
| *** Kevin_Zheng has joined #openstack-telemetry | 08:33 | |
| *** jmccarthy has left #openstack-telemetry | 08:35 | |
| openstackgerrit | liusheng proposed openstack/ceilometer: Add 'task_state' attribute to meter metadata https://review.openstack.org/332010 | 08:37 |
| *** yassine__ has joined #openstack-telemetry | 08:46 | |
| *** permalac__ has quit IRC | 08:47 | |
| openstackgerrit | liusheng proposed openstack/ceilometer: Add 'task_state' attribute to meter metadata https://review.openstack.org/332010 | 08:48 |
| *** permalac has joined #openstack-telemetry | 08:50 | |
| openstackgerrit | liusheng proposed openstack/aodh: Fixing ordering of 'severity' in alarms https://review.openstack.org/328230 | 09:11 |
| openstackgerrit | liusheng proposed openstack/aodh: Correct the order when sorting by "severity" https://review.openstack.org/330936 | 09:13 |
| *** openstackgerrit has quit IRC | 09:18 | |
| *** openstackgerrit has joined #openstack-telemetry | 09:19 | |
| *** cdent has joined #openstack-telemetry | 09:20 | |
| openstackgerrit | liusheng proposed openstack/ceilometer: Switch to use glanceclient to get image https://review.openstack.org/331500 | 09:26 |
| *** cdent has quit IRC | 09:36 | |
| *** LanceHaig has left #openstack-telemetry | 10:08 | |
| therve | jd__, https://review.openstack.org/#/c/327641/ seems stuck for some reasons, can you try reapprove again? | 10:10 |
| *** marcin1234 has quit IRC | 10:22 | |
| *** Kevin_Zheng has quit IRC | 10:43 | |
| *** chlong|rhce_trng has joined #openstack-telemetry | 10:49 | |
| *** yassine__ has quit IRC | 10:55 | |
| *** tomoiaga has joined #openstack-telemetry | 10:56 | |
| tomoiaga | for some reason, gnocchi does not set the ended_at property (in the indexer) for none of the instances I delete. Has anyone seen this ? | 10:58 |
| *** achatterjee has quit IRC | 11:12 | |
| *** sheel has quit IRC | 11:15 | |
| *** ljxiash has quit IRC | 11:30 | |
| *** ljxiash has joined #openstack-telemetry | 11:31 | |
| *** links has quit IRC | 11:35 | |
| *** ljxiash has quit IRC | 11:36 | |
| *** links has joined #openstack-telemetry | 11:47 | |
| *** yassine__ has joined #openstack-telemetry | 12:01 | |
| *** shardy has joined #openstack-telemetry | 12:04 | |
| *** shardy has quit IRC | 12:04 | |
| *** dave-mccowan has joined #openstack-telemetry | 12:11 | |
| *** pradk has joined #openstack-telemetry | 12:18 | |
| *** gordc has joined #openstack-telemetry | 12:22 | |
| *** peristeri has joined #openstack-telemetry | 12:27 | |
| *** links has quit IRC | 12:33 | |
| *** liamji has quit IRC | 12:42 | |
| *** links has joined #openstack-telemetry | 12:46 | |
| jd__ | tomoiaga: this is not implemented yet, there's a patch to do that | 12:47 |
| jd__ | therve: it's marked as merged | 12:48 |
| tomoiaga | jd__: ok, thank you! I'll look for the patch | 12:55 |
| jd__ | tomoiaga: if you willing to test it that'd be cool | 12:55 |
| jd__ | https://review.openstack.org/#/c/217017/ | 12:56 |
| tomoiaga | jd__: I'll have a look and test it. I have my own implementation of resources and events handling and I would like for some time now to fully switch to Gnocchi but I couldn't because of different missing parts in it :) | 12:58 |
| jd__ | tomoiaga: that sounds cool, feel free to help us indeed | 13:00 |
| jd__ | we'll help you too ;) | 13:00 |
| tomoiaga | jd__: you're always helpful, thank you! | 13:01 |
| *** yassine__ has quit IRC | 13:08 | |
| *** yassine__ has joined #openstack-telemetry | 13:08 | |
| *** ljxiash has joined #openstack-telemetry | 13:11 | |
| *** links has quit IRC | 13:23 | |
| therve | jd__, Where? | 13:23 |
| EmilienM | jd__: hey | 13:26 |
| EmilienM | jd__: I'm testing recent Aodh with tempest/master and tests are failing | 13:26 |
| EmilienM | I got 503 from Aodh API | 13:27 |
| EmilienM | http://logs.openstack.org/91/328591/23/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/b1f8192/console.html#_2016-06-21_09_03_15_017365 | 13:27 |
| EmilienM | does it sound familiar? | 13:27 |
| EmilienM | jd__: if you look at aodh logs, you'll see 2016-06-21 09:02:38.951 23433 CRITICAL keystonemiddleware.auth_token [-] Unable to validate token: Unable to establish connection to https://127.0.0.1:35357 | 13:28 |
| EmilienM | but we use ipv6 | 13:29 |
| EmilienM | so something in aodh is defaulting to 127.0.0.1 since recently | 13:29 |
| EmilienM | http://logs.openstack.org/91/328591/23/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/b1f8192/logs/aodh/app.txt.gz#_2016-06-21_09_02_38_951 | 13:29 |
| therve | Oopsi | 13:29 |
| therve | EmilienM, Probably https://review.openstack.org/328268 | 13:30 |
| EmilienM | our configuration is http://logs.openstack.org/91/328591/23/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/b1f8192/logs/etc/aodh/aodh.conf.txt.gz | 13:30 |
| EmilienM | therve: I don't think so | 13:31 |
| *** yprokule has quit IRC | 13:31 | |
| EmilienM | therve: I tried with a delorean URL from before this patch | 13:31 |
| EmilienM | it was same thing | 13:31 |
| EmilienM | your patch is ok | 13:31 |
| *** yprokule has joined #openstack-telemetry | 13:32 | |
| *** BigWillie has joined #openstack-telemetry | 13:34 | |
| therve | EmilienM, Looking at that conf, the service_credentials section looks incorrect | 13:35 |
| EmilienM | therve: right, I'm doing https://review.openstack.org/#/c/328806/ | 13:35 |
| therve | os_* stuff are not conf values, that I know | 13:35 |
| EmilienM | brb | 13:36 |
| therve | Hum so you should have a different file, no? | 13:36 |
| openstackgerrit | Merged openstack/ceilometer: Fix concurrency issue with snmp pollsters https://review.openstack.org/311057 | 13:37 |
| EmilienM | even if our conf is not correct, it's weird that it suddenly breaks | 13:41 |
| EmilienM | without warning or something | 13:41 |
| EmilienM | therve: different file for what? | 13:41 |
| therve | EmilienM, Different config file | 13:41 |
| therve | http://logs.openstack.org/06/328806/4/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/88c3a86/logs/etc/aodh/aodh.conf.txt.gz looks more correct | 13:41 |
| therve | And it fails in a different way | 13:41 |
| EmilienM | therve: yes this is the config after my patch on puppet-aodh | 13:42 |
| EmilienM | I need to continue this work | 13:42 |
| EmilienM | I'll see why it fails | 13:42 |
| therve | http://logs.openstack.org/06/328806/4/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/88c3a86/logs/apache/aodh_wsgi_error_ssl.txt.gz FWIW | 13:43 |
| therve | But auth_url is there which doesn't make sense | 13:44 |
| therve | Unless it's the section with auth_uri but urg | 13:44 |
| EmilienM | therve: I'll look how aodh gate configure aodh and use the same | 13:48 |
| *** openstackgerrit has quit IRC | 13:48 | |
| EmilienM | therve: thx for your help | 13:48 |
| *** openstackgerrit has joined #openstack-telemetry | 13:49 | |
| therve | Np | 13:50 |
| *** jkraj has joined #openstack-telemetry | 13:51 | |
| *** ametts has joined #openstack-telemetry | 13:55 | |
| *** rbak has joined #openstack-telemetry | 13:56 | |
| *** thumpba has joined #openstack-telemetry | 14:09 | |
| *** dewanee_ has joined #openstack-telemetry | 14:16 | |
| *** jkraj has quit IRC | 14:24 | |
| *** donghao has joined #openstack-telemetry | 14:32 | |
| *** yprokule has quit IRC | 14:35 | |
| *** yprokule has joined #openstack-telemetry | 14:36 | |
| *** ljxiash_ has joined #openstack-telemetry | 14:37 | |
| *** liamji has joined #openstack-telemetry | 14:38 | |
| *** ljxiash has quit IRC | 14:38 | |
| *** tomoiaga has quit IRC | 14:56 | |
| *** donghao has quit IRC | 14:57 | |
| *** julim has joined #openstack-telemetry | 15:00 | |
| EmilienM | therve: for service credentials, do you see something wrong in https://review.openstack.org/#/c/328806/4/manifests/auth.pp ? | 15:18 |
| *** shardy has joined #openstack-telemetry | 15:25 | |
| *** belmoreira has quit IRC | 15:29 | |
| *** pcaruana has quit IRC | 15:35 | |
| *** sheeprine_ has joined #openstack-telemetry | 15:42 | |
| *** sheeprine_ has quit IRC | 15:49 | |
| *** sheeprine_ has joined #openstack-telemetry | 15:50 | |
| *** sheeprine_ has quit IRC | 15:50 | |
| *** sheeprine_ has joined #openstack-telemetry | 15:51 | |
| *** sheeprine_ has joined #openstack-telemetry | 15:51 | |
| *** khushbu_ has joined #openstack-telemetry | 15:51 | |
| *** sheeprine_ has quit IRC | 15:51 | |
| *** sheeprine_ has joined #openstack-telemetry | 15:52 | |
| *** sheeprine_ has quit IRC | 15:59 | |
| *** sheeprine_ has joined #openstack-telemetry | 16:01 | |
| *** sheeprine_ has quit IRC | 16:01 | |
| *** sheeprine_ has joined #openstack-telemetry | 16:02 | |
| *** khushbu_ has quit IRC | 16:05 | |
| *** sheeprine_ has quit IRC | 16:05 | |
| *** sheeprine_ has joined #openstack-telemetry | 16:06 | |
| -openstackstatus- NOTICE: Gerrit is being restarted now to apply an emergency security-related configuration change | 16:06 | |
| *** _nadya__ has quit IRC | 16:10 | |
| *** sheeprine_ has quit IRC | 16:10 | |
| *** sheeprine_ has joined #openstack-telemetry | 16:10 | |
| *** sheeprine_ has quit IRC | 16:15 | |
| *** sheeprine_ has joined #openstack-telemetry | 16:15 | |
| *** yassine__ has quit IRC | 16:23 | |
| *** links has joined #openstack-telemetry | 16:31 | |
| *** shardy has quit IRC | 16:37 | |
| EmilienM | http://logs.openstack.org/91/328591/24/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/8ff3e29/logs/aodh/app.txt.gz#_2016-06-21_16_12_11_432 | 16:43 |
| EmilienM | therve: I still have that ^ | 16:43 |
| EmilienM | can you check config ? http://logs.openstack.org/91/328591/24/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/8ff3e29/logs/etc/aodh/aodh.conf.txt.gz | 16:44 |
| EmilienM | jd__: if you around too ^ | 16:44 |
| EmilienM | I can't deploy aodh from master | 16:44 |
| *** yprokule has quit IRC | 16:45 | |
| *** khushbu has joined #openstack-telemetry | 16:47 | |
| *** ljxiash_ has quit IRC | 16:51 | |
| *** catintheroof has joined #openstack-telemetry | 16:53 | |
| *** jwcroppe has quit IRC | 17:01 | |
| *** amoralej has joined #openstack-telemetry | 17:06 | |
| EmilienM | pradk: can you help on the aodh issue? | 17:10 |
| EmilienM | it's really blocking us to test latest OpenStack | 17:10 |
| EmilienM | amoralej: what kind of manual testing did you do? | 17:11 |
| amoralej | i installed aodh with packstack and when i try to do aodh list i get error because it tries to conect to https://127.0.0.1:35357 | 17:12 |
| amoralej | while i don't have https but http | 17:12 |
| amoralej | i've changed different configuration options manually | 17:12 |
| amoralej | but i get the same | 17:12 |
| amoralej | copying the one in the gate | 17:12 |
| EmilienM | right | 17:12 |
| EmilienM | something is hardcoding the auth_uri for us | 17:12 |
| amoralej | and it only works when i revert keystonemiddleware before https://github.com/openstack/keystonemiddleware/commit/f8c150a9cc9b407b2df87244daf3342177260e90 | 17:12 |
| EmilienM | gordc: do you have any idea? | 17:13 |
| amoralej | then, with the exact same configuration it works fine | 17:13 |
| amoralej | i guess it's the same issue you are finding EmilienM | 17:13 |
| *** leitan has joined #openstack-telemetry | 17:34 | |
| leitan | jd__, how are you, did you get any chance to check the vmware collector bug : https://bugs.launchpad.net/ceilometer/+bug/1593023 | 17:35 |
| openstack | Launchpad bug 1593023 in Ceilometer "vmware compute agent makes gnocchi dispatcher to stacktrace reading samples" [Undecided,New] | 17:35 |
| *** pcaruana has joined #openstack-telemetry | 17:40 | |
| *** liamji has quit IRC | 17:42 | |
| *** rcernin has quit IRC | 17:43 | |
| pradk | EmilienM, looking | 17:48 |
| amoralej | pradk, let me know if i can help you, i've reproduce the issue | 17:50 |
| pradk | EmilienM, hmm is this the same issue you had last week.. this error looks familiar | 17:50 |
| pradk | amoralej, cool, so you narrowed down the issue already? | 17:51 |
| amoralej | in my case, i get an error SSLError: SSL exception connecting to https://127.0.0.1:35357: [SSL: UNKNOWN_PROTOCOL] unknown protocol (_ssl.c:765) | 17:52 |
| amoralej | but i have configured http:/127.0.0.1:35357 | 17:53 |
| amoralej | not https | 17:53 |
| amoralej | i've checked that going to a previous version of keystonemiddleware it works fine | 17:53 |
| amoralej | in EmilienM case, it's trying to connect to https://127.0.0.1:35357 but he's using ipv6 | 17:55 |
| pradk | hmm the above error seems related to keystonemiddleware as well.. but there is not enough info to look | 17:55 |
| amoralej | so i guess it's a similar issue | 17:55 |
| pradk | the aodh.conf seems ok to me http://logs.openstack.org/91/328591/24/check/gate-puppet-openstack-integration-3-scenario001-tempest-centos-7/8ff3e29/logs/etc/aodh/aodh.conf.txt.gz | 17:55 |
| pradk | may be we need to pin down keystonemiddleware version | 17:56 |
| amoralej | pining versions is hard to maintain... | 17:58 |
| *** _nadya_ has joined #openstack-telemetry | 17:59 | |
| amoralej | i think other projects are working fine with current version of keystonemw, is aodh doing something differently with it? | 17:59 |
| pradk | hmm i'm not sure .. may be gordc ^^ ? | 18:06 |
| amoralej | i've reported it in https://bugs.launchpad.net/aodh/+bug/1594930 | 18:08 |
| openstack | Launchpad bug 1594930 in Aodh "aodh fails with keystonemiddleware after commit f8c150a9cc9b407b2df87244daf3342177260e90" [Undecided,New] | 18:08 |
| *** amoralej is now known as amoralej|off | 18:11 | |
| *** pcaruana has quit IRC | 18:22 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/ceilometer: Merge tag '6.1.0' https://review.openstack.org/332417 | 18:23 |
| *** thumpba has quit IRC | 18:25 | |
| *** jdandrea_ is now known as jdandrea | 18:27 | |
| *** thumpba has joined #openstack-telemetry | 18:27 | |
| EmilienM | amoralej|off: ack, thx | 18:34 |
| *** links has quit IRC | 18:36 | |
| *** jwcroppe has joined #openstack-telemetry | 18:41 | |
| *** r-mibu has quit IRC | 18:45 | |
| *** r-mibu has joined #openstack-telemetry | 18:45 | |
| therve | EmilienM, Did you change something? | 18:46 |
| therve | Your latest patch seems to pass | 18:46 |
| EmilienM | therve: my last patch does not test latest aod | 18:47 |
| EmilienM | aodh | 18:47 |
| therve | Ah, ok | 18:47 |
| EmilienM | https://review.openstack.org/#/c/328591/ does | 18:47 |
| EmilienM | gate-puppet-openstack-integration-3-scenario001-tempest-centos-7 is RED | 18:47 |
| therve | EmilienM, Is it possible that the configuration happens after the service is started? | 18:48 |
| therve | We've seen that issue with heat | 18:49 |
| EmilienM | therve: no | 18:51 |
| *** catintheroof has quit IRC | 18:51 | |
| *** catintheroof has joined #openstack-telemetry | 18:51 | |
| therve | Otherwise that conf looks ok | 18:51 |
| EmilienM | therve: https://github.com/openstack/puppet-aodh/blob/master/manifests/api.pp#L78 | 18:51 |
| EmilienM | we configure aodh before running httpd | 18:51 |
| EmilienM | (httpd for aodh-api) | 18:52 |
| therve | The service credentials section defines both auth_uri and auth_url, which is weird | 18:52 |
| EmilienM | what is required? | 18:52 |
| therve | auth_uri, I think? | 18:53 |
| *** nicodemus_ has joined #openstack-telemetry | 18:54 | |
| EmilienM | therve: could it block it? | 19:07 |
| therve | EmilienM, You mean could it fails because of that? | 19:08 |
| therve | Actually you need both auth_uri and auth_url for some reasons | 19:08 |
| therve | EmilienM, Could you try with auth_uri=https://[::1]:5000 ? | 19:12 |
| EmilienM | what do I have now? | 19:13 |
| therve | https://[::1]:35357 | 19:13 |
| EmilienM | therve: ok but current logs show something look for 127.0.0.1 | 19:14 |
| therve | Yeah that is a mistery :) | 19:16 |
| therve | FWIW I believe the value displayed is the default one | 19:17 |
| therve | Which would make sense if the config file wasn't used or something | 19:18 |
| *** _nadya_ has quit IRC | 19:19 | |
| *** cllewellyn__ has quit IRC | 19:20 | |
| *** cllewellyn__ has joined #openstack-telemetry | 19:24 | |
| jd__ | leitan: nop | 19:25 |
| *** permalac_ has joined #openstack-telemetry | 19:27 | |
| therve | EmilienM, OK yeah the issue is with keystonemiddleware master as mentioned above | 19:29 |
| catintheroof | jd__, leitan can we help you with something ? we have everything set here, or maybe point someone to help us get it to work ? | 19:30 |
| *** jwcroppe has quit IRC | 19:30 | |
| *** pradk has quit IRC | 19:30 | |
| EmilienM | therve: yes master | 19:30 |
| EmilienM | therve: not in latest tag | 19:30 |
| EmilienM | therve: we're on the edge ;) | 19:30 |
| *** permalac has quit IRC | 19:31 | |
| *** hoonetorg has quit IRC | 19:31 | |
| EmilienM | therve: try to checkout master and run aodh, it will fail too I think | 19:31 |
| therve | Yeah I just did | 19:31 |
| EmilienM | therve: and it works? :P | 19:31 |
| therve | No? :) | 19:31 |
| *** dave-mccowan has quit IRC | 19:36 | |
| *** _nadya_ has joined #openstack-telemetry | 19:38 | |
| *** dave-mccowan has joined #openstack-telemetry | 19:40 | |
| *** pradk has joined #openstack-telemetry | 19:43 | |
| *** hoonetorg has joined #openstack-telemetry | 19:43 | |
| *** jwcroppe has joined #openstack-telemetry | 19:44 | |
| *** dave-mccowan has quit IRC | 19:45 | |
| *** dave-mcc_ has joined #openstack-telemetry | 19:45 | |
| *** BigWillie has quit IRC | 19:45 | |
| jd__ | catintheroof: no idea, I don't think a lot of people are using vmware :( | 19:46 |
| *** marcin1234 has joined #openstack-telemetry | 19:53 | |
| marcin1234 | gordc: did you try to merry swift with file backedn for gnocchi? | 19:53 |
| catintheroof | jd__, what road should i approach ? because i've tried to debug and cant nail it should i see who made the lasts commits on vmware driver and try to contact them ? would that work ? | 19:55 |
| gordc | marcin1234: not swift. tried it with ceph but it'd be the same difference in IO change. | 19:55 |
| gordc | i'm just looking at the results right now. | 19:55 |
| jd__ | catintheroof: that's an idea if you can pinpoint to a particular change | 19:55 |
| gordc | the POSTs are much faster since i'm writing to ramdisk | 19:55 |
| gordc | trying to see how much gain we get from metricd. | 19:56 |
| gordc | it doesn't seem much at first glance (since majority of IO is to read/write aggregates) | 19:56 |
| *** jwcroppe has quit IRC | 19:56 | |
| therve | Ah that's a really stupid change | 19:57 |
| therve | default_config_files = [] != default_config_files = None | 19:57 |
| *** vint_bra has joined #openstack-telemetry | 19:58 | |
| catintheroof | jd__, i believe i cant, it might be ALL BROKEN, since i cant try to get it work with legacy ceilometer + mongo dispatcher. | 20:00 |
| *** _nadya_ has quit IRC | 20:01 | |
| therve | EmilienM, https://review.openstack.org/332459 | 20:02 |
| EmilienM | therve: w00t | 20:03 |
| EmilienM | therve: you tested it? | 20:04 |
| gordc | EmilienM: you don't trust? | 20:04 |
| EmilienM | lol | 20:04 |
| EmilienM | I trust therve, not gordc | 20:04 |
| gordc | good choice. | 20:04 |
| EmilienM | gordc: you found a place now? | 20:05 |
| gordc | where's your dog on computer meme | 20:05 |
| *** jwcroppe has joined #openstack-telemetry | 20:05 | |
| gordc | EmilienM: nope. | 20:05 |
| EmilienM | gordc: you in the street now? | 20:05 |
| therve | EmilienM, Yes, I tested it :) | 20:05 |
| gordc | EmilienM: i'm going to start making fake visits to 5 star apartments and pretend to be rich | 20:06 |
| EmilienM | therve: merci :) | 20:06 |
| gordc | and then i go sleep on street. | 20:06 |
| EmilienM | gordc: come in quebec, i have a couch | 20:06 |
| marcin1234 | gordc that is exciting let me know the results, | 20:07 |
| gordc | EmilienM: it's a nice couch | 20:08 |
| EmilienM | gordc: I can make you a good price | 20:08 |
| catintheroof | gordc, do you know someone that can help me go through this bug ? https://bugs.launchpad.net/ceilometer/+bug/1593023 | 20:09 |
| openstack | Launchpad bug 1593023 in Ceilometer "vmware compute agent makes gnocchi dispatcher to stacktrace reading samples" [Undecided,New] | 20:09 |
| vint_bra | Hi there :) Can anyone help me? I'm trying use ceilometer with gnocchi. My gnocchi use a Swift to store data. When I start the ceilometer-collector, I get this error "Object GET failed: https://swift/v1/AUTH_60fc5dcbb44c40ffb97e81e1d124fff8/gnocchi.69ebe138-7fd7-4254-963c-6abb127f49d5/std 404" | 20:10 |
| EmilienM | therve: how keystonemiddleware CI could not catch it? | 20:11 |
| therve | EmilienM, Probably because they don't test it? | 20:12 |
| EmilienM | therve: I mean, they run devstack jobs | 20:12 |
| EmilienM | therve: with other projects, i guess | 20:12 |
| therve | EmilienM, aodh is one of the rare project to not use the global cfg.CONF | 20:13 |
| therve | Which is the root of the issue | 20:13 |
| *** rcernin has joined #openstack-telemetry | 20:13 | |
| EmilienM | ah ok | 20:13 |
| gordc | marcin1234: might have something tomorrow. i'm sorta jumping between things right now | 20:17 |
| *** khushbu has quit IRC | 20:25 | |
| *** vint_bra has quit IRC | 20:37 | |
| gordc | catintheroof: are you using a customised version of ceilometer? | 20:42 |
| catintheroof | gordc, nope, flat mitaka | 20:43 |
| gordc | hmm.. if i were to guess, your gnocchi dispatcher is getting a string passed in as 'data', when it should be a list of dictionaries. | 20:47 |
| *** pradk has quit IRC | 20:51 | |
| *** nicodemus_ has quit IRC | 20:54 | |
| *** thumpba has quit IRC | 20:59 | |
| *** vint_bra has joined #openstack-telemetry | 21:09 | |
| *** cllewellyn__ has quit IRC | 21:32 | |
| *** khushbu_ has joined #openstack-telemetry | 21:34 | |
| *** rcernin has quit IRC | 21:41 | |
| *** chlong|rhce_trng has quit IRC | 21:48 | |
| *** catintheroof has quit IRC | 21:51 | |
| *** ametts has quit IRC | 21:54 | |
| *** KrishR has joined #openstack-telemetry | 22:01 | |
| *** vint_bra has quit IRC | 22:07 | |
| leitan | jd__, gordc we tested with catintheroof, and its worse, we grabbed a messaged that wasnt working on mitaka (collecting vmware stats) manually published it on our kilo/liberty ceilometer setup, and it worked like a charm, it seems that something is broken on mitaka related on what oslo.serialization specs and what we publish with ceilometer | 22:10 |
| leitan | im going to update the bug | 22:10 |
| leitan | cause its more heavy than just "vmware", we tested it backwards too, using a cinder message from our ceilometer deploy kilo/liberty manually posted on the mitaka deploy ... same error with oslo serialization on the mitaka cloud | 22:11 |
| gordc | leitan: is the paste in your bug report the message causing issue in collector? | 22:16 |
| leitan | gordc, the last part of the bug where says https://bugs.launchpad.net/ceilometer/+bug/1593023 | 22:17 |
| openstack | Launchpad bug 1593023 in Ceilometer "vmware compute agent makes gnocchi dispatcher to stacktrace reading samples" [Undecided,New] | 22:17 |
| leitan | gordc, payload ok but still stacktraces | 22:17 |
| leitan | that happens, with every message | 22:17 |
| leitan | kilo/libert/mitaka, trying to get parsed by a mitaka implementation | 22:17 |
| leitan | of ceilometer/gnocchi | 22:18 |
| leitan | when the collector try to deserialize it | 22:18 |
| leitan | stacks with ValueError: dictionary update sequence element #0 has length 1; 2 is required | 22:18 |
| leitan | same "broken" message , i manually post it on a working kilo/liberty deployment, and everything works as expected | 22:18 |
| leitan | maybe somethin missing on the mitaka publisher is causing this | 22:19 |
| gordc | leitan: i meant, in https://bugs.launchpad.net/ceilometer/+bug/1593023 there's a paste: http://paste.openstack.org/show/516413/ | 22:19 |
| openstack | Launchpad bug 1593023 in Ceilometer "vmware compute agent makes gnocchi dispatcher to stacktrace reading samples" [Undecided,New] | 22:19 |
| gordc | is that the broken message? | 22:19 |
| leitan | gordc, thats the message, it works on a kilo/liberty deploy but not on mitaka | 22:19 |
| gordc | because that message shouldn't actually be reaching collector. it should picked up by notification agent | 22:19 |
| gordc | ok. i see the problem | 22:21 |
| gordc | you have: metering_topic = notifications in your conf | 22:21 |
| gordc | so currently your collector and notification agent are fighting for topics on same queue | 22:21 |
| leitan | gordc, currently the only messages going on, on the mitaka cloud, are getting posted to notifications.sample | 22:22 |
| leitan | thats why notifications its on there | 22:22 |
| leitan | the issue is that, that message on a kilo/liberty deployment i manually publish it on the metering.sample queue | 22:22 |
| gordc | right. by default 'notifications' topic is what all the projcets use to communicate with each other. | 22:22 |
| leitan | and get processed ok | 22:22 |
| gordc | but ceilometer also uses queue internally. | 22:23 |
| gordc | metering_topic is the internal queue we use for ipc | 22:23 |
| gordc | so right not stuff that should be picked up by the notification agent is getting picked up by the collector | 22:23 |
| gordc | and it doesn't understand it. | 22:23 |
| leitan | if the only thing that im posting to the queue, its that messages | 22:24 |
| leitan | why the collect shouldnt understand them | 22:24 |
| leitan | and why is getting processed ok, on the kilo/liberty queue ? | 22:25 |
| gordc | the collector only understands messages from notification agent... that's what normalises messages from all the projects (including ceilometer) in format that can be stored. | 22:25 |
| leitan | ok, so the issue here is that im not running notification agent | 22:25 |
| leitan | on the mitaka cloud | 22:25 |
| leitan | it doesnt grab that guy | 22:26 |
| leitan | to "serialize it" | 22:26 |
| leitan | and then since the collector | 22:26 |
| leitan | is pointing to the same queue | 22:26 |
| leitan | is trying to treat the message itself | 22:26 |
| leitan | and of course, fails doing it | 22:26 |
| gordc | yep | 22:26 |
| gordc | i think in kilo or older, you could bypass the notificaiton agent... now it's not optional. | 22:27 |
| leitan | gordc, thats why then, cause in the other deploy, we have the same "setup" | 22:27 |
| leitan | all the guys are reading from that same queue | 22:27 |
| leitan | with no issues | 22:27 |
| leitan | gordc, ill try deploying notification agent, and splitting the queues | 22:29 |
| leitan | gordc, that should do it | 22:29 |
| gordc | kk. you probably don't need to define metering_topic option... unless you plan on sending data to multiple places | 22:30 |
| leitan | gordc, we only need to send it to gnocchi | 22:34 |
| leitan | gordc, but i guess the issue actually was that we dindt installed the notification agent, since we think that we are not going to need it just to collect the metrics from vwmare and post it to gnocchi | 22:35 |
| gordc | kk. you can probably just drop it then. but it doesn't really matter. just make sure it's not the same as the topic that every other project in OpenStack uses (default: notifications) | 22:35 |
| gordc | leitan: yeah. it's needed currently. we offloaded all the processing/normalisation to that service | 22:35 |
| leitan | gordc, it totally make sense now, totally | 22:36 |
| leitan | gordc, ill try that, and let you know tomorrow, and updating the bug | 22:36 |
| gordc | kk. apologies on the confusion. hope it helps | 22:36 |
| leitan | thanks gordc of course it helped ! | 22:37 |
| gordc | np | 22:37 |
| leitan | gordc, its working, now its trying to push to gnocchi parsed samples | 22:48 |
| leitan | gordc, thanks a lot !!! | 22:49 |
| gordc | np. good to hear! | 22:51 |
| *** leitan has quit IRC | 22:54 | |
| *** KrishR has quit IRC | 22:54 | |
| *** rbak has quit IRC | 22:57 | |
| *** jwcroppe has quit IRC | 22:57 | |
| *** khushbu_ has quit IRC | 22:59 | |
| *** chlong has joined #openstack-telemetry | 23:02 | |
| *** jwcroppe has joined #openstack-telemetry | 23:14 | |
| *** jwcroppe has quit IRC | 23:17 | |
| *** jwcroppe has joined #openstack-telemetry | 23:17 | |
| *** julim has quit IRC | 23:25 | |
| *** rbak has joined #openstack-telemetry | 23:28 | |
| *** rbak has quit IRC | 23:29 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!